GPU Under Pressure: Estimating Application's Stress via Telemetry and Performance Counters
By: Giuseppe Esposito , Juan-David Guerrero-Balaguera , Josie Esteban Rodriguez Condia and more
Potential Business Impact:
Measures computer chip strain to predict failures.
Graphics Processing Units (GPUs) are specialized accelerators in data centers and high-performance computing (HPC) systems, enabling the fast execution of compute-intensive applications, such as Convolutional Neural Networks (CNNs). However, sustained workloads can impose significant stress on GPU components, raising reliability concerns due to potential faults that corrupt the intermediate application computations, leading to incorrect results. Estimating the stress induced by an application is thus crucial to predict reliability (with\,special\,emphasis\,on\,aging\,effects). In this work, we combine online telemetry parameters and hardware performance counters to assess GPU stress induced by different applications. The experimental results indicate the stress induced by a parallel workload can be estimated by combining telemetry data and Performance Counters that reveal the efficiency in the resource usage of the target workload. For this purpose the selected performance counters focus on measuring the i) throughput, ii) amount of issued instructions and iii) stall events.
Similar Papers
Privacy-Preserving Performance Profiling of In-The-Wild GPUs
Hardware Architecture
Lets companies see how many computers are working well.
Host-Side Telemetry for Performance Diagnosis in Cloud and HPC GPU Infrastructure
Distributed, Parallel, and Cluster Computing
Finds computer slowdowns in seconds.
RTGPU: Real-Time Computing with Graphics Processing Units
Hardware Architecture
Makes computers do hard jobs on time.