Skip to main content
Version: Next

Real-time device usage endpoint

You can get the real-time device memory and core utilization by visiting {GPU node ip}:31992/metrics, or add it to a prometheus endpoint, as the command below:

curl {GPU node ip}:31992/metrics

It contains the following metrics:

MetricsDescriptionExample
hami_host_gpu_utilization_ratioGPU real-time utilization on host{device_index="0",device_uuid="GPU-00552014-5c87-89ac-b1a6-7b53aa24b0ec",zone="vGPU"} 0
hami_host_gpu_memory_used_bytesGPU real-time device memory usage on host{device_index="0",device_uuid="GPU-00552014-5c87-89ac-b1a6-7b53aa24b0ec",zone="vGPU"} 2.87244288e+08
CNCFHAMi is a CNCF Sandbox project