NVIDIA当“No running processes found”时,为什么我的CUDA GPU-Util~70%?——开启Persistence
发布日期:2021-06-20 07:26:09 浏览次数:32 分类:技术文章

本文共 4168 字,大约阅读时间需要 13 分钟。

问题:

在配置了2个Tesla K80卡的系统之后,我注意到在运行时nvidia-smi4个GPU中的一个处于高负荷状态,尽管“没有找到正在运行的进程”。为什么会发生这种情况,我该如何纠正?

以下是来自的输出nvidia-smi

➜  compute-0-1: ~/> nvidia-smiMon Sep 26 14:48:00 2016       +-----------------------------------------------------------------------------+| NVIDIA-SMI 361.77                 Driver Version: 361.77                    ||-------------------------------+----------------------+----------------------+| GPU  Name        Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC || Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. ||===============================+======================+======================||   0  Tesla K80           Off  | 0000:05:00.0     Off |                    0 || N/A   34C    P0    57W / 149W |      0MiB / 11441MiB |      0%      Default |+-------------------------------+----------------------+----------------------+|   1  Tesla K80           Off  | 0000:06:00.0     Off |                    0 || N/A   26C    P0    76W / 149W |      0MiB / 11441MiB |      0%      Default |+-------------------------------+----------------------+----------------------+|   2  Tesla K80           Off  | 0000:85:00.0     Off |                    0 || N/A   33C    P0    60W / 149W |      0MiB / 11441MiB |      0%      Default |+-------------------------------+----------------------+----------------------+|   3  Tesla K80           Off  | 0000:86:00.0     Off |                    0 || N/A   24C    P0    74W / 149W |      0MiB / 11441MiB |     71%      Default |+-------------------------------+----------------------+----------------------++-----------------------------------------------------------------------------+| Processes:                                                       GPU Memory ||  GPU       PID  Type  Process name                               Usage      ||=============================================================================||  No running processes found                                                 |+-----------------------------------------------------------------------------+

回答:

解决了这个问题。要更正此问题,请启用持久性模式(Persistence Mode):

sudo nvidia-smi -pm 1

运行此命令后,nvidia-smi结果如下:

➜  compute-0-1: ~/> nvidia-smi            Mon Sep 26 14:55:21 2016    Mon Sep 26 14:55:21 2016       +-----------------------------------------------------------------------------+| NVIDIA-SMI 361.77                 Driver Version: 361.77                    ||-------------------------------+----------------------+----------------------+| GPU  Name        Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC || Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. ||===============================+======================+======================||   0  Tesla K80           On   | 0000:05:00.0     Off |                    0 || N/A   36C    P8    27W / 149W |      0MiB / 11441MiB |      0%      Default |+-------------------------------+----------------------+----------------------+|   1  Tesla K80           On   | 0000:06:00.0     Off |                    0 || N/A   28C    P8    30W / 149W |      0MiB / 11441MiB |      0%      Default |+-------------------------------+----------------------+----------------------+|   2  Tesla K80           On   | 0000:85:00.0     Off |                    0 || N/A   37C    P8    28W / 149W |      0MiB / 11441MiB |      0%      Default |+-------------------------------+----------------------+----------------------+|   3  Tesla K80           On   | 0000:86:00.0     Off |                    0 || N/A   27C    P8    72W / 149W |      0MiB / 11441MiB |      0%      Default |+-------------------------------+----------------------+----------------------++-----------------------------------------------------------------------------+| Processes:                                                       GPU Memory ||  GPU       PID  Type  Process name                               Usage      ||=============================================================================||  No running processes found                                                 |+-----------------------------------------------------------------------------+

转载自:

转载地址:https://blog.csdn.net/HD243608836/article/details/100086009 如侵犯您的版权,请留言回复原文章的地址,我们会给您删除此文章,给您带来不便请您谅解!

上一篇:linux中查找“关键字”并替换文件中的“关键字”
下一篇:linux(ubuntu等)切换到root用户下提示bash(或mv、vim、cp、useradd):command not found解决方法

发表评论

最新留言

留言是一种美德,欢迎回访!
[***.207.175.100]2024年05月05日 13时25分47秒