We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Hi, I am running the training and it seems it was very slow. Take more than one hour to complete one epoch. Here is the output of nvidia-smi:
-----------------------------------------------------------------------------+ | NVIDIA-SMI 450.51.05 Driver Version: 450.51.05 CUDA Version: 11.0 | |-------------------------------+----------------------+----------------------+ | GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC | | Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. | | | | MIG M. | |===============================+======================+======================| | 0 TITAN V Off | 00000000:65:00.0 Off | N/A | | 32% 46C P8 28W / 250W | 320MiB / 12066MiB | 0% Default | | | | N/A | +-------------------------------+----------------------+----------------------+ | 1 Quadro K620 Off | 00000000:B3:00.0 On | N/A | | 35% 51C P0 3W / 30W | 373MiB / 1977MiB | 2% Default | | | | N/A | +-------------------------------+----------------------+----------------------+
+-----------------------------------------------------------------------------+ | Processes: | | GPU GI CI PID Type Process name GPU Memory | | ID ID Usage | |=============================================================================| | 0 N/A N/A 1205 G /usr/lib/xorg/Xorg 4MiB | | 0 N/A N/A 1806 G /usr/lib/xorg/Xorg 4MiB | | 0 N/A N/A 21419 C python3 305MiB | | 1 N/A N/A 1205 G /usr/lib/xorg/Xorg 56MiB | | 1 N/A N/A 1806 G /usr/lib/xorg/Xorg 133MiB | | 1 N/A N/A 2005 G /usr/bin/gnome-shell 131MiB | | 1 N/A N/A 3991 G /usr/lib/firefox/firefox 0MiB | | 1 N/A N/A 4606 G /usr/lib/firefox/firefox 0MiB | | 1 N/A N/A 4976 G /usr/lib/firefox/firefox 37MiB | +-----------------------------------------------------------------------------+
The text was updated successfully, but these errors were encountered:
You need to install tensorflow-gpu 1.14
Sorry, something went wrong.
No branches or pull requests
Hi, I am running the training and it seems it was very slow. Take more than one hour to complete one epoch. Here is the output of nvidia-smi:
-----------------------------------------------------------------------------+
| NVIDIA-SMI 450.51.05 Driver Version: 450.51.05 CUDA Version: 11.0 |
|-------------------------------+----------------------+----------------------+
| GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. |
| | | MIG M. |
|===============================+======================+======================|
| 0 TITAN V Off | 00000000:65:00.0 Off | N/A |
| 32% 46C P8 28W / 250W | 320MiB / 12066MiB | 0% Default |
| | | N/A |
+-------------------------------+----------------------+----------------------+
| 1 Quadro K620 Off | 00000000:B3:00.0 On | N/A |
| 35% 51C P0 3W / 30W | 373MiB / 1977MiB | 2% Default |
| | | N/A |
+-------------------------------+----------------------+----------------------+
+-----------------------------------------------------------------------------+
| Processes: |
| GPU GI CI PID Type Process name GPU Memory |
| ID ID Usage |
|=============================================================================|
| 0 N/A N/A 1205 G /usr/lib/xorg/Xorg 4MiB |
| 0 N/A N/A 1806 G /usr/lib/xorg/Xorg 4MiB |
| 0 N/A N/A 21419 C python3 305MiB |
| 1 N/A N/A 1205 G /usr/lib/xorg/Xorg 56MiB |
| 1 N/A N/A 1806 G /usr/lib/xorg/Xorg 133MiB |
| 1 N/A N/A 2005 G /usr/bin/gnome-shell 131MiB |
| 1 N/A N/A 3991 G /usr/lib/firefox/firefox 0MiB |
| 1 N/A N/A 4606 G /usr/lib/firefox/firefox 0MiB |
| 1 N/A N/A 4976 G /usr/lib/firefox/firefox 37MiB |
+-----------------------------------------------------------------------------+
The text was updated successfully, but these errors were encountered: