Mark Saroufim shares a kernel workaround to run NVIDIA Nsight Compute profiling on rented cloud GPUs
Setting NVreg_RestrictProfilingToAdminUsers to zero via modprobe unlocks profiling.
Positive users are optimistic about Colab suggestions and sudo commands to enable NCU profiling on L4 GPU rentals, while negative users note that most providers restrict such access.
Most Activity
@vikhyatk You can do it on any neocloud that gives you sudo access
echo "options nvidia NVreg_RestrictProfilingToAdminUsers=0" | sudo tee /etc/modprobe.d/nvprof.conf sudo reboot
anyone know where i can find an L4 GPU rental that also lets me run ncu?
@vikhyatk Buy one and make it a CI
@vikhyatk colab?
@ptntlbyrnths looks like this might work, trying it out!
@Leik0w0 will probably end up doing this
@vikhyatk good luck finding one that lets you run ncu. most rental terms lock that down immediately
@vikhyatk people usually say just use http://vast.ai for cheap L4s but the fine print on ncu support kills it half the time
you try lambda or paperspace yet?