His award-winning ICLR paper runs overnight on one GPU.
@YiMaTweets I wish I can say same thing, but tbh it just become impossible to do research without compute
I’m getting increasingly annoyed by young people complaining that they cannot do AI-related research unless they join big industrial labs… well, here is my reply: academia is supposed to work on ideas that money cannot buy!
you could run all experiments in our "outstanding paper award" ICLR 2021 paper overnight on a single GPU, and the method is still SOTA in that field (see our ICML'25 follow-up) -- you don't have to be in a frontier lab to do cool stuff and have an impact
I’m getting increasingly annoyed by young people complaining that they cannot do AI-related research unless they join big industrial labs… well, here is my reply: academia is supposed to work on ideas that money cannot buy!
Paper: https://iclr-conf.medium.com/announcing-iclr-2021-outstanding-paper-awards-9ae0514734ab#3bf5 Follow-up: https://arxiv.org/abs/2410.12537
you could run all experiments in our "outstanding paper award" ICLR 2021 paper overnight on a single GPU, and the method is still SOTA in that field (see our ICML'25 follow-up) -- you don't have to be in a frontier lab to do cool stuff and have an impact
His award-winning ICLR paper runs overnight on one GPU.
@YiMaTweets I wish I can say same thing, but tbh it just become impossible to do research without compute
I’m getting increasingly annoyed by young people complaining that they cannot do AI-related research unless they join big industrial labs… well, here is my reply: academia is supposed to work on ideas that money cannot buy!