Loading activity…
@liliang_ren
Pretraining @thinkymachines | Prev. Microsoft Superintelligence | UIUC CS PhD | Scaling Efficient LLM | NLP
AI
DAIR.AI says a paper from Microsoft and Cornell describes essentially no extra inference latency and an unchanged memory cache, with the extra cost shifted to training.
