Databricks Mosaic AI's Andrew Drozdov argues computer science is within two years of being too complex for one expert to master
Boytsov notes GPU specialization already exceeds standard curricula.
@mrdrozdov You took a course on lock-free data structures? Maybe also a course on succinct data structures 😉? Also nand2tetris doesn't cover GPUs AFAIK. But there are a lot of other examples.
Andrew Drozdov@mrdrozdov@srchvrs I mean. A decent amount 😅 I did take courses for all of those topics at some point. And something like nand2tetris does cover a lot of the CS stack. My hot take here is that AI infra structure in particular will see an explosion of complexity, although maybe I'm overestimating.
@srchvrs I mean. A decent amount 😅 I did take courses for all of those topics at some point. And something like nand2tetris does cover a lot of the CS stack. My hot take here is that AI infra structure in particular will see an explosion of complexity, although maybe I'm overestimating.
Leo Boytsov@srchvrs@mrdrozdov We are far beyond that point. For example, how much do you understand compilers, cryptography, or complexity theory? Are you an expert in C++ template-based programming, do you know lock-free data structure?