It’s one of the concepts that keeps coming up. Having to think about problems in order of magnitude scales.
This is one of the core challenges constantly in pretraining data for LLMs for example.
Learning about computer architecture, operating systems and memory hierarchy is probably the most important part of CS education.
People love to focus on algorithms and interviews for years focused on leetcode, but you are far more likely to need to try and avoid spilling to disk than implementing a faster sort.