Anthropic CEO Claims 100 Million Word Context Window Is Feasible

"From a machine learning persepective from an AI perspective, there is no reason why we cant make a context-window of 100m"

Let's see what you've got, Anthropic.