As the guy who put the DBRX 10^13 point on the board 10^14 is not that hard. 10^15 is probably pretty doable with enough effort and compute for data generation. I’d bet by the time we run up against 10^15 as a limitation synthetic data will have taken another step function improvement forward and 10^16 will look reasonable as well.
