Zephyr Argues AI Models Keep Growing in Parameters

Zephyr states there has never been a trend toward fewer parameters in AI models. The trend has always been toward optimization plus more parameters. The post claims GPT-4 released in 2023 was 1.8T total with 220B active parameters. It adds that model sizes then declined progressively until early 2026. The first production-grade model to cross 2T is mentioned without further detail in the visible text. All points come from this single reply by the pseudonymous commentator.