The strategy aims to counter Chinese open-source LLM dominance.
Given token economics, we really need @apple’s new ceo to go all in on workstations that can run local, open source models
Ideally, with a router that can flip between local models and frontier models when the former gets stuck.
And America needs an open source champion — we really should not be comfortable with the Chinese owning the open source LLM market to the extent they do
Many users endorsed Apple building workstations for local open-source AI models due to environmental benefits and strong current hardware performance, while some dismissed Apple as unsuitable or behind competitors like Nvidia.
@Jason @Apple I endorse this message!
Given token economics, we really need @apple’s new ceo to go all in on workstations that can run local, open source models
Ideally, with a router that can flip between local models and frontier models when the former gets stuck.
And America needs an open source champion — we really should not be comfortable with the Chinese owning the open source LLM market to the extent they do
@ClementDelangue @Jason @Apple Genuinely curious: without all the wishy washy nationalist language, why are you worried about it? Open is open. It doesn't matter where it originates from.
@Jason @Apple More local, open-source models equals less energy and data center impact. Local LLM's change the web entirely so much less has to be fetched.
@Jason @Apple Some interesting technical feedback on this topic here:
@Jason @Apple I just want to buy a 128 unified memory m4 Max rn. It’s literally impossible to find
@Jason @Apple pretty sure apple cares more about thermal constraints and keeping user data inside the walled garden than building hardware just to appease the open source crowd. they definitely prefer a locked ecosystem over us having full control over the weights.
@Jason @Apple macOS 27 includes a System Orchestrator that routes between on-device Apple foundation models and Private Cloud Compute. You can also build your own smart router with the new Foundation Models framework + Core AI + MLX to mix local and frontier models.
@Jason @Apple Arguably both Microsoft & Apple were built on "But what if you run this at home on your own device?" to begin with.
That was the Personal Computer revolution.
Round 2, Go!
@Jason @Apple We had one. Then they decided they’d rather make money instead. The American Way.
@Jason @Apple They already built the workstation people wanted: the 512GB M3 Ultra Mac Studio. Then they killed it. I hope they see the opportunity staring them in the face.
@Jason @Apple My vibe-coded harness does this
@Jason @Apple I'd love to run a local model on iPhone to enable an AI dungeon-master, waiting for next-gen hardware to come out, hopefully soon. 12gb memory is a great direction.
@Jason @Apple Just load @Alibaba_Qwen 3.6 27B and Hermes Agent. It works now on Mac Studio 64GB.
@Jason @Apple Apple's never gonna give us that kind of freedom with their hardware, but the push for local models is the right bet. Just don't sleep on the market sorting it out without government help.
@Jason @Apple Yes! 🙌
@Jason @Apple Fate loves irony.
@Jason @Apple They should own cusumer hardware
@Jason @Apple Yeah but how? We will probably need a RAM Act (à la the Chips Act) to get us producing enough RAM and VRAM to accomplish this endgame. 128 GB of RAM isn’t gonna cut it. Need several TBs on each work station.
@Jason @Apple No money in open source. Who is going to build it for free?
@Jason @niubi @Apple Dude, see all the laptops, desktops, and RTX Sparks (Mac Mini on steroids) that Jensen is releasing at Nvidia - Apple is far behind.
The strategy aims to counter Chinese open-source LLM dominance.
Given token economics, we really need @apple’s new ceo to go all in on workstations that can run local, open source models
Ideally, with a router that can flip between local models and frontier models when the former gets stuck.
And America needs an open source champion — we really should not be comfortable with the Chinese owning the open source LLM market to the extent they do