• Home
  • Technology
  • Gaming
  • Entertainment
  • World & Business
  • Science
  • Sports
  • AI
HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
    • HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
    • Home
    • Technology
    • Gaming
    • Entertainment
    • World & Business
    • Science
    • Sports
    • AI
    AI

    Gergely Orosz Says Local AI Models Are Inevitable

    Software engineer and author wants device-based AI runs independent of API pricing.

    EM
    GO
    SA
    4 Sources, 28d ago, first seen 28d ago

    TLDR

    Gergely Orosz, a software engineer, former Uber and Skype manager, and author of The Pragmatic Engineer newsletter on Substack, stated that local AI models seem inevitable. He explained his preference for running a good enough model on his laptop or phone to avoid depending on API services whose prices can change without his control. Orosz added that AI labs will hate this future while cloud providers will love it. The comment appeared in a public post.

    Combined views

    111.3K

    4 Sources, first seen 28d ago

    Combined views

    111.3K

    4 Sources, first seen 28d ago

    1.4K likes
    1.4K likes
    140 comments
    131 saves
    47 reposts
    140 comments
    131 saves
    47 reposts

    Sentiment

    Positive71.7%28.3%Negative

    Summary

    Sentiment

    Positive71.7%28.3%Negative

    Positive accounts welcomed local "good enough" models for reducing API dependency and enabling clearer ownership and economics, while negative replies argued such models remain overhyped and cannot match cloud performance.

    Based on 55 sentiment-bearing replies from 53 accounts across 2 conversations.

    Summary

    Positive accounts welcomed local "good enough" models for reducing API dependency and enabling clearer ownership and economics, while negative replies argued such models remain overhyped and cannot match cloud performance.

    Based on 55 sentiment-bearing replies from 53 accounts across 2 conversations.

    Today's Rank

    —

    Not ranked yet

    Today's Rank

    —

    Not ranked yet

    4 Sources

    @GergelyOroszAlso, local models seem inevitable. I want to be able to run a “good enough” model on my laptop, or even on my phone, and not depend on paying for an API that changes prices in ways I don’t control. AI labs will hate this idea of the future, cloud providers will love it tho.
    @svpinoLocal models *are* inevitable. We will all be running local models that will take care of 90% of the problems we need solving. Only the most demanding problems will need hardware outside of our reach.
    @EMostaqueThis is known as satisficing At a certain speed they go faster than our ability to guide them Then what is left to improve

    4 Sources

    @GergelyOroszAlso, local models seem inevitable. I want to be able to run a “good enough” model on my laptop, or even on my phone, and not depend on paying for an API that changes prices in ways I don’t control. AI labs will hate this idea of the future, cloud providers will love it tho.
    @svpinoLocal models *are* inevitable. We will all be running local models that will take care of 90% of the problems we need solving. Only the most demanding problems will need hardware outside of our reach.
    @EMostaqueThis is known as satisficing At a certain speed they go faster than our ability to guide them Then what is left to improve