• Home
  • Technology
  • Gaming
  • Entertainment
  • World & Business
  • Science
  • Sports
  • AI
HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
    • HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
    • Home
    • Technology
    • Gaming
    • Entertainment
    • World & Business
    • Science
    • Sports
    • AI
    AI

    RunAnywhere Releases SDKs for On-Device AI

    Y Combinator-backed company shares its full cross-platform SDK suite for local AI inference.

    RU
    1 Source, 25d ago, first seen 25d ago

    TLDR

    RunAnywhere, backed by Y Combinator, posted its complete inference suite after months of sharing pieces separately. The SDKs let any developer run AI directly on user devices. They cover eight environments: Swift, Kotlin, Flutter, React Native, Web, Electron, Python, and a terminal CLI, all using the same API. The post includes a 24-second video of side-by-side chat interfaces on Android and Windows.

    Combined views

    2.3K

    1 Source, first seen 25d ago

    Combined views

    2.3K

    1 Source, first seen 25d ago

    20 likes
    20 likes
    4 comments
    5 saves
    7 reposts

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    4 comments
    5 saves
    7 reposts

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    Today's Rank

    —

    Not ranked yet

    Today's Rank

    —

    Not ranked yet

    1 Source

    @RunAnywhereAIBeen posting individual pieces of RunAnywhere for months. Here's the whole thing in one place. RunAnywhere SDKs is a complete inference suite for any dev who wants to run AI on the user's device. ->8 SDKs: Swift, Kotlin, Flutter, React Native, Web, Electron, Python, and rcli for the terminal. Same API on every one. ->Every platform: iOS, Android, macOS, Windows, Linux, and the browser. ->Every modality: LLM, vision, speech to text, text to speech, embeddings, RAG, structured output, tool calling, and a full voice pipeline. ->Multiple backends under one API: llama.cpp, MLX, sherpa, ONNX Runtime, Core ML. The highest priority engine that fits the device wins, your app never branches. ->Our own runtimes for neural acceleration: QHexRT runs LLM, vision, speech and TTS directly on the Snapdragon Hexagon NPU. NeuRT does the same on the Apple Neural Engine, iPhone and Mac.Pick the model, the acceleration is automatic. ->A console to manage it all: deploy models to your API keys, see every registered device and its hardware, and track usage, latency and errors per modality across the fleet. One SDK. Every modality. Every device. Check it out here: http://github.com/RunanywhereAI/runanywhere-sdks

    1 Source

    @RunAnywhereAIBeen posting individual pieces of RunAnywhere for months. Here's the whole thing in one place. RunAnywhere SDKs is a complete inference suite for any dev who wants to run AI on the user's device. ->8 SDKs: Swift, Kotlin, Flutter, React Native, Web, Electron, Python, and rcli for the terminal. Same API on every one. ->Every platform: iOS, Android, macOS, Windows, Linux, and the browser. ->Every modality: LLM, vision, speech to text, text to speech, embeddings, RAG, structured output, tool calling, and a full voice pipeline. ->Multiple backends under one API: llama.cpp, MLX, sherpa, ONNX Runtime, Core ML. The highest priority engine that fits the device wins, your app never branches. ->Our own runtimes for neural acceleration: QHexRT runs LLM, vision, speech and TTS directly on the Snapdragon Hexagon NPU. NeuRT does the same on the Apple Neural Engine, iPhone and Mac.Pick the model, the acceleration is automatic. ->A console to manage it all: deploy models to your API keys, see every registered device and its hardware, and track usage, latency and errors per modality across the fleet. One SDK. Every modality. Every device. Check it out here: http://github.com/RunanywhereAI/runanywhere-sdks