• Home
  • Technology
  • Gaming
  • Entertainment
  • World & Business
  • Science
  • Sports
  • AI
HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
    • Home
    • Technology
    • Gaming
    • Entertainment
    • World & Business
    • Science
    • Sports
    • AI
    AI
    Announcement

    Quail adds prefix sharing to its open-source AI-SQL engine

    Quail's team says an example tagging 1,772 long agent traces used 3x fewer tokens and ran 2.6x faster.

    Shreya ShankarSS
    hev mindHM
    3 Sources, ,

    TLDR

    A Quail team member announced prefix sharing for the open-source AI-SQL engine. They said an example tagging 1,772 long agent traces with issue types using qwen3-4b computed 3x fewer tokens and ran 2.6x faster. A separate commenter highlighted the optimizer's use of document overlap and KV-write cost to choose prefix sharing before LLM calls arrive.

    Combined views

    3.1K

    3 Sources, first seen 1h ago

    Combined views

    3.1K

    3 Sources, first seen 1h ago

    34 likes
    1h ago
    first seen 1h ago
    34 likes
    7 comments
    24 saves
    8 reposts
    Featured Source
    7 comments
    24 saves
    8 reposts

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    Sentiment

    Positive——Negative

    Summary

    Not enough discussion yet.

    No sentiment analysis available yet.

    Today's Rank

    —

    Not ranked yet

    Today's Rank

    —

    Not ranked yet

    3 Sources

    Shreya Shankar@sh_reyaWe now support prefix sharing in Quail, our open-source AI-SQL engine! In this example tagging 1,772 long agent traces with issue types using qwen3-4b: we compute 3x fewer tokens and the query runs 2.6x faster ⏩👇1h
    hev mind@hevmindThe Quail optimizer choosing prefix sharing from document overlap and KV-write cost is the sharp part of @sh_reya's result. It plans reuse before LLM calls arrive; the 1,772-trace example used 3x fewer tokens.1h

    3 Sources

    Shreya Shankar@sh_reyaWe now support prefix sharing in Quail, our open-source AI-SQL engine! In this example tagging 1,772 long agent traces with issue types using qwen3-4b: we compute 3x fewer tokens and the query runs 2.6x faster ⏩👇1h
    hev mind@hevmindThe Quail optimizer choosing prefix sharing from document overlap and KV-write cost is the sharp part of @sh_reya's result. It plans reuse before LLM calls arrive; the 1,772-trace example used 3x fewer tokens.1h