• Home
  • Technology
  • Gaming
  • Entertainment
  • World & Business
  • Science
  • Sports
  • AI
HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
AI

LLM batch-size scaling, action spaces and full-turn sampling

One participant expects LLM batch sizes to scale much higher because of a constrained starting point; a reply highlights a way to reason about sampling over a full turn.

will brownWB
1 Source, 20d ago, first seen 20d ago

TLDR

One participant claims their algorithm is much stronger because it avoids LLM action-space problems. They expect LLM batch sizes to “scale” much higher, arguing that those problems weaken the starting point. A reply criticizes tokenizers but says treating full-turn sampling as a high-dimensional, concentrated prior—for example, a Gaussian—offers useful rules of thumb.

Combined views

135

1 Source, first seen 20d ago

1 likes

Combined views

135

1 Source, first seen 20d ago

1 likes

Sentiment

Positive——Negative

Summary

Not enough discussion yet.

No sentiment analysis available yet.

Featured Source

Sentiment

Positive——Negative

Summary

Not enough discussion yet.

No sentiment analysis available yet.

1 Source

will brown@willcb@jsuarez @andrew_n_carr tokenizers suck yes but conceptualizing full turn-level sampling as a high-dim concentrated prior (eg gaussian) gives solid heuristics20d
    • Home
    • Technology
    • Gaming
    • Entertainment
    • World & Business
    • Science
    • Sports
    • AI

    1 Source

    will brown@willcb@jsuarez @andrew_n_carr tokenizers suck yes but conceptualizing full turn-level sampling as a high-dim concentrated prior (eg gaussian) gives solid heuristics20d
    Today's Rank

    —

    Not ranked yet

    Today's Rank

    —

    Not ranked yet