AILogprobs and the case for repackaging the LLM stack
One commenter sees a maturing LLM market opening up useful new ways to package parts of the technology. Another says logprobs had become “fairly useless” before they were removed.
TLDR
Logprobs—log probabilities—were once universally exposed through LLM inference APIs, one commenter recalls. They argue that the market is entering a phase where individual parts of the LLM stack can be repackaged in useful new ways. A separate comment offers a dimmer view of logprobs specifically, saying they became “fairly useless” before being removed.
Combined views
4.8K
2 Sources, first seen 13h ago
40 likes
Logprobs and the case for repackaging the LLM stack
One commenter sees a maturing LLM market opening up useful new ways to package parts of the technology. Another says logprobs had become “fairly useless” before they were removed.