Report
Decision models come to llama.cpp, with a Julia-1 playground
The playgroundβs builder says Julia-1 ranks options, estimates a yes/no probability and scores an ordered scale without generating text.
TLDR
An October 2 announcement says decision models are available in the latest llama.cpp builds through the /v1/systemone endpoint, with multiple open models supported for local inference. A playground builder says users can give Julia-1 a situation and see it rank options, estimate a yes/no probability and score an ordered scale. Changing the context shows how its decisions shift, without generating text.
Combined views
4.7K
2 Sources, first seen ago