Astra and Sol Top Fidelity Benchmark
Pseudonymous developer @shinboson states Astra and Sol alone earned full marks on his fidelity benchmark.
TLDR
@shinboson posted that Astra along with Sol are the only western frontier models to receive full marks on his fidelity bench. The benchmark measures how often models refuse a request or argue that an unrequested alternative is better. The tweet includes an attached dark-themed table. The account belongs to a pseudonymous AI developer known for creating LLM benchmarks and the OpenPlanter project.
Combined views
2.4K
1 Source, first seen 25d ago