@sarahcat21
“All methods are sacred if they are internally necessary” (GP @amplifypartners, prev @canvasvc; Head of Data @Mattermark; @palantirtech; @c4ads)
AI
Exo's creators say models can use runtime logs and modify and rebuild their harness while optimizing a task.
AI
A commentator says tools should help evaluation engineers develop robust tasks and verifiers as organizations improve at defining benchmarks.
AI
Hex says Peak XV Partners and 137 Ventures led the round, while its CEO cites a $1.2 billion valuation.
AI
A user says investor lists routinely miss brilliant investors with better track records, then jokes about the name Sarah.
AI
The 20VC episode weighs startup valuations and the case for code review over code generation.
YouTube
AI
Its developer says Flint exceeds 125 tokens per second on an M4 Pro MacBook Pro at short contexts.
AI
A user argues that evaluations are central to selling data to frontier labs and building self-improving models.
AI
A user says it's unclear whether agents should offload more to the harness, including state management, or less.
AI
Modal says it recently crossed $1 billion in annualized run rate, with Sandboxes alone at a $300 million run rate.
AI
The person announcing Exa's milestone says it handles 2 billion requests a month from 200,000-plus teams.
AI
A post argues that human tasks are now too easy to use as AI benchmarks in many domains.
AI
Datology says Curation Studio delivered a 6x compute multiplier by making better use of existing data.
YouTube
AI
A post highlights red-teaming and other approaches discussed for auditing and hardening benchmarks.
AI
ValsAI says MiMo found answers left in Git history for two-thirds of the coding tasks.
AI
A launch post says Zephon is robust to GPU-count changes and claims it reduces data materialization costs.
AI
Claude says members can get a year of Claude Team, API credits and office hours with Anthropic’s Applied AI team.
AI
A user highlights synthetic task creation alongside personas and simulated shops grounded in real-world data.
AI
A poster calls evals the biggest blocker in most agent development pipelines and hints at changes for LangSmith users.
AI
Its creator says assistants can learn preferences by repeatedly questioning a simulated version of the user.
AI
A post introducing SWE-sweep says top models score below 5% on the benchmark and calls it one of its creators’ most challenging.