Jeff Ma

@18jeffreyma

CS PhD @Harvard + researcher @Meta Created http://swefficiency.com, http://programbench.com, http://swe-sweep.com

following
followers

DuoDiscover is designed to find code optimization targets and cheap proxy evaluators together

A Google team member claims the agent ranked #1 on NVIDIA's SOL-ExecBench and reached 2× human experts on SWE-fficiency.

12 Sources, 4d ago, updated 4d ago

Muse Spark 1.3 reportedly lifts average test pass rate from 47.0% to 68.6% at xhigh

A user comparing versions 1.1 and 1.3, both at xhigh, says 1.3 used 39% fewer tokens across the benchmark and brought the number of programs at least 95% resolved from eight to 33.

12 Sources, 20d ago, updated 20d ago

Featured in

DuoDiscover is designed to find code optimization targets and cheap proxy evaluators together

Muse Spark 1.3 reportedly lifts average test pass rate from 47.0% to 68.6% at xhigh

Featured in

DuoDiscover is designed to find code optimization targets and cheap proxy evaluators together

Muse Spark 1.3 reportedly lifts average test pass rate from 47.0% to 68.6% at xhigh