People are increasingly worried that AI tools make us overreliant. But how do we actually measure this? We introduce Offloading Score, a measure of reliance based on the fraction of cognitive effort offloaded to AI while completing a task. In a controlled user study, Offloading Score detects increased reliance under time pressure, while several common alternatives do not. (1/9)
Stanford's Vishakh Padmakumar introduces Offloading Score, a metric to quantify how much cognitive effort users delegate to AI
The metric successfully tracked increased AI reliance under tight deadlines.
Most Activity
We introduce Offloading Score. The idea is simple: we examine the AI-assisted steps of the user’s workflow, estimate how the user would have completed it without the tool, then compare how many steps from the counterfactual workflow were ‘saved’ by using the tool. (4/9)
We introduce Offloading Score. The idea is simple: we examine the AI-assisted steps of the user’s workflow, estimate how the user would have completed it without the tool, then compare how many steps from the counterfactual workflow were ‘saved’ by using the tool. (4/9)