Researchers Launch AI Observatory Tracking Real Usage
Public platform draws from consented conversations to measure actual AI assistant use.
TLDR
Academics from MIT, Stanford and other institutions announced the launch of the AI Observatory. The platform aggregates consented conversations to create an independent public measure of how people interact with AI assistants. Posts from project leads including Shayne Longpre and Anka Reuel highlight its 145-feature taxonomy and note coverage on the front page of the Washington Post along with a long piece in MIT Technology Review. Multiple researchers described the effort as filling gaps left by coarse proprietary reports from frontier labs.
Combined views
32.2K
22 Sources, first seen ago
Sources
SK 
Sanmi Koyejo@sanmikoyejohttps://ai-observatory.org is live! An independent, public measure of how people actually use AI, built from 24,521 consented conversations across 52 models. Led by @anka_reuel and @ShayneRedford, with a great team. Front page of WaPo and a long piece in MIT Tech Review today.
- likes: 23
- replies: 0
- bookmarks: 10
- reposts: 4
CF Cathy Fang@thecatfangsDo some AI models refuse more user requests than others? Are people using AI to generate illicit content more or less over time? And which models do people go to for coding vs role-play? Unfortunately, existing reports of AI use from frontier labs are coarse and proprietary…
- likes: 33
- replies: 2
- bookmarks: 6
- reposts: 10
DK Dayeon (Zoey) Ki@zoeykiiWe tried to audit how people are actually using AI assistants beyond what company reports show. Check it out here! 📍https://www.ai-observatory.org https://twitter.com/shayneredford/status/2089772789981172137
- likes: 27
- replies: 1
- bookmarks: 3
- reposts: 5
SK Sanmi Koyejo@sanmikoyejohttps://ai-observatory.org is live! An independent, public measure of how people actually use AI, built from 24,521 consented conversations across 52 models. Led by @AnkaReuel and @ShayneRedford with a great team. Front page of WaPo and a long piece in MIT Tech Review today.…
- likes: 33
- replies: 1
- bookmarks: 5
- reposts: 5
SG Sebastian Gehrmann@sebgehrReally nice initiative and interesting findings. Probably one of the highest impact research problems people interested in economics of AI and policy can work one. https://twitter.com/ShayneRedford/status/2089772789981172137
- likes: 13
- replies: 0
- bookmarks: 3
- reposts: 0
TL Tianshi Li@tianshi_liGlad this is finally out! Understanding how people actually use AI is such a challenging yet important problem and it takes efforts to craft the work to achieve scale, rigor, and care to detail at the same time. Check out more 👇…
- likes: 17
- replies: 0
- bookmarks: 4
- reposts: 6