Horace He

AI

Researchers note that visible dashboard numbers lead users to include cached inputs when reporting token usage.

4 Sources, 31d ago, first seen 31d ago

Technology

Engineers discuss how dashboards prompt users to count cached tokens.

3 Sources, 31d ago, first seen 31d ago

AI

Horace He argues successful ML methods create added work for infrastructure teams.

18 Sources, 57d ago, first seen 57d ago

Recent stories