LLM inference dataset announced with metadata on 6.12 billion requests
The team behind the dataset says it spans a year and hopes it can support research into real-world workloads, system design and infrastructure optimization.
TLDR
The announcement describes one year of metadata traces covering 6.12 billion LLM inference requests—requests to run large language models. The team hopes researchers can use the dataset to better understand real-world serving workloads and study system design and infrastructure optimization. It points readers to data.agentic-system.org to explore the data.
Combined views
—
2 Sources, first seen ago
— likes— comments— saves— reposts
