• Home
  • Technology
  • Gaming
  • Entertainment
  • World & Business
  • Science
  • Sports
  • AI
HomeTechnologyGamingEntertainmentWorld & BusinessScienceSportsAI
AI
Announcement

Kombine benchmark suggests LLMs are more creative than the average human at combining ideas

A thread introducing Kombine says conceptual blending is the hardest task for LLMs, and even frontier models struggle.

2 Sources, 3h ago, first seen 3h ago

TLDR

The thread introducing Kombine says LLMs are more combinatorially creative than the average human, though even frontier models struggle with conceptual blending. It says separate models tend to invent concepts with the same properties, while humans and LLMs combine ideas in distinct regions of semantic space. The authors anticipate that human-AI collaboration could bring greater conceptual diversity.

Combined views

—

2 Sources, first seen 3h ago

— likes— comments— saves— reposts

Combined views

—

2 Sources, first seen 3h ago

— likes— comments— saves— reposts
Image: @samschapiro on X

Sentiment

Positive——Negative

Summary

Not enough discussion yet.

No sentiment analysis available yet.

Featured Source

Sentiment

Positive——Negative

Summary

Not enough discussion yet.

No sentiment analysis available yet.

2 Sources

Samuel Schapiro@samschapiro🧵[1/N] Are large language models more creative than humans at combining ideas? 🤔 Combinatorial creativity involves combining familiar ideas in unfamiliar ways, and is central to scientific discovery and technological innovation. In fact, breakthrough scientific work is often associated with more distant combinations of methods, techniques, and concepts. Here, we introduce Kombine, a new benchmark of combinatorial creativity for LLMs. TLDR: - LLMs are more combinatorially creative than the average human. - However, conceptual blending is the hardest task for LLMs, and even frontier models struggle. - LLMs also tend to homogenize, inventing concepts with the same properties across separate models. - Moreover, humans and LLMs combine in distinct regions of semantic space. - As a result, we anticipate greater conceptual diversity can be unlocked through human-AI collaboration. 🗣️ Thread below🧵⬇️3h
Kenneth Huang @COLM2026@windx0303RT @samschapiro: 🧵[1/N] Are large language models more creative than humans at combining ideas? 🤔 Combinatorial creativity involves combin…1h
    • Home
    • Technology
    • Gaming
    • Entertainment
    • World & Business
    • Science
    • Sports
    • AI

    2 Sources

    Samuel Schapiro@samschapiro🧵[1/N] Are large language models more creative than humans at combining ideas? 🤔 Combinatorial creativity involves combining familiar ideas in unfamiliar ways, and is central to scientific discovery and technological innovation. In fact, breakthrough scientific work is often associated with more distant combinations of methods, techniques, and concepts. Here, we introduce Kombine, a new benchmark of combinatorial creativity for LLMs. TLDR: - LLMs are more combinatorially creative than the average human. - However, conceptual blending is the hardest task for LLMs, and even frontier models struggle. - LLMs also tend to homogenize, inventing concepts with the same properties across separate models. - Moreover, humans and LLMs combine in distinct regions of semantic space. - As a result, we anticipate greater conceptual diversity can be unlocked through human-AI collaboration. 🗣️ Thread below🧵⬇️3h
    Kenneth Huang @COLM2026@windx0303RT @samschapiro: 🧵[1/N] Are large language models more creative than humans at combining ideas? 🤔 Combinatorial creativity involves combin…1h
    Today's Rank

    —

    Not ranked yet

    Today's Rank

    —

    Not ranked yet