arXiv:2605.06540: Frontier models fall below diversity threshold in idea generation

Nafis Saami Azad and Raiyan Abdul Baten address in a paper published on arXiv on 7 May idea diversity collapse — the phenomenon whereby creative AI systems, viewed at the level of the user population, produce convergent suggestions that lose value relative to one another.

Why does rating individual output fall short?

Traditional evaluation of creative AI examines the quality of individual output in isolation. But the authors stress: “an idea loses value when many others produce something similar.” If thousands of users receive the same slogan or the same punchline of a short story, individual quality becomes irrelevant because the suggestion is no longer differentiated in the market.

How is collapse measured before deployment?

The framework uses an ex ante protocol — a sample is generated from the model itself without human interaction — and compared against a human baseline sample matched by task. From game theory, the authors borrow the concept of constrained resources and model adoption with redundancy costs.

Two key metrics:

• Δ (excess-crowding coefficient) — identifies overcrowding within the source distribution
• ρ (diversity ratio) — ratio relative to the human baseline, where ρ ≥ 1 means parity

What did the results show?

Three frontier LLMs were tested on short story, marketing slogan, and Alternative Uses Task assignments. All three models fall below the parity threshold across multiple crowding measures — all produce less diversity than humans.

The good news: varying the generation protocol (temperature, sampling, explicit instructions) can significantly reduce collapse. This makes diversity collapse a measurable and improvable design target rather than a fixed model limitation.