How to Write 10,000+ Word Paper, Report or Book with AI

There’s a real demand for generating long-form content — whether it’s a 10,000+ word paper, detailed report, or even a book.

Everybody were trying various ways to use GPT-4o or Claude 3.5 Sonnet for that, but they just don’t deliver.

Here’s the average word count for different types of texts:

Today, ultra-long context Large Language Models (LLMs) can handle over 100,000 tokens in a single go but we know that they struggle to produce equally long responses.

While they can take in all that lengthy context, they can’t generate more than about 2,000 words in one go.

How do we push these limits? It seems there’s finally a light at the end of the tunnel.

How Do We Test the Limits of 10,000 Word Challenge?

Researchers from Tsinghua University and Zhipu AI tried pushing big models with prompts like “Write a 10,000-word article on the history of the Roman Empire” — and guess what?

Every single model fell short, maxing out at around 2,000 words. It’s like asking a marathon runner to do an ultramarathon, but they keep hitting the wall at mile 20.