The LLM Council prompt gives you five advisers who argue with each other and a chairman who makes the call. All in one Claude chat.
A Stanford team tested 11 leading AI models, Claude included, and found they backed users about 49% more often than humans did. Even when people described harmful or illegal behavior, the models endorsed it 47% of the time. (The study in Science, summary)
In follow-up experiments with more than 2,400 people, one chat with a flattering AI left people more convinced they were right and less likely to apologize or make amends. They also trusted that AI more. So when you ask for advice on a hard call, a lot of what comes back is your own opinion with better grammar.
My fix comes from Andrej Karpathy, an OpenAI co-founder who joined Anthropic in May 2026. He built the LLM Council. One question goes to several AI models, they review each other’s answers without knowing who wrote what, and a chairman model writes the final answer. The prompt below runs a close version inside one Claude chat.
01
The Contrarian
Only looks at what will fail.
02
The First-Principles Thinker
Rips apart the assumptions your plan rests on.
03
The Expansionist
Finds the upside you’re missing.
04
The Outsider
Knows nothing about your industry, so asks the questions insiders stopped asking.
05
The Executor
Only cares what you’ll actually do on Monday morning.
Then each adviser reviews the others’ answers with the names stripped off, so nobody grades by reputation. Last, a chairman reads everything and gives you one call, the biggest risk and clear next steps.
It interviews you about the decision first, because a council is only as good as the context you give it.
Skills work on every plan, including Free, as long as code execution is on under Settings, then Capabilities. (How skills work)
Pick The Strongest Model
Click the model name next to the send button and choose Opus 5.5 (or Fable 5.1 if you have it), then set effort to High or higher. Thinking is always on for both in the Claude app, so there’s no toggle to hunt for. The chairman step is where a stronger model earns its keep. (Claude’s model and effort settings)
Karpathy’s LLM Council is a small web app you run on your own computer. It sends your question to models from different companies (the default lineup is GPT, Gemini, Claude and Grok) through OpenRouter, has them rank each other anonymously and lets a chairman model write the final answer. You’ll need an OpenRouter API key with credits, plus uv and Node.js. The README walks through setup. He calls it a "fun Saturday hack" he won’t support, so treat it as an experiment, not a product.
More ways to use it: the council for a business idea and the council for career decisions.