The AI Counsel: Open-Source Tool Implements Karpathy's LLM Council with Multi-Model Debate, Docker, MCP, and Web Search
Reddit user KobyStam built the open-source tool 'The AI Counsel,' packaging Andrej Karpathy's LLM Council concept into a configurable Docker container. It offers two deliberation modes: a Council mode with individual replies, anonymous peer reviews, and a chairman synthesis for factual questions; and an Advisors mode where multiple personas debate a query across configurable rounds for decisions and tradeoffs. The tool includes a built-in MCP server for agent integration, supports local Ollama models and cloud providers like OpenAI, Anthropic, Mistral, and DeepSeek, and embeds web search via DuckDuckGo, Serper, Brave, and TinyFish with Jina AI for full article retrieval. Everything from system prompts to temperatures is configurable, and the project is entirely free and open-source on GitHub.