The AI Counsel: Open-Source Tool Implements Karpathy's LLM Council with Multi-Model Debate, Docker, MCP, and Web Search
English summary
Reddit user KobyStam built the open-source tool 'The AI Counsel,' packaging Andrej Karpathy's LLM Council concept into a configurable Docker container. It offers two deliberation modes: a Council mode with individual replies, anonymous peer reviews, and a chairman synthesis for factual questions; and an Advisors mode where multiple personas debate a query across configurable rounds for decisions and tradeoffs. The tool includes a built-in MCP server for agent integration, supports local Ollama models and cloud providers like OpenAI, Anthropic, Mistral, and DeepSeek, and embeds web search via DuckDuckGo, Serper, Brave, and TinyFish with Jina AI for full article retrieval. Everything from system prompts to temperatures is configurable, and the project is entirely free and open-source on GitHub.
Chinese summary
Reddit用户KobyStam基于Andrej Karpathy的LLM议会概念，构建了开源工具“The AI Counsel”，并将其打包为可配置的Docker容器。该工具提供两种审议模式：议会模式包含独立回复、匿名同行评审和主席总结三阶段，适用于事实性问题；顾问模式则由多个可定制的人设在多轮辩论后达成共识，适用于决策与权衡。工具内置MCP服务器，可被智能体直接调用，支持本地Ollama模型和OpenAI、Anthropic、Mistral、DeepSeek等云端模型，并集成了DuckDuckGo、Serper、Brave、TinyFish网络搜索以及Jina AI全文获取。所有系统提示、温度等均可配置，项目完全开源免费。
Key points
Implements two distinct LLM deliberation modes: Council (stage pipeline) for factual queries and Advisors (persona debate) for decisions.
实现两种LLM审议模式：适用于事实性问题的议会管线模式和适用于决策的顾问辩论模式。
Packaged as a Docker container with an MCP server, enabling integration with agents like Hermes or OpenClaw.
以Docker容器形式发布，内置MCP服务器，可与Hermes、OpenClaw等智能体集成。
Supports local models via Ollama and cloud APIs from OpenAI, Anthropic, Mistral, DeepSeek, and others.
支持通过Ollama运行本地模型，以及OpenAI、Anthropic、Mistral、DeepSeek等云端API。
Integrates multiple search engines (DuckDuckGo, Serper, Brave, TinyFish) and Jina AI for full-article grounding.
集成多种搜索引擎（DuckDuckGo、Serper、Brave、TinyFish）和Jina AI，为回复提供最新网络信息支撑。
Fully open-source and highly configurable (prompts, temperatures, debate settings).
完全开源，系统提示、温度参数、辩论设置等均高度可配置。