https://preview.redd.it/90dgpjg9ri6h1.png?width=3316&format=png&auto=webp&s=5294bee2b5491b9270cdfa6928c78ab3f806cff8 I took Andrej Karpathy’s LLM Council concept to the next level (Docker, MCP, and local model support) We want better answers from our LLMs, but relying on a single model falls short. So I built The AI Counsel to run two distinct deliberation modes: First, the LLM Council mode. It runs a 3-stage pipeline: individual replies, anonymous peer reviews, and chairman synthesis. This works best for factual questions and direct answers. Second, the LLM Advisors mode. Multiple customizable personas (like The Skeptic, The Strategist, The Ethicist) debate your question across configurable rounds, reaching consensus to deliver a structured verdict. This works best for decisions, strategy, and tradeoffs. I packaged the tool as a Docker container with a built-in MCP server for full API access. You can connect it to any agent that supports MCP, like Hermes or OpenClaw. It comes with a dedicated skill so your agents can call it directly. You can spin it up using local Ollama models or connect free models from OpenCode Zen/Go and NVIDIA NIM. I also built in direct connections to OpenAI, Anthropic, OpenCode, Mistral, and DeepSeek. To ground responses in the latest web information, I added a search engine. It supports DuckDuckGo (free, no API key), Serper, Brave, and TinyFish (all with free tiers). I also integrated Jina AI to fetch full articles for the LLMs to read. EVERYTHING in the tool is configurable, from system prompts to model temperatures. There are advanced debate models for the council. This tool is massive. Free and Fully Open Source. Check it out Repo: https://github.com/jacob-bd/the-ai-counsel submitted by /u/KobyStam
Originally posted by u/KobyStam on r/ArtificialInteligence