I’ve been looking into various solutions for a while, especially since pewdiepie made that LLM council video. There seems to be two pathways. The multi chat, where you prompt once, and all ais give you an answer, then either you look at all of them, or another bot will summarize it for you. Tools include https://app.meshub.ai/ I’ve been playing with this one, its early on but its cool. Another one but paid https://multiple.chat/ and probably a better “leader” bot. The idea definitely stems from the council https://github.com/karpathy/llm-council I think some people have created something similar with https://openrouter.ai/ All in all, it is a cool concept, but limited on the technology. With the price of cloud tokens, and the sheer amount you’d use. You either have to have a lot of money, and also it should be taken into consideration the ecological outcomes from using 6 ai’s at once. OR You have a setup like Pewdiepie, where you have half a dozen GPU’s in a mining rig essentially. Although I think even he said you could technically have it on one gpu just sequentially. I was asking Claude/Gemini about that, and I think there’s pros/cons to either method. Another idea that I don’t think people are thinking about enough are computer clusters. I.e. I got into the idea via raspberry pi clusters, with AI hats. That’s cool, but the models you can run on them right now are too small. Even with the best tech you can buy. Other choices would be like the Framework desktop or mac mini clusters, but even those I’m not sure how well they’re gonna run the models you’d actually want for the the complex problems that the llm council would be USEFUL for. I.e. global problems, or wicked problems. Not promoting but I did make a video recently talking about local LLM hardware options, as I didn’t see anyone else talking about it enough. Potentially I could see the Tiiny AI being useful in this case. Maybe minisforum ai max 470 mini pc being useful too. Again model size though. I’m making this post because I really wanted to ask all of you. A lot of you probably know a lot more than me, I’m just good at synergizing ideas and connecting the dots, so I figured we could work together on coming up with potential ideas! I know I’m not the only one interested in this! Cheers! submitted by /u/ulcweb
Originally posted by u/ulcweb on r/ArtificialInteligence
You must log in or # to comment.