As much as I’ve tried, I have not found any good open source free tools that can do programming tasks like Claude does (as well as claude does) and I’m asking for your ideas. I found Poolside AI to be a nice free (for now) option that is effective at programming, albeit a maybe on par of sonnet-4 or sonnet-5. I tried loading models onto my computer, big and small, quantized and thinking models, and none of them perform anywhere near claude’s capabilities. In order to run the smarter ones effectively I would need to build a whole new computer. Even though I have 20GB VRAM and 64GB memory the smaller models still run too slowly with OpenCode. Some also got stuck in thinking loops. I fully expect people to run models in their own hardware, but we need something that can actually run without taking every resource imaginable - because I want to program and watch Netflix at the same time. Also, I have an integrated GPU just sitting there doing nothing because the monitors have to be connected to the dedicated GPU. We should be able to use both seamlessly at the same time with some sort of passthrough system, where the computer determines which card to use based on the workload. My question is, which free local models or tools are you running for programming tasks that can be considered as good as either Claude or Gemini and fast. submitted by /u/Buckwheat469
Originally posted by u/Buckwheat469 on r/ArtificialInteligence