I have been running local models for a while now and got tired of watching the power meter go up every time I wanted to ask a question. Data centers use ridiculous amounts of electricity and water just so people can chat with an AI. I decided I did not want to be part of that anymore. So I connected the hamster wheel. Wally runs, the model runs. That is the entire setup. Right now the speed is sitting at 0.1 and the energy reading is at 1019 with the AI load around 22 percent. It is not fast by any normal standard, but it works and it does not require any extra power from the grid. The only thing I have to do is keep the water bottle full and the seeds topped up. He has no idea he is the reason I can run inference completely offline. He just likes the wheel. I like not needing a data center or a bigger PSU or any of the usual excuses people give for why local AI is hard. He provides enough. I do not need more power. The model answers, the hamster keeps spinning, and nothing leaves the house. It is surprisingly stable too. He takes breaks when he wants, but when he is on the wheel the tokens keep coming. No cloud fees, no rate limits, no waiting for some distant server farm to free up capacity. Just one small animal doing what he already does all night anyway. Has anyone else found a way to run their local models without constantly needing more power? More on github: https://github.com/kMegapnbedt submitted by /u/Sad_Measurement_7502
Originally posted by u/Sad_Measurement_7502 on r/ArtificialInteligence