The hype around Ternary Bonsai 2 27B got me to finally install the local model locally. I’ve been testing it with CC for the past day, for basically 2 things: Claude delegates simple, preplanned tasks, for to run on the local model. Usually tool usage and installation, monitoring and filtering. Scanning large DB and flagging entries by vague criteria and light reasoning. I have a RTX3070TI and it works surpassingly well. Claude is now Vibe-tooling with the local model instead of running shell commands, I would estimate the saving to be ~10% in usage and ~10%-20% in context size depending on the session. Highly recomand for such use cases, less so for coding and large context tasks. Links: https://prismml.com/news/bonsai-2-27b https://x.com/PrismML/status/2100692248480596348 submitted by /u/AIgeek
Originally posted by u/AIgeek on r/ClaudeCode
You must log in or # to comment.