I think we are already seeing a big interest towards local models and it’s development in last 2 years, as most people started using local models like oLLama for the favor of privacy and security and every day increased token prices. The hardware is a big factor too as all the big manufacturers are focused on the ai running chips and gpus and unified memory, as Nvidia just did with its latest laptop chip, and Apple’s unified apple silicon chips. One of the main reasons of developing HashCortX was to make the user able to run local models in many ways like making workflows and specified agents, have a rag memory and chat following up, on devices coding with full privacy, without depending on cloud models or external services. Projects like Odysseus have definitely accelerated the conversation, as PewDiePie’s reach made alot of people suddenly interested in local models use and hosting. That’s the public figure effect, as the local models didn’t appear overnight, people used them for years. Tell me what do you think ? will power users go to local models more or just keep using cloud models ? or maybe both, I would love to hear your thoughts about the community direction :) submitted by /u/SSSHash
Originally posted by u/SSSHash on r/ArtificialInteligence