Hello, i’m currently developing CrowdGPT , with the goal of creating the first, datacenterless, 1 Billion parameters LLM (same tech behind ChatGPT), in a 100% Opensource and collaborative way. The idea is simple: what if we could build an AI together, with everyone able to contribute computing power, inspect the code, and have a say in the project’s direction? My goal is to show you don’t need huge Nvidia GPU clusters nor million of dollars to train a commercial grade Language Model. The project is already working, and the model was already trained on 6.9 billion tokens using the framework itself , but I’m still looking for people who are curious enough to try it, review the implementation, or tell me what I’m getting wrong. You can find more details at https://crowdgpt.net/ Or check the github: https://github.com/Vxtzq/CrowdGPT Any kind of feedback is appreciated! Thanks in advance 😄 submitted by /u/Vxtzq1
Originally posted by u/Vxtzq1 on r/ArtificialInteligence
You must log in or # to comment.