I’ve been doing AI training/evaluation work for a while now and one thing that’s always bothered me is how temporary everything feels. Every project has its own Discord or Slack. You get to know people. You help each other figure out guidelines, compare notes, share leads, talk about weird tasks, whatever. Then the project ends, the server disappears, and everyone gets scattered to the wind. A few months later you’re working on another project with completely different people and starting over from scratch. It seems weird because there are hundreds of thousands of us doing this work, but most of us don’t really have an actual community. We have company-owned spaces that exist until the contract ends. So I made a Discord server called The Evaluator’s Guild . Nothing fancy. Just a place for people doing AI evaluation, annotation, RLHF, prompt work, ranking tasks, fact-checking, and similar work to stay connected between projects. My hope is that it becomes a place where people can share referrals, job leads, technical advice, industry news, and maybe just keep in touch with colleagues after a project wraps up instead of disappearing forever. It’s brand new, so right now I’m mostly looking for people who think this is a problem worth solving. If that sounds like something you’d be interested in, send me a message and I’ll get you an invite. submitted by /u/Smooth_Sailing102
Originally posted by u/Smooth_Sailing102 on r/ArtificialInteligence