Been thinking abt this lately but how are people actually measuring AI skills rn in a way that isnt kinda fake? Not talking abt “can you use ChatGPT” level stuff. I mean actual AI proficiency in real work situations. Prompting is one thing but theres also evaluating outputs, workflow thinking, knowing when the model is bullshitting, adapting tools to diff contexts, etc. Feels like most AI certifications and AI skills tests rn have the same issue coding bootcamps had years ago. Multiple choice quizzes, memorizing concepts, generic coursework. Doesn’t really tell you if someone can USE AI effectively in realistic scenarios. Whats weird is companies are already hiring for “AI fluency” and “AI-native” roles but I honestly dont think theres agreement yet on how to properly measure AI skills or run an actual AI skills assessment. I tried a few different assessments recently out of curiosity and honestly most of them felt way too standardized. One of them used an actual conversational format instead of MCQs and it was surprisingly harder than expected because it tested reasoning/process more than memorized answers. Made me realize someone can know prompting tricks and still be terrible at critical evaluation or decision making. Curious where ppl here land on this. Do you think AI certifications and AI proficiency tests can ever become genuinely useful or are we heading toward another wave of mostly meaningless certs? submitted by /u/AccomplishedPine4602
Originally posted by u/AccomplishedPine4602 on r/ArtificialInteligence