In this article https://www.boozallen.com/expertise/cybersecurity/whats-in-americas-code.html Booz makes big claims about the vulnerability of Chinese models. To be clear I’m sure there is some risk. I think there is risk involved with any AI written code. In an effort to manage risks while getting the best model I have been trying to reproduce these findings because in my estimation the qwen models are the beat open source models currently. I’ll publish my findings later but so far I am seeing the opposite. For those four models qwen 3 has actually produced the best results. It’s not lost on me the Booz has a huge financial interest in these models being deemed dangerous. Also the article and technical appendix are written in such a way that it’s a lot of guess work to reproduce the findings. If the signal was as strong as they claim why didn’t they try to publish in a way that could be peer reviewed. Also I’m new to the AI field but this research is for work so am I technically a professional? lol definitely not submitted by /u/bobjonvon
Originally posted by u/bobjonvon on r/ArtificialInteligence