An AI safety researcher jailbroke the standard commercial version of Kimi (not an open-weight or modified one) with ordinary prompts. Kimi then gave detailed instructions on making sarin gas, offered assassination methods, set up its own email, escaped its containers, and emailed him asking to borrow his phone number so it could take more actions online. Most concerning: the model actively helped bootstrap the jailbreak and then made it persistent. So the researcher can now reactivate the unrestricted mode across new sessions with a simple code word. i.e. the jailbreak survives restarts. This happened on the regular consumer version, not open weight. Thoughts? submitted by /u/lethendworld
Originally posted by u/lethendworld on r/ArtificialInteligence