Original Reddit post

You give this model a recording and ask it questions about what it hears. The demo runs AntLing’s open Ming-3.0-audio-flash locally on one machine and goes through three kinds of task:

  • Client calls: two speakerphone excerpts come back with instructions and quantities the creator rates as perfect
  • Sound and music: rain and a low musical drone get picked out of a mixed scene
  • Delivery: a tense exchange comes back with “a slow, deliberate cadence and a tone of grave authority” for one speaker and “cold defiance and urgency” for the other This model can transcribe speech, identify sound effects and music, and describe the tone and emotion in people’s voices. Try it on any voice memo with a bit of life in it and ask: “Who sounds tense here, and which sounds tell you that?” submitted by /u/truecakesnake

Originally posted by u/truecakesnake on r/ArtificialInteligence