I am a BCA student and got a little curious to see which video model would be the best, so I decided to run a small test myself. I used the same prompt, aspect ratio and 5-second duration for 6 video models. Used the same seed wherever the platform allowed it, although I got to know that seeds weren’t always cross-compatible with different models. The prompt:- “A woman in a yellow raincoat walks towards camera down a wet street at night, neom reflections, handheld.” After generating the clips, I renamed them so the model wasn’t identifiable and sent them to around 40 classmates. Some work/study AI, while others are basically regularly using ChatGPT. I asked everyone to rank the videos based on which one looked the most realistic. Interestingly, both the groups came to almost the same conclusions. Veo came first, but the top 3 were extremely close, like by a vote or two. The gap between third and last was much bigger though. Seedance 2.5 came second and got some pretty crazy reactions from a few people. Hailuo was last by a large margin. Obviously, this is only one prompt and one 5-second shot, so I wouldn’t call this a proper benchmark. I think a longer multi-shot sequence could produce a different result. Ay, at least my professors praised me lel. I’m thinking of doing a follow up with multi-shot sequences and more prompts if I get the time. Would be interesting to see if the ranking changes! submitted by /u/NewPhoneWhotiz
Originally posted by u/NewPhoneWhotiz on r/ArtificialInteligence