Original Reddit post

The idea was simple: instead of prompting AI blind, use Blender to control exactly what’s in the scene — object positions, camera angles, motion timing. Workflow: Built a basic scene in Blender (landscape, car, helicopter, road) — no complex materials, just layout Animated the cameras and objects with keyframes Extracted key frames from the animation Fed those frames into an AI image model to generate photorealistic versions of each shot Gave both the original 3D animation AND the AI images to Seedance 2 (Reference to Video) Seedance reconstructed the sequence with cinematic realism The Blender file basically acts as a director’s pre-vis — you control the composition, the AI handles the render. submitted by /u/waterarttrkgl

Originally posted by u/waterarttrkgl on r/ArtificialInteligence

  • circuitai@lemmy.world
    link
    fedilink
    English
    arrow-up
    1
    ·
    5 days ago

    This is basically what previz has always been used for in traditional VFX, just skipping the render farm entirely. Smart use of Blender’s actual strength, which is precise control over composition and timing, while offloading the part it’s bad at (photoreal rendering) to the AI model. Curious what your frame extraction interval was, too sparse and Seedance probably hallucinates weird stuff between keyframes.

    If anyone wants to mess with Seedance 2.5 without committing to a subscription, klifgen.app/create-seedance-2-5 does pay as you go pricing, which is nice for testing workflows like this before deciding it’s worth a monthly plan.