Original Reddit post

If you have tried editing videos with claude, you already know the reason. .mp4 is flawed. You just can’t give a whole video file to claude’s context for it to edit. I am talking about B-rolls, raw footages, assets, SVGs, etc. A 3 min 4k or 1080 video will eat 100K of tokens at minimum. Go 2-3 times back-and-forth and the limit is exhausted. Plus… the latency increases hugely and the accuracy/efficiency decreases exponentially. And at this point, if you think using hyperframes or remotion is easy, god bless you! I have open sourced a .cdaf or ‘cached descriptive asset file’ format. It stores she256-encrypted timestamped visual description of videos and links it to the original .mp4 file. Anytime your Claude wants to use a video, it uses the .cdaf file to read what scene it should pick from it or what duration and then continues the edit. We tested on benchmarks -

  • 91% token and cost reduction
  • 65% latency reduction Everything is in the evals & bench. Try it out and ask me if you have an open Q. submitted by /u/Uditakhourii

Originally posted by u/Uditakhourii on r/ClaudeCode