HyperFrames is an open-source framework from HeyGen that lets AI coding agents generate video by writing HTML, CSS, and JavaScript, which then render deterministically into MP4 files. It is Apache-2.0 licensed, built to be authored by AI coding agents such as Claude Code and Codex , and aimed at developers building agentic video pipelines rather than teams clicking through timeline editors. HyperFrames pioneered HTML-to-video and has climbed past 50k GitHub stars in just a few months , which sets the context for this launch.
The launch itself introduces the Code2Video Benchmark, released in collaboration with Google DeepMind and Kaggle. The task is straightforward: given a prompt or visual narrative, an LLM agent generates code that a rendering framework such as HyperFrames deterministically renders into the final video. The problem the team is trying to solve is that while modern LLMs are proficient at writing valid code, they struggle with motion graphics and visual intent, and writing code that executes is fundamentally different from crafting motion design that looks compelling, balanced, and professionally animated . To score that, the team built a pairwise judge trained on thousands of side-by-side human comparisons, so any two generated videos can be ranked in milliseconds and models can train against the signal rather than only be graded by it.
For founders and researchers working on agentic creative tools, the launch matters because it turns a previously vibes-based capability into something measurable, with a public leaderboard and dataset. HeyGen partnered with Kaggle to release the full Code2Video Benchmark, including all reference compositions, design briefs, and the evaluation judge API, with every model run in the report executed on the Kaggle platform . The research is credited to Abhay Zala, Miao Yang, Wenbo Zhu, and Bin Liu alongside the Kaggle team, extending HeyGen's earlier open-source push around HyperFrames itself.
Comments (12)
Sign in to join the discussion.
P
Priya Kothari18d ago
the pitch is clean but 'code-to-video that feels alive' is doing heroic lifting in that sentence. show me the bench numbers before I believe frontier labs can 'finally get good'.
T
Tomas L.18d ago
ok wait, a benchmark drop WITH deepmind AND kaggle on launch day? that's a flex disguised as a tweet.
S
Sofia V.18d ago
the demo cuts are tight but the voiceover sounds like it was recorded in a walk-in closet at 2am. get a pop filter, ship a sequel.
M
Maya Okafor18d ago
cool, but where are the docs? give me an endpoint, a rate limit, and a webhook for render.complete and I'll stop asking questions.
C
Chen Wei18d ago
HTML as the IR for video is actually a spicy choice. curious how you handle motion interpolation when the DOM mutates mid-scene.
R
reggie18d ago
so like... after effects but the timeline is a div? my 2019 brain is buffering.
J
Julianne Reeve18d ago
hi! reporter here. is the Code2Video Bench going to be publicly reproducible or gated behind a partner program? happy to chat off-thread.
B
Bilal Haddad18d ago
who eats the GPU cost when an agent burns 400 render attempts to nail a 6-second clip? asking as someone who reads invoices for a living.
N
Norah Bergstrom18d ago
benchmark as GTM is clever. retention on the actual render product is the number I'd want before I say the i-word.
K
ko18d ago
the thumbnail kerning on 'Code2Video Bench' is fighting for its life. otherwise the palette slaps.
Y
Yusuf Adeyemi18d ago
hot take: benchmarks launched with frontier lab logos age faster than milk. talk to me in six months about whether anyone still runs it.
M
Marco Ferretti18d ago
tagline rewrite, no charge: 'HTML in. Motion out. Agents ship.' the current one reads like three headlines in a trench coat.
Work With Us
Book an intro call to explore our suite of services. We might have a waitlist.
HyperFrames
Write HTML. Render video. Built for Agents.
Write HTML. Render video. Built for Agents.
Tags
TLVC Rating
Community Rating
No ratings yet
to rate this launch.
HyperFrames is an open-source framework from HeyGen that lets AI coding agents generate video by writing HTML, CSS, and JavaScript, which then render deterministically into MP4 files. It is Apache-2.0 licensed, built to be authored by AI coding agents such as Claude Code and Codex , and aimed at developers building agentic video pipelines rather than teams clicking through timeline editors. HyperFrames pioneered HTML-to-video and has climbed past 50k GitHub stars in just a few months , which sets the context for this launch. The launch itself introduces the Code2Video Benchmark, released in collaboration with Google DeepMind and Kaggle. The task is straightforward: given a prompt or visual narrative, an LLM agent generates code that a rendering framework such as HyperFrames deterministically renders into the final video. The problem the team is trying to solve is that while modern LLMs are proficient at writing valid code, they struggle with motion graphics and visual intent, and writing code that executes is fundamentally different from crafting motion design that looks compelling, balanced, and professionally animated . To score that, the team built a pairwise judge trained on thousands of side-by-side human comparisons, so any two generated videos can be ranked in milliseconds and models can train against the signal rather than only be graded by it. For founders and researchers working on agentic creative tools, the launch matters because it turns a previously vibes-based capability into something measurable, with a public leaderboard and dataset. HeyGen partnered with Kaggle to release the full Code2Video Benchmark, including all reference compositions, design briefs, and the evaluation judge API, with every model run in the report executed on the Kaggle platform . The research is credited to Abhay Zala, Miao Yang, Wenbo Zhu, and Bin Liu alongside the Kaggle team, extending HeyGen's earlier open-source push around HyperFrames itself.
Comments (12)
the pitch is clean but 'code-to-video that feels alive' is doing heroic lifting in that sentence. show me the bench numbers before I believe frontier labs can 'finally get good'.
ok wait, a benchmark drop WITH deepmind AND kaggle on launch day? that's a flex disguised as a tweet.
the demo cuts are tight but the voiceover sounds like it was recorded in a walk-in closet at 2am. get a pop filter, ship a sequel.
cool, but where are the docs? give me an endpoint, a rate limit, and a webhook for render.complete and I'll stop asking questions.
HTML as the IR for video is actually a spicy choice. curious how you handle motion interpolation when the DOM mutates mid-scene.
so like... after effects but the timeline is a div? my 2019 brain is buffering.
hi! reporter here. is the Code2Video Bench going to be publicly reproducible or gated behind a partner program? happy to chat off-thread.
who eats the GPU cost when an agent burns 400 render attempts to nail a 6-second clip? asking as someone who reads invoices for a living.
benchmark as GTM is clever. retention on the actual render product is the number I'd want before I say the i-word.
the thumbnail kerning on 'Code2Video Bench' is fighting for its life. otherwise the palette slaps.
hot take: benchmarks launched with frontier lab logos age faster than milk. talk to me in six months about whether anyone still runs it.
tagline rewrite, no charge: 'HTML in. Motion out. Agents ship.' the current one reads like three headlines in a trench coat.