2026-07-27 00:40:54 +03:00
< p align = "center" >
2026-08-15 14:51:29 +02:00
< a href = "https://diffusion.studio" >
< img src = "assets/banner.png" alt = "Diffusion Studio" width = "700" / >
< / a >
2026-07-27 00:40:54 +03:00
< / p >
2026-10-01 09:52:52 +02:00
< p align = "center" > Turn your agent into a professional video editor< / p >
2026-07-07 13:18:52 +02:00
2026-08-15 01:19:30 +02:00
< p align = "center" >
2026-09-22 14:28:29 +02:00
< a href = "https://www.diffusion.studio/download" > < img src = "https://img.shields.io/badge/Download-macOS%20%7C%20Windows-161616?style=flat&labelColor=000000" alt = "Download for macOS or Windows" / > < / a >
2026-08-15 01:19:30 +02:00
< a href = "https://discord.com/invite/zPQJrNGuFB" > < img src = "https://img.shields.io/discord/1115673443141156924?style=flat&logo=discord&logoColor=F8F8F8&label=Discord&labelColor=000000&color=161616" alt = "Discord" / > < / a >
< a href = "https://x.com/diffusionhq" > < img src = "https://img.shields.io/badge/Follow%20for-Updates-161616?style=flat&logo=x&logoColor=F8F8F8&labelColor=000000" alt = "Follow on X" / > < / a >
< a href = "https://www.ycombinator.com/companies/diffusion-studio" > < img src = "https://img.shields.io/badge/Combinator-F24-161616?style=flat&logo=ycombinator&logoColor=F8F8F8&labelColor=000000" alt = "Y Combinator F24" / > < / a >
< / p >
2026-07-07 13:18:52 +02:00
2026-08-15 14:51:29 +02:00
< p align = "center" >
2026-08-27 13:04:26 +02:00
< code > npx skills add diffusionstudio/skills< / code >
2026-08-15 14:51:29 +02:00
< / p >
2026-08-15 14:55:48 +02:00
< br / >
2026-08-15 14:51:29 +02:00
< p align = "center" >
< a href = "https://app.diffusion.studio" >
< img src = "assets/desktop-screenshot.png" alt = "The Diffusion Studio editor" width = "800" / >
< / a >
< / p >
2026-08-15 14:55:48 +02:00
< br / >
2026-09-03 11:06:41 +02:00
## Diffusion Studio
2026-08-15 14:51:29 +02:00
2026-09-03 11:06:41 +02:00
Edit videos with Codex, Claude Code, OpenCode, or Pi. Refine any output in a fully featured editing environment.
2026-08-27 13:04:26 +02:00
2026-09-03 11:07:41 +02:00
Every edit you make is written to real code, so the agent always sees the latest version. A headless mode is available too.
2026-07-07 13:18:52 +02:00
2026-09-03 11:06:41 +02:00
## What people do with it
2026-08-15 14:51:29 +02:00
2026-09-02 16:33:17 +02:00
Drop your raw footage and files into a folder, then ask for the video you want. That's it.
The agent handles everything from there:
- Cuts the clips
- Removes filler words
- Adds subtitles
- Applies color correction and filters
- Handles animations
- Renders the final video
Beyond finishing a cut, it covers:
2026-08-15 14:51:29 +02:00
- **Motion graphics**: explainers, promos, and title sequences
- **Clipping**: highlights from a long video, reformatted for social
- **Video understanding**: summaries, scene search, quotes with timestamps
2026-07-07 13:18:52 +02:00
2026-07-26 21:00:23 +02:00
## Getting started
2026-09-22 14:28:29 +02:00
Download the desktop app for macOS (Apple Silicon) or Windows (x64), it walks you through setting everything up:
2026-07-26 21:00:23 +02:00
2026-09-22 14:28:29 +02:00
< a href = "https://www.diffusion.studio/download" > < img src = "https://img.shields.io/badge/Download-Diffusion%20Studio-161616?style=for-the-badge&labelColor=000000" alt = "Download Diffusion Studio" / > < / a >
2026-07-26 21:00:23 +02:00
2026-09-23 14:49:01 +02:00
Use with Claude Code, Codex, Cursor, Copilot, or Gemini CLI. The app registers its MCP server with your agent, so just ask for what you want in plain language.
2026-07-26 21:00:23 +02:00
## Prompt examples
2026-08-15 15:04:53 +02:00
< details open >
< summary > < b > Motion graphics< / b > < / summary >
2026-07-26 21:00:23 +02:00
```text
2026-09-24 23:09:47 +02:00
Create a polished, 20-second SaaS product promo video for https://typesafe.ai/. Use the website’ s branding and highlight the product’ s main benefit with animated UI mockups, concise on-screen text, and smooth transitions. End with a clear call to action.
2026-07-26 21:02:37 +02:00
```
2026-07-26 21:00:23 +02:00
2026-07-26 21:02:37 +02:00
```text
2026-09-09 14:52:29 +02:00
Recreate the 3blue1brown animation from https://youtu.be/HEfHFsfGXjs, closely matching its visual style, pacing, framing, colors, labels, and transitions. Use the exact collision mathematics from Gregory Galperin's original paper, do not approximate the physics.
2026-07-26 21:00:23 +02:00
```
2026-08-15 15:04:53 +02:00
< / details >
< details >
< summary > < b > Video editing< / b > < / summary >
2026-07-26 21:00:23 +02:00
```text
2026-09-09 14:52:29 +02:00
Edit the footage in /path/to/folder
2026-07-26 21:02:37 +02:00
```
2026-07-26 21:00:23 +02:00
2026-07-26 21:02:37 +02:00
```text
2026-09-09 14:52:29 +02:00
Turn this footage into a polished YouTube video. Add readable captions and an attention-grabbing graphic in the opening to give viewers a strong visual hook.
2026-07-26 21:00:23 +02:00
```
2026-08-15 15:04:53 +02:00
< / details >
< details >
< summary > < b > Clipping< / b > < / summary >
2026-07-26 21:00:23 +02:00
```text
2026-09-09 14:52:29 +02:00
Can you pull the best 30-second moment from https://youtu.be/MtQ0qxyf-Ds and make a vertical version for social?
2026-07-26 21:02:37 +02:00
```
2026-07-26 21:00:23 +02:00
2026-07-26 21:02:37 +02:00
```text
2026-09-09 14:52:29 +02:00
Make a 15-second version of this launch video. https://x.com/claudeai/status/2045156267690213649
2026-07-26 21:00:23 +02:00
```
2026-08-15 15:04:53 +02:00
< / details >
2026-08-10 14:03:59 +02:00
2026-08-15 15:04:53 +02:00
< details >
< summary > < b > Video understanding and reasoning< / b > < / summary >
2026-08-10 14:03:59 +02:00
```text
2026-09-09 14:52:29 +02:00
In three bullets, explain what starts the conflict. Include timestamps. https://youtu.be/aqz-KE-bpKQ
2026-08-10 14:03:59 +02:00
```
```text
2026-09-09 14:52:29 +02:00
Name three recurring locations and give one visual cue that distinguishes each. https://youtu.be/dQw4w9WgXcQ
2026-08-10 14:03:59 +02:00
```
2026-08-15 15:04:53 +02:00
< / details >
2026-08-15 14:51:29 +02:00
## Made with Diffusion Studio
2026-08-15 14:55:48 +02:00
Both were created by prompting. The compositions are published in [diffusionstudio/open-projects ](https://github.com/diffusionstudio/open-projects ):
2026-08-15 14:51:29 +02:00
| [Launch video ](https://github.com/diffusionstudio/open-projects/tree/main/launch-video ) | [Raise announcement ](https://github.com/diffusionstudio/open-projects/tree/main/raise-announcement ) |
| --- | --- |
| < img src = "assets/launch-video.gif" alt = "Launch video" width = "420" / > | < img src = "assets/raise-announcement.gif" alt = "Raise announcement" width = "420" / > |
2026-09-20 12:01:19 +02:00
## How it works
Diffusion Studio uses [SolidJS ](https://www.solidjs.com ) modules as the document source. Think IDE, but it renders a video canvas instead of text.
Editing works both ways: change something on the canvas and the code updates; change the code and the canvas redraws.
The desktop app includes command-line tools that let agents watch and listen to footage, edit it on a timeline, and render the result.
2026-07-07 13:18:52 +02:00
## Compositions as code
2026-09-23 14:49:01 +02:00
A project is a folder of that JSX: `open` a folder once (`diffusion open <dir>` from a shell), then edit the files. Saving recompiles the entry file and mounts it directly into the editor's ECS.
2026-08-27 13:23:03 +02:00
2026-08-27 13:24:13 +02:00
Every element carries an `id` , which is how the write-back finds its target: a rect dragged on the canvas, a clip trimmed on the timeline, or a retyped line lands as a prop on the element that authored it.
2026-08-27 13:23:03 +02:00
The root is a `<stage>` holding one `<scene>` per frame you cut in:
2026-07-07 13:18:52 +02:00
```tsx
import { For } from "solid-js";
const TITLES = [
2026-07-12 08:39:04 +02:00
{ text: "The Grid", start: 0, end: 2.5 },
{ text: "Neon Nights", start: 2.5, end: 5 },
2026-07-07 13:18:52 +02:00
];
export default function Project() {
return (
2026-08-27 13:23:03 +02:00
< stage camera = {[0.3, 0 , 0 , 0 . 3 , 85 , 150 ] } >
< scene name = "Intro" width = {1920} height = {1080} fill = "black" active >
2026-10-04 11:12:49 +02:00
< video src = "footage/city.mp4" start = {0} end = {5} width = {1920} height = {1080} / >
2026-07-07 13:18:52 +02:00
< For each = {TITLES} >
{(t) => (
2026-07-20 14:15:45 +02:00
< text
2026-08-27 13:23:03 +02:00
width={1920}
height={1080}
2026-07-07 13:18:52 +02:00
textAlign="center"
textBaseline="middle"
fontSize={128}
2026-08-27 13:23:03 +02:00
color="#FFFFFF "
2026-07-12 08:39:04 +02:00
start={t.start}
end={t.end}
2026-07-07 13:18:52 +02:00
>
{t.text}
2026-07-20 14:15:45 +02:00
< / text >
2026-07-07 13:18:52 +02:00
)}
< / For >
2026-08-27 13:23:03 +02:00
< / scene >
< / stage >
2026-07-07 13:18:52 +02:00
);
}
```
Everything a mount produces stays a first-class editor node, so a person can pick up in the UI exactly where the script left off.
## Seeing and hearing the media
2026-09-09 14:01:06 +02:00
Cutting footage requires understanding it. The app exposes the inspection tools an agent needs to work with media it cannot watch — as MCP tools, and as the same commands in a shell:
2026-07-07 13:18:52 +02:00
```sh
2026-10-07 15:04:15 +02:00
diffusion probe clip.mp4 # container + codec metadata, like ffprobe
diffusion grab clip.mp4 -t 0 12 45 # decode frames to PNGs
diffusion filmstrip clip.mp4 # grid of video frames
diffusion waveform track.mp3 # audio waveform, silence flagged
diffusion transcribe interview.wav # timed, word-level transcript
diffusion listen interview.mp4 -p "what is said in the intro?" # ask a multimodal model
diffusion capture intro -t 0 2 4 # the frames a render would produce, by scene id
2026-07-07 13:18:52 +02:00
```
2026-10-07 15:04:15 +02:00
Each command is the MCP tool of the same name: `diffusion grab` is `grab` , `--per-sheet` is `perSheet` .
2026-09-09 14:01:06 +02:00
2026-07-07 13:18:52 +02:00
| Command | Purpose |
| --- | --- |
2026-09-23 14:49:01 +02:00
| `diffusion open` | Launch the app and open (or create) a project folder, anywhere on disk |
| `diffusion context` | Summary of app state |
| `diffusion capture` | Render frames of a scene, as an export would, to a labelled contact sheet or one PNG per position |
| `diffusion check` | Check a node's subtree for structural mistakes (black-frame gaps, never-visible nodes, failed sources) and report subtree stats |
2026-10-07 15:04:15 +02:00
| `diffusion probe` / `grab` / `filmstrip` / `waveform` / `transcribe` / `listen` | Inspect a file by id or path |
2026-10-04 11:12:49 +02:00
| `diffusion fonts` | Discover Google Fonts and local font families |
2026-09-23 14:49:01 +02:00
| `diffusion screenshot` / `diffusion logs` | The app itself: capture the window, read recent console output |
| `diffusion report` | Report a bug in the tools or the app: diagnostics bundled, filed as a GitHub issue via `gh` |
2026-07-07 13:18:52 +02:00
2026-09-09 14:01:06 +02:00
Conventions throughout: every result is one JSON object, the same structured content the MCP tool returns; errors go to stderr with exit code `1` . Everything is built to be piped, grepped, and driven by a program.
2026-07-07 13:18:52 +02:00
## Documentation
2026-09-11 20:33:57 +02:00
- [Tool reference ](docs/reference/tools/README.md ): every tool and CLI command, its options, and its output
2026-10-04 11:12:49 +02:00
- [JSX reference ](docs/reference/jsx/README.md ): the composition markup with elements, timing, paints, and captions
- [Examples ](docs/examples/README.md ): runnable compositions, from basic scenes to three.js and raw WebGPU
2026-07-07 13:18:52 +02:00
## Repository layout
| Path | Package | What it is |
| --- | --- | --- |
| `apps/web` | `@diffusionstudio/web` | The editor UI (Solid + Vite) |
| `apps/desktop` | `@diffusionstudio/desktop` | Electron shell hosting the editor |
2026-09-23 14:49:01 +02:00
| `apps/cli` | `@diffusionstudio/cli` | The `diffusion` CLI (`dapi` alias): a client of the app's MCP server |
2026-08-27 13:23:03 +02:00
| `packages/runtime` | `@diffusionstudio/runtime` | Headless editor runtime: the koota world, traits, actions, systems, media decoding, capture. No DOM, no Solid |
| `packages/reconciler` | `@diffusionstudio/reconciler` | Evaluates a compiled project bundle and reconciles its element tree onto runtime entities, via Solid's universal renderer |
2026-10-04 11:12:49 +02:00
| `packages/jsx` | `@diffusionstudio/jsx` | The authoring API: element vocabulary and types |
2026-08-27 13:23:03 +02:00
| `packages/assets` | `@diffusionstudio/assets` | A project's asset library: the `assets.yml` manifest, content hashing, probing, resolution |
| `packages/encoder` | `@diffusionstudio/encoder` | Offline video/audio/image encoding over runtime worlds (mediabunny) |
| `packages/koota-solid` | `@diffusionstudio/koota-solid` | Solid bindings for koota, ported from `@koota/react` |
2026-07-07 13:18:52 +02:00
## Contributing / local setup
Requirements: Node 20+ and npm.
```sh
git clone https://github.com/diffusionstudio/editor.git
cd editor
npm install
2026-07-08 18:06:51 +02:00
cp apps/web/.env.example apps/web/.env # required: the app won't run without it
2026-08-27 13:23:03 +02:00
npm run dev
2026-07-07 13:18:52 +02:00
```
2026-09-23 14:49:01 +02:00
To put `diffusion` (and its `dapi` alias) on your PATH, link it once (`unlink` undoes it):
2026-07-07 13:18:52 +02:00
```sh
2026-09-22 09:37:31 +02:00
npm run link --workspace=@diffusionstudio/cli
2026-07-07 13:18:52 +02:00
```
Before sending a PR:
```sh
npm run check # typecheck all workspaces
npm run lint # lint all workspaces
2026-09-22 09:54:37 +02:00
npm run test # ensure tests are green
2026-07-07 13:18:52 +02:00
```
## License
[MPL-2.0 ](LICENSE )
2026-08-09 23:25:51 +02:00
The brand assets in [apps/desktop/assets ](apps/desktop/assets ) are not covered by this license. Copyright (c) Diffusion Studio Inc. All rights reserved.