54 Commits

Author SHA1 Message Date
konstantin-paulus
cb852b0ca5 Update brand documentation and assets
- Renamed and clarified sections in design, library, and video guides to enhance consistency and understanding.
- Removed outdated logo assets and adjusted references to branding terminology throughout the documentation.
- Updated color and typography guidelines to reflect a more neutral and flexible approach.
- Streamlined instructions for applying the brand style and using reusable components.
- Enhanced clarity in voice and language guidelines to ensure alignment with the updated brand identity.
2026-09-17 10:27:49 +02:00
konstantin-paulus
53a9ecc7d9 Merge remote-tracking branch 'origin/main' into mcp-support 2026-09-14 11:40:13 +02:00
konstantin-paulus
763ce7aa5c Enhance playhead management and update scene documentation
- Added `playhead` property to the scene, allowing the editor to track the playhead's position when the project is opened, improving playback accuracy.
- Introduced `editPlayhead` function to manage playhead updates, ensuring the file reflects the playhead's position during scrubbing and timeline interactions.
- Updated documentation to clarify the role of the `playhead` property in the scene, emphasizing its importance for project state management.
2026-09-14 00:16:55 +02:00
konstantin-paulus
2874735936 Update scene and stage documentation, and adjust default camera settings
- Enhanced the `scene.md` documentation to clarify the `workarea` property and its implications for playback and export.
- Revised the `stage.md` documentation to provide clearer guidance on the `camera` property, emphasizing the importance of setting a camera for non-standard compositions.
- Updated the default camera settings in the `world.ts` and `types.ts` files to better frame typical project dimensions, ensuring a more intuitive starting point for users.
2026-09-13 21:15:22 +02:00
konstantin-paulus
df9d7d9f84 Remove fetch command and related functionality from the application
- Deleted the `fetch` command from the CLI and associated handlers, streamlining the toolset.
- Updated documentation to reflect the removal of the `fetch` command, emphasizing the use of `yt-dlp` directly for downloading videos.
- Adjusted various components and types to remove references to `fetch`, ensuring consistency across the codebase.
- Enhanced error handling to clarify the absence of the `fetch` functionality.
2026-09-13 16:08:07 +02:00
konstantin-paulus
04f388ff33 Add project initialization tests and refactor project handling logic
- Introduced a new test suite in `projects.init.test.ts` to validate the behavior of the `initProject` function, ensuring it correctly initializes new projects and handles existing project directories.
- Refactored the `initProject` function in `projects.ts` to streamline project setup, including improved handling of entry files and package.json records.
- Enhanced error handling for invalid paths in the `initProject` function, ensuring only absolute paths are accepted.
- Updated the `scaffold` function to utilize the new `ensureRecord` function, improving code clarity and maintainability.
- Added tests for various scenarios, including creating new projects, preserving existing project data, and handling invalid inputs, to ensure robust project management functionality.
2026-09-13 15:53:07 +02:00
konstantin-paulus
f92a8339a4 Refactor documentation and enhance instruction clarity
- Updated the README to clarify how the app's MCP server interacts with agents, emphasizing the guidance provided during sessions.
- Removed outdated comments and code related to skill directories in `skills-cleanup.ts`, streamlining the cleanup process.
- Simplified the `docs.test.ts` file by removing unnecessary tests and focusing on the core functionality of the instructions.
- Refactored the `docs.ts` file to improve the instructions function, ensuring it accurately reflects the current documentation structure and skill usage.
- Enhanced the `server.ts` file by removing the registration of prompts, as this functionality has been deprecated, and clarified the documentation structure in comments.
- Updated `INSTRUCTIONS.md` to provide clearer guidance on using skills and their corresponding documentation, improving user onboarding.
2026-09-13 10:28:18 +02:00
konstantin-paulus
1bbe992345 Refactor and enhance transform functionality in the asset management system
- Replaced the `useModifiers` hook with `useTransforms` to better reflect the new transform functionality.
- Updated components to utilize the new `useTransforms` hook, including `ActionBar` and `PromptInputActions`, improving the handling of transformations.
- Introduced new `TransformItem` component for managing transform actions in the UI.
- Refactored asset handling logic to accommodate the new transform types and ensure compatibility with existing features.
- Removed deprecated modifier-related code and documentation, streamlining the codebase and enhancing clarity.
- Updated documentation to reflect changes in transform functionality and usage examples.
2026-09-12 16:31:36 +02:00
konstantin-paulus
28ad0372db Enhance asset management and introduce partial asset handling
- Updated the `Assets` component to include support for partial assets, allowing for better management of assets that are still generating.
- Introduced a new `PartialAssetItem` component to represent partial documents in the asset panel, providing options to retry or delete failed generations.
- Modified the `AssetInfoPanel` to display information about partial assets, including their status and error messages.
- Refactored the `useAssetSelection` hook to accommodate both assets and partial assets, improving the selection logic.
- Updated the `FolderItem` component to count partial assets alongside regular assets, enhancing folder statistics.
- Removed the `sourceErrorSystem` as part of the cleanup, streamlining error handling for asset generations.
- Added documentation updates to reflect changes in asset handling and the introduction of partial assets.
2026-09-12 15:52:41 +02:00
konstantin-paulus
7a95fada7a Refactor MCP integration and update dependencies
- Removed the `@modelcontextprotocol/sdk` dependency from `package-lock.json` and `package.json`.
- Updated the CLI client to connect via Streamable HTTP instead of a socket, enhancing communication with the MCP server.
- Simplified the `ping` and `call` functions in `cli-client.ts` to utilize the new connection method.
- Removed the `mcp-proxy.ts` file as it is no longer needed with the new HTTP integration.
- Updated documentation to reflect changes in MCP server access and removed references to the socket transport.
- Cleaned up unused imports and refactored related code for improved clarity and maintainability.
2026-09-12 09:18:46 +02:00
konstantin-paulus
093aa671ac Enhance media_transcribe tool and logging functionality
- Updated the `media_transcribe` command to write transcripts to a JSON file, including an output option for specifying the file path.
- Implemented a new `presentTranscript` function to handle the writing of transcripts and return relevant metadata.
- Added filtering options for the `logs` command, including `since` and `contains`, to improve log retrieval capabilities.
- Introduced tests for the new logging features and updated documentation to reflect changes in the `media_transcribe` tool and logging options.
2026-09-11 23:20:46 +02:00
konstantin-paulus
7372c40429 Update documentation references and refactor knowledge handling
- Changed references from `knowledge` to `docs` in README and various files to reflect the new documentation structure.
- Updated `.gitignore` to exclude the `docs` directory instead of `knowledge`.
- Refactored `forge.config.ts` and `main.ts` to utilize the new `docs` directory for staging resources.
- Introduced `stage-docs.mjs` script to manage the staging of documentation files.
- Added new documentation files under `docs/`, including `INSTRUCTIONS.md`, brand guidelines, and design specifications.
- Removed outdated `knowledge` related tests and files to streamline the codebase.
2026-09-11 20:33:57 +02:00
konstantin-paulus
db2a3bd1f3 Implement agent chat functionality in desktop and web applications
- Added `agent-chat.ts` to manage the agent chat host process, including spawning and communication with the host.
- Updated `main.ts` and `main-channels.ts` to integrate agent chat endpoint handling and lifecycle management.
- Introduced new components for the agent chat interface, including `ChatPanel`, `Composer`, and `HeaderActions`, enhancing user interaction.
- Implemented file attachment handling in the chat with `attachments.tsx` and related functionality.
- Updated package dependencies to include `@diffusionstudio/agent-chat` and related libraries for improved chat capabilities.
- Refactored project deletion logic to ensure associated chats are properly managed.
2026-09-11 18:31:56 +02:00
konstantin-paulus
b13dec966a Add agent chat design specification document 2026-09-11 14:25:10 +02:00
konstantin-paulus
312ce2e1b3 Refactor CLI dependencies and update documentation
- Removed Babel-related dependencies from apps/cli/package.json and package-lock.json to streamline the build process.
- Added esbuild as a devDependency in apps/cli/package.json for improved bundling.
- Updated README.md to provide a more detailed description of the dapi CLI tool, clarifying its role as a client of the MCP server and stdio proxy.
- Deleted untyped-modules.d.ts to eliminate unnecessary type declarations for Babel presets.
- Enhanced comments in stage-cli.mjs to clarify the staging process for the dapi CLI within the Electron app.
2026-09-09 14:04:57 +02:00
konstantin-paulus
28135e68cc Update documentation and refine tool references
- Revised the README.md to clarify the app's MCP server functionality and the CLI tool descriptions, ensuring consistency in terminology.
- Updated various sections to replace `dapi` references with direct tool names, enhancing clarity for users.
- Improved instructions for using the CLI commands, including examples and command syntax, to better guide users in their interactions with the app.
- Enhanced the knowledge base documentation to reflect recent changes in tool functionalities and command structures, ensuring users have access to the latest information.
2026-09-09 14:01:06 +02:00
konstantin-paulus
5c0e109cd5 Refactor CLI tool input handling and update documentation
- Replaced the `time` argument with `times` in the CLI commands for consistency across tools.
- Updated the `capture` and `media_grab` tools to handle multiple timestamps, improving flexibility in frame extraction.
- Refactored input validation to utilize `zod` for better error handling and user feedback.
- Removed the `help.ts` module as its functionality has been integrated into the main CLI structure.
- Updated documentation to reflect changes in command syntax and input handling, ensuring clarity for users.
2026-09-09 11:37:43 +02:00
konstantin-paulus
4d4cdda91e Refactor knowledge base integration and update documentation
- Replaced references to 'docs' and 'skills' with 'knowledge' in various configurations and scripts to streamline the knowledge base integration.
- Removed the `stage-docs.mjs` and `stage-skills.mjs` scripts, replacing them with `stage-knowledge.mjs` to facilitate the staging of the knowledge base.
- Updated `README.md` and other documentation to reflect the new structure and paths for the knowledge base resources.
- Adjusted the DAPI server and related components to serve knowledge resources, ensuring agents can access the latest documentation and instructions.
- Enhanced test cases to validate the new knowledge base structure and resource accessibility.
2026-09-08 23:51:36 +02:00
konstantin-paulus
a7039fe8b2 Enhance MCP server integration and add help functionality
- Added `zod` as a dependency in package-lock.json and apps/cli/package.json for input validation.
- Introduced new help.ts module to provide descriptions and validation for CLI commands, ensuring consistency with the app's tool catalog.
- Refactored cli-client.ts to improve timeout handling for tool calls, enhancing error management.
- Created mcp-proxy.ts to facilitate communication between agents and the app's MCP server.
- Updated index.ts to streamline command execution and improve error handling.
- Implemented mcp-config.ts and mcp-install.ts for managing MCP server configurations across different agents.
- Enhanced desktop application to support MCP registration from the menu, improving user experience.
2026-09-08 12:17:03 +02:00
konstantin-paulus
059e1f6e76 Update dependencies and refactor CLI integration
- Added @modelcontextprotocol/sdk as a dependency in package-lock.json and apps/cli/package.json.
- Removed unused @types/ws dependency from package-lock.json and apps/cli/package.json.
- Refactored cli-client.ts to utilize the new SDK for tool interactions, enhancing modularity and performance.
- Updated media handling functions in index.ts to streamline output handling and improve clarity.
- Deleted obsolete protocol.ts and ytdlp.ts files, consolidating functionality within the new SDK.
- Introduced edit-types.ts to define types for source edits, improving type safety and maintainability in the editing process.
- Updated package.json files to include vitest for testing support in both CLI and desktop applications.
2026-09-03 15:53:35 +02:00
konstantin-paulus
905d649141 Refactor CLI and DAPI integration
- Removed @trpc/client and @trpc/server dependencies from package-lock.json and apps/cli/package.json.
- Updated TypeScript configuration in apps/cli/tsconfig.json to simplify compiler options.
- Refactored cli-client.ts to replace TRPC client calls with direct calls to the DAPI, enhancing modularity and performance.
- Adjusted media handling functions in index.ts to utilize the new call method for better clarity and maintainability.
- Cleaned up protocol.ts by introducing encoding and decoding functions for replies, improving data handling consistency.
2026-09-03 10:04:02 +02:00
konstantin-paulus
4d94b87881 Integrate @diffusionstudio/dapi into CLI and desktop applications
- Added @diffusionstudio/dapi as a dependency in package-lock.json, apps/cli/package.json, apps/desktop/package.json, and apps/web/package.json.
- Refactored imports in CLI and desktop source files to utilize types and constants from @diffusionstudio/dapi, enhancing code modularity and maintainability.
- Removed the cli-channels.ts file as its functionality is now encapsulated within the new dapi package.
- Introduced a new MCP server design proposal in docs/mcp-server.md, outlining the transition to a unified API for tool interactions.
2026-09-03 09:40:50 +02:00
konstantin-paulus
c1bc3f0085 Update package.json and README for consistency and clarity
Modified the "check" script in package.json to reference the correct "examples" directory. Updated the README to replace "video editor" with "media compositor" for improved accuracy and restructured some sentences for better readability. Removed outdated documentation files related to assets, CLI, composition, distribution, and getting started, streamlining the documentation for a more focused user experience.
2026-07-20 15:53:30 +02:00
konstantin-paulus
5e42ec2084 Refactor JSX elements to use lowercase tags for consistency
Updated all JSX elements in the documentation and codebase to use lowercase tags (e.g., `<Scene>` to `<scene>`, `<Video>` to `<video>`, etc.) for uniformity and adherence to the new standards. This change enhances clarity and consistency across the JSX API, ensuring that users have a cohesive experience when working with the elements. Updated related documentation to reflect these changes.
2026-07-20 14:15:45 +02:00
konstantin-paulus
2bb2add67b Update JSX elements to PascalCase and enhance type handling in documentation
Refactored JSX elements from lowercase to PascalCase, including `<scene>` to `<Scene>`, `<text>` to `<Text>`, and others, to improve consistency and clarity in the codebase. Updated related documentation to reflect these changes, ensuring that the usage of JSX elements aligns with the new naming conventions. This update enhances the overall readability and usability of the JSX API.
2026-07-19 20:25:33 +02:00
konstantin-paulus
9feb7badc3 Refactor <canvas> to <surface> for improved clarity and functionality
Replaced all instances of `<canvas>` and `<canvasPaint>` with `<surface>` and `<surfacePaint>` across the codebase. Updated related documentation to reflect this change, ensuring consistency in naming and usage. Adjusted rendering logic and component imports to support the new surface functionality, enhancing the drawing capabilities for various context types (2D, WebGL, WebGPU). This refactor improves the overall clarity and usability of the rendering system.
2026-07-18 14:34:18 +02:00
konstantin-paulus
8b9c8ef0cc Add useFile hook for resolving file sources in effects
Introduced the `useFile` hook, which resolves a source (path, asset id, URL, or `generate.*` ref) to its `File`, allowing for reading raw bytes within effects. This hook returns Solid's `createResource` tuple, enabling async resolution and providing loading and error states. Updated documentation to include usage examples for drawing images onto a `<canvas>` and parsing data files, enhancing the functionality for handling media assets in the application.
2026-07-18 10:41:45 +02:00
konstantin-paulus
aaafd86eaa Add <canvas> element and related functionality for custom drawing
Introduced the `<canvas>` element as a shorthand for a rectangle carrying a `<canvasPaint>`, enabling users to draw custom graphics using various context types (2D, WebGL, WebGPU). Updated the rendering system to support this new element, ensuring it integrates with existing components. Enhanced documentation to clarify the usage of `<canvas>` and its properties, and added new samples demonstrating its functionality in different contexts. This update improves the flexibility and creative potential of rendered content.
2026-07-18 09:48:26 +02:00
konstantin-paulus
924218d0d4 Enhance HTML rendering capabilities with new <html> element
Introduced the `<html>` element as a shorthand for a rectangle carrying an `<htmlPaint>`, allowing for browser-laid-out HTML/SVG children. Updated the rendering logic to support this new element, ensuring it integrates seamlessly with existing components. Enhanced documentation to clarify the usage of `<html>` and its properties, and added new samples demonstrating its functionality in various contexts. This update improves the flexibility and interactivity of rendered content.
2026-07-17 19:19:22 +02:00
konstantin-paulus
7c6406c8e7 Update Electron version and enhance documentation for JSX elements
Bumped the Electron version in both `package-lock.json` and `package.json` to `43.1.1`. Removed the deprecated `<jstemp>` component and updated the JSX elements documentation to reflect new aliases for paint elements, including `<solid>`, `<linearGradient>`, `<radialGradient>`, and `<stop>`. Revised the `html-paint.md` and `elements.md` files to clarify the usage of the `<html>` element and its properties. Added new samples demonstrating the use of the `<html>` element in various contexts.
2026-07-17 14:30:04 +02:00
konstantin-paulus
67dcb6fdcc Refactor asset and folder command outputs for consistency and clarity
Update the output format for various asset and folder commands to ensure JSON Lines are emitted on stdout, providing a consistent structure across commands. Enhance error handling to ensure that unknown ids or invalid inputs fail the entire command, improving user feedback and command reliability. This change streamlines the user experience and aligns with the fail-fast convention for batch commands.
2026-07-15 12:39:25 +02:00
konstantin-paulus
e3bbc1e77b Add subtitle support and enhance transcript handling
Introduce parsing for SRT and WebVTT subtitle formats, allowing transcripts to be mounted directly from these files. Update the asset detection logic to recognize subtitle MIME types and adjust the caption handling in the playback system to ensure proper integration. Additionally, enhance the documentation to clarify the usage of the `<captions>` component for manual transcript sourcing.
2026-07-14 11:37:06 +02:00
konstantin-paulus
8fcf8884b8 Update audio and video documentation to reflect volume changes in decibels
Revise the JSX documentation for `<audio>` and `<video>` components to clarify the `volume` prop, now expressed in decibels instead of a linear scale. Update example usages in the README and ensure consistency across related documentation. Additionally, modify the description of volume handling in the CLI to align with the new decibel representation, enhancing user understanding of audio properties.
2026-07-12 13:57:58 +02:00
konstantin-paulus
efb17d896c Refactor timing properties in JSX elements for improved clarity and consistency
Update timing-related properties across various JSX elements, replacing `inPoint`, `outPoint`, and `startTime` with `start`, `end`, `sourceIn`, and `sourceOut`. This change enhances the clarity of temporal placement semantics and aligns with the new structure for managing media timelines. Additionally, update related documentation to reflect these changes, ensuring users have accurate information on timing properties.
2026-07-12 08:39:04 +02:00
konstantin-paulus
125a156fcb Enhance node capture command with timestamp options and documentation updates
Add a `--no-timestamp` option to the `node capture` command, allowing users to disable timestamp labeling on captured images. Update the command description and related documentation to reflect this new functionality, ensuring clarity on the capture process and output format. Additionally, implement a utility function for consistent timestamp labeling across the application, improving the overall user experience when capturing node images.
2026-07-11 08:16:32 +02:00
konstantin-paulus
6878007846 Enhance node capture functionality to support multiple timeline positions
Refactor the `node capture` command to allow capturing images at multiple specified timeline positions, updating the output format to return a JSON line for each capture with the corresponding time and path. Adjust related documentation and descriptions to reflect these changes, improving clarity and usability for users. This update enhances the command's functionality, enabling more precise captures in the application.
2026-07-11 08:10:27 +02:00
konstantin-paulus
6199baf1ab Refactor screenshot command to capture and update documentation
Rename the `screenshot` command to `capture` across the codebase and documentation for consistency. Update related descriptions and references to reflect this change, enhancing clarity in the CLI usage and improving user understanding of the command's functionality. This refactor also includes adjustments in the API handling and documentation to ensure a seamless transition.
2026-07-11 08:04:38 +02:00
konstantin-paulus
d52f63ec76 Refactor media inspection commands and enhance documentation
Replace the `visualize` command with `filmstrip` and introduce a new `waveform` command for rendering audio waveforms. Update type definitions and API handling to reflect these changes, ensuring consistency across the application. Revise documentation to clarify command functionalities and improve user understanding of media asset inspection tools, enhancing overall usability.
2026-07-10 11:01:48 +02:00
konstantin-paulus
121ab67a2d Refactor media command: replace analyze with listen for audio analysis
Update the CLI to replace the `analyze` command with `listen`, focusing on audio track analysis. Modify related documentation and command descriptions to reflect this change, ensuring clarity on the command's functionality. Adjust type definitions and API handling to support the new command structure, enhancing the user experience when working with audio assets.
2026-07-10 08:43:52 +02:00
konstantin-paulus
4a92a1913b Refactor media command structure and update documentation for clarity
Introduce a new `media` command group to replace the previous `asset` command for media inspection tasks, including `probe`, `grab`, `visualize`, `transcribe`, and `analyze`. Update CLI descriptions and documentation to reflect this change, ensuring users can easily understand the functionalities related to media files. This refactor enhances the organization of commands and improves the user experience when working with media assets.
2026-07-10 07:48:28 +02:00
konstantin-paulus
c61b08a162 Update Homebrew cask documentation to reflect renaming from 'diffusion-studio' to 'editor' and adjust installation instructions accordingly 2026-07-10 00:04:16 +02:00
konstantin-paulus
5e3b6d577a Remove outdated API documentation files and introduce new reference files for dapi CLI commands, including context, fonts, models, mount, open, and others. Update the main reference README to reflect the new command structure and organization, ensuring clarity and accessibility for users. This restructuring enhances the overall documentation quality and usability. 2026-07-08 22:33:29 +02:00
konstantin-paulus
3c851e9c3d Enhance DMG configuration for macOS distribution by adding a custom dark background and layout options. Introduce new assets for DMG background in both PNG and SVG formats, and update documentation to reflect changes in the DMG window design and asset generation process. 2026-07-08 16:04:23 +02:00
konstantin-paulus
de6326f42f Update versioning across applications to 0.129.0, add release workflow for GitHub Actions, and enhance desktop app with CLI installation feature. Introduce new scripts for release management and asset handling, including staging the CLI for distribution. Update dependencies and documentation to reflect changes in the build process and application structure. 2026-07-08 15:20:21 +02:00
konstantin-paulus
31332d23a1 Refactor and replace @diffusionstudio/ai and @diffusionstudio/solid with @diffusionstudio/jsx across the codebase. Update dependencies in package-lock.json and documentation to reflect the new JSX runtime and asset generation capabilities. Remove the @diffusionstudio/ai package and its references, ensuring a cohesive transition to the new structure. 2026-07-08 13:30:09 +02:00
konstantin-paulus
7acdd62008 Implement transition support in JSX and rendering systems. Introduce transition prop for clips within <sequence>, allowing for various transition types and durations. Update related type definitions and documentation to reflect these changes, ensuring clarity on usage and behavior of transitions in the composition system. 2026-07-08 13:03:57 +02:00
konstantin-paulus
310ee8eb36 Introduce animatable properties and keyframe support in JSX and rendering systems. Update documentation to reflect new animation capabilities for properties like x, y, width, height, rotation, opacity, and cornerRadius. Implement keyframe management functions and enhance easing options for smoother animations. Ensure compatibility with existing rendering logic and improve type definitions for better clarity. 2026-07-08 10:08:58 +02:00
konstantin-paulus
0d86b8fb12 Enhance asset management by introducing generationKey in asset loading and schema definitions. Update related functions to utilize generationKey for improved caching and retrieval of transcript assets. Refactor documentation to clarify caching behavior in the asset library. 2026-07-08 08:52:50 +02:00
konstantin-paulus
28f71e565c Enhance asset management commands in CLI by introducing dapi asset ls [ids...] for listing raw asset records and dapi asset tree for displaying the asset library as a folder tree. Updated related types and functions to support these changes, ensuring improved flexibility and clarity in asset handling. Adjusted documentation to reflect new command structures and behaviors. 2026-07-07 23:23:32 +02:00
konstantin-paulus
0e2dac7eec Rename transcript command to transcribe across CLI, API, and documentation for consistency. Updated related types, functions, and command descriptions to reflect the new terminology. 2026-07-07 22:21:53 +02:00