91 Commits

Author SHA1 Message Date
konstantin-paulus
7d9d2330a5 Enhance app launch functionality and update route key
- Modified the `launchApp` function in `cli-client.ts` to ensure the environment is correctly passed when launching the app, preventing issues with Electron running as Node.
- Updated the `ROUTE_KEY` in `persist-route.tsx` to a new versioned key, improving route persistence management.
2026-09-13 21:27:24 +02:00
konstantin-paulus
df9d7d9f84 Remove fetch command and related functionality from the application
- Deleted the `fetch` command from the CLI and associated handlers, streamlining the toolset.
- Updated documentation to reflect the removal of the `fetch` command, emphasizing the use of `yt-dlp` directly for downloading videos.
- Adjusted various components and types to remove references to `fetch`, ensuring consistency across the codebase.
- Enhanced error handling to clarify the absence of the `fetch` functionality.
2026-09-13 16:08:07 +02:00
konstantin-paulus
277d44e636 Add MCP server command and enhance dashboard integration
- Introduced a new CLI command to serve the MCP server over stdio for agents unable to connect via URL.
- Updated the dashboard to include a dedicated MCP section, allowing users to manage agent connections and view MCP status.
- Enhanced the sidebar navigation to include a link to the MCP settings, improving user accessibility.
- Added new types and handlers for MCP-related requests in the main application logic.
- Updated the dashboard components to support displaying MCP-related information and actions.
2026-09-12 10:59:38 +02:00
konstantin-paulus
7a95fada7a Refactor MCP integration and update dependencies
- Removed the `@modelcontextprotocol/sdk` dependency from `package-lock.json` and `package.json`.
- Updated the CLI client to connect via Streamable HTTP instead of a socket, enhancing communication with the MCP server.
- Simplified the `ping` and `call` functions in `cli-client.ts` to utilize the new connection method.
- Removed the `mcp-proxy.ts` file as it is no longer needed with the new HTTP integration.
- Updated documentation to reflect changes in MCP server access and removed references to the socket transport.
- Cleaned up unused imports and refactored related code for improved clarity and maintainability.
2026-09-12 09:18:46 +02:00
konstantin-paulus
093aa671ac Enhance media_transcribe tool and logging functionality
- Updated the `media_transcribe` command to write transcripts to a JSON file, including an output option for specifying the file path.
- Implemented a new `presentTranscript` function to handle the writing of transcripts and return relevant metadata.
- Added filtering options for the `logs` command, including `since` and `contains`, to improve log retrieval capabilities.
- Introduced tests for the new logging features and updated documentation to reflect changes in the `media_transcribe` tool and logging options.
2026-09-11 23:20:46 +02:00
konstantin-paulus
312ce2e1b3 Refactor CLI dependencies and update documentation
- Removed Babel-related dependencies from apps/cli/package.json and package-lock.json to streamline the build process.
- Added esbuild as a devDependency in apps/cli/package.json for improved bundling.
- Updated README.md to provide a more detailed description of the dapi CLI tool, clarifying its role as a client of the MCP server and stdio proxy.
- Deleted untyped-modules.d.ts to eliminate unnecessary type declarations for Babel presets.
- Enhanced comments in stage-cli.mjs to clarify the staging process for the dapi CLI within the Electron app.
2026-09-09 14:04:57 +02:00
konstantin-paulus
d5a298f004 Refactor CLI tool descriptions and improve input validation
- Removed fallback parameters from the `field` function in CLI tools to simplify input handling.
- Updated command options for `media_grab`, `media_filmstrip`, and `media_waveform` to remove default descriptions, relying on schema definitions instead.
- Enhanced the `logs` and `fonts` tools to provide clearer descriptions for input fields.
- Improved the `windowFields` schema to include default value descriptions for better user guidance.
- Adjusted the `models` tool to specify model types in the description, enhancing clarity for users.
2026-09-09 11:41:19 +02:00
konstantin-paulus
5c0e109cd5 Refactor CLI tool input handling and update documentation
- Replaced the `time` argument with `times` in the CLI commands for consistency across tools.
- Updated the `capture` and `media_grab` tools to handle multiple timestamps, improving flexibility in frame extraction.
- Refactored input validation to utilize `zod` for better error handling and user feedback.
- Removed the `help.ts` module as its functionality has been integrated into the main CLI structure.
- Updated documentation to reflect changes in command syntax and input handling, ensuring clarity for users.
2026-09-09 11:37:43 +02:00
konstantin-paulus
a7039fe8b2 Enhance MCP server integration and add help functionality
- Added `zod` as a dependency in package-lock.json and apps/cli/package.json for input validation.
- Introduced new help.ts module to provide descriptions and validation for CLI commands, ensuring consistency with the app's tool catalog.
- Refactored cli-client.ts to improve timeout handling for tool calls, enhancing error management.
- Created mcp-proxy.ts to facilitate communication between agents and the app's MCP server.
- Updated index.ts to streamline command execution and improve error handling.
- Implemented mcp-config.ts and mcp-install.ts for managing MCP server configurations across different agents.
- Enhanced desktop application to support MCP registration from the menu, improving user experience.
2026-09-08 12:17:03 +02:00
konstantin-paulus
059e1f6e76 Update dependencies and refactor CLI integration
- Added @modelcontextprotocol/sdk as a dependency in package-lock.json and apps/cli/package.json.
- Removed unused @types/ws dependency from package-lock.json and apps/cli/package.json.
- Refactored cli-client.ts to utilize the new SDK for tool interactions, enhancing modularity and performance.
- Updated media handling functions in index.ts to streamline output handling and improve clarity.
- Deleted obsolete protocol.ts and ytdlp.ts files, consolidating functionality within the new SDK.
- Introduced edit-types.ts to define types for source edits, improving type safety and maintainability in the editing process.
- Updated package.json files to include vitest for testing support in both CLI and desktop applications.
2026-09-03 15:53:35 +02:00
konstantin-paulus
905d649141 Refactor CLI and DAPI integration
- Removed @trpc/client and @trpc/server dependencies from package-lock.json and apps/cli/package.json.
- Updated TypeScript configuration in apps/cli/tsconfig.json to simplify compiler options.
- Refactored cli-client.ts to replace TRPC client calls with direct calls to the DAPI, enhancing modularity and performance.
- Adjusted media handling functions in index.ts to utilize the new call method for better clarity and maintainability.
- Cleaned up protocol.ts by introducing encoding and decoding functions for replies, improving data handling consistency.
2026-09-03 10:04:02 +02:00
konstantin-paulus
4d94b87881 Integrate @diffusionstudio/dapi into CLI and desktop applications
- Added @diffusionstudio/dapi as a dependency in package-lock.json, apps/cli/package.json, apps/desktop/package.json, and apps/web/package.json.
- Refactored imports in CLI and desktop source files to utilize types and constants from @diffusionstudio/dapi, enhancing code modularity and maintainability.
- Removed the cli-channels.ts file as its functionality is now encapsulated within the new dapi package.
- Introduced a new MCP server design proposal in docs/mcp-server.md, outlining the transition to a unified API for tool interactions.
2026-09-03 09:40:50 +02:00
konstantin-paulus
3b0c2608a4 Refine export command description in CLI
- Updated the export command description to clarify the encoding process and settings retrieval from the project's package.json.
- Simplified language for better readability while retaining essential details about output formats and export behavior.
2026-09-01 10:51:42 +02:00
konstantin-paulus
b06d72388e Add export functionality to CLI with configurable settings
- Introduced new export command in the CLI to encode scenes into video files, utilizing settings from the project's package.json.
- Added types for export formats and settings, including video and audio configurations.
- Implemented exportScene function to handle the export process and output results.
- Updated README.md to include documentation for the new export command.
2026-09-01 10:40:24 +02:00
konstantin-paulus
22c75e7e26 Update capture command to render scene frames and improve documentation
- Modified the `capture` command to render single frames of a scene instead of a node, ensuring the output matches the export's encoding.
- Updated command descriptions and argument details to reflect the new functionality, including changes to the time reference and scene handling.
- Enhanced documentation for the `capture` command and related references to clarify usage and expected behavior.
- Improved error messages for invalid scene captures, guiding users to capture the correct scene id.
2026-08-27 12:08:41 +02:00
konstantin-paulus
aea37e16ce Add dapi check command for structural analysis of nodes
- Introduced a new command `dapi check` to analyze a node's subtree for structural issues, including black frames, never-visible nodes, and source errors.
- Implemented types for check requests and results, detailing the structure of issues found during analysis.
- Added a new `check.ts` file to handle the logic for checking nodes, including coverage calculations and issue reporting.
- Updated the `README.md` and reference documentation to include usage instructions and details about the new command.
- Enhanced the CLI with a new command option for checking node integrity without rendering, providing instant feedback on potential issues in the project.
2026-08-26 19:23:29 +02:00
konstantin-paulus
0e68a5d8e4 Enhance context reporting in CLI and DAPI
- Updated the CLI context command description to clarify the information reported, including the application root folder and project details.
- Modified the DAPI context handling to return both the projects root directory and the open project directory, improving the context information available when no project is open.
- Adjusted related documentation to reflect the new structure of the context report, ensuring consistency and clarity for users.
2026-08-25 15:27:56 +02:00
konstantin-paulus
3099d1c122 Refactor asset reference handling and improve media command descriptions
- Updated the `AssetRef` type to only accept paths, simplifying asset reference management.
- Refactored media command descriptions to clarify that local files and URLs can be used without an open project, while library paths require one.
- Enhanced error handling in media commands to specify when paths cannot be resolved, improving user feedback.
- Removed the deprecated `ShellApi` component and integrated its functionality into the new `EditorApi` for better organization and clarity.
2026-08-25 10:27:25 +02:00
konstantin-paulus
c629822d3f Enhance context reporting in CLI and desktop applications
- Updated the CLI command description for `dapi context` to include information about asset generations, improving clarity on the project's state.
- Modified the desktop application documentation to reflect the new context reporting, detailing the status of asset generations (generating, failed, or done) alongside project and playhead information.
- Refactored the context handling in the web application to collect and report generation states, enhancing the overall context management functionality.
2026-08-24 17:11:24 +02:00
konstantin-paulus
8eafe46f16 Update capture functionality and documentation for node IDs
- Changed the `id` type in `CaptureRequest` from number to string to accommodate JSX element IDs.
- Refactored the `resolveNode` function to handle string IDs, improving error handling for ambiguous and non-existent nodes.
- Updated the `README.md` and `capture.md` to clarify the expected format for node IDs, including the use of `file:id` for disambiguation.
- Enhanced the `dapi capture` command documentation to reflect changes in ID handling and provide clearer usage instructions.
2026-08-24 10:58:54 +02:00
konstantin-paulus
963f3c1f6f Enhance project management commands and documentation
- Added the `dapi open` command to launch the app and open or create a project folder, with updates to the `README.md` and `projects.ts` for clarity.
- Implemented `initProject` function to initialize project folders, ensuring they can be opened from any location on disk.
- Updated the `main-channels.ts` and `main.ts` to handle new project initialization requests.
- Enhanced the database schema to support project root types, allowing for better project organization and retrieval.
- Improved the IPC layer to manage multiple routers for different command contexts, ensuring efficient command handling.
2026-08-24 10:26:09 +02:00
konstantin-paulus
b9f3aafd96 Update dapi context command documentation and implementation
- Revised the `dapi context` command description in `README.md`, `index.ts`, and `projects.ts` to clarify its purpose in reporting the current project and playhead position.
- Enhanced the `handleContextGet` function to return detailed project information, including project ID, name, directory, and frame rate.
- Updated the API response structure in `context.ts` to reflect the new project context format, ensuring accurate data representation for users.
- Improved documentation in `context.md` and `README.md` to provide clearer guidance on the command's functionality and expected output.
2026-08-24 09:48:15 +02:00
konstantin-paulus
ac181f985e Update asset management and enhance project features
- Added support for asset manifests with read and write capabilities, allowing for better organization of project assets.
- Introduced new project channels for manifest reading and writing, enhancing communication between main and renderer processes.
- Improved file system interactions with new methods for listing, statting, and removing project files, streamlining asset management.
- Updated package dependencies to include `yaml` for manifest handling and linked `@diffusionstudio/assets` for asset management.
- Refactored existing code to integrate new asset handling features and improve overall project structure.
2026-08-19 11:11:02 +02:00
konstantin-paulus
e85cee917a Refactor CLI and API structure by removing deprecated components
Eliminated the `compile-project.ts` and `open-folder.ts` files from the CLI, streamlining the codebase. Updated the README to reflect changes in CLI commands, including the removal of outdated examples. Adjusted the API to enhance clarity and maintainability by consolidating asset handling functions and removing unused types. This refactor improves the overall architecture and reduces complexity in the CLI interactions.
2026-08-14 14:52:20 +02:00
konstantin-paulus
66a2ef085a Refactor editor API to use new DAPI context
Updated imports in cli-client and sidebar-left components to reference the new DAPI context instead of the deprecated editor-api. Removed the editor-api module and its associated files, streamlining the codebase and improving maintainability. This change enhances the overall architecture by consolidating API interactions under the new DAPI structure.
2026-08-14 13:40:44 +02:00
konstantin-paulus
77050e9bb0 Update package versions to 0.132.0 and enhance CLI environment handling
Bumped version for all applications to 0.132.0. Updated the CLI to properly handle environment variables when spawning processes, ensuring compatibility with Electron and improving overall functionality.
2026-08-11 11:29:17 +02:00
konstantin-paulus
37ebe9d9f5 Remove --open option and associated openInBrowser function from dapi report command
Eliminated the `--open` option from the `dapi report` command, which previously opened the created issue in the default browser. Removed the `openInBrowser` function and updated related documentation to reflect these changes, streamlining the command's functionality and focusing on direct issue filing without browser interaction.
2026-08-02 13:29:20 +02:00
konstantin-paulus
a9c21b4427 Refactor dapi report command for direct issue filing and improved documentation
Updated the `dapi report` command to file GitHub issues directly using the `gh` CLI, removing the previous markdown report generation step. Enhanced the command's description and options in the README and reference documentation to clarify the immediate submission process and the requirement for `gh` authentication. Adjusted related code in the report handling to streamline issue creation and improve user experience.
2026-08-02 11:44:32 +02:00
konstantin-paulus
4e47a7d00f Enhance media frame and node capture functionality with timecoded images
Updated the MediaFrameResult and NodeCaptureResult types to utilize a new TimecodedImage format, which includes timecodes for better clarity. Introduced options for combining frames into contact sheets and specifying frames per sheet, enhancing the output structure. Adjusted related functions and documentation to reflect these changes, improving user understanding of the output format and capabilities.
2026-07-31 10:43:34 +02:00
konstantin-paulus
b9c47a1975 Refactor timecode formatting in media frame and node capture outputs
Updated the naming convention for output PNG files in both media frame and node capture functions to use a more descriptive timecode format (e.g., 00h00m01s15f.png). Introduced a new utility function, `timecodeFilename`, to handle the formatting. Adjusted related documentation to reflect these changes, enhancing clarity for users regarding the output file naming structure.
2026-07-30 00:07:35 +02:00
konstantin-paulus
8772591502 Refactor media frame and node capture to include timecode in output
Updated the MediaFrameResult and related functions to replace the timestamp with a timecode string for better clarity. Adjusted the output structure in both media frame and node capture processes to include timecode, ensuring that captured images and frames are named accordingly. Enhanced documentation to reflect these changes, improving user understanding of the output format.
2026-07-30 00:00:59 +02:00
konstantin-paulus
97ef63115f Add 'report' command to CLI for bug reporting with diagnostics
Introduced a new command `dapi report` that allows users to report bugs in the CLI or the app. This command generates a markdown report containing diagnostics, including the app's status and recent logs, and provides a prefilled GitHub issue URL. Updated the README and reference documentation to include details about the new command and its usage.
2026-07-29 09:30:11 +02:00
konstantin-paulus
0d51ab494b Enhance context command and selection handling in editor API
Updated the context command description for clarity on spatial and temporal references. Refactored the context handling to include selected node IDs, improving the context response structure. Additionally, modified the selection utility to streamline the retrieval of selected node IDs, ensuring consistency across the editor API.
2026-07-26 12:03:24 +02:00
konstantin-paulus
7743b32645 Refactor Trim component to Workarea for improved clarity and functionality
Updated the codebase to replace instances of the Trim component with the Workarea component, enhancing the handling of playback and rendering windows. This change includes adjustments in the context command, encoder, playback system, and rendering logic to utilize the new Workarea structure, ensuring a more intuitive and consistent approach to managing scene work areas.
2026-07-24 17:35:07 +02:00
konstantin-paulus
90d0959a91 Refactor JSX elements to replace <scene> with <rect> using the scene property for root promotion
Updated multiple files to transition from using `<scene>` elements to `<rect>` elements with the `scene` property, promoting rectangle geometries to mount roots. This change enhances the JSX API by clarifying the role of scenes and ensuring consistency across examples and documentation. Additionally, modified related documentation to reflect the new usage and constraints of the `scene` property.
2026-07-24 12:01:41 +02:00
konstantin-paulus
bf0ef25506 Update context command to include workarea trim information in project overview
Enhanced the context command description to specify the inclusion of workarea trim in seconds when set, providing users with a more comprehensive overview of the open project. Additionally, updated the context retrieval logic to calculate and return workarea details based on the active scene's trim settings.
2026-07-24 08:05:59 +02:00
konstantin-paulus
5da1a203a8 Refactor media transcription logic to simplify parameters and improve clarity
Removed optional start and end parameters from the MediaTranscribeRequest type and the mediaTranscribe function, streamlining the transcription process. Updated related documentation to reflect these changes, ensuring a clearer understanding of the transcription command and its usage.
2026-07-23 14:33:14 +02:00
konstantin-paulus
07c47fae94 Enhance audio downsampling logic and update captions documentation
Refactored the downsampleAudio function to improve peak calculation efficiency and accuracy. Updated the logic to handle peak accumulation more effectively, ensuring better audio quality in downsampled outputs. Additionally, expanded the captions documentation to clarify the relationship between timing properties and transcript trimming, enhancing user understanding of captioning mechanics.
2026-07-22 19:21:16 +02:00
konstantin-paulus
81d29d5d88 Add Shader Paint functionality and related components
Introduced a new `<shaderPaint>` element that applies a WGSL fragment shader to the media paint directly below it in the paint stack. Implemented support for shader uniforms and updated the rendering logic to handle shader paints in the engine. Enhanced the API to include shader-related methods and types, ensuring seamless integration with existing media elements. Updated documentation and examples to demonstrate the new shader capabilities, improving user guidance and showcasing practical implementations.
2026-07-20 20:56:32 +02:00
konstantin-paulus
5e42ec2084 Refactor JSX elements to use lowercase tags for consistency
Updated all JSX elements in the documentation and codebase to use lowercase tags (e.g., `<Scene>` to `<scene>`, `<Video>` to `<video>`, etc.) for uniformity and adherence to the new standards. This change enhances clarity and consistency across the JSX API, ensuring that users have a cohesive experience when working with the elements. Updated related documentation to reflect these changes.
2026-07-20 14:15:45 +02:00
konstantin-paulus
d083cd76ed Add screenshot command to CLI and implement screenshot functionality
Introduced a new `screenshot` command in the CLI to capture the entire application window as a PNG. Updated the documentation to include this command and its options. Implemented the screenshot functionality in both the CLI and desktop applications, allowing users to save the screenshot to a specified directory. Enhanced the type definitions to support the new screenshot feature, improving overall usability and functionality.
2026-07-20 10:25:35 +02:00
konstantin-paulus
7f1e8f7a0f Add logging functionality to CLI and desktop applications
Introduced a logging system that captures console output from the running app, including various log levels (debug, info, warning, error). Implemented a new `logs` command in the CLI to display recent log entries, and integrated log handling in the desktop application to maintain a buffer of log entries across reloads. Updated relevant types and API routes to support log retrieval, enhancing debugging capabilities and overall application observability.
2026-07-19 22:28:15 +02:00
konstantin-paulus
2bb2add67b Update JSX elements to PascalCase and enhance type handling in documentation
Refactored JSX elements from lowercase to PascalCase, including `<scene>` to `<Scene>`, `<text>` to `<Text>`, and others, to improve consistency and clarity in the codebase. Updated related documentation to reflect these changes, ensuring that the usage of JSX elements aligns with the new naming conventions. This update enhances the overall readability and usability of the JSX API.
2026-07-19 20:25:33 +02:00
konstantin-paulus
e011b1d593 Refactor mount and insert commands for improved clarity and functionality
Updated the `dapi mount` command to ensure the reactive graph remains live after execution, enhancing the persistence and re-execution of modules across contexts. Simplified the `dapi node insert` command to accept only inline JSX tags, removing the `export default` requirement and clarifying its non-persistent nature. Adjusted related documentation to reflect these changes, ensuring consistency and clarity in usage. This refactor improves the overall usability and understanding of the mounting and insertion processes in the application.
2026-07-19 12:37:08 +02:00
konstantin-paulus
ad2c7e27b7 Enhance module import resolution and documentation for userland packages
Updated the module compilation process to improve import resolution for userland packages, allowing bare specifiers to be rewritten to CDN URLs. Introduced a `dapi.config.json` configuration file for pinning versions and redirecting imports, enhancing reproducibility. Expanded documentation to clarify the import resolution process and added examples for using the new configuration options. This update streamlines the handling of external dependencies and improves the developer experience.
2026-07-18 14:03:23 +02:00
konstantin-paulus
091631e559 Add live mount functionality to the mounting process
Enhance the `mount` command to support a new `--live` option, allowing the reactive graph to remain active after mounting. This change includes updates to the `MountRequest` and `MountOptions` types, as well as modifications to the `handleMount` function to manage live mounts effectively. Additionally, a new utility for managing live mounts has been introduced, improving the overall handling of reactive entities in the engine.
2026-07-17 09:18:41 +02:00
konstantin-paulus
67dcb6fdcc Refactor asset and folder command outputs for consistency and clarity
Update the output format for various asset and folder commands to ensure JSON Lines are emitted on stdout, providing a consistent structure across commands. Enhance error handling to ensure that unknown ids or invalid inputs fail the entire command, improving user feedback and command reliability. This change streamlines the user experience and aligns with the fail-fast convention for batch commands.
2026-07-15 12:39:25 +02:00
konstantin-paulus
429a6c8153 Enhance node capture functionality with output directory option
Add an `output` option to the `CaptureOptions` type, allowing users to specify a directory for saving captured PNG files. Update the `nodeCapture` function to create the specified directory recursively if it doesn't exist, improving flexibility in file management during node captures. This change enhances user experience by providing control over file output locations.
2026-07-15 11:48:28 +02:00
konstantin-paulus
95f4a8d5f5 Refactor error handling and improve directory creation in CLI client
Update the `errnoCode` function to ensure it only processes TRPCClientError instances, enhancing error handling accuracy. Additionally, modify the media processing functions to create output directories recursively, ensuring that the necessary paths exist before file operations. This change improves robustness and reliability in file handling within the CLI application.
2026-07-15 07:35:31 +02:00
konstantin-paulus
54cd22f038 Refactor node capture logic for improved clarity and default handling
Simplify the `nodeCapture` function by consolidating time parsing logic and ensuring default values are handled more gracefully. Update the CLI command description to clarify the default time behavior for captures. This change enhances code readability and user experience by providing clearer expectations for time input.
2026-07-14 09:42:27 +02:00