103 Commits

Author SHA1 Message Date
konstantin-paulus
55e1f1189f Refactor media command structure and update documentation
- Removed the `media` prefix from various commands (`media_grab`, `media_transcribe`, etc.) to simplify usage and improve consistency across the CLI and API.
- Updated the corresponding handlers and references in the codebase to reflect the new command names.
- Enhanced the README and documentation to clarify the changes in command structure and provide updated examples for users.
- Introduced new handlers for `grab`, `transcribe`, `filmstrip`, `waveform`, and `listen`, ensuring they align with the updated command naming conventions.
- Improved error handling and validation in the new command implementations for better user experience.
2026-10-07 15:04:15 +02:00
konstantin-paulus
fe3f1d68e7 Implement estimate option in generate tool for cost and time prediction
- Added an `--estimate` option to the `generate` command, allowing users to retrieve the estimated credits and execution time without starting a job.
- Updated the `generate` function to handle the new estimate logic, returning a structured response with `credits` and `etaSeconds`.
- Enhanced documentation to clarify the usage of the estimate feature and its implications for job execution.
- Modified related types and validation to accommodate the new estimate functionality, ensuring robust input handling.
2026-10-07 12:04:03 +02:00
konstantin-paulus
e18ab84562 Remove media segment functionality and related tests
- Eliminated the `media_segment` command and its associated options from the CLI, streamlining the media handling process.
- Removed references to `media_segment` in the API handlers and tests, ensuring a cleaner codebase.
- Updated the `present` function to no longer handle `media_segment`, focusing on other media processing tasks.
- Adjusted related documentation to reflect the removal of the `media_segment` functionality, enhancing clarity for developers.
2026-10-07 10:29:55 +02:00
konstantin-paulus
21589f4843 Enhance audio handling in media generation and update documentation
- Updated the `generate` function to support audio field references for scenes, allowing users to transcribe audio from scene mixes.
- Introduced new utility functions for audio encoding and scene reference validation, improving the handling of audio uploads.
- Modified the `requireScene` function to include a reason parameter for better error messaging.
- Updated documentation to reflect the new capabilities for transcribing scenes and handling audio, enhancing clarity for developers.
2026-10-07 00:23:55 +02:00
konstantin-paulus
6a0ef3c188 Implement generate and job endpoints in the web API
- Added `generate` and `job` handlers to facilitate media generation and job management through the API.
- Enhanced the `generate` function to handle file uploads and return job details, including estimated run time and credit costs.
- Implemented the `job` function to retrieve job status and results, allowing users to poll for job completion and access generated files.
- Updated documentation to reflect the new endpoints and their usage, improving clarity for developers integrating with the API.
2026-10-06 23:14:59 +02:00
konstantin-paulus
1a8968a396 Refactor generative AI components and update dependencies
- Removed unused imports and code related to generative assets in various components.
- Updated the `package-lock.json` to remove `@diffusionstudio/api-contract` and `@trpc` dependencies.
- Introduced a placeholder mechanism for generative AI features that are currently being rebuilt.
- Adjusted the CLI and documentation to reflect changes in available commands and features.
- Enhanced the handling of timeouts in the CLI client for media analysis and rendering tasks.
2026-10-04 11:12:49 +02:00
konstantin-paulus
d2f0ecb1de Enhance CLI and Desktop Functionality
- Updated the CLI to include a new `window` command for managing the application window state (show/hide).
- Improved the background launch logic to prevent launching the app if it is already running in the background.
- Added new tray icons for different application states (busy, idle, window) to enhance user experience.
- Refactored the `agent-chat` module to improve the handling of the agent chat endpoint and its lifecycle.
- Introduced a `WindowHost` class to manage the main window's lifecycle, ensuring it only exists when needed and integrates with the tray functionality.
- Removed the deprecated `headless` module and adjusted related logic to streamline the application flow.
- Updated the DAPI server to support window management, allowing tools to interact with the main window effectively.
2026-10-01 09:11:07 +02:00
konstantin-paulus
fc63b73214 Add Google Fonts Support and Enhance Font Picker Functionality
- Introduced new options for the `fonts` command to filter by provider and popular fonts, enhancing user experience in font selection.
- Updated the documentation to reflect the inclusion of Google Fonts and local fonts, clarifying how to access and utilize them in projects.
- Implemented a new `FontDropdown` component in the web inspector for improved font selection, allowing users to choose from popular and Google Fonts seamlessly.
- Refactored existing components to integrate the new font selection logic, ensuring consistency across the application.
2026-09-30 11:57:25 +02:00
konstantin-paulus
67e783e5c8 Add Media Segment Tool for Object Tracking in Video
- Introduced the `media_segment` tool to segment objects in video footage using SAM 2.1, allowing users to track objects and generate mask files.
- Implemented input validation for prompts, ensuring at least one point or a bounding box is provided for segmentation.
- Enhanced the output structure to include mask paths and tracking details, improving integration with the `<mask>` component in the editor.
- Added comprehensive documentation for the new tool, detailing usage, input parameters, and expected outputs.
- Updated related components and tests to support the new functionality, ensuring robust performance and user experience.
2026-09-28 15:35:40 +02:00
konstantin-paulus
1539fbc2e9 Refactor CLI command names from dapi to diffusion across documentation and codebase
- Updated all instances of the CLI command from `dapi` to `diffusion` in README, documentation, and source files for consistency.
- Adjusted related scripts and examples to reflect the new command name, enhancing clarity for users and developers.
- Ensured backward compatibility by maintaining `dapi` as an alias where necessary.
2026-09-23 14:49:01 +02:00
konstantin-paulus
1bcbea6093 Remove whoami command and related references from the CLI and documentation
- Deleted the `whoami` command from the CLI, including its associated action and description.
- Updated various documentation files to remove references to the `whoami` tool, ensuring consistency across the project.
- Adjusted related test cases and API handlers to reflect the removal of the `whoami` functionality.
2026-09-20 20:52:52 +02:00
konstantin-paulus
307a6a4a76 Implement Windows CLI shim and update installation process
- Added a new `dev-shim.mjs` script for creating and removing a Windows shim for the `dapi` command, ensuring it points to the correct executable.
- Updated the `package.json` to include new npm scripts for creating and removing the shim.
- Refactored the CLI installation logic to support Windows, including the addition of `refreshCliShim` to rewrite the shim on app updates.
- Enhanced the `mcp-config` to accommodate Windows-specific command handling for the `dapi` binary.
- Introduced tests for the Windows CLI installation and cloud sync functionalities to ensure reliability across platforms.
2026-09-20 15:28:14 +02:00
konstantin-paulus
7d9d2330a5 Enhance app launch functionality and update route key
- Modified the `launchApp` function in `cli-client.ts` to ensure the environment is correctly passed when launching the app, preventing issues with Electron running as Node.
- Updated the `ROUTE_KEY` in `persist-route.tsx` to a new versioned key, improving route persistence management.
2026-09-13 21:27:24 +02:00
konstantin-paulus
df9d7d9f84 Remove fetch command and related functionality from the application
- Deleted the `fetch` command from the CLI and associated handlers, streamlining the toolset.
- Updated documentation to reflect the removal of the `fetch` command, emphasizing the use of `yt-dlp` directly for downloading videos.
- Adjusted various components and types to remove references to `fetch`, ensuring consistency across the codebase.
- Enhanced error handling to clarify the absence of the `fetch` functionality.
2026-09-13 16:08:07 +02:00
konstantin-paulus
277d44e636 Add MCP server command and enhance dashboard integration
- Introduced a new CLI command to serve the MCP server over stdio for agents unable to connect via URL.
- Updated the dashboard to include a dedicated MCP section, allowing users to manage agent connections and view MCP status.
- Enhanced the sidebar navigation to include a link to the MCP settings, improving user accessibility.
- Added new types and handlers for MCP-related requests in the main application logic.
- Updated the dashboard components to support displaying MCP-related information and actions.
2026-09-12 10:59:38 +02:00
konstantin-paulus
7a95fada7a Refactor MCP integration and update dependencies
- Removed the `@modelcontextprotocol/sdk` dependency from `package-lock.json` and `package.json`.
- Updated the CLI client to connect via Streamable HTTP instead of a socket, enhancing communication with the MCP server.
- Simplified the `ping` and `call` functions in `cli-client.ts` to utilize the new connection method.
- Removed the `mcp-proxy.ts` file as it is no longer needed with the new HTTP integration.
- Updated documentation to reflect changes in MCP server access and removed references to the socket transport.
- Cleaned up unused imports and refactored related code for improved clarity and maintainability.
2026-09-12 09:18:46 +02:00
konstantin-paulus
093aa671ac Enhance media_transcribe tool and logging functionality
- Updated the `media_transcribe` command to write transcripts to a JSON file, including an output option for specifying the file path.
- Implemented a new `presentTranscript` function to handle the writing of transcripts and return relevant metadata.
- Added filtering options for the `logs` command, including `since` and `contains`, to improve log retrieval capabilities.
- Introduced tests for the new logging features and updated documentation to reflect changes in the `media_transcribe` tool and logging options.
2026-09-11 23:20:46 +02:00
konstantin-paulus
312ce2e1b3 Refactor CLI dependencies and update documentation
- Removed Babel-related dependencies from apps/cli/package.json and package-lock.json to streamline the build process.
- Added esbuild as a devDependency in apps/cli/package.json for improved bundling.
- Updated README.md to provide a more detailed description of the dapi CLI tool, clarifying its role as a client of the MCP server and stdio proxy.
- Deleted untyped-modules.d.ts to eliminate unnecessary type declarations for Babel presets.
- Enhanced comments in stage-cli.mjs to clarify the staging process for the dapi CLI within the Electron app.
2026-09-09 14:04:57 +02:00
konstantin-paulus
d5a298f004 Refactor CLI tool descriptions and improve input validation
- Removed fallback parameters from the `field` function in CLI tools to simplify input handling.
- Updated command options for `media_grab`, `media_filmstrip`, and `media_waveform` to remove default descriptions, relying on schema definitions instead.
- Enhanced the `logs` and `fonts` tools to provide clearer descriptions for input fields.
- Improved the `windowFields` schema to include default value descriptions for better user guidance.
- Adjusted the `models` tool to specify model types in the description, enhancing clarity for users.
2026-09-09 11:41:19 +02:00
konstantin-paulus
5c0e109cd5 Refactor CLI tool input handling and update documentation
- Replaced the `time` argument with `times` in the CLI commands for consistency across tools.
- Updated the `capture` and `media_grab` tools to handle multiple timestamps, improving flexibility in frame extraction.
- Refactored input validation to utilize `zod` for better error handling and user feedback.
- Removed the `help.ts` module as its functionality has been integrated into the main CLI structure.
- Updated documentation to reflect changes in command syntax and input handling, ensuring clarity for users.
2026-09-09 11:37:43 +02:00
konstantin-paulus
a7039fe8b2 Enhance MCP server integration and add help functionality
- Added `zod` as a dependency in package-lock.json and apps/cli/package.json for input validation.
- Introduced new help.ts module to provide descriptions and validation for CLI commands, ensuring consistency with the app's tool catalog.
- Refactored cli-client.ts to improve timeout handling for tool calls, enhancing error management.
- Created mcp-proxy.ts to facilitate communication between agents and the app's MCP server.
- Updated index.ts to streamline command execution and improve error handling.
- Implemented mcp-config.ts and mcp-install.ts for managing MCP server configurations across different agents.
- Enhanced desktop application to support MCP registration from the menu, improving user experience.
2026-09-08 12:17:03 +02:00
konstantin-paulus
059e1f6e76 Update dependencies and refactor CLI integration
- Added @modelcontextprotocol/sdk as a dependency in package-lock.json and apps/cli/package.json.
- Removed unused @types/ws dependency from package-lock.json and apps/cli/package.json.
- Refactored cli-client.ts to utilize the new SDK for tool interactions, enhancing modularity and performance.
- Updated media handling functions in index.ts to streamline output handling and improve clarity.
- Deleted obsolete protocol.ts and ytdlp.ts files, consolidating functionality within the new SDK.
- Introduced edit-types.ts to define types for source edits, improving type safety and maintainability in the editing process.
- Updated package.json files to include vitest for testing support in both CLI and desktop applications.
2026-09-03 15:53:35 +02:00
konstantin-paulus
905d649141 Refactor CLI and DAPI integration
- Removed @trpc/client and @trpc/server dependencies from package-lock.json and apps/cli/package.json.
- Updated TypeScript configuration in apps/cli/tsconfig.json to simplify compiler options.
- Refactored cli-client.ts to replace TRPC client calls with direct calls to the DAPI, enhancing modularity and performance.
- Adjusted media handling functions in index.ts to utilize the new call method for better clarity and maintainability.
- Cleaned up protocol.ts by introducing encoding and decoding functions for replies, improving data handling consistency.
2026-09-03 10:04:02 +02:00
konstantin-paulus
4d94b87881 Integrate @diffusionstudio/dapi into CLI and desktop applications
- Added @diffusionstudio/dapi as a dependency in package-lock.json, apps/cli/package.json, apps/desktop/package.json, and apps/web/package.json.
- Refactored imports in CLI and desktop source files to utilize types and constants from @diffusionstudio/dapi, enhancing code modularity and maintainability.
- Removed the cli-channels.ts file as its functionality is now encapsulated within the new dapi package.
- Introduced a new MCP server design proposal in docs/mcp-server.md, outlining the transition to a unified API for tool interactions.
2026-09-03 09:40:50 +02:00
konstantin-paulus
3b0c2608a4 Refine export command description in CLI
- Updated the export command description to clarify the encoding process and settings retrieval from the project's package.json.
- Simplified language for better readability while retaining essential details about output formats and export behavior.
2026-09-01 10:51:42 +02:00
konstantin-paulus
b06d72388e Add export functionality to CLI with configurable settings
- Introduced new export command in the CLI to encode scenes into video files, utilizing settings from the project's package.json.
- Added types for export formats and settings, including video and audio configurations.
- Implemented exportScene function to handle the export process and output results.
- Updated README.md to include documentation for the new export command.
2026-09-01 10:40:24 +02:00
konstantin-paulus
22c75e7e26 Update capture command to render scene frames and improve documentation
- Modified the `capture` command to render single frames of a scene instead of a node, ensuring the output matches the export's encoding.
- Updated command descriptions and argument details to reflect the new functionality, including changes to the time reference and scene handling.
- Enhanced documentation for the `capture` command and related references to clarify usage and expected behavior.
- Improved error messages for invalid scene captures, guiding users to capture the correct scene id.
2026-08-27 12:08:41 +02:00
konstantin-paulus
aea37e16ce Add dapi check command for structural analysis of nodes
- Introduced a new command `dapi check` to analyze a node's subtree for structural issues, including black frames, never-visible nodes, and source errors.
- Implemented types for check requests and results, detailing the structure of issues found during analysis.
- Added a new `check.ts` file to handle the logic for checking nodes, including coverage calculations and issue reporting.
- Updated the `README.md` and reference documentation to include usage instructions and details about the new command.
- Enhanced the CLI with a new command option for checking node integrity without rendering, providing instant feedback on potential issues in the project.
2026-08-26 19:23:29 +02:00
konstantin-paulus
0e68a5d8e4 Enhance context reporting in CLI and DAPI
- Updated the CLI context command description to clarify the information reported, including the application root folder and project details.
- Modified the DAPI context handling to return both the projects root directory and the open project directory, improving the context information available when no project is open.
- Adjusted related documentation to reflect the new structure of the context report, ensuring consistency and clarity for users.
2026-08-25 15:27:56 +02:00
konstantin-paulus
3099d1c122 Refactor asset reference handling and improve media command descriptions
- Updated the `AssetRef` type to only accept paths, simplifying asset reference management.
- Refactored media command descriptions to clarify that local files and URLs can be used without an open project, while library paths require one.
- Enhanced error handling in media commands to specify when paths cannot be resolved, improving user feedback.
- Removed the deprecated `ShellApi` component and integrated its functionality into the new `EditorApi` for better organization and clarity.
2026-08-25 10:27:25 +02:00
konstantin-paulus
c629822d3f Enhance context reporting in CLI and desktop applications
- Updated the CLI command description for `dapi context` to include information about asset generations, improving clarity on the project's state.
- Modified the desktop application documentation to reflect the new context reporting, detailing the status of asset generations (generating, failed, or done) alongside project and playhead information.
- Refactored the context handling in the web application to collect and report generation states, enhancing the overall context management functionality.
2026-08-24 17:11:24 +02:00
konstantin-paulus
8eafe46f16 Update capture functionality and documentation for node IDs
- Changed the `id` type in `CaptureRequest` from number to string to accommodate JSX element IDs.
- Refactored the `resolveNode` function to handle string IDs, improving error handling for ambiguous and non-existent nodes.
- Updated the `README.md` and `capture.md` to clarify the expected format for node IDs, including the use of `file:id` for disambiguation.
- Enhanced the `dapi capture` command documentation to reflect changes in ID handling and provide clearer usage instructions.
2026-08-24 10:58:54 +02:00
konstantin-paulus
963f3c1f6f Enhance project management commands and documentation
- Added the `dapi open` command to launch the app and open or create a project folder, with updates to the `README.md` and `projects.ts` for clarity.
- Implemented `initProject` function to initialize project folders, ensuring they can be opened from any location on disk.
- Updated the `main-channels.ts` and `main.ts` to handle new project initialization requests.
- Enhanced the database schema to support project root types, allowing for better project organization and retrieval.
- Improved the IPC layer to manage multiple routers for different command contexts, ensuring efficient command handling.
2026-08-24 10:26:09 +02:00
konstantin-paulus
b9f3aafd96 Update dapi context command documentation and implementation
- Revised the `dapi context` command description in `README.md`, `index.ts`, and `projects.ts` to clarify its purpose in reporting the current project and playhead position.
- Enhanced the `handleContextGet` function to return detailed project information, including project ID, name, directory, and frame rate.
- Updated the API response structure in `context.ts` to reflect the new project context format, ensuring accurate data representation for users.
- Improved documentation in `context.md` and `README.md` to provide clearer guidance on the command's functionality and expected output.
2026-08-24 09:48:15 +02:00
konstantin-paulus
ac181f985e Update asset management and enhance project features
- Added support for asset manifests with read and write capabilities, allowing for better organization of project assets.
- Introduced new project channels for manifest reading and writing, enhancing communication between main and renderer processes.
- Improved file system interactions with new methods for listing, statting, and removing project files, streamlining asset management.
- Updated package dependencies to include `yaml` for manifest handling and linked `@diffusionstudio/assets` for asset management.
- Refactored existing code to integrate new asset handling features and improve overall project structure.
2026-08-19 11:11:02 +02:00
konstantin-paulus
e85cee917a Refactor CLI and API structure by removing deprecated components
Eliminated the `compile-project.ts` and `open-folder.ts` files from the CLI, streamlining the codebase. Updated the README to reflect changes in CLI commands, including the removal of outdated examples. Adjusted the API to enhance clarity and maintainability by consolidating asset handling functions and removing unused types. This refactor improves the overall architecture and reduces complexity in the CLI interactions.
2026-08-14 14:52:20 +02:00
konstantin-paulus
66a2ef085a Refactor editor API to use new DAPI context
Updated imports in cli-client and sidebar-left components to reference the new DAPI context instead of the deprecated editor-api. Removed the editor-api module and its associated files, streamlining the codebase and improving maintainability. This change enhances the overall architecture by consolidating API interactions under the new DAPI structure.
2026-08-14 13:40:44 +02:00
konstantin-paulus
77050e9bb0 Update package versions to 0.132.0 and enhance CLI environment handling
Bumped version for all applications to 0.132.0. Updated the CLI to properly handle environment variables when spawning processes, ensuring compatibility with Electron and improving overall functionality.
2026-08-11 11:29:17 +02:00
konstantin-paulus
37ebe9d9f5 Remove --open option and associated openInBrowser function from dapi report command
Eliminated the `--open` option from the `dapi report` command, which previously opened the created issue in the default browser. Removed the `openInBrowser` function and updated related documentation to reflect these changes, streamlining the command's functionality and focusing on direct issue filing without browser interaction.
2026-08-02 13:29:20 +02:00
konstantin-paulus
a9c21b4427 Refactor dapi report command for direct issue filing and improved documentation
Updated the `dapi report` command to file GitHub issues directly using the `gh` CLI, removing the previous markdown report generation step. Enhanced the command's description and options in the README and reference documentation to clarify the immediate submission process and the requirement for `gh` authentication. Adjusted related code in the report handling to streamline issue creation and improve user experience.
2026-08-02 11:44:32 +02:00
konstantin-paulus
4e47a7d00f Enhance media frame and node capture functionality with timecoded images
Updated the MediaFrameResult and NodeCaptureResult types to utilize a new TimecodedImage format, which includes timecodes for better clarity. Introduced options for combining frames into contact sheets and specifying frames per sheet, enhancing the output structure. Adjusted related functions and documentation to reflect these changes, improving user understanding of the output format and capabilities.
2026-07-31 10:43:34 +02:00
konstantin-paulus
b9c47a1975 Refactor timecode formatting in media frame and node capture outputs
Updated the naming convention for output PNG files in both media frame and node capture functions to use a more descriptive timecode format (e.g., 00h00m01s15f.png). Introduced a new utility function, `timecodeFilename`, to handle the formatting. Adjusted related documentation to reflect these changes, enhancing clarity for users regarding the output file naming structure.
2026-07-30 00:07:35 +02:00
konstantin-paulus
8772591502 Refactor media frame and node capture to include timecode in output
Updated the MediaFrameResult and related functions to replace the timestamp with a timecode string for better clarity. Adjusted the output structure in both media frame and node capture processes to include timecode, ensuring that captured images and frames are named accordingly. Enhanced documentation to reflect these changes, improving user understanding of the output format.
2026-07-30 00:00:59 +02:00
konstantin-paulus
97ef63115f Add 'report' command to CLI for bug reporting with diagnostics
Introduced a new command `dapi report` that allows users to report bugs in the CLI or the app. This command generates a markdown report containing diagnostics, including the app's status and recent logs, and provides a prefilled GitHub issue URL. Updated the README and reference documentation to include details about the new command and its usage.
2026-07-29 09:30:11 +02:00
konstantin-paulus
0d51ab494b Enhance context command and selection handling in editor API
Updated the context command description for clarity on spatial and temporal references. Refactored the context handling to include selected node IDs, improving the context response structure. Additionally, modified the selection utility to streamline the retrieval of selected node IDs, ensuring consistency across the editor API.
2026-07-26 12:03:24 +02:00
konstantin-paulus
7743b32645 Refactor Trim component to Workarea for improved clarity and functionality
Updated the codebase to replace instances of the Trim component with the Workarea component, enhancing the handling of playback and rendering windows. This change includes adjustments in the context command, encoder, playback system, and rendering logic to utilize the new Workarea structure, ensuring a more intuitive and consistent approach to managing scene work areas.
2026-07-24 17:35:07 +02:00
konstantin-paulus
90d0959a91 Refactor JSX elements to replace <scene> with <rect> using the scene property for root promotion
Updated multiple files to transition from using `<scene>` elements to `<rect>` elements with the `scene` property, promoting rectangle geometries to mount roots. This change enhances the JSX API by clarifying the role of scenes and ensuring consistency across examples and documentation. Additionally, modified related documentation to reflect the new usage and constraints of the `scene` property.
2026-07-24 12:01:41 +02:00
konstantin-paulus
bf0ef25506 Update context command to include workarea trim information in project overview
Enhanced the context command description to specify the inclusion of workarea trim in seconds when set, providing users with a more comprehensive overview of the open project. Additionally, updated the context retrieval logic to calculate and return workarea details based on the active scene's trim settings.
2026-07-24 08:05:59 +02:00
konstantin-paulus
5da1a203a8 Refactor media transcription logic to simplify parameters and improve clarity
Removed optional start and end parameters from the MediaTranscribeRequest type and the mediaTranscribe function, streamlining the transcription process. Updated related documentation to reflect these changes, ensuring a clearer understanding of the transcription command and its usage.
2026-07-23 14:33:14 +02:00
konstantin-paulus
07c47fae94 Enhance audio downsampling logic and update captions documentation
Refactored the downsampleAudio function to improve peak calculation efficiency and accuracy. Updated the logic to handle peak accumulation more effectively, ensuring better audio quality in downsampled outputs. Additionally, expanded the captions documentation to clarify the relationship between timing properties and transcript trimming, enhancing user understanding of captioning mechanics.
2026-07-22 19:21:16 +02:00