- Removed outdated API reference from the `.env.example` file.
- Updated `@diffusionstudio/api-contract` dependency version to `^0.4.0` in both `package.json` files.
- Replaced model name `gemini-3.5-flash` with `qwen3.8-omni-flash` in configuration and documentation, ensuring alignment with the latest model capabilities.
- Added a note in the editor documentation regarding project management in cloud-synced folders to prevent issues with media handling.
- Updated documentation for various media tools to reflect the removal of the `media` prefix from command names, enhancing clarity and consistency.
- Adjusted links and references in the documentation to point to the new command structures for `grab`, `transcribe`, `filmstrip`, `waveform`, and `listen`.
- Added new documentation for the `filmstrip`, `grab`, `listen`, `probe`, and `transcribe` tools, detailing their functionalities and usage.
- Improved error handling descriptions and examples in the documentation to assist users in understanding tool operations better.
- Removed the `media` prefix from various commands (`media_grab`, `media_transcribe`, etc.) to simplify usage and improve consistency across the CLI and API.
- Updated the corresponding handlers and references in the codebase to reflect the new command names.
- Enhanced the README and documentation to clarify the changes in command structure and provide updated examples for users.
- Introduced new handlers for `grab`, `transcribe`, `filmstrip`, `waveform`, and `listen`, ensuring they align with the updated command naming conventions.
- Improved error handling and validation in the new command implementations for better user experience.
- Introduced a new `audioFile` function to extract audio from assets, ensuring only the audio track is uploaded for analysis and transcription.
- Updated `mediaListen` and `mediaTranscribe` handlers to utilize the new audio extraction logic, improving efficiency and clarity in processing audio and video assets.
- Implemented error handling for audio analysis and transcription, ensuring robust responses for unsupported formats and empty audio tracks.
- Added `requireSignIn` and `apiError` functions to manage user authentication and API error handling, enhancing the reliability of tool operations.
- Updated documentation to reflect changes in audio processing and tool functionalities, providing clearer guidance for users.
- Replaced outdated model names in the configuration with new models: `remove-background` and `upscale-image` are now `bria-rmbg-2.0` and `seedvr-2`, respectively.
- Updated the `request` logic in the `use-transforms` file to reflect the new model names for background removal and image/video upscaling.
- Changed the transcription model from `transcribe` to `universal-3.5-pro` in the captions generation process.
- Adjusted documentation to align with the new model names and their functionalities, ensuring clarity for users.
- Added an `--estimate` option to the `generate` command, allowing users to retrieve the estimated credits and execution time without starting a job.
- Updated the `generate` function to handle the new estimate logic, returning a structured response with `credits` and `etaSeconds`.
- Enhanced documentation to clarify the usage of the estimate feature and its implications for job execution.
- Modified related types and validation to accommodate the new estimate functionality, ensuring robust input handling.
- Eliminated the `media_segment` command and its associated options from the CLI, streamlining the media handling process.
- Removed references to `media_segment` in the API handlers and tests, ensuring a cleaner codebase.
- Updated the `present` function to no longer handle `media_segment`, focusing on other media processing tasks.
- Adjusted related documentation to reflect the removal of the `media_segment` functionality, enhancing clarity for developers.
- Updated the `generate` function to support audio field references for scenes, allowing users to transcribe audio from scene mixes.
- Introduced new utility functions for audio encoding and scene reference validation, improving the handling of audio uploads.
- Modified the `requireScene` function to include a reason parameter for better error messaging.
- Updated documentation to reflect the new capabilities for transcribing scenes and handling audio, enhancing clarity for developers.
- Added `generate` and `job` handlers to facilitate media generation and job management through the API.
- Enhanced the `generate` function to handle file uploads and return job details, including estimated run time and credit costs.
- Implemented the `job` function to retrieve job status and results, allowing users to poll for job completion and access generated files.
- Updated documentation to reflect the new endpoints and their usage, improving clarity for developers integrating with the API.
- Removed unused imports and code related to generative assets in various components.
- Updated the `package-lock.json` to remove `@diffusionstudio/api-contract` and `@trpc` dependencies.
- Introduced a placeholder mechanism for generative AI features that are currently being rebuilt.
- Adjusted the CLI and documentation to reflect changes in available commands and features.
- Enhanced the handling of timeouts in the CLI client for media analysis and rendering tasks.
- Updated the CLI to include a new `window` command for managing the application window state (show/hide).
- Improved the background launch logic to prevent launching the app if it is already running in the background.
- Added new tray icons for different application states (busy, idle, window) to enhance user experience.
- Refactored the `agent-chat` module to improve the handling of the agent chat endpoint and its lifecycle.
- Introduced a `WindowHost` class to manage the main window's lifecycle, ensuring it only exists when needed and integrates with the tray functionality.
- Removed the deprecated `headless` module and adjusted related logic to streamline the application flow.
- Updated the DAPI server to support window management, allowing tools to interact with the main window effectively.
- Introduced new options for the `fonts` command to filter by provider and popular fonts, enhancing user experience in font selection.
- Updated the documentation to reflect the inclusion of Google Fonts and local fonts, clarifying how to access and utilize them in projects.
- Implemented a new `FontDropdown` component in the web inspector for improved font selection, allowing users to choose from popular and Google Fonts seamlessly.
- Refactored existing components to integrate the new font selection logic, ensuring consistency across the application.
- Updated the animations documentation to clarify the behavior of presets, emphasizing that they scale or shift the node's authored properties rather than replacing them.
- Modified the `applyAnimation` function to ensure that computed values are compounded correctly for overlapping animations, improving the accuracy of visual effects during animation playback.
- Enhanced the `present` function to support background track processing in the `media_segment` tool, allowing for real-time tracking and reporting of mask states.
- Introduced a new `presentContext` function to manage the output of background tracks, including their progress and contact sheets.
- Updated the `context` tool to report the status of ongoing background tracks, including their state and associated images.
- Modified the `media_segment` tool to return tracking states and paths, improving integration with the `<mask>` component in the editor.
- Enhanced documentation to clarify the new behavior and usage of background tracks in the context of media segmentation.
- Introduced the `media_segment` tool to segment objects in video footage using SAM 2.1, allowing users to track objects and generate mask files.
- Implemented input validation for prompts, ensuring at least one point or a bounding box is provided for segmentation.
- Enhanced the output structure to include mask paths and tracking details, improving integration with the `<mask>` component in the editor.
- Added comprehensive documentation for the new tool, detailing usage, input parameters, and expected outputs.
- Updated related components and tests to support the new functionality, ensuring robust performance and user experience.
- Renamed mask-related components and functions to reflect the new terminology of "clip path" throughout the codebase.
- Introduced a new `ClipPathsSettings` component for managing clip paths in the inspector.
- Updated the `Inspector` to integrate clip path settings and adjusted related logic to accommodate the new structure.
- Enhanced the `ObjectMenu` to change "Set mask target" to "Set clip path target" for clarity.
- Refactored various utility functions and traits to replace mask references with clip path equivalents, ensuring consistent behavior across the application.
- Updated documentation and type definitions to reflect the transition from masks to clip paths, improving clarity for developers.
- Added new `ObjectMaskPanel` component to manage object masks within the effects inspector.
- Introduced functionality for adding and managing object masks, including dropdown menus for selecting masks and controls for editing.
- Enhanced the `EffectsInspector` to support object mask interactions, including displaying existing masks and allowing users to track new objects.
- Implemented brush functionality for painting masks directly onto video clips, improving user experience for object segmentation.
- Updated cursor styles for the object mask tool to provide clearer visual feedback during interactions.
- Refactored related components and utilities to support the new object mask features, ensuring seamless integration with existing functionality.
- Added the `Object Mask` tool to the toolbar and sidebar menu, allowing users to select and utilize this new functionality.
- Introduced a new SVG icon for the `Object Mask` tool to improve visual representation in the UI.
- Updated the `Inspector` component to display the `ObjectMaskPanel` when the `Object Mask` tool is selected.
- Enhanced the `Effect` options to include `opacity`, allowing for more refined control over visual effects.
- Updated documentation to reflect the new `<mask>` element and its properties, improving clarity for developers.
- Refactored related components to ensure seamless integration of the new tool and its functionalities.
- Updated the CLI installation logic to use `diffusion` instead of `dapi`, including changes to link paths and installation scripts for macOS.
- Enhanced the status checking functions to reflect the new command structure, ensuring accurate detection of installed links.
- Adjusted comments and documentation throughout the codebase to improve clarity regarding the `diffusion` command and its aliases.
- Ensured backward compatibility by maintaining `dapi` as an alias where necessary.
- Updated all instances of the CLI command from `dapi` to `diffusion` in README, documentation, and source files for consistency.
- Adjusted related scripts and examples to reflect the new command name, enhancing clarity for users and developers.
- Ensured backward compatibility by maintaining `dapi` as an alias where necessary.
- Deleted the `whoami` command from the CLI, including its associated action and description.
- Updated various documentation files to remove references to the `whoami` tool, ensuring consistency across the project.
- Adjusted related test cases and API handlers to reflect the removal of the `whoami` functionality.
- Added a new `dev-shim.mjs` script for creating and removing a Windows shim for the `dapi` command, ensuring it points to the correct executable.
- Updated the `package.json` to include new npm scripts for creating and removing the shim.
- Refactored the CLI installation logic to support Windows, including the addition of `refreshCliShim` to rewrite the shim on app updates.
- Enhanced the `mcp-config` to accommodate Windows-specific command handling for the `dapi` binary.
- Introduced tests for the Windows CLI installation and cloud sync functionalities to ensure reliability across platforms.
- Renamed and clarified sections in design, library, and video guides to enhance consistency and understanding.
- Removed outdated logo assets and adjusted references to branding terminology throughout the documentation.
- Updated color and typography guidelines to reflect a more neutral and flexible approach.
- Streamlined instructions for applying the brand style and using reusable components.
- Enhanced clarity in voice and language guidelines to ensure alignment with the updated brand identity.
- Added `playhead` property to the scene, allowing the editor to track the playhead's position when the project is opened, improving playback accuracy.
- Introduced `editPlayhead` function to manage playhead updates, ensuring the file reflects the playhead's position during scrubbing and timeline interactions.
- Updated documentation to clarify the role of the `playhead` property in the scene, emphasizing its importance for project state management.
- Enhanced the `scene.md` documentation to clarify the `workarea` property and its implications for playback and export.
- Revised the `stage.md` documentation to provide clearer guidance on the `camera` property, emphasizing the importance of setting a camera for non-standard compositions.
- Updated the default camera settings in the `world.ts` and `types.ts` files to better frame typical project dimensions, ensuring a more intuitive starting point for users.
- Deleted the `fetch` command from the CLI and associated handlers, streamlining the toolset.
- Updated documentation to reflect the removal of the `fetch` command, emphasizing the use of `yt-dlp` directly for downloading videos.
- Adjusted various components and types to remove references to `fetch`, ensuring consistency across the codebase.
- Enhanced error handling to clarify the absence of the `fetch` functionality.
- Introduced a new test suite in `projects.init.test.ts` to validate the behavior of the `initProject` function, ensuring it correctly initializes new projects and handles existing project directories.
- Refactored the `initProject` function in `projects.ts` to streamline project setup, including improved handling of entry files and package.json records.
- Enhanced error handling for invalid paths in the `initProject` function, ensuring only absolute paths are accepted.
- Updated the `scaffold` function to utilize the new `ensureRecord` function, improving code clarity and maintainability.
- Added tests for various scenarios, including creating new projects, preserving existing project data, and handling invalid inputs, to ensure robust project management functionality.
- Updated the README to clarify how the app's MCP server interacts with agents, emphasizing the guidance provided during sessions.
- Removed outdated comments and code related to skill directories in `skills-cleanup.ts`, streamlining the cleanup process.
- Simplified the `docs.test.ts` file by removing unnecessary tests and focusing on the core functionality of the instructions.
- Refactored the `docs.ts` file to improve the instructions function, ensuring it accurately reflects the current documentation structure and skill usage.
- Enhanced the `server.ts` file by removing the registration of prompts, as this functionality has been deprecated, and clarified the documentation structure in comments.
- Updated `INSTRUCTIONS.md` to provide clearer guidance on using skills and their corresponding documentation, improving user onboarding.
- Replaced the `useModifiers` hook with `useTransforms` to better reflect the new transform functionality.
- Updated components to utilize the new `useTransforms` hook, including `ActionBar` and `PromptInputActions`, improving the handling of transformations.
- Introduced new `TransformItem` component for managing transform actions in the UI.
- Refactored asset handling logic to accommodate the new transform types and ensure compatibility with existing features.
- Removed deprecated modifier-related code and documentation, streamlining the codebase and enhancing clarity.
- Updated documentation to reflect changes in transform functionality and usage examples.
- Updated the `Assets` component to include support for partial assets, allowing for better management of assets that are still generating.
- Introduced a new `PartialAssetItem` component to represent partial documents in the asset panel, providing options to retry or delete failed generations.
- Modified the `AssetInfoPanel` to display information about partial assets, including their status and error messages.
- Refactored the `useAssetSelection` hook to accommodate both assets and partial assets, improving the selection logic.
- Updated the `FolderItem` component to count partial assets alongside regular assets, enhancing folder statistics.
- Removed the `sourceErrorSystem` as part of the cleanup, streamlining error handling for asset generations.
- Added documentation updates to reflect changes in asset handling and the introduction of partial assets.
- Removed the `@modelcontextprotocol/sdk` dependency from `package-lock.json` and `package.json`.
- Updated the CLI client to connect via Streamable HTTP instead of a socket, enhancing communication with the MCP server.
- Simplified the `ping` and `call` functions in `cli-client.ts` to utilize the new connection method.
- Removed the `mcp-proxy.ts` file as it is no longer needed with the new HTTP integration.
- Updated documentation to reflect changes in MCP server access and removed references to the socket transport.
- Cleaned up unused imports and refactored related code for improved clarity and maintainability.
- Updated the `media_transcribe` command to write transcripts to a JSON file, including an output option for specifying the file path.
- Implemented a new `presentTranscript` function to handle the writing of transcripts and return relevant metadata.
- Added filtering options for the `logs` command, including `since` and `contains`, to improve log retrieval capabilities.
- Introduced tests for the new logging features and updated documentation to reflect changes in the `media_transcribe` tool and logging options.
- Changed references from `knowledge` to `docs` in README and various files to reflect the new documentation structure.
- Updated `.gitignore` to exclude the `docs` directory instead of `knowledge`.
- Refactored `forge.config.ts` and `main.ts` to utilize the new `docs` directory for staging resources.
- Introduced `stage-docs.mjs` script to manage the staging of documentation files.
- Added new documentation files under `docs/`, including `INSTRUCTIONS.md`, brand guidelines, and design specifications.
- Removed outdated `knowledge` related tests and files to streamline the codebase.
- Added `agent-chat.ts` to manage the agent chat host process, including spawning and communication with the host.
- Updated `main.ts` and `main-channels.ts` to integrate agent chat endpoint handling and lifecycle management.
- Introduced new components for the agent chat interface, including `ChatPanel`, `Composer`, and `HeaderActions`, enhancing user interaction.
- Implemented file attachment handling in the chat with `attachments.tsx` and related functionality.
- Updated package dependencies to include `@diffusionstudio/agent-chat` and related libraries for improved chat capabilities.
- Refactored project deletion logic to ensure associated chats are properly managed.
- Removed Babel-related dependencies from apps/cli/package.json and package-lock.json to streamline the build process.
- Added esbuild as a devDependency in apps/cli/package.json for improved bundling.
- Updated README.md to provide a more detailed description of the dapi CLI tool, clarifying its role as a client of the MCP server and stdio proxy.
- Deleted untyped-modules.d.ts to eliminate unnecessary type declarations for Babel presets.
- Enhanced comments in stage-cli.mjs to clarify the staging process for the dapi CLI within the Electron app.
- Revised the README.md to clarify the app's MCP server functionality and the CLI tool descriptions, ensuring consistency in terminology.
- Updated various sections to replace `dapi` references with direct tool names, enhancing clarity for users.
- Improved instructions for using the CLI commands, including examples and command syntax, to better guide users in their interactions with the app.
- Enhanced the knowledge base documentation to reflect recent changes in tool functionalities and command structures, ensuring users have access to the latest information.
- Replaced the `time` argument with `times` in the CLI commands for consistency across tools.
- Updated the `capture` and `media_grab` tools to handle multiple timestamps, improving flexibility in frame extraction.
- Refactored input validation to utilize `zod` for better error handling and user feedback.
- Removed the `help.ts` module as its functionality has been integrated into the main CLI structure.
- Updated documentation to reflect changes in command syntax and input handling, ensuring clarity for users.
- Replaced references to 'docs' and 'skills' with 'knowledge' in various configurations and scripts to streamline the knowledge base integration.
- Removed the `stage-docs.mjs` and `stage-skills.mjs` scripts, replacing them with `stage-knowledge.mjs` to facilitate the staging of the knowledge base.
- Updated `README.md` and other documentation to reflect the new structure and paths for the knowledge base resources.
- Adjusted the DAPI server and related components to serve knowledge resources, ensuring agents can access the latest documentation and instructions.
- Enhanced test cases to validate the new knowledge base structure and resource accessibility.
- Added `zod` as a dependency in package-lock.json and apps/cli/package.json for input validation.
- Introduced new help.ts module to provide descriptions and validation for CLI commands, ensuring consistency with the app's tool catalog.
- Refactored cli-client.ts to improve timeout handling for tool calls, enhancing error management.
- Created mcp-proxy.ts to facilitate communication between agents and the app's MCP server.
- Updated index.ts to streamline command execution and improve error handling.
- Implemented mcp-config.ts and mcp-install.ts for managing MCP server configurations across different agents.
- Enhanced desktop application to support MCP registration from the menu, improving user experience.
- Added @modelcontextprotocol/sdk as a dependency in package-lock.json and apps/cli/package.json.
- Removed unused @types/ws dependency from package-lock.json and apps/cli/package.json.
- Refactored cli-client.ts to utilize the new SDK for tool interactions, enhancing modularity and performance.
- Updated media handling functions in index.ts to streamline output handling and improve clarity.
- Deleted obsolete protocol.ts and ytdlp.ts files, consolidating functionality within the new SDK.
- Introduced edit-types.ts to define types for source edits, improving type safety and maintainability in the editing process.
- Updated package.json files to include vitest for testing support in both CLI and desktop applications.
- Removed @trpc/client and @trpc/server dependencies from package-lock.json and apps/cli/package.json.
- Updated TypeScript configuration in apps/cli/tsconfig.json to simplify compiler options.
- Refactored cli-client.ts to replace TRPC client calls with direct calls to the DAPI, enhancing modularity and performance.
- Adjusted media handling functions in index.ts to utilize the new call method for better clarity and maintainability.
- Cleaned up protocol.ts by introducing encoding and decoding functions for replies, improving data handling consistency.
- Added @diffusionstudio/dapi as a dependency in package-lock.json, apps/cli/package.json, apps/desktop/package.json, and apps/web/package.json.
- Refactored imports in CLI and desktop source files to utilize types and constants from @diffusionstudio/dapi, enhancing code modularity and maintainability.
- Removed the cli-channels.ts file as its functionality is now encapsulated within the new dapi package.
- Introduced a new MCP server design proposal in docs/mcp-server.md, outlining the transition to a unified API for tool interactions.
Modified the "check" script in package.json to reference the correct "examples" directory. Updated the README to replace "video editor" with "media compositor" for improved accuracy and restructured some sentences for better readability. Removed outdated documentation files related to assets, CLI, composition, distribution, and getting started, streamlining the documentation for a more focused user experience.
Updated all JSX elements in the documentation and codebase to use lowercase tags (e.g., `<Scene>` to `<scene>`, `<Video>` to `<video>`, etc.) for uniformity and adherence to the new standards. This change enhances clarity and consistency across the JSX API, ensuring that users have a cohesive experience when working with the elements. Updated related documentation to reflect these changes.
Refactored JSX elements from lowercase to PascalCase, including `<scene>` to `<Scene>`, `<text>` to `<Text>`, and others, to improve consistency and clarity in the codebase. Updated related documentation to reflect these changes, ensuring that the usage of JSX elements aligns with the new naming conventions. This update enhances the overall readability and usability of the JSX API.
Replaced all instances of `<canvas>` and `<canvasPaint>` with `<surface>` and `<surfacePaint>` across the codebase. Updated related documentation to reflect this change, ensuring consistency in naming and usage. Adjusted rendering logic and component imports to support the new surface functionality, enhancing the drawing capabilities for various context types (2D, WebGL, WebGPU). This refactor improves the overall clarity and usability of the rendering system.
Introduced the `useFile` hook, which resolves a source (path, asset id, URL, or `generate.*` ref) to its `File`, allowing for reading raw bytes within effects. This hook returns Solid's `createResource` tuple, enabling async resolution and providing loading and error states. Updated documentation to include usage examples for drawing images onto a `<canvas>` and parsing data files, enhancing the functionality for handling media assets in the application.
Introduced the `<canvas>` element as a shorthand for a rectangle carrying a `<canvasPaint>`, enabling users to draw custom graphics using various context types (2D, WebGL, WebGPU). Updated the rendering system to support this new element, ensuring it integrates with existing components. Enhanced documentation to clarify the usage of `<canvas>` and its properties, and added new samples demonstrating its functionality in different contexts. This update improves the flexibility and creative potential of rendered content.