21 Commits

Author SHA1 Message Date
konstantin-paulus
35f4cf6c26 Refactor media tool documentation and update command references
- Updated documentation for various media tools to reflect the removal of the `media` prefix from command names, enhancing clarity and consistency.
- Adjusted links and references in the documentation to point to the new command structures for `grab`, `transcribe`, `filmstrip`, `waveform`, and `listen`.
- Added new documentation for the `filmstrip`, `grab`, `listen`, `probe`, and `transcribe` tools, detailing their functionalities and usage.
- Improved error handling descriptions and examples in the documentation to assist users in understanding tool operations better.
2026-10-07 15:06:38 +02:00
konstantin-paulus
e8c1bde745 Update model configurations and tool requests for improved functionality
- Replaced outdated model names in the configuration with new models: `remove-background` and `upscale-image` are now `bria-rmbg-2.0` and `seedvr-2`, respectively.
- Updated the `request` logic in the `use-transforms` file to reflect the new model names for background removal and image/video upscaling.
- Changed the transcription model from `transcribe` to `universal-3.5-pro` in the captions generation process.
- Adjusted documentation to align with the new model names and their functionalities, ensuring clarity for users.
2026-10-07 14:13:27 +02:00
konstantin-paulus
e18ab84562 Remove media segment functionality and related tests
- Eliminated the `media_segment` command and its associated options from the CLI, streamlining the media handling process.
- Removed references to `media_segment` in the API handlers and tests, ensuring a cleaner codebase.
- Updated the `present` function to no longer handle `media_segment`, focusing on other media processing tasks.
- Adjusted related documentation to reflect the removal of the `media_segment` functionality, enhancing clarity for developers.
2026-10-07 10:29:55 +02:00
konstantin-paulus
21589f4843 Enhance audio handling in media generation and update documentation
- Updated the `generate` function to support audio field references for scenes, allowing users to transcribe audio from scene mixes.
- Introduced new utility functions for audio encoding and scene reference validation, improving the handling of audio uploads.
- Modified the `requireScene` function to include a reason parameter for better error messaging.
- Updated documentation to reflect the new capabilities for transcribing scenes and handling audio, enhancing clarity for developers.
2026-10-07 00:23:55 +02:00
konstantin-paulus
6a0ef3c188 Implement generate and job endpoints in the web API
- Added `generate` and `job` handlers to facilitate media generation and job management through the API.
- Enhanced the `generate` function to handle file uploads and return job details, including estimated run time and credit costs.
- Implemented the `job` function to retrieve job status and results, allowing users to poll for job completion and access generated files.
- Updated documentation to reflect the new endpoints and their usage, improving clarity for developers integrating with the API.
2026-10-06 23:14:59 +02:00
konstantin-paulus
1a8968a396 Refactor generative AI components and update dependencies
- Removed unused imports and code related to generative assets in various components.
- Updated the `package-lock.json` to remove `@diffusionstudio/api-contract` and `@trpc` dependencies.
- Introduced a placeholder mechanism for generative AI features that are currently being rebuilt.
- Adjusted the CLI and documentation to reflect changes in available commands and features.
- Enhanced the handling of timeouts in the CLI client for media analysis and rendering tasks.
2026-10-04 11:12:49 +02:00
konstantin-paulus
fc63b73214 Add Google Fonts Support and Enhance Font Picker Functionality
- Introduced new options for the `fonts` command to filter by provider and popular fonts, enhancing user experience in font selection.
- Updated the documentation to reflect the inclusion of Google Fonts and local fonts, clarifying how to access and utilize them in projects.
- Implemented a new `FontDropdown` component in the web inspector for improved font selection, allowing users to choose from popular and Google Fonts seamlessly.
- Refactored existing components to integrate the new font selection logic, ensuring consistency across the application.
2026-09-30 11:57:25 +02:00
konstantin-paulus
f00276fd86 Enhance Animation Documentation and Logic
- Updated the animations documentation to clarify the behavior of presets, emphasizing that they scale or shift the node's authored properties rather than replacing them.
- Modified the `applyAnimation` function to ensure that computed values are compounded correctly for overlapping animations, improving the accuracy of visual effects during animation playback.
2026-09-29 22:21:23 +02:00
konstantin-paulus
67e783e5c8 Add Media Segment Tool for Object Tracking in Video
- Introduced the `media_segment` tool to segment objects in video footage using SAM 2.1, allowing users to track objects and generate mask files.
- Implemented input validation for prompts, ensuring at least one point or a bounding box is provided for segmentation.
- Enhanced the output structure to include mask paths and tracking details, improving integration with the `<mask>` component in the editor.
- Added comprehensive documentation for the new tool, detailing usage, input parameters, and expected outputs.
- Updated related components and tests to support the new functionality, ensuring robust performance and user experience.
2026-09-28 15:35:40 +02:00
konstantin-paulus
cde1cc1b53 Refactor Mask Functionality to Clip Path
- Renamed mask-related components and functions to reflect the new terminology of "clip path" throughout the codebase.
- Introduced a new `ClipPathsSettings` component for managing clip paths in the inspector.
- Updated the `Inspector` to integrate clip path settings and adjusted related logic to accommodate the new structure.
- Enhanced the `ObjectMenu` to change "Set mask target" to "Set clip path target" for clarity.
- Refactored various utility functions and traits to replace mask references with clip path equivalents, ensuring consistent behavior across the application.
- Updated documentation and type definitions to reflect the transition from masks to clip paths, improving clarity for developers.
2026-09-28 09:56:30 +02:00
konstantin-paulus
b7866279fa Implement Object Mask Tool Enhancements and UI Integration
- Added new `ObjectMaskPanel` component to manage object masks within the effects inspector.
- Introduced functionality for adding and managing object masks, including dropdown menus for selecting masks and controls for editing.
- Enhanced the `EffectsInspector` to support object mask interactions, including displaying existing masks and allowing users to track new objects.
- Implemented brush functionality for painting masks directly onto video clips, improving user experience for object segmentation.
- Updated cursor styles for the object mask tool to provide clearer visual feedback during interactions.
- Refactored related components and utilities to support the new object mask features, ensuring seamless integration with existing functionality.
2026-09-28 09:41:49 +02:00
konstantin-paulus
e63f1c7a0f Implement Object Mask Tool and Enhance UI Components
- Added the `Object Mask` tool to the toolbar and sidebar menu, allowing users to select and utilize this new functionality.
- Introduced a new SVG icon for the `Object Mask` tool to improve visual representation in the UI.
- Updated the `Inspector` component to display the `ObjectMaskPanel` when the `Object Mask` tool is selected.
- Enhanced the `Effect` options to include `opacity`, allowing for more refined control over visual effects.
- Updated documentation to reflect the new `<mask>` element and its properties, improving clarity for developers.
- Refactored related components to ensure seamless integration of the new tool and its functionalities.
2026-09-26 20:40:12 +02:00
konstantin-paulus
2f05fbea8f Refactor CLI installation and status handling to support diffusion command
- Updated the CLI installation logic to use `diffusion` instead of `dapi`, including changes to link paths and installation scripts for macOS.
- Enhanced the status checking functions to reflect the new command structure, ensuring accurate detection of installed links.
- Adjusted comments and documentation throughout the codebase to improve clarity regarding the `diffusion` command and its aliases.
- Ensured backward compatibility by maintaining `dapi` as an alias where necessary.
2026-09-23 15:31:40 +02:00
konstantin-paulus
307a6a4a76 Implement Windows CLI shim and update installation process
- Added a new `dev-shim.mjs` script for creating and removing a Windows shim for the `dapi` command, ensuring it points to the correct executable.
- Updated the `package.json` to include new npm scripts for creating and removing the shim.
- Refactored the CLI installation logic to support Windows, including the addition of `refreshCliShim` to rewrite the shim on app updates.
- Enhanced the `mcp-config` to accommodate Windows-specific command handling for the `dapi` binary.
- Introduced tests for the Windows CLI installation and cloud sync functionalities to ensure reliability across platforms.
2026-09-20 15:28:14 +02:00
konstantin-paulus
53a9ecc7d9 Merge remote-tracking branch 'origin/main' into mcp-support 2026-09-14 11:40:13 +02:00
konstantin-paulus
763ce7aa5c Enhance playhead management and update scene documentation
- Added `playhead` property to the scene, allowing the editor to track the playhead's position when the project is opened, improving playback accuracy.
- Introduced `editPlayhead` function to manage playhead updates, ensuring the file reflects the playhead's position during scrubbing and timeline interactions.
- Updated documentation to clarify the role of the `playhead` property in the scene, emphasizing its importance for project state management.
2026-09-14 00:16:55 +02:00
konstantin-paulus
2874735936 Update scene and stage documentation, and adjust default camera settings
- Enhanced the `scene.md` documentation to clarify the `workarea` property and its implications for playback and export.
- Revised the `stage.md` documentation to provide clearer guidance on the `camera` property, emphasizing the importance of setting a camera for non-standard compositions.
- Updated the default camera settings in the `world.ts` and `types.ts` files to better frame typical project dimensions, ensuring a more intuitive starting point for users.
2026-09-13 21:15:22 +02:00
konstantin-paulus
df9d7d9f84 Remove fetch command and related functionality from the application
- Deleted the `fetch` command from the CLI and associated handlers, streamlining the toolset.
- Updated documentation to reflect the removal of the `fetch` command, emphasizing the use of `yt-dlp` directly for downloading videos.
- Adjusted various components and types to remove references to `fetch`, ensuring consistency across the codebase.
- Enhanced error handling to clarify the absence of the `fetch` functionality.
2026-09-13 16:08:07 +02:00
konstantin-paulus
1bbe992345 Refactor and enhance transform functionality in the asset management system
- Replaced the `useModifiers` hook with `useTransforms` to better reflect the new transform functionality.
- Updated components to utilize the new `useTransforms` hook, including `ActionBar` and `PromptInputActions`, improving the handling of transformations.
- Introduced new `TransformItem` component for managing transform actions in the UI.
- Refactored asset handling logic to accommodate the new transform types and ensure compatibility with existing features.
- Removed deprecated modifier-related code and documentation, streamlining the codebase and enhancing clarity.
- Updated documentation to reflect changes in transform functionality and usage examples.
2026-09-12 16:31:36 +02:00
konstantin-paulus
28ad0372db Enhance asset management and introduce partial asset handling
- Updated the `Assets` component to include support for partial assets, allowing for better management of assets that are still generating.
- Introduced a new `PartialAssetItem` component to represent partial documents in the asset panel, providing options to retry or delete failed generations.
- Modified the `AssetInfoPanel` to display information about partial assets, including their status and error messages.
- Refactored the `useAssetSelection` hook to accommodate both assets and partial assets, improving the selection logic.
- Updated the `FolderItem` component to count partial assets alongside regular assets, enhancing folder statistics.
- Removed the `sourceErrorSystem` as part of the cleanup, streamlining error handling for asset generations.
- Added documentation updates to reflect changes in asset handling and the introduction of partial assets.
2026-09-12 15:52:41 +02:00
konstantin-paulus
7372c40429 Update documentation references and refactor knowledge handling
- Changed references from `knowledge` to `docs` in README and various files to reflect the new documentation structure.
- Updated `.gitignore` to exclude the `docs` directory instead of `knowledge`.
- Refactored `forge.config.ts` and `main.ts` to utilize the new `docs` directory for staging resources.
- Introduced `stage-docs.mjs` script to manage the staging of documentation files.
- Added new documentation files under `docs/`, including `INSTRUCTIONS.md`, brand guidelines, and design specifications.
- Removed outdated `knowledge` related tests and files to streamline the codebase.
2026-09-11 20:33:57 +02:00