650 Commits

Author SHA1 Message Date
konstantin-paulus
af39a55a13 Remove ClipPathBar Component and Integrate Command System
- Deleted the `ClipPathBar` component to streamline the toolbar and improve command management.
- Updated the `Toolbar` component to remove references to the `ClipPathBar` and adjusted the command handling logic.
- Introduced a new `CommandBar` for managing pending commands, enhancing user interaction with command execution.
- Refactored the `ClipPathsSettings` to utilize the new command system for initiating clip path actions.
- Added a `CommandContext` to manage command states and interactions across the application.
2026-09-30 16:21:26 +02:00
konstantin-paulus
f9963a15b0 Refactor Toolbar Component and Integrate Command Bar
- Replaced the `ActionBar` with a new `CommandBar` and `CommandPalette` for improved command management in the `Toolbar` component.
- Enhanced the toolbar's functionality by adding command cancellation logic based on tool selection and prompt input state.
- Removed the `ActionBar` component and updated related imports and usages to streamline the codebase.
- Updated the `useMediaSelection` hook to utilize the new `resolveMedia` function for better media handling.
2026-09-30 15:55:57 +02:00
Konstantin Paulus
a69468fb5d
Merge pull request #86 from diffusionstudio/google-font-integration
Release v0.208.0
v0.208.0
2026-09-30 11:49:58 +01:00
konstantin-paulus
f7f6ee02a3 Update package versions to 0.208.0 across all modules
- Incremented version numbers in `package.json` and `package-lock.json` for the main editor, CLI, desktop, and web applications to reflect the new release.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-09-30 12:47:39 +02:00
konstantin-paulus
f2a82581c9 Update Caption Text Styles and Highlight Color
- Changed font family from 'Poppins' to 'Outfit' and adjusted font weights in both `guinea.ts` and `spotlight.ts` for consistency in text styling.
- Updated the highlight color in `spotlight.ts` to improve visual distinction in captions.
2026-09-30 12:43:02 +02:00
konstantin-paulus
11995532b6 Refactor Export Progress Component and Enhance Cancel Functionality
- Updated the `ExportProgress` component to include an alert dialog for confirming export cancellation, improving user experience during export operations.
- Removed unnecessary props from the component, simplifying its interface and enhancing maintainability.
- Adjusted the rendering logic to display audio or video export status based on the `audioOnly` prop.
- Modified the `ExportProvider` to pass the new `audioOnly` state, ensuring accurate progress reporting.
- Streamlined the `RenderOverlayState` to focus on essential properties, enhancing clarity in the export process.
2026-09-30 12:29:16 +02:00
konstantin-paulus
fc63b73214 Add Google Fonts Support and Enhance Font Picker Functionality
- Introduced new options for the `fonts` command to filter by provider and popular fonts, enhancing user experience in font selection.
- Updated the documentation to reflect the inclusion of Google Fonts and local fonts, clarifying how to access and utilize them in projects.
- Implemented a new `FontDropdown` component in the web inspector for improved font selection, allowing users to choose from popular and Google Fonts seamlessly.
- Refactored existing components to integrate the new font selection logic, ensuring consistency across the application.
2026-09-30 11:57:25 +02:00
konstantin-paulus
b06d5b21c7 Remove Tracking Settings Component from Inspector
- Deleted the `TrackingSettings` component and its associated logic from the inspector, streamlining the sidebar functionality.
- Updated the inspector to no longer display tracking settings for shape targets, improving clarity and focus on relevant settings.
2026-09-30 10:49:14 +02:00
konstantin-paulus
f00276fd86 Enhance Animation Documentation and Logic
- Updated the animations documentation to clarify the behavior of presets, emphasizing that they scale or shift the node's authored properties rather than replacing them.
- Modified the `applyAnimation` function to ensure that computed values are compounded correctly for overlapping animations, improving the accuracy of visual effects during animation playback.
2026-09-29 22:21:23 +02:00
konstantin-paulus
d302d4b938 Remove redundant assignment of computed.chars in resetAnimatedValues function to prevent static node issues with text motion overrides. 2026-09-29 20:36:28 +02:00
konstantin-paulus
5310ff0324 Sync lockfile jsx version to 0.207.0 v0.207.0 2026-09-29 10:07:43 +02:00
Konstantin Paulus
52e3a2a997
Merge pull request #85 from diffusionstudio/motion-tracking
Motion tracking
2026-09-29 08:48:49 +01:00
konstantin-paulus
8c5529eacf Implement Background Track Handling in Media Segment Tool
- Enhanced the `present` function to support background track processing in the `media_segment` tool, allowing for real-time tracking and reporting of mask states.
- Introduced a new `presentContext` function to manage the output of background tracks, including their progress and contact sheets.
- Updated the `context` tool to report the status of ongoing background tracks, including their state and associated images.
- Modified the `media_segment` tool to return tracking states and paths, improving integration with the `<mask>` component in the editor.
- Enhanced documentation to clarify the new behavior and usage of background tracks in the context of media segmentation.
2026-09-29 01:29:31 +02:00
konstantin-paulus
22d32d9c22 Enhance Support for Mask Assets Across Components
- Updated various components to recognize and handle mask assets, including `getLayerIcon`, `insertAsset`, and `resolveStill`.
- Modified rendering and styling logic in the timeline to accommodate mask types, ensuring consistent behavior with other asset types.
- Enhanced documentation to clarify the handling of mask assets in the timeline and related functionalities.
2026-09-29 01:00:11 +02:00
konstantin-paulus
a6e27ef3f2 Implement Clip Path Tool and Enhance Toolbar Functionality
- Added the `ClipPathBar` component to the toolbar for managing clip paths.
- Updated the toolbar logic to clear the clip path target when switching tools.
- Refactored the toolbar's tool selection to use a `Switch` statement for better readability.
- Integrated clip path functionality into the inspector, allowing users to begin clip paths directly from the UI.
- Updated cursor settings to reflect the new clip path tool type.
- Enhanced keyboard shortcuts to support clip path actions, improving user interaction.
2026-09-29 00:42:45 +02:00
konstantin-paulus
77f7513960 Update package versions to 0.207.0 across all modules
- Incremented version numbers in `package.json` and `package-lock.json` for the main editor, CLI, desktop, web applications, and JSX package to reflect the new release.
- Ensured consistency in versioning across all related packages to maintain compatibility.
2026-09-29 00:08:50 +02:00
konstantin-paulus
794c5d8a83 Enhance Asset Thumbnail Component to Support Mask Assets
- Updated the `AssetThumbnail` component to recognize and handle mask assets by introducing a new `hasPicture` function.
- Modified the thumbnail rendering logic to include masks alongside images and videos, improving asset representation.
- Enhanced documentation to clarify the types of assets supported for thumbnail generation.
2026-09-28 23:31:43 +02:00
konstantin-paulus
ae33eabe52 Enhance Text Editing Functionality in JSX Elements
- Added tests to verify that text edits preserve associated paint elements and only replace the text content within JSX elements.
- Updated the `setText` function to ensure that only the text is replaced while retaining other child elements, such as paint and comments.
- Improved the logic for identifying which parts of an element's children are considered as text, enhancing the accuracy of text replacements.
- Enhanced documentation to clarify the behavior of text replacements in JSX structures.
2026-09-28 23:22:22 +02:00
konstantin-paulus
a2ff21575a Refactor Appearance Settings and Source Rows Integration
- Updated the `AppearanceSettings` component to include `SourceRows`, which displays source information only when the node has an intrinsic paint or fill.
- Removed the deprecated `SourceSettings` component from the `Inspector`, streamlining the inspector's structure.
- Enhanced the `SourceRows` component to manage media and solid fill display logic, improving clarity and usability in the appearance panel.
- Adjusted documentation and comments for better understanding of the source rendering logic.
2026-09-28 23:03:08 +02:00
konstantin-paulus
b195be7d01 Enhance Text Rendering and Inspector Logic
- Updated the `DrawOverlay` component to include a `SolidPaint` element within the `Text` component, allowing for customizable text color.
- Modified the `Inspector` component to expand the target check for text elements, improving the settings display for text-related shapes.
- Refactored the `SolidFillRow` logic to dynamically determine the property to edit based on the node type, enhancing flexibility in color management.
2026-09-28 22:00:34 +02:00
konstantin-paulus
67e783e5c8 Add Media Segment Tool for Object Tracking in Video
- Introduced the `media_segment` tool to segment objects in video footage using SAM 2.1, allowing users to track objects and generate mask files.
- Implemented input validation for prompts, ensuring at least one point or a bounding box is provided for segmentation.
- Enhanced the output structure to include mask paths and tracking details, improving integration with the `<mask>` component in the editor.
- Added comprehensive documentation for the new tool, detailing usage, input parameters, and expected outputs.
- Updated related components and tests to support the new functionality, ensuring robust performance and user experience.
2026-09-28 15:35:40 +02:00
konstantin-paulus
16fe0cbec0 Update DropdownMenuContent and SelectContent for Improved Height Management
- Modified the `DropdownMenuContent` in `EffectsInspector` to include a maximum height constraint, enhancing usability by preventing overflow.
- Updated the `SelectContent` in `ObjectMaskInspector` to similarly enforce a maximum height, ensuring a consistent and user-friendly interface across components.
2026-09-28 14:39:20 +02:00
konstantin-paulus
95b9531719 Implement Object Mask Tool Integration and Refactor Logic
- Introduced the `useObjectMaskTool` hook for reactive management of the object mask tool's state, including mode, operation, and brush radius.
- Refactored the `ObjectMaskBar` and related components to utilize the new hook, enhancing clarity and maintainability.
- Updated interaction logic to streamline the handling of object mask operations, ensuring consistent behavior across the application.
- Improved documentation and code organization to support the new structure and enhance developer understanding.
2026-09-28 14:35:08 +02:00
konstantin-paulus
7e788582a4 Enhance Object Mask Bar and Interaction Logic
- Updated the `OpMenu` component to conditionally disable based on the object mask mode, improving user experience by preventing invalid operations.
- Refined the `handleObjectMaskInteraction` function to clarify the brush's behavior, ensuring it only adds to the mask while points can subtract.
- Adjusted the brush outline drawing logic to simplify the visual feedback during interactions, enhancing clarity for users.
- Improved documentation for better understanding of the interaction mechanics and brush functionality.
2026-09-28 14:13:03 +02:00
konstantin-paulus
b603f8b1da Refactor Object Mask Bar and Enhance Progress Display
- Updated the `ObjectMaskBar` to improve the tracking progress display, utilizing a new `FixedWidth` component for better alignment and readability.
- Removed deprecated destination logic from the tooltip content, streamlining the user interface.
- Introduced `ModelProgress` component to show model loading progress alongside its label, enhancing user feedback during operations.
- Added `resetObjectMaskTools` function to reset object mask settings when the tool is put down, improving user experience and consistency.
- Improved overall code organization and documentation for better maintainability.
2026-09-28 13:04:51 +02:00
konstantin-paulus
b528d8844c Enhance Object Mask Bar with Hover Functionality and Improved Documentation
- Introduced hover functionality in the `ObjectMaskBar` to display model-specific hints, enhancing user interaction.
- Updated model notes for clarity on when to use each model, improving user guidance.
- Refactored the `ModelMenu` to integrate the new hover state and tooltip-like hints, streamlining the user experience.
- Improved overall code organization and documentation for better maintainability and clarity.
2026-09-28 12:35:46 +02:00
konstantin-paulus
3f38c5eb60 Enhance Object Mask Tool Functionality and UI Integration
- Integrated the `ObjectMaskBar` into the `Toolbar`, allowing for dynamic display based on the selected tool.
- Updated the `Inspector` component to remove the deprecated `ObjectMaskPanel`, streamlining the interface.
- Refactored shortcut handling to include new actions for the object mask tool, improving user interaction.
- Enhanced object mask interaction logic to support dynamic operation modes (add/subtract) based on user input.
- Improved overall code organization and documentation for better clarity and maintainability.
2026-09-28 12:27:37 +02:00
konstantin-paulus
caefe16d67 Refactor Object Mask Handling and Introduce useObjectMasks Hook
- Updated the `EffectsInspector`, `ObjectMaskInspector`, and `TrackingSettings` components to utilize the new `useObjectMasks` hook for improved mask management.
- Removed deprecated functions and streamlined mask retrieval logic, enhancing performance and readability.
- Adjusted rendering conditions to reflect the new structure, ensuring accurate display of footage and associated masks.
- Improved overall code organization and documentation to support the new mask handling approach.
2026-09-28 11:50:33 +02:00
konstantin-paulus
f40cadc07f Add Tracking Settings to Inspector Component
- Integrated the new `TrackingSettings` component into the `Inspector`, allowing users to manage tracking options for shapes.
- Updated the rendering logic to conditionally display `TrackingSettings` based on the selected target, enhancing user interaction and functionality.
- Improved the overall structure of the inspector to accommodate the new settings, ensuring a cohesive user experience across components.
2026-09-28 11:36:25 +02:00
konstantin-paulus
5d1d023ea0 Remove Object Mask SVG Icon and Update Toolbar References
- Deleted the `tool.object-mask.svg` file to streamline icon assets.
- Updated the `Toolbar` component to reference the new icon name for the Object Mask tool, ensuring consistency in the UI.
- Refactored the `EffectsInspector` and `ObjectMaskInspector` components to improve mask handling and UI interactions, enhancing overall user experience.
2026-09-28 10:42:36 +02:00
konstantin-paulus
c7eb628ac0 Refactor Object Mask Commit Logic and Cleanup
- Removed the unused `slug` function from the `copy.tsx` file to streamline the codebase.
- Updated the `commit.tsx` file to enhance the naming convention for stored mask files, ensuring they follow the format `Tracking <n>.mask` within the appropriate folder.
- Improved documentation to clarify the structure of mask file storage and the logic for generating unique tracking names.
- Refactored the asset storage logic to utilize a more concise approach for folder and name generation, enhancing code readability.
2026-09-28 10:17:44 +02:00
konstantin-paulus
4d5d9fc780 Refactor Mask Terminology and Functionality
- Updated references from "matte" to "mask" across various components and files to align with new terminology.
- Adjusted related logic in the `EffectsInspector`, `ObjectMaskInspector`, and other components to ensure consistent behavior with the updated mask handling.
- Refactored caching and serialization processes to accommodate the new mask structure, enhancing overall functionality.
- Improved documentation and type definitions to reflect the transition from mattes to masks, ensuring clarity for developers.
2026-09-28 10:14:19 +02:00
konstantin-paulus
cde1cc1b53 Refactor Mask Functionality to Clip Path
- Renamed mask-related components and functions to reflect the new terminology of "clip path" throughout the codebase.
- Introduced a new `ClipPathsSettings` component for managing clip paths in the inspector.
- Updated the `Inspector` to integrate clip path settings and adjusted related logic to accommodate the new structure.
- Enhanced the `ObjectMenu` to change "Set mask target" to "Set clip path target" for clarity.
- Refactored various utility functions and traits to replace mask references with clip path equivalents, ensuring consistent behavior across the application.
- Updated documentation and type definitions to reflect the transition from masks to clip paths, improving clarity for developers.
2026-09-28 09:56:30 +02:00
konstantin-paulus
b7866279fa Implement Object Mask Tool Enhancements and UI Integration
- Added new `ObjectMaskPanel` component to manage object masks within the effects inspector.
- Introduced functionality for adding and managing object masks, including dropdown menus for selecting masks and controls for editing.
- Enhanced the `EffectsInspector` to support object mask interactions, including displaying existing masks and allowing users to track new objects.
- Implemented brush functionality for painting masks directly onto video clips, improving user experience for object segmentation.
- Updated cursor styles for the object mask tool to provide clearer visual feedback during interactions.
- Refactored related components and utilities to support the new object mask features, ensuring seamless integration with existing functionality.
2026-09-28 09:41:49 +02:00
konstantin-paulus
88f74f8bfe Enhance SAM 2.1 model structure and GPU processing
- Updated `package.json` to include new model export for `./models`.
- Expanded `constants.ts` to define new types and structures for SAM 2.1 models, including `Sam2Model` and `Sam2Geometry`.
- Refactored `gpu.ts` to utilize dynamic image sizes and geometry for frame processing, improving flexibility in GPU operations.
- Enhanced `load.ts` to support model-specific loading and progress tracking, optimizing the user experience during model initialization.
- Updated `mask.ts` to redefine mask handling with logits and improved painting functionality for strokes.
- Refactored `tracker.ts` to integrate new model structures and enhance video tracking capabilities with corrected masks.
- Improved documentation and type definitions across the codebase for better clarity and usability.
2026-09-27 23:43:47 +02:00
konstantin-paulus
37f6195ba0 Enhance model loading and session creation for SAM 2.1
- Introduced `readFloat16Initializer` function in `onnx.ts` to read float16 initializers from model bytes, improving model loading capabilities.
- Updated `createSession` function in `sessions.ts` to accept additional options for session configuration, allowing for enhanced flexibility during model execution.
- Modified the `load` function in `load.ts` to utilize the new initializer and pass position tokens to the `Sam2Video` constructor, optimizing video processing.
- Refactored `Sam2Video` class to handle position tokens, ensuring accurate representation of the vision encoder's positional embeddings during video tracking.
2026-09-26 23:05:43 +02:00
konstantin-paulus
e63f1c7a0f Implement Object Mask Tool and Enhance UI Components
- Added the `Object Mask` tool to the toolbar and sidebar menu, allowing users to select and utilize this new functionality.
- Introduced a new SVG icon for the `Object Mask` tool to improve visual representation in the UI.
- Updated the `Inspector` component to display the `ObjectMaskPanel` when the `Object Mask` tool is selected.
- Enhanced the `Effect` options to include `opacity`, allowing for more refined control over visual effects.
- Updated documentation to reflect the new `<mask>` element and its properties, improving clarity for developers.
- Refactored related components to ensure seamless integration of the new tool and its functionalities.
2026-09-26 20:40:12 +02:00
konstantin-paulus
1882b539c9 Enhance SAM 2.1 video tracking functionality and update export parameters
- Updated `export.py` to include model size as a parameter for ONNX graph exports, improving flexibility in model loading.
- Refactored the `load` function to accept a checkpoint string, allowing dynamic model loading based on specified size.
- Introduced new methods in `tracker.ts` for holding and previewing frames, enhancing the user experience during object segmentation.
- Updated type exports in `video.ts` to include `FrameRequest`, facilitating better integration with the tracking system.
- Improved documentation and comments throughout the codebase for clarity on new features and functionality.
2026-09-26 16:45:06 +02:00
konstantin-paulus
70b2fa3ddf Remove convert_fp16.py script and introduce export.py for ONNX model export
- Deleted the `convert_fp16.py` script, which was responsible for converting ONNX models from fp32 to fp16.
- Added `export.py` script to export fixed-shape ONNX graphs for SAM 2.1 video tracking, ensuring compatibility with input parameters for image size and memory frames.
- Updated `constants.ts` to reflect changes in model repository links and fixed shapes for `IMAGE_SIZE` and `MEMORY_FRAMES`.
- Adjusted memory management and constants in various source files to align with the new export functionality.
2026-09-26 10:22:23 +02:00
konstantin-paulus
6d275f1a61 Add fp16 conversion script and update model repository links
- Introduced `convert_fp16.py` script for converting ONNX models from fp32 to fp16, optimizing memory usage while maintaining input/output compatibility.
- Updated `MODEL_REPO` in `constants.ts` to point to the new fp16 model repository, reflecting changes in model file sizes.
- Enhanced `weights.ts` to retain model files in the cache, improving file management during model loading.
2026-09-26 09:39:17 +02:00
konstantin-paulus
6c3901e543 Add SAM 2.1 video object segmentation and tracking package
- Introduced the `@diffusionstudio/sam2` package for video object segmentation and tracking in the browser using ONNX Runtime on WebGPU.
- Added essential files including `package.json`, `tsconfig.json`, and various source files for core functionality, constants, and GPU processing.
- Implemented model file fetching and caching from Hugging Face, along with memory management for tracking objects across frames.
- Included shaders for preprocessing video frames and transposing feature maps for memory attention.
- Established a comprehensive API for loading models, processing frames, and tracking objects with segmentation masks.
- Ensured type definitions and module exports for seamless integration with existing projects.
2026-09-25 23:36:58 +02:00
konstantin-paulus
6879ea773f Update package-lock.json and README for CLI enhancements
- Added 'diffusion' as a new command in package-lock.json alongside 'dapi'.
- Revised README to describe a new promotional video for https://typesafe.ai/, improving clarity and alignment with branding.
2026-09-24 23:09:47 +02:00
konstantin-paulus
666cdced1f Update version to 0.206.0 and enhance CLI functionality
- Bumped version for @diffusionstudio/editor, @diffusionstudio/cli, @diffusionstudio/desktop to 0.206.0.
- Updated README to reflect changes in download options for macOS and Windows.
- Refactored CLI commands to use 'diffusion' instead of 'dapi' for consistency.
- Added new scripts for Windows asset generation and improved build workflows.
- Introduced new dependencies for enhanced functionality in the desktop application.
2026-09-23 15:53:34 +02:00
konstantin-paulus
2a3632aad5 Remove Windows support implementation plan document
- Deleted the `WINDOWS.md` file, which contained the implementation plan for Windows support in the desktop application.
- This document outlined goals, design decisions, and stages for achieving feature parity with macOS, but is no longer needed as the project progresses.
v0.206.0
2026-09-23 15:49:32 +02:00
konstantin-paulus
2f05fbea8f Refactor CLI installation and status handling to support diffusion command
- Updated the CLI installation logic to use `diffusion` instead of `dapi`, including changes to link paths and installation scripts for macOS.
- Enhanced the status checking functions to reflect the new command structure, ensuring accurate detection of installed links.
- Adjusted comments and documentation throughout the codebase to improve clarity regarding the `diffusion` command and its aliases.
- Ensured backward compatibility by maintaining `dapi` as an alias where necessary.
2026-09-23 15:31:40 +02:00
konstantin-paulus
7a9393d4e2 Refactor CLI command references from dapi to diffusion in source files
- Updated all instances of the CLI command from `dapi` to `diffusion` in the desktop and web applications for consistency.
- Adjusted related comments and documentation to reflect the new command name, improving clarity for users and developers.
- Ensured that the changes are applied across relevant files, including configuration and dashboard components.
2026-09-23 15:21:24 +02:00
konstantin-paulus
943912f247 Add OpenCode support in MCP configuration
- Introduced OpenCode as a new agent in the MCP configuration, updating the `ServerEntry` type to include boolean values.
- Enhanced the `agentTarget` function to accommodate OpenCode's specific entry format.
- Updated tests to verify OpenCode's integration and ensure proper handling of its configuration settings.
- Added OpenCode's icon to the agent icons mapping in the web application.
2026-09-23 15:05:22 +02:00
konstantin-paulus
1539fbc2e9 Refactor CLI command names from dapi to diffusion across documentation and codebase
- Updated all instances of the CLI command from `dapi` to `diffusion` in README, documentation, and source files for consistency.
- Adjusted related scripts and examples to reflect the new command name, enhancing clarity for users and developers.
- Ensured backward compatibility by maintaining `dapi` as an alias where necessary.
2026-09-23 14:49:01 +02:00
konstantin-paulus
baeaad6b0a Update package versions to 0.206.0 across all modules
- Bumped version number from 0.205.2 to 0.206.0 in package.json and package-lock.json for the editor, CLI, desktop, and web applications, ensuring consistency across the project.
2026-09-23 14:37:21 +02:00
konstantin-paulus
dc8f95eba7 Update installation spinner asset and adjust background colors in win-assets.py
- Replaced the installation spinner GIF with an updated version to enhance the installation UI.
- Modified background and track colors in the `win-assets.py` script for improved visual consistency during the installation process.
2026-09-22 15:32:41 +02:00