- Deleted the `ClipPathBar` component to streamline the toolbar and improve command management.
- Updated the `Toolbar` component to remove references to the `ClipPathBar` and adjusted the command handling logic.
- Introduced a new `CommandBar` for managing pending commands, enhancing user interaction with command execution.
- Refactored the `ClipPathsSettings` to utilize the new command system for initiating clip path actions.
- Added a `CommandContext` to manage command states and interactions across the application.
- Replaced the `ActionBar` with a new `CommandBar` and `CommandPalette` for improved command management in the `Toolbar` component.
- Enhanced the toolbar's functionality by adding command cancellation logic based on tool selection and prompt input state.
- Removed the `ActionBar` component and updated related imports and usages to streamline the codebase.
- Updated the `useMediaSelection` hook to utilize the new `resolveMedia` function for better media handling.
- Incremented version numbers in `package.json` and `package-lock.json` for the main editor, CLI, desktop, and web applications to reflect the new release.
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
- Changed font family from 'Poppins' to 'Outfit' and adjusted font weights in both `guinea.ts` and `spotlight.ts` for consistency in text styling.
- Updated the highlight color in `spotlight.ts` to improve visual distinction in captions.
- Updated the `ExportProgress` component to include an alert dialog for confirming export cancellation, improving user experience during export operations.
- Removed unnecessary props from the component, simplifying its interface and enhancing maintainability.
- Adjusted the rendering logic to display audio or video export status based on the `audioOnly` prop.
- Modified the `ExportProvider` to pass the new `audioOnly` state, ensuring accurate progress reporting.
- Streamlined the `RenderOverlayState` to focus on essential properties, enhancing clarity in the export process.
- Introduced new options for the `fonts` command to filter by provider and popular fonts, enhancing user experience in font selection.
- Updated the documentation to reflect the inclusion of Google Fonts and local fonts, clarifying how to access and utilize them in projects.
- Implemented a new `FontDropdown` component in the web inspector for improved font selection, allowing users to choose from popular and Google Fonts seamlessly.
- Refactored existing components to integrate the new font selection logic, ensuring consistency across the application.
- Deleted the `TrackingSettings` component and its associated logic from the inspector, streamlining the sidebar functionality.
- Updated the inspector to no longer display tracking settings for shape targets, improving clarity and focus on relevant settings.
- Updated the animations documentation to clarify the behavior of presets, emphasizing that they scale or shift the node's authored properties rather than replacing them.
- Modified the `applyAnimation` function to ensure that computed values are compounded correctly for overlapping animations, improving the accuracy of visual effects during animation playback.
- Enhanced the `present` function to support background track processing in the `media_segment` tool, allowing for real-time tracking and reporting of mask states.
- Introduced a new `presentContext` function to manage the output of background tracks, including their progress and contact sheets.
- Updated the `context` tool to report the status of ongoing background tracks, including their state and associated images.
- Modified the `media_segment` tool to return tracking states and paths, improving integration with the `<mask>` component in the editor.
- Enhanced documentation to clarify the new behavior and usage of background tracks in the context of media segmentation.
- Updated various components to recognize and handle mask assets, including `getLayerIcon`, `insertAsset`, and `resolveStill`.
- Modified rendering and styling logic in the timeline to accommodate mask types, ensuring consistent behavior with other asset types.
- Enhanced documentation to clarify the handling of mask assets in the timeline and related functionalities.
- Added the `ClipPathBar` component to the toolbar for managing clip paths.
- Updated the toolbar logic to clear the clip path target when switching tools.
- Refactored the toolbar's tool selection to use a `Switch` statement for better readability.
- Integrated clip path functionality into the inspector, allowing users to begin clip paths directly from the UI.
- Updated cursor settings to reflect the new clip path tool type.
- Enhanced keyboard shortcuts to support clip path actions, improving user interaction.
- Incremented version numbers in `package.json` and `package-lock.json` for the main editor, CLI, desktop, web applications, and JSX package to reflect the new release.
- Ensured consistency in versioning across all related packages to maintain compatibility.
- Updated the `AssetThumbnail` component to recognize and handle mask assets by introducing a new `hasPicture` function.
- Modified the thumbnail rendering logic to include masks alongside images and videos, improving asset representation.
- Enhanced documentation to clarify the types of assets supported for thumbnail generation.
- Added tests to verify that text edits preserve associated paint elements and only replace the text content within JSX elements.
- Updated the `setText` function to ensure that only the text is replaced while retaining other child elements, such as paint and comments.
- Improved the logic for identifying which parts of an element's children are considered as text, enhancing the accuracy of text replacements.
- Enhanced documentation to clarify the behavior of text replacements in JSX structures.
- Updated the `AppearanceSettings` component to include `SourceRows`, which displays source information only when the node has an intrinsic paint or fill.
- Removed the deprecated `SourceSettings` component from the `Inspector`, streamlining the inspector's structure.
- Enhanced the `SourceRows` component to manage media and solid fill display logic, improving clarity and usability in the appearance panel.
- Adjusted documentation and comments for better understanding of the source rendering logic.
- Updated the `DrawOverlay` component to include a `SolidPaint` element within the `Text` component, allowing for customizable text color.
- Modified the `Inspector` component to expand the target check for text elements, improving the settings display for text-related shapes.
- Refactored the `SolidFillRow` logic to dynamically determine the property to edit based on the node type, enhancing flexibility in color management.
- Introduced the `media_segment` tool to segment objects in video footage using SAM 2.1, allowing users to track objects and generate mask files.
- Implemented input validation for prompts, ensuring at least one point or a bounding box is provided for segmentation.
- Enhanced the output structure to include mask paths and tracking details, improving integration with the `<mask>` component in the editor.
- Added comprehensive documentation for the new tool, detailing usage, input parameters, and expected outputs.
- Updated related components and tests to support the new functionality, ensuring robust performance and user experience.
- Modified the `DropdownMenuContent` in `EffectsInspector` to include a maximum height constraint, enhancing usability by preventing overflow.
- Updated the `SelectContent` in `ObjectMaskInspector` to similarly enforce a maximum height, ensuring a consistent and user-friendly interface across components.
- Introduced the `useObjectMaskTool` hook for reactive management of the object mask tool's state, including mode, operation, and brush radius.
- Refactored the `ObjectMaskBar` and related components to utilize the new hook, enhancing clarity and maintainability.
- Updated interaction logic to streamline the handling of object mask operations, ensuring consistent behavior across the application.
- Improved documentation and code organization to support the new structure and enhance developer understanding.
- Updated the `OpMenu` component to conditionally disable based on the object mask mode, improving user experience by preventing invalid operations.
- Refined the `handleObjectMaskInteraction` function to clarify the brush's behavior, ensuring it only adds to the mask while points can subtract.
- Adjusted the brush outline drawing logic to simplify the visual feedback during interactions, enhancing clarity for users.
- Improved documentation for better understanding of the interaction mechanics and brush functionality.
- Updated the `ObjectMaskBar` to improve the tracking progress display, utilizing a new `FixedWidth` component for better alignment and readability.
- Removed deprecated destination logic from the tooltip content, streamlining the user interface.
- Introduced `ModelProgress` component to show model loading progress alongside its label, enhancing user feedback during operations.
- Added `resetObjectMaskTools` function to reset object mask settings when the tool is put down, improving user experience and consistency.
- Improved overall code organization and documentation for better maintainability.
- Introduced hover functionality in the `ObjectMaskBar` to display model-specific hints, enhancing user interaction.
- Updated model notes for clarity on when to use each model, improving user guidance.
- Refactored the `ModelMenu` to integrate the new hover state and tooltip-like hints, streamlining the user experience.
- Improved overall code organization and documentation for better maintainability and clarity.
- Integrated the `ObjectMaskBar` into the `Toolbar`, allowing for dynamic display based on the selected tool.
- Updated the `Inspector` component to remove the deprecated `ObjectMaskPanel`, streamlining the interface.
- Refactored shortcut handling to include new actions for the object mask tool, improving user interaction.
- Enhanced object mask interaction logic to support dynamic operation modes (add/subtract) based on user input.
- Improved overall code organization and documentation for better clarity and maintainability.
- Updated the `EffectsInspector`, `ObjectMaskInspector`, and `TrackingSettings` components to utilize the new `useObjectMasks` hook for improved mask management.
- Removed deprecated functions and streamlined mask retrieval logic, enhancing performance and readability.
- Adjusted rendering conditions to reflect the new structure, ensuring accurate display of footage and associated masks.
- Improved overall code organization and documentation to support the new mask handling approach.
- Integrated the new `TrackingSettings` component into the `Inspector`, allowing users to manage tracking options for shapes.
- Updated the rendering logic to conditionally display `TrackingSettings` based on the selected target, enhancing user interaction and functionality.
- Improved the overall structure of the inspector to accommodate the new settings, ensuring a cohesive user experience across components.
- Deleted the `tool.object-mask.svg` file to streamline icon assets.
- Updated the `Toolbar` component to reference the new icon name for the Object Mask tool, ensuring consistency in the UI.
- Refactored the `EffectsInspector` and `ObjectMaskInspector` components to improve mask handling and UI interactions, enhancing overall user experience.
- Removed the unused `slug` function from the `copy.tsx` file to streamline the codebase.
- Updated the `commit.tsx` file to enhance the naming convention for stored mask files, ensuring they follow the format `Tracking <n>.mask` within the appropriate folder.
- Improved documentation to clarify the structure of mask file storage and the logic for generating unique tracking names.
- Refactored the asset storage logic to utilize a more concise approach for folder and name generation, enhancing code readability.
- Updated references from "matte" to "mask" across various components and files to align with new terminology.
- Adjusted related logic in the `EffectsInspector`, `ObjectMaskInspector`, and other components to ensure consistent behavior with the updated mask handling.
- Refactored caching and serialization processes to accommodate the new mask structure, enhancing overall functionality.
- Improved documentation and type definitions to reflect the transition from mattes to masks, ensuring clarity for developers.
- Renamed mask-related components and functions to reflect the new terminology of "clip path" throughout the codebase.
- Introduced a new `ClipPathsSettings` component for managing clip paths in the inspector.
- Updated the `Inspector` to integrate clip path settings and adjusted related logic to accommodate the new structure.
- Enhanced the `ObjectMenu` to change "Set mask target" to "Set clip path target" for clarity.
- Refactored various utility functions and traits to replace mask references with clip path equivalents, ensuring consistent behavior across the application.
- Updated documentation and type definitions to reflect the transition from masks to clip paths, improving clarity for developers.
- Added new `ObjectMaskPanel` component to manage object masks within the effects inspector.
- Introduced functionality for adding and managing object masks, including dropdown menus for selecting masks and controls for editing.
- Enhanced the `EffectsInspector` to support object mask interactions, including displaying existing masks and allowing users to track new objects.
- Implemented brush functionality for painting masks directly onto video clips, improving user experience for object segmentation.
- Updated cursor styles for the object mask tool to provide clearer visual feedback during interactions.
- Refactored related components and utilities to support the new object mask features, ensuring seamless integration with existing functionality.
- Updated `package.json` to include new model export for `./models`.
- Expanded `constants.ts` to define new types and structures for SAM 2.1 models, including `Sam2Model` and `Sam2Geometry`.
- Refactored `gpu.ts` to utilize dynamic image sizes and geometry for frame processing, improving flexibility in GPU operations.
- Enhanced `load.ts` to support model-specific loading and progress tracking, optimizing the user experience during model initialization.
- Updated `mask.ts` to redefine mask handling with logits and improved painting functionality for strokes.
- Refactored `tracker.ts` to integrate new model structures and enhance video tracking capabilities with corrected masks.
- Improved documentation and type definitions across the codebase for better clarity and usability.
- Introduced `readFloat16Initializer` function in `onnx.ts` to read float16 initializers from model bytes, improving model loading capabilities.
- Updated `createSession` function in `sessions.ts` to accept additional options for session configuration, allowing for enhanced flexibility during model execution.
- Modified the `load` function in `load.ts` to utilize the new initializer and pass position tokens to the `Sam2Video` constructor, optimizing video processing.
- Refactored `Sam2Video` class to handle position tokens, ensuring accurate representation of the vision encoder's positional embeddings during video tracking.
- Added the `Object Mask` tool to the toolbar and sidebar menu, allowing users to select and utilize this new functionality.
- Introduced a new SVG icon for the `Object Mask` tool to improve visual representation in the UI.
- Updated the `Inspector` component to display the `ObjectMaskPanel` when the `Object Mask` tool is selected.
- Enhanced the `Effect` options to include `opacity`, allowing for more refined control over visual effects.
- Updated documentation to reflect the new `<mask>` element and its properties, improving clarity for developers.
- Refactored related components to ensure seamless integration of the new tool and its functionalities.
- Updated `export.py` to include model size as a parameter for ONNX graph exports, improving flexibility in model loading.
- Refactored the `load` function to accept a checkpoint string, allowing dynamic model loading based on specified size.
- Introduced new methods in `tracker.ts` for holding and previewing frames, enhancing the user experience during object segmentation.
- Updated type exports in `video.ts` to include `FrameRequest`, facilitating better integration with the tracking system.
- Improved documentation and comments throughout the codebase for clarity on new features and functionality.
- Deleted the `convert_fp16.py` script, which was responsible for converting ONNX models from fp32 to fp16.
- Added `export.py` script to export fixed-shape ONNX graphs for SAM 2.1 video tracking, ensuring compatibility with input parameters for image size and memory frames.
- Updated `constants.ts` to reflect changes in model repository links and fixed shapes for `IMAGE_SIZE` and `MEMORY_FRAMES`.
- Adjusted memory management and constants in various source files to align with the new export functionality.
- Introduced `convert_fp16.py` script for converting ONNX models from fp32 to fp16, optimizing memory usage while maintaining input/output compatibility.
- Updated `MODEL_REPO` in `constants.ts` to point to the new fp16 model repository, reflecting changes in model file sizes.
- Enhanced `weights.ts` to retain model files in the cache, improving file management during model loading.
- Introduced the `@diffusionstudio/sam2` package for video object segmentation and tracking in the browser using ONNX Runtime on WebGPU.
- Added essential files including `package.json`, `tsconfig.json`, and various source files for core functionality, constants, and GPU processing.
- Implemented model file fetching and caching from Hugging Face, along with memory management for tracking objects across frames.
- Included shaders for preprocessing video frames and transposing feature maps for memory attention.
- Established a comprehensive API for loading models, processing frames, and tracking objects with segmentation masks.
- Ensured type definitions and module exports for seamless integration with existing projects.
- Added 'diffusion' as a new command in package-lock.json alongside 'dapi'.
- Revised README to describe a new promotional video for https://typesafe.ai/, improving clarity and alignment with branding.
- Bumped version for @diffusionstudio/editor, @diffusionstudio/cli, @diffusionstudio/desktop to 0.206.0.
- Updated README to reflect changes in download options for macOS and Windows.
- Refactored CLI commands to use 'diffusion' instead of 'dapi' for consistency.
- Added new scripts for Windows asset generation and improved build workflows.
- Introduced new dependencies for enhanced functionality in the desktop application.
- Deleted the `WINDOWS.md` file, which contained the implementation plan for Windows support in the desktop application.
- This document outlined goals, design decisions, and stages for achieving feature parity with macOS, but is no longer needed as the project progresses.
- Updated the CLI installation logic to use `diffusion` instead of `dapi`, including changes to link paths and installation scripts for macOS.
- Enhanced the status checking functions to reflect the new command structure, ensuring accurate detection of installed links.
- Adjusted comments and documentation throughout the codebase to improve clarity regarding the `diffusion` command and its aliases.
- Ensured backward compatibility by maintaining `dapi` as an alias where necessary.
- Updated all instances of the CLI command from `dapi` to `diffusion` in the desktop and web applications for consistency.
- Adjusted related comments and documentation to reflect the new command name, improving clarity for users and developers.
- Ensured that the changes are applied across relevant files, including configuration and dashboard components.
- Introduced OpenCode as a new agent in the MCP configuration, updating the `ServerEntry` type to include boolean values.
- Enhanced the `agentTarget` function to accommodate OpenCode's specific entry format.
- Updated tests to verify OpenCode's integration and ensure proper handling of its configuration settings.
- Added OpenCode's icon to the agent icons mapping in the web application.
- Updated all instances of the CLI command from `dapi` to `diffusion` in README, documentation, and source files for consistency.
- Adjusted related scripts and examples to reflect the new command name, enhancing clarity for users and developers.
- Ensured backward compatibility by maintaining `dapi` as an alias where necessary.
- Bumped version number from 0.205.2 to 0.206.0 in package.json and package-lock.json for the editor, CLI, desktop, and web applications, ensuring consistency across the project.
- Replaced the installation spinner GIF with an updated version to enhance the installation UI.
- Modified background and track colors in the `win-assets.py` script for improved visual consistency during the installation process.