710 Commits

Author SHA1 Message Date
konstantin-paulus
cf8164b3fe Rename winget package to DiffusionStudio.Editor
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
2026-10-08 10:20:03 +02:00
konstantin-paulus
e836ffce14 Add shimmer effect for ongoing caption generation
- Introduced a new `shimmer` function to visually indicate when a scene is being captioned, enhancing user experience.
- Updated the `generateCaptions` function to prevent multiple caption generations on the same scene.
- Added `Shimmering` trait to manage the shimmer state and timing.
- Updated rendering logic to include the shimmer effect around scenes during processing.
- Added `@diffusionstudio/api-contract` dependency to `package-lock.json` for improved API integration.
v0.210.0
2026-10-08 10:02:02 +02:00
Konstantin Paulus
38ecaef5c3
Merge pull request #92 from diffusionstudio/api-v2-migration
Api v2 migration
2026-10-07 23:39:25 +01:00
konstantin-paulus
32ab74e482 Update model references and package dependencies for improved functionality
- Removed outdated API reference from the `.env.example` file.
- Updated `@diffusionstudio/api-contract` dependency version to `^0.4.0` in both `package.json` files.
- Replaced model name `gemini-3.5-flash` with `qwen3.8-omni-flash` in configuration and documentation, ensuring alignment with the latest model capabilities.
- Added a note in the editor documentation regarding project management in cloud-synced folders to prevent issues with media handling.
2026-10-08 00:29:26 +02:00
konstantin-paulus
3e376ca95f Enhance analytics tracking in desktop and web applications
- Updated the `startAnalytics` function to accept a `WindowHost` parameter, allowing for improved tracking of app usage.
- Introduced a timer to track app usage every minute when the window is active.
- Added similar usage tracking functionality in the web application's analytics module, ensuring consistent tracking across platforms.
2026-10-07 18:28:03 +02:00
konstantin-paulus
42ede69691 Add transcript parsing functionality and integrate with asset resolution
- Introduced a new `parseTranscriptJson` function to handle various transcript JSON formats, ensuring robust parsing and error handling.
- Updated the `resolveTranscript` function to utilize `parseTranscriptJson` for improved transcript processing, replacing direct JSON parsing.
- Enhanced the overall structure and clarity of transcript handling within the media captioning system.
2026-10-07 17:22:42 +02:00
konstantin-paulus
e6573a717d Enhance asset metadata handling in AssetInfoPanel
- Introduced `createResource` to fetch job details associated with the asset, improving the retrieval of generation information.
- Updated logic to extract prompt and model details from the job data, enhancing the clarity of asset generation metadata.
- Refactored the use of asset properties to ensure accurate representation of asset creation and modification dates.
2026-10-07 15:16:21 +02:00
konstantin-paulus
35f4cf6c26 Refactor media tool documentation and update command references
- Updated documentation for various media tools to reflect the removal of the `media` prefix from command names, enhancing clarity and consistency.
- Adjusted links and references in the documentation to point to the new command structures for `grab`, `transcribe`, `filmstrip`, `waveform`, and `listen`.
- Added new documentation for the `filmstrip`, `grab`, `listen`, `probe`, and `transcribe` tools, detailing their functionalities and usage.
- Improved error handling descriptions and examples in the documentation to assist users in understanding tool operations better.
2026-10-07 15:06:38 +02:00
konstantin-paulus
55e1f1189f Refactor media command structure and update documentation
- Removed the `media` prefix from various commands (`media_grab`, `media_transcribe`, etc.) to simplify usage and improve consistency across the CLI and API.
- Updated the corresponding handlers and references in the codebase to reflect the new command names.
- Enhanced the README and documentation to clarify the changes in command structure and provide updated examples for users.
- Introduced new handlers for `grab`, `transcribe`, `filmstrip`, `waveform`, and `listen`, ensuring they align with the updated command naming conventions.
- Improved error handling and validation in the new command implementations for better user experience.
2026-10-07 15:04:15 +02:00
konstantin-paulus
6e25123941 Refactor audio handling and enhance media processing tools
- Introduced a new `audioFile` function to extract audio from assets, ensuring only the audio track is uploaded for analysis and transcription.
- Updated `mediaListen` and `mediaTranscribe` handlers to utilize the new audio extraction logic, improving efficiency and clarity in processing audio and video assets.
- Implemented error handling for audio analysis and transcription, ensuring robust responses for unsupported formats and empty audio tracks.
- Added `requireSignIn` and `apiError` functions to manage user authentication and API error handling, enhancing the reliability of tool operations.
- Updated documentation to reflect changes in audio processing and tool functionalities, providing clearer guidance for users.
2026-10-07 14:49:57 +02:00
konstantin-paulus
116eae23b8 Update cost calculation logic in estimate function to reflect model's minimum pricing
- Adjusted the chargeOf function to ensure that the cost calculation returns the model's minimum price instead of a fixed value of 1, aligning with API pricing requirements.
- Updated documentation comments for clarity on pricing logic and conditions for undefined values.
2026-10-07 14:32:07 +02:00
konstantin-paulus
e8c1bde745 Update model configurations and tool requests for improved functionality
- Replaced outdated model names in the configuration with new models: `remove-background` and `upscale-image` are now `bria-rmbg-2.0` and `seedvr-2`, respectively.
- Updated the `request` logic in the `use-transforms` file to reflect the new model names for background removal and image/video upscaling.
- Changed the transcription model from `transcribe` to `universal-3.5-pro` in the captions generation process.
- Adjusted documentation to align with the new model names and their functionalities, ensuring clarity for users.
2026-10-07 14:13:27 +02:00
konstantin-paulus
4e232a3c5d Update package versions to 0.210.0 across all modules
- Bumped version numbers in package.json and package-lock.json for the editor, CLI, desktop, web, and JSX packages to 0.210.0, ensuring consistency across the project.
- This update may include new features, bug fixes, or improvements as part of the version increment.
2026-10-07 12:35:25 +02:00
konstantin-paulus
9d09dbf0ca Remove unused large hailuo icon and update model configurations to reflect new icon names and descriptions. Adjusted model options for Grok Imagine and Krea to use appropriate icons, and modified video model configurations for Kling and Flux to enhance clarity and consistency. 2026-10-07 12:29:13 +02:00
konstantin-paulus
fe3f1d68e7 Implement estimate option in generate tool for cost and time prediction
- Added an `--estimate` option to the `generate` command, allowing users to retrieve the estimated credits and execution time without starting a job.
- Updated the `generate` function to handle the new estimate logic, returning a structured response with `credits` and `etaSeconds`.
- Enhanced documentation to clarify the usage of the estimate feature and its implications for job execution.
- Modified related types and validation to accommodate the new estimate functionality, ensuring robust input handling.
2026-10-07 12:04:03 +02:00
konstantin-paulus
f10a6917f9 Enhance generate tool to include model fields and improve input validation
- Updated the `generate` function to declare every model's fields by name, allowing clients to send only the declared properties.
- Introduced a new `modelFields` constant that aggregates fields from both API and local models, enhancing input validation.
- Added tests to verify the correct declaration of model fields and ensure proper parsing of input data.
2026-10-07 11:20:22 +02:00
konstantin-paulus
1f0476833b Update waveform rendering logic to clarify export behavior
- Enhanced documentation to specify that waveforms are only drawn in the editor and not included in exports, particularly when part of a scene composition.
- Modified the condition for rendering waveforms in real-time to ensure it only occurs when the entity is not part of a parent node, improving rendering accuracy.
2026-10-07 10:51:14 +02:00
konstantin-paulus
5c685e15b0 Refactor object mask handling and enhance effects inspector functionality
- Updated EffectsInspector and ObjectMaskInspector components to utilize the getParentNode function for improved mask grouping.
- Modified useObjectMasks hook to accept a clip parameter, allowing for more accurate retrieval of object masks based on the current video context.
- Enhanced objectMaskGroups function to categorize masks based on the associated video footage, improving user experience when selecting masks from the library.
2026-10-07 10:47:07 +02:00
konstantin-paulus
6ce93217bb Enhance effects inspector and object mask handling
- Added a new "Opacity" effect option to the EFFECT_OPTIONS array for better control over layer effects.
- Refactored the EffectsInspector component to utilize grouped object masks, improving the organization of mask options in the dropdown menu.
- Updated the ObjectMaskInspector to support selection from grouped masks, enhancing user experience when choosing masks from the library.
- Modified the useObjectMasks hook to return grouped masks, streamlining the retrieval of masks by their respective folders.
2026-10-07 10:43:17 +02:00
konstantin-paulus
e18ab84562 Remove media segment functionality and related tests
- Eliminated the `media_segment` command and its associated options from the CLI, streamlining the media handling process.
- Removed references to `media_segment` in the API handlers and tests, ensuring a cleaner codebase.
- Updated the `present` function to no longer handle `media_segment`, focusing on other media processing tasks.
- Adjusted related documentation to reflect the removal of the `media_segment` functionality, enhancing clarity for developers.
2026-10-07 10:29:55 +02:00
konstantin-paulus
21589f4843 Enhance audio handling in media generation and update documentation
- Updated the `generate` function to support audio field references for scenes, allowing users to transcribe audio from scene mixes.
- Introduced new utility functions for audio encoding and scene reference validation, improving the handling of audio uploads.
- Modified the `requireScene` function to include a reason parameter for better error messaging.
- Updated documentation to reflect the new capabilities for transcribing scenes and handling audio, enhancing clarity for developers.
2026-10-07 00:23:55 +02:00
konstantin-paulus
6a0ef3c188 Implement generate and job endpoints in the web API
- Added `generate` and `job` handlers to facilitate media generation and job management through the API.
- Enhanced the `generate` function to handle file uploads and return job details, including estimated run time and credit costs.
- Implemented the `job` function to retrieve job status and results, allowing users to poll for job completion and access generated files.
- Updated documentation to reflect the new endpoints and their usage, improving clarity for developers integrating with the API.
2026-10-06 23:14:59 +02:00
konstantin-paulus
d2e56157a4 Enhance authentication event tracking to differentiate new users
- Updated the authentication state change handler to track sign-in events specifically for new users by introducing an `isNewUser` check.
- Modified the condition for tracking the 'signed_in' event to ensure it only triggers for new users, improving the accuracy of user engagement analytics.
2026-10-06 18:24:23 +02:00
konstantin-paulus
73e578f47c Refactor analytics tracking and configuration in desktop application
- Replaced the Umami tracking implementation with a new analytics system that utilizes a queue for event tracking.
- Introduced `configureAnalytics` function to set API URL and token for event tracking.
- Updated event tracking methods to handle canvas edits and code changes, improving the granularity of analytics data.
- Modified main channels to reflect the new analytics configuration, enhancing the integration between the main and renderer processes.
- Improved documentation and code organization for better maintainability and clarity.
2026-10-06 18:11:41 +02:00
konstantin-paulus
8d9dfb690c Update placement logic for beside function to improve alignment
- Changed documentation and implementation in the `beside` function to clarify that the spot is now top-aligned with the reference box instead of level.
- Adjusted the calculation of `minY` to align with the top of the box, enhancing the placement logic for better visual consistency on the canvas.
2026-10-06 16:22:09 +02:00
konstantin-paulus
62c1f1533d Refactor recent projects display in DashboardHomeView for responsive grid layout
- Introduced dynamic column calculation for recent projects based on available width, improving responsiveness.
- Replaced fixed column count with a calculated grid layout that adapts to screen size, enhancing user experience.
- Updated documentation for constants related to recent project card dimensions and grid configuration.
2026-10-06 16:12:39 +02:00
konstantin-paulus
68b3095405 Enhance project deletion logic to handle non-existent directories
- Updated the `deleteProject` function to check if the directory exists before attempting to move it to the trash, preventing errors when trying to delete already deleted projects.
- Improved documentation to clarify that a project can still be removed from the list even if its folder is already gone.
2026-10-06 16:08:32 +02:00
konstantin-paulus
2c536d913d Implement upgrade dialog visibility control in purchase success component
- Added `hideUpgradeDialog` function to manage the visibility of the upgrade dialog.
- Integrated `hideUpgradeDialog` call in the `show` function of the `PurchaseSuccess` component to ensure the dialog is closed when a new purchase is displayed, enhancing user experience by preventing overlapping dialogs.
2026-10-06 16:04:23 +02:00
konstantin-paulus
105f81de89 Add credit display and tooltip functionality in action bar and prompt input components
- Introduced a new `TransformButton` component to encapsulate the credit display and tooltip functionality for transformation actions in the action bar.
- Updated the `ActionBar` component to utilize `TransformButton`, enhancing the user experience by providing clear credit information for each action.
- Enhanced the `PromptInputActions` component to show estimated credits for rerun actions, improving user awareness of costs.
- Refactored the `use-estimate` module to support dynamic credit calculations and formatting, ensuring accurate cost representation throughout the application.
2026-10-06 15:30:11 +02:00
konstantin-paulus
932c92d5f6 Add credit estimation feature in PromptInput component
- Integrated a new `useEstimate` hook to calculate the cost of generation based on the current configuration.
- Updated the `PromptInput` component to display estimated credits required for generation, enhancing user awareness of costs.
- Improved the UI to show credit information dynamically, providing a better user experience during prompt generation.
2026-10-06 13:37:24 +02:00
konstantin-paulus
ecf97f8cc1 Add duration range support in model options and prompt input
- Introduced a new `durationRange` property in the `ModelOption` interface to allow models to specify a range of valid durations.
- Implemented a `DurationRangeMenu` component in the `PromptInput` to enable users to select durations within the specified range, including presets and custom input.
- Updated the `fitToModel` function to utilize the new duration range when configuring model options, enhancing the flexibility of duration selection.
- Enhanced the UI to dynamically display and handle duration selections, improving overall user experience.
2026-10-06 13:31:05 +02:00
konstantin-paulus
f4e7e7f54f Add duration selection functionality with slider in PromptInput component
- Introduced a new DurationMenu component that allows users to select durations using a slider.
- Refactored duration handling to utilize a list of available durations, improving user interaction.
- Updated the duration accessor to return a number or undefined for better type safety.
- Enhanced the UI to display the selected duration dynamically, improving overall usability.
2026-10-06 13:10:11 +02:00
konstantin-paulus
75f0bfc8fc Remove "Add audio" functionality from the action bar and related components
- Deleted the "Add audio" button from the ActionBar and its associated logic in the PromptInputActions component.
- Updated the TransformType definition to exclude "addAudio" and removed related handling in the use-transforms module.
- Adjusted the model configuration to reflect the removal of audio-related transformations, streamlining the available options for users.
2026-10-06 12:53:36 +02:00
konstantin-paulus
14feb5d4f7 Add Gemini 3.8 Flash TTS model and voice options
- Introduced the "gemini-3.8-flash-tts" model with associated voice options to the configuration.
- Added a new `GEMINI_VOICE_OPTIONS` array, detailing various prebuilt voices with descriptions and preview URLs.
- Updated the default model for the VOICE mode to use the new Gemini model, enhancing the voice generation capabilities in the application.
2026-10-06 12:46:45 +02:00
konstantin-paulus
56fb94104b Refactor prompt input handling and introduce saved configuration functionality
- Replaced `createDefaultConfig` with `restoreConfig` in multiple components to utilize saved configurations for prompt input.
- Added `saved-config.ts` to manage saving and loading prompt configurations across sessions, enhancing user experience by preserving state.
- Updated the `PromptInput` component to load saved configurations on initialization and save changes automatically.
- Adjusted the `openPromptInput` method to accept optional configurations, allowing for more flexible prompt handling.
- Modified model defaults in `config.ts` to reflect updated model options, ensuring consistency across the application.
2026-10-06 12:25:32 +02:00
konstantin-paulus
8d3965fa9c Enhance model menu with keyboard navigation and search functionality
- Introduced keyboard navigation for the model selection menu, allowing users to highlight options using arrow keys and select with Enter.
- Refactored the search input to support dynamic filtering of model options based on user input, improving accessibility and usability.
- Updated the `SearchInput` component to accept a ref and onKeyDown handler for better integration with the model menu.
- Enhanced the overall user experience by ensuring focus management and visual feedback during selection.
2026-10-06 12:12:16 +02:00
konstantin-paulus
e5b8971aac Update model options and refactor default model handling
- Reordered and updated the `MODEL_OPTIONS` to enhance clarity and relevance, introducing new models and adjusting their positions.
- Refactored the `fitToModel` and `createDefaultConfig` functions to utilize a new `defaultModelOption` for improved model selection based on mode.
- Removed deprecated model entries to streamline the configuration and ensure consistency across components.
2026-10-06 12:02:35 +02:00
konstantin-paulus
8616127c50 Enhance model configuration with resolution support
- Added resolution handling to the generation configuration, allowing models to specify available output resolutions.
- Updated the `MODEL_OPTIONS` and `MODEL_MODES` to include new models and their respective resolutions.
- Refactored the `fitToModel` function to accommodate resolution selection, ensuring compatibility with model capabilities.
- Integrated resolution options into the `PromptInput` component for user selection, improving the overall user experience.
- Adjusted type definitions to include resolution in the generation configuration, enhancing type safety across components.
2026-10-06 11:43:38 +02:00
konstantin-paulus
e3af57b136 Refactor generation configuration and type handling
- Moved generation configuration types from `schemas.ts` to `types.ts` for better organization and clarity.
- Updated imports across components to utilize the new `types.ts` file, ensuring consistent type usage.
- Refactored the `createDefaultConfig` and `fitToModel` functions in `requests.ts` to streamline model configuration handling.
- Removed deprecated `schemas.ts` file to clean up the codebase and improve maintainability.
2026-10-06 10:52:46 +02:00
konstantin-paulus
9bde5fe6ef Add file attachment handling and paste support in agent chat
- Introduced functionality for handling pasted files as attachments, including image previews.
- Enhanced the `fileAttachment` function to support generating object URLs for image previews.
- Implemented a `createPasteHandler` to manage paste events and display error messages for failed uploads.
- Updated the `Composer` and `DashboardHomeView` components to integrate paste handling.
- Added server-side support for uploading attachments, ensuring unique paths for each upload.
- Enhanced the protocol to include an `attachments.upload` method for handling file uploads.
2026-10-05 23:37:30 +02:00
konstantin-paulus
b83d6e4b80 Enhance focus behavior and clean up UI components
- Added a CSS rule to remove focus outlines for non-input elements, improving visual clarity.
- Removed unnecessary focus-related classes from various UI components, streamlining their styles.
- Updated button and dialog components to enhance user experience by simplifying focus management.
2026-10-05 23:25:59 +02:00
konstantin-paulus
6f14ce551a Add focus behavior to PromptInput component on mount
- Implemented `onMount` lifecycle method to automatically focus the textarea and set the selection range to the end of the current value when the component is rendered.
- This enhancement improves user experience by allowing immediate interaction with the input field.
2026-10-05 23:22:12 +02:00
konstantin-paulus
e4c4cdad4b Refactor API client and job handling logic
- Simplified the API client setup by consolidating authorization logic into the `httpBatchLink`.
- Updated job handling to replace subscription-based polling with a more efficient polling mechanism using `jobs.get`.
- Improved error handling during job polling to allow for retries before giving up on failed polls.
- Enhanced code clarity by removing deprecated subscription logic and unnecessary comments.
2026-10-05 23:12:45 +02:00
konstantin-paulus
d29d18b33c Export generating utility functions to enhance modularity and facilitate generation processes in the runtime package. 2026-10-05 23:02:31 +02:00
konstantin-paulus
42753381ff Refactor generative AI components and consolidate generation logic
- Replaced individual generation hooks for image, video, voice, and audio with a unified `useGenerate` hook to streamline generation processes.
- Updated the `ActionBar` and `PromptInputActions` components to utilize the new `useGenerate` hook for rerunning generation jobs.
- Enhanced media selection handling by refactoring the `useMediaSelection` hook to return image and video media more efficiently.
- Removed deprecated placeholder functionality and related imports, improving code clarity and maintainability.
- Introduced a new `requests.ts` file to manage API request configurations for generation tasks.
- Updated the `useGenerationRecords` hook to track job information more effectively, including the first job and total credits.
- Improved transform handling in the `useTransforms` hook to apply transformations over selected media nodes.
- Added auto-caption generation functionality in the `useAutoCaptions` hook, integrating with the project context.
- Removed unused files and code related to legacy generation methods, enhancing overall project structure.
2026-10-05 23:02:23 +02:00
konstantin-paulus
77eee77313 Add purchase success poster and enhance success dialog
- Introduced a new poster image for the purchase success dialog.
- Added CSS animations for the poster and button interactions to improve user experience.
- Refactored the `PurchaseSuccess` component to handle purchase details and display animations.
- Updated success URL handling to include purchase information for better tracking.
2026-10-05 16:31:03 +02:00
konstantin-paulus
8ff93b159b Update dependencies and enhance dashboard components
- Added `@trpc/client` and `@trpc/server` dependencies to `package-lock.json` and `package.json`.
- Updated `.env.example` to include the new API URL for Diffusion Studio.
- Refactored dashboard components to utilize the new `@diffusionstudio/api-contract`, replacing legacy backend calls.
- Improved user experience in the dashboard by updating plan and billing information handling.
- Removed deprecated backend code and adjusted related components for better maintainability.
2026-10-05 15:37:48 +02:00
konstantin-paulus
631d457373 Export sourceFiles function for external use and integrate migrateGenerations in compileProject to handle legacy asset migrations. This enhances project compatibility with previous versions. 2026-10-04 11:33:51 +02:00
konstantin-paulus
1a8968a396 Refactor generative AI components and update dependencies
- Removed unused imports and code related to generative assets in various components.
- Updated the `package-lock.json` to remove `@diffusionstudio/api-contract` and `@trpc` dependencies.
- Introduced a placeholder mechanism for generative AI features that are currently being rebuilt.
- Adjusted the CLI and documentation to reflect changes in available commands and features.
- Enhanced the handling of timeouts in the CLI client for media analysis and rendering tasks.
2026-10-04 11:12:49 +02:00
Konstantin Paulus
fefcde9df7
Merge pull request #90 from diffusionstudio/agent-plugins
Agent plugins
v0.209.1
2026-10-03 16:30:32 +01:00