80 Commits

Author SHA1 Message Date
konstantin-paulus
0d51ab494b Enhance context command and selection handling in editor API
Updated the context command description for clarity on spatial and temporal references. Refactored the context handling to include selected node IDs, improving the context response structure. Additionally, modified the selection utility to streamline the retrieval of selected node IDs, ensuring consistency across the editor API.
2026-07-26 12:03:24 +02:00
konstantin-paulus
7743b32645 Refactor Trim component to Workarea for improved clarity and functionality
Updated the codebase to replace instances of the Trim component with the Workarea component, enhancing the handling of playback and rendering windows. This change includes adjustments in the context command, encoder, playback system, and rendering logic to utilize the new Workarea structure, ensuring a more intuitive and consistent approach to managing scene work areas.
2026-07-24 17:35:07 +02:00
konstantin-paulus
90d0959a91 Refactor JSX elements to replace <scene> with <rect> using the scene property for root promotion
Updated multiple files to transition from using `<scene>` elements to `<rect>` elements with the `scene` property, promoting rectangle geometries to mount roots. This change enhances the JSX API by clarifying the role of scenes and ensuring consistency across examples and documentation. Additionally, modified related documentation to reflect the new usage and constraints of the `scene` property.
2026-07-24 12:01:41 +02:00
konstantin-paulus
bf0ef25506 Update context command to include workarea trim information in project overview
Enhanced the context command description to specify the inclusion of workarea trim in seconds when set, providing users with a more comprehensive overview of the open project. Additionally, updated the context retrieval logic to calculate and return workarea details based on the active scene's trim settings.
2026-07-24 08:05:59 +02:00
konstantin-paulus
5da1a203a8 Refactor media transcription logic to simplify parameters and improve clarity
Removed optional start and end parameters from the MediaTranscribeRequest type and the mediaTranscribe function, streamlining the transcription process. Updated related documentation to reflect these changes, ensuring a clearer understanding of the transcription command and its usage.
2026-07-23 14:33:14 +02:00
konstantin-paulus
07c47fae94 Enhance audio downsampling logic and update captions documentation
Refactored the downsampleAudio function to improve peak calculation efficiency and accuracy. Updated the logic to handle peak accumulation more effectively, ensuring better audio quality in downsampled outputs. Additionally, expanded the captions documentation to clarify the relationship between timing properties and transcript trimming, enhancing user understanding of captioning mechanics.
2026-07-22 19:21:16 +02:00
konstantin-paulus
81d29d5d88 Add Shader Paint functionality and related components
Introduced a new `<shaderPaint>` element that applies a WGSL fragment shader to the media paint directly below it in the paint stack. Implemented support for shader uniforms and updated the rendering logic to handle shader paints in the engine. Enhanced the API to include shader-related methods and types, ensuring seamless integration with existing media elements. Updated documentation and examples to demonstrate the new shader capabilities, improving user guidance and showcasing practical implementations.
2026-07-20 20:56:32 +02:00
konstantin-paulus
c1bc3f0085 Update package.json and README for consistency and clarity
Modified the "check" script in package.json to reference the correct "examples" directory. Updated the README to replace "video editor" with "media compositor" for improved accuracy and restructured some sentences for better readability. Removed outdated documentation files related to assets, CLI, composition, distribution, and getting started, streamlining the documentation for a more focused user experience.
2026-07-20 15:53:30 +02:00
konstantin-paulus
5e42ec2084 Refactor JSX elements to use lowercase tags for consistency
Updated all JSX elements in the documentation and codebase to use lowercase tags (e.g., `<Scene>` to `<scene>`, `<Video>` to `<video>`, etc.) for uniformity and adherence to the new standards. This change enhances clarity and consistency across the JSX API, ensuring that users have a cohesive experience when working with the elements. Updated related documentation to reflect these changes.
2026-07-20 14:15:45 +02:00
konstantin-paulus
7180de47ae Enhance <Captions /> component with verticalAlign property and update related functionality
Added a `verticalAlign` property to the `<Captions />` component, allowing for customizable vertical positioning of caption blocks. Updated the relevant API, decoders, and serialization logic to support this new feature. Enhanced documentation to reflect the changes and clarify usage, improving the overall flexibility and usability of the captioning system.
2026-07-20 11:17:00 +02:00
konstantin-paulus
5ab9652d06 Add offsetX and offsetY properties to JSX elements and update related documentation
Introduced `offsetX` and `offsetY` as new animatable properties for visual elements, allowing for render-time translations without altering layout boxes. Updated the documentation to reflect these changes, ensuring clarity on their usage. Enhanced the type definitions and functionality in the editor API to support these new properties, improving the overall flexibility of animations in the application.
2026-07-20 10:57:29 +02:00
konstantin-paulus
ca796b49a9 Update documentation for <Html> and <Surface> elements to clarify usage and improve descriptions
Revised the documentation for the `<Html>` and `<Surface>` elements, enhancing clarity by updating descriptions and correcting terminology. The `<Html>` element now emphasizes its role in rendering real HTML content, while the `<Surface>` element is described as an element backed by a canvas. Additionally, improved the examples and clarified the relationship between `<Html>` and `<HtmlPaint>`, as well as `<Surface>` and `<SurfacePaint>`, to better guide users in their implementation.
2026-07-20 10:35:05 +02:00
konstantin-paulus
d083cd76ed Add screenshot command to CLI and implement screenshot functionality
Introduced a new `screenshot` command in the CLI to capture the entire application window as a PNG. Updated the documentation to include this command and its options. Implemented the screenshot functionality in both the CLI and desktop applications, allowing users to save the screenshot to a specified directory. Enhanced the type definitions to support the new screenshot feature, improving overall usability and functionality.
2026-07-20 10:25:35 +02:00
konstantin-paulus
d4b23008f0 Update JSX handling to reject <audio> and <video> tags in paint hosts
Modified the JSX runtime and related documentation to clarify that `<audio>` and `<video>` tags are not supported within paint hosts. Users are now directed to use the `<Audio>` and `<Video>` composition elements for media playback, ensuring better adherence to the paint host's functionality and improving overall documentation clarity.
2026-07-19 23:25:23 +02:00
konstantin-paulus
a5644b44b4 Update CLI documentation to include new logs command and clarify output formats
Added the `logs` command to the CLI documentation, detailing its functionality for displaying recent console output. Updated the conventions section to specify that the `logs` command outputs plain formatted log lines, enhancing clarity on command outputs and improving the overall documentation for user reference.
2026-07-19 23:11:58 +02:00
konstantin-paulus
7f1e8f7a0f Add logging functionality to CLI and desktop applications
Introduced a logging system that captures console output from the running app, including various log levels (debug, info, warning, error). Implemented a new `logs` command in the CLI to display recent log entries, and integrated log handling in the desktop application to maintain a buffer of log entries across reloads. Updated relevant types and API routes to support log retrieval, enhancing debugging capabilities and overall application observability.
2026-07-19 22:28:15 +02:00
konstantin-paulus
2bb2add67b Update JSX elements to PascalCase and enhance type handling in documentation
Refactored JSX elements from lowercase to PascalCase, including `<scene>` to `<Scene>`, `<text>` to `<Text>`, and others, to improve consistency and clarity in the codebase. Updated related documentation to reflect these changes, ensuring that the usage of JSX elements aligns with the new naming conventions. This update enhances the overall readability and usability of the JSX API.
2026-07-19 20:25:33 +02:00
konstantin-paulus
e011b1d593 Refactor mount and insert commands for improved clarity and functionality
Updated the `dapi mount` command to ensure the reactive graph remains live after execution, enhancing the persistence and re-execution of modules across contexts. Simplified the `dapi node insert` command to accept only inline JSX tags, removing the `export default` requirement and clarifying its non-persistent nature. Adjusted related documentation to reflect these changes, ensuring consistency and clarity in usage. This refactor improves the overall usability and understanding of the mounting and insertion processes in the application.
2026-07-19 12:37:08 +02:00
konstantin-paulus
9feb7badc3 Refactor <canvas> to <surface> for improved clarity and functionality
Replaced all instances of `<canvas>` and `<canvasPaint>` with `<surface>` and `<surfacePaint>` across the codebase. Updated related documentation to reflect this change, ensuring consistency in naming and usage. Adjusted rendering logic and component imports to support the new surface functionality, enhancing the drawing capabilities for various context types (2D, WebGL, WebGPU). This refactor improves the overall clarity and usability of the rendering system.
2026-07-18 14:34:18 +02:00
konstantin-paulus
ad2c7e27b7 Enhance module import resolution and documentation for userland packages
Updated the module compilation process to improve import resolution for userland packages, allowing bare specifiers to be rewritten to CDN URLs. Introduced a `dapi.config.json` configuration file for pinning versions and redirecting imports, enhancing reproducibility. Expanded documentation to clarify the import resolution process and added examples for using the new configuration options. This update streamlines the handling of external dependencies and improves the developer experience.
2026-07-18 14:03:23 +02:00
konstantin-paulus
8b9c8ef0cc Add useFile hook for resolving file sources in effects
Introduced the `useFile` hook, which resolves a source (path, asset id, URL, or `generate.*` ref) to its `File`, allowing for reading raw bytes within effects. This hook returns Solid's `createResource` tuple, enabling async resolution and providing loading and error states. Updated documentation to include usage examples for drawing images onto a `<canvas>` and parsing data files, enhancing the functionality for handling media assets in the application.
2026-07-18 10:41:45 +02:00
konstantin-paulus
aaafd86eaa Add <canvas> element and related functionality for custom drawing
Introduced the `<canvas>` element as a shorthand for a rectangle carrying a `<canvasPaint>`, enabling users to draw custom graphics using various context types (2D, WebGL, WebGPU). Updated the rendering system to support this new element, ensuring it integrates with existing components. Enhanced documentation to clarify the usage of `<canvas>` and its properties, and added new samples demonstrating its functionality in different contexts. This update improves the flexibility and creative potential of rendered content.
2026-07-18 09:48:26 +02:00
konstantin-paulus
7c6406c8e7 Update Electron version and enhance documentation for JSX elements
Bumped the Electron version in both `package-lock.json` and `package.json` to `43.1.1`. Removed the deprecated `<jstemp>` component and updated the JSX elements documentation to reflect new aliases for paint elements, including `<solid>`, `<linearGradient>`, `<radialGradient>`, and `<stop>`. Revised the `html-paint.md` and `elements.md` files to clarify the usage of the `<html>` element and its properties. Added new samples demonstrating the use of the `<html>` element in various contexts.
2026-07-17 14:30:04 +02:00
konstantin-paulus
1582db9862 Add <htmlPaint> element and related documentation for reactive HTML rendering
Introduced the `<htmlPaint>` element, allowing real HTML children to be rendered within a defined box using the html-in-canvas API. Updated the `elements.md`, `paints.md`, and `README.md` to include details about `<htmlPaint>`, its properties, and usage examples. Added a new `html-paint.md` file for comprehensive documentation on the element's functionality and limitations. Enhanced the rendering system to support HTML content, ensuring it integrates seamlessly with existing paint types.
2026-07-17 12:13:30 +02:00
konstantin-paulus
86b06ac300 Enhance documentation and implement live mode features for mounting
Updated the `mount.md` and `lifecycle.md` documentation to clarify the new `--live` option, detailing its behavior and implications for the reactive graph. Introduced the `useTicker` hook in the `renderer.ts` to facilitate access to the project's timeline during live mounts. Additionally, modified the `playback.ts` and `live-mounts.ts` to support the new live functionality, ensuring that the reactive graph remains active and responsive during playback. These changes improve the overall usability and clarity of the mounting process.
2026-07-17 09:53:37 +02:00
konstantin-paulus
091631e559 Add live mount functionality to the mounting process
Enhance the `mount` command to support a new `--live` option, allowing the reactive graph to remain active after mounting. This change includes updates to the `MountRequest` and `MountOptions` types, as well as modifications to the `handleMount` function to manage live mounts effectively. Additionally, a new utility for managing live mounts has been introduced, improving the overall handling of reactive entities in the engine.
2026-07-17 09:18:41 +02:00
konstantin-paulus
79daf8a037 Update default objectFit value in image and elements documentation for consistency
Change the default value of the `objectFit` property in the image documentation from "contain" to "cover" to align with the updated description in the elements documentation. This ensures clarity and consistency across the documentation regarding how media pixels map into the box.
2026-07-17 08:36:41 +02:00
konstantin-paulus
5a8b56d29b Add animations prop to various components and documentation
Introduce the `animations` prop across multiple components, including audio, elements, and text, allowing for preset in/out animations. Update related documentation to reflect this new feature and enhance the `animations` handling in the node patching process. This change improves the flexibility and visual dynamics of the UI elements.
2026-07-15 15:33:44 +02:00
konstantin-paulus
67dcb6fdcc Refactor asset and folder command outputs for consistency and clarity
Update the output format for various asset and folder commands to ensure JSON Lines are emitted on stdout, providing a consistent structure across commands. Enhance error handling to ensure that unknown ids or invalid inputs fail the entire command, improving user feedback and command reliability. This change streamlines the user experience and aligns with the fail-fast convention for batch commands.
2026-07-15 12:39:25 +02:00
konstantin-paulus
429a6c8153 Enhance node capture functionality with output directory option
Add an `output` option to the `CaptureOptions` type, allowing users to specify a directory for saving captured PNG files. Update the `nodeCapture` function to create the specified directory recursively if it doesn't exist, improving flexibility in file management during node captures. This change enhances user experience by providing control over file output locations.
2026-07-15 11:48:28 +02:00
konstantin-paulus
95f4a8d5f5 Refactor error handling and improve directory creation in CLI client
Update the `errnoCode` function to ensure it only processes TRPCClientError instances, enhancing error handling accuracy. Additionally, modify the media processing functions to create output directories recursively, ensuring that the necessary paths exist before file operations. This change improves robustness and reliability in file handling within the CLI application.
2026-07-15 07:35:31 +02:00
konstantin-paulus
54cd22f038 Refactor node capture logic for improved clarity and default handling
Simplify the `nodeCapture` function by consolidating time parsing logic and ensuring default values are handled more gracefully. Update the CLI command description to clarify the default time behavior for captures. This change enhances code readability and user experience by providing clearer expectations for time input.
2026-07-14 09:42:27 +02:00
konstantin-paulus
6c436b9658 Refactor mount and node insert functions for improved clarity
Update the `dispose` function initialization to include a space for consistency. Remove the `rootCreated` property from the `WorldDocument` class, simplifying the state management during scene handling. This change enhances code readability and maintains functionality in scene mounting and node insertion processes.
2026-07-13 23:16:59 +02:00
konstantin-paulus
dd1d764641 Focus camera on newly mounted scenes
When dapi mount creates a scene root that did not exist before (no node
with the same key), the camera now fits it into view after it becomes
the active scene. Re-mounts of an existing key still switch the active
scene but leave the camera untouched, so iterating on a project does not
yank the viewport.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-13 23:09:19 +02:00
konstantin-paulus
66a37207c2 Enhance node capture functionality with resolution support
Update the image encoder configuration to include a new `resolution` parameter, allowing for customizable output height during node captures. Modify the CLI command description to reflect the fixed 720p height for captures, ensuring consistency in output quality. This change improves the flexibility and precision of the image capturing process, enhancing the overall user experience.
2026-07-13 22:59:14 +02:00
konstantin-paulus
35534e3189 Implement image encoding for entity frames in node capture
Introduce a new `ImageEncoder` to render frames of an entity into standalone PNGs, enhancing the node capture functionality. Update the `handleNodeCapture` function to utilize the new encoder, allowing for more precise frame capturing with optional timestamp labeling. This change streamlines the capture process and improves the quality of output images, ensuring better representation of animated entities.
2026-07-13 10:13:11 +02:00
konstantin-paulus
92c2459a5b Refactor node capture functionality for improved type safety and clarity
Update the `nodeCapture` function to require a non-optional `id` parameter, enhancing type safety. Revise the CLI command to reflect this change, ensuring users must provide a node ID for capturing. Additionally, streamline the `handleNodeCapture` function by asserting canvas readiness and simplifying scene handling, which improves the robustness and clarity of the node capture process.
2026-07-12 15:52:47 +02:00
konstantin-paulus
8fcf8884b8 Update audio and video documentation to reflect volume changes in decibels
Revise the JSX documentation for `<audio>` and `<video>` components to clarify the `volume` prop, now expressed in decibels instead of a linear scale. Update example usages in the README and ensure consistency across related documentation. Additionally, modify the description of volume handling in the CLI to align with the new decibel representation, enhancing user understanding of audio properties.
2026-07-12 13:57:58 +02:00
konstantin-paulus
7ace383dbe Update JSX documentation to clarify group behavior and paint usage
Revise the documentation for JSX elements, specifically the `<group>`, `<text>`, and paint elements, to enhance clarity regarding their properties and behaviors. The `<group>` now emphasizes its auto-sizing feature based on children, while `<text>` and paint elements have been updated to reflect the use of `fill` instead of `color`. Additionally, the README has been updated to describe the pseudo-SVG nature of the markup, ensuring users have accurate and comprehensive information.
2026-07-12 10:54:06 +02:00
konstantin-paulus
efb17d896c Refactor timing properties in JSX elements for improved clarity and consistency
Update timing-related properties across various JSX elements, replacing `inPoint`, `outPoint`, and `startTime` with `start`, `end`, `sourceIn`, and `sourceOut`. This change enhances the clarity of temporal placement semantics and aligns with the new structure for managing media timelines. Additionally, update related documentation to reflect these changes, ensuring users have accurate information on timing properties.
2026-07-12 08:39:04 +02:00
konstantin-paulus
586cd78164 Add WebGPU types and enhance media frame handling with auto selection feature
Introduce the `@webgpu/types` package to support WebGPU functionalities in the CLI and web applications. Update the media frame handling logic to include an `auto` option, allowing for automatic frame selection based on visual state changes. This enhancement improves the user experience by providing a more intuitive way to capture frames from video assets, ensuring better quality and relevance in the output.
2026-07-11 15:21:43 +02:00
konstantin-paulus
b461d278a9 Update CLI asset and selection commands to support multiple aliases for improved usability
Modify the `ls` command in the asset and selection sections to allow for multiple aliases, enhancing user flexibility in command usage. This change aims to improve the overall user experience by providing alternative command options while maintaining existing functionality.
2026-07-11 11:51:16 +02:00
konstantin-paulus
babbd0b60d Update CLI command descriptions for improved clarity and usability
Revise descriptions across various CLI commands to enhance user understanding. Changes include clearer explanations for the `context`, `open`, `mount`, `asset`, and `media` commands, ensuring users have precise information on functionality and usage. Additionally, update argument and option descriptions for better context and error handling, contributing to an overall improved user experience in the CLI.
2026-07-11 09:40:05 +02:00
konstantin-paulus
125a156fcb Enhance node capture command with timestamp options and documentation updates
Add a `--no-timestamp` option to the `node capture` command, allowing users to disable timestamp labeling on captured images. Update the command description and related documentation to reflect this new functionality, ensuring clarity on the capture process and output format. Additionally, implement a utility function for consistent timestamp labeling across the application, improving the overall user experience when capturing node images.
2026-07-11 08:16:32 +02:00
konstantin-paulus
6878007846 Enhance node capture functionality to support multiple timeline positions
Refactor the `node capture` command to allow capturing images at multiple specified timeline positions, updating the output format to return a JSON line for each capture with the corresponding time and path. Adjust related documentation and descriptions to reflect these changes, improving clarity and usability for users. This update enhances the command's functionality, enabling more precise captures in the application.
2026-07-11 08:10:27 +02:00
konstantin-paulus
6199baf1ab Refactor screenshot command to capture and update documentation
Rename the `screenshot` command to `capture` across the codebase and documentation for consistency. Update related descriptions and references to reflect this change, enhancing clarity in the CLI usage and improving user understanding of the command's functionality. This refactor also includes adjustments in the API handling and documentation to ensure a seamless transition.
2026-07-11 08:04:38 +02:00
konstantin-paulus
fda2c7e78c Update transcribe command description to include ultra-precise millisecond-level timestamps for improved clarity and usability in media analysis. 2026-07-10 13:13:06 +02:00
konstantin-paulus
e22e4bbc30 Enhance media frame grabbing functionality and update documentation
Refactor the `grab` command to support new options for frame extraction, including `--count`, `--start`, `--end`, and `--quality`, allowing users to specify the number of frames, sampling window, and resolution presets. Update error handling to ensure proper validation of input parameters. Revise command descriptions for clarity, improving user understanding of frame extraction capabilities and enhancing overall usability in media analysis.
2026-07-10 13:08:48 +02:00
konstantin-paulus
25b4187691 Refactor media output structures and enhance waveform functionality
Update the output structure for the `filmstrip` command to simplify the JSON response by removing grid geometry details. Enhance the `waveform` command to include silent stretches in the output, providing users with additional information about audio silence periods. Adjust type definitions and documentation to reflect these changes, improving clarity and usability for media analysis tools.
2026-07-10 12:13:42 +02:00
konstantin-paulus
d52f63ec76 Refactor media inspection commands and enhance documentation
Replace the `visualize` command with `filmstrip` and introduce a new `waveform` command for rendering audio waveforms. Update type definitions and API handling to reflect these changes, ensuring consistency across the application. Revise documentation to clarify command functionalities and improve user understanding of media asset inspection tools, enhancing overall usability.
2026-07-10 11:01:48 +02:00