ComfyUI

ComfyUI is an open source node graph application for running generative models locally, built by Comfy Org and licensed under GPL 3.0. The project began on GitHub in January 2023 as a graph and node interface for diffusion models and has grown into a general creation engine for images, video, audio and 3D, where every model, parameter and output is a node that can be wired into a larger workflow.

ComfyUI runs on Windows, macOS and Linux. Comfy Org ships a desktop application for Windows and macOS, portable Windows builds for NVIDIA, AMD and Intel GPUs, and a manual install that supports NVIDIA, AMD, Intel, Apple Silicon and Ascend hardware. Comfy Org states that its asynchronous weight streaming runs the largest open models on as little as 4 GB of VRAM and 8 GB of system RAM. Comfy Cloud is the paid hosted version for users without local hardware, and partner nodes reach closed source models through the same graph.

Gaussian splatting first reached ComfyUI through community node packs. Comfy3D by Mr. For Example arrived in February 2024 with VAST AI's Triplane Gaussian image to splat model and in graph previews of 3DGS scenes and meshes. ComfyUI v0.23.0 then brought day zero support for TripoSplat, an MIT licensed image to Gaussian splat model from Tripo, as a workflow template that downloads the model, takes one image and returns a viewable splat at a detail level the user chooses.

The same release made splats a native data type. ComfyUI's SPLAT type stores positions, scales, rotations, opacities and spherical harmonic coefficients and flows between nodes the way images, masks and latents do. RenderSplat rasterizes color, clay, depth and normal passes with turntable orbits, SplatToMesh extracts a vertex colored mesh, TransformSplat and MergeSplat handle transforms and concatenation, and GetSplatCount reports how many splats a batch holds. The Get Splat loader reads .ply, .splat, .ksplat and .spz and can detect the format from the file contents, and the exporter writes .ply with full spherical harmonics, or .ksplat and .spz with base color only. A dedicated Preview Splat node for interactive previews inside the editor followed in v0.25.0.

Because the type is shared, any core or custom node can produce or consume a splat. A scene reconstructed in another tool can be loaded as a .ply, repositioned, rendered to depth and normal maps that guide a diffusion pass, and exported back to .spz for delivery inside a single graph with no Python scripting.

ComfyUI is available on GitHub.