Enlighten 3D

Enlighten 3D, a pioneering AI lab focusing on the synthetic 3D world, has unveiled Enlighten-SDS 1.5, the latest version of its cutting-edge synthetic 3D creation system. This groundbreaking tool leverages AI to generate highly realistic 3D assets with photogrammetry-like mesh, using physically based rendering (PBR) materials—all guided by text prompts and optional conditions from images, voxels, or rough meshes. By eliminating the need for real-world references, Enlighten-SDS 1.5 reduces modeling time by up to 60%, empowering artists to focus on creativity and innovation.

• Film Pre-visualization, Virtual Production Background

• Product/Architectural Visualization Background

• Synthetic AI Training Data for Other Workflows

A Novel Approach to 3D Model Creation

Enlighten-SDS 1.5 distinguishes itself by synthesizing lifelike 3D models without direct reliance on real-world photo scans. Its design focuses on extracting visual details from 2D imagery and other pre-trained AI models while adhering to rigorous ethical standards.

The Technology Behind Enlighten-SDS 1.5

Enlighten-SDS 1.5 represents a significant leap forward in 3D model generation through its unique combination of AI technologies:

1. Geometry Creation:

   • A NeRF-inspired neural network supports the optimization of surface-aligned 3D geometry, allowing to learn geometric knowledge derived from pre-trained diffusion and vision-language models.

   • Optional integration with 3D Gaussian Splatting (3DGS) enables better stability and quality for constructing semi-transparent surfaces.

2. Photorealistic PBR Materials:

   • A differentiable ray-tracing pipeline produces high-fidelity diffuse, roughness and metallic maps.

   • The system minimizes baked lighting artifacts in diffuse maps, delivering lifelike textures that capture imperfections and natural surface characteristics.

3. Style and Photorealism Alignment:

   • Advanced distillation methods improve realism and geometric accuracy while addressing common issues such as Janus faces and structural instability.

   • The system balances data sourced from 3D and 2D datasets, prioritizing image-based learning to synthesize textures while leveraging 3D datasets primarily for geometric stability.

Addressing Data Ethics

In response to controversies surrounding datasets like Objaverse, which sourced 3D assets from platforms such as Sketchfab, Enlighten-SDS 1.5 employs robust alignment techniques. These ensure outputs are derived from 2D knowledge, predominantly images and photo captures, while using artist-crafted 3D data sparingly to stabilize geometry.

The result is a system capable of generating out-of-distribution assets with photorealistic proportions, intricate geometric details, and high-quality textures—all while respecting the hard work of human 3D creators.

Challenges and Current Limitations

Despite its groundbreaking potential, Enlighten-SDS 1.5 comes with a few technical challenges:

• High Computational Demand: The generation process requires data-center-grade GPUs and takes 45–90 minutes per model.

• Stability Issues: Human intervention is often needed to achieve optimal output fidelity.

• Topology Artifacts and Uneven Surface: Similar to photogrammetry, the system may produce artifacts like surface holes, broken geometry, and baked lighting in diffuse maps.

To address these issues, Enlighten 3D is currently working on its successor and, in the meantime, offers an AI modeling service rather than a direct on-demand model, optimizing costs and turnaround times while maintaining high output fidelity.

Future Developments

Looking ahead, Enlighten 3D is exploring new AI agents capable of automating the system and integrating directly with popular tools like Blender. This evolution aims to simplify the creative process, empowering artists by reducing technical complexities and repetitive tasks.

A New Era for 3D Artistry

Enlighten-SDS 1.5 represents a transformative moment in AI-driven 3D creation. By prioritizing ethical innovation and technological excellence, Enlighten 3D holds its commitment to empower artists while protecting the integrity of human creativity.