Frame brings users innovative features that enhance performance, creativity, and functionality in a collaborative digital environment. Their December 2024 update introduces several new capabilities, including Gaussian Splatting support, performance optimizations, and expanded AI integrations.

The standout feature in this update is Frame’s support for Gaussian Splatting— a method that reconstructs a Radiance Field. This functionality is made possible through Babylon.js, which now integrates with Radiance Field methods as well. Companies like Bitbybit are already leveraging Babylon.js’s support to incorporate these innovative techniques. We’ve seen a couple companies, such as Bitbybit leverage the Babylon.js support. 

While there is no training functionality, the ability to import trained ply files from your favorite platform, whether that means Postshot, Luma, Polycam, Scaniverse, or elsewhere, is now super easy in a Frame environment. Speaking of Scaniverse, soon Frame will also support Niantic's open source compressed file type, .spz.

Frame, which has built digital twins for organizations like MIT, Trello, and Coca-Cola, must be celebrating these advancements. The ability to create hyper-real digital twins using Radiance Field methods such as Gaussian Splatting has never been easier.

Performance also remains a priority for Frame, especially as users continue to push the boundaries of what their immersive spaces can do. The December update expands the "hide at a distance" optimization feature, initially available for image assets, to a broader range of elements, including text, videos, polls, and more. This enhancement ensures that assets only render when they’re relevant, boosting performance on lower-end hardware and mobile devices.

Frame’s experimental non-player characters (NPCs) have evolved into "AI Agents," reflecting their growing role in immersive collaboration. The new AI Dashboard allows users to manage agents, access meeting transcripts, and build knowledge bases tailored to their needs. While these agents are still in development, Frame is laying the groundwork for transformative AI-powered meeting tools. Future updates will enable agents to assist between meetings, prepare for upcoming sessions, and contribute meaningfully during collaboration. These advancements promise to make meetings not just more productive but also more creative.

The proliferation of Radiance Field methods into metaverse and other spatial applications continues to roll out, lowering the barrier to interacting with hyper-real versions of the world. These integrations make it easier for people to connect and learn from one another, regardless of geographic location, serving as a reminder of the metaverse’s transformative potential.

Frame is free to get started, allowing users to upload files up to 512MB. For those interested in experimenting further with Babylon.js’s implementation of Gaussian Splatting, additional documentation can be found online.