Mapillary

Mapillary, a subsidiary of Meta Platforms, Inc., is a cutting-edge technology company specializing in the collection and analysis of street-level imagery to create a comprehensive and up-to-date map of the world. Founded in 2013, Mapillary was acquired by Meta (formerly Facebook) in 2020, aligning its mission with Meta's broader vision of building the metaverse and advancing geospatial technology.

Mapillary's platform allows users and organizations to contribute street-level imagery captured via smartphones, action cameras, and other devices. This crowdsourced approach democratizes map data collection, making it possible to map areas that are often overlooked by traditional mapping services. The platform uses computer vision and machine learning to automatically detect and blur faces and license plates, extract map features like road signs, and stitch together images into panoramic views.

One of the most significant advancements in Mapillary’s technology stack is the integration of Neural Radiance Fields (NeRFs). NeRFs are a revolutionary technology in the field of 3D graphics and computer vision, enabling the creation of high-fidelity, photorealistic 3D models from 2D images. This technology has transformed the way Mapillary processes and visualizes the massive amounts of imagery collected by its users.

By leveraging NeRFs, Mapillary can create detailed 3D reconstructions of urban environments that are not only visually accurate but also capable of capturing fine details and nuances in lighting. These 3D models are crucial for various applications, including urban planning, infrastructure development, autonomous driving, and augmented reality experiences. The high level of detail and accuracy provided by NeRFs allows Mapillary to offer a more immersive and interactive experience for developers, city planners, and end-users alike.

Moreover, the use of NeRFs aligns with Meta’s broader goal of enhancing virtual and augmented reality experiences within the metaverse. By creating highly detailed and realistic 3D models of real-world environments, Mapillary contributes to the development of virtual spaces that can be seamlessly integrated with physical locations, offering new possibilities for navigation, exploration, and social interaction within the metaverse.