Research Scientist - 3D/4D Reconstruction/Generation, PICO

Full Time

|

San Jose, CA, US

|

ByteDance

Job Details

Location: San Jose
Team: Technology
Employment Type: Regular
Job Code: A243243

About the Team

The PICO MR team is dedicated to developing core environmental perception algorithms for the PICO system. The team focuses on three main areas: visual localization, scene perception, and 3D reconstruction.

Its work in MR scenarios includes research, exploration, and deployment of technologies such as multimodal scene perception, AIGC scene generation, depth estimation, including Mono, Stereo, and MVS, 3D scene reconstruction, including 3DGS and NeRF, and lighting estimation.

The team has strong technical capabilities, with most members holding master’s or doctoral degrees from renowned universities, including Tsinghua University, Peking University, Zhejiang University, Nanyang Technological University, and Hong Kong University of Science and Technology.

The team has published numerous papers in top conferences and journals, including CVPR, ECCV, ICCV, SIGGRAPH, and TPAMI. It has also won multiple awards, including:

  • CVPR 2025 OpenSUN3D Double Track Champion

  • CVPR 2025 Cross-device Localization Challenge Champion

  • CVPR 2024 Monocular Depth Estimation Challenge Champion

  • CVPR 2024 OpenSUN3D 3D Functionality Grounding Track Champion

  • ICCV 2023 OpenSUN3D 3D Object Instance Search Track Champion

Responsibilities

  • Participate in R&D for 3D/4D algorithms and foundation models, and promote their deployment in MR application scenarios.

  • Develop and optimize large 3D/4D generative models, including data curation, pre-training, post-training, evaluation, acceleration, and deployment.

Qualifications

Minimum Qualifications

  • Master’s degree or above in Computer Science or a related field.

  • 3+ years of algorithm research or industry experience.

  • Excellent programming skills, with proficiency in Python, C, or C++ and common deep learning frameworks.

  • Solid foundation in AIGC, 3DV, or CG, with project experience in reconstruction or generation.

  • Proficiency in 3D representation and rendering, including Gaussian Splatting, NeRF, meshes, and point clouds.

Preferred Qualifications

  • Thorough understanding of the latest advances in reconstruction and generation.

  • Experience in any of the following areas is preferred:

    • 3D/4D reconstruction, including feed-forward GS or optimization-based methods

    • 3D/4D generation, including human, scene, or novel view synthesis

    • Image/video generation and understanding, including video depth estimation, tracking, or understanding

  • Publications in CV, CG, ML, or AI conferences or journals, such as CVPR, ICCV, ECCV, SIGGRAPH, TOG, TVCG, NeurIPS, ICML, or ICLR, with a focus on computer vision or computer graphics.

  • Hands-on experience building large model training pipelines and curating datasets.

  • Familiarity with MR, AR, or VR technologies is a strong plus.

  • Award winners of competitions such as ACM-ICPC, NOI/IOI, TopCoder, or AI/CV contests are preferred.

Job Information

Compensation

For Pay Transparency: The base salary range for this position in the selected city is $212,800–$450,000 annually.

Compensation may vary outside of this range depending on a number of factors, including a candidate’s qualifications, skills, competencies, experience, and location.

Base pay is one part of the total package provided to compensate and recognize employees for their work. This role may also be eligible for additional discretionary bonuses, incentives, and restricted stock units.

Benefits

Benefits may vary depending on the nature of employment and the country of work location.

Employees have day-one access to medical, dental, and vision insurance; a 401(k) savings plan with company match; paid parental leave; short-term and long-term disability coverage; life insurance; wellbeing benefits; and other benefits.

Employees also receive:

  • 10 paid holidays per year

  • 10 paid sick days per year

  • 17 days of Paid Personal Time, prorated upon hire with increasing accruals by tenure

The Company reserves the right to modify or change these benefits programs at any time, with or without notice.

For Los Angeles County Unincorporated Candidates

Qualified applicants with arrest or conviction records will be considered for employment in accordance with all federal, state, and local laws, including the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act.

Our company believes that criminal history may have a direct, adverse, and negative relationship with the following job duties, potentially resulting in the withdrawal of a conditional offer of employment:

  1. Interacting and occasionally having unsupervised contact with internal or external clients and/or colleagues.

  2. Appropriately handling and managing confidential information, including proprietary and trade secret information, and access to information technology systems.

  3. Exercising sound judgment.

About Pico

Founded in April 2015, Pico is a VR company committed to developing immersive and interactive VR experiences for people around the world.

Pico also provides tailor-made solutions for enterprise clients in the fields of education and healthcare.

Why Join ByteDance

Inspiring creativity is at the core of ByteDance’s mission. Our innovative products are built to help people authentically express themselves, discover, and connect, and our global, diverse teams make that possible.

Together, we create value for our communities, inspire creativity, and enrich life — a mission we work toward every day.

As ByteDancers, we strive to do great things with great people. We lead with curiosity, humility, and a desire to make an impact in a rapidly growing tech company.

By constantly iterating and fostering an “Always Day 1” mindset, we achieve meaningful breakthroughs for ourselves, our company, and our users. When we create and grow together, the possibilities are limitless.

Join us.

Diversity & Inclusion

ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives.

Our platform connects people from across the globe, and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and creating an environment that reflects the many communities we reach.

We are passionate about this and hope you are too.

Reasonable Accommodation

ByteDance is committed to providing reasonable accommodations in our recruitment processes for candidates with disabilities, pregnancy, sincerely held religious beliefs, or other reasons protected by applicable laws.

If you need assistance or a reasonable accommodation, please reach out to us at: https://tinyurl.com/RA-request