Research Engineer Intern, XR Maps Building (PhD)

Employer

Job Description

Facebook's mission is to give people the power to build community and bring the world closer together. Through our family of apps and services, we're building a different kind of company that connects billions of people around the world, gives them ways to share what matters most to them, and helps bring people closer together. Whether we're creating new products or helping a small business expand its reach, people at Facebook are builders at heart. Our global teams are constantly iterating, solving problems, and working together to empower people around the world to build community and connect in meaningful ways. Together, we can help people build stronger communities - we're just getting started.

Facebook Reality Labs is helping people around the world come together and connect through world-class Augmented and Virtual Reality hardware and software. We are developing the future of AR and VR, bringing products to consumers that transform entertainment and social experiences. Virtual reality’s potential to connect the world is immense—and we’re just getting started. With global departments dedicated to VR research, computer vision, haptics, social interaction, and more, AR/VR is committed to driving the state of the art forward through relentless innovation.

FRL is investing in a large-scale 3D mapping initiative. Its mission is to build 3D mapping and localization technology to enable users to create, share and experience digital content in a way that is seamlessly integrated into their physical world. Our team, Mapping Operations (MapOps), is a combination of CV researchers and software engineers. We are focused on the cloud representation of 3D maps. Our team is responsible for a variety of capabilities associated with 3D maps, such as storing them in Facebook’s Cloud, consolidating them, providing services to efficiently query them, and building capabilities to understand the quality of these maps. These efforts involve a combination of CV algorithms and core software engineering infra work. We are seeking a Research intern who is interested in working at the intersection of CV and 3D map representation to help solve scalability challenges that would arise from periodic uploads and merging of maps. 3D point clouds and image descriptors of locations are constantly changing, with varying lighting conditions, moving objects in the scene etc and new maps are constantly being uploaded to the cloud. We need to find robust algorithms to be able to combine uploaded maps to scale. Said another way, we are implementing collaborative life-long mapping between devices and the cloud. Open positions are in the Bay Area, California and remote in the Americas or EMEA.

Our internships are twelve (12) to sixteen (16) weeks long and you have the option to start at various dates throughout the year.

Responsibilities
  • Research, develop, and implement a proof of concept for scalable map merging.
  • Collaboration with and support of other engineers/researchers across various disciplines.
  • Communication of research project agenda, projects and results.
Minimum Qualification
  • Currently has or in the process of obtaining a PhD degree in the field of Computer Vision, Computer Science, Electrical Engineering, Machine Learning or Computer Engineering.
  • Prior research experience and, ideally, prior publication(s) in some of the top computer vision venues (CVPR, ECCV, ICCV, BMVC, 3DV, etc.).
  • Able to write high-quality code in Python and C++.
  • Excellent interpersonal skills, cross-group and cross-culture collaboration required across multiple teams to deliver project solutions.
  • Highly self-motivated and resourceful with good problem solving abilities.
  • Must obtain work authorization in the country of employment at the time of hire and maintain ongoing work authorization during employment.
Preferred Qualification
  • Experience in applying machine learning / deep learning in the multi-view geometry domain (e.g. SLAM, Stereo, Depth Estimation, Visual Localization, Structure-from-Motion).
  • Domain knowledge in state-of-the-art Visual Localization approaches.
  • Demonstrated software engineer experience (via an internship, work experience, coding competitions, etc).
  • Intent to return to degree-program after the completion of the internship.
Facebook is proud to be an Equal Opportunity and Affirmative Action employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender, gender identity, gender expression, transgender status, sexual stereotypes, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law. Facebook is committed to providing reasonable accommodations for candidates with disabilities in our recruiting process. If you need any assistance or accommodations due to a disability, please let us know at accommodations-ext@fb.com.