Job Description

Facebook's mission is to give people the power to build community and bring the world closer together. Through our family of apps and services, we're building a different kind of company that connects billions of people around the world, gives them ways to share what matters most to them, and helps bring people closer together. Whether we're creating new products or helping a small business expand its reach, people at Facebook are builders at heart. Our global teams are constantly iterating, solving problems, and working together to empower people around the world to build community and connect in meaningful ways. Together, we can help people build stronger communities - we're just getting started.

Facebook Reality Labs Research (FRL-R) brings together a world-class team of researchers, developers, and engineers to create the future of AR and VR, which together will become as universal and essential as smartphones and personal computers are today. The technology that is being developed within the Surreal team at FRL-R is a new generation of end-to-end real-time 3D object & scene understanding systems working across novel mobile sensor design, sensor fusion, state estimation, computer vision, large-scale reconstruction and localization, as well as large-scale online inference and optimization. The Surreal Index team is seeking an exceptional experienced senior engineer and tech lead, with deep expertise in 3D object detection and 6D pose estimation. The expectation is to lead a group of world-class researchers and engineers to perform applied research and push the boundaries with new architectures, scalable ML detection systems and training approaches with synthetic and real data.

Responsibilities

• Plan and execute innovative engineering development to advance the state of the art in machine perception and 3D object & scene understanding in AR/VR systems
• Collaborate closely with researchers and engineers across both machine and human perception teams at Facebook to design prototypes, and concepts related to multi-user object detection and tracking systems distributed across cloud and embedded devices at scale
• Establish a comprehensive and deep technical understanding of LiveMaps Index and existing infrastructures within FB and industry, to help the Index team to make informed decisions
• Architect and communicate designs for Index services running both on embedded devices and cloud
• Set the direction and goals for the team, in terms of project impact, product quality, and engineering efficiency
• Lead design/technical direction, quality efforts, code reviews with the team and give clear and actionable feedback on a timely basis
• Gather use cases from both internal research teams and cross-functional partners to have a clear picture of the requirements for the Index platform
• Given the set of requirements, help formulate a coherent roadmap that delivers features in a progressive, incremental fashion
• Work closely with Index EMs and across the Surreal team to form dynamic virtual teams to pull together research features on the roadmap into end-to-end systems
• Set concrete goals and priorities with ranked features as clear expectations for the team to execute on
• Help recruit new members to grow the team from bootcamp, industry/academia and onboard new members into the team, by mentoring them and making it easy to ramp up in the team's codebases and infra
• Communicate proactively, effectively, and efficiently, both vertically within the Surreal Index, and horizontally across different teams not only within Surreal, but also in cross-functional collaborations
• Proactively learn the bigger context, and bring the right level of context wherever necessary to increase the Index team’s clarity and visibility
• The candidate will be responsible for helping Index EMs drive/orchestrate cross-functional collaborations, to understand their requirements and roadmap, identify commonalities, and further influence their development to accelerate the goals for the overall LiveMaps mission
• The candidate should help the cross-functional collaboration establish alignment on those investments and help the Surreal team to negotiate tech transfer, consolidation and long-term support plans wherever there is opportunity
  

Minimum Qualification

• 9+ years of software engineering work experience in commercial environments, including 3+ years experience of leading multidisciplinary teams to deliver machine perception features
• 6+ years of experience with real world system building, including design, coding (C++/Python) and evaluation/testing (C++/Python)
• 5+ years of experience in Object detection, Pose estimation, 3D Computer Vision algorithms, Reconstruction, Tracking and Deep Learning Frameworks
• PhD degree in the following fields: Computer Science, Software Engineering, Computer Vision, Robotics, 3D Reconstruction
  

Preferred Qualification

• Experience with designing (products or open-source) software for robotic or AR/VR devices
• Experience in real-time computer vision or modern GPU programming (CUDA, OpenGL, OpenCL)
• Experience designing or developing complex cloud integrated machine perception architectures
• Experience in embedded devices
• Experience working in a Unix environment
  

Facebook is proud to be an Equal Opportunity and Affirmative Action employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender, gender identity, gender expression, transgender status, sexual stereotypes, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law. Facebook is committed to providing reasonable accommodations for candidates with disabilities in our recruiting process. If you need any assistance or accommodations due to a disability, please let us know at accommodations-ext@fb.com.