Job Description

Facebook's mission is to give people the power to build community and bring the world closer together. Through our family of apps and services, we're building a different kind of company that connects billions of people around the world, gives them ways to share what matters most to them, and helps bring people closer together. Whether we're creating new products or helping a small business expand its reach, people at Facebook are builders at heart. Our global teams are constantly iterating, solving problems, and working together to empower people around the world to build community and connect in meaningful ways. Together, we can help people build stronger communities - we're just getting started.

Understanding the user is at the center of our research, as it informs our work in displays, optics, rendering and practically all components of an AR/VR system. As a Research Engineer on the Applied Perception Science team at Facebook Reality Labs, you will be tackling the scientific challenges that will define cutting-edge next generation AR & VR.

We are currently seeking innovative and self-motivated Research Engineers with a Computer Graphics background to join us in pushing forward the state of the art in wearability and anthropometric analysis; including working with hardware and software tools for 3D data collection and 3D scanning, geometry processing, mesh registration, and statistical shape modeling. In addition to working in a dynamic cross-functional environment with researchers within the Display and Optics organization, this role offers opportunities to collaborate closely across the Facebook Reality Labs org.

An ideal candidate would be able to take a real-world problem 3D scanning problem, create automated data registration pipelines and derive parameters from the meshes. The work will involve working closely with cross-functional teams to design/implement models that estimate relevant parameters from geometric data.

Responsibilities

• Apply geometry and machine learning algorithms to 3D scanning problems (i.e. PCA on meshes, statistical shape modeling, robust mesh registration algorithms).
• Conceive proof-of-concept prototypes that establish overall system requirements and performance.
• Work with 3D hardware and software to define scalable 3D data capture pipelines.
• Analyze data derived from 3D scanned geometry and improve data analysis pipelines with an emphasis on scalability and stability of various deployed systems.
• Collaborate with other researchers and engineers across teams at Facebook to develop experiments, prototypes, and concepts that advance the state-of-the-art in AR/VR systems.
• Collaborate with internal cross-functional teams for data collection, data processing and analysis.
• Present regularly to large cross-functional teams and communicate progress.
  

Minimum Qualification

• Currently has, or is in the process of obtaining, a PhD degree or completing a postdoctoral assignment in the field of Computer Science, Computer Graphics, Robotics, Computer Vision, or a similar field.
• 3+ years of experience in applied research and/or product development related to 3D geometry.
• 3+ years of experience with any combination of the following: computer graphics, visual effects (VFX), differentiable rendering, machine learning, advanced optimization techniques, computer vision, finite element modeling and analysis, computational physics.
• Experience with 3D vision hardware and software tools and automation.
• Experience with C++, Python, PyTorch, MATLAB.
• Interpersonal experience: cross-group and cross-culture collaboration.
• Must obtain work authorization in country of employment at the time of hire, and maintain ongoing work authorization during employment.
  

Preferred Qualification

• Demonstrated software engineering experience via an internship, work experience, coding competitions, widely used contributions in open source repositories (e.g. GitHub), or contributions to collaborative code base research projects.
• Experience with mesh data processing, noisy data surface extraction, deformable mesh data processing, parametric surface extraction, and data set (point cloud or mesh) to data set alignment and comparison.
• 5+ years of experience in applied research and/or product development related to 3D reconstruction and/or 3D geometry and in particular applications for face scanning and annotation.
• 5+ years of experience with any combination of the following: computer graphics, differentiable rendering, machine learning, data sciences, advanced optimization techniques, visual effects (VFX), computer vision, finite element modeling and analysis, computational physics, 3D rendering, 3D sensing.
• Experience with app development.
• Proven track record of achieving significant results as demonstrated by one or more of the following: grants, fellowships, patents, or at leading workshops or conferences such as CVPR, ECCV/ICCV, SIGGRAPH or similar.
  

Facebook is proud to be an Equal Opportunity and Affirmative Action employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender, gender identity, gender expression, transgender status, sexual stereotypes, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law. Facebook is committed to providing reasonable accommodations for candidates with disabilities in our recruiting process. If you need any assistance or accommodations due to a disability, please let us know at accommodations-ext@fb.com.