Job Description

Facebook's mission is to give people the power to build community and bring the world closer together. Through our family of apps and services, we're building a different kind of company that connects billions of people around the world, gives them ways to share what matters most to them, and helps bring people closer together. Whether we're creating new products or helping a small business expand its reach, people at Facebook are builders at heart. Our global teams are constantly iterating, solving problems, and working together to empower people around the world to build community and connect in meaningful ways. Together, we can help people build stronger communities - we're just getting started.

At Facebook Reality Labs Research, our goal is to explore, innovate, and design novel interfaces and hardware for virtual, augmented, and mixed reality experiences. We are driving research towards a wrist-worn AR input device that enables rich user interactions across a range of complex, dynamic, real-world tasks in natural environments. We are looking for a skilled and motivated research scientist with expertise in computer vision & machine learning, human-computer interaction, robotics, or related fields to join our team. In this position, you will design, implement and study systems and algorithms that infer human actions and input commands in real-time, using live data from wearable sensors (e.g., cameras, IMU, EMG, worn on the wrist or other parts of the body). You will be part of our interdisciplinary team of experts in artificial intelligence, human–computer interaction, computer vision, sensor hardware, cognitive science, and UX design, that is defining the next era of human-centered computing. You will have access to FRL’s cutting edge resources and infrastructure to build and test your ideas in real-time on prototype AR systems.

Responsibilities

• Design, build and study computer vision and machine learning systems for real-time pose estimation, activity and object recognition, gesture recognition
• Collaborate with other researchers and engineers to advance research in computer vision and machine learning methods for AR input
• Collaborate with other researchers and engineers to advance research in real-time inference from multimodal data streams, including IMU and EMG
• Research and evaluate new CV/ML solutions for AR input through live interactive demonstrations and through controlled user studies
  

Minimum Qualification

• PhD in the field of computer vision, machine learning, human-computer interaction, robotics, or related technical field
• 3+ years of experience building CV/ML solutions for challenging real-world interactive applications and proving them through end-to-end demos or user experiments
• 3+ years of computer vision experience that demonstrates familiarity with fundamental concepts such as image formation and camera calibration
• 3+ years of experience in at least one deep-learning software library (e.g., PyTorch, Caffe2, TensorFlow) and at least one CV library such as OpenCV. This experience should include formulation, training, and evaluation of new algorithms and writing reusable modules
• Interpersonal experience: cross-group and cross-culture collaboration
• Must obtain work authorization in country of employment at the time of hire, and maintain ongoing work authorization during employment
  

Preferred Qualification

• Experience with hand or body tracking approaches, action recognition
• Experience with 3D computer vision, SLAM, SfM, Multi-view geometry
• Experience with sensor fusion and systems that fuse heterogeneous data streams
• Experience with sensor systems and joint hardware/algorithm design, in particular with camera hardware
• Experience designing data-collection protocols and recording datasets for machine-learning systems
  

Facebook is proud to be an Equal Opportunity and Affirmative Action employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender, gender identity, gender expression, transgender status, sexual stereotypes, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law. Facebook is committed to providing reasonable accommodations for candidates with disabilities in our recruiting process. If you need any assistance or accommodations due to a disability, please let us know at accommodations-ext@fb.com.