Job Description

At Reality Labs Research (RL-R), our goal is to explore, innovate and design novel interfaces and hardware subsystems for the next generation of virtual, augmented, and mixed reality experiences. Our aim is to unleash human potential by erasing the bottlenecks between intent and action. The key to this work is in the development of robust, adaptive algorithms and systems that can seamlessly power the decoding of wearable biometrics and drive powerful adaptive XR interfaces. As a Research Engineer, you will focus on developing novel, robust, and real-time multi-sensor processing algorithms for wrist-wearables. Your work will involve novel techniques around self-supervised learning, robust decoding of biometric signals, confounder mitigations, and state-estimation/sensor-fusion techniques for stringing an entire ultra-low-friction (ULF) interactive system together. Lastly, you will also be responsible for the full-stack integration of your work onto our real-time SDKs and systems for the creation of compelling demonstrations of this technology. Our research lies at the intersection of signal processing, machine learning, and human-computer interaction (HCI), and is both state-of-the-art research but also applied, practical, and concrete. You will work with world-leading collaborators, researchers, and mentors in the AR/VR, machine learning, neuroscience, AI, and HCI fields.

Wearables Algorithms Research Engineer Responsibilities:

• Plan, execute, code, and integrate (i.e., full-stack development) of cutting-edge research and design (R&D) of novel adaptive algorithms for a variety of different sensory modalities. This includes classification, fusion, confounder mitigation, and robust real-time gesture recognition algorithms and systems that yield seamless interactions.
• Rapid prototyping of proof-of-concepts for various DNN, fusion and signal processing algorithms. This includes working deeply in our code base, and not shying away from integration responsibilities. Work closely with our data collection team to articulate and assist in data collection protocol design, labeling protocols, etc. You will also be expected to be able to assist in giving valuable feedback and guidance to our tooling team.
• Design algorithms that lend themselves towards being sample efficient, easily tunable, and adaptive enough to work across multiple users and multiple use-cases with minimal re-training. Typical modalities can include, but are not limited to, EMG, IMU, Imaging sensors, PPG, etc.
• Clearly communicate, present, and articulate algorithm and system designs to the team and beyond.
  
  

Minimum Qualifications:

• Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience.
• MS degree in signal processing, computer vision, machine learning, state-estimation, robotics, or equivalent.
• 3+ years of academic/industry experience around multi-channel time-series signal processing, fusion, and algorithms design.
• 3+ years of experience with scientific programming languages such as Python, PyTorch or C++.
• Interpersonal skills: cross-group collaboration and cross-culture collaboration.
• Must obtain work authorization in the country of employment at the time of hire and maintain ongoing work authorization during employment.
  
  

Preferred Qualifications:

• PhD degree in signal processing, computer vision, machine learning, state-estimation, robotics, or equivalent.
• 5+ years of industry experience around multi-channel time-series fusion and algorithms design.
• 5+ years of experience with scientific programming languages such as Python, PyTorch and/or C++.
• Proven track record in the design of novel and fieldable algorithms that have been deployed in the real-world and in real-time (e.g., Wireless, RADAR, SONAR, Biometrics such as EMG or EEG signal processing stacks, including beamforming or fusion techniques).
• Experience with self-supervised learning, state estimation and/or sensor-fusion techniques and natural language processing (NLP).
• Experience with biometric modeling for real-time interactive scenarios (e.g., gesture recognition, task inference).
  
  

Facebook is proud to be an Equal Opportunity and Affirmative Action employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender, gender identity, gender expression, transgender status, sexual stereotypes, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law.Facebook is committed to providing reasonable accommodations for candidates with disabilities in our recruiting process. If you need any assistance or accommodations due to a disability, please let us know at accommodations-ext@fb.com.