Research Scientist, Speech Enhancement

Employer

Job Description

Facebook's mission is to give people the power to build community and bring the world closer together. Through our family of apps and services, we're building a different kind of company that connects billions of people around the world, gives them ways to share what matters most to them, and helps bring people closer together. Whether we're creating new products or helping a small business expand its reach, people at Facebook are builders at heart. Our global teams are constantly iterating, solving problems, and working together to empower people around the world to build community and connect in meaningful ways. Together, we can help people build stronger communities - we're just getting started.

Facebook Reality Labs brings together a world-class team of researchers, developers, and engineers to create the future of virtual and augmented reality, which together will become as universal and essential as smartphones and personal computers are today. And just as personal computers have done over the past 45 years, AR and VR will ultimately change everything about how we work, play, and connect.We are developing all the technologies needed to enable breakthrough AR glasses and VR headsets, including optics and displays, computer vision, audio, graphics, brain-computer interface, haptic interaction, eye/hand/face/body tracking, perception science, and true telepresence. Some of those will advance much faster than others, but they all need to happen to enable AR and VR that are so compelling that they become an integral part of our lives.The audio team at Facebook Reality Labs is looking for experts in machine learning in speech enhancement. This role is focused in design and development of novel machine learning models to advance the state of the art in speech and audio processing that drive audio experiences in AR and VR. An ideal candidate will be passionate about development of robust technologies that solve real-world problems.

Responsibilities
  • Perform research to tackle unsolved real-world problems and push state of the art in the field.
  • Independently design, implement and train state of the art speech and audio processing models and techniques on Pytorch, Tensorflow or other platforms.
  • Work with research scientists to minimize footprint of trained ML models with various pruning, compression and real-time adaptation techniques.
  • Support research engineers to effectively implement trained models for different platforms, including popular portable personal computing systems with AI accelerators.
  • Mentor Ph.D./M.S. interns, create and drive new initiatives.

Minimum Qualification
  • PhD in a relevant field such as Deep Learning, Machine Learning, Audio signal processing, Speech signal processing, Computer Science, Mathematics or equivalent work experience.
  • 5+ years experience with development and implementation of speech and audio processing algorithms in scientific languages such as Python and C++.
  • 3+ years hands-on experience working with machine learning libraries like Tensorflow, PyTorch, etc.
  • 1+ years experience with developing small foot-print and real-time machine learning models.
  • Must obtain work authorization in country of employment at the time of hire, and maintain ongoing work authorization during employment.

Preferred Qualification
  • Experience with developing scalable machine learning models in at least one of the following areas: noise suppression, speaker separation, de-reverberation, acoustic event detection, ASR.
  • Experience with subjective and objective speech metrics and measures of performance.
  • Solid understanding of digital signal processing fundamentals.
  • Basic understanding of Psychoacoustics, especially human perception of speech.
  • Proven track record of achieving significant results and innovation as demonstrated by first-authored publications and patents.
  • Experience with implementing and evaluating end-to-end prototypical learning systems.
  • Understanding of computer science fundamentals such as data structures and algorithms.
  • Experience working in cross-group and cross-culture teams.

Facebook is proud to be an Equal Opportunity and Affirmative Action employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender, gender identity, gender expression, transgender status, sexual stereotypes, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law. Facebook is committed to providing reasonable accommodations for candidates with disabilities in our recruiting process. If you need any assistance or accommodations due to a disability, please let us know at accommodations-ext@fb.com.