Research Scientist Intern, On-Device AI Systems (PhD)

Employer

Job Description

Facebook's mission is to give people the power to build community and bring the world closer together. Through our family of apps and services, we're building a different kind of company that connects billions of people around the world, gives them ways to share what matters most to them, and helps bring people closer together. Whether we're creating new products or helping a small business expand its reach, people at Facebook are builders at heart. Our global teams are constantly iterating, solving problems, and working together to empower people around the world to build community and connect in meaningful ways. Together, we can help people build stronger communities - we're just getting started.

Facebook Reality Labs (FRL) focuses on delivering Facebook's vision through Virtual Reality (VR) and Augmented Reality (AR). Enabling compelling user experiences on Virtual and Augmented Reality devices requires innovation and co-design across all layers of stack from novel algorithms to custom silicon. The FRL team is driving the state of the art forward with breakthrough work in computer vision, speech, virtual assistant, machine learning, mixed reality, graphics, displays, sensors, and new ways to map the human body among many others.

We are seeking exceptional interns with a background in Deep Learning acceleration, Computer Architecture, Hardware/Software Co-design of Accelerator systems to join our On-device AI team. This team focuses on designing efficient Deep Learning-based solutions to enable compelling user experiences on mobile AR/VR systems, with particular focus on enabling on-device execution for low latency, power efficiency, and privacy, while achieving high accuracy from deployed deep learning models. The ideal candidate will have practical experience in accelerating deep learning models using custom hardware accelerators. In particular, (1) experiences in accelerating multi-DNN workloads under various constraints such as limited compute resources and execution latency and (2) those in developing programming and optimization constructs for ML accelerator systems are preferred.

In this position, you will get exposure to the full stack from user experiences, algorithms down to hardware execution blocks. You will work with the domain experts in vision and assistant-related aspects of Virtual/Augmented Reality to understand the challenges and accelerate state-of-the-art networks for on-device execution.

Our internships are twelve (12) - sixteen (16) weeks long and we have various start dates throughout the year.

Responsibilities
  • Define, plan and execute cutting-edge deep learning research to advance AR/VR experiences
  • Develop novel hardware and/or software techniques to accelerate deep learning models to meet the constraints of on-device and real-time execution
  • Collaborate with other research scientists and software engineers to develop innovative deep learning techniques for vision, speech, user interface and other use-cases
  • Collaborate with software and hardware engineers to develop tradeoff curves for accuracy vs the runtime resources/constraints such as latency, energy
  • Communicate the experimental results and the recommendations clearly, both within the group as well as to the cross-functional groups
Minimum Qualification
  • Currently has, or is in the process of obtaining, a PhD degree in Computer Science, Electrical Engineering or related field
  • 1+ years experience in accelerating machine learning solutions for problems
  • 1+ years experience with computer architecture concepts
  • Must obtain work authorization in the country of employment at the time of hire and maintain ongoing work authorization during employment
Preferred Qualification
  • Intent to return to degree-program after the completion of the internship/co-op
  • Publication track record in computer architecture and/or machine learning conferences/journals
  • Experience (e.g., ISCA, ASPLOS, MICRO, HPCA, MLSys, ISPASS, ASAP, PACT, etc.) in accelerator architecture design, programming model, and compiler optimizations for accelerators
  • Experience in optimizing deep learning networks for execution constraints besides just the final accuracy
  • Programming experience and experience with deep learning framework
  • Background in computer vision, speech, or natural language understanding
  • Interpersonal experience: cross-group and cross-culture collaboration
Facebook is proud to be an Equal Opportunity and Affirmative Action employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender, gender identity, gender expression, transgender status, sexual stereotypes, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law. Facebook is committed to providing reasonable accommodations for candidates with disabilities in our recruiting process. If you need any assistance or accommodations due to a disability, please let us know at accommodations-ext@fb.com.