Research Scientist - Neural Rendering

Employer

Job Description

For AR/VR communication to be a success, it has to continue the tradition of phone and video calling: you’re hearing and seeing what the other person sounds and looks like. Our goal is to create a truly photographic experience for communication. For this, we are exploring ways to render a digital representation of a user that is high fidelity and highly realistic. And to do this Facebook is exploring completely new ways of thinking about rendering. In this position, we want to research and explore using machine learning neural rendering techniques to work in conjunction with the latest technology in rendering to produce a digital representation of a user that is as immediate and accurate as a video of a user. The ideal candidate will have a strong understanding of computer graphics and machine learning techniques with an emphasis on image-to-image translation.

  • Develop new ways of rendering the head, hair and body of a user in a highly photographic manner
  • Research techniques for combining image-to-image translation and deferred neural rendering with highly accurate traditional rendering techniques
  • Build prototypes and demos of real-time image-to-image enhanced digital humans
  • Research disentangling the components of an image: lighting, pose, expression and identity
  • Research techniques to quickly create 3D real-time representations of the user as they are in the moment
  • 5+ years of work experience working with game engines in the games or movie industry
  • Experience working with shading pipelines
  • Solid understanding of the rendering and shading stack of game engines
  • Solid understanding of multi-process and GPU architectures
  • A broad understanding of machine learning techniques
  • A broad understanding of challenges in rendering, in particular for AR/VR applications
  • Communication and organizational skills
  • Demonstrated experience working with minimal supervision to complete tasks
  • Exhibiting listening and communication skills, experience receiving direction and criticism
  • Demonstrated experience working collaboratively within a team environment
  • Experience picking up new techniques and experience learning new software quickly and easily
  • Experience working with and expanding the usability of new research software
  • Experience with some high level shading languages (RSL, OSL, HLSL, AZSL), Python, CUDA C, C++, PyTorch

Facebook's mission is to give people the power to build community and bring the world closer together. Through our family of apps and services, we're building a different kind of company that connects billions of people around the world, gives them ways to share what matters most to them, and helps bring people closer together. Whether we're creating new products or helping a small business expand its reach, people at Facebook are builders at heart. Our global teams are constantly iterating, solving problems, and working together to empower people around the world to build community and connect in meaningful ways. Together, we can help people build stronger communities - we're just getting started.

Facebook is proud to be an Equal Opportunity and Affirmative Action employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender, gender identity, gender expression, transgender status, sexual stereotypes, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law.Facebook is committed to providing reasonable accommodations for candidates with disabilities in our recruiting process. If you need any assistance or accommodations due to a disability, please let us know at accommodations-ext@fb.com.