Job Description

Facebook's mission is to give people the power to build community and bring the world closer together. Through our family of apps and services, we're building a different kind of company that connects billions of people around the world, gives them ways to share what matters most to them, and helps bring people closer together. Whether we're creating new products or helping a small business expand its reach, people at Facebook are builders at heart. Our global teams are constantly iterating, solving problems, and working together to empower people around the world to build community and connect in meaningful ways. Together, we can help people build stronger communities - we're just getting started.

Facebook Reality Labs Research (FRL-R) brings together a world-class team of researchers, developers, and engineers to create the future of AR and VR, which together will become as ubiquitous and essential as smartphones and personal computers are today. The technology that is being developed within the Surreal team at FRL-R is a new generation of spatial and contextual AI capabilities working across devices, software and infrastructure which we collectively refer to as LiveMaps. The Surreal Index team is seeking an exceptional experienced technology leader, with deep expertise in real-time simulation, high performance 3D graphics, or synthetic data generation. The expectation is to lead a group of engineers and contingent workers to implement both real-time and offline, scalable, simulation of photorealistic and dynamic scenes, physical devices and physical phenomenons, using commercial game engines such as Unreal, Unity3D, or cloud based commercial off the shelf solutions such as NVidia Omniverse, or simulation technology developed in-house.

Responsibilities

• Collaborate with researchers and engineers across machine and human perception teams at Facebook to understand requirements for training, validation and test using synthetic data, then design and build scalable synthetic data generation systems to requirements
• Plan and execute Implementation of real-time, physically based simulation of a living, breathing world populated with people and objects with scriptable, triggerable environmental events and changes, including dynamic simulations of time-of-day, weather and seasons, dynamic simulations of ambient traffic and people, and third person and egocentric AI controllers of human agents
• Hardware in the loop and system in the loop simulation blending real physical components with simulated components in a working system
• Drive down power, latency, and costs by optimizing simulation pipelines
• Establish a deep technical understanding of Livemaps related science and FB infrastructures
• Architect and communicate designs for scalable real-time and offline simulation running on local PCs, on-premises clusters, and cloud
• Set concrete goals and priorities for the team with ranked features as clear expectations for the team to execute on. Formulate coherent roadmaps with timelines that deliver features in a progressive, incremental fashion
• Lead design/technical direction, quality efforts, code reviews with the team and give clear and actionable feedback on a timely basis to ensure project impact, product quality, and engineering efficiency
• Communicate simulated data generation status, roadmaps and feature plans proactively, effectively, and efficiently, both vertically within Surreal and horizontally across different teams not only within Surreal, but also in cross-functional collaborations
• Proactively learn the bigger context, and bring the right level of context back to the simulation team wherever necessary, to increase team member clarity and visibility
• Help recruit new members and onboard new members into the team, by mentoring them and making it easy to ramp up in the team's codebases and infra
  

Minimum Qualification

• Master’s degree in the following fields: Computer Science, Software Engineering, Computer Vision, Robotics, 3D Reconstruction, 3D Graphics, Computer Game Development
• 10+ years software engineering or graphical simulation work experience in commercial environments or game development
• 5+ years experience with real world system building, including design, coding and evaluation/testing (C++/C#/Python)
• 5+ years experience in real-time 3D graphical simulation or rendering, and modern GPU programming (CUDA/OpenGL/OpenCL) or shader programming, and with physics engines such as Havok and PhysX
  

Preferred Qualification

• Experience contributing to (products or open-source) software for games, robotics or AR/VR devices
• Expertise in real-time Animation, animation controllers, behavioral scripting, game AI, engine technology and gameplay programming using popular game engines
• Experience with 3D graphics and rendering, including emerging ML based representations and techniques such as NeRF
• Experience in 3D Computer Vision algorithms (e.g. Object detection, Pose estimation, 3D Reconstruction, Tracking and Deep Learning Frameworks)
• Experience in engineering scalable, distributed systems and cloud services
• Experience working in Linux and Windows environments across PC and mobile hardware
• An interest for rendering, game engines and the technology that allows them to scale in fidelity and size, tools that accelerate content creation, and systems that allow for a rapid iteration
  

Facebook is proud to be an Equal Opportunity and Affirmative Action employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender, gender identity, gender expression, transgender status, sexual stereotypes, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law. Facebook is committed to providing reasonable accommodations for candidates with disabilities in our recruiting process. If you need any assistance or accommodations due to a disability, please let us know at accommodations-ext@fb.com.