**Summary:** We are aiming to make Llama 4 the leading SoTA model and Meta AI the leading assistant in the world by the end of 2025. None of these goals would be possible without a robust set of evals and a highly reliable and performant platform backing them.On the GenAI Evals Platform team, you will be helping build a state-of-the-art platform that enables:- Intuitive authoring/maintenance of complex evals and judges for multi-modal, agentic and reasoning use cases- Reliable, efficient and automated execution of evals at scale over a fleet of GPUs/CPUs- Seamless eval reporting, analysis and debugging **Required Skills:** Software Engineer, Systems ML - GenAI Evals Platform Responsibilities: 1. Design methods, tools, and infrastructure to push forward the state of the art in evaluating large language models. 2. Collaborate with AI research scientists to accelerate the next generation of Generative AI models by facilitating development of novel evals and judges 3. Optimize GPU / CPU utilization to maximize efficiency and speed of running evals 4. Hold a high bar in engineering quality with a focus on reliability, scalability and user experience 5. Work with a large and globally distributed team. 6. Contribute to publications and open-sourcing efforts. **Minimum Qualifications:** Minimum Qualifications: 7. Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience 8. Programming experience in Python and hands-on experience with frameworks such as PyTorch 9. Experience with architectural patterns of large scale software applications, especially in the ML Systems domain 10. Must obtain work authorization in the country of employment at the time of hire, and maintain ongoing work authorization during employment **Preferred Qualifications:** Preferred Qualifications: 11. A Bachelor's degree in Computer Science, Computer Engineering, relevant technical field and 6+ years of experience in AI framework development OR a Master's degree in Computer Science, Computer Engineering, relevant technical field and 4+ years of experience in AI framework development OR a PhD in Computer Science Computer Engineering, or relevant technical field and 3+ years of experience in AI framework development 12. Direct experience with Generative AI and LLMs 13. Proven track record of execution in a dynamic environment, preferably on AI/ML infra projects 14. Knowledge of GPU, CPU, or AI hardware accelerators 15. Experience in system performance optimizations such as runtime analysis of latency, memory bandwidth, I/O access, compute utilization analysis and associated tooling development **Public Compensation:** $70.67/hour to $208,000/year + bonus + equity + benefits **Industry:** Internet **Equal Opportunity:** Meta is proud to be an Equal Employment Opportunity and Affirmative Action employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender, gender identity, gender expression, transgender status, sexual stereotypes, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law. Meta participates in the E-Verify program in certain locations, as required by law. Please note that Meta may leverage artificial intelligence and machine learning technologies in connection with applications for employment. Meta is committed to providing reasonable accommodations for candidates with disabilities in our recruiting process. If you need any assistance or accommodations due to a disability, please let us know at accommodations-ext@fb.com.