Microsoft’s bold vision of Azure Machine Learning (ML) is to democratize ML and make it available to every enterprise, developer and data scientist. Do you want to join a team that builds the platform to run all internal and external ML workloads? We are already serving billions of requests per day on the most cutting-edge scenarios and models across the industry You will be joining the Inference team that builds the model-serving platform for large models including the OpenAI generative models. We host models at the scale of Bing and Office and solve exciting problems on the intersection of AI and Cloud We are looking for a strong Software Engineer who is passionate about designing and building highly reliable, available platform to support model inferencing at scale. You will also be expected to work on high throughput/low latency scenarios and drive performance optimization capabilities. **Responsibilities** **Responsibilities** We’re looking for a Software Engineer who is passionate about building services that bring state-of-the-art OpenAI models to customers. + Implement and deliver Azure Inferencing services meeting Azure Standards and the enterprise promise. + Participate in the lifecycle of service delivery and service monitoring, find new and innovative ways to detect defects and improve livesite quality. + Build development tools to simplify processes and empower every engineer on the team. + Enable customers to leverage various machine learning scenarios to drive tangible business impact. **Other:** Embody our Culture and Value **Qualifications** Required and Preferred: + B Tech or M Tech in computer science, engineering, mathematics or a related field, or equivalent industry experience. + 1+ years of software development experience. + Work experience of running a real time service with high throughput and low latency requirements is a plus **\#AIPLATFORM# #IDC** Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter. Microsoft is an equal opportunity employer. Consistent with applicable law, all qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations (https://careers.microsoft.com/v2/global/en/accessibility.html) .