Description We are looking for a passionate, hard-working, and talented Software Development Engineer who can build innovative & mission critical system software applications & tools to measure Search Relevance. You will have an enormous opportunity to make a large impact on the design, architecture, and development of Amazon Search Measurement which paves the path for the Search business. Amazon Search Science builds the core machine learning algorithms used by 100’s of millions of customers worldwide to discover products to buy amongst billions of available items at Amazon.com Relevance Measurement team builds systems and metrics powered by search and browse attributed user behavioural datasets that are used by search algorithms. This team has singular mission to improve relevance and search quality for Amazon customers. We will analyse peta bytes of data to enable Amazon Search to measure customer success metrics and identify ways to improve search. We run the Search Defects process to provide training data for defect classifiers, to help matching and ranking experimenters build and evaluate experiments for defect improvements, and to measure customers’ overall defect experience with Amazon Search. As a Software Development Engineer, you will create and maintain large-scale systems that will help us better understand customer behaviour, highlight pain points, and help identify opportunities to improve search for Amazon customers. The main focus will be to design, develop, and implement an array of full stack applications, UX, data pipelines, analytics and debuggability tools that will provide valuable insights into customer feedback and behaviour. The systems you develop will be instrumental in helping the Amazon Search team find and resolve issues and shape our product strategy. You will be interfacing and building infrastructure for machine learning based inference to measure relevance at scale using LLMs. You will be given significant authority and ownership, but also be supported with strong mentors. You will have the opportunity to work on software development using cutting edge big data technologies, while taking products and features from conception to production. You will work closely with a stellar team of engineers, applied scientists, business intelligence engineers, and product managers to ensure Amazon’s data is a powerful and innovative business advantage. A day in the life * Oncall for maintenance of Airflow DAGs and EMR jobs which builds Data Cubes for Search metrics and Model Training data * Build UX for Analytics portal for 100+ customers * Build Services and Library for Sampling, Snapshotting, Labelling and Scoring Search * Build Services for LLM inference, distillation, Fine tuning and Prompt Caching * Solve for Policy Engine Risks and Software Risks * Generate offender clusters and insights for Search debuggability * Build tools for debugging Search layerwise * Build ML applications for time series analysis and hypothesis testing for A/B testing Search algorithms Basic Qualifications - 3+ years of non-internship professional software development experience - 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience - Experience programming with at least one software programming language Preferred Qualifications - 3+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience - Bachelor's degree in computer science or equivalent - Strong, object-oriented design and coding skills (C/C++ and/or Java preferably on a UNIX or Linux platform) - - Knowledge of Python or other scripting languages a plus - - Experience with distributed (multi-tiered) systems, algorithms, and relational databases - - Experience in ML and/or statistics background is preferable - - Experience in map-reduce, EMR or Spark highly preferred - - Ability to effectively articulate technical challenges and solutions - - Deal well with ambiguous/undefined problems; ability to think abstractly - - Previous technical internship(s) preferred - - Competitive Coding experience preferred