OCI is Oracle’s next-generation cloud platform, built for the most demanding enterprise workloads. We are focused on delivering high-performance computing, storage, networking, and platform services at global scale.

The AI Platform, Services & Solutions organization within OCI is building a robust ecosystem to support the end-to-end lifecycle of AI and machine learning workloads. From GPU infrastructure and training pipelines to model serving and deployment tools—we empower teams across Oracle and our customers to build and deploy AI at scale.

We are looking for a Senior Software Engineer to join our growing team and help shape the future of AI infrastructure and services at Oracle. You will work on critical components of OCI’s AI platform, including high-scale GPU cluster management, self-service ML infrastructure, and model training and serving systems.

Work on critical AI infrastructure that powers Oracle’s GenAI and ML initiatives. Contribute to high-impact projects with visibility across Oracle Cloud. Collaborate with top engineers and researchers in a fast-paced, innovation-driven environment. Grow your career in a supportive, mission-driven team building the future of enterprise AI.

This is a highly technical, hands-on role where you’ll build large-scale distributed systems, optimize AI/ML workflows, and collaborate with cross-functional teams to deliver scalable and reliable solutions.

Responsibilities

Design, implement, and operate scalable services for GPU-based model training, tuning, and inference. Build tools and APIs that enable internal and external users to easily launch, monitor, and manage ML workloads. Collaborate with product, infrastructure, and ML engineering teams to define and deliver key platform features. Optimize performance, reliability, and efficiency of AI infrastructure using best-in-class engineering practices. Contribute to platform automation, observability, CI/CD pipelines, and operational excellence. Troubleshoot complex issues in distributed systems and participate in on-call rotations as needed. Mentor junior engineers and participate in design and code reviews.

Basic Qualifications:

BS degree in Computer Science or related field  4+ years distributed service engineering experience in a software development environment Development experience in a modern programming language, such as Java, Python Hands-on experience designing, developing, and operating public cloud service control or data planes Demonstrable technical leadership and mentorship skills
 

Preferred Qualifications:

5+ years of experience in software development, preferably in cloud services, infrastructure, or AI/ML platforms. Proficiency in one or more programming languages (e.g., Java, Python). Experience with distributed systems, container orchestration (e.g., Kubernetes), and microservices architecture. Understanding of machine learning pipelines, model training/tuning, and GPU workloads. Familiarity with AI frameworks (e.g., PyTorch, TensorFlow) and MLOps tools (e.g., MLflow, Ray, Kubeflow) is a plus. Familiarity with NVIDIA tools like CUDA, NCCL, Run:ai is a plus Strong problem-solving and debugging skills. Bachelor's or Master’s degree in Computer Science, Engineering, or a related field.