As a Senior Data Engineer, you will play a leading role in designing, building, and optimizing our data infrastructure, ensuring that it supports the advanced analytics need of the bank. You will oversee a team of data engineers, working closely with data analysts, DevOps team, infrastructure engineers, and other stakeholders to deliver high-quality data solution.

Responsibilities

• Lead the design, development and implementation of data pipelines, transformations and aggregations to support analytics and machine learning initiatives

• Optimize Spark jobs for performance and scalability, ensuring efficient data processing and indexing in Elasticsearch

• Design and deploy data engineering solutions on OpenShift using containerization and orchestration techniques

• Implement and maintain CI/CD pipelines for data engineering workflows, ensuring platform stability and efficient resource utilization

• Stay abreast of emerging technologies and best practices in data engineering and DevOps

• Collaborate with cross-functional teams to define data requirements and translate them into robust and scalable solutions

• Mentor and guide junior team members, fostering a culture of continuous learning and innovation

Requirements

• Bachelor's degree in Computer Science, Data Engineering, Information Technology, or a related field

• 7+ years of experience as a Data Engineer with expertise in Hadoop, Spark, and related technologies (HDFS, Hive, Ranger)

• Strong proficiency in Spark, Python, Scala, or Java for data engineering tasks

• Experience with containerization (Docker, Kubernetes) and orchestration platforms like OpenShift

• Knowledge of DevOps practices, CI/CD pipelines, and automation tools (Jenkins, Ansible, BitBucket)

• Strong problem-solving, troubleshooting, and communication skills

• Ability to work effectively in a fast-paced, collaborative environment

Nice to have

• Experience with monitoring and logging tools (Grafana, Prometheus, Splunk) is a plus

• Experience with cloud platforms (AWS, Azure, GCP) is a plus

We offer

• By choosing EPAM, you're getting a job at one of the most loved workplaces according to Newsweek 2021 & 2022&2023

• Employee ideas are the main driver of our business. We have a very supportive environment where your voice matters

• You will be challenged while working side-by-side with the best talent globally. We work with top-notch technologies, constantly seeking new industry trends and best practices

• We offer a transparent career path and an individual roadmap to engineer your future & accelerate your journey

• At EPAM, you can find vast opportunities for self-development: online courses and libraries, mentoring programs, partial grants of certification, and experience exchange with colleagues around the world. You will learn, contribute, and grow with us