Cape Town, South Africa
26 days ago
DevOps Engineer
Job Description

We require someone to manage our Cloudera environment. Their responsibilities would be to ensure that our Cloudera installation and configuration is at optimal specifications. They’ll be required to fine-tune our Cloudera environment for optimal performance. They’ll also be responsible for managing our Linux Servers.Deploy, configure, Cloudera Dataflow (CDF) platforms with required components like Kafka, Nifi, Schema registry, Nifi Registry etc.Cluster expansion and management, Access Management, performance tuning, capacity planning, security, monitoring and alerting CDF clusters.Collaborate with data engineers to optimize and troubleshoot data flows in CDF especially on Nifi, Kafka.Implement and maintain security policies and access controls for CDF environments using Kerberos , Ranger.Creating alerts and dashboards utilizing different application, infrastructure monitoring tools such as Grafana, Splunk etc.Troubleshoot and resolve issues related to CDFCreating tickets/cases with Cloudera vendor for support and resolution for the issues.Perform routine maintenance tasks, including backups, updates, and patch management for both platforms.Collaborate with cross-functional teams to understand and address business requirements.Provide support to users on CDF tools and best practices.DevOps – Infrastructure orchestration using Manual/Scripts. Identify and implement opportunities for automation. Resolve infrastructure and applications security vulnerabilities.

 

Requirements:

Experience on Cloudera CDF platforms and clusters management.Proven experience as a Cloudera Administrator and Dataflow Administrator.In-depth knowledge of Cloudera Manager, Ranger, Spark, Apache Nifi, Kafka Schema Registry, and other components.Strong Experience with Linux system administration and shell scripting.Good understanding of CDFKnowledge with cloud platforms such as AWS, Azure, GCP is a plus.Excellent problem-solving and communication skills.Understand Microsoft Active DirectoryKnowledge of how to use TLS/SSL to enforce secure encrypted connections.Job Details

Application Closing Date

22/05/24

All appointments will be made in line with FirstRand Group’s Employment Equity plan. The Bank supports the recruitment and advancement of individuals with disabilities. In order for us to fulfill this purpose, candidates can disclose their disability information on a voluntary basis. The Bank will keep this information confidential unless we are required by law to disclose this information to other parties.

Confirm your E-mail: Send Email