DataBricks Admin
Nigel Frank International Limited
Job description
We are looking for a Databricks Administrator responsible for managing users, groups, and data access across Databricks environments. This role involves overseeing workspace and cluster setup, ensuring optimal performance for various workloads. You will collaborate with teams to apply best practices, troubleshoot issues, as well as manage CI/CD workflows.
Responsibilities:
* Cluster Management: Create and manage clusters for DE/ML/SQL personas, establish policies, and manage entitlements.
* Workflow Management: Ensure job and cluster policies are in place and accessible to the right groups.
* Budget & Resource Optimization: Assign budget tags, monitor usage, and optimize resource allocation.
* Performance Monitoring & Troubleshooting: Track platform performance, investigate job failures, and set alerts for issues.
* CI/CD & Workload Management: Manage CI/CD processes, optimize workflows, and ensure infrastructure follows best practices.
* User & Group Management: Create, modify, and delete users/groups; manage roles, permissions, and workspace resources.
* Data Access & Management: Create and manage Metastore, link to workspaces, and handle ownership transfers. Manage Unity Catalog privileges on catalogs, schemas, tables, and views. Requirements
* Experience with Databricks administration - managing users, groups, roles, and permissions across workspaces and clusters.
* Proficient in workspace setup, cluster management, and workload optimization.
* Expertise in data access management, including metastore and catalog privileges.
* Strong skills in platform performance monitoring and troubleshooting.
* Experience with CI/CD pipelines and workflow management
* Strong interpersonal skills both in Polish and English language selected.Apply
DataBricks Admin
a0MaA000000UyQ9.1_1734341946
Role description:We are looking for a Databricks Administrator responsible for managing users, groups, and data access across Databricks environments. This role involves overseeing workspace and cluster setup, ensuring optimal performance for various workloads. You will collaborate with teams to apply best practices, troubleshoot issues, as well as manage CI/CD workflows.
Responsibilities:
* Cluster Management: Create and manage clusters for DE/ML/SQL personas, establish policies, and manage entitlements.
* Workflow Management: Ensure job and cluster policies are in place and accessible to the right groups.
* Budget & Resource Optimization: Assign budget tags, monitor usage, and optimize resource allocation.
* Performance Monitoring & Troubleshooting: Track platform performance, investigate job failures, and set alerts for issues.
* CI/CD & Workload Management: Manage CI/CD processes, optimize workflows, and ensure infrastructure follows best practices.
* User & Group Management: Create, modify, and delete users/groups; manage roles, permissions, and workspace resources.
* Data Access & Management: Create and manage Metastore, link to workspaces, and handle ownership transfers. Manage Unity Catalog privileges on catalogs, schemas, tables, and views. Requirements
* Experience with Databricks administration - managing users, groups, roles, and permissions across workspaces and clusters.
* Proficient in workspace setup, cluster management, and workload optimization.
* Expertise in data access management, including metastore and catalog privileges.
* Strong skills in platform performance monitoring and troubleshooting.
* Experience with CI/CD pipelines and workflow management
* Strong interpersonal skills both in Polish and English language selected.Apply
Confirm your E-mail: Send Email
All Jobs from Nigel Frank International Limited