Bangalore, IND
15 days ago
Consultant
Job Title: Consultant Job Description Key Responsibilities • Data Migration and Integration: Lead the migration of data from existing host systems into a new Data Lake/ Data Warehouse architecture on Databricks. • Data Consolidation: Consolidate data from multiple sources and ensure that it is integrated into a unified data repository for reporting and analytics. • Development of Databricks Workflows: Build, maintain, and optimize workflows and data pipelines on Databricks, ensuring reliable and timely data delivery. • Data Quality Assurance: Ensure data quality and integrity throughout the migration process and proactively address any data quality issues. Technical Documentation: Create and maintain clear technical documentation for all data engineering tasks, including workflows, pipelines, and any new data models. Required Skills & Experience • 6+ years’ experience in data engineering in cloud-based environments like Databricks and Azure Platform. • Strong experience in designing and building ETL (Extract, Transform, Load) pipelines. • Advanced proficiency in Python PySpark for data manipulation and modeling • Solid understanding of data modeling and data warehouse architecture. • Proficiency with SQL and working with large datasets. • Familiarity with data lake and data warehouse concepts. • Experience with data integration tools and technologies. • Familiarity with business intelligence tools (e.g., Domo, Tableau, Power BI). • Ability to collaborate with cross-functional teams, including data scientists and business stakeholders. • Experience with version control (e.g., Git) and agile development methodologies. Location: IND Pune - Amar Tech Centre S No.30/4A 1 Language Requirements: Time Type: Full time **If you are a California resident, by submitting your information, you acknowledge that you have read and have access to the Job Applicant Privacy Notice for California Residents (https://www.concentrix.com/resource/job-applicant-privacy-notice-for-california-residents/)**
Confirm your E-mail: Send Email