Hillsboro, OR, USA
7 days ago
IT - Technology Lead | Big Data - Data Processing | Spark
Job Seekers, Please send resumes to resumes@hireitpeople.com Must Have Skills: Spark Python AWS Required Skills: Strong communication, analytical and problem-solving skills Strong Knowledge/experience in Python, Spark Strong Knowledge and experience in Databricks AWS preferable Strong knowledge in SQL Domain knowledge in Retail Detailed Job Description: Create data ingestion pipelines using spark streaming to consume data from Apache Kafka Write transformational logic and aggregation logic in spark Experience in setting up Airflow jobs for orchestration Communicate and co-ordinate with Business users, Product Owners and Data Architects Technical ownership for Agile squad

Minimum years of experience: 8-10 years

Certifications Needed: No

Top 3 responsibilities you would expect the Subcon to shoulder and execute:

Excellent communication skills with business stake holders and data architects Technically drive an agile squad Design and develop Spark data pipeline

Interview Process (Is face to face required?) No

Does this position require Visa independent candidates only? No

Confirm your E-mail: Send Email