Hillsboro, OR, USA
6 days ago
IT - Technology Lead | Big Data - Data Processing | Spark
Job Seekers, Please send resumes to resumes@hireitpeople.com Must Have Skills: Spark Python AWS Detailed Job Description: Advanced Spark Programming Hands - on Engineering Leadership with proven track record of Innovation and expertise in Big Data Engineering Deep understanding and experience developing code in modern data processing technology stacks Mentor less senior engineers in coding best practices and problem solving Skills / Qualifications: Strong experience with data engineering with emphasis on data analytics and reporting Strong experience with SQL and Relational database engineering (Oracle, SQL Server, Teradata)— expert-level SQL abilities Experience developing with Python Experience with Spark, AWS components and services, particularly, EMR, S3, and Lambda Experience with developing in service oriented architectures, leveraging REST API’s Experience working with source-code management tools such as GitHub and Jenkins Good understanding of file formats including JSON, Parquet, Avro, and others Good maturity in assessing and implementing cloud security, networking, cluster scaling requirements Good working knowledge of SQL, NoSQL databases.

Minimum years of experience: 5-8 years

Certifications Needed: No

Top 3 responsibilities you would expect the Subcon to shoulder and execute:

Advanced Spark Programming Advanced Python Skills AWS Skills S3, Athena, lambda or any CloudPlatform Data Engineering ETL and ELT Skills Streaming, Airflow, Nifi Advanced Architecture Design skills Experience with developing in service oriented architectures, leveraging REST APIs

Interview Process (Is face to face required?) No

Does this position require Visa independent candidates only? No

Confirm your E-mail: Send Email