DataBricks (on AWS) Sr. Developer -North Quincy, MA

DataBricks (on AWS) Sr. Developer with strong experience in Apache Spark, Python / Pyspark
Location: North Quincy, MA (Candidate has to work from the client office 5 days/week)

Job Description: Candidates should have at least 5 yrs of experience on Databricks on AWS.

 

• 8-10 years of experience in IT industry and 5+ years of experience in data engineering tools and technologies using AWS & Databricks.
• Designing and implementing highly performant data ingestion pipelines from multiple sources using Apache Spark and Databricks on AWS
• Integrating the end-to-end Databricks pipeline to take data from source systems to target data repositories ensuring the quality and consistency of data is always maintained
• Strong knowledge of Data Management principles
• Good Experience in SQL or any native SQL like query languages.
• Experience in building ETL / data warehouse transformation processes
• Direct experience of building data pipelines using Apache Spark (Databricks on AWS).
• Good to have experience in writing code in python / Pyspark.
• Good to have experience in Power BI/Tableau.
• Working with other members of the project team to support delivery of additional project components.
• Evaluating the performance and applicability of multiple tools against customer requirements.
• Working within an Agile delivery / DevOps methodology to deliver proof of concept and production implementation in iterative sprints.
• Able to Work Independently
• Good oral and written communication skill

--
You received this message because you are subscribed to the Google Groups "c2cactiverequirements2023Bharath3" group.
To unsubscribe from this group and stop receiving emails from it, send an email to c2cactiverequirements2023bharath3+unsubscribe@googlegroups.com.
To view this discussion on the web, visit https://groups.google.com/d/msgid/c2cactiverequirements2023bharath3/CAG1E41WBy171Nr4TYetiDc-NgL129HzGgG%3Dia_4LCa%2Bi6bppGA%40mail.gmail.com.