Role: Sr. Databricks Architect & Lake house (Day 1 Onsite)
Location: O'Fallon,MO
Job Description :
Minimum 10+ years of IT experience and minimum 2+ years of hands-on experience in Databricks with validated knowledge in designing database models to store structured & unstructured data efficiently and in creating effective data tools for analytics experts along with following:
• Familiarity with Lakehouse Architecture with Delta Tables – Delta tables, Schema Evolution, ACID compatibility, History capture etc.
• Integrating Databricks with various ETL/Orchestration tools and performing required operations.
• Expertise in Spark ecosystems, Data frame API, Data set API, RDD APIs & Spark SQL.
• Expertise in workspace and cluster configuration, performance tuning and log monitoring.
• Experience with structured streaming along with streaming frameworks.
• Hands-on experience with Python, Scala and SQL.
• Create and maintain optimal data pipeline architecture with knowledge in best practices from Databricks around Cluster setup/Development/Deployment
• Strong understanding of Data Modelling and defining conceptual logical and physical data models.
• Experience in building Data Engineering solutions using Azure native stack
• Experience in managing various client relationships to get consensus on solutions.
• Nice to have AI/ML skill and any architect level certification from Databricks.
Best Regards, | ||
|
You received this message because you are subscribed to the Google Groups "c2cactiverequirements2023Bharath3" group.
To unsubscribe from this group and stop receiving emails from it, send an email to c2cactiverequirements2023bharath3+unsubscribe@googlegroups.com.
To view this discussion on the web, visit https://groups.google.com/d/msgid/c2cactiverequirements2023bharath3/CAPOpW%2BuTibXuLZDHqMfNtZGezr58GEuUNshdyAdVz0MX-%2Buu%3Dw%40mail.gmail.com.
No comments:
Post a Comment