|
Hi, We are looking for Big Data Engineer @ Detroit, MI. If you are interested kindly send your updated resume and rate you are looking for this position. Big Data Engineer Duration: 6 Months CTH (fulltime) What You Will Do - Develop ELT processes from various data repositories and APIs across the enterprise, ensuring data quality and process efficiency
- Develop data processing scripts using Spark
- Develop relational and NoSQL data models to help conform data to meet users' needs using Hive and HBase
- Integrate platform into existing EDW and various operational systems
- Develop administration processes to monitor cluster performance, resource usage, backup and mirroring to ensure a highly available platform
- Address performance and scalability issues in a large-scale data lake environment
- Provide big data platform support and issues resolutions to Data Scientists and fellow engineer
Skills and Experience Needed - 2 years of experience with a Hadoop distribution and ecosystem tools such as Hive, Spark, Nifi and Oozie
- 2 years of experience developing batch and streaming ETL/ELT processes
- 2 years of experience with relational and NoSQL databases, including modeling and writing complex queries
- Proficiency in at least one programming language such as Python or Java
- Excellent communication, analytical, and problem-solving skills
Desired: - Experience with Linux system administration, Linux scripting and basic network skills
- AWS experience
- Education:
- Master's degree in Computer Science, Software Engineering or closely related field
Thanks, Jaya Technical Recruiter Vedainfo Inc Office: 310-929-2578. EXT: 129 Direct: 310-929-2578. |
| | |
No comments:
Post a Comment