Hi Partners,
Please send suitable profiles on below requirement.
Job Title: Kafka developer
Location: Harrisburg, CA
Duration: 1 year
Tax terms: C2C, W2
Visa: EADs (H4 EAD, GC EAD, L2 EAD), US Citizen, TN Visa, E3 Visa, No H1b Visa
Job Description:
Confluent Kafka is being used for transferring the "change data" every 15 minutes.
Looking for a "hands on" experienced Kafka developer who can enhance existing code and develop new code as needed.
Deliverables:
- Modify incoming IBM MQ messages using custom SMT.
- Read MQ messages from Kafka cluster using Confluent KStream API from multiple partitions, create new topics as needed and send messages back to Kafka cluster on a new topic.
- Read messages from Confluent Kafka cluster using Spark streaming code running on AWS EMR, store messages as a record in CSV file on AWS S3.
Must have skills:
- Must have Confluent Kafka KStream, schema registry, SMT experience.
- Should be able to develop solution using Spark scala on AWS EMR.
- Ability to understand existing code and make changes as per the direction from solution architect.
Nice to have skills:
- Nice to have pyspark and python pandas experience.
- Experience with Java is an added advantage.
- Must be able to work with team and mentor junior team members.
Prem
Sage IT Inc
3011 Internet Blvd, Suite-110|Frisco, TX – 75034
Desk: 972-996-0650 Ext: 349
E: psiliveri@sageitinc.net |W: www.sageitinc.com
--
No comments:
Post a Comment