IDC Technologies: Big data Lead developer@ Philadelphia, PA

Monday 28 November 2022

Big data Lead developer@ Philadelphia, PA

Hello,

My name is Stephen Fleming and I am a Staffing Specialist at Veda Info Inc. I am reaching out to you on an exciting job opportunity with one of our clients.

Please find the JD below and kindly respond with the below details if interested

Work authorization:

Expected pay-rate (or) employer details:

Job Title: Big data Lead developer

Work Location: Philadelphia, PA

Contract duration: 06 Months + Extendable Possible

Does this position require Visa independent candidates only? No

Job Details:

Must Have Skills

· Big Data Hadoop\Hive\Pig\Sqoop

· Apache Spark

· Phyton

· Scala

Nice to have skills

· Sqoop

· Oozie

Detailed Job Description:

· Strong experience in Big Data and Java/J2EE technologies such as Apache Spark, Hadoop, Hive, Pig, Sqoop, Oozie, HBase, Zookeeper, Python & Scala.

· Experience in Spark Core, Spark SQL, Java MapReduce, Spark on Java Applications implementation

· Experience in real-time data processing using Spark Streaming and Kafka.

· Experience in Apache Spark, Hive and Pig's analytical functions

· Experience in analyzing large amounts of data sets writing Pyspark scripts and Hive queries.

· Experience in performing ETL using Spark, Spark SQL.

· Experience in installing backup, recovery, configuration and development on multiple Hadoop distribution platforms Cloudera and Hortonworks including cloud platforms Amazon AWS and Google Cloud.

· Experience in Agile / Scrum Methodologies

· Strong UNIX/Linux systems administration skills, including configuration, troubleshooting and automation

Minimum years of experience

>10 years

Certifications Needed: No

If this job/position is not suitable to you, please refer a candidate and earn a referral bonus. Vedainfo Referral Program is one of the best in the industry! Contact us for more details.

Thanks & Regards,

Stephen Fleming

Cell: 310-929-1191

Office: 310-929-1616 Extn: 157

E: stephen@us.vedainfo.com

Certified Women Owned Minority Business Enterprise {WMBE}

13355 Noel Road, Suite 1100, Dallas, Texas 75240 | Offices: USA, India, Australia

W: http://www.Vedainfo.com