GCP IBM Streams Data Engineer-

Share only if the data engineers are wth "GCP IBM Streams Data Engineer".

 

Location : Irving, TX | Basking Ridge, NJ | Temple Terrace, FL | Alpharetta, GA | Piscataway, NJ | Colorado Springs, CO | Ashburn, VA | Lone Tree, CO

 

Skillset:

IBM Streams, Apache Flink, Google Cloud Platform, Linux, Apache Airflow, Google Compute Engine, GitLab, BigQuery, Python, Pyspark, Spark & Kafka

Job Description :

             Must have 5 + years of experience as GCP Data Engineer.

             The Data Engineer will be responsible for developing and supporting database applications to drive automated data collection, storage, visualization and transformation as per business needs.

             Understand the existing IBM streams pipelines

             Able to write the Custom templates in Apache Data flow (Apache Beam)

             Migrate the IBM Stream pipelines to Data Flow

             Able to handle Billions of records / day volume in real-time streaming systems and write the pipelines in Flink / Dataflow over GCP

             Able to perform the Quality check on the data (Data validation)

             Work experience over the CICD like jenkins and construct them over the cloud Database design, Data Modelling and Mining.

             Consolidate data across multiple sources and databases to make it easier to locate and access.

             Implement automated data collection and data storage systems.

             Write complex SQL queries and stored procedures.

             Work with multiple data systems and large relational databases.

 

Thanks,

Jaya

Qualmission 

Head office - Pflugerville, Texas, USA

Advance your career with us!

https://www.linkedin.com/in/jaya-qualmission-083568251/