Job Title: Lead Data Engineer (52815-CIJBST-IOM-ARI)

Location: San Ramon, CA

Duration: Long Term

Emp.Type: W2 / 1099

 

Job Responsibility:

This position will serve as a engineer for a industrial big data platform. This individual deals with the very complex and interrelated applications and systems being designed for today's big data platforms. Working closely with an internal team of highly skilled technical resources as well as vendor engineering relationships, the selected individual will participate in big data platform projects from inception up and through the daily maintenance phase of a project.

 

 

Essential Responsibilities: 

 

• Design and implement big data solutions across the Enterprise.

 

 

 

As an engineer within the Industrial Big Data Services group, the selected individual will:

 

• Create and support data processing solutions in a distributed processing environment (Hadoop)
• Participate in API-based integrations and back-end based build-outs of data architecture and pipeline
• Provide engineering support to other teams as needed
• Build fault tolerant, self-healing, adaptive and highly accurate data computational pipelines. Tune queries running over billion of rows of data running in a distributed query engine
• Experience with object oriented programming in Java/C++/C# and Python
• Strong analytical ability and debugging skills
• Experience developing software against 3rd party APIs / RESTful web services and working with vendors to identify and correct issues and drive enhancements
• Experience managing a GNU/Linux environment for development, including package management
• Architect, Design and maintain high performing ELT/ETL Processes.
• Participate in an Agile SDLC to deliver new cloud platform services and components
• Prior experience with ERP systems.

 

Required Skill:

 

• Bachelor's Degree in Computer Science, Information Technology or equivalent (STEM) with minimum 5 years of experience as data engineer.
• (Must have) Minimum of 2 years of experience with Greenplum, Talend, and working with ERP systems.
• A minimum of 2 year of experience using Hadoop ecosystem, Map-Reduce, Spark, NoSQL (HBase, MongoDB etc.), Cassandra is required
• A minimum of 2 year of experience using Scripting (Pig, Python, Perl, etc) is required
• A minimum of 2 years of experience with Core Java, Java WebServices development SOAP, REST APIs
• A minimum of 1 year of experience working on Database(s), SQL is required

 

 

Desired Characteristics:

 

• Advanced degrees preferred.
• Primary role in recent positions must be as a Lead Data/Big Data Engineer
• Ability to leverage data assets to respond to complex questions that require timely answers
• Must have superior communication skills - both oral and written
• Must be able to function productively in an ambiguous environment

 

 

 

To Apply, Please click here: APPLY NOW