Hadoop Developer

Responsibilities:

•  Work with remote development teams to complete projects on schedule.
• Analyzes source system data to understand the data structure, definitions and anomalies.
• Interacts with customers as needed to better define and understand the general reporting requirements.
•  Interacts with other technical team members to establish ELT requirements and designs.
• Designs, develops and implements ELT processes and procedures.
• Ability to program in SQL to perform the data query, extract, transformation and load functions.
• Ability to program in Java to perform the data query, extract, transformation and load functions.
•  Well versed in data access and manipulation within Hadoop using tools such as Hive, Pig, Spark, Kafka and HBase.
• Responsible for information technology infrastructures and designs include: software, hardware, data warehouse, applications.
•  Develops and trains team members and can take a lead role on various projects simultaneously.
• Conducts researches on newer technologies and solutions. Responsible for conducting and complete proof of concepts on new technology and be able to apply these new findings into our current work environment and information technology infrastructures.

Key Skills:

• Knowledge of the Hadoop ecosystem and its components.
• Ability to write manageable, reliable, and high-performance codes.
• Expert knowledge of Hadoop, Pig, HBase, and Hive.
• Experience in writing MapReduce jobs and Pig Latin scripts.