Hadoop Developer

Responsiblties:

• Develop in Big Data architecture, Hadoop stack including HDFS cluster, Hive, Spark and Scala.
• Write processes in Ni-Fi, Spark to Ingest data from various sources including sftp, mainframe, RDBMS, Kafka etc.
• Write Spark/Scala code to transform data using business rules provided.
• Participate in the analysis of data stores and help with data analytics.
• Assist and support proof of concepts as Big Data technology evolves.
• Ensure solutions developed adhere to security and data entitlements.

Key Skills:

• Hadoop Fundamental units.
• Data Ingestion tools.
• Writing Code to Solve Problems.
• Machine Learning Tools.
• Job Scheduling Tools.
• Cluster Computing Tools.