Big Data/Hadoop Developer

Responsibilities:

• Loading from disparate data sets.
• Pre-processing using Hive and Pig.
• Designing, building, installing, configuring, and supporting Hadoop.
• Translate complex functional and technical requirements into detailed design. Strong development skills around Hadoop, Hive, Pig Latin, Spark, Scalding, Map Reduce, Storm, Kafka Knowledge of Spark and NoSQL databases
• Strong skills in object-oriented design, Core Java, Scala, shell scripting/Python Excellent problem solving and analytical skills
• Proven background in Distributed Computing, Data Warehousing, ETL development, and large scale data processing.
• Designing, building, installing, configuring, and supporting Hadoop.
• Translate complex functional and technical requirements into detailed design.
• Perform analysis of vast data stores and uncover insights.
• Maintain security and data privacy.
• Create scalable and high-performance web services for data tracking.
• High-speed querying.
• Managing and deploying HBase.
• Test prototypes and oversee handover to operational teams.
• Propose best practices/standards.

Company Information hidden please Login to view details