Get job as soon as 2 days (HURRY UP) ENROLL NOW or Call   +1 (804)-454-3215
+


Job ID : 15871

Job Title : Hadoop Developer

Location : Bellevue, WA

Company Name : E Solutions Inc

Industry : Information Technology

Salary : $59,341 - $108,341  per year

Job Type : Fulltime

Posted on: 2020-11-04


Required Skills : Java, Python, Storm, Spark, MapReduce

Benefits : No benefits are available


Responsibilities:

  • Responsible for Development, implementation maintenance of various Hadoop applications data feeds in the Big Data ecosystem.
  • Responsible for integrating providing development support including code check-in, library updates and management, and deployment control for updated or modified jobs.
  • Troubleshoot any failures and ensure the job completes.
  • Modifying and troubleshooting queries, script, and ETLs for the supported feeds inline with the runbook.
  • Maintain the parser and automated processes.
  • Perform a daily check to verify integrity.
  • Review system and application logs, and verifying completion of scheduled jobs optimize the performance.
  • Manage the ingestion and transformation of data feeds into the production cluster.
  • Coordinate major code-level issues and changes with development and Quality Assurance teams.
  • Monitor Manage Scheduler.
  • Responsible for Shell Scripting programming, Java, EDW platforms with Knowledge around any Data Integration andor EDW tools.
  • Perform daily system monitoring(alarmsKPI's), verifying the integrity and availability of all hardware, server resources, systems and key processes, reviewing system and application logs, and verifying completion of scheduled jobs such as backups.
  • Manage optimize Daily Aggregation jobs.
  • Troubleshoot in case of any issues delays in order to ensure ontime delivery.
  • Any major issues with the Code, Modifications change in Source data type warrants rewriting the code.

Required Skills & Experience:

  • Experience in developing and supporting Java, Python, Storm, Spark, and Map Reduce, Tez applications in a distributed platform Experience in working MPP systems like Hadoop, Impala, Teradata and Oracle and analyzing Hundreds of Terabytes of data.
  • Experience in implementing with real-time data ingestion frameworks with Spark, Kafka, and Flume
  • Should have complete hands-on experience on Cassandra Scala.
  • Experience in building and implementing data pipelines with Hadoop ecosystem tools to capture near real-timebatch processing pipelines.
  • Hands on experience in working with Hortonworks and Cloudera Enterprise Hadoop distributions.
  • Experience in processing and moving large structured andor unstructured and semi-structured data into data lake or out of data Lake.
  • Working experience in Jenkins, CICD pipeline is an added advantage.

 

Recommended Jobs For You

  • Big Data/Hadoop Developer

    Amgenium LLC NJ

    Responsibilities: Loading from disparate data sets.

    View Job
  • Hadoop Developer

    n9 Salisbury, MD

    2 or more years IT experience and 1 year exp in Big Data area Need

    View Job
  • Hadoop developer

    iTvorks Inc New York Mills, NY

    Required Experience: Java/Scala Programming Language

    View Job
  • Hadoop developer

    OrgSpire San Ramon, CA

      Need  Hadoop developer with focus on BI on Hadoop. Should be

    View Job
  • Hadoop Developer

    Logging-in Farmington Hills

    Job Description We are looking for a Big Data Engineer that will work

    View Job

Thanks For Your Feedback

We’re an equal opportunity provider.
All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status.
OPTnation.com is not a Consulting Company/Training Company/H1B Sponsor.

Attach A Resume First