Get job as soon as 2 days (HURRY UP) ENROLL NOW or Call   +1 (804)-454-3215
+

Hadoop Administrator


Job ID : 13491

Job Title : Hadoop Administrator

Location : Columbus, Ohio

Company Name : Huntington

Industry : Information Technology

Salary : $15,000 - $100,000  per year

Job Type : Fulltime

Posted on: 2020-05-05


Required Skills : Linux Environment And Ability To Program In UNIX Or Other High-level Programming Languages Is A Plus,analytical, Written And Oral Communications Skills,Nifi , HBase, Spark, Pig, Storm, Flume

Benefits : No benefits are available


Job Description :

 

  • The administrator will need to have an in-depth knowledge of Hadoop administration, installation, configuration, monitoring and troubleshooting of Hadoop services. 
  • The administrator should have strong understanding of Hadoop eco system such as HDFS, Yarn, MapReduce and data ingestion concepts.
  • Need to have experience setting up and administration of hadoop clusters using ambari admin console.
  • Deep understanding and experience with Horton Works or Cloudera Hadoop stack is required.
  • Need to have substantial expertise and experience with Hive, Hbase, Storm, Flume,Spark and kafka required.
  • Experience with Red Hat Enterprise Linux, spark, java, R & Python Packages is desired.
  • Strong verbal and written communication skills are required.
  • Ability to work in a team environment under limited supervision is needed.

 

Responsibilities :

 

  • Provide administration & support for Hadoop Cluster
  • Perform troubleshooting of Hadoop ecosystem services issues, performance analysis, ensuring security, developing and testing Unix Shell scripts, scripting in Perl, Java and coding required for Hadoop administration and associated core Hadoop ecosystem.
  • Implement LDAP integration & access controls for Hadoop Business groups.
  • Provide user onboarding of Hadoop users & support of day to day tasks
  • Set up configuration and management of security for Hadoop clusters using Kerberos and integration with LDAP/AD at an Enterprise level
  • Setup and manage back-ups for hadoop name node metadata, configuration directories & postgres, mysql DBs for ambari, ranger etc
  • Perform services install, configure settings, ranger policy updates and other administration tasks using Ambari admin tool
  • Implement upgrades, patch updates & fixes as needed
  • Set up and manage data access policy thru ranger
  • Install R & Python Packages as per business needs
  • Set up ingestion jobs into HDFS, Hive using sqoop, Nifi, Storm & kafka for flat file, RDBMS & other data sources
  • Create hive structures by applying proper compression, partitioning & encryption
  • Troubleshoot & solve job failures triggering from mapreduce, sparkR, R & sqoop ingestion jobs
  • Install client connectivity for SAS, Hadoop Environments to Databases and other sources
  • Monitor Hadoop cluster job performances and perform capacity planning

 

Required Qualifications :

 

  • Bachelor's degree
  • 5+ years of experience with Hadoop Administration required of which at least 2 years in Hortonworks Hadoop is mandatory
  • 4 years of experience with development of common ingestion framework, hive structure creation, compression, encryption steps
  • 4 years of experience with unix shell scripting, Perl
  • 3 years of experience with tools like Nifi , HBase, Spark, pig, storm, flume
  • 3 years of experience with Hive which includes creation of schema structures, partitioning & performance tuning
  • 3 years of experience with python, R or spark programming

 

Preferred Qualifications :

 

  • Experience in setting up and configuring hadoop clusters, set up of kerberos, backups and High availability is required
  • Advanced knowledge of the Linux environment and ability to program in UNIX or other high-level programming languages is a plus.
  • Excellent analytical, written and oral communications skills
  • 2 years of experience with Linux Administration

Latest Jobs For You

  • Project Engineer

    Journey Group Sioux Falls, SD

    Essential Duties and Responsibilities: Assist the Project Manager with project procurement, ...

    View Job
  • Software/Database Developer

    CSL SOFTWARE SOLUTIONS Burlington, VT

    Ideal Experience/Skills: Knowledgeable in SQL, preferably Microsoft Transact-SQL Server 2012....

    View Job
  • Entry Level Computer Programmer

    Revature Chattanooga, TN

    Job Requirements: College degree (Associates or Bachelors) Must be authorized to work in the...

    View Job
  • Software Developer - Entry Level

    360 View Nashville, TN

    Job Description: Looking for talented graduates who are hungry to be challenged and grow their...

    View Job
  • Electrical Engineer – Entry and Mid-Level

    Elliott Bay Design Group Entry, WV

    Responsibilities & Duties: Work will primarily be in an office environment (5 days per ...

    View Job

Thanks For Your Feedback

We’re an equal opportunity provider.
All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status.
OPTnation.com is not a Consulting Company/Training Company/H1B Sponsor.

Attach A Resume First