Hadoop Developer

Job Description:

The Senior Hadoop position will be part of the Insight Core Hadoop platform team within Global Banking and Markets. The Hadoop Developer is responsible for platform design, configuration, and capacity planning and is expected to have depth of knowledge of applicable processes, methodologies, standards, products and frameworks.

Responsibilities

• Responsible for developing, enhancing, modifying and/or maintaining a multi-tenant big data platform
• Use your in-depth knowledge of development tools and languages towards design and development of applications to meet complex business requirements
• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc
• Design and implement scalable data platforms for our customer facing services
• Deploy and scale Hadoop infrastructure
• Hadoop / HDFS maintenance and operations
• Partner with program management, network engineering, site reliability operations, and other related groups
• Work on Proof-of-Concepts to determine feasibility and functional capabilities of new tools and software
• Perform impact analysis, performance tuning, capacity planning for the enterprise data warehouse and its infrastructure as source systems are added and new integration business rules and logic are introduced
• Provide recommendations, technical direction and leadership for Hadoop and NoSQL technologies as part of the overall architecture
• Participate in regular status meetings to track progress, resolve issues, mitigate risks and escalate concerns in a timely manner
• Contribute to the development, review, and maintenance of requirements documents, technical design documents and functional specifications.

Required Skills

• Expertise with Hadoop and its ecosystem Hive, Pig, Spark, HDFS, HBase, Oozie, Sqoop, Flume, Zookeeper, Kerberos, Sentry, Impala etc.
• Experience designing multi-tenant, containerized Hadoop architectures for memory/CPU management/sharing across different lines of business.
• 5+ years managing clustered services, secure distributed systems, production data stores.
• 3+ years of experience administering and operating Hadoop clusters.
• Cloudera CHD4 /CDH5 cluster management and capacity planning experience.
• Ability to rapidly learn new software languages, frameworks and APIs quickly.
• Hands on development experience and high proficiency in Java /Python.
• Skilled in data analysis, profiling, data quality and processing to create visualizations.
• Good SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases (Hive, Impala, Kudu a plus).
• Experience working with Agile Methodology.

About TEKsystems:

We're partners in transformation. We help clients activate ideas and solutions to take advantage of a new world of opportunity. We are a team of 80,000 strong, working with over 6,000 clients, including 80% of the Fortune 500, across North America, Europe and Asia. As an industry leader in Full-Stack Technology Services, Talent Services, and real-world application, we work with progressive leaders to drive change. That's the power of true partnership. TEKsystems is an Allegis Group company.

The company is an equal opportunity employer and will consider all applications without regards to race, sex, age, color, religion, national origin, veteran status, disability, sexual orientation, gender identity, genetic information or any characteristic protected by law.If you would like to request a reasonable accommodation, such as the modification or adjustment of the job application process or interviewing process due to a disability, please call -3411 or email .com for other accommodation options.Job Requirements: