Get job as soon as 2 days (HURRY UP) ENROLL NOW or Call   +1 (804)-454-3215
+

Scala Big Data Developer


Job Id : 13915

Jobtitle : Scala Big Data Developer

Location : Sunnyvale, CA

Company Name : Staffing Headquarters

Industry : Information Technology

Salary : $100,000 - $120,000  PER YEAR

Job type : Fulltime

Posted on: 2020-05-29


Required Skills : Support Spark ETL Pipelines Built Using Apache Spark, Kafka, Solr, Java/Python/Scala

Benefits : No benefits are available


Job Description :

 

software engineer with expert level experience in Scala, Spark, Java and ML. You will be part of the team, building one of the largest Big Data Platforms processing Petabytes of data. Your ETL pipelines will deliver value to Business Analytics, Operational Analytics, Text Analytics, Data Services.

Key Responsibilities:

 

  • Support Spark ETL pipelines built using Apache Spark, Kafka, Solr
  • Manage Hadoop clusters with Industry best practices
  • Build CI/CD pipeline for Automated software delivery
  • Troubleshoot issues related to data ingestion, processing and export
  • Performance tuning of Spark Jobs

Job Requirements:

 

Must have:

 

  • 7-8 years Industry experience of large scale big data systems development
  • Programming experience in Java/Python/Scala
  • Experience configuring and managing Hadoop cluster in Production
  • Automation experience with Ansible, Puppet or equivalent
  • Experience setting up MySQL/Postgres for High Availability
  • Development experience in the Linux environment using GIT/Jenkins/JIRA
  • Experience with infrastructure-as-code, templates, and source control
  • Knowledge of network protocols such as TCP/IP, HTTP, SSL/TLS, DNS
  • Knowledge of routing, firewalls, load balancing, and web proxies
  • B.S. in Computer Science or a related technical field

Good to have:

 

  • Experience developing apps at scale on AWS or Azure
  • Understanding of Hadoop stacks from Cloudera, Hortonworks

Latest jobs for you

  • Hadoop Developer

    I Link Solutions Beaverton, OR

    Responsibilities Design and implement distributed data processing pipelines using PySpark, ...

    View Job
  • Backend / PHP Developer

    Red Oak Technologies, Inc. Cupertino, CA

      Qualifications: Bachelor Degree in Computer Science, or related field 3-5 years ...

    View Job
  • Lead PHP Developer

    Ranger Technical Resources Tamarac, FL

    Job Description: Looking for a Senior PHP Developer that will be creating software that is ...

    View Job
  • PHP Developer - Healthcare Tech

    Intelli Hiring Herndon, VA

    Job Description: Looking for a PHP/Laravel Developer to join their technical team and deliver a ...

    View Job
  • PHP Developer

    Ennsee Technologies Franklin , TN

    Job Description: Looking for a PHP Developer responsible for creating a new set of front-end ...

    View Job

Thanks For Your Feedback

We’re an equal opportunity provider.
All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status.
OPTnation.com is not a Consulting Company/Training Company/H1B Sponsor.

Attach A Resume First