Get job as soon as 2 days (HURRY UP) ENROLL NOW or Call   +1 (804)-454-3215
+


Job Id : 14876

Jobtitle : Spark Developer

Location : Irvine , CA

Company Name : Perficient

Industry : Information Technology

Salary : $86,000 - $108,680  PER YEAR

Job type : Fulltime

Posted on: 2020-07-14


Required Skills : Spark, Scala, Java, Oozie, Hive

Benefits : No benefits are available


Job Description:

  • A Senior Technical Consultant is expected to be knowledgeable in two or more technologies within (a given SolutionsPractice area).
  • The Senior Technical Consultant is expected to have strong development and programming skills in Spark with a focus on ScalaJava and other ETL development experience in the big data space.
  • You are expected to be experienced and fluent in agile development and agile tools as well as code repositories and agile SLDCDevOps frameworks.
  • You will work with architects and infrastructure teams to develop, test, deploy, and troubleshoot your code as well as provide input into solutions and design of the system.
  • You will collaborate with some of the best talents in the industry to create and implement innovative high-quality solutions focused on our clients' business needs.

Responsibilities:

  • Work with the data engineering team to define and develop data ingestion, validation, transformation, and data engineering code.
  • Develop open-source platform components using Spark, Scala, Java, Oozie, Hive, and other components
  • Document code artifacts and participate in developing user documentation and run books
  • Troubleshoot deployment to various environments and provide test support.
  • Participate in design sessions, demos and prototype sessions, testing and training workshops with business users and other IT associates

Qualifications:

  • At least 3 years of experience in developing large scale data processing data storage data distribution systems
  • At least 3 years of experience on working with large Hadoop projects using Spark and Scala and working with Spark DataFrame, Dataset APIs with SparkSQL as well as RDDs and Scala function literals and closures.
  • Hands-on experience with Hadoop, Hive, Sqoop, Oozie, HDFS Experience with ELT ETL development, patterns and tooling, experience with ETL tools (Informatica, Talend) preferred.
  • Experience with AWS and cloud environments including S3 object storage, EC2, RDS and Redshift
  • Experience with SQL including Postgres, MySQL RDBMS platforms
  • Experience with Linux (RHEL or Centos preferred) environments
  • Experience with various IDE and code repositories as well as unit testing frameworks.
  • Experience with code build tools such as Maven.
  • Fundamental knowledge of distributed data processing systems and storage mechanisms.
  • Ability to produce high-quality work products under pressure and within deadlines with specific references
  • Strong communication and collaborative skills
  • At least 5 years of working with the large multi-vendor environment with multiple teams and people as a part of the project
  • At least 5 years of working with a complex Big Data environment
  • 5 years of experience with JIRAGitHubGit and other code management toolsets

Preferred Skills and Education:

  • Bachelor's degree in Computer Science or related field
  • Certification in Spark, AWS or another cloud platform

 

Latest jobs for you

  • AWS Senior Software Engineer

    Bridgewater Associates Westport, CT

    Position Responsibilities The Amazon Web Services Senior Software Engineer will be ...

    View Job
  • Senior Full Stack Developer, AWS

    Technology Partners Saint Louis , Missouri

    Responsibilities & Duties: You will collaborate closely with the team to deliver on ...

    View Job
  • AWS Developer II

    nextgen global resources Dallas, TX

    Roles & Responsibilities Responsible for the design and development of medium to highly ...

    View Job
  • Python Developer

    EdgeLink Portland, OR

    Job Description: This opportunity is with a global not-for-profit that specializes in ...

    View Job
  • Full Stack Python Developer

    ConsultNet, LLC Bluffdale , UT

    Job Description: In the search for a Full Stack Python Developer. It is a prestigious co. ...

    View Job

Thanks For Your Feedback

We’re an equal opportunity provider.
All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status.
OPTnation.com is not a Consulting Company/Training Company/H1B Sponsor.

Attach A Resume First