Get job as soon as 2 days (HURRY UP) ENROLL NOW or Call   +1 (804)-454-3215
+


Job ID : 13951

Job Title : Spark Developer

Location : Wayne MI, Michigan

Company Name :  Reliable Software Resources

Industry : Information Technology

Salary : $90,000 - $120,000  per year

Job Type : Fulltime

Posted on: 2020-06-01


Required Skills : Strong Communication And Collaborative Skills,SQL Including Postgres, MySQL RDBMS Platforms,AWS And Cloud Environments Including S3 Object Storage, EC2, RDS And Redshift

Benefits : No benefits are available


Job Description :

 

Responsibilities :

 

  • Work with data engineering team to define and develop data ingestion, validation, transformation and data engineering code.
  • Develop open source platform components using Spark, Scala, Java, Oozie, Hive and other components Document code artifacts and participate in developing user documentation and run books Troubleshoot deployment to various environments and provide test support.
  • Participate in design sessions, demos and prototype sessions, testing and training workshops with business users and other IT associates

 

Qualifications :

 

  • At least 3 years of experience in developing large scale data processingdata storagedata distribution systems
  • At least 3 years of experience on working with large Hadoop projects using Spark and Scala and working with Spark Data Frame, Dataset APIs with SparkSQL as well as RDDs and Scala function literals and closures.
  • Hands-on experience with Hadoop, Hive, Sqoop, Oozie, HDFS Experience with ELTETL development, patterns and tooling, experience with ETL tools (Informatica, Talend) preferred.
  • Experience with AWS and cloud environments including S3 object storage, EC2, RDS and Redshift
  • Experience with SQL including Postgres, MySQL RDBMS platforms
  • Experience with Linux (RHEL or Centos preferred) environments
  • Experience with various IDE and code repositories as well as unit testing frameworks.
  • Experience with code build tools such as Maven.
  • Fundamental knowledge of distributed data processing systems and storage mechanisms.
  • Ability to produce high quality work products under pressure and within deadlines with specific references
  • Strong communication and collaborative skills
  • At least 5 years of working with large multi-vendor environment with multiple teams and people as a part of the project
  • At least 5 years of working with a complex Big Data environment 5 years of experience with JIRAGitHubGit and other code management tool sets.
  • Certification in Spark, AWS or other cloud platform

 

Educational Qualifications :

 

  • Bachelor's degree, with a technical major, such as engineering or computer science.
  • TravelAbility to travel up to 50 percent, preferred. 

Latest Jobs For You

  • Project Engineer

    Journey Group Sioux Falls, SD

    Essential Duties and Responsibilities: Assist the Project Manager with project procurement, ...

    View Job
  • Software/Database Developer

    CSL SOFTWARE SOLUTIONS Burlington, VT

    Ideal Experience/Skills: Knowledgeable in SQL, preferably Microsoft Transact-SQL Server 2012....

    View Job
  • Entry Level Computer Programmer

    Revature Chattanooga, TN

    Job Requirements: College degree (Associates or Bachelors) Must be authorized to work in the...

    View Job
  • Software Developer - Entry Level

    360 View Nashville, TN

    Job Description: Looking for talented graduates who are hungry to be challenged and grow their...

    View Job
  • Electrical Engineer – Entry and Mid-Level

    Elliott Bay Design Group Entry, WV

    Responsibilities & Duties: Work will primarily be in an office environment (5 days per ...

    View Job

Thanks For Your Feedback

We’re an equal opportunity provider.
All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status.
OPTnation.com is not a Consulting Company/Training Company/H1B Sponsor.

Attach A Resume First