Get your dream job within 2 days (HURRY UP)ENROLL NOW
+

Senior Big Data Developer


Job Id : 7891

Jobtitle : Senior Big Data Developer

Location : Rockville, MD

Company Name : Vensoft Inc

Industry : Information Technology

Salary : $42,098 - $131,068  YEAR

Job type : Fulltime

Posted on: 2019-11-26


Required Skills : AWS EMR, Hadoop, Hive, Apache Spark, Apache HBase, AWS Dynamo DB

Benefits : No benefits are available


Job Description:

The Big Data Developer will work on ingesting, storing, validating and transforming data in a consumable format for business intelligence teams and data analysts to get deeper business insight from the data.

 

Tasks:

  • Understand complex business requirements
  • Design and develop ETL pipeline for collecting, validating and transforming data according to the specification
  • Develop unit tests and performance tests
  • Maintain optimal data pipeline architecture
  • Design ETL jobs for optimal execution in AWS cloud environment
  • Reduce processing time and cost of ETL workloads
  • Participate in peer reviews and design/code review meetings
  • Provide support for production support operations team
  • Implement data quality checks
  • Identify areas where machine learning can be used to identify data anomalies

 

Required Skills :

  • 10 years of experience in programming language Java or Scala
  • 10 years of experience in ETL projects
  • 3 years of experience in big data projects
  • Believes in Scrum/Agile, and has deep experience delivering software when working on teams that use Scrum/Agile methodology
  • Strong and creative analytical and problem-solving skills

 

Required Technical Skills and Knowledge:

  • Strong experience in Java or Scala
  • Strong experience in big data technologies like AWS EMR, Hadoop, Hive, Apache Spark, Apache HBase, AWS Dynamo DB, AWS Lambda
  • Must be able to write complex SQL queries
  • Experience in performance tuning and optimization
  • Familiar with columnar storage formats ORC, Parquet and various compression techniques
  • Experience in writing Unix shell scripts
  • Unit testing using Junit or Scalatest
  • Git/Maven/Gradle
  • Code Reviews
  •  Agile The following skills a plus:
  • AWS Cloud
  • BPM/Activiti
  • Python scripting

Latest jobs for you

  • SAP Functional Quality Analyst - OPT/H1B/GC

    Techorbitinc Dallas, TX

    Job Description : Responsible for defining adequate test coverage including functional, ...

    View Job
  • QA Automation tester - OPT/CPT/GC/W2/1099

    3A SOFT INC Albany, NY

    Skills required: At least 80 months as the lead tester At least 80 months working with ...

    View Job
  • Senior Quality Assurance Analyst - H1B/GC

    Forsys Inc Chicago, IL

    Job Description: The primary area of responsibility is of quality acceptance testing and ...

    View Job
  • Production support Analyst-Unix - H1B/GC

    IKCON TECHNOLOGIES INC Nashville, TN

    JOB DESCRIPTION: Management and support of VMWare environments. Windows and Linux (RHEL) ...

    View Job
  • Middleware Engineer - H1B/GC

    kpg99 inc Charlotte, NC

    Required Skills: Configure, implement, and tune solutions to meet business and technical ...

    View Job

Thanks For Your Feedback

We’re an equal opportunity provider.
All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status.
OPTnation.com is not a Consulting Company/Training Company/H1B Sponsor.

Attach A Resume First