Get your dream job within 2 days (HURRY UP)ENROLL NOW
+


Job Id : 5089

Jobtitle : Data Engineer

Location :  San Jose, CA

Company Name : Spar Information Systems

Industry : Information Technology

Salary : $84,000 - $129,000  YEAR

Job type : Fulltime

Posted on: 2019-10-02


Required Skills : SQL, ETL, Scripting, Programming Skills, Python, Java, Scala

Benefits : No benefits are available


Job Description:

Designing, develop & tune data products, applications and integrations on large scale data platforms (Hadoop, Kafka Streaming, Hana, SQL server etc) with an emphasis on performance, reliability and scalability and most of all quality.

  • Analyze the business needs, profile large data sets and build custom data models and applications to drive the Adobe business decision making and customers experience
  • Develop and extend design patterns, processes, standards, frameworks and reusable components for various data engineering functions/areas.
  • Collaborate with key stakeholders including business team, engineering leads, architects, BSA's & program managers.

 

The ideal candidate will have:

  • MS in Computer Science / related technical field with 10+(level 5) years of strong hands-on experience in enterprise data warehousing / big data implementations & complex data solutions and frameworks
  • Strong SQL, ETL, scripting and or programming skills with a preference towards Python, Java, Scala, shell scripting
  • Demonstrated ability to clearly form and communicate ideas to both technical and non-technical audiences.
  • Strong problem-solving skills with an ability to isolate, deconstruct and resolve complex data / engineering challenges
  • Results driven with attention to detail, strong sense of ownership, and a commitment to up-leveling the broader IDS engineering team through mentoring, innovation and thought leadership

 

Desired skils:

  • Familiarity with streaming applications
  • Experience in development methodologies like Agile / Scrum
  • Strong Experience with Hadoop ETL/ Data Ingestion: Sqoop, Flume, HiveSpark, Hbase
  • Strong experience on SQL and PLSQL
  • Nice to have experience in Real Time Data Ingestion using Kafka, Storm, Spark or Complex Event Processing
  • Experience in Hadoop Data Consumption and Other Components: HiveHue HBase, , Spark, Pig, Impala, Presto
  • Experience monitoring, troubleshooting and tuning services and applications and operational expertise such as good troubleshooting skills, understanding of systems capacity, bottlenecks, and basics of memory, CPU, OS, storage, and networks.
  • Experience in Design & Development of API framework using Python/Java is a Plu
  • Experience in developing BI Dash boards and Reports is a plus

Recommended jobs for you

  • IT –Hadoop Developer /Big Data Engineer

    Elajika Inc Weehawken, NJ

    Title: IT –Hadoop Developer /Big Data

    View Job
  • Data Engineer

    Esvee Technologies New York, NY

    Data Engineer (Netezza / Teradata / BigQuery/ GCP) New York City. Job description This role

    View Job
  • Data Engineer

    Aclat Inc Vienna, VA

    Job Description: Build and maintain data pipelines for business users and provide hands on ...

    View Job
  • Big Data Engineer/Architect - W2

    Real Soft, Inc / Diversity Direct Woonsocket, RI

    Job Description: Debugging issues related to Spark performance in a big data environment. ...

    View Job
  • QA ETL/ Data Engineering

    Enormous Enterprise LLC Pleasanton, CA

    Job Description: Strong experience & expertise in creation of Test Automation frameworks...

    View Job

Thanks For Your Feedback

Attach A Resume First