Get job as soon as 2 days (HURRY UP) ENROLL NOW or Call   +1 (804)-454-3215
+


Job Id : 14982

Jobtitle : Big Data Engineer

Location : Chicago, IL

Company Name : Centro

Industry : Information Technology

Salary : $93,000 - $97,000  PER YEAR

Job type : Fulltime

Posted on: 2020-07-24


Required Skills : Spark/Spark Streaming, Hive, Kafka/KSQL, Hadoop

Benefits : Medical Insurance,Dental Insurance,Vision Insurance,Life Insurance


Job Description:

Looking for engineers who are excited about building distributed data pipelines. We want you to help us shape our internal and external brand-new data warehouses, leveraging the latest advances of big data processing: a combination of Kafka Streams, Hadoop, and traditional RDBMS.

Responsibilities & Duties:

  • Be a part of our Big Data team and of an overall Data Organization spanning multiple offices.
  • Participate in architecture discussions and bring your experience in scalable data pipelines using Kafka Streams and/or other Big Data tools.
  • Take ownership of the design and implementation of scalable and fault-tolerant projects.
  • Maintain and incrementally improve existing solutions.
  • Get to build brand new pipelines with the technology stack including Spark, Spark Structured Streaming, Kafka, Hadoop, MySql, Python.

Required Skills & Experience:

  • Solid understanding of distributed system fundamentals.
  • Experience in developing, troubleshooting, diagnosing, and performance tuning of distributed data pipelines at scale.
  • Demonstrated professional experience working with various components of Big Data ecosystem: Spark/Spark Streaming, Hive, Kafka/KSQL, Hadoop (or similar NoSQL ecosystem), et. al, in a production system.
  • Strong software engineering skills with Python.
  • Knowledge of some flavor of SQL (MySQL, Oracle, Hive, Impala), including the fundamentals of data modeling and performance.

Desired Experience:

  • Skills in real-time streaming applications.
  • Knowledge of Scala.
  • A development workflow using Docker containers.
  • The compulsion for automating your day-to-day processes.

Benefits & Perks:

  • Ability to see your direct impact on a high visibility project.
  • An opportunity to both create new projects and help improve the existing big data pipelines.
  • Work in a mature, private, nationally-known company with a CEO approval of 90% on Glassdoor and a positive atmosphere in our San Francisco tech team.
  • 401K plan with employer matching.
  • Commuter pre-tax contributions.
  • Flexible working hours and work-from-home days.
  • Health plan.
  • In-office snacks.
  • Organized team events.

Recommended jobs for you

  • BIG Data Engineer

    QData Sunnyvale, CA

    Job Description: 8 +Professional experience with Big Data

    View Job
  • BIG Data Engineer

    QData Sunnyvale, CA

    Required Skills & Experience: Experience range: 8-14

    View Job
  • Big Data Engineer/Spark

    iTvorks Inc Multiple Locations

    Role:

    View Job
  • Big Data Engineer

    Sun Technologies,Inc. Cincinnati, OH

    Requirements: Bachelor’s degree typically in Computer

    View Job
  • IT –Hadoop Developer /Big Data Engineer

    Elajika Inc Weehawken, NJ

    Title: IT –Hadoop Developer /Big Data

    View Job

Thanks For Your Feedback

We’re an equal opportunity provider.
All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status.
OPTnation.com is not a Consulting Company/Training Company/H1B Sponsor.

Attach A Resume First