Big Data Engineer

Requirements:

• Bachelor’s degree typically in Computer Science, Management Information Systems, Mathematics, Business Analytics or another STEM degree.
• 5+ years proven ability of professional data development experience
• 3+ years proven ability of developing with Hadoop/HDFS
• 3+ years developing experience with either Java or Python
• 3+ years experience with PySpark/Spark
• Full understanding of ETL concepts
• Exposure to VCS (Git, SVN)
• Strong understanding of Agile Principles (Scrum)

Preferred Skills – Experience in the following

• Exposure to NoSQL (Mongo, Cassandra, PostreSQL)
• Exposure to Service Oriented Architecture
• Exposure to public cloud platforms, preferably Google and/or Microsoft Azure
• Proficient with relational data modeling
• Continuous Integration/Continuous Delivery

Responsibilities

• Participate in design of and develop Cloud and Hadoop based solutions
• Perform unit and integration testing
• Collaborate with architecture and lead and senior engineers to ensure consistent development practices
• Provide mentoring to junior engineers
• Participate in retrospective reviews
• Participate in the estimation process for new work and releases
• Collaborate with other engineers to solve and bring new perspectives to complex problems
• Drive improvements in people, practices, and procedures
• Embrace new technologies and an ever-changing environment