Senior Data Engineer

Responsibilities:

• Process complex data sets, leverage technologies used to process these disparate data sets and understand the correlation as well as patterns that exist between the data sets.
• Work closely with other teams to develop solutions to meet business requirements, perform assessments, POC’s and establish an execution or development plan.
• Forecast technical challenges and develop implementation strategies.
• Identify enabling technologies and develop solutions based on identified technologies as required.
• Prepare and present white papers and proposals.
• Employ lateral thinking to develop innovative solutions to meet business needs.
• Communicate complex technical ideas in a straightforward and compelling way.
• Job Qualifications:
• 8 years of relevant IT experience and 3 years of experience with Java coding
• Bachelor's degree in Engineering, Computer Science, Information Technology, related discipline or significant industry experience
• Excellent coding skills with expertise in Java, REST APIs, SQL, and micro-services
• Experience with Apache Spark/Beam, Google Cloud Dataflow, MySQL, Big Query, Airflow, Kafka, Kubernetes, and Anthos
• Experience with development & operations in cloud native technologies (GCP preferred)
• Broad knowledge of open-source libraries & packages
• Well versed with big data concepts and data engineering principles or techniques
• Excellent communication and organization skills
• Must have a go-getter attitude and a willingness to pick up new technologies and programming languages
• Must be a team player with a creative mindset who's always looking for novel solutions to challenging problems and open to learning as well as sharing knowledge with others.

Key Skills:

• Knowledge of data warehousing and ETL processes.
• Programming languages Java, Python, R, Scala.
• Big data, cloud computing and leadership skills.