Data Engineer

Responsibilities:

• Develop and maintain high volume streaming pipelines as well as batch processes.
• Maintain and improve existing framework to support data integration pipelines.
• Conduct design and code reviews with peers, business analyst and QA teams relating to data processes.
• Interface with all areas of TAB to understand and analyze business and functional requirements.
• Maintain the data dictionary as processes and applications change.
• Understand and implement best practices, tuning and optimization for applications and reporting systems.
• Other duties as assigned.

 Requirements:

• Bachelor’s degree in a computer science, information technology or another computer-based discipline.
• 5 years of experience in designing and developing ETL data pipelines.
• Experience with ETL methodologies and practices.
• Experience with large scale streaming pipelines is a plus.
• MSSQL and NoSQL experience preferred.
• Experience utilizing and extending ETL processes in a complex, high-volume data environment.

Key Skills:

• Solid programming skills.
• Statistics knowledge.
• Analytical skills.
• An understanding of big data technologies.
• Python, Java, Scala, and SQL.