Senior Data Engineer

Responsibilities:

• Develop and optimize procedures to productionalize data science models.
• Define and manage SLAs for data products and processes running in production.
• Support large-scale experimentation done by data scientists.
• Prototype new approaches and build solutions at scale.
• Create documentation for learnings and knowledge transfer.
• Create and audit reusable packages or libraries.

Qualifications:

• 9+ years of overall technology experience that includes at least 3+ years of hands-on software development, data engineering, and systems architecture.
• Experience with Azure Data Factory, Azure Databricks and Azure Machine learning tools is a plus.
• Fluent with Azure cloud services. Azure Certification is a plus.
• Experience with integration of multi cloud services with on-premises technologies.
• Experience with data modeling, data warehousing, and building high-volume ETL/ELT pipelines.
• Experience with data profiling and data quality tools like Apache Griffin, Deequ, and Great Expectations.
• Understanding of metadata management, data lineage, and data glossaries is a plus.

Key Skills:

• Communication.
• Teamwork.
• Problem solving.
• Initiative and enterprise.
• Planning and organising.
• Self-management.
• Learning.