Sr Data Engineer

Responsibilities:

• Build and maintain real-time and batch data pipelines across the advanced analytics platform.
• Design, develop and orchestrate highly robust and scalable ETL pipelines.
• Design and implement Dimensional and NoSQL data modelling as per the business requirements.
• Develop highly optimal codebase and perform Spark optimizations for Big Data use cases.
• Design, develop and deploy optimal monitoring and testing strategy for the data products.
• Collaborate with stakeholders and advanced analytics business partners to understand business needs and translate requirements into scalable data engineering solutions.
• Collaborate with data scientists to prepare data for model development and production.
• Collaborate with data visualization and reporting application developers to ensure the sustainability of production applications and reports.
• Collaborate with data architects on the enhancement of Chamberlain’s enterprise data architecture and platforms.
• Provide leadership to third-party contractors.
• Comply with health and safety guidelines and rules.

Key Skills:

• Expertise in ETL technologies and processes.
• Experience in big data tools and databases.
• Experience in cloud computing technologies.
• Working knowledge of computer programming languages.
• Understanding of database security and compliance tools.