Azure Data Engineer

Responsibilities:

• Engage business partners to deeply understand the business requirements for all data transformations.
• Develop pipelines in Synapse that ingest data from a growing number of data sources.
• Implement data quality checks and validation processes to ensure the accuracy, consistency, and integrity.
• Identify, design, and integrate process improvements: automate manual processes, timely data delivery, and re-designing for future use cases.
• Monitor pipeline operations, tasks, resource utilization, and failures.
• Support HA, DR, Backup, and retention policies on all data platforms
• Ensure compliance with IT General Controls, provide needed information in support of audits and to substantiate process and controls compliance.
• Produce documentation for data models, transformations, business rules, and lessons learned that allows other staff members to understand the ingestion process and maintain and troubleshoot it.

Key Skills:

• Cloud Platform Skills. 
• Data Integration and ETL Tools. 
• Data Pipeline Development. 
• Data Quality and Testing.
• Data Security and Compliance.
• Database Administration Skills. 
• Collaboration and Communication Skills.