Azure Data Engineer

Responsiblties:

• Design, develop, and deploy data solutions using Microsoft Azure cloud platform.
• Develop and maintain automated data ingestion, transformation, and validation processes to ensure data accuracy and consistency.
• Data Ingestion: Ingesting data from various sources, such as on-premises systems, cloud-based systems, and third-party services into.
• Data Transformation: Transforming data into the appropriate format, schema, and structure to meet business requirements.
• Data Loading: Loading transformed data into Azure Synapse SQL Warehouse/ Azure Data Lake Storage.
• Error Handling and Monitoring: Implementing error handling and monitoring processes to ensure data integration solutions operate smoothly and provide reliable data.
• Performance Optimization: Optimizing data integration processes for performance and cost, by tuning queries, caching data, and managing resources.
•  Collaborating with other teams, such as, architects, developers, and business analysts, to ensure data solutions meet their requirements.

Key Skills:

• Programming and Scripting Languages. 
• Cloud Platform Skills. 
• Data Integration and ETL Tools. 
• Data Pipeline Development. 
• Data Quality and Testing. 
• Data Security and Compliance. 
• Database Administration Skills. 
• Collaboration and Communication Skills.