Data Engineer

Responsibilities:

• Develop and optimize storage solutions on Microsoft Azure, ensuring data availability, scalability, and reliability.
• Automate data-related jobs, processes, and workflows to streamline data delivery.
• Collaborate closely with cross-functional teams, including data scientists, analysts, and developers, to understand data requirements and support their data-related needs.
• Design and maintain data models and architecture, enabling efficient data consumption by business applications and analytical tools.
• Ensure data quality, integrity, and security throughout the data lifecycle.
• Troubleshoot and promptly resolve data-related issues, performance bottlenecks, and system failures.
• Research new data sources, third-party platforms, and data engineering best practices.
• Stay current with the latest data engineering and cloud computing trends, particularly in the Azure ecosystem.
• Assist Data Scientists with general analysis and dashboards, as needed.

Qualifications:

• 3-5 years of relevant Data Engineering, Software Engineering, and/or Analytics experience.
• Proved experience with Azure cloud solutions, preferably through your work portfolio and Azure certifications.
• Strong proficiency in Azure Data Factory, Azure Storage, and other relevant Azure services.
• Extensive experience designing and implementing automated data pipelines, ETL processes, and data workflows.
• Familiarity with data warehousing concepts, modeling, and integration techniques.
• Expert in integrating cloud solutions with external API sources and knowledgeable in creating in-house API solutions that meet our needs.
• Excellent problem-solving abilities and a track record of handling complex data engineering challenges.
• Strong communication skills and the ability to collaborate effectively with multidisciplinary teams.

Key Skills:

• Database tools. 
• Data transformation tools. 
• Data ingestion tools. 
• Data mining tools. 
• Data warehousing and ETL tools. 
• Real-time processing frameworks. 
• Data buffering tools.
• Machine Learning skills.