Data Engineer

Responsibilities:

• Create and manage the systems and pipelines that enable efficient and reliable flow of data, including ingestion, processing, and storage.
• Design, develop, and manage data systems and pipelines to ensure efficient data flow, including ingestion, processing, and storage.
• Use Rhapsody to integrate data from diverse sources, transform and clean it to maintain accuracy, and load it into data storage systems or warehouses.
• Work closely with data technicians to deploy a public health surveillance system
• Optimize data pipelines, infrastructure, and workflows to enhance performance and scalability.
• Monitor and troubleshoot data pipelines and systems, addressing performance issues, errors, and anomalies.
• Implement security measures to safeguard sensitive information.
• Work closely with data scientists, analysts, and other stakeholders to understand their data requirements and ensure that the data infrastructure supports organizational goals.
• Collaborate with cross-functional teams to design scalable data solutions that align with business needs.
• Manage data storage systems, including relational and NoSQL databases, and data warehouses.
• Stay informed about industry trends, best practices, and emerging technologies in data engineering, applying this knowledge to the organization's data infrastructure.
• Provide technical guidance to internal and external team members.
• Communicate effectively with all organizational levels to gather requirements, provide updates, and present findings.

Key Skills:

• Coding.
• Machine learning.
• Data science.
• Cloud computing.
• Databases.
• Communication.
• Data warehouse.
• NoSQL.