Data Engineer

Responsibilities:

• Design, develop, and manage data systems and pipelines to ensure efficient data flow, including ingestion, processing, and storage.
• Use Rhapsody to integrate data from diverse sources, transform and clean it to maintain accuracy, and load it into data storage systems or warehouses.
• Work closely with data technicians to deploy a public health surveillance system
• Optimize data pipelines, infrastructure, and workflows to enhance performance and scalability.
• Monitor and troubleshoot data pipelines and systems, addressing performance issues, errors, and anomalies.
• Implement security measures to safeguard sensitive information.
• Work closely with data scientists, analysts, and other stakeholders to understand their data requirements and ensure that the data infrastructure supports organizational goals.
• Collaborate with cross-functional teams to design scalable data solutions that align with business needs.
• Manage data storage systems, including relational and NoSQL databases, and data warehouses.
• Stay informed about industry trends, best practices, and emerging technologies in data engineering, applying this knowledge to the organization's data infrastructure.

Key Skills:

• Data pipelines.
• Cloud computing.
• Machine learning.
• Coding.
• Data warehouse.
• Big data technologies.
• Databases.
• SQL.
• ETL tools.