Data Engineer

Responsibilities:

• Assemble and analyze large, complex sets of data.
• Design and build sustainable and optimal database models to support business requirements.
• Identify, design, and implement internal process improvements including for greater scalability, optimizing data delivery, and automating manual processes.
• Build required infrastructure for optimal extraction, transformation and loading of data from various data sources using Microsoft Azure and SQL technologies.
• Build analytical tools to utilize the data pipeline, providing actionable insight into key business performance metrics including operational efficiency and customer acquisition.
• Work with stakeholders including data, design, product, and leadership teams and assist them with data-related technical issues.
• Assist with setting standards, ensuring proper documentation and environment controls.
• Mentor development team members in design and development of complex ETL And BI solutions.
• Contribute to testing, QA, and documentation of data pipelines and systems.
• Support exploratory data analysis, statistical analysis, predictive analytics, and machine learning models.
• Ensure systems meet industry standard practices and business, security, privacy, and data retention requirements.
• Participate in and lead Agile/Scrum meetings.

Key Skills:

• Strong programming skills.
•  Python, Java, Scala, and SQL.
• They should also understand database systems.
• Distributed computing systems, and big data technologies such as Hadoop, Spark, and Kafka.