Data Engineer

Job description:

• Design, develop, and test data pipelines and solutions using AWS and Azure cloud services, such as S3, Lambda, Glue, Kinesis, Redshift, Databricks, Synapse, Data Factory, etc.
• Optimize data pipelines and solutions for performance, scalability, reliability, and cost-efficiency.
• Implement data quality checks, data governance, and data security best practices.
• Mentor and coach junior data engineers.

Qualifications:

• Bachelors degree in computer science, engineering, or related field.
• At least 6 to 9 years of experience as a data engineer or similar role.
• Proficient in SQL and Python/Scala/Java.
• Hands-on experience with AWS and Azure cloud services for data engineering.
• Hands-on experience with data processing frameworks and tools, such as Kafka, Spark, Hadoop, etc.

Key Skills:

• Machine learning.
• Data pipelines.
• Data warehouse.
• NoSQL.
• Programming.
• Cloud computing.
• Python.
• SQL.
• Data visualization.