GCP Data Engineer

Responsibilities:

• Analyze and organize raw data 
• Build data systems and pipelines
• Evaluate business needs and objectives
• Interpret trends and patterns
• Conduct complex data analysis and report on results 
• Prepare data for prescriptive and predictive modeling
• Build algorithms and prototypes
• Combine raw information from different sources
• Explore ways to enhance data quality and reliability
• Identify opportunities for data acquisition
• Develop analytical tools and programs
• Collaborate with data scientists and architects on several projects

Skillset Needed:

• Spark(PySpark preferred)
• Spark Workload Tuning/Optimization
• Python(focus on data engineering)
• Apache Beam(Python preferred)
• Airflow(Cloud Composer preferred)
• BigQuery
• Hive
• Data Modeling/Data Warehouse/Analytics
• Looker, Tableau
• CICD(Cloud Build, Bazel, MonoRepo)
• Jupyter Notebooks(Good to have but not required)