Azure Data Engineer
Job ID : 38199
Job Title : Azure Data Engineer
Location : Dallas, TX
Comapny Name : Twelve Labs
Job Type : Full-Time, Part-Time, Contract, Training
Industry : Information Technology
Salary : $25000 - $35000 per year
Work Authorization : ["OPT","CPT","Entry Level","F1","H4","L1","H1 Visa","TN Permit Holder","Green Card Holder","Canadian Citizen","All EAD","US Citizen"]
No. of Positions : I have ongoing need to fill this role
Posted on : 12-09-2024
Required Skills : Data warehouse, ETL, Machine learning.
Benefits : Medical Insurance, Dental Insurance, Vision Insurance, 401K, Life Insurance
Job Description :
Qualification:
- Databricks Engineers with 2-3 years of hand-on experience in Pyspark, Cloud Platform and SQL.
- Proven experience in implementing data solutions on the Databricks platform withhands on experience in setting up Databricks cluster, working in Databricks modules,data pipelines for ingestingand transforming data from various sources into Databricks.
- Spark-based ETL workflows and data pipelines for data preparation and transformation within Databricks.
Responsibilities:
- Bachelors or Masters degree with 4-6 years of professional experience.
- Proven experience in implementing data solutions on the Databricks platform.
- Develop, optimize, and maintain Spark-based ETL workflows and data pipelines for data preparation and transformation within Databricks.
- Knowledge of Performance Optimization, Monitoring and Automation would be a plus.
- Understanding of data governance, compliance, and security best practices.
- Strong Proficiency in Pyspark, Databricks Notebooks, SQL, Python, Scala, or Java.
Key Skills:
- Data warehouse.
- ETL.
- Machine learning.
- Data modeling.
- NoSQL.
- Data pipelines.
- Data security and compliance.
- Data storage and management.
- Problem-solving and critical thinking.
Company Details :
Company Information hidden please Login to view details