Data Engineer
Job ID : 39220
Job Title : Data Engineer
Location : Boston, MA
Comapny Name : Atechstar
Job Type : Full-Time, Part-Time, Contract, Training
Industry : Information Technology
Salary : $500000 - $900000 per year
Work Authorization : ["OPT","CPT","Entry Level","F1","H4","L1","H1 Visa","TN Permit Holder","Green Card Holder","Canadian Citizen","All EAD","US Citizen"]
No. of Positions : I have ongoing need to fill this role
Posted on : 05-30-2025
Required Skills : Hadoop, Kafka
Benefits : Medical Insurance, Dental Insurance, Vision Insurance, 401K, Life Insurance
Job Description :
Key Responsibilities:
- Design, develop, and maintain scalable and robust data pipelines on Databricks.
- Collaborate with data scientists and analysts to understand data requirements and deliver solutions.
- Optimize and troubleshoot existing data pipelines for performance and reliability.
- Ensure data quality and integrity across various data sources.
- Implement data security and compliance best practices.
- Monitor data pipeline performance and conduct necessary maintenance and updates.
- Document data pipeline processes and technical specifications.
Skills:
- Bachelors degree in Computer Science, Engineering, or a related field.
- 3+ years of experience in data engineering.
- Proficiency with Databricks and Spark.
- Strong SQL skills and experience with relational databases.
- Experience with big data technologies (e.g., Hadoop, Kafka).
- Knowledge of data warehousing concepts and ETL processes.
- Excellent problem-solving and analytical skills.
- Experience with multi-cloud environments (e.g., AWS, Azure, GCP) is preferred.
Company Details :
Company Information hidden please Login to view details