Copyright OPTnation. All rights reserved.

ETL Developer

Job ID : 38093

Job Title : ETL Developer

Location : Charlotte, NC

Comapny Name : Soro Technologies

Job Type : Full-Time, Part-Time, Contract, Training

Industry : Information Technology

Salary :  $106200 - $107700  per year

Work Authorization : ["OPT","CPT","Entry Level","F1","H4","L1","H1 Visa","TN Permit Holder","Green Card Holder","Canadian Citizen","All EAD","US Citizen"]

No. of Positions : I have ongoing need to fill this role

Posted on : 11-27-2024

Required Skills : ETL tools, Data warehouse, ETL processes.

Benefits : Medical Insurance, Dental Insurance, Vision Insurance, 401K, Life Insurance

Job Description :

 Responsibilities:

  • Design, develop, and implement ETL workflows, data models and pipelines using PySpark to meet business requirements
  • Extract data from multiple sources, transform it for consistency, and load it into data lake/repository.
  • Optimize PySpark scripts for performance, scalability, and efficiency, ensuring minimal resource consumption.
  • Ensure data accuracy and reliability through quality checks, error handling, and validations within ETL pipelines.
  • Monitor, troubleshoot, and enhance ETL pipeline performance.
  • Automate ETL processes and integrate with scheduling tools like Apache Airflow, AWS Eventbridge, or similar.
  • Manage and optimize data storage, compute resources, and security configurations on cloud platforms.
  • Develop and maintain technical documentation for ETL processes, workflows, and data definitions.

Key Skills:

  • ETL tools.
  • Data warehouse.
  • ETL processes.
  • Scripting language.
  • SQL.
  • Data modeling.
  • Data quality.
  • BI.
  • Problem-solving abilities.

Company Details :

Company Information hidden please Login to view details

Login To Apply Now! Register & Apply Now!