Senior Python Data Engineer

Job ID : 29263

Job Title : Senior Python Data Engineer

Location : Reston, VA

Comapny Name : Atechstar

Job Type : Full-Time, parttime, contract, training

Industry : Information Technology

Salary : $358900 - $499000 per year

Work Authorization : ["OPT","CPT","F1","H4","L1","Have H1 Visa","TN Permit Holder","Green Card Holder","Canadian Citizen","US Citizen"]

No. of Positions : I have ongoing need to fill this role

Posted on : 07-21-2022

Required Skills : Senior Python Data Engineer

Benefits : Medical Insurance, Dental Insurance, Vision Insurance, 401K, Life Insurance

Job Description :

RESPONSIBILITIES Solve problems at architectural level Manage the complexity inherent in versioned data pipelines Responsible of data pipeline versioning and change management Research and analysis on data inconsistencies Build Python based ETL processes Promote and implement best practices in observability (monitoring, tracking, alerting, logging) and incident response REQUIREMENTS Strong experience with Python, Athena, SQL and AWS managed services Basic knowledge of Elasticsearch Clean code / best coding practices Good data knowledge and data analysis skills Experience in data cleansing, anomaly detection, and preparation Experience in relational querying on top of unstructured storage Expertise in building Python based ETL processes Familiarity with Python based Workflows and SDK Experience with PySpark and/or Redshift would be nice to have Great communication skills Experience with Lambda functions is nice to have