Job ID : 28878
Location : Washington, DC
Company Name : Atechstar
Job Type : Full-Time, parttime, contract, training
Industry : Information Technology
Salary : $358900 - $499000 per year
No. of Positions : I have ongoing need to fill this role
Required Skills : Data Lake Data Pipeline Py Spark Kafka Data Warehousing Data Modeling ETL Python SQL.
Benefits : Medical Insurance, Dental Insurance, Vision Insurance, 401K, Life Insurance
Job description Skills Required :
- Proficient in languages : Python.
- Experience in AWS Stack - Glue, Athena, Quick sight, RDS, Redshift, Kafka, pySpark.
- Experience setting up data pipelines, archiving data, data lakes.
- Bachelors or Master's degree in computer science Maths statistics or related field.
- Expertise with designing complex Data Models and Data Engineering solutions.
- Write complex SQL for processing raw data, data transformations as well as data validations.
- Experience with infrastructure as code using shell scripting.
- Hands on experience in working with big data on AWS environments including cleaning transformingcatalogingmapping etc.
- Experience in setup of data warehouse using Amazon Redshift, creating Redshift clusters and perform data analysis queries.
- Experience in ETL and data modeling on AWS ecosystem components - AWS Glue, Redshift, DynamoDB.
- Familiarity with AWS data migration tools such as AWS DMS and AWS Data Pipeline.
- Certifications on AWS will be an added plus.
Roles and Responsibilities :
- Tests, monitors, manages and validates data warehouse activity including data extraction. transformation, movement, loading, cleansing, and updating processes.
- Building and maintaining optimised and highly available data pipelines that facilitate deeper analysis and reporting.
- Collaborate with stakeholders to understand, define and document business applications, data sourcesrelationships, and needs (metrics, dimensions, charts and dashboards).
- Analyse and Identify new data sources as needed per stakeholder requirements.
- Working closely with the analytics team and other business stakeholders to create data processing frameworks that help the business make sense of growing data .
- Manage and monitor existing data pipelines and work with other team members to ensure best practices for ETL and data warehousing.
- Work on optimisation of data storage and processing infrastructure to reduce costs.
- Assist in the design and documentation of data infrastructure and technologies.
Education UG :B.Sc in Maths, Computers, Statistics, B.A in Statistics, Maths, B.Tech/B.E. in Computers, BCA in Computers PG :M.A in Maths, Statistics, M.Tech in Computers, MCA in Computers, MCM in Computers and Management, MS/M.Sc(Science) in Maths, Computers, Statistics Doctorate :Doctorate Not Required
Key Skills AWS Data Lake Data Pipeline Py Spark Kafka Data Warehousing Data Modeling ETL Python SQL
Twelve Labs Ohio City, OH
Responsibilities : Responsibilities: Create and maintain optimal data pipeline architecture, assemble large, complex data sets that meet functional / non-functional business require
Soro Technologies Los Angeles, CA
Responsibilities : Responsibilities: In collaboration with the Head of Market Data, manage exchange entitlement reporting. Responsible for owning the invoice reconciliati
wipros Manchester, MI
Responsibilities : Responsiblties: Translate research data and findings into actionable strategic insights using strong storytelling, data visualization, and presentation skills
MSIT Texas City, TX
Responsibilities : Responsibilities: An expert in building digital solutions and comfortable with all layers of the application stack. Eager to learn new technology and b
Apollose Philadelphia, PA
Responsibilities : Responsibilities: Work with team to design, develop, test, and maintain software applications written in Angular and Java. Work with team to integrate
We’re an equal opportunity provider.
All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status.
OPTnation.com is not a Consulting Company/Training Company/H1B Sponsor.
