Job ID : 34745
Location : Naperville, IL
Company Name : Binary tech Consulting corp
Job Type : Contract
Industry : Information Technology
Salary : $60 - $80 per hour
No. of Positions : 2-4
Required Skills : python, aws, scala, spark.
Benefits : Medical Insurance
Job Description:
Skilled in Business Intelligence/Data Warehouse, Data and Technical Architecture, Methodology, Architecture, Data Governance, Data Modeling, ETL Tools, Big Data, Data Lake. Strong expertise applying industry best practice methods and sound enterprise architecture, data architecture/ management, and integration techniques across domains.
What you will be doing:
1. End to End responsibility for data modeling (OLTP, OLAP)
2. Data analysis experience with writing complex queries, unions, joins and aggregations.
3. Data analysis experience using major RDBMS solutions like snowflake, redshift etc.
4. Experience with ELT, ETL processes using glue, glue brew transformations.
5. Use airflow to schedule and time data transfers.
6. Understanding of deep JSON structures and partitioning using Kafka, spark, Scala, s3 etc.
7. Work with Data Scientist team to build segmentations, ML use cases, forecasting etc.
8. Experience working with sage maker, jupyter notebooks for deep data analysis.
9. Work with the BI specialists to design, develop and enhance connectors to get closer to business use cases.
10. Migration of existing custom pipelines to a normalized connector approach
11. Help educate CT teams on data integration, validation standards and drive clean ingestion egestion patterns for the platform.
What you bring:
1. Work with APIs to extract and ingest data.
2. Work with virtual warehouses and configure them for optimal performance and efficiency.
3. Conduct ETL data integration, cleansing transformations using glue spark script.
4. Work on aggregations of data coming from applications and apis to store results in a historic table.
5. Experience with streaming data analytics and building of streaming pipelines and connectors.
6. Experience with connections to BI solutions like tableau which include configurations of roles, policies within aws
7. Leverage Lambda, glue and step functions to cleanse and transform data.
8. Work with DWH technologies like EC2, s3, redshift, Athena, snowflake to churn large data sets and partition them in readable formats and in real time
Atechstar Austin, TX
Responsibilities : Responsibilities: Select, optimize and integrate data science tools and frameworks required to provide data analytics solutions. Implement complex data
MSIT Los Angeles, CA
Responsibilities : Responsibilities: Work in the medical office buildings with regular physician leadership interaction. Perform analysis for problem solving and new meth
Apollose Boston, MA
Responsibilities : Responsibilities: Provides counsel and advice to top management on significant Engineering matters, often requiring coordination between organizations.
Atechstar Frisco, TX
Responsibilities : Responsibilities: Design, develop and implement large scale distributed systems with large volumes of data focusing on scalability, latency and fault tolerance.
Dart Point College Park, GA
Responsibilities : Responsibilities: An expert in building digital solutions and comfortable with all layers of the application stack. Eager to learn new technology and b
We’re an equal opportunity provider.
All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status.
OPTnation.com is not a Consulting Company/Training Company/H1B Sponsor.
