Get your dream job within 2 days (HURRY UP)ENROLL NOW
+

Senior Data Architects


Job Id : 7587

Jobtitle : Senior Data Architects

Location : Naperville, IL

Company Name : EGEN SOLUTIONS INC

Industry : Information Technology

Salary : $76,400 - $143,900  YEAR

Job type : Fulltime

Posted on: 2019-11-21


Required Skills : Amazon Redshift, Snowflake, BigQuery, SQL, PL/SQL Queries, Spark, Kafka, Flume, Sqoop, Cassandra, PostgreSQL, Elasticsearch

Benefits : No benefits are available


Job Description:

  • Review the systems requirements for detecting and analyzing patterns in big data
  • Create strategy documents for enterprise data analytics
  • Present the documents for approval and respond to all technical and functional issues raised during stakeholder meetings
  • Advise on additions and changes required in information technology workflows and on components of data repositories, middleware, consumption of existing API's, or introduction of third party API tools
  • Work with Product Owner and Scrum Master within the agile environment and follow Scrum/Kanban approach of delivering user stories using Jira and Confluence
  • This will involve breaking user stories to small technical tasks and updating the status in every standup
  • Advise other developers in the team on the performance efficiency and best practices for ETL data pipelines including SQL query optimizations, data modeling, data governance, and overall architecture
  • Perform code reviews on the pull requests opened by the developers for code quality
  • Work with other teams and platform architects on the architectural approach and then guiding developers to follow the technical plan
  • Create strategy plans for ETL Data Pipelines for moving structured and unstructured data from SQL, Flat Files, and API sources
  • Review implementation for data warehouse systems including Amazon Redshift, Snowflake, BigQuery, and database clusters for analytics purposes
  • Review performance and accuracy of complex SQL and PL/SQL queries to extract data from the relational sources and dump it to the destination warehouses
  • Review and improve Spark, Kafka, and Flume processes for transforming incoming streaming or batched data
  • Design star and snowflake schema data model for Data Marts
  • Design data management processes and develop data governance standards for metadata management, data quality, and data security
  • Design analytical queries and tools using SQL, Sqoop for analytics and data scientists' team to assist them in deploying and validating the results from their data science models
  • Design, develop, customize and implement APIs for data science models to store analytical insights into the database including Cassandra, PostgreSQL, Elasticsearch and make them available for applications to provide actionable insights to the end users
  • Build infrastructure required for ETL pipelines for frameworks including Apache Kafka, Spark, Hadoop, Flume, and integrating data using AWS Lambda, Attunity Replicate, NiFi, SSIS, Informatica, Azure Data Factory, Azure Integration Runtime with AWS/Azure managed data services including Amazon Redshift, AWS S3, Azure SQL Server, PostgreSQL, and Oracle
  • Test SQL scripts on local environments to validate the correctness of these before running on production environments
  • Develop alerting and monitoring hooks using Java, Python, KSQL, PowerShell scripting for various stages in the ETL pipeline and infrastructure and visualize it on the Grafana, Power BI, Qlikview, SSRS dashboards
  • Configure alerts to be sent from Grafana to Slack, MS Teams, and emails
  • Document schema of the sources and data warehouse data model, ETL stages, data quality/validation scripts, monitoring, and alerting mechanisms with Markdown, Confluence, and other wiki tools
  • Work with the following tools and technologies: Amazon Redshift, Snowflake, BigQuery, SQL, PL/SQL queries, Spark, Kafka, Flume, Sqoop, Cassandra, PostgreSQL, Elasticsearch, Hadoop, AWS Lambda, Attunity Replicate, NiFi, SSIS, Informatica, Azure Data Factory, Azure Integration Runtime, AWS S3, Azure SQL Server, PostgreSQL, Oracle, Java, Python, KSQL, PowerShell, Grafana, Power BI, Qlikview, and SSRS
  • Other similar duties as assigned.

Latest jobs for you

  • SailPoint Developer - OPT/H1B/C2C

    Techginia INC Minneapolis, MN

    Job Description: We are looking for a SailPoint Lead/Developer from Information Technology & ...

    View Job
  • Oracle EBS Cloud / Lead - OPT/H1B

    keybusinessglobal.com Secaucus, NJ

    Job Description: Senior Level Technical Lead with hands-on and leadership experience managing ...

    View Job
  • AS/400 Developer - OPT

    K Anand Corporation Houston, Texas

    Job Description: Migrate AS400 servers from IBM Data center to Equinix ...

    View Job
  • Java Developer+ Master Data Services (MDS) OPT/H1B

    Xiartech Mountain View, CA

    Required Qualifications: Java experience (primary skill set) Strong Java experience and ...

    View Job
  • Embedded Developer - OPT/H1B

    Aristasys Peachtree City, GA

    Job Description: Skill Level, Years: 2-4+ Programming Languages: C/C++ OS: Android ...

    View Job

Thanks For Your Feedback

We’re an equal opportunity provider.
All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status.
OPTnation.com is not a Consulting Company/Training Company/H1B Sponsor.

Attach A Resume First