DA Engineer

This role is an experienced Development Data Engineer that will assist in designing, developing and deploying data-driven solutions as part of a strategic data transformation effort. The candidate will join a team of Data Architects and Engineers who will be responsible for optimizing and transforming our data architecture, infrastructure, operations, and related functions.  This team will work with developers, architects, business / data analysts and data scientists on data initiatives and will ensure optimal data solutions.

Summary of Essential Job Functions

• Leverage modern data management tool sets and coding methods to design, build, implement, and optimize data solutions of all types — including support for OLTP and API/Microservices, data warehouses, data lakes, ODS, streaming data, analytic and BI/visualizations, etc.
• Transform legacy data structures and processes to modern, capable, and secure solutions in a hybrid cloud setup.
• Apply Data Engineering & Design best practices to architecting solutions, using a deep understanding of various data formats and database design approaches.
• Design and Implement Data Services (DaaS) for consumption and various manipulations throughout the Data Ecosystem applying the “contract first” design principle and including use of API, Microservices, Microbatch, ELT Pipeline and other methods.
• Build best-practice driven data ingestion, develop tooling for increasing scale, accuracy and automation in data pipeline, to integrate with decisioning, AI/NLP and consuming systems.
• Ensure data security by designing controls and protection strategies.
• Enable application performance and modernization by creating appropriate data capabilities to match.

Position Requirements

• 3+ years of experience in data engineering, development and operations roles, including experience with transformational efforts.
• Strong Database skills, with RDBMS (E.g., Oracle, SQL) as well as modern relational and unstructured data sources (like NoSQL), including cloud services (AWS/GCP/Azure).  Hands-on experience using tools is strongly preferred.
• Experience with tools (or similar) such as Hadoop Stack, Airflow, Kafka, NiFi, PostgreSQL, Oracle, SQL Server, Elasticsearch (ELK), JSON, Parquet, Avro and other Data Storage formats, Tableau, Superset and other Visualization Tools, Apache Atlas, and other Data-centric Apache Packages.
• Knowledge of Design Patterns for Software and Data Engineering.
• Experience Coding with Java, JavaScript (Nodejs), Python, GO, Rust and similar.
• Experience in on-prem and hybrid cloud infrastructure, including service and cost optimization.