Copyright OPTnation. All rights reserved.

Data Engineer

Job ID : 34883

Job Title : Data Engineer

Location : San Diego, CA

Comapny Name : MSIT

Job Type : Full-Time, Part-Time, Contract, Training

Industry : Information Technology

Salary :  $175000 - $250000  per year

Work Authorization : ["OPT","CPT","Entry Level","F1","H4","L1","H1 Visa","TN Permit Holder","Green Card Holder","Canadian Citizen","All EAD","US Citizen"]

No. of Positions : I have ongoing need to fill this role

Posted on : 09-29-2023

Required Skills : Data Warehousing, Data Architecture, Coding.

Benefits : Medical Insurance, Dental Insurance, Vision Insurance, 401K, Life Insurance

Job Description :

Responsibilities:

  • Partner with COO, Head of Technology, and Engineering Leads for digital assets to evaluate data providers and implement strategic roadmap for the research platform.
  • Analyze real-time and historical digital asset data sources and work to integrate into firm platforms similar to existing asset classes.
  • Gather and process raw data at scale.
  • Build solutions to process unstructured data into a form suitable for analysis and ingest into the platform. This includes a strong emphasis on data quality and resiliency.
  • Work with other members of the team to ensure data is ingested, stored, and managed properly to support our analytical needs.
  • Helping define automation and management of cloud infrastructure and services using native tools, open source tools, and third party products.
  • Implement platform telemetry and reliability systems for performance tuning and troubleshooting, and to trigger automated actions based on events or thresholds.

Qualifications:

  • 4+ years of experience building scalable and reliable data pipelines based on Big Data processing technologies like Hadoop, Cassandra, MapReduce, Spark, etc.
  • 4+ years of combined hands-on experience in Java and Python, with examples of reusable and efficient code to automate analyses and data processes.
  • 2+ years of experience deploying and managing cloud environments for data pipelines and intelligence services for digital assets.
  • Experience processing large amounts of structured and unstructured data from disparate sources with strong emphasis on quality controls and resiliency.
  • Strong knowledge of and experience with statistics; potentially other advanced math as well.
  • Broad understanding of financial services instruments helpful.

Key Skills:

  • Data Warehousing. 
  • Data Architecture. 
  • Coding. 
  • Operating System. 
  • Apache Hadoop-Based Analytics. 
  • Machine Learning.

Company Details :

Company Information hidden please Login to view details

Login To Apply Now! Register & Apply Now!