Data Engineer
Job ID : 34883
Job Title : Data Engineer
Location : San Diego, CA
Comapny Name : MSIT
Job Type : Full-Time, Part-Time, Contract, Training
Industry : Information Technology
Salary : $175000 - $250000 per year
Work Authorization : ["OPT","CPT","Entry Level","F1","H4","L1","H1 Visa","TN Permit Holder","Green Card Holder","Canadian Citizen","All EAD","US Citizen"]
No. of Positions : I have ongoing need to fill this role
Posted on : 09-29-2023
Required Skills : Data Warehousing, Data Architecture, Coding.
Benefits : Medical Insurance, Dental Insurance, Vision Insurance, 401K, Life Insurance
Job Description :
Responsibilities:
- Partner with COO, Head of Technology, and Engineering Leads for digital assets to evaluate data providers and implement strategic roadmap for the research platform.
- Analyze real-time and historical digital asset data sources and work to integrate into firm platforms similar to existing asset classes.
- Gather and process raw data at scale.
- Build solutions to process unstructured data into a form suitable for analysis and ingest into the platform. This includes a strong emphasis on data quality and resiliency.
- Work with other members of the team to ensure data is ingested, stored, and managed properly to support our analytical needs.
- Helping define automation and management of cloud infrastructure and services using native tools, open source tools, and third party products.
- Implement platform telemetry and reliability systems for performance tuning and troubleshooting, and to trigger automated actions based on events or thresholds.
Qualifications:
- 4+ years of experience building scalable and reliable data pipelines based on Big Data processing technologies like Hadoop, Cassandra, MapReduce, Spark, etc.
- 4+ years of combined hands-on experience in Java and Python, with examples of reusable and efficient code to automate analyses and data processes.
- 2+ years of experience deploying and managing cloud environments for data pipelines and intelligence services for digital assets.
- Experience processing large amounts of structured and unstructured data from disparate sources with strong emphasis on quality controls and resiliency.
- Strong knowledge of and experience with statistics; potentially other advanced math as well.
- Broad understanding of financial services instruments helpful.
Key Skills:
- Data Warehousing.
- Data Architecture.
- Coding.
- Operating System.
- Apache Hadoop-Based Analytics.
- Machine Learning.
Company Details :
Company Information hidden please Login to view details
Data Engineer
Comapny Name :wipros
Job Location :San Diego, CA
Job Description:
Responsibilities: Operate through ambiguity using technical background to deliver impactful, secure and incrementally robust solutions. Define and depl
View Job
Data Engineer
Comapny Name :MSIT
Job Location :San Diego, CA
Job Description:
Responsibilities: Develop and operate data management tools, monitoring data flows, data quality, data cleansing and data processing. Create and docume
View Job
Senior Data Engineer
Comapny Name :MSIT
Job Location :San Diego, TX
Job Description:
Responsiblties: Builds and maintains Azure data platform for Sun including enterprise data lake and data warehouse in alignment with Suns strategic objectiv
View Job