Big Data Engineer
Job ID : 36429
Job Title : Big Data Engineer
Location : San Jose, CA
Comapny Name : Apollose
Job Type : Full-Time, Part-Time, Contract, Training
Industry : Information Technology
Salary : $31000 - $44000 per year
Work Authorization : ["OPT","CPT","Entry Level","F1","H4","L1","H1 Visa","TN Permit Holder","Green Card Holder","Canadian Citizen","All EAD","US Citizen"]
No. of Positions : I have ongoing need to fill this role
Posted on : 03-21-2024
Required Skills : Data Pipelines, Hyper Automation, Programming.
Benefits : Medical Insurance, Dental Insurance, Vision Insurance, 401K, Life Insurance
Job Description :
Responsibilities:
- Design, develop, and implement scalable data pipelines and ETL processes using Java, Python, and Spark.
- Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and design efficient solutions.
- Perform data exploration, data cleaning, and data transformation tasks to prepare data for analysis and modeling.
- Develop and maintain data models and schemas to support data integration and analysis.
- Implement data quality and validation checks to ensure accuracy and consistency of data.
- Utilize REST API development skills to create and integrate data services and endpoints for seamless data access and consumption.
- Monitor and troubleshoot data pipeline performance, identifying and resolving bottlenecks and issues.
- Mentor and guide junior team members, providing technical leadership and sharing best practices.
Qualifications:
- Master's degree in Computer Science, Data Science, or a related field.
- Minimum of 3 years of professional experience in data engineering, working with Java, Python, Spark, and big data technologies.
- Strong programming skills in Java and Python, with expertise in building scalable and maintainable code.
- Proven experience in Spark cluster management, optimization, and performance tuning.
- Solid understanding of data science concepts and experience working with data scientists and analysts.
Key Skills:
- Multi-Cloud computing.
- Visualization.
- Machine Learning and AI.
- NoSQL.
- Data Pipelines.
- Hyper Automation.
- Programming.
- DevOps.
Company Details :
Company Information hidden please Login to view details
Python Developer
Comapny Name :Dart Point
Job Location :Charlotte, NC
Job Description:
Responsibilities: Write reusable and efficient code. Design and implement low latency, data intensive applications. Design and implement JSO
View Job
Software Engineer
Comapny Name :Emblue
Job Location :Claremont, CA
Job Description:
Responsibilities: Designs, develops, implements, and maintains data models to be used by various reporting and data discovery tools. Performance and accuracy are
View Job
Application Developer
Comapny Name :Atechstar
Job Location :College Park, MD
Job Description:
Responsiblties: Design and implement processes and solutions associated with a wide variety of data sets used for data/text mining, and analysis to enable informe
View Job