Get job as soon as 2 days (HURRY UP) ENROLL NOW or Call   +1 (804)-454-3215
+


Job Id : 13852

Jobtitle : SPARK Developer

Location : Columbus, IN

Company Name : Smartit Frame

Industry : Information Technology

Salary : $90,000 - $120,000  PER YEAR

Job type : Fulltime

Posted on: 2020-05-26


Required Skills : SPARK, ScalaJava, Map-Reduce, Hive, Hbase, And Kafka Or Equivalent College Coursework SQL Query

Benefits : No benefits are available


Job description :

 

Responsibility :

 

  • Leads projects for design, development and maintenance of a data and analytics platform.
  • Effectively and efficiently process, store and make data available to analysts and other consumers.
  • Works with key business stakeholders, IT experts and subject-matter experts to plan, design and deliver optimal analytics and data science solutions.
  • Works on one or many product teams at a time.

 

Key Responsibilities :

 

  • Designs and automates deployment of our distributed system for ingesting and transforming data from various types of sources (relational, event-based, unstructured).
  • Designs and implements framework to continuously monitor and troubleshoot data quality and data integrity issues.
  • Implements data governance processes and methods for managing metadata, access, retention to data for internal and external users.
  • Designs and provide guidance on building reliable, efficient, scalable and quality data pipelines with monitoring and alert mechanisms that combine a variety of sources using ETLELT tools or scripting languages.
  • Designs and implements physical data models to define the database structure.
  • Optimizing database performance through efficient indexing and table relationships.
  • Participates in optimizing, testing, and troubleshooting of data pipelines.
  • Designs, develops and operates large scale data storage and processing solutions using different distributed and cloud based platforms for storing data (e.g.Data Lakes, Hadoop, Hbase, Cassandra, MongoDB, Accumulo, DynamoDB, others).
  • Uses innovative and modern tools, techniques and architectures to partially or completely automate the most-common, repeatable and tedious data preparation and integration tasks in order to minimize manual and error-prone processes and improve productivity.
  • Assists with renovating the data management infrastructure to drive automation in data integration and management.
  • Ensures the timeliness and success of critical analytics initiatives by using agile development technologies such as DevOps, Scrum, Kanban Coaches and develops less experienced team members.

 

REQUIRED :

 

  • Intermediate experience resulting in the following skills and knowledge Familiarity analyzing complex business systems, industry requirements, andor data regulations Background in processing and managing large data sets Design and development for a Big Data platform using open source and third-party tools SPARK, ScalaJava, Map-Reduce, Hive, Hbase, and Kafka or equivalent college coursework SQL query language Clustered compute cloud-based implementation experience
  • Experience developing applications requiring large file movement for a Cloud-based environment and other data extraction tools and methods from a variety of sources
  • Experience in building analytical solutions

Latest jobs for you

  • Data Analyst

    LEIDOS Fort Knox, KY

    Job Description: The Data Analyst's position will create actionable, high-impact plans that ...

    View Job
  • Bioinformatics Data Analyst

    Regeneron Pharmaceuticals, Inc. Tarrytown, NY

    Job Description: Seeking a bright and motivated candidate with a strong data science toolkit and ...

    View Job
  • Data Analyst - Environmental, Social, and Governance

    Bloomberg New York, NY

    Job Description: You will leverage your demonstrated technical expertise, knowledge of the ...

    View Job
  • UI Developer

    Vy Systems Atlanta , GA

    Job Description: Strong hands-on experience in Angular 2 Component developments implementation...

    View Job
  • UI Developer

    Softworld, Inc. Columbia , MD

    Role and Responsibilities: Responsible for writing standards-compliant, reusable, testable, ...

    View Job

Thanks For Your Feedback

We’re an equal opportunity provider.
All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status.
OPTnation.com is not a Consulting Company/Training Company/H1B Sponsor.

Attach A Resume First