Get job as soon as 2 days (HURRY UP) ENROLL NOW or Call   +1 (804)-454-3215
+


Job ID : 13852

Job Title : SPARK Developer

Location : Columbus, IN

Company Name : Smartit Frame

Industry : Information Technology

Salary : $90,000 - $120,000  per year

Job Type : Fulltime

Posted on: 2020-05-26


Required Skills : SPARK, ScalaJava, Map-Reduce, Hive, Hbase, And Kafka Or Equivalent College Coursework SQL Query

Benefits : No benefits are available


Job description :

 

Responsibility :

 

  • Leads projects for design, development and maintenance of a data and analytics platform.
  • Effectively and efficiently process, store and make data available to analysts and other consumers.
  • Works with key business stakeholders, IT experts and subject-matter experts to plan, design and deliver optimal analytics and data science solutions.
  • Works on one or many product teams at a time.

 

Key Responsibilities :

 

  • Designs and automates deployment of our distributed system for ingesting and transforming data from various types of sources (relational, event-based, unstructured).
  • Designs and implements framework to continuously monitor and troubleshoot data quality and data integrity issues.
  • Implements data governance processes and methods for managing metadata, access, retention to data for internal and external users.
  • Designs and provide guidance on building reliable, efficient, scalable and quality data pipelines with monitoring and alert mechanisms that combine a variety of sources using ETLELT tools or scripting languages.
  • Designs and implements physical data models to define the database structure.
  • Optimizing database performance through efficient indexing and table relationships.
  • Participates in optimizing, testing, and troubleshooting of data pipelines.
  • Designs, develops and operates large scale data storage and processing solutions using different distributed and cloud based platforms for storing data (e.g.Data Lakes, Hadoop, Hbase, Cassandra, MongoDB, Accumulo, DynamoDB, others).
  • Uses innovative and modern tools, techniques and architectures to partially or completely automate the most-common, repeatable and tedious data preparation and integration tasks in order to minimize manual and error-prone processes and improve productivity.
  • Assists with renovating the data management infrastructure to drive automation in data integration and management.
  • Ensures the timeliness and success of critical analytics initiatives by using agile development technologies such as DevOps, Scrum, Kanban Coaches and develops less experienced team members.

 

REQUIRED :

 

  • Intermediate experience resulting in the following skills and knowledge Familiarity analyzing complex business systems, industry requirements, andor data regulations Background in processing and managing large data sets Design and development for a Big Data platform using open source and third-party tools SPARK, ScalaJava, Map-Reduce, Hive, Hbase, and Kafka or equivalent college coursework SQL query language Clustered compute cloud-based implementation experience
  • Experience developing applications requiring large file movement for a Cloud-based environment and other data extraction tools and methods from a variety of sources
  • Experience in building analytical solutions

Latest Jobs For You

  • Sr Salesforce Developer

    Krea Technology Inc. Rockville, MD

    Overview: The Senior Salesforce Developer will work with TechnicalSolutions Architects and ...

    View Job
  • Salesforce Lead Developer

    MATRIX Resources Charlotte, NC

    Summary: This candidate will design, propose, evaluate, estimate, and drive solutions with a ...

    View Job
  • senior salesforce developer

    MantraMinds Inc. Jersey City, NJ

    Job Description: BS/BA degree or equivalent experience Strong understanding of the ...

    View Job
  • Salesforce Developer

    AIT Global, Inc. Atlanta, GA

     Job Responsibilities: Responsible for all phases of Software Development which involves ...

    View Job
  • Mobile Application Developer

    General Dynamics Information Technology Washington, DC

    Job Description: The role involves designing and building mobile applications on iOS and/or ...

    View Job

Thanks For Your Feedback

We’re an equal opportunity provider.
All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status.
OPTnation.com is not a Consulting Company/Training Company/H1B Sponsor.

Attach A Resume First