Get your dream job within 2 days (HURRY UP)ENROLL NOW

Big Data Engineer with Kafka , NiFi

Job Id : 7686

Jobtitle : Big Data Engineer With Kafka , NiFi

Location : Saint Louis, MO


Industry : Information Technology

Salary : $84,000 - $121,000  YEAR

Job type : Contractor

Posted on: 2019-11-22

Required Skills : Big Data Engineer, NiFi, Kafka, Python, Shell, Bitbucket

Benefits : No benefits are available

Job Description:

  • Design and develop Hadoop, Kafka and BiFi based big data solutions for Fortune500 CME (Communications Media and Entertainment) industry company
  • Hadoop, NiFi and Kafka deliverables



  • Deep knowledge on the Hadoop Architecture and functioning of various components such as HDFS, Name Node, Data Node, Job Tracker, Task Tracker, Map reduce, Spark.
  • Experience in importing and exporting data using Apche NiFi from HDFS/Hive/HBase to Relational Database Systems and vice - versa. Skilled in Data migration and data generation in Big Data ecosystem.
  • Must have experience with strong UNIX shell scripting, SQOOP, eclipse, HCatalog
  • Must have experience with NoSql Databases like HBASE
  • Must have experience with Developing Pig scripts/Hive QL,UDF for analyzing all semi-structured/unstructured/structured data flows.
  • Hands-on experience with one or more implementations of Hadoop & Apache Spark applications (e.g. administration, configuration management, monitoring, debugging, and performance tuning).
  • Planning and execution of infrastructure projects as well as on-boarding of new application development projects
  • 3+ years of experience with Apache Kafka. Develop Publisher using NiFi,Scala and Python.
  • Good knowledge of Nifi User Interface
  • Good knowledge of DataFlow using NiFi
  • Should be able to Optimize DataFlow
  • Good knowledge of NiFi Expression Language,Groovy script and JOLT Transformations.
  • Should be able to learn and write Custom Processors
  • Understand the concepts of a NiFi Cluster
  • Create Data Pipeline NiFi Cluster
  • Learn how to secure NiFi and effectively Monitor NiFi
  • Learn about building End to End Data Pipeline (Data Ingestion , Data Transformation , Data Regression) using NiFiExperience
  • Familiar with implementing NiFi APIs.
  • Build software across our entire cutting-edge . processing, storage, and serving large-scale web APIs, with awesome cutting-edge technologies operating in real-time with high-availability.
  • DevOps methodologies -Experience with leading Scrum initiatives.
  • Working experience with offshore-onsite model
  • Develop code for data services, test and deploy
  • Experience with DevOps tools like Python/Shell Scripts to integrate the artifacts and assets developed by model developers
  • Experience in optimizing and troubleshooting application performance with tuning of NiFi jobs,Hive and Apache Spark.
  • Good Knowledge on Bitbucket and GitHubs.
  • Able to interact with client projects in cross-functional teams.
  • Good team player interested in sharing knowledge and cross-training other team members and shows interest in learning new technologies and products.
  • Ability to create documents of high quality. Ability to work in a structured environment and follow procedures, processes and policies.
  • Self-starter who works with minimal supervision. Ability to work in a team of diverse skill sets and geographies.
  • DevOPS / Production support Knowledge is a must


Latest jobs for you

  • SailPoint Developer - OPT/H1B/C2C

    Techginia INC Minneapolis, MN

    Job Description: We are looking for a SailPoint Lead/Developer from Information Technology & ...

    View Job
  • Oracle EBS Cloud / Lead - OPT/H1B Secaucus, NJ

    Job Description: Senior Level Technical Lead with hands-on and leadership experience managing ...

    View Job
  • AS/400 Developer - OPT

    K Anand Corporation Houston, Texas

    Job Description: Migrate AS400 servers from IBM Data center to Equinix ...

    View Job
  • Java Developer+ Master Data Services (MDS) OPT/H1B

    Xiartech Mountain View, CA

    Required Qualifications: Java experience (primary skill set) Strong Java experience and ...

    View Job
  • Embedded Developer - OPT/H1B

    Aristasys Peachtree City, GA

    Job Description: Skill Level, Years: 2-4+ Programming Languages: C/C++ OS: Android ...

    View Job

Thanks For Your Feedback

We’re an equal opportunity provider.
All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status. is not a Consulting Company/Training Company/H1B Sponsor.

Attach A Resume First