Get job as soon as 2 days (HURRY UP) ENROLL NOW or Call   +1 (804)-454-3215

Data Engineer (Hadoop, Spark)

Job Id : 13547

Jobtitle : Data Engineer (Hadoop, Spark)

Location : Plano, Texas

Company Name :  AgreeYa Solutions

Industry : Information Technology

Salary : $40,000 - $150,000  PER YEAR

Job type : Contractor

Posted on: 2020-05-07

Required Skills : Real-time Processing Framework. Apache Spark Is A Distributed Real-time Processing Framework

Benefits : No benefits are available

Job Description :


Responsible for designs, develops, modifies, debugs andor maintains software systems, Serves as an expert on specific modules, applications or technologies, and deals with complex assignments during the software development life cycle.


Responsibility :


  • You will take ownership and accountability of specific modules within an application and provides technical support and guidance during solution design for new requirements, problem resolution for critical complex issues
  • You will Ensures code is maintainable, scalable and supportable.
  • You will present demos of the software products to stakeholders and internalexternal customers, using knowledge of the productsolution and technologies to influence the direction and evolution of the productsolution.
  • You will investigate issues by reviewingdebugging code and providing fixes (analyzes and fixes bugs) and workarounds, will review changes for operability to maintain existing software solutions, will highlight risks and will help mitigate risks from technical aspects.
  • You will bring continuous improvementsefficiencies to the software or business processes by utilizing software engineering tools and various innovative techniques, and reusing existing solutions.
  • By means of automation, reduces design complexity, reduces time to response, and simplifies the clientend-user experience.
  • You will representlead discussions related to productapplicationmodulesteam (for example, leads technical design reviews).


Required :


  • Bachelor's or Masters degree in Science ITComputing Business Analytics or equivalent.
  • 5 years total experience in development mainly around Bigdata, Hive Hadoop, Spark, Scala, PythonPyspark, AWS, and other cloud related technologies.
  • Experienced in Data Engineering with good understanding of Datawarehouse, Data Lake, Data Modelling, Parsing, Data wrangling, Cleansing Transformation, and sanitizing.
  • Agile work experience, build CICD pipelines using Jenkins Hands-on Development experience with Scala, Python using Spark 2.0, Spark Internals and Spark jobs performance improvement Good understanding of Yarn, Spark UI, Spark resource management and Hadoop resource management and efficient Hadoop storage mechanisms.
  • Good understanding experience with Performance tuning in Cloud environment for complex SW projects mainly around large scale and low latency.
  • AWS knowledge is essential with good working experience in AWS Technologies EMR, S3, Cluster management, AWS Airflow automation.
  • Snowflake Knowledge is plus. AWS development certificationSpark certifications is an advantage


Latest jobs for you

  • ETL SQL Developer

    Milan Solution Point Pleasant Beach, NJ

    Duties and Responsibilities 05 to 06 years of experience with Develop, implement and optimize ...

    View Job
  • BI SQL Developer

    Independent Software Inc. Carlisle, PA

    Job Description: As the BI SQL Developer, one will work with the Enterprise Performance ...

    View Job
  • Scala Developer

    Capgemini America, Inc. New York, NY

    Required Skills: Development experience on SCALA Kafka framework. 4 years of experience in ...

    View Job
  • Hadoop Developer with Scala and Spark

    CitiusTech Jacksonville, FL

    Job Description: Required Skills: Expert in Hadoop, Spark, Scala, NiFi, shell scripts,...

    View Job
  • Scala Developer

    Signature Consultants Brooklyn, NY

    Job Description: The focus for this role is to work with the various project teams, help them ...

    View Job

Thanks For Your Feedback

We’re an equal opportunity provider.
All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status. is not a Consulting Company/Training Company/H1B Sponsor.

Attach A Resume First