Get job as soon as 2 days (HURRY UP) ENROLL NOW or Call   +1 (804)-454-3215
+

Healthcare Data Engineer - PySpark/Spark-SQL/AWS


Job Id : 14732

Jobtitle : Healthcare Data Engineer - PySpark/Spark-SQL/AWS

Location : Philadelphia, PA

Company Name : IT Pros

Industry : Information Technology

Salary : $97,000 - $127,000  PER YEAR

Job type : Fulltime

Posted on: 2020-07-01


Required Skills : Python, PySpark, Spark-SQL, AWS EMR, Shell Scripting

Benefits : Medical Insurance,Dental Insurance,Vision Insurance,Life Insurance


    Job Description:

    The Data Engineer will support the engineering team’s data endeavors, diving in to fix issues, optimize processes, and automate what you do more than once.

    Responsibilities:

    • Work with internal stakeholders to load data into the data warehouse
    • Troubleshoot and resolve issues relating to data integrity
    • Help establish procedures and best practices for transforming and storing data
    • Lead requirements gathering around data pipeline automation improvements
    • Work with open-source tools like Spark, Hadoop, Docker, Airflow, Zeppelin
    • Leverage distributed computing and serverless architecture such as AWS EMR & AWS Lambda, to develop pipelines for transforming data
    • Research and implement new technologies with a team of developers to execute strategies and implement solutions
    • Solve complex problems related to the real-time discovery of large data

    Qualifications:

    • Successful Data Engineers will have 5+ years of experience writing scalable applications on distributed architectures.
    • 3+ years of experience with Python
    • 3+ years of experience with PySpark and Spark-SQL (writing, testing, debugging spark routines)
    • 1+ years of experience with AWS EMR, AWS S3 service. Comfortable using AWS CLI and boto3
    • Comfortable using *nix command line (shell scripting, AWK, SED)
    • Experience with MySQL and Postgres
    • Experience with Apache Airflow preferred
    • Experience with Apache Zeppelin preferred
    • Experience with healthcare data preferred

    Benefits / Perks:  

    • Excellent medical, dental and vision coverage, starting on Day 1
    • Performance-based bonus 
    • Equity plan 
    • 401K
    • Life and long-term disability insurance
    • 20 days Paid Time Off 
    • 8 paid holidays
    • Pre-tax commuter savings program
    • Company lunch once a week 
    • On-site gym

    Latest jobs for you

    • AWS Senior Software Engineer

      Bridgewater Associates Westport, CT

      Position Responsibilities The Amazon Web Services Senior Software Engineer will be ...

      View Job
    • Senior Full Stack Developer, AWS

      Technology Partners Saint Louis , Missouri

      Responsibilities & Duties: You will collaborate closely with the team to deliver on ...

      View Job
    • AWS Developer II

      nextgen global resources Dallas, TX

      Roles & Responsibilities Responsible for the design and development of medium to highly ...

      View Job
    • Python Developer

      EdgeLink Portland, OR

      Job Description: This opportunity is with a global not-for-profit that specializes in ...

      View Job
    • Full Stack Python Developer

      ConsultNet, LLC Bluffdale , UT

      Job Description: In the search for a Full Stack Python Developer. It is a prestigious co. ...

      View Job

    Thanks For Your Feedback

    We’re an equal opportunity provider.
    All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status.
    OPTnation.com is not a Consulting Company/Training Company/H1B Sponsor.

    Attach A Resume First