Get job as soon as 2 days (HURRY UP) ENROLL NOW or Call   +1 (804)-454-3215
+

Software Engineer, Data Platform


Job ID : 28963

Location : Florida City, FL

Company Name : Atechstar

Job Type : Full-Time, parttime, contract, training

Industry : Information Technology

Salary : $198900 - $499000  per year

No. of Positions : I have ongoing need to fill this role


Required Skills : orchestration apache big data python github no sql infrastructure.

Benefits : Medical Insurance, Dental Insurance, Vision Insurance, 401K, Life Insurance


Job Description :

JOB DESCRIPTION

Who You have expert experience with

several programming languages (Python, Scala, Go, etc.) building scalable data intensive microservices orchestration tools such as Airflow, Luiji, Azkaban, Cask, etc. streaming data processing frameworks like Kafka, Spark Structured Streaming, or Flink a diverse set of SQL and NoSQL databases like MongoDB, Cassandra, Redshift, Postgres, etc. different storage formats like Parquet, ORC, Avro, Arrow, and JSON data processing frameworks like Spark or Apache Beam AWS services such as EMR, Lambda, S3, Athena, Glue, IAM, RDS, etc. Git and Github CI/CD Pipelines

Also Constantly think of ways to squeeze better performance out of a data platform Communicate with stakeholders to discover requirements for designing and building a solution that will scale to their needs Plan effective data storage, security, sharing, and publishing within the organization Design boilerplate architecture that can abstract underlying technology from end users Design, manage, and test disaster recovery procedures for a variety of data platforms Value code simplicity and performance Obsess over data: everything needs to be accounted for and be thoroughly tested Build great things alone, but the greatest things in collaboration with others

Bonus Points You are deeply familiar with Spark and/or Hive You have expert experience with Airflow You have expert experience with different storage format like Parquet, ORC, Avro, Arrow, and JSON You are familiar with deployment and configuration tools such as Kubernetes, Drone, and Terraform You have expert experience building microservices Youve built an end-to-end production-grade data platform that runs on cloud infrastructure You have experience building a machine learning platform using tools like SparkML, Pytorch, Tensorflow, Scikit-Learn, etc. You have experience building a web frontend using frameworks like React

What As a Software Engineer, Data Platform, you will

Estimate task complexity, report progress, and voice risks to peers and managers Both learn from and teach peers and junior engineers Develop and maintain expertise in big data best practices Build a large-scale batch and real-time data platform that will make engineering pipelines seamless and scalable Help drive best practices in continuous integration and delivery Help drive optimization, testing, and tooling to improve data platform quality Collaborate with other software engineers, machine learning experts, and stakeholders, taking learning and leadership opportunities that will arise every single day

KEY SKILLS orchestration apache big data python github no sql infrastructure

Recommended jobs for you

  • .Net Developer

    MTK Technologies Indianapolis, IN

    Responsibilities : Greeting from Mtk Technologies.......! We're hiring on urgent basis for .Net Developer  on W2. Please let me know if you are actively looking for new position opportunity.

    View Job
  • Machine Learning Engineer

    MTK Technologies Memphis, TN

    Responsibilities : Greeting from Mtk Technologies.......! We're hiring on urgent basis for Machine Learning Engineer  on W2. Please let me know if you are actively looking for new position o

    View Job
  • Full Stack Java Developer

    MTK Technologies Pittsburgh, PA

    Responsibilities : Greeting from Mtk Technologies.......! We're hiring on urgent basis for Full Stack Java Developer on W2. Please let me know if you are actively looking for new position opportu

    View Job
  • Salesforce developers

    MTK Technologies Houston, TX

    Responsibilities : Greeting from Mtk Technologies.......! We're hiring on urgent basis for Salesforce developer on W2. Please let me know if you are actively looking for new position opportunity.

    View Job
  • Lead ServiceNow Developer

    MTK Technologies Atlanta, GA

    Responsibilities : Greeting from Mtk Technologies.......!   We're hiring on urgent basis for Lead ServiceNow Developer on W2. Please let me know if you are actively looking for new position o

    View Job

Thanks For Your Feedback

We’re an equal opportunity provider.
All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status.
OPTnation.com is not a Consulting Company/Training Company/H1B Sponsor.

Attach A Resume First