Big Data developer

Job Description:

• Strong knowledge in Scala , Spark implementation and preferably in Kafka as well
• Strong Scripting / programming experience in Spark,Scala and Java
• Experience in cleansing and preparing large, complex datasets
• Extensive experience in RDBMS, SQL
• Experience with bash shell scripts, Unix commands and utilities
• Distributed processing, parallel processing, real-time processing
• Linking and ingesting data sets, so experience with ETL and data pipelines for SQL-based data warehouses is required
• Using a micro-services-based design and create high quality API's for data accessibility, that ultimately integrate with a broader service-based architecture.