Big Data Engineer – Lightning job by Cutshort ⚡ at Remote only Full Time

Lightning job by Cutshort ⚡

As part of this feature, you can expect status updates about your application and replies within 72 hours (once the screening questions are answered)

About the company:

Vithamas offers end to end design services in the areas of embedded firmware, custom PCB design and mobile applications for clients seeking to create reliable, innovative products while keeping the process cost-effective giving utmost importance to quality and trust.

About the role:

We are seeking Mid and Senior Big Data Engineers, who will join the SCRUM team. In this role, you will be responsible for designing, implementing, and maintaining complex data pipelines, ensuring efficient data processing, and building scalable infrastructure.

Requirements:

● Experience in data engineering, ETL design and implementation

● Solid experience with batch processing

● Experience in data analysis, profiling, integration and reporting

● Good knowledge about SQL and Scala

● Experience with Apache Spark, Kafka, Flink and HDFS

● Being a great team player

Responsibilities:

● Designing and developing ETL solutions to process big amount of medical data

● Ensuring high quality by creating comprehensive and automated tests

● Continuously improving our data platform and reducing technical debt

● Supporting the introduction of new tools and migration to Azure cloud