Data Engineer Full Time

DATA ENGINEER:

Experience : 4 to 8 Years

Location: Chennai , Bangalore, Hyderabad

Notice period : Immediate to Maximum 15 DAYS

Design, develop and support data pipelines in a hybrid cloud environment to enable advanced analytics. Design, develop and support CI/CD of data pipelines and micro-services.

Develop new services in GCP/AWS/Azure using server-less and container-based services. Work with Spark clusters and Bigdata ecosystem tools on-prem and in the cloud like Databricks, BigQuery, DataProc.

Minimum Qualifications:

Proficient in Python, PySpark and Spark

Hands-on experience with Azure/AWS/GCP.

Hands-on experience with Data Lake, Data Warehouse and data modelling

Intermediate to advanced SQL skills

Preferred Qualifications:

4+ Years of working experience in relevant technologies.

Besides Minimum Qualification below will be considered added advantages

· Working experience on Python, Airflow, Apache Spark ,PySpark, Apache Beam, Apache Flink, Kubernetes etc.

· Experience with CI/CD and DevOps is added advantage

· Working Knowledge of OpenShift

Familiarity in using AIOPS platforms like mlFlow, AutoML

· Knowledge on Kafka is added advantage

Bachelors in Computer Engineering and/or Computer Science and/or Information Technology.