Tech Lead – Data Engineering (AWS Focus) at Gurugram Full Time

Summary:

We are seeking a highly skilled Data Engineer with extensive experience in designing, building, and maintaining complex data pipelines and architectures on the AWS platform. The ideal candidate will have a strong understanding of data warehousing, ETL/ELT processes, and big data technologies.

Responsibilities:

• Design, develop, and implement scalable data pipelines using AWS services (Glue, EMR, DMS, S3, Redshift, etc.).
• Architect and maintain data lakes and data warehouses to support business intelligence and analytics.
• Optimize data processing and storage for efficiency and cost-effectiveness.
• Implement data quality checks and monitoring to ensure data integrity.
• Collaborate with cross-functional teams (data scientists, analysts, software engineers) to understand data requirements and deliver solutions.
• Stay updated with emerging technologies and industry best practices in data engineering.

Qualifications:

• 7+ years of experience in data engineering or a related field.
• Strong understanding of data warehousing concepts and dimensional modeling.
• Hands-on experience with AWS services (Glue, EMR, Athena, DMS, S3, Redshift, EC2, Lambda, etc.).
• Proficiency in SQL and Python.
• Experience with big data technologies (Spark/PySpark, Kafka, etc.).
• Familiarity with CI/CD pipelines and DevOps practices.
• Excellent problem-solving and analytical skills.
• Ability to work independently and collaboratively within a team.

Good to Have:

• Experience with Snowflake, EMR, DataBricks, or other cloud data warehouses.
• Knowledge of data visualization tools (Tableau, Superset, Power BI, etc.).
• Experience in the healthcare or insurance industry