Azure Data Engineer at Bengaluru (Bangalore) Full Time

Key Responsibilities:

Design, build and maintain scalable ETL/ELT pipelines using Azure Data Factory, Azure Databricks and Spark.

Develop and optimize data workflows using SQL and Python/Scala for large-scale processing.

Implement performance tuning and optimization strategies for pipelines and Spark jobs.

Support feature engineering and model deployment workflows with data engineering teams.

Ensure data quality, validation, error-handling and monitoring are in place. Work with Delta Lake, Parquet and Big Data storage (ADLS / Blob).

Required Skills:

Azure Data Platform: Data Factory, Databricks, ADLS / Blob Storage.

Strong SQL and Python or Scala.

Big Data technologies: Spark, Delta Lake, Parquet. ETL/ELT pipeline design and data transformation expertise.

Data pipeline optimization, performance tuning and CI/CD for data workloads.

Nice-to-Have Familiarity with data governance, security and compliance in hybrid environments.