Log In
Sign Up
Government Jobs / Public Sector
Azure Data Engineer at Bengaluru (Bangalore) Full Time
Key Responsibilities:
Design, build and maintain scalable ETL/ELT pipelines using Azure Data Factory, Azure Databricks and Spark.
Develop and optimize data workflows using SQL and Python/Scala for large-scale processing.
Implement performance tuning and optimization strategies for pipelines and Spark jobs.
Support feature engineering and model deployment workflows with data engineering teams.
Ensure data quality, validation, error-handling and monitoring are in place. Work with Delta Lake, Parquet and Big Data storage (ADLS / Blob).
Required Skills:
Azure Data Platform: Data Factory, Databricks, ADLS / Blob Storage.
Strong SQL and Python or Scala.
Big Data technologies: Spark, Delta Lake, Parquet. ETL/ELT pipeline design and data transformation expertise.
Data pipeline optimization, performance tuning and CI/CD for data workloads.
Nice-to-Have Familiarity with data governance, security and compliance in hybrid environments.