Key Responsibilities:
Design, build and maintain scalable ETL/ELT pipelines using Azure Data Factory, Azure Databricks and Spark.
Develop and optimize data workflows using SQL and Python/Scala for large-scale processing.
Implement performance tuning and optimization strategies for pipelines and Spark jobs.
Support feature engineering and model deployment workflows with data engineering teams.
Ensure data quality, validation, error-handling and monitoring are in place. Work with Delta Lake, Parquet and Big Data storage (ADLS / Blob).
Required Skills:
Azure Data Platform: Data Factory, Databricks, ADLS / Blob Storage.
Strong SQL and Python or Scala.
Big Data technologies: Spark, Delta Lake, Parquet. ETL/ELT pipeline design and data transformation expertise.
Data pipeline optimization, performance tuning and CI/CD for data workloads.
Nice-to-Have Familiarity with data governance, security and compliance in hybrid environments.
Recruiter Name JMI Position Name JMI Recruitment 2022 TGT Government Jobs In New Delhi B.Ed Total Vacancies 1 Start Date...
Apply For This JobRecruiter Name Railway Recruitment Cell Position Name RRC Recruitment 2022 – Apply Online For 2422 Trade Apprentice Post Total Vacancies...
Apply For This JobRecruiter Name ICFRE Position Name ICFRE Recruitment 2022 Junior Project Fellow Government Jobs In Hyderabad Total Vacancies 1 Start Date...
Apply For This JobJob Description: Job Description The Person will be responsible for: 1. Handling customer queries and ensuring best customer service. 2....
Apply For This JobCustomer Styling: Assist customers in selecting outfits that align with their personal style, body type, and needs Offer suggestions...
Apply For This JobRecruiter Name High Court Of Madhya Pradesh Position Name MP High Court Recruitment 2022 – Apply Online For District Judge...
Apply For This Job
“`
Search qualified candidates by skills, location, experience, education, and more.
“`