Key Responsibilities:
Design, build and maintain scalable ETL/ELT pipelines using Azure Data Factory, Azure Databricks and Spark.
Develop and optimize data workflows using SQL and Python/Scala for large-scale processing.
Implement performance tuning and optimization strategies for pipelines and Spark jobs.
Support feature engineering and model deployment workflows with data engineering teams.
Ensure data quality, validation, error-handling and monitoring are in place. Work with Delta Lake, Parquet and Big Data storage (ADLS / Blob).
Required Skills:
Azure Data Platform: Data Factory, Databricks, ADLS / Blob Storage.
Strong SQL and Python or Scala.
Big Data technologies: Spark, Delta Lake, Parquet. ETL/ELT pipeline design and data transformation expertise.
Data pipeline optimization, performance tuning and CI/CD for data workloads.
Nice-to-Have Familiarity with data governance, security and compliance in hybrid environments.
Job Description We are hiring an experienced SEO Executive with 1–2 years of hands-on experience in managing on-page and off-page...
Apply For This JobJob Timings 10:30 AM – 5:00 PM | Monday to Saturday Interview Timings 11:00 AM – 4:00 PM | Monday...
Apply For This Job>Website development and maintenance >Daily Upload News >Develope & Design New Website. >1years of experience in Web design. Note: -Please...
Apply For This JobResponsibilities Lead the design, configuration, implementation, and support of the Firm’s Microsoft Azure and Microsoft 365 platforms Develop, define, and...
Apply For This JobPOSITION SUMMARYAmerican Councils is currently seeking a qualified consultant to serve as a Punjabi-speaking Resident Director to work on a...
Apply For This JobRecruiter Name UIDAI Position Name Section Officer Jobs In Gurgaon Apply Online Haryana Govt Job Vacancy 2022 Total Vacancies 1...
Apply For This Job
“`
Search qualified candidates by skills, location, experience, education, and more.
“`