Data Engineer at Gurugram Full Time

ob Description: 

We are seeking an experienced Azure Data Engineer with expertise in Azure Data Factory, Azure Databricks, and Azure Data Fabric to lead the migration of our existing data pipeline and processing infrastructure. The ideal candidate will have a strong background in Azure cloud data services, big data analytics, and data engineering, with specific experience in Azure Data Fabric. We are looking for someone who has at least 6 months of hands-on experience with Azure Data Fabric or has successfully completed at least one migration to Azure Data Fabric.

Key Responsibilities:

• Assess the current data architecture using Azure Data Factory and Databricks and develop a detailed migration plan to Azure Data Fabric.
• Design and implement end-to-end data pipelines within Azure Data Fabric, including data ingestion, transformation, storage, and analytics.
• Optimize data workflows to leverage Azure Data Fabric’s unified platform for data integration, big data processing, and real-time analytics.
• Ensure seamless integration of data from SharePoint and other sources into Azure Data Fabric, maintaining data quality and integrity.
• Collaborate with business analysts and business stakeholders to align data strategies and optimize the data environment for machine learning and AI workloads.
• Implement security best practices, including data governance, access control, and monitoring within Azure Data Fabric.
• Conduct performance tuning and optimization for data storage and processing within Azure Data Fabric to ensure high availability and cost efficiency.

Key Requirements:

• Proven experience (5+ years) in Azure data engineering with a strong focus on Azure Data Factory and Azure Databricks.
• At least 6 months of hands-on experience with Azure Data Fabric or completion of one migration to Azure Data Fabric.
• Hands-on experience in designing, building, and managing data pipelines, data lakes, and data warehouses on Azure.
• Expertise in Spark, SQL, and data transformation techniques within Azure environments.
• Strong understanding of data governance, security, and compliance in cloud environments.
• Experience with migrating data architectures and optimizing workflows on cloud platforms.
• Ability to work collaboratively with cross-functional teams and communicate technical concepts effectively to non-technical stakeholders.
• Azure certifications (e.g., Azure Data Engineer Associate, Azure Solutions Architect Expert) are a plus.

Key requirements:

• The person should have at least 6 months of work experience in Data Fabric.  Make sure the experience is not less than 6 months 
• Solid technical skills: data bricks, data fabric and data factory
• Polished, good communication and interpersonal skills
• The Person should have at least 6 years of experience in Databricks, Datafactory.