Design, develop, and maintain data pipelines and ETL processes using Databricks.
Manage and optimize data solutions on cloud platforms such as Azure and AWS.
Implement big data processing workflows using PySpark.
Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver effective solutions.
Ensure data quality and integrity through rigorous testing and validation.
Optimize and tune big data solutions for performance and scalability.
Stay updated with the latest industry trends and technologies in big data and cloud computing.
Requirements:
Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related field.
Proven experience as a Big Data Engineer or similar role.
Strong proficiency in Databricks and cloud platforms (Azure/AWS).
Expertise in PySpark and big data processing.
Experience with data modeling, ETL processes, and data warehousing.
Familiarity with cloud services and infrastructure.
Excellent problem-solving skills and attention to detail.
Strong communication and teamwork abilities.
Preferred Qualifications:
Experience with other big data technologies and frameworks.
Knowledge of machine learning frameworks and libraries.
About Virtusa
Teamwork, quality of life, professional and personal development: values that Virtusa is proud to embody. When you join us, you join a team of 30,000 people globally that cares about your growth — one that seeks to provide you with exciting projects, opportunities and work with state of the art technologies throughout your career with us.
Great minds, great potential: it all comes together at Virtusa. We value collaboration and the team environment of our company, and seek to provide great minds with a dynamic place to nurture new ideas and foster excellence.
Virtusa was founded on principles of equal opportunity for all, and so does not discriminate on the basis of race, religion, color, sex, gender identity, sexual orientation, age, non-disqualifying physical or mental disability, national origin, veteran status or any other basis covered by appropriate law. All employment is decided on the basis of qualifications, merit, and business need.
br{display:none;}.css-58vpdc ul > li{margin-left:0;}.css-58vpdc li{padding:0;}]]> About Rackspace Technology We are the multicloud solutions experts. We combine our expertise with the...
Apply For This JobTaPOIENw0626 KPI management – NPO Engg. Mumbai, Maharashtra, India (https://aluperf.referrals.selectminds.com/jobs/93829/other-jobs-matching/location-only) New 4 additional locations Gurgaon, Haryana, IndiaHyderabad, Telangana, India (https://aluperf.referrals.selectminds.com/jobs/93829/other-jobs-matching/location-only?location_id=2540)...
Apply For This Jobbr{display:none;}.css-58vpdc ul > li{margin-left:0;}.css-58vpdc li{padding:0;}]]> We are looking for Market Researcher to join our team. About us We’re an emerging...
Apply For This JobJob Summary Primarily responsible for liaising with Pharmacometrics (MBMA group) and clinical pharmacology therapeutic area leads in creating and maintaining...
Apply For This JobJob Description Job Description About Team: Ion Torrent™ Genexus™ Software supports the Ion Torrent™ Genexus™ Integrated Sequencer workflow for research...
Apply For This JobJob Description Wise Travel India (WTi) www.WTicabs.com is one of the largest car rental and employee transportation companies in India...
Apply For This Job