HoonarTek Hiring for Cloudera Admin at Navi Mumbai, Maharashtra Full Time

About Us

We empower enterprises globally through intelligent, creative, and insightful services for data integration, data analytics and data visualization.

Hoonartek is a leader in enterprise transformation, data engineering and an acknowledged world-class Ab Initio delivery partner.

Using centuries of cumulative experience, research and leadership, we help our clients eliminate the complexities & risk of legacy modernization and safely deliver big data hubs, operational data integration, business intelligence, risk & compliance solutions and traditional data warehouses & marts.

At Hoonartek, we work to ensure that our customers, partners and employees all benefit from our unstinting commitment to delivery, quality and value. Hoonartek is increasingly the choice for customers seeking a trusted partner of vision, value and integrity

How We Work?

Define, Design and Deliver (D3) is our in-house delivery philosophy. It’s culled from agile and rapid methodologies and focused on ‘just enough design’. We embrace this philosophy in everything we do, leading to numerous client success stories and indeed to our own success.

We embrace change, empowering and trusting our people and building long and valuable relationships with our employees, our customers and our partners. We work flexibly, even adopting traditional/waterfall methods where circumstances demand it. At Hoonartek, the focus is always on delivery and value.

Job Description

1. Review current architecture and recommend best practices/reference architecture

2. Ensure high uptime and availability of CDP platform 24X7

3. Conduct performance management, regular tunning to ensure optimal query throughput

4. Adept at Stakeholder management: for technical issues, engage with Product vendor and raise support case to ensure timely resolution

5. Perform regular Server maintenance / upgrade / patch deployments (including Rollback in case of failure) in sync with I-Bank and Cloudera team

6. Creation and Maintenance of Development and Production environment

7. Should have strong knowledge of industry best practices / techniques for Disk space management

8. Manage the team and be self driven to ensure monitoring of hourly/ daily/weekly/Monthly ETL Jobs to load data from DWH to DL

9. Development and enhancement of hourly/ daily/weekly/Monthly ETL Jobs to load data from DWH

10. Performance optimization of existing Sqoop and hive jobs as and when required.

Job Requirement

• Focus on Resiliency, Observability, Operability and Scalability
• The role is for a Hadoop/Cloudera Administrator/Lead Developer, capable of providing Administrative and Operational support as well as performing BAU operations. He/She will need to possess the right skillsets for new data lake solutions planned this year, it is important to bring in the right skillsets for the successful implementation of the production engineering initiatives for existing and upcoming system rollouts.
• In addition to BAU, the resource will be responsible for driving various initiatives such as

Shift left initiative for enabling production standards readiness for new Data warehouse platforms

• Focus on Resiliency, Observability, Operability and Scalability
• The role is for a Hadoop/Cloudera Administrator/Lead Developer, capable of providing Administrative and Operational support as well as performing BAU operations. He/She will need to possess the right skillsets for new data lake solutions planned this year, it is important to bring in the right skillsets for the successful implementation of the production engineering initiatives for existing and upcoming system rollouts.
• In addition to BAU, the resource will be responsible for driving various initiatives such as

Shift left initiative for enabling production standards readiness for new Data warehouse platforms

Automation for new platform

Refactoring the ETL workflows

Configure/Implement data quality measures

Cloudera experience: (6 – 10 years of relevant experience)

Cloudera platform installation

Performance tuning experience in Apache Spark / Pyspark, Spark SQL

Cluster configuration, maintenance, troubleshooting, and monitoring

CDP Private Cloud Base Installation

HDFS Topology and Roles, HDFS Performance and Fault Tolerance, HDFS and Hadoop Security Overview

Data Ingest – Ingesting Data, Best Practices for Importing Data

Data Flow – NiFi Architecture, Apache Kafka, Apache Kafka Cluster Architecture, Apache Kafka Command Line Tools

Data Access and Discovery – Apache Hive, Apache Impala, Apache Impala Tuning, Managing and Configuring Hue, Hue Authentication and Authorization

Data Compute – Running Applications on YARN, MapReduce Applications, YARN Memory, and CPU Settings, Tez, ACID, Spark

Managing Resources – Capacity Scheduler, Managing Queues, Impala Query Scheduling

Security – Data Governance with SDX, Hadoop Security, Hadoop Authentication Using Kerberos, Hadoop Encryption, Apache Ranger, Apache Atlas, Backup and Recovery

Private Cloud Capabilities

Planned, designed, and built various production tooling-related solutions.

Identifies better ways of working and seed and drive continuous improvement initiatives.

Review the architecture for SPOFs and resiliency.

Manage Day to Day Security Operations (Daily checklist, monitoring for availability/performance, user access management, troubleshooting & resolving user issues, managing user queries,) & validating reports

Drive escalated issues or major outages.

Tracking and escalating issues with OEM/other connected system teams.

Identify, respond, troubleshoot, and remediate issues in a timely manner and carry out root cause analysis

Ensure that all security controls are implemented as per security guidelines/best practices

Review and action reports – Incident, Capacity & others on a weekly/ monthly basis.

Managing Audit & Compliance. Coordinate with different stakeholders to get audit observations closed related tIT security.

Knowledge and practice of ITIL processes

Conduct periodic MIS/ Review meetings with OEM to track the status of operational and implementation activities.

Must be able to manage & guide the team.

Good communication and presentation skills

Ability to learn new engineering tools and apply best practices

Assigning the tasks & closure of same

Evaluate BI operations effectiveness and create and execute a plan to increase maturity.