Full Job Description
Job Description: #LI-DNI
The primary objective of the Kafka Administrator is to develop and maintain the corporate messaging infrastructure ensuring message delivery, security, retention, and recoverability of the topics and messages.
In this role, the Kafka Admin will design, build, test, and deploy quality messaging and streaming solutions that are consistent with project objectives, technology architecture standards and departmental best practices. The Kafka admin will design and implement event sourcing strategies, administer enterprise-wide messaging architecture, and provide daily management of Kafka eco-system.
Specific responsibilities include:Manage large scale multi-nodes Kafka cluster environments residing on AWS and on-prem OpenShift platform.Handle all Kafka environment builds, including design, capacity planning, cluster setup, performance tuning and ongoing monitoring.Perform high-level, day-to-day operational maintenance, support, and upgrades for the Kafka Cluster.Creation of key performance metrics, measuring the utilization, performance and overall health of the cluster.Capacity planning and implementation of new/upgraded hardware and software releases as well as for storage infrastructure.Research and recommend innovative, and where possible, automate key administration tasks.Ability to closely collaborate with product managers and lead engineers.Provide guidance in the creation and modification of standards and proceduresCreate topics, setup redundancy cluster, deploy monitoring tools, alertsProactively monitor and setup alerting mechanism for Kafka Cluster and supporting hardware to ensure system health and maximum availabilityPerform high-level, day-to-day operational maintenance, support, and upgrades for the Kafka clusterProvide technical expertise and guidance to production support.5+ years of solid Kafka Admin experience in managing critical 24/7 applicationsDesign, build, assemble, and configure the application or technical architecture components using business requirements.Hands-on experience with Kafka clusters hosted on ROSA in AWS and on-prem K8 Open Shift platformExperience in building Kafka pipelines using Terraform, Ansible, Cloud formation templates, shells etc.Experience in implementing security & authorization (permission based) on Kafka cluster.Aid System Administrators with setting up Kafka platform in provisioning, access lists Kerberos and SSL configurations.Experience in setting standards to automate deployments using Kubernetes, Docker, Chef or JenkinsExperience in open source and confluence Kafka, zookeepers, Kafka connect, schema registry, KSQL, Rest proxy and Kafka Control center.Experience in Kafka Mirror Maker or Confluent ReplicatorExperience in High availability cluster setup, maintenance and ongoing 24/7 supportEstablish best practice standards for configuring Source and Sink connectors.Hands on experience in standing up and administrating Kafka platform from scratch which includes creating a backup & mirroring of Kafka Cluster brokers, broker sizing, topic sizing, h/w sizing, performance monitoring, broker security, topic security, consumer/producer access management (ACL)Knowledge of Kafka API (development experience is a plus)Knowledge of best practices related to security, performance, and disaster recovery.Ability to concentrate on a wide range of loosely defined complex situations, which require creativity and originality, where guidance and counsel may be unavailable.Demonstrate a product mindset with an ability to set forward thinking and direction.Ability to synthesize large amounts of complex data into meaningful conclusions and present recommendations.Ability to maintain a positive attitude while working with high demands and short deadlines that leads to working after hours.Must have excellent communications and interpersonal skillsNot Required, but Preferred:Experience with Oracle Streams and/or another real-time streaming solution is a plus.Experience in setting up Prometheus/Grafana or ELK monitoring tools is a plus.Experience as Linux (RHEL) /Unix administrator is huge plus.Experience in PostgreSQL, SQL Server, No-SQL (Couchbase), Oracle, and AWS Cloud is a plus.Understanding of or experience supporting .NET / Java application.Understanding of or experience with Programming languages like Python, PowerShell, etc is plus.Key Skills: Hands on experience in standing up and administrating Kafka platform from scratch which includes creating a backup & mirroring of Kafka Cluster brokers, broker sizing, topic sizing, h/w sizing, performance monitoring, broker security, topic security, consumer/producer access management (ACL)
Knowledge of Kafka API (development experience is a plus)Knowledge of best practices related to security, performance, and disaster recovery.Ability to concentrate on a wide range of loosely defined complex situations, which require creativity and originality, where guidance and counsel may be unavailable.Demonstrate a product mindset with an ability to set forward thinking and direction.Ability to synthesize large amounts of complex data into meaningful conclusions and present recommendations.Ability to maintain a positive attitude while working with high demands and short deadlines that leads to working after hours.Must have excellent communications and interpersonal skillsLocation: CHN
Required Experience: Min 7 yrs
Contact Person: RMG
Email ID: RMG@SERVION.COM
br{display:none;}.css-58vpdc ul > li{margin-left:0;}.css-58vpdc li{padding:0;}]]> Responsibilities A day in the life of an Infoscion • As part of the Infosys...
Apply For This Jobbr{display:none;}.css-58vpdc ul > li{margin-left:0;}.css-58vpdc li{padding:0;}]]> We are looking for a talented and motivated blog writer to join our team. The...
Apply For This JobMarket Research Specialist – Multiple Sectors We are seeking a talented and experienced Market Research Specialist to join our highly...
Apply For This JobFull Job Description Designation: Senior Executive – Accounts & Finance Location of work: HSR Layout & Vadodara Experience: 2+ years...
Apply For This JobFantek was started by Mr. Kishore Kumar, an M.Tech from IIT Madras and Mr. Srinivas Kishore, an MBA from NUS...
Apply For This JobUrgent Vacancy with Leading Bank Role – Government Banking Relationship Manager Key Responsibilities Manage Government banking group clients and acquisition...
Apply For This Job