About the role
At ABC Company, you will play a pivotal role in architecting and maintaining robust, real-time data pipelines using Apache Kafka. Your expertise will drive the reliability and scalability of our event-driven systems, directly impacting our business agility and data-driven decision-making.
Role and Responsibilities (What You'll Do):
- Design, develop, and maintain Kafka producers, consumers, and streams to enable real-time data processing across critical business applications.
- Build and support event-driven and microservices architectures, ensuring seamless integration and data flow between distributed systems.
- Develop and implement Kafka integrations with various applications, databases, and external systems to support business requirements.
- Configure and manage Kafka topics, partitions, replication, and consumer groups to optimize data distribution and system performance.
- Ensure high availability, fault tolerance, and performance tuning of Kafka clusters to meet stringent uptime and reliability standards.
- Implement and manage schema evolution using Schema Registry (Avro/Protobuf/JSON) to maintain data consistency and compatibility.
- Monitor, troubleshoot, and resolve Kafka-related issues in production environments, ensuring minimal disruption to business operations.
- Collaborate closely with DevOps teams on Kafka deployment, upgrades, scaling, and automation initiatives.
- Implement and enforce security best practices, including ACLs, SSL, SASL, and RBAC, to safeguard data and system integrity.
Qualifications (What You'll Bring):
Must-Have:
- Proficiency in Apache Kafka, including Kafka producers, consumers, and streams.
- Strong experience with event-driven architecture and microservices.
- Expertise in Kafka cluster management, topic and partition configuration, and consumer group management.
- Hands-on experience with Schema Registry and serialization formats such as Avro, Protobuf, and JSON.
- Advanced skills in performance tuning, monitoring, and troubleshooting Kafka in production environments.
- Familiarity with DevOps practices related to Kafka deployment, scaling, and upgrades.
- In-depth knowledge of Kafka security mechanisms (ACLs, SSL, SASL, RBAC).
Preferred:
- Bachelor of Technology (B.Tech) or equivalent in Computer Science, Information Technology, or a related field.
- Domain expertise in large-scale, high-availability distributed systems.
- Strong analytical, problem-solving, and communication skills.
- Experience working in collaborative, cross-functional teams.
Why Join Us? (Company, Culture & Benefits):
Your Company is a high-performance AI-driven organization, empowering enterprises to build scalable hiring engines with cutting-edge technology. We foster a collaborative, customer-centric culture and offer competitive compensation, comprehensive health benefits, and continuous professional development opportunities.
Our Commitment to You (Inclusivity & Process):
We are an Equal Opportunity Employer committed to diversity and inclusion. We welcome candidates from all backgrounds and make hiring decisions based on merit. Please ensure you have the legal right to work in this specific location before applying.
We encourage candidates of all backgrounds to apply. We do not discriminate based on race, religion, colour, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.
Accommodations: We are committed to providing reasonable accommodations for candidates with disabilities in our recruiting process.
Join Our Journey:
We are ABC Company, and our future is built by you. Bring your unique talent to a team that champions growth, innovation, and belonging. Apply now to start your journey.