About the role
Responsibilities:
- Design and implement distributed, fault-tolerant streaming pipelines using Kafka, Apache Flink, and MQTT.
- Build event-driven microservices for real-time data processing and analytics.
- Optimize streaming applications for performance, throughput, and latency.
- Deploy and manage containerized applications on Kubernetes clusters.
- Implement monitoring, alerting, and auto-scaling strategies for streaming workloads.
- Troubleshoot production issues and ensure system reliability.
- Collaborate with cross-functional teams and mentor junior developers.
Requirements:
- 6-8 years in backend development with 4+ years in real-time streaming systems.
- Proven track record of building production systems handling 100K messages/second.
- Data Structures and Algorithms: Extremely strong foundation in data structures and algorithms with the ability to design optimal solutions for complex problems.
- Programming: Strong proficiency in Python, Golang, or Java with Spring Boot, with a deep understanding of concurrent and async programming.
- Streaming Systems: Expert-level proficiency with Apache Kafka (including Kafka Streams), hands-on experience with Apache Flink, and working knowledge of the MQTT protocol.
- Distributed Systems: Solid understanding of distributed systems concepts, event-driven architecture, and streaming design patterns.
- Databases: Experience with time-series databases and NoSQL stores (Cassandra, MongoDB).