About the role
Responsibilities:
- Design and build LLM agents that plan, call tools and complete multi-step business tasks across voice, chat and back-office channels.
- Implement task and conversation state, memory and context management, retrieval (RAG) and model routing between fast and more capable models.
- Define tool schemas and permissions, validate every tool call, and add human approval points for high-impact actions.
- Build durable workflows with checkpoints, retries, idempotency keys, timeouts and compensation for failed actions.
- Use multi-agent designs, such as a router with specialist agents, only where they measurably beat a single agent.
- Integrate CRMs, ticketing systems and databases for actions such as complaint registration, classification, routing, status updates and notifications, with warm human handoff.
Requirements:
- Strong Python and backend skills: APIs, asyncio, WebSockets, structured error handling and automated tests with 2-5 years of experience.
- Hands-on experience shipping LLM agents beyond a prompt demo: tool calling, state management, RAG and failure handling in a real workflow.
- Sound judgment on agent design: when a fixed workflow beats an autonomous agent, single versus multi-agent, and how to keep agents safe with permissions and guardrails.
- Working knowledge of a real-time voice stack: streaming ASR and TTS, VAD, turn-taking and the trade-offs between latency and accuracy.
- Experience designing evaluations for LLM agents: test sets, trajectory and outcome metrics, LLM-as-judge and regression tracking — and knowing when a metric is misleading.
- Ability to debug across services using logs, traces and recorded sessions to find where an agent failed or slowed down.
- Experience with SQL or NoSQL databases, Git, Docker and CI pipelines.
- Bachelor's degree in a technical field or equivalent practical experience, with clear examples of delivered work.
Preferred experience:
- Agent frameworks and orchestration tools such as LangGraph, OpenAI Agents SDK, Temporal or MCP tool servers.
- Production voice agents on telephony (SIP, Twilio, Exotel) or WebRTC, with frameworks such as LiveKit Agents or Pipecat.
- Speech providers such as Deepgram, Whisper, Google STT, ElevenLabs, Azure TTS or Cartesia, and measuring their WER and latency on your own data.
- Indian-language and code-switched speech (Hindi, Telugu, Tamil and English).
- Queues, caching and event-driven systems (Redis, Kafka, RabbitMQ), and load-testing tools such as Locust or k6.
- Access controls, PII redaction and on-premises or restricted-network deployments.
- Other modalities, such as vision or document understanding (images, screenshots, scanned forms), and combining them with voice or text in one agent.