About the role
Requirements:
- 6+ years of hands-on cloud infrastructure; 3+ years operating multiple clouds simultaneously in production; deep expertise in at least two of AWS/GCP/Azure.
- Real-time audio/video systems in production: WebRTC, SIP/PSTN, or streaming media; you've debugged jitter, not just read about it.
- Networking depth: VPC/VNet design, load balancing, DNS, NAT; private connectivity.
- (Direct Connect / Cloud Interconnect / ExpressRoute, PrivateLink / Private Service Connect); transit gateways and cross-cloud mesh.
- Kubernetes at scale (EKS/GKE/AKS), Helm, and scaling *stateful* workloads; service mesh familiarity (Istio/Linkerd).
- Infrastructure as Code: Terraform (non-negotiable) across multi-account/multi-project estates; drift is a bug.
- AI/ML serving in production: GPU allocation and scheduling, inference servers or serverless GPU platforms (vLLM / Triton / Modal / Baseten-class), streaming protocols(WebRTC, WebSocket, gRPC).
- Production STT/TTS/LLM API operations: streaming integrations, quota management, multi-vendor failover (Deepgram / Google / Azure / Whisper-class ASR; ElevenLabs / Azure-class TTS).
- Security fundamentals: IAM/RBAC, secrets management (Vault or cloud-native), encryption and key rotation.
- CI/CD: GitHub Actions or GitLab CI with security scanning integrated into the pipeline.
Strong signal (nice-to-have):
- LiveKit, pipecat, Twilio, or comparable real-time platforms; SIP trunking and PSTN integration.
- KEDA or other event-driven autoscaling used in anger.
- MLOps: model versioning, canary and A/B rollout.
- FinOps discipline: reserved/spot strategy, unit-economics reporting.
- Certifications: AWS SA Professional, GCP Professional Cloud Architect, Azure Solutions Architect Expert.
- ISO/IEC 42001:2023 exposure.