About the role
The RoleWe are looking for a Senior Backend Engineer to own the Velogent platform end to end: its architecture, its processing pipeline and its production health. You will take the six-stage pipeline, from ingestion to output, from design to a reliable multi-tenant service running at enterprise scale. This is a platform ownership role, not a feature-delivery role. You decide how the system is built, you carry it in production, and you fix it when it breaks.What Makes This Role Different
- Full ownership. You have built a platform or product architecture from the ground up and stayed accountable for it afterwards.
- Production accountability. You have run live systems, led performance investigations and owned incident response.
- Real scale. You have operated distributed systems that served 10,000+ users and know what changes in design as load grows.
- Own the Velogent platform architecture, technical roadmap and design decisions across all six pipeline stages, from ingestion to output.
- Write and maintain architecture decision records, capacity plans and reliability targets (SLOs) for the platform.
- Lead production operations: monitoring, on-call, incident response, root-cause analysis and performance tuning.
- Design the core pipeline orchestration framework in async Python, supporting parallel and sequential stage execution with retries and dead-letter queues.
- Design the event-driven architecture with message queuing, backpressure handling and graceful degradation.
- Build the reconstruction module that turns extracted data into Markdown and vector representations and context maps.
- Build the connector framework for 50+ enterprise data sources (APIs, databases, file systems, SaaS platforms).
- Implement the safety layer: PII/PHI detection, data integrity checks, format compliance and input sanitisation.
- Implement an immutable audit trail across all six stages, recording every decision, action and transformation.
- Build multi-tenant data isolation so customer data stays strictly separated at every stage.
- Set engineering standards for testing, CI/CD, observability and code review. Mentor engineers and raise the technical bar for the team.
- Partner with product, solution architects and customer delivery teams to turn customer requirements into platform capability.
- 6 to 10 years of backend engineering experience, including 2+ years building data-intensive pipelines.
- Proven track record of designing and building a complete platform or product architecture and holding end-to-end ownership of it.
- Experience managing production systems, including diagnosing and resolving performance issues and leading incident response.
- Experience building and running distributed systems that supported 10,000+ users.
- Distributed Python systems: asyncio, aiohttp and Celery. This is not scripting.
- Message queues or streaming: Kafka, SQS, RabbitMQ or Redis Streams.
- High-volume data pipelines handling 100K+ documents or records per batch.
- API design: REST or GraphQL, versioning, rate limiting and authentication.
- AWS: Lambda, SQS/SNS, MSK, ECS/EKS, Step Functions, S3, DynamoDB and RDS.
- Multi-tenant SaaS architecture and customer data isolation patterns.
- Production habits: comprehensive testing, CI/CD, monitoring and incident response.
- Experience with PII/PHI handling or regulated environments (HIPAA, SOC 2, GDPR).
- Vector databases, embeddings and retrieval pipelines for LLM or agentic workloads.
- Infrastructure as code (Terraform or CDK) and cost optimisation on AWS.
- Experience mentoring engineers or acting as a technical lead.