NextHire Try for free

LogicMonitor

Posted 15 Nov 2026

Senior AI Engineer

Apply with NextHire Auto Apply fills in the application for you.
Employment
Full time
Team
Software Engineering
Posted
15 Nov 2026

About the role

What You'll Do:


LogicMonitor is redefining observability through Edwin AI, our GenAI-powered AIOps platform that helps engineering and operations teams understand, investigate, and resolve issues faster across complex hybrid environments. Edwin AI brings together telemetry, topology, alerts, metrics, logs, traces, incidents, and operational context with the reasoning capabilities of large language models.


We're looking for a Senior AI Engineer to design, build, evaluate, and operate the AI systems that power Edwin's intelligence. This role sits at the intersection of applied machine learning, LLM application engineering, retrieval-augmented generation, data intelligence, and production software engineering.


You will build AI workflows that transform complex observability signals into clear summaries, correlations, root-cause hypotheses, anomaly explanations, recommendations, and guided remediation steps. You'll work closely with AI Platform, Backend, Data, AIOps, SRE, Product, and Design teams to make Edwin accurate, reliable, explainable, secure, and impactful for customers.


Here's a closer look at this key role:

  • Design and build AI capabilities for Edwin AI, including incident summarization, alert correlation, anomaly explanation, root-cause analysis assistance, recommendation generation, and guided remediation workflows.
  • Develop production-grade LLM applications using techniques such as retrieval-augmented generation, tool calling, function calling, prompt orchestration, agentic workflows, structured outputs, and multi-step reasoning pipelines.
  • Build and optimize RAG pipelines that retrieve relevant observability context from metrics, logs, traces, alerts, topology, incidents, runbooks, knowledge bases, and historical operational data.
  • Design embedding, indexing, chunking, reranking, query expansion, and semantic retrieval strategies for high-scale observability and AIOps use cases.
  • Develop AI orchestration services using Python, FastAPI, LangGraph, LangChain, LlamaIndex, or similar frameworks.
  • Implement structured AI workflows that combine deterministic business logic, statistical methods, retrieval systems, and LLM reasoning.
  • Collaborate with backend and data engineering teams to define AI-ready data contracts, metadata schemas, context formats, and retrieval APIs.
  • Build evaluation frameworks for AI quality, including relevance, groundedness, correctness, hallucination reduction, latency, cost, safety, and user usefulness.
  • Create offline and online evaluation pipelines using golden datasets, synthetic test cases, human review, A/B testing, feedback loops, and production telemetry.
  • Optimize prompt templates, model selection, retrieval strategies, context windows, latency, token usage, cost, and response consistency.
  • Implement guardrails for safe and trustworthy AI behavior, including source attribution, citation handling, confidence signals, output validation, policy checks, and fallback strategies.
  • Work with structured and unstructured observability data to power AI reasoning across events, incidents, alerts, logs, metrics, topology, and service dependencies.
  • Integrate with commercial and open-source LLMs, embedding models, rerankers, vector databases, and model-serving infrastructure.
  • Build APIs and services that expose AI capabilities to Edwin's UI, backend systems, and AIOps workflows.
  • Instrument AI pipelines with observability, tracing, metrics, structured logs, evaluation signals, and debugging tools.
  • Partner with SRE and platform teams to monitor production AI behavior, troubleshoot failures, and improve reliability across end-to-end AI workflows.
  • Collaborate with Product and Design to shape AI UX patterns such as citations, reasoning summaries, confidence indicators, feedback capture, explainability, and human-in-the-loop interactions.
  • Ensure model inputs, retrieved context, generated outputs, and stored AI artifacts follow data privacy, RBAC, tenant isolation, and compliance requirements.
  • Participate in technical design discussions, architecture reviews, code reviews, and AI best-practice development.
  • Mentor engineers on LLM application patterns, RAG design, evaluation methods, and production AI engineering practices.


What You'll Need:

  • Bachelor's degree in Computer Science, Machine Learning, Data Science, Software Engineering, or a related technical field, or equivalent practical experience.
  • 5-8+ years of experience in software engineering, machine learning engineering, AI engineering, data engineering, or backend systems.
  • Strong programming skills in Python, with experience building production-grade services, APIs, pipelines, or AI applications.
  • Experience building LLM-powered applications using RAG, embeddings, vector search, prompt engineering, structured outputs, tool calling, or agentic workflows.
  • Hands-on experience with AI orchestration frameworks such as LangGraph, LangChain, LlamaIndex, or similar technologies.
  • Experience with model APIs and platforms such as OpenAI, Azure OpenAI, Anthropic, AWS Bedrock, Google Vertex AI, or open-source model-serving stacks.
  • Strong understanding of retrieval systems, semantic search, chunking strategies, embeddings, metadata filtering, reranking, query rewriting, and context assembly.
  • Experience building evaluation pipelines for LLM applications, including test datasets, human review workflows, automated scoring, and production feedback loops.
  • Strong software engineering fundamentals, including API design, testing, CI/CD, observability, reliability, and secure coding practices.
  • Experience working with distributed systems, data pipelines, streaming systems, or large-scale operational data.
  • Familiarity with vector databases or search systems such as pgvector, OpenSearch, Elasticsearch, Pinecone, Weaviate, Milvus, Qdrant, or similar technologies.
  • Experience with containers, Kubernetes, cloud-native deployment, and production service operations.
  • Understanding of AI safety, data privacy, RBAC, tenant isolation, prompt injection risks, grounding, hallucination mitigation, and secure handling of customer data.
  • Ability to collaborate effectively with AI Platform, Backend, Data, SRE, Product, Design, and Engineering teams.
  • Strong communication skills and the ability to explain AI behavior, quality tradeoffs, and technical implementation details clearly.

Similar jobs

See every job

85% of jobs are filled through networking

The AI Outreach Agent writes to recruiters and hiring managers at the companies you pick, from your own Gmail.

Try AI Outreach