About the role
AI Ops Engineer – Required Skills and Qualifications
Required Technical Skills
- Experience administering enterprise SaaS platforms, preferably AI, cloud, or developer productivity platforms.
- Working knowledge of Large Language Models (LLMs), including prompt engineering, context windows, token consumption, model capabilities, and common AI workflows.
- Experience using enterprise AI platforms such as ChatGPT Enterprise, Anthropic Claude, Microsoft Copilot.
- Ability to analyze platform usage, cost, and operational metrics to identify optimization opportunities.
- Experience working with REST APIs and using APIs to automate operational tasks.
- Proficiency in scripting or automation using one or more languages such as Python, PowerShell, or JavaScript.
- Experience with SQL and data analysis for operational reporting.
- Familiarity with identity and access management concepts, including SSO, RBAC, Entra ID (Azure AD), SCIM provisioning, and user lifecycle management.
- Experience creating dashboards and reports using tools such as Power BI, Tableau, or similar analytics platforms.
- Understanding of SaaS licensing models, usage-based billing, quotas, and cost management practices.
- Experience troubleshooting user issues and working with vendor support organizations.
Preferred Technical Skills
- Experience administering ChatGPT Enterprise and/or Anthropic Claude Enterprise.
- Experience with OpenAI APIs and Anthropic APIs.
- Familiarity with AI gateways, model routing, or proxy platforms such as LiteLLM.
- Experience building lightweight internal tools or operational automations.
- Knowledge of FinOps principles for cloud or SaaS platforms.
- Familiarity with MCP (Model Context Protocol) and AI agent architectures.
- Experience with observability platforms, monitoring systems, or operational analytics.
Professional Skills
- Strong analytical and problem-solving skills with the ability to identify inefficient usage patterns and recommend practical improvements.
- Ability to explain technical concepts to both technical and non-technical users.
- Excellent communication skills for creating documentation, best practices, and user guidance.
- Strong customer-service mindset with a passion for helping users maximize productivity.
- Ability to balance governance, security, cost optimization, and user experience.
- Comfortable working across engineering, security, procurement, legal, and business teams.
- Highly organized with strong attention to detail and operational discipline.
- Ability to manage multiple priorities in a fast-paced environment.
Responsibilities and Experience
Candidates should demonstrate experience with one or more of the following:
- Operating enterprise AI or SaaS platforms in a production environment.
- Managing user onboarding, access, licensing, and platform administration.
- Monitoring platform usage, costs, and operational health.
- Investigating abnormal usage patterns and recommending corrective actions.
- Developing user training, documentation, and adoption programs.
- Creating operational runbooks, standard operating procedures, and governance documentation.
- Automating repetitive operational activities through scripting or APIs.
- Collaborating with vendors to resolve technical or operational issues.
- Producing executive dashboards and operational metrics.