Test Automation Engineer

Role Overview

The Test Automation Engineer will build and maintain shared automated testing frameworks and suites covering UI, API, end-to-end (E2E), and regression testing. The role involves using AI tools to generate and improve tests, validating AI-generated code, integrating automation into CI/CD pipelines, and testing AI-powered features against reliable source data.

The ideal candidate has strong hands-on automation experience and at least 1 year of AI-assisted delivery experience.

Key Responsibilities

• Build and maintain reusable UI, API, E2E, and regression automation suites.

• Develop automation frameworks using Playwright, Selenium, TypeScript, or Python.

• Use AI tools to generate test scripts and assertions, then review and correct the output.

• Integrate automated tests into CI/CD pipelines using Azure DevOps or GitHub Actions.

• Manage test data, environment dependencies, and test execution.

• Investigate failures, flaky tests, incorrect locators, synchronization issues, and assertion problems.

• Test AI features by checking output accuracy, grounding, and consistency against source information.

• Maintain readable, reusable, reliable, and maintainable automation code.

• Track test coverage, regression execution time, failures, and automation effectiveness.

Mandatory Skills & Experience

• 5+ years of hands-on test automation experience.

• Strong experience building and maintaining automated test suites.

• Practical UI, API, E2E, and regression testing experience.

• Experience with Playwright or Selenium.

• Programming skills in TypeScript or Python.

• Experience with API testing tools such as Postman/Newman or equivalent.

• At least 1 year of hands-on AI-assisted delivery for test generation, automation development, or test maintenance.

• Ability to review AI-generated tests for correct locators, assertions, waits, reliability, and maintainability.

• Experience integrating automation into CI/CD pipelines.

• Ability to investigate test failures and distinguish genuine product defects from automation issues.

• Understanding that a passing automated test does not, by itself, prove product quality.

Preferred Skills

• Playwright with TypeScript.

• Azure DevOps pipelines or GitHub Actions.

• Codex, Augment Code, Claude, or GitHub Copilot.

• Experience testing GenAI or document-AI features.

• Validation of AI output against source documents or expected ground-truth results.

• Experience building shared automation frameworks adopted by multiple teams.