About the role
We are looking for an experienced Strategic Project Lead with hands-on experience operating software-engineering data programs for frontier AI models.
This is a highly specialized role for professionals who have managed production programs involving coding data, SWE benchmarks, model evaluations, RLHF/preference data, agentic coding, code generation, or code-repair datasets.
What You'll Do
-
Operate software-engineering data and evaluation programs end to end.
-
Manage contributor sourcing, calibration, onboarding, reviewer capacity, and performance.
-
Track throughput, quality, rework, defects, costs, and delivery timelines.
-
Review code, tests, task metadata, and final artifacts for technical correctness.
-
Diagnose quality failures and improve task design, rubrics, instructions, and review processes.
-
Lead recovery plans when programs fall behind on quality, throughput, cost, or timelines.
-
Coordinate distributed software engineers, reviewers, and team leads.
-
Communicate progress, risks, and corrective actions to research and program teams.
-
Use Python, SQL, or similar tools for quality analysis, defect tracking, and operational reporting.
What We're Looking For
-
Direct experience operating production software-engineering data programs for frontier AI models.
-
Experience with coding training, coding RLHF, SWE benchmarks, model evaluations, agentic coding, code generation, or code repair.
-
Proven ownership of contributor sourcing and calibration, throughput, quality, rework, cost management, and delivery recovery.
-
Strong software-engineering judgment and the ability to read code and tests, inspect final artifacts, and identify invalid technical work.
-
Experience managing distributed software engineers, reviewers, and team leads.
-
Ability to quickly take ownership of an active program, diagnose operational issues, and develop recovery plans.
Project Details
-
Role: Strategic Project Lead – Software Engineering
-
Type: Short-term Contractor
-
Duration: 3 months
-
Start: Immediate
-
Locations: USA, Bangladesh, Brazil, Colombia, Egypt, Ghana, India, Pakistan, Indonesia, Nigeria, Turkey, Vietnam
-
Availability: 8 hours/day, minimum 40 hours/week
-
Time Zone: Minimum 4-hour overlap with PST