About the role
This role involves guiding the Experimentation Platform team in developing a statistically correct, flexible, and powerful platform for online experimentation. You will be the statistical voice and technical lead, co-designing a new AI experimentation experience and backend, ensuring high-level functionality like hierarchical experimentation and statistical correctness guardrails. You will be in charge of developing and integrating a variety of experiment analysis techniques, including more powerful variance reduction methods, quantile treatment effect analysis, and cross-experiment analysis. Finally, you will help drive expansion of platform capabilities into additional experiment designs, such as cluster-randomized designs and budget split testing.
Responsibilities:
• Co-design the new AI experimentation experience and the backend that powers it.
• Collaborate cross-functionally to identify business opportunities and develop algorithms and methodologies to address them.
• Analyze large-scale structured and unstructured data.
• Engage with technology partners to build, prototype and validate scalable tools/applications end to end (backend, frontend, data) for converting data to insights.
• Initiate and drive projects to completion independently.
• Act as a thought partner to senior leaders to prioritize/scope projects, provide recommendations and evangelize data-driven business decisions in support of strategic goals.
• Partner with cross-functional teams to initiate, lead or contribute to large-scale/complex strategic projects for team, department, and company.
• Provide technical guidance and mentorship to junior team members on solution design as well as lead code/design reviews.
QualificationsBasic Qualifications:
- MS or PhD in a quantitative discipline: Statistics, Economics, Applied Mathematics, Operations Research, Computer Science, Informatics, or other quantitative field relevant to the science of experimentation.
- Expertise in statistics, including analysis of bias and variance for experimental design and analysis approaches.
- Fluent in at least one programming language and a capable user of AI software engineering tools.
- Ability to establish requirements and design a new system for a broad set of users.
- 3+ years in a position that includes substantial technical leadership. 10+ years of total experience
Preferred Qualifications:
- Experience in infrastructure/platform development.
- Ability to collaborate with and shape technical solutions for a broad set of customers and stakeholders.
Suggested Skills:
- Structured thinking around bias
- Understanding of AI Experimentation
- Leadership
India Disability Policy
Global Data Privacy Notice and Compliance Posters for Job Candidates