Principal Data Scientist, Experimentation
Core
Leading individual contributor responsible for setting technical standards, tooling, and protocols for experimentation across the organization to improve decision-making speed and reliability.
Role type
Principal Data Scientist (Experimentation)
Builds
Experimentation standards, tooling, and protocols for Product Data Science teams
Domain
Travel technology, two-sided marketplaces
Deliverable
production ML models
Required skills
Experimental design, causal inference, Bayesian methods, multi-arm bandits, statistical modelling, Python, SQL, machine learning, product metrics definition, cross-functional partnership, standardization at scale, critical thinking
Preferred skills
Two-sided marketplace experimentation, proxy/surrogate metrics, hierarchical approaches, experimentation platform development, high-scale tech experience, AI/LLM application, SaaS experimentation tools
Technologies
Python, SQL, Statsig, Eppo, GrowthBook
Responsibilities
Set technical standards for experimentation from A/B testing to Bayesian methods; Partner with Product, Engineering, and Data Platform teams to improve experimentation velocity; Critically assess how experimentation affects platform health and growth; Own measurement approaches for complex questions where standard experimentation is insufficient; Develop and validate statistical methods including simulation-based verification; Act as final technical authority on measurement validity; Standardize recurring analytical processes using automation and AI; Design and land methodological improvements with organization-wide impact; Mentor senior data scientists and improve team reasoning about measurement; Advise on when experimentation is not the appropriate tool
Seniority
Principal, hands-on IC with strategy & mentorship