A/B Testing Template
- Abhinandan Rudramuni
This template is brought to you by Optimizely, a leading experimentation platform.
Experiment plan and results |
|
|---|---|
Experiment owner | |
Reviewers | |
Approver | |
Optimizely link | |
Jira ticket(s) |
|
Status | In review / In progress / Complete |
On this page |
Stakeholder summary
Experiment planning
Overview
What type of experiment is this?
What user problem is being solved
Hypothesis
We hypothesize that
will increase / decrease
because
Metrics
primary metric
secondary metric
Targeting
Where will this experiment run?
Who will see it?
What is the traffic allocation (% in total let in based on targeting)?
Variations
| A: Control | B: Variation | C: Variation |
|---|---|---|---|
Screenshot |
|
|
|
% of visitors/users to see each variation |
|
|
|
Pre-analysis
Add any baseline data or pre-analysis you have for this experiment. Add planned sample size and time to run.
Notes
Results
Experiment start | Nov 16, 2023 |
|---|---|
Experiment end | Nov 16, 2023 |
Link to results in Optimizely | |
Conclusion | inconclusive / hypothesis proved |
Add a short summary of the metrics below and whether you hit significance.
| A: Control | B: Variation |
| A: Control | C: Variation |
|
|---|---|---|---|---|---|---|
Cohort size |
|
|
|
| ||
Primary metric |
|
|
|
|
|
|
Other metrics |
|
|
|
|
|
|
Conclusions
Highlights
Primary goal
increase / decrease, by
increase / decrease, by
Takeaways
Follow-up