Articles
About
© 2022 Data Science Illustrated
Statistical Hypothesis Testing Interactive Visualization: A/B Testing with Chi Squared Test
2020 · Posted by
Sebastien Lemieux-Codere
Count Histograms
Fraction Positive Histograms
Test Statistic Histogram
Computed P-Value Histogram
Simulation Parameters
Group Size
Probability of Positive Outcome for Group
Group A
Group B
Suggested Simulation Parameters to Try:
Same Probability of Positive Outcome
Same Probability of Positive Outcome, Stronger Significance Level
Different Probability of Positive Outcome
Different Probability of Positive Outcome, Stronger Significance Level
Small Difference in Probability of Positive Outcome (Low Test Power Scenario)
Small Difference in Probability of Positive Outcome and Very Large Group Sizes
Same Probability of Positive Outcome, Different Group Sizes
Different Probability of Positive Outcome, Different Group Sizes
Rerun Simulations
Metrics for
Significance Level:
\$ \alpha \$ =
0.1
0.05
0.01
See results of specific simulation:
/ 2000
The Author
Sebastien Lemieux-Codere
Sebastien is a Data Scientist and Software Developer.