Content deleted Content added
Citation bot (talk | contribs) Alter: template type. Add: isbn. | Use this bot. Report bugs. | Suggested by Abductive | #UCB_webform 3416/3850 |
|||
Line 47:
* Logging: user interactions can be logged reliably.
* Number of users: large sites, such as Amazon, Bing/Microsoft, and Google run experiments, each with over a million users.
* Number of concurrent experiments: large sites run tens of overlapping, or concurrent, experiments.<ref name="ExPScale">{{cite
| last = Kohavi
| first = Ron
Line 59:
| year = 2013
| doi = 10.1145/2487575.2488217
| isbn = 9781450321747
}}</ref>
* Robots, whether [[web crawlers]] from valid sources or malicious [[internet bots]].{{clarify|reason=what about them? do they affect the reliability of the results?|date=May 2019}}
* Ability to ramp-up experiments from low percentages to higher percentages.
* Speed / performance has significant impact on key metrics.<ref name="surveyarticle" /><ref name="ExPRulesOfThumb">
{{cite
| last = Kohavi
| first = Ron
Line 76 ⟶ 77:
| year = 2014
| doi = 10.1145/2623330.2623341
| isbn = 9781450329569
}}</ref>
* Ability to use the pre-experiment period as an A/A test to reduce variance.<ref name="cuped">{{cite conference
| |||