Content deleted Content added
EightAndNine (talk | contribs) |
Rescuing orphaned refs ("kline" from rev 1299244632) |
||
Line 293:
*Layers of philosophical concerns. The probability of statistical significance is a function of decisions made by experimenters/analysts.<ref name="bakan66">
{{cite journal |last=Bakan |first=David |year=1966 |title=The test of significance in psychological research |journal=Psychological Bulletin |volume=66 |issue=6 |pages=423–437 |doi=10.1037/h0020412 |pmid=5974619}}</ref> If the decisions are based on convention they are termed arbitrary or mindless<ref name="Gigerenzer 587–606">{{cite journal|last=Gigerenzer|first=G|title=Mindless statistics|journal=The Journal of Socio-Economics|date=November 2004|volume=33|issue=5|pages=587–606|doi=10.1016/j.socec.2004.09.033}}</ref> while those not so based may be termed subjective. To minimize type II errors, large samples are recommended. In psychology practically all null hypotheses are claimed to be false for sufficiently large samples so "...it is usually nonsensical to perform an experiment with the ''sole'' aim of rejecting the null hypothesis."<ref>{{cite journal | last = Nunnally | first = Jum | title = The place of statistics in psychology | journal = Educational and Psychological Measurement | volume = 20 | number = 4 | pages = 641–650 | year = 1960 | doi=10.1177/001316446002000401| s2cid = 144813784}}</ref> "Statistically significant findings are often misleading" in psychology.<ref>{{cite journal | last = Lykken | first = David T. | title = What's wrong with psychology, anyway? | journal = Thinking Clearly About Psychology | volume = 1 | pages = 3–39 | year = 1991}}</ref> Statistical significance does not imply practical significance, and [[correlation does not imply causation]]. Casting doubt on the null hypothesis is thus far from directly supporting the research hypothesis.
*"[I]t does not tell us what we want to know".<ref name=cohen94>{{cite journal|author=Jacob Cohen|title=The Earth Is Round (p < .05)|journal=American Psychologist|volume=49|issue=12|pages=997–1003|date=December 1994|doi=10.1037/0003-066X.49.12.997|s2cid=380942}} This paper lead to the review of statistical practices by the APA. Cohen was a member of the Task Force that did the review.</ref> Lists of dozens of complaints are available.<ref name=kline>{{cite book|last=Kline|first=Rex|title=Beyond Significance Testing: Reforming Data Analysis Methods in Behavioral Research|publisher=American Psychological Association|___location=Washington, D.C. |year=2004|isbn=9781591471189 }}</ref><ref name="nickerson">{{cite journal|author=Nickerson, Raymond S.|title=Null Hypothesis Significance Tests: A Review of an Old and Continuing Controversy|journal=Psychological Methods|volume=5|issue=2|pages=241–301|year=2000|url=https://psycnet.apa.org/doiLanding?doi=10.1037%2F1082-989X.5.2.241|doi=10.1037/1082-989X.5.2.241|pmid=10937333|s2cid=28340967|archive-url=https://is.muni.cz/el/1423/jaro2010/PSY117/um/_Nickerson_-_NHST_controversy_review.pdf|archive-date=2000-02-23}}</ref><ref name="branch">{{cite journal|author=Branch, Mark|title=Malignant side effects of null hypothesis significance testing|journal=Theory & Psychology|volume=24|issue=2|pages=256–277|year=2014|doi=10.1177/0959354314525282|s2cid=40712136}}</ref>
Critics and supporters are largely in factual agreement regarding the characteristics of null hypothesis significance testing (NHST): While it can provide critical information, it is ''inadequate as the sole tool for statistical analysis''. ''Successfully rejecting the null hypothesis may offer no support for the research hypothesis.'' The continuing controversy concerns the selection of the best statistical practices for the near-term future given the existing practices. However, adequate research design can minimize this issue. Critics would prefer to ban NHST completely, forcing a complete departure from those practices,<ref>{{cite journal |last1=Hunter |first1=John E. |title=Needed: A Ban on the Significance Test |journal=Psychological Science |date=January 1997 |volume=8 |issue=1 |pages=3–7 |doi=10.1111/j.1467-9280.1997.tb00534.x|s2cid=145422959 }}</ref> while supporters suggest a less absolute change.{{citation needed|date=December 2015}}
| |||