creators_name: Chow, Siu L.
type: journalp
datestamp: 2003-05-19
lastmod: 2011-03-11 08:55:17
metadata_visibility: show
title: What statistical significance means
ispublished: pub
subjects: cog-psy
full_text_status: public
keywords: Chance, Control, Reliability, Replication, Statistical significiance
abstract: Sohn (1998) presents a good argument that neither statistical significance nor effect size is indicative of the replicability of research results. His objection to the Bayesian argument is also succinct. However, his solution of the `replicability belief' issue is problematic, and his verdict that significance tests have no role to play in empirical research is debatable. The strengths and weaknesses of Sohn's argument may be seen by explicating some of his assertions.
KEY WORDS: chance, control, reliability, replication, statistical significance.

date: 1998
date_type: published
publication: Theory & PSychology
volume: 8
number: 3
pagerange: 323-330
refereed: TRUE
referencetext: Boring, E.G. (1954). The nature and history of experimental control. American Journal of Psychology, 67, 573﷓589.
Boring, E.G. (1969). Perspective: Artifact and control. In R. Rosenthal & R.L. Rosnow (Eds.), Artifact in behavioral research (pp. 1﷓11). New York: Academic Press.
Chow, S.L. (1989). Significance tests and deduction: Reply to Folger (1989). Psychological Bulletin, 106, 161﷓165.
Chow, S.L. (1991). Rigor and logic: A response to comments on `Conceptual Rigor'. Theory & Psychology, 1, 389﷓400.
Chow, S.L. (1996). Statistical significance: Rationale, validity and utility. London: Sage.
Copi, I.M. (1982). Introduction to logic (6th ed.). New York: Macmillan.
Garner, W.R., Hake, H.W., & Eriksen, C.W. (1956). Operationalism and the concept of perception. Psychological Review, 63, 149﷓159.
Lykken, D.T. (1968). Statistical significance in psychological research. Psychological Bulletin, 70, 151﷓159.
Mayo, D.G. (1996). Error and the growth of experimental knowledge. Chicago, IL: University of Chicago Press.
Skinner, B.F. (1938). The behavior of organisms. New York: Appleton﷓Century.
Sohn, D. (1998). Statistical significance and replicability: Why the former does not presage the latter. Theory & Psychology, 8, 291﷓311.
Steering Committee of the Physicians' Health Study Research Group (1988). Preliminary report: Findings of the aspirin component of the ongoing physicians' health study. New England Journal of Medicine, 318, 262﷓264.

citation:   Chow, Dr Siu L.  (1998) What statistical significance means.  [Journal (Paginated)]     
document_url: http://cogprints.org/2961/1/Wsigmean.pdf