Considering Quantitative and Qualitative Issues Together
2013, Qualitative Research in Psychology
https://doi.org/10.1080/14780887.2012.743202Abstract
At the level of methods, quantitative researchers criticize qualitative researchers for not performing null hypothesis significance tests. However, I review literature showing that these are invalid, and so it is not particularly meaningful to criticize a lack of performance of something that should not be performed anyhow. More generally, I suggest that there are strengths and limitations to quantitative and qualitative methods. The more interesting question pertains to goals, and quantitative and qualitative researchers differ there, too. I briefly mention some limitations of the usual quantitative goal, which is to find causal mechanisms. But a typical qualitative goal of describing personal or subjective experience also has limitations. Finally, I compare both quantitative and qualitative social science research to physics and show that each has similarities and differences. There is much for quantitative and qualitative social science researchers to gain, not only by considering each other's methods and goals carefully but also by going outside social science and considering the accomplishments in nonsocial sciences.
References (33)
- Bakan, D 1966, 'The test of significance in psychological research', Psychological Bulletin, vol. 66, pp. 423-37.
- Beauchamp, TL 1974, Philosophical problems of causation, Dickenson Publishing Company, Encino, CA.
- Berkowitz, L 1989, 'Frustration-aggression hypothesis: examination and reformulation', Psychological Bulletin, vol. 106, pp. 59-73.
- Carver, RP 1978, 'The case against statistical significance testing', Harvard Educational Review, vol. 48, pp. 378-99.
- Carver, RP 1993, 'The case against statistical significance testing, revisited', The Journal of Experimental Education, vol. 61, pp. 287-92.
- Cohen, J 1994, 'The earth is round (p < .05)', American Psychologist, vol. 49, pp. 997-1003.
- Einhorn, HJ & Hogarth, RM 1978, 'Confidence in judgment: persistence of the illusion of validity', Psychological Review, vol. 85, pp. 395-416.
- Ekman, P & Friesen, WV 1971, 'Constants across cultures in the face and emotion', Journal of Personality and Social Psychology, vol. 17, pp. 124-9.
- Fishbein, M & Ajzen, I 2010, Predicting and changing behavior: the reasoned action approach, Psychology Press, New York.
- Gallistel, CR 2009, 'The importance of proving the null', Psychological Review, vol. 116, pp. 439-53.
- Hassandra, M, Vlachopoulos, SP, Kosmidou, E, Hatzigeorgiadis, A, Goudas, M & Theodorakis, Y 2011, 'Predicting students' intention to smoke by theory of planned behavior variables and parental influences across school grade levels', Psychology & Health, vol. 26, pp. 1241-58.
- Iverson, GJ, Lee, MD & Wagenmakers, E-J 2009, 'P-rep misestimates the probability of replication', Psychonomic Bulletin & Review, vol. 16, pp. 424-9.
- Iverson, GJ, Lee, MD, Zhang, S & Wagenmakers, E-J 2009, 'P-rep: an agony in five fits', Journal of Mathematical Psychology, vol. 53, pp. 195-202.
- Killeen, PR 2005a, 'An alternative to null-hypothesis significance tests', Psychological Science, vol. 16, pp. 345-52.
- ---2005b, 'Replicability, confidence, and priors', Psychological Science, vol. 16, pp. 1009-12.
- Killeen, PR 2006, 'The problem with Bayes', Psychological Science, vol. 17, pp. 643-4.
- Krueger, J 2001, 'Null hypothesis significance testing: on the survival of a flawed method', American Psychologist, vol. 56, pp. 16-26.
- Lambdin, C 2012, 'Significance tests as sorcery: science is empirical-significance tests are not', Theory & Psychology, vol. 22, pp. 67-90.
- Lederman, L 1993, The god particle: if the universe is the answer, what is the question?, Houghton Mifflin Company, New York.
- Maxwell, JA 2005, Qualitative research design: an interactive approach, Sage, Thousand Oaks, CA.
- Pearl, J 2000, Causality: models, reasoning, and inference, Cambridge University Press, Cambridge.
- Rozeboom, WW 1960, 'The fallacy of the null-hypothesis significance test', Psychological Bulletin, vol. 57, pp. 416-28.
- Rozeboom, WW 1997, 'Good science is abductive, not hypothetico-deductive', in L Harlow, SA Mulaik & JH Steiger (eds.), What if there were no significance tests?, Erlbaum, Mahwah, NJ, pp. 335-91.
- Salmon, WC 1998, Causality and explanation, Oxford University Press, Oxford.
- Sanabria, F & Killeen, PR 2007, 'Better statistics for better decisions: rejecting null hypotheses statistical tests in favor of replication statistics', Psychology in the Schools, vol. 44, pp. 471-81.
- Schmidt, FL 1996, 'Statistical significance testing and cumulative knowledge in psychology: implications for the training of researchers', Psychological Methods, vol. 1, pp. 115-29.
- Schmidt, FL & Hunter, JE 1997, 'Eight objections to the discontinuation of significance testing in the analysis of research data', in L Harlow, SA Mulaik & JH Steiger (eds.), What if there were no significance tests?, Erlbaum, Mahwah, NJ, pp. 37-64.
- Sosa, E 1975, Causation and conditionals, Oxford University Press, Oxford.
- Spearman, C 1904, 'The proof and measurement of association between two things', The American Journal of Psychology, vol. 15, pp. 72-101.
- Trafimow, D 2003, 'Hypothesis testing and theory evaluation at the boundaries: surprising insights from Bayes's theorem', Psychological Review, vol. 110, pp. 526-35.
- Trafimow, D 2005, 'The ubiquitous Laplacian assumption: reply to Lee and Wagenmakers', Psychological Review, vol. 112, pp. 669-74.
- Trafimow, D 2006, 'Using epistemic ratios to evaluate hypotheses: an imprecision penalty for imprecise hypotheses', Genetic, Social, and General Psychology Monographs, vol. 132, pp. 431-62.
- Trafimow, D, MacDonald, JA, Rice, S & Clason, DL 2010, 'How often is p rep close to the true replication probability?', Psychological Methods, vol. 15, pp. 300-7.