Skip to main content Accessibility help

We use cookies to distinguish you from other users and to provide you with a better experience on our websites. Close this message to accept cookies or find out how to manage your cookie settings.

Close cookie message
×
Hostname: page-component-8448b6f56d-42gr6 Total loading time: 0 Render date: 2024-04-23T05:29:55.520Z Has data issue: false hasContentIssue false

2 - Quackery in Educational Research

from Part I - Foundations

Published online by Cambridge University Press:  08 February 2019

By
Daniel H. Robinson  and
Joel R. Levin
Edited by
John Dunlosky  and
Katherine A. Rawson
John Dunlosky
Affiliation:
Kent State University, Ohio
Katherine A. Rawson
Affiliation:
Kent State University, Ohio
Get access

Summary

The past thirty years have seen an increase in the tendency for educational researchers to base recommendations for practice on non-experimental research. If educational research is to be taken seriously as a science, we need to do a better job of curbing such quackery.
Type
Chapter
Information
The Cambridge Handbook of Cognition and Education , pp. 35 - 48
Publisher: Cambridge University Press
Print publication year: 2019

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Baeder, J. (2011). The “90/90/90 Schools” myth. Education Week. May 30, 2017. http://blogs.edweek.org/edweek/on_performance/2011/05/909090_schools_revisited.htmlGoogle Scholar
Barton, E. E., Reichow, B., Schnitz, A., Smith, I. C., & Sherlock, D. (2015). A systematic review of sensory-based treatments for children with disabilities. Research in Developmental Disabilities, 37, 64–80.Google Scholar
Berwick, D. M., Calkins, D. R., McCannon, C. J., & Hackbarth, A. D. (2006). The 100,000 lives campaign: Setting a goal and a deadline for improving health care quality. Journal of the American Medical Association, 295, 324–327.Google Scholar
Blumenstyk, G. (2017). Quick hits. Re:Learning. July 25, 2017.Google Scholar
Cahnmann, M. (2003). The craft, practice, and possibility of poetry in educational research. Educational Researcher, 32(3), 29–36.Google Scholar
Christensen, J. (2015). Homeopathic medicine under FDA scrutiny. CNN. April 21, 2015. www.cnn.com/2015/04/20/health/homeopathic-medicine-fda/index.htmlGoogle Scholar
Clay, R. A. (2015). SMOCs: The next “great adventure.” Monitor on Psychology, 46(7), 54. https://www.apa.org/monitor/2015/07-08/moocs-smocs.aspxGoogle Scholar
Cooper, H. & Valentine, J. C. (2001). Using research to answer practical questions about homework. Educational Psychologist, 36, 143–153.Google Scholar
Cullen, F. T. & Gendreau, P. (2000). Assessing correctional rehabilitation: Policy, practice, and prospects. In Horney, J. (ed.), Criminal justice 2000: Vol. 3. Policies, processes, and decisions of the criminal justice system (pp. 109–175). Washington, DC: National Institute of Justice, US Department of Justice.Google Scholar
Davies, P. (1999). What is evidence-based education? British Journal of Educational Studies, 47, 108–121.Google Scholar
The Evidence-Based Medicine Working Group. (1992). Evidence-based medicine: A new approach to teaching the practice of medicine. Journal of the American Medical Association, 268, 2420–2425.Google Scholar
Finn, J. D., Gerber, S. B., Achilles, C. M., & Boyd-Zaharias, J. (2001). The enduring effects of small classes. Teachers College Record, 103, 45–83.Google Scholar
Freyer, F. J. (2017). Naturopaths get their own licensing board in Mass. Boston Globe. www.bostonglobe.com/metro/2017/01/11/naturopaths-get-their-own-licensingboard/Lk12PKB7jAYN1z8alxTw9K/story.html?et_rid=436855471&s_campaign=fastforward:newsletter.Google Scholar
Gilgun, J. F. (2005). The four consequences of evidence-based practice in social work. Research on Social Work Practice, 15, 52–61.CrossRefGoogle Scholar
Grim, T. (2008). A possible role of social activity to explain differences in publication output among ecologists. Oikos, 117, 484–487.CrossRefGoogle Scholar
Hughes, S., Pennington, J. L., & Makris, S. (2012). Translating autoethnography across the AERA standards: Toward understanding autoethnographic scholarship as empirical research. Educational Researcher, 41, 209–219.Google Scholar
Kalenkoski, C. M. & Hamrick, K. S. (2013). How does time poverty affect behavior? A look at eating and physical activity. Applied Economic Perspectives and Policy, 35, 89–105.Google Scholar
Kirschner, P. A., & de Bruyckere, P. (2017). The myths of the digital native and multitasker. Teaching and Teacher Education, 67, 135–142.Google Scholar
Levin, J. R. (1994). Crafting educational intervention research that’s both credible and creditable. Educational Psychology Review, 6, 231–243.CrossRefGoogle Scholar
Levin, J. R. (2004). Random thoughts on the (in)credibility of educational-psychological intervention research. Educational Psychologist, 39, 173–184.Google Scholar
Levin, J. R. (2011). Educational research, for better or verse. Educational Psychology Review, 23, 297.Google Scholar
Lilienfeld, S. O., Marshall, J., Todd, J. T., & Shane, H. C. (2014). The persistence of fad interventions in the face of negative scientific evidence: Facilitated communication for autism as a case example. Evidence-Based Communication Assessment and Intervention, 8, 62–101. http://dx.doi.org/10.1080/17489539.2014.976332.Google Scholar
Macdonald, K., Germine, L., Anderson, A., Christodoulou, J., & McGrath, L. M. (2017). Dispelling the myth: Training in education or neuroscience decreases but does not eliminate beliefs in neuromyths. Frontiers in Psychology. https://doi.org/10.3389/fpsyg.2017.01314Google Scholar
MacKenzie, D. L. (2001). Evidence-based corrections: Identifying what works. Crime and Delinquency, 46, 457–471.CrossRefGoogle Scholar
MacKenzie, D. L. (2006). What works in corrections: Reducing the criminal activities of offenders and delinquents. New York: Cambridge University Press.Google Scholar
Makel, M. C. & Plucker, J. A. (2014). Facts are more important than novelty: Replication in the education sciences. Educational Researcher, 43, 304–316.Google Scholar
McAfee, D. G. (2017). England will ban prescriptions for homeopathy and other “low value” treatments. Patheos. July 23, 2017. www.patheos.com/blogs/friendlyatheist/2017/07/23/england-will-ban-prescriptions-for-homeopathy-and-other-low-value-treatments/?utm_medium=email&utm_source=BRSS&utm_campaign=Nonreligious&utm_content=361 on July 24, 2017.Google Scholar
McCoy, T. (2014). Half of Dr. Oz’s medical advice is baseless or wrong, study says. Washington Post, December 19, 2014.Google Scholar
Moher, D., et al. (2017). Stop this waste of people, animals and money. Nature, 549, 23–25. https://doi.org/10.1038/549023aGoogle Scholar
Mosteller, F. (1995). The Tennessee study of class size in the early school grades. The Future of Children, 5(2), 114–127.CrossRefGoogle ScholarPubMed
Mosteller, F. & Boruch, R. (eds.). (2002). Evidence matters: Randomized trials in education research. Washington, DC: Brookings Institution Press.Google Scholar
Murphy, H. (2017). The ‘Gaydar’ machine causes an uproar. New York Times. September 10, 2017.Google Scholar
Open Science Collaboration. (2015). Estimating the reproducibility of psychological science. Science, 349(6251), aac4716. https://doi.org/10.1126/science.aac4716Google Scholar
Pashler, H., McDaniel, M., Rohrer, D., & Bjork, R. (2008). Learning styles concepts and evidence. Psychological Science in the Public Interest, 9, 105–119. https://doi.org/10.1111/j.1539–6053.2009.01038.xCrossRefGoogle ScholarPubMed
Pennebaker, J. W., Gosling, S. D., & Ferrell, J. D. (2013). Daily online testing in large classes: Boosting college performance while reducing achievement gaps. PLoS One, 8(11). https://doi.org/10.1371/journal.pone.0079774Google Scholar
Pfeffer, J. & Sutton, R. J. (2006). Evidence-based management. Harvard Business Review, 84 (1), 62–74.Google Scholar
Phifer, T. (2017). Data shapes student success. The Magazine. http://magazine.colostate.edu/issues/spring-2017/data-shapes-student-success/ on June 19, 2017.Google Scholar
Purtell, K. M. & Gershoff, E. T. (2014). Fast food consumption and academic growth in late childhood. Clinical Pediatrics, 54, 871–877. https://doi.org/10.1177/0009922814561742.CrossRefGoogle ScholarPubMed
Ransford-Kaldon, C., Flynt, E. S., Ross, C. L., Franceschini, L., Zoblotsky, T., Huang, Y., & Gallagher, B. (2010). Implementation of effective intervention: An empirical study to evaluate the efficacy of Fountas & Pinnell’s Leveled Literacy Intervention system (LLI). Memphis, TN: Center for Research in Educational Policy, University of Memphis. https://eric.ed.gov/?&id=ED544374Google Scholar
Ravitch, D. (2011). Waiting for a school miracle. New York Times, May 31, 2011.Google Scholar
Reinhart, A. L., Haring, S. H., Levin, J. R., Patall, E. A., & Robinson, D. H. (2013). Models of not-so-good behavior: Yet another way to squeeze causality and recommendations for practice out of correlational data. Journal of Educational Psychology, 105, 241–247.Google Scholar
Ritter, M. (2014). Researchers withdraw papers about stem cells due to “extensive” errors. Wisconsin State Journal, July 3, 2014, A7.Google Scholar
Ritterbush, R. (2017). UT introduces Project 2021, new education innovation project. Daily Texan. March 31, 2017. www.dailytexanonline.com/2017/03/31/ut-introduces-project-2021-new-education-innovation-projectGoogle Scholar
Roberts, A. R. & Yeager, K. R. (eds.). (2004). Evidence-based practice manual: Research and outcome measures in health and human services. New York: Oxford University Press.Google Scholar
Robinson, D. H. (2017). An example of recommendations for practice gone bad. Manuscript under review.Google Scholar
Robinson, D. H. & Levin, J. R. (2010). The not-so-quiet revolution: Cautionary comments on the rejection of hypothesis testing in favor of a “causal” modeling alternative. Journal of Modern Applied Statistical Methods, 9, 332–339.Google Scholar
Robinson, D. H., Levin, J. R., Schraw, G., Patall, E. R., & Hunt, E. (2013). On going (way) beyond one’s data: A proposal to restrict recommendations for practice in primary educational research journals. Educational Psychology Review, 25, 291–302.CrossRefGoogle Scholar
Robinson, D. H., Levin, J. R., Thomas, G. D., Pituch, K. A., & Vaughn, S. R. (2007). The incidence of “causal” statements in teaching and learning research journals. American Educational Research Journal, 44, 400–413.Google Scholar
Rychetnik, L., Hawe, P., Waters, E., Barratt, A., & Frommer, M. (2004). A glossary for evidence based public health. Journal of Epidemiology and Community Health, 58, 538–545.Google Scholar
Samhita, L. & Gross, H. J. (2013). The “Clever Hans Phenomenon” revisited. Communicative & Integrative Biology, 6(6), e27122. www.ncbi.nlm.nih.gov/pmc/articles/PMC3921203/Google Scholar
Schmid, R. E. (2011). Researchers retract paper on gene groups, longevity. Seattle Times. July 22, 2011.Google Scholar
Shaw, S. M., Walls, S. M., Dacy, B. S., Levin, J. R., & Robinson, D. H. (2010). A follow-up note on prescriptive statements in nonintervention research studies. Journal of Educational Psychology, 102, 982–988.Google Scholar
Sherman, L. J. (1998). Evidence-based policing. Washington, DC: Police Foundation.Google Scholar
Straumsheim, C. (2013). Don’t call it a MOOC. Inside Higher Ed. August 27, 2013. www.insidehighered.com/news/2013/08/27/ut-austin-psychology-professors-prepare-worlds-first-synchronous-massive-onlineGoogle Scholar
Teras, H., Myllyla, M., & Teras, M. (2011). Empowering teachers to meet their digital native learners. Paper presented at the 2011 International E-Learning Conference, Bangkok, Thailand.Google Scholar
Wade, N. (2012). University suspects fraud by a researcher who studied red wine. New York Times. January 12, 2012.Google Scholar
Welsh, B. C., & Farrington, D. P. (eds.). (2006). Preventing crime: What works with children, offenders, victims, and places. New York: Springer.CrossRefGoogle Scholar
Whitehurst, G. J., Epstein, J. N., Angell, A. L., Payne, A. C., Crone, D. A., & Fischel, J. E. (1994). Outcomes of an emergent literacy intervention in Head Start. Journal of Educational Psychology, 86, 542–555.Google Scholar
Wolf, F. M. (2000). Lessons to be learned from evidence-based medicine: Practice and promise of evidence-based medicine and evidence-based education. Medical Teacher, 22, 251–259.CrossRefGoogle Scholar

Save book to Kindle

To save this book to your Kindle, first ensure coreplatform@cambridge.org is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about saving to your Kindle.

Note you can select to save to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be saved to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

Find out more about the Kindle Personal Document Service.

Available formats
×

Save book to Dropbox

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Dropbox.

Available formats
×

Save book to Google Drive

To save content items to your account, please confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your account. Find out more about saving content to Google Drive.

Available formats
×