What Makes the Difference? A Practical Analysis of Research on the Effectiveness of Distance Education
Abstract
This article reports findings of a meta-analytical study of research on distance education. The purpose of this study was to identify factors that affect the effectiveness of distance education. The results show that although the aggregated data of available studies show no significant difference in outcomes between distance education and face-to-face education as previous research reviews suggest, there is remarkable difference across the studies. Further examination of the difference reveals that distance education programs, just like traditional education programs, vary a great deal in their outcomes, and the outcome of distance education is associated with a number of pedagogical and technological factors. This study led to some important data-driven suggestions for and about distance education.
Get full access to this article
View all access and purchase options for this article.
References
Allen M., Bourhis J., Burrell N., and Mabry E. (2002). Comparing student satisfaction with distance education to traditional classrooms in higher education: A meta-analysis. American Journal of Distance Education, 16(2), 83—97.
Arbaugh J. B. (2000). Virtual classroom versus physical classroom: An exploratory study of class discussion patterns and student learning in an asynchronous Internet-based MBA course. Journal of Management Education, 24(2), 213—233.
Bader M. B., and Roy S. (1999). Using technology to enhance relationships in interactive television classrooms. Journal of Education for Business, 74(6), 357—362.
Barkhi R., and Brozovsky J. (2000). An analysis of the dynamics of a distance course. Journal of Educational Technology Systems, 28(4), 311—325.
Bates A. W. (1995). Technology, open learning and distance education. London: Routledge.
Becker B. J. (2000). Multivariate meta-analysis. In Tinsley H.A., and Brown S. (Eds.), Handbook of applied multivariate statistics and mathematical modeling (pp. 499—525). Burlington, MA: Academic Press.
Begg C. B. (1994). Publication bias. In The handbook of research synthesis (pp. 399—409). New York: Russell Sage Foundation.
Boulet M.-M., Boudreault S., and Guerett L. (1998). Effects of a television distance education course in computer science. British Journal of Educational Technology, 29(2), 101—111.
Braun K. L., Roberts E., and Dubanoski J. (1998). Evaluating a telecourse on aging. Educational Gerontology, 24(2), 141—157.
Carl D. R., and Densmore B. (1988). Introductory accounting on Distance University Education via Television (DUET): A Comparative Evaluation. Canadian Journal of Educational Communication, 17(2), 81—94.
Carr-Chellman A. A., Dyer D., and Breman J. (2000). Burrowing through the network wires: Does distance detract from collaborative authentic learning? Journal of Distance Education, 15(1), 39—62.
Cavanaugh C. S. (2001). The effectiveness of interactive distance education technologies in K-12 learning: A meta-analysis. International Journal of Educational Telecomunications, 7, 73—88.
Cheng H.-C., Lehman J., and Armstrong P. (1991). Comparison of performance and attitude in traditional and computer conferencing classes. American Journal of Distance Education, 5(3), 51—64.
Chisholm M. A., Miller A. W., and Spruill W. J. (2000). Influence of interactive videoconferencing on the performance of pharmacy students and instructors. American Journal of Pharmaceutical Education, 64(2), 152—158.
Clark R. A., and Jones D. (2001). A comparison of traditional and online formats in a public speaking course. Communication Education, 50(2), 109—124.
Clark R. E. (1983). Reconsidering research on learning from media. Review of Educational Research, 53(4), 445—459.
Clark R. E. (1994). Media will never influence learning. Educational Technology Research & Development, 42(2), 21—29.
Clark R. E., and Salomon G. (1986). Media in teaching. In and and Wittrock M.C. (Ed.), Handbook of research on teaching (pp. 464—478). New York: MacMillan.
Collins M. (2000). Comparing Web, correspondence and lecture versions of a second-year non-major biology course. British Journal of Educational Technology, 31(1), 21—27.
Cook T. D., and Campbell D. T. (1979). Quasi-experimentation: Design & analysis issues for field settings. Boston: Houghton Mifflin.
Cooper H. (1998). Synthesizing research: A guide for literature reviews. Thousand Oaks, CA: Sage.
Cooper H., Valentine J. C., Charlton K., and Melson A. (2003). The effects of modified school calendars on student achievement and on school and community attitudes. Review of Educational Research, 73(1), 1—52.
Day T. M., Raven M. R., and Newman M. E. (1998). The effects of World Wide Web instruction and traditional instruction and learning styles on achievement and changes in student attitudes in a Technical Writing in Agricommunication course. Journal of Agricultural Education, 39(4), 65—75.
Dellana S. A., Collins W. H., and West D. (2000). On-line education in a management science course–Effectiveness and performance factors. Journal of Education for Business, 76(1), 43—47.
Dickersin K. (1990). The existence of publication bias and risk factors for its occurrence. Journal of the American Medical Association, 263(10), 1385—1389.
Dubin R., and Hedley R. (1969). The medium may be related to the message. Eugene: University of Oregon Press.
Frear V., and Hirschbuhl J. J. (1999). Does interactive multimedia promote achievement and higher level thinking skills for today's science students? British Journal of Educational Technology, 30(4), 323—329.
Furst-Bowe J. A. (1997). Comparison of student reactions in traditional and videoconferencing courses in training and development. International Journal of Instructional Media, 24(3), 197—205.
Glaser B. G. (1992). Basics of grounded theory analysis: Emergence vs. forcing. Mill Valley, CA: Sociology Press.
Glaser B. G., and Strauss A. L. (1967). The discovery of grounded theory: Strategies for qualitative research. Chicago: Aldine.
Glass V. G. (1976). Primary, secondary, and meta-analysis research. Educational Researcher, 5(10), 3—8.
Glass V. G., McGaw B., and Smith M. L. (1981). Meta-analysis in social research. Beverly Hills, CA: Sage.
Gunawardena C. N., and McIsaac M. S. (2004). Distance education. In and and Jonassen D.H. (Ed.), Handbook of research for educational communications and technology (2nd ed., pp. 355—396). Mahwah, NJ: Erlbaum.
Hacker R., and Sova B. (1998). Initial teacher education: A study of the efficacy of computer mediated courseware delivery in a partnership context. British Journal of Educational Technology, 29(4), 333—341.
Head J. T., Lockee B. B., and Oliver K. M. (2002). Method, media, and mode: Clarifying the discussion of distance education effectiveness. Quarterly Review of Distance Education, 3(3), 261—268.
Holman L. (2000). A comparison of computer-assisted instruction and classroom bibliographic instruction. Reference & User Services Quarterly, 40(1), 53—60.
Institute for Higher Education Policy. (1999). What's the difference? A review of contemporary research on the effectiveness of distance learning in higher education. Washington DC: Author.
Institute for Higher Education Policy. (2000). Quality online: Benchmark for success in Internet-based distance education. Washington, DC: National Education Association.
ISI Research Soft. (2001). EndNote (version 5.0) [Computer software]. Berkeley, CA: Author.
Jackman D. H., and Swan M. K. (2000). Comparing the success of students enrolled in distance education courses vs. face-to-face classrooms. Journal of Technology Studies, 26(1), 58—63.
Johnson M. (2002). Introductory biology “online”: Assessing outcomes of two student populations. Journal of College Science Teaching, 31(5), 312—317.
Joy E. H., and Garcia F. E. (2000). Measuring learning effectiveness: A new look at no-significant-difference findings. Journal of Asynchronous Learning Network, 4(1), 33—39.
King P., and Hildreth D. (2001). Internet courses: Are they worth the effort? Journal of College Science Teaching, 31(2), 112—115.
Kirman J. M., and Goldberg J. (1982). Distance education: Simultaneous one-way television and group telephone conferencing for satellite map instruction. Alberta Journal of Educational Research, 28(1), 51—57.
Koumi J. (1994). Media comparison and deployment: A practitioner's view. British Journal of Educational Technology, 25, 41—57.
Lant K. M. (2002). Flesh and bone: Information literacy, teaching and the connected classroom. Paper presented at the Annual Mid-south Instructional Technology Conference. (ERIC Document Reproduction Service No. ED464624)
Leasure A. R., Davis L., and Thievon S. L. (2000). Comparison of student outcomes and preferences in a traditional vs. World Wide Web-based baccalaureate nursing research course. Journal of Nursing Education, 39(4), 149—154.
Levin S. R., Levin J. A., and Chandler M. (2001, April). Social and organizational factors in creating and maintaining effective online learning environments. Paper presented at the annual meeting of the American Educational Research Association, Seattle, WA.
Lia-Hoagberg B., Vellenga B., and Miller M. (1999). A partnership model of distance education: Students’ perceptions of connectedness and professionalization. Journal of Professional Nursing, 15(2), 116—122.
Lipsey M. W. (1994). Identifying potentially interesting variables and analysis opportunities. In Cooper H., and Hedges L.V. (Eds.). The handbook of research synthesis (pp. 111—123). New York: Russell Sage Foundation.
Lock J. V. (2002). Laying the Groundwork for the Development of Learning Communities within Online Courses. Quarterly Review of Distance Education, 3(4), 395—408.
Lockee B. B., Burton J. K., and Cross L. H. (1999). No comparison: Distance education finds a new use for “no significant difference.” Educational Technology Research and Development, 7(3), 33—42.
Machtmes K., and Asher J. W. (2000). A meta-analysis of the effectiveness of telecourses in distance education. American Journal of Distance Education, 14(1), 27—46.
Magiera F. T. (1994). Teaching managerial finance through compressed video: An alternative for distance education. Journal of Education for Business, 69(5), 273—277.
McFall J. P., and Freddolino P. P. (2000). Quality and comparability in distance field education: Lessons learned from comparing three program sites. Journal of Social Work Education, 36(2), 293—307.
McGreal R. (1994). Comparison of the attitudes of learners taking audiographic teleconferencing courses in secondary schools in Northern Ontario. Interpersonal Computing and Technology Journal, 2(4), 11—23.
McIsaac M. S., and Gunawardena C. N. (1996). Distance education. In and and Jonassen D.H. (Ed.), Handbook of research for educational communications and technology: A project of the Association for Educational Communications and Technology (pp. 403—437). New York: Simon & Schuster Macmillan.
Miller G., and Richer C. L. (2001). Levels of cognition reached in agricultural distance education courses in comparison to on-campus courses and to faculty perceptions concerning an appropriate level. Journal of Agricultural Education, 42(1), 20—27.
Miller J. W., McKenna M. C., and Ramsey P. (1993). An evaluation of student content learning and affective perceptions of a two-way interactive video learning experience. Educational Technology, 33(6), 51—55.
Moore M. G., and Thompson M. M. (1996). The effects of distance learning (Rev. ed.; Research Monograph No. 15). University Park: Pennsylvania State University, American Center for the Study of Distance Education.
Murphy T. H. (2000). An evaluation of a distance education course design for general soils. Journal of Agricultural Education, 41(3), 103—113.
National Center for Education Statistics. (1999). Distance education at postsecondary education institutions, 1997–98 (Statistical analysis report, NCES No. 2000–013). Washington, DC: U.S. Department of Education, National Center for Education Statistics. Retrieved May 23, 2005, from http://nces.ed.gov/pubs2000/2000013.pdf
National Center for Education Statistics. (2003). Distance education at degree-granting postsecondary institutions: 2000–2001 (NCES No. 2003–017). Washington, DC: U.S. Department of Education, National Center for Education Statistics.
Nesler M. S., Hanner M. B., and Melburg V. (2001). Professional socialization of baccalaureate nursing students: Can students in distance nursing programs become socialized? Journal of Nursing Education, 40(7), 293—302.
Phelps R. H., Wells R. A., Ashworth R. L. Jr., and Heidi A. H. (1991). Effectiveness and costs of distance education using computer-mediated communication. American Journal of Distance Education, 5(3), 7—19.
Phillips M. R., and Peters M. J. (1999). Targeting rural students with distance learning courses: A comparative study of determinant attributes and satisfaction levels. Journal of Education for Business, 74(6), 351—356.
Redding T. R., and Rotzien J. (2001). Comparative analysis of online learning versus classroom learning. Journal of Interactive Instruction Development, 13(4), 3—12.
Roblyer M. D. (1999). Is choice important in distance learning? A study of student motives for taking Internet-based courses at the high school and community college levels. Journal of Research on Computing in Education, 32(1), 157—171.
Rosenthal R. (1991). Meta-analytic procedures for social research. Newbury Park, CA: Sage.
Russell T. L. (1999). The no significant difference phenomenon. Chapel Hill: North Carolina State University, Office of Instructional Telecommunications.
Ryan M., Carlton K. H., and Ali N. S. (1999). Evaluation of traditional classroom teaching methods versus course delivery via the World Wide Web. Journal of Nursing Education, 38(5), 272–277.
Ryan W. F. (1996). The effectiveness of traditional vs. audiographics delivery in senior high advanced mathematics courses. Journal of Distance Education, 11(2), 45—55.
Schlosser C. A., and Anderson M. L. (1994). Distance education: Review of the literature. Ames, IA: Iowa Distance Education Alliance. (ERIC Document Reproduction Service No. ED382159)
Schoenfeld-Tacher R., McConnell S., and Gra M. (2001). Do no harm–A comparison of the effects of on-line vs. traditional delivery media on a science course. Journal of Science Education and Technology, 10(3), 257—265.
Schramm W. (1962). Learning from instructional television. Review of Educational Research, 32(2), 156—167.
Schwab J. H. (1983). The practical 4: Something for curriculum professors to do. Curriculum Inquiry, 13(3), 239—265.
Shadish W. R., and Haddock C. K. (1994). Combining estimates of effect size. In The handbook of research synthesis (pp. 261—284). New York: Russell Sage Foundation.
Shale D. (1990). Toward a reconceptualization of distance education. In and and Moore M.G. (Ed.), Contemporary issues in American distance education (pp. 333—343). Oxford, UK: Pergamon Press.
Simpson H., Pugh H. L., and Parchman S. W. (1991). An experimental two-way video tele-training system: Design, development and evaluation. Distance Education, 12(2), 209—231.
Smeaton A. F., and Keogh G. (1999). An analysis of the use of virtual delivery of undergraduate lectures. Computers & Education, 32(1), 83—94.
Smith S. B., Smith S. J., and Boone R. (2000). Increasing access to teacher preparation: The effectiveness of traditional instructional methods in an online learning environment. Journal of Special Education Technology, 15(2), 37—46.
Sonner B. S. (1999). Success in the capstone business course–Assessing the effectiveness of distance learning. Journal of Education for Business, 74(4), 243—247.
Sowinski K. M., Scott S. A., and Carlstedt B. C. (2000). An Internet training module for traditional and nontraditional doctor of pharmacy students: Content and evaluation. American Journal of Pharmaceutical Education, 64(1), 15—19.
Spooner F., Jordan L., Algozzine B., and Spo M. (1999). Student ratings of instruction in distance learning and on-campus classes. Journal of Educational Research, 92(3), 132—140.
Steyn M. M. d. V., Alexander P. M., and Rohm D. (1996). CAL for first year analytical chemistry by distance education. Computers & Education, 27(2), 95—101.
Stickell D. W. (1963). A critical review of the methodology and results of research comparing televised and face-to-face instruction. University Park: Pennsylvania State University.
Stock W. A. (1994). Systematic coding for research synthesis. In Cooper H., and Hedges L.V. (Eds.), The handbook of research synthesis (pp. 125—138). New York: Russell Sage Foundation.
Sugrue B., Rietz T., and Hansen S. (1999). Distance learning: Relationships among class size, instructor location, student perceptions, and performance. Performance Improvement Quarterly, 12(3), 44—57.
Summers M., Anderson J. L., Lines A. R., Gelder B. C., and Dean R. S. (1996). The camera adds more than pounds: Gender differences in course satisfaction for campus and distance learning students. Journal of Research and Development in Education, 29(4), 212—219.
Thyer B. A., Artelt T., and Markward M. (1998). Evaluating distance learning in social work education: A replication study. Journal of Social Work Education, 34(2), 291—295.
Twigg C. A. (2001). Innovations in online learning: Moving beyond no significant difference. Taylor, NY: Pew Learning and Technology.
United States General Accounting Office. (2002). Growth in distance education programs and implications for federal education policy: Statement of Cornelia M. Ashby, Director. Washington, DC: Author.
Wagner N., and Craft E. H. (1988). Instructional television fixed service in Arizona. American Journal of Distance Education, 2(1), 76—80.
Wang A. Y., and Newlin M. H. (2000). Characteristics of students who enroll and succeed in psychology Web-based classes. Journal of Educational Psychology, 92(1), 137—143.
Wilkinson K. L., and Hemby K. V. (2000). An examination of perceptions of the use of virtual conferences in organizations: The Organizational Systems Research Association (OSRA) and the Association for Business Communication (ABC) Members. Information Technology, Learning, and Performance Journal, 18(2), 13—23.
Wisher R. A., and Curnow C. K. (1999). Perceptions and effects of image transmissions during Internet-based training. American Journal of Distance Education, 13(3), 37—51.
Cite article
Cite article
Cite article
OR
Download to reference manager
If you have citation software installed, you can download article citation data to the citation manager of your choice
Information, rights and permissions
Information
Published In
Article first published: August 2005
Issue published: August 2005
Authors
Metrics and citations
Metrics
Journals metrics
This article was published in Teachers College Record: The Voice of Scholarship in Education.
View All Journal MetricsArticle usage*
Total views and downloads: 293
*Article usage tracking started in December 2016
Articles citing this one
Receive email alerts when this article is cited
Web of Science: 0
Crossref: 253
- Designing Effective Hybrid Course Curriculum: A Design Science Approach to Gamification and Student Outcomes Validation
- Assessing the Efficacy of Online Learning in Disparate Business Subjects: Lessons from Distributed Practice and Social Learning Theory
- Effectiveness of synchronous and asynchronous online learning: a meta-analysis
- Competence-Based Curriculum and E-Learning in Higher Education
- Assessing blended and online-only delivery formats for teacher professional development in Kenya
- Notes et taux de décrochage inébranlables durant la Covid-19 en enseignement universitaire à distance
- Students engagement in distant learning: How much influence do the critical factors have for success in academic performance?
- Proceedings of the 6th International Conference on Digital Technology in Education
- Preservice elementary teachers’ mathematical achievement and attitudes: A study of blended learning
- International Encyclopedia of Education(Fourth Edition)
- View More
Figures and tables
Figures & Media
Tables
View Options
Access options
If you have access to journal content via a personal subscription, university, library, employer or society, select from the options below:
I am signed in as:
View my profileSign out
I can access personal subscriptions, purchases, paired institutional access and free tools such as favourite journals, email alerts and saved searches.
loading institutional access options
Alternatively, view purchase options below:
Purchase 24 hour online access to view and download content.
Access journal content via a DeepDyve subscription or find out more about this option.
