Critical Issue: Using Technology to Improve Student Achievement

ICT Schools Rubric: Integrating ICT into School Curriculum Click to enter

CathEdNet: Catholic Education Network Click to enter

Technology to Support Assessment Click to enter
Power Point: Issues Introduced

This Critical Issue was adapted from a manuscript written by Margaret Honey, director of the Center for Children and Technology, Katherine McMillan Culp, assistant director for research at the Center for Children and Technology, and Robert Spielvogel, senior scientist at the Center for Children and Technology. The Center for Children and Technology is a division of the Educational Development Corporation.

Development and production of this Critical Issue were supported in part by the North Central Regional Technology in Education Consortium NCrtec

Issues: : Since educators first began to use computers in the classroom, researchers have tried to evaluate whether the use of educational technology has a significant and reliable impact on student achievement. Searching for an answer, researchers have realised that technology cannot be treated as a single independent variable, and that student achievement is gauged not only by how well students perform on standardised tests but also by students' ability to use higher-order thinking skills (such as thinking critically, analysing, making inferences, and solving problems).

Judging the impact of any particular technology requires an understanding of how it is used in the classroom and what learning goals are held by the educators involved, knowledge about the type of assessments that are used to evaluate improvements in student achievement, and an awareness of the complex nature of change in the school environment.

Evidence indicates that when used effectively, "technology applications can support higher-order thinking by engaging students in authentic, complex tasks within collaborative learning contexts" (Means, Blando, Olson, Middleton, Morocco, Remz & Zorfass, 1993). When educators use the accumulating knowledge regarding the circumstances under which technology supports the broad definition of student achievement, they will be able to make informed choices about what technologies will best meet the particular needs of specific schools. They also will be able to ensure that teachers, parents, students, and community members understand what role technology is playing in a school or district and how its impact is being evaluated. Finally, they will be able to justify the investments being made in technology.

Overview: Across the country, schools are developing and implementing technology plans and investing in computers and other new technologies. In particular, educators realise that computer networking offers flexible and powerful new ways to accomplish a range of goals that long have been important in schools, such as gaining access to a universe of informational resources (including digital archives), establishing contact with students and professionals in other places and cultures, and putting teachers in touch with a broader community of educators in their disciplines.

Because effective use of technology must be supported by significant investments in hardware, software, infrastructure, professional development, and support services, there is a call for evidence regarding the efficacy and cost-effectiveness of technology in K-12 schools (Panel on Educational Technology, 1997; Melmed, 1995). Schools will be held accountable for these investments. Many innovations in education have come and gone without fulfilling the promised impact on student learning. How can schools ensure that the promise that technology holds for student achievement is realised? What factors need to be in place to support the effective use of technology? What resources can school districts use to help them plan for technology that will have a positive impact on student achievement, and how can they justify that investment?

To answer these questions, educators need to look at the research on technology and student achievement and the contextual factors that affect learning goals. Rapid advances in multimedia and telecommunications technologies, combined with a growing consensus among educators regarding the need for developing educational standards for student achievement, have led to a new set of expectations for how educational technology can support meaningful, engaged learning for students. Instead of focusing merely on isolated, skills-based uses of technology (such as integrated learning systems), educational technologists are promoting the use of various technologies (ranging from word processors to modeling software to Internet-based research) that are integrated across the curriculum (Means & Olson, 1995; Panel on Educational Technology, 1997; Eisenberg & Johnson, 1996).

Researchers are now beginning to meet the more complicated research task of investigating the impact of technology use in meeting these new expectations for what students should learn. They are examining students' ability to understand complex phenomena, analyse and synthesise multiple sources of information, and build representations of their own knowledge. This model of integrated technology-supported learning emphasises the ability to access, interpret, and synthesise information instead of rote memorisation and the acquisition of isolated skills.

Central to this change in expectations for student learning has been an acknowledgement of the complexity of three key factors that must be considered in evaluating the impact of technology on student achievement:

The term technology refers not to simply one type of technology but to a wide range of electronic materials and methods for learning. It can apply to the use of computers in education, but it also can apply to video production and distance learning classes. Each type of technology has different uses and fulfills different learning goals. Assessing the effect of technology on student achievement is a complex process. Changes in the classroom correlate with changes in other educational factors as well.

Different Types of Technology: In addressing the first factor, educators become aware that many different types of technology can be used to support and enhance learning. Various technologies deliver different kinds of content and serve different purposes in the classroom. For example, word processing and e-mail promote communication skills; database and spreadsheet programs promote organisational skills; modeling software promotes the understanding of science and math concepts. It is important to consider how these electronic technologies differ and what characteristics make them important as vehicles for education (Becker, 1994). Technologies available in classrooms today range from simple tool-based applications (such as word processors) to online repositories of scientific data and primary historical documents, to closed-circuit television channels and two-way distance learning classrooms. Each one is likely to play a different role in students’ learning. Rather than trying to describe the impact of all technologies, as if they were the same, researchers need to think about what kind of technologies are being used in the classroom and for what purposes.

Some researchers define technology use on the basis of its application--how it is used for learning. Means (1994), for example, describes four major functions of technology used to support learning:

Technology can be used as a tutor (examples are drill-and-practice software, tutoring systems, instructional television, computer-assisted instruction, and intelligent computer-assisted instruction); a means to explore (examples are CD-ROM encyclopedias, simulations, hypermedia stacks, network search tools, and microcomputer-based laboratories); a tool to create, compose, store, and analyse data (examples are word processing and spreadsheet software, database management programs, graphic software, desktop publishing systems, hypermedia, network search tools, and videotape recording and editing equipment); and a means to communicate with others (examples are e-mail, interactive distance learning through satellite systems, computer and modem, and cable links).

Similarly, Bruce and Levin (1997) look at ways in which the tools, techniques, and applications of technology can support integrated, inquiry-based learning to "engage children in exploring, thinking, reading, writing, researching, inventing, problem-solving, and experiencing the world." They developed the idea of technology as media with four different focuses: media for inquiry (such as data modeling, spreadsheets, access to online databases, access to online observatories and microscopes, and hypertext), media for communication (such as word processing, e-mail, synchronous conferencing, graphics software, simulations, and tutorials), media for construction (such as robotics, computer-aided design, and control systems), and media for expression (such as interactive video, animation software, and music composition). Whichever way a school decides to define technology use, educators need to determine if the specific purpose of the technology addresses the school's goals for student learning. Only then can plans be made for purchasing equipment and materials, and for assessing how well the technology helps achieve the goals.

Assessment of Student Achievement: The second consideration is that assessing the effect of technology on student achievement is a complex issue. Most research on technology and student achievement has used traditional standardised assessments to measure changes in student performance. This research often has focused on students' knowledge of isolated facts but has paid little attention to how well students think. Much has been learned in the last 15 years about new and meaningful ways to measure what students know and how well they know it. To measure the effect of specific technologies on student achievement, assessment methods and instruments should be appropriate to the learning outcomes promoted by those technologies (Glennan & Melmed, 1996; Conte, 1997). Newer standardised tests may be appropriate if they fit in with the school's learning goals and are designed to measure the effects of technology use. In many cases, however, alternative assessment may be more suitable for meaningful research about the relationship between technology and student achievement.

Complex Nature of Change: The third factor influencing the impact of technology on student achievement is that changes in classroom technologies correlate to changes in other educational factors as well. Originally the determination of student achievement was based on traditional methods of social scientific investigation: It asked whether there was a specific, causal relationship between one thing, technology, and another, student achievement. Because schools are complex social environments, however, it is impossible to change just one thing at a time (Glennan & Melmed, 1996; Hawkins, Panush, & Spielvogel, 1996; Newman, 1990). If a new technology is introduced into a classroom, other things also change. For example, teachers’ perceptions of their students' capabilities can shift dramatically when technology is integrated into the classroom (Honey, Chang, Light, Moeller, in press); also, teachers frequently find themselves acting more as coaches and less as lecturers (Henriquez & Riconscente, 1998). Another example is that use of technology tends to foster collaboration among students, which in turn may have a positive effect on student achievement (Tinzmann, 1998). Because the technology becomes part of a complex network of changes, its impact cannot be reduced to a simple cause-and-effect model that would provide a definitive answer to how it has improved student achievement.

These three factors suggest that the relationship between technology and student achievement is a good deal more complicated now than when computers first appeared in the classroom. Technology is changing rapidly and offers a huge array of opportunities and resources; student achievement and improvements in thinking skills are difficult to measure; and schools integrating technology are changing in a multitude of ways all at once. Nevertheless, specific studies on technology and student learning demonstrate that it is possible to do research that takes into account this range of factors and to demonstrate that use of technology, integrated into the classroom context, can have a positive impact on student achievement.

The researchers' findings have implications for every school using or planning to use technology. The research on successfully developing, evaluating, studying, and implementing a wide range of technology-based educational programs suggests that the value of technology for students will not be realised unless attention is paid to several important considerations that support the effective use of technology (Chang, Henriquez, Honey, Light, Moeller, & Ross, 1998; Cradler, 1997; Frederiksen & White, 1997; Hawkins, Panush, & Spielvogel, 1996; Honey, McMillan, Tsikalas, & Light, 1996; National Foundation for the Improvement of Education, 1996; Pea & Gomez, 1992). These considerations are: specific educational goals and a vision of learning through technology, ongoing professional development, structural changes in the school day, a robust technical infrastructure and technical support, and ongoing evaluation.

The term technology refers not to simply one type of technology but to a wide range of electronic materials and methods for learning. It can apply to the use of computers in education, but it also can apply to video production and distance learning classes. Each type of technology has different uses and fulfills different learning goals.

Educational Goals and a Vision of Learning Through Technology: Before technology is purchased or teachers participate in their first professional development session, the educational goals for students should be determined. What do students need to learn, and how can technology promote those learning goals? To answer these questions, the school can convene a technology planning team comprising administrators, teachers, other instructional staff, technology coordinators, students, parents, and representatives of the community. This team first develops a clear set of goals, expectations, and criteria for student learning based on national and state standards, the student population, and community concerns. Next, it determines the types of technology that will best support efforts to meet those goals. The viewpoints of parents and community members are helpful in presenting a broader perspective of skills that students need to succeed after school. In fact, community wide involvement in determining the school's technology goals benefits the entire educational process (Panel on Educational Technology, 1997).

Rather than using technology for technology’s sake, the planning team ensures that particular educational objectives are achieved more efficiently, in more depth, or with more flexibility through technology.

Cuban (cited in Trotter, 1998) states, "The obligation is for educators, practitioners, and educational policymakers to think about what they are after. Only with clear goals can educators be intelligent about how much they want to spend for what purpose and under what conditions." If there is a clear understanding of the purpose of and type of technology used, evaluating the impact is easier and more valuable.

According to Hawkins, Panush, and Spielvogel (1996), school districts that successfully integrate technology show a clear and meaningful connection between technology and larger educational goals.

Next, the planning team develops a vision of how technology can improve teaching and learning. Team members come to consensus in answering the question How Will You Use Technology to Support Your Vision of Learning? Essential to this vision is an emphasis on meaningful, engaged learning with technology, in which students are actively involved in the learning process. Students take ownership of their learning, acting as explorers and producers; teachers function as facilitators and guides. Used effectively, technology can encourage collaborative learning, development of critical thinking skills, and problem solving (Means, Blando, Olson, Middleton, Morocco, Remz, & Zorfass, 1993; Cradler, 1994, 1996; Singh & Means, 1994). It can help learners explore the world beyond the classroom by providing access to vast resources and information, promoting scientific inquiry and discovery, and allowing students to communicate with experts. Technology used for authentic tasks can provide students with opportunities to interact with a wealth of resources, materials, and data sets, and to perform challenging tasks similar to those in careers and out-of-school activities.

The school's vision of learning through technology also emphasizes the importance of all students having equitable access and use of technology. Too often, students who most would benefit from effective technology use--females, special-needs students, minority students, disadvantaged students, students at risk of educational failure, rural and inner-city students--are consigned to less frequent access, older equipment, and simple software applications (Gaines, Johnson, & King, 1996). All students need opportunities to use technology in meaningful, authentic tasks that develop higher-order thinking skills.

Continued Next Page