|
||
Five Years of Online Learning
Research in New Zealand: A Review
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
Qualitative Research (33) |
|||
|
Case Studies (12) |
|||
|
Trewern & Fry (2002) |
Capner (2001) |
McSporran & King (2002) |
Halliday & Girven (1999) |
|
Johnson et al (2001) |
McSporran & King (2001) |
Maclaren & Shukla (1999) |
Panko (2002) |
|
Dewstow et al (2001) |
Paynter (2002a) |
Paynter (2002b) |
Sheridan et al (2002) |
|
Discussion Papers (12) |
|||
|
Brimblecombe (2000) |
French (2000) |
Haynes (2002) |
Marshall & Mitchell (2002) |
|
Moore & Nichols (2002) |
Northover (2002) |
Walker & Gunn (2002) |
Williamson & DeSouza (2002) |
|
Wolfe (2001a) |
Young & McSporran (2002a) |
|
Kinshuk & Su (2002) |
|
Action Research (1) |
|||
|
|
|
||
|
Ethnographical Research (1) |
|||
|
Brown, Riley & Santos (1999) |
|
||
|
Implementations (5) |
|||
|
Manford & Crawford (2002) |
Williamson & Nodder (2002) |
Donald et al (2002) |
Gunn et al (2002) |
|
Johnson (2002) |
|
||
|
Experience Surveys (2) |
|||
|
Brown (1999) |
Clayton (2002) |
|
|
|
Literature reviews (3) |
|||
|
|
Cooper (2002) |
Hardie(2002) |
|
Quantitative
(2)
|
|||
|
Young & Mc Sporran (2002) |
Young et al (2000) |
|
|
Mixed
Method (triangulated)
(2)
|
|||
|
Wolfe (2001b) |
Newby-Fraser (2002) |
|
|
Table 1: References by Subgroup within Type
It was discovered that subgroups do not always sit neatly side-by-side. They often overlap or have "fuzzy" boundaries, so that categorisation at times has been arbitrary. This is demonstrated most clearly by the subgroup of 'discussion paper'. Of the twelve so categorised, seven of them had many of the elements of a literature review, yet they were comprehensive only up to a point, which was to bear out their stated position or argument (see, for example, Moore & Nichols (2002) on Learning Objects). Another five had their basis in the writers' experiences, having elements of case study about them, perhaps along the lines of Stake's collective definition (ibid, p.437), yet the prime focus was not on case studies as such, rather that the case study element was there to back up the writers' point of view (see, for example, Young & McSporran (2002a) where they use information from a number of different computer classes).
In just these few examples, it can be seen how elements of literature review, case study and opinion piece can be found in discussion papers, and judgement is required for subgroup classification.
Creswell (2003) describes four distinct knowledge claims or assumptions made by the researcher prior to research beginning. These are postpositivism, constructivism, advocacy/participatory and pragmatism. It is useful to identify the assumptions that researchers are making about their research to gain an understanding of the research being undertaken in this area. According to Creswell (2003) the postpositivist will look at the causes to explain an effect or outcome. The research will be divided into small discrete sections. Of the two quantitative research papers, one demonstrates postpositivist assumptions while the other has a leaning towards a constructivist paradigm.

Figure 2. Research Locations
Qualitative research usually has a leaning towards a constructivism knowledge claim (Creswell, 2003). The constructivist perspective constructs meaning or develops a theory as the research progresses. The majority of the papers reviewed fall into this category. Researchers using an advocacy/participatory approach seek to achieve some form of action, possibly with a political agenda, as a result of the research. In a pragmatic approach the researcher views the problem as the main point rather than the methods used.
In many of the research papers, particularly the case studies, the researcher had a close relationship with the people he/she has studied, either as the tutor or as an employee in the educational institution. Creswell (1994) states that using the qualitative approach the researcher interacts with those people, whether in the form of an interview, observation or actually running the program for the students. Examples of this are, Brown, Riley & Santos (1999), Clayton (2002) and Dewstow, McSporran & Young (2001). Also relating to this is that some research papers could, according to Creswell, be "value-laden and biased" (1994, p. 5), which can lead, in the authors' opinion, to a lack of rigour. Some researchers work in the online learning field and it is in their interest to produce research that is positive about online learning. This leads to some papers like that by Paynter (2002b), The role of multiple choice questions in e-learning, which essentially was a complimentary description of Cecil, the online learning platform used at Auckland University, rather than an in-depth investigation on multiple choice questions.
The language of many of the research reports tended to be informal, particularly those describing case studies. The author's personal voice comes through, again, as a result of the researcher being actively involved with the online learning activity. Informality is much more likely to be found in qualitative research where the researcher is more subjectively involved in the research and its outcomes.

Figure 3: The Data Gathering Method
The process of the qualitative research is inductive: that is, the researchers are inquiring how, why and what is happening, rather than proving a theory (as would be the case with quantitative research). Much of the research using the qualitative paradigm is situation specific: that is, the research is conducted upon a specific group of learners using a particular platform where the content is provided in a particular way. The results from one qualitative study are not necessarily applicable to other situations.
To analyse the available research on a topic, Creswell (2003) suggests the use of a literature map. This allows the researcher to organise the current research into appropriate areas and to identify any obvious gaps. It also allows the researcher to see the connections between possible future research and current research.
In the map, shown below in Figure 3, research on online learning has been divided up into general research, research on the structure of online courses, the evaluation of online courses and research on interaction and communication in online courses. These categories have been further divided up into appropriate groups. Recognising that the categorising of each paper is a personal judgement, it appears that the majority of research being carried out in New Zealand is on the evaluation of current situations. This is to be expected, as many institutions are presently moving into online or flexible learning opportunities for their students. Researching the process of changing is relevant in these situations.
In the past few years the research on online learning in New Zealand has been increasing at a rapid rate. In the papers reviewed for this paper there were 4 research papers from 1999, 3 from 2000, rising to 6 in 2001 and 27 in 2002. With the increases in opportunities available to students to learn online these numbers are expected to rise further.
There has been extensive research on planning online programmes (Donald et al (2002), Johnston (2002), Sheridan et al (2002), Young & McSporran (2002a), Manford & Crawford (2002) , Halliday & Girvan (1999), Trewern & Fry (2002)), communication in online courses (Williamson & Nodder, 2002), Panko (2002), Northover (2002), Cooper (2002), Haynes (2002), Anderson (2002)) and the effects of change on staff and students (Wolfe (2001b), McSporran & King (2001), Moore (2002), Wolfe (2001a), Brown et al (1999), Newby-Fraser (2002), Walker & Gunn (2002), Gunn et al (2002), Kinshuk & Su (2002)).
From the literature map in figure 3 possible areas for future research can be identified, including links to current research papers. Areas for future research identified include the most effective ways of combining learning opportunities for students in a flexible learning environment including face-to-face, online course material, video links, discussion boards and so on. This would continue on from the work of Gunn et al (2002) and McSporran and King (2002). Another area that could be further developed is looking at how changing from a traditional course to a fully online or flexible learning course affects student learning. This would follow on from the work by Trewern and Fry (2002), Johnston (2002) and Cooper (2002). Williamson and DeSouza (2002) in their paper on discursive spaces have investigated the use of online discussion boards to provide for differing epistemologies and cultural differences in students. Research in catering for the cultural and learning differences of students with online or flexible learning courses is an area for future possible research. Along with Williamson and DeSouza (2002) this would also follow on from research by Brown et al (1999) and Johnston (2001).
This body of research, taken as a group, is not well-focused. The lack of focus comes about in the overall direction of research. It is difficult to discern much forward movement, with research building upon research (or if there is such research, it is not represented in this sample). Instead, case studies, particularly, are often inconclusive, such as this example from Johnson et al (2001):
"Although is
may seem obvious to state that we need to rethink our models for how teaching
and learning is done in online, or computer supported environments, there
is still a lack of clarity about which models should be implemented."
(p.185)
Similarly, Young et al (2000) say: "At time of writing, we have only partial data so few firm conclusions can be made" (p. 6). This may again be a function of the newness of much of this research. Johnson et al are promising further studies, and it may well be found that follow-up research does begin to produce some focus and directionality, providing meaningful and reliable data which is explicitly available both for classrooms and as a basis for later research.
In further considering the lack of focus, it is informative to look at exactly what sort of research is being done. The most common area is that of researching student perceptions of their online courses or teacher perceptions, or both. Papers with this as their main thrust numbered sixteen. A further nine papers were in the "how to" category: how to set up a website (Johnston, 2001), how to move from one Learning Management System to another (Manford & Crawford, 2002), how to introduce online learning to midwives (Wolfe, 2001a) and so on. Less common were papers on theoretical topics (six) and papers evaluating performance by use of student results (three, all incidentally involving just one group of researchers, Young et al (2000, 2002a, 2002b). Only one paper (Brimblecombe, 2000) attempted to research strategic issues.
The research in this area is of a "crazy patchwork" nature (irregular, and sewn together with no discernable pattern). Much of it is ad hoc, a by-product of existing teaching work, rather than research planned independently, and systematically worked through. There is no evidence of any large-scale longitudinal studies being implemented and survey samples are small. For example, Brown, Riley & Santos (1999) had only 20 participants, MacLaren & Shukla (1999) had 10, and Johnson, Bishop, Holt, Stirling & Zane had 6 (only one more than the number of authors of the paper!).
It is a pity that there is not more cohesion and direction in this area of research. The field is going to get bigger, and will be a very important part of most learning institutions' future strategic plans. What may be needed are one or more research centres of excellence for information technology applied to instructional technology, to provide some cohesion and direction to what is currently a very fragmented body of knowledge.
Research into online learning is dominated by a qualitative approach. Due the nature of the population studied and the type of questions being asked, it would be reasonable to expect qualitative research to continue to dominate because the research tends to be carried out by tutors involved in the Online Education field. They use the qualitative approach because they are interested in researching their own particular online course for further improvements, which suits the case study method.
The majority of papers used a constructive epistemology. According to Creswell (2003) qualitative research is usually either constructive or uses an advocacy/participatory perspective. There are a number of research projects that are conducted by researchers who are personally associated with the situation being studied. This could lead to some bias in the conclusions reached. The Action Research method would be more suitable here in order to eliminate bias.
Overall the research in New Zealand appears to be lacking in depth and in the main uses small sample sizes. Also online learning is a relatively new phenomenon, and as the online learning programmes mature the research will become more focussed. Lack of collaboration between Tertiary Institutions has also led to ad-hoc and scattered research that relies mostly on overseas literature for references. Research in catering for the cultural and learning differences of students with online or flexible learning courses in the New Zealand context is another area for future possible research. As our literature review has shown, the majority of research is using the qualitative method, more studies are needed using the quantitative and mixed methods approach to broaden the research platform.
It is a pity that there is not more cohesion and direction in this area of research. The field is going to get bigger, and will be a very important part of most learning institutions' future strategic plans. What may be needed are one or more research centres of excellence for information technology applied to instructional technology, to provide some cohesion and direction to what is currently a very fragmented body of knowledge.
this
issue | home |
back issues index | about
bitr | about citrus
Copyright
© 2003 The CITRUS Charitable Trust. All rights reserved.
Individual articles remain the property of the authors.