Reading Comprehension as a Function of Text Genre and Presentation Environment: Comprehension of Narrative and Informational Texts in a Computer-Assisted Environment vs. Print ()
1. Introduction
In the digital era, printed texts have ceased to be the major source of information, as technological innovations are becoming a grand carrier of information. The invasion of technology has changed the face of literacy. The rapid emergence of new technologies is leading to the birth of new literacies, requiring on the one hand, its redefinition ( Cammack, 2002 ; King & O’Brien, 2002; Leu, Kinzer, Coiro, & Cammack, 2004 ) and on the other hand, the development of the necessary skills to cope with its demands. Nowadays, educational technologies play a crucial role in literacy instruction, supplying diverse tools to cope with literate content via technological devices such as computers, smart-boards, and internet based technologies that support and shape the development of reading and writing skills, tailored to 21st century literacy perquisites.
In the scoop of the current theoretical review, the linkage between technology and reading comprehension is explored in terms of the environment medium of presentation (computerized/printed) and the text genre (narrative/ informational).
1.1. Literacy Education and Technology
The technological rapid progress has left its marks on the construct of literacy and as such its instruction. Today, classroom instruction is constantly changing, relying more and more on technological innovations, that support and advance literacy acquisition. For example, the incorporation of computer assisted instruction has proven to be beneficial in supporting reading acquisition and for remedial purposes, enhancing the different skills underlying and supporting reading such as phonemic awareness, word decoding, fluency and sound-letter correspondence and reading comprehension ( Blok, Oostdam, Otter & Overmaat, 2002 ; MacArthur, Ferretti, Okolo & Cavalier, 2001 ; Cobb, 2001 ; Mayer & Moreno, 2000; Roth & Beck, 1997 ; Foster, Erickson, Foster, Brinkman, & Torgesen, 1994; Lonigan, Driscoll, Phillips, Cantor, Anthony & Goldstein, 2003 ; Wise, Ring & Olson, 2000 ; Kim, 2002 ; Makhoul, Olshtein, & Ibrahim, 2014 ). However, research on the usage of computers as means to promote reading comprehension is still limited and needs further investigating.
1.1.1. Reading Comprehension in the Era of Technology
Reading comprehension is a core skill in the route to literacy, especially in our information age area, since it is a major competency for acquiring and using information and later inclusion in society and job markets ( Hay & Fielding-Barnsley, 2009 ; Moats, 2000 ). Throughout primary school years, grand effort is dedicated to foster and enhance strategic re5ading comprehension, recruiting technological tools to support classroom instruction that in turn exposes students to reading comprehension in various contexts they are expected to encounter later on.
As part of the changes occurring in the nature of literacy and in coincidence with the scientific insights, reading comprehension is undergoing constant re-conceptualizing, striving to encompass its underlying mechanisms and processes in the different contexts. In part, the gradually increasing shift to on-screen reading via the multitudes of available technological apparatuses has contributed to the variance in reading comprehension processes and skills.
The RAND Reading Study Group (2000) conceptualized reading comprehension as a function of the interaction between the reader, the text and reading activity that are impacted by socio-cultural values and context. Specifically, it is suggested that the reading environment in which comprehension is embedded affects the dynamics between the two core components: the reader and the text. Thus, when considering the diversity of reading environments, it is presumed that reading comprehension processes differ.
1.1.2. Reading Comprehension: Between Digitized Environments and Print
Throughout the years, studies that addressed the difference in reading performance in computerized versus printed medium yielded controversial results. Conceding with the prominent increase in computer usage, early comparative studies in the field reported superiority in reading performance in printed medium of presentation when compared to computerized environment noted across several reading measures: reading accuracy, fluency and comprehension (e.g. Ziefle, 1998; Dillon, 1992; Gould & Grischkowsky, 1984; Wright & Lickorish, 1983) . On the other hand, other group of studies reported no significant effect of the texts’ medium of presentation on the above-mentioned reading measures (e.g. Muter & Maurutto, 1991; Askwall, 1985; Oborne & Holton, 1988) . Accordingly, Noyes & Garland (2004) suggested that the deteriorative effect of screen-displayed texts on reading, as noted by studies conducted in the 80s and 90s, is due to the digressed resolution of screen displays. Nowadays, with the immense technological advancements (e.g. higher resolution screens), scientific evidence points to the efficacy of CAI in promoting decoding skills and reading comprehension (Makhoul et al., 2014; Mitchell & Fox, 2001; Wise & Olson, 2000) .
In part, the incorporation of computer-assisted instruction enables exposure to reading comprehension processes in different contexts, supplying the pupils with required tools and strategies to cope with the specific characteristics of each text genre. Additionally, such environments can be employed to support reading comprehension skills as a result of the diverse features it incorporates, allowing modification and enhancements that fosters reading comprehension and learning (Meyer & Rose, 2005; Kamil, Intrator, & Kim, 2000; Leu, 2000; Anderson-Inmana & Homey, 2007) . Main features of computerized reading environments are presented below:
1. Digitalized speech: Electronic texts might be accompanied by auditory narration of the text that might contribute to improving word decoding and comprehension and reducing the cognitive effort invested in decoding, thus allowing allocation of effort to construct meaning (Hartas & Moseley 1993; Lewin, 2000; Matthew, 1997; Miller, Blackstock & Miller, 1994) . Additionally, Digitalized speech enables incorporation of beneficial instructional practices such as scaffolding, corrective feedback and immediate evaluation of performance (Ellis & Worthington, 1994; Elbro, Rasmussen & Spelling, 1996) . Indeed, synthesized feedback has been shown to improve word-decoding skills among struggling readers, reduces the cognitive load resulting from decoding and induces success experience that in turn enhances motivation (e.g. Olson & Wise, 1992; Wise, Olson, Ring & Johnson, 1998; Forgrave, 2002; Montali & Lewandowski, 1996) .
2. Text enhancements: Electronic texts might be accompanied by illustrations, videos, passage paraphrases, background information and font size modification, adjusted to the needs of the reader, which ultimately aid in promoting comprehension (Reinking & Schreiner, 1985; Greenlee- Moore & Smith, 1996) . Additionally, facilitating functions such word definitions, proofing tools, copy-paste functions can be included.
3. Internet accessibility: computerized learning environments offers accessibility to the multitudinous of information resources available online such dictionaries, encyclopedias, scientific articles and other types of media. Access to sources of information might contribute to text comprehension by enriching background knowledge. Prior knowledge is thought to play a crucial role in comprehension process, especially in informational texts requiring domain-specific knowledge (e.g. Adams, Bell, & Perfetti, 1995; Coiro & Dubler, 2007; Alexander, Kulikowich, & Schulze, 1994; Means & Voss, 1985; Snow, 2002; Beck, McKeown, Sinatra, & Loxterman, 1991; Graesser, Leon, & Otero, 2002) .
Accordingly, due to the bimodal nature of computerized environment, it is thought to enhance reading skills by fostering letter-sound correspondence and giving feedback regarding the accuracy of decoding, which in turn improves reading automaticity and comprehension (e.g. Montali & Lewandowski, 1996; MacArthur, Ferretti, Okolo, & Cavalier 2001; Olson & Wise, 1992) . In their study, Montali & Lewandowski (1996) examined the effect of simultaneous bimodal exposure to passages presented in computerized environment on comprehension by comparing reading comprehension performance of poor readers in three conditions: visually, auditory (speech synthesis) and simultaneous auditory-visual presentation. The results of the study pointed to an optimal reading comprehension performance in the bimodal condition, where the performance of less skilful readers was enhanced to match their control counterparts. Additionally, both poor readers and control group reported higher preference of the bimodal medium of presentation.
Another advantage for computerized environment is its impact on motivation. Computer-assisted environment have been found to enhance learning motivation (Makhoul, Olshtein, & Ibrahim, 2014) . Extensive scientific efforts have established the causality between reading motivation and reading performance (e.g. Gambrell, 2001; Guthrie, Wigfield, Metsala, & Cox, 1999) . Features encountered in computerized environments such as graphics, animations, sound effects and video inspires more enjoyable reading experience and engagement with the text, affecting reading and comprehension performance (Grimshaw, Dungworth, McKnight, & Anne Morris, 2007) .
In conclusion, it is worthy to note that despite the advantages of a computerized environment and the above presented argumentations, its superiority over printed presentation is still controversial, some pointing to no difference in reading comprehension between the two manners of presentation. For example, in their study, Sorrell, Bell & McCallum (2007) , examined the benefice of computerized-assisted reading to improving reading comprehension among elementary school-aged weak readers, compared to traditional instruction. No difference was encountered in overall reading comprehension scores after computer-assisted reading. Furthermore, it was proposed that reading hypertexts might hinder reading comprehension since it tends to induce cognitive load (DeStefano & LeFevre, 2007) . In their review, addressing the equivalency between the two environments, Noyes and Garland (2008) concluded that difference in coping with reading activities in the two environments―compute- rized and printed―resides in the adequacy of each environment to the specific task in hand and its outcome where for a certain task one environment might be superior to the other. In addition, it has been suggested that the sole presentation of the text in a computerized environment is not sufficient to enhance reading comprehension (Twyman & Tindal, 2006) .
1.2. Reading Comprehension as a Function of Genre
Text genre is one of the factors influencing reading comprehension. Awareness and familiarity with text genres is essential in the road to obtaining meaning since it dictates the reader’s anticipation regarding the manner of ideas and information’s enfoldment in the text (RAND Study Group, 2002; Meyer, 2003) . In addition to decoding skills, general knowledge, linguistic competencies, semantics and orthographical knowledge, reading comprehension is subject to comprehension processes that rely on structure sensitivity and texts’ mental representation (Perfetti, Landi, & Oakhill, 2005) .
Already in childhood, children are familiarized with narrative text structure, gaining awareness to its features, which in turn facilitates their understanding of stories. In contrast, informational texts are mainly addressed in advanced stages of primary instruction. Additionally, unlike the overall standardized and familiar structure of narrative texts, informational texts are varied in their structure and incorporate different features, complex linguistic constructs and vocabulary that solicits different requirements from the reader and adds another layer of difficulty in arriving to comprehension (Kucan & Beck, 1997; Yopp & Yopp, 2002; Berman & Katzenberger, 2004) . Previous findings indicate that in comparison to narrative texts, fluency and comprehension is reduced when reading informational texts (e.g. Parmar et al., 1994; Sáenz & Fuchs, 2002) .
Reading Comprehension: Between Digitized Environments and Print
In light of the above-depicted advantages encountered in computerized environment, one can assume that technology can facilitate and bridge the gaps in literacy acquisition, especially in complex orthographies. Specifically, when considering the case of Diglossic Arabic, it is thought to be one of the most controversial languages to be acquired due to its socio-linguistic constraints. On the one hand, the impact of the Diglossic nature of Arabic (i.e. the linguistic discrepancy between its spoken and literary form) on literacy acquisition has been extensively documented (Ayari, 1996; Khamis-Dakwar & Froud, 2007; Ibrahim, 2009) . On the other hand, the orthographic complexity of Arabic sets yet another impediment for reading acquisition, due to the induced visual load during visual processing of words, leading to slower word identification (Abdelhadi, Ibrahim, & Eviatar, 2011; Eviatar, Ibrahim, & Ganayim, 2004) .
Accordingly, it is presumed that bimodal facilitation and text enhancements, as offered by computerized environments, might be utilized as a compensating factor, assisting in overcoming the complexities of Arabic orthography and improving decoding and reading comprehension skills. The investigation of technology role in Arabic reading instruction has only incited lately, drawing on the additive learning value of computer assisted instruction that might contribute to overcome the obstacles hindering Arabic reading acquisition. In one study, Makhoul, Olshtein, and Ibrahim (2014) investigated the effect of a balanced interactive computer assisted promoting reading comprehension skills among at-linguistic risk Arab first graders. The results of the study pointed to a significant improvement in comprehension skills among children in the intervention group when compared to comparison group.
1.3. The Current Study
So far, scientific research has focused on investigating the effect of computer-assisted environments on reading literacy. However, no other study has directly attempted to investigate the suitability of computer-assisted environment to cope with different text genres.
Hence, the current study will attempt to investigate for the first time reading comprehension performance of fifth graders, after completing their reading acquisition process in two environments: printed vs. computerized. Additionally, it will investigate performance difference across two text genres.
The study questions:
1. Is there a difference in the pupils’ reading comprehension performance in the computerized environment when compared to printed environment?
2. Is there a difference in the pupils’ reading performance when dealing with narrative texts compared to informational texts in each of the environments?
3. Which environment will be more beneficial for poor comprehenders when compared to good comprehenders?
4. Is there a correlation between the pupils’ presentation environment preference and reading comprehension achievements?
2. Method
2.1. Participants
Fifty-five Arabic native speaker fifth graders from an elementary school in Israel center area participated in the study (23 boys and 32 girls) (M = 10.8, SD = 5.97). It should be noted that only 34 students completed all the four units.
As part of their Arabic classroom instruction, all the selected participants used “Arabic is our language” textbooks series, developed by the team of Arabic language in the Center of Educational Technology (CET) drawing on the principles of balanced interactive learning. Additionally, the sampled school was part of two years on- going project of school technology immersion where every pupil was equipped by a personal laptop. To enable successful implementation, teachers have been participating for three years in a weekly training session, carried out by an instructor of digital content development from CET that aims to facilitate the integration of computer assisted learning, provide tools and knowledge of the digital environment and ideas for integrating digital tools in the teaching process. Alongside the training, the instructor monitored the teachers’ ability to implement the acquired knowledge, and supervised the incorporated digital tool in their lesson plans.
2.2. Measures
1. For the purpose of the current study, four reading comprehension units were developed: narrative computerized unit, informational computerized unit, narrative printed unit and informational printed unit (See Table 1).
2. On each unit, a text was presented, followed by comprehension questions, addressing the four comprehension levels as proposed in PIRLS―Progress in International Reading Literacy―theoretical framework (2006), in addition to exercises evaluating (see Table 2) linguistic knowledge (Phonology, morphology, syntax, spelling and punctuation). Both close-ended and open-ended questions were included (multiple choice, cloze, matching and dragging). Scoring was assigned on 100 points scale where partial answers and wrong answers received 50 and 0 points on the open-ended questions, respectively. On the closed-ended questions, each correct answer granted 100 points. For each unit, an average score was calculated.
3. Student’s questionnaire: The pupils filled a feedback questionnaire, containing six statements describing their performance level on both environments and their preferences. The students were asked to rate on a Likert scale their agreement degree to the presented statements (1-little to 6-to a great extent). For example, “I found it difficult to solve the computerized unit”.
4. Observational documentations for qualitative impression on the quantitative data performed by the accompanying teacher.
3. Results
3.1. Differences in the Pupils’ Reading Comprehension Performance in the Computerized Environment When Compared to Printed Environment
Two-way analysis of Variance revealed no significant t for the task environment [F < 1] on reading comprehension performance. No significant difference was encountered in the pupils’ reading comprehension scores in the computerized environment (M = 5.86, SD = 3.62) when compared to printed (M = 58.13, SD = 3.21) (See Figure 1).
Figure 1. The pupils’ comprehension performance on the computerized vs. the printed environment.
Table 1. Units description as a function of text genre and medium of presentation.
Table 2. The distribution of comprehension questions types in the different units.
3.2. Differences in the Pupils’ Reading Comprehension as a Function of Text Genre
No significant difference was encountered in the pupils’ overall performance on the narrative units (M = 57.17, SD = 3.42) when compared to informational units, (M = 59.52, SD = 3.44), [F < 1] (See Figure 2).
3.3. Differences in the Pupils’ Reading Comprehension as a Function of Text Genre and Presentation Environment
Two-way analysis of variance revealed a significant interaction effect between the text genre and presentation environment [F (1, 33) = 8.53, MSE = 195.01, p < .01]. For the informational units, a significant difference was encountered between the pupils’ performance on the computerized (M = 63.23, SD = 4.38) and printed based environment (M = 53.89, SD = 3.73), where significantly higher average score was obtained on the former (t (39) = −2.31, p < .05) (See Figure 2). In contrast, on the narrative units, only Marginal difference in the pupils’ performance was found between the computerized and printed units (t (45) = 2.03, p < .05). The pupils’ performance was slightly higher on the printed environment (M = 60.46, SD = 3.7) when compared to the computerized (M = 53.89, SD = 3.73) (See Figure 3).
Figure 2. The pupils’ comprehension performance on the narrative units vs. the informational units.
Figure 3. Pupils’ performance in reading comprehension as a function of text genre and presentation environment.
Good and Poor Comprehenders’ Performance in Different Genres as a Function of Presentation Environment
In accordance with the pupils’ overall mean score (i.e. composed of their scores on the four units), two groups of comprehenders were created: poor (M < 70) and good comprehenders (M ≥ 70). Independent samples T-test pointed to a significant difference between the two groups in reading comprehension overall score (t (25) = −7.048, p < .001). The good comprehenders performed significantly better than the poor comporehenders in both the computerized units (t (25) = −5.99, p < .001) and the printed units (t(25) = −5.05, p < .001). In addition, good comprehenders outperformed the bad comprehenders in both the narrative units (t(25) = −4.86, p < .001) and printed units (t(25) = −6.12, p < .001) (See Table 3).
To examine the combined effect of presentation environment and text genre on the performance of each group, three-way-analysis of variance was conducted. No interaction effect was encountered between comprehension level, text genre and presentation environment (F < 1). However, post-hoc analysis revealed that for the good comprehenders, performance was significantly higher on the printed environment, on both the narrative units and the informational units, (t (15) = 2.74, p < .05), (t (26) = −2.96, p < .05), respectively.
3.4. Description of the Pupils’ Working Environment Preference and Correlation with Reading Comprehension Performance
The pupil’s self-rating on the preference questionnaire revealed that higher percentage of pupils prefers the computerized environment in learning processes. On average, 57.1% of the students expressed their preference of the computerized environment (See Figure 4).
To examine the relation between the pupils’ preference and performance in reading comprehension, Pearson correlation was calculated. No significant correlation was encountered between the pupils’ preference and reading comprehension performance on (r = −0.05, p. ns).
Figure 4. The pupils’ learning environment preferences.
Table 3. Comparison between poor and good comprehenders ( Reading comprehension Mean scores, Standard deviations, T- test scores and P value across genre type and presentation environment and comprehension level).
4. Discussion
Contrary to our expectations and to previous findings, no significant differences were found in coping with narrative texts when compared to informational texts. The equivalency of both genre types may be attributed to Arabic diglossic nature, where the discrepancy between its spoken and written form affects students’ reading comprehension performance, across the different text genres, both differing greatly in their vocabulary repertoire and linguistic construct if presented in spoken Arabic.
The results of the current study did not yield clear cut conclusion regarding the supremacy of neither the computerized nor the printed based environment where no significant difference was encountered in reading comprehension performance between the two environments. The current results falls in line with Noyes and Garland (2004) conclusions, pointing to no differences in reading comprehension and reading time in computerized vs. printed medium of presentation.
However, in the current study, an interaction effect was encountered between the texts’ genre type and its medium of presentation. In narrative units, although only marginal effect was encountered, better performance was noted in the printed environment when compared to the computerized environment. In contrast, in the informational units, there was a significant difference when comparing the performance of the pupils in the computerized environment to the printed environment; the pupils performed better in the computerized unit.
Despite the fact that no significant effect was encountered in reading comprehension performance between informational and narrative texts, the interaction effect as encountered in our study, suggest to the involvement of different reading comprehension process, set by the demands of each genre type. Furthermore, the results points to significant differences between the three achievers sub-groups, across genre type and task environment where no effect of the task environment was encountered among the low-achieving students. Accordingly, This results show that neither task environment helped the struggling pupils to bridge the gap with the other pupils.
Another important issue that our results raise is the relationship between the Pupils’ presentation environment preference and actual achievements. The results of the current study did not encounter any significant correlation between the pupils’ preferences and achievements. Due to the limitation of the small sample size, any conclusion should be treated carefully. Hence, future study is required to investigate whether the pupils’ preferences affect their reading comprehension achievements.
5. Conclusion
In conclusion, the benefice of each medium of presentation needs to be further explored, taking into account individual differences and task demands. Further study is needed in order to map the different comprehension process when dealing with the variant genre types across different environments. Also, in order to arrive to clearer conclusions, bigger sample of participants is needed.