They Like to Play Games? Student Interest of Serious Game-Based Assessments for Language Literacy ()
1. Introduction
The United Nations 2030 Agenda for Sustainable Development, or Sustainable Development Goals (SDGs), Education 2030 Framework (UN, 2019) for action offer, the development of more robust comprehensive assessment systems to assess learning outcomes at critical points, including assessment of foundational reading, writing and numeracy skills as well as non-cognitive skill and designing formative assessments as an integral part at the teaching and learning process. This notion meets Malaysian education vision to adopt new methods of teaching and learning in line with the needs of today’s technologically advanced generation of students, to better prepare students for any form of assessment.
The issue of the student’s achievement in the language literacy among primary school students continues until now. Therefore, many efforts have been done to improve language literacy skills among lower level of students in primary school. As to spark the interest and motivation in improving language literacy achievement among children, serious game-based assessment is proposed to accommodate students’ interests towards technological kits in a pragmatic learning approach. In the context of education, serious games are an educational game-based approach that could potentially help students to master the learning process in formative form of assessment (Serrano-Laguna, Martínez-Ortiz, Haag, Regan, Johnson, & Fernández-Manjón, 2017; Adnan & Ritzhaupt, 2018).
2. Overview
2.1. What Sparks Students’ Interest in Games?
Games have been reported to increase levels of motivation for its users (Kim & Shute, 2015). However, (Hamari, 2013) has empirically stated the reasons and motivations as to why people use games are expected to vary, either between the purposes of games or between games for entertainment and those for instrumental purposes. (Merikivi, Tuunainen, & Duyen, 2017) mentioned that perceived enjoyment as a motive, which thrives gamers to immersed in playing game, while (Hamari, 2017) has stated the important factors to associate fun and usefulness in his study of why do people play games.
Technologies also open new windows of opportunities when applied in assessments. According to (Bennett, Dawson, Bearman, Molloy, & Boud, 2017), technology integration in assessment is needed to understand routine assessment design work to stimulate motivation and engagement in teaching and learning process. Meanwhile, in another study, (Nikou & Economides, 2017) demonstrated that perceived trust positively influences technological-based assessment acceptance. Thus, games served as such an innovative tool to hook student’s interests and demonstrate meaningful learning and cognition (Perkins, 2016), therefore reflect on how people learn in various methods. Moreover, the use of games in education generally has a positive impact on students’ learning (Sadiq, 2010; Çankaya & Karamete, 2009; De Freitas, 2018).
2.2. The Potential of Serious Game-Based Assessment
Games have been a part of educational strategies for decades. However, with technological advances in Fourth Industrial Revolution (4IR), serious games have recently emerged as an assessment tool for learning. Serious games is referred to as games that can potentially 1) to be fun and entertaining, and 2) to be educational (Bellotti, Kapralos, Lee, Moreno-Ger, & Berta, 2013). (Coovert, Winner, Bennett, & Howard, 2012) stated that serious games refers to computerized games and advanced video graphics systems utilized for non-entertainment purposes and whose focus is on learning and training or educational and behavioral change.
To date, studies by scholars such as (Malaquias, Malaquias, Fernanda Francielle de Oliveira; Borges, & Zambra, 2018; Kato & de Klerk, 2017; Garneli, Giannakos, & Chorianopoulos, 2017), provides a good exposure to serious games applications as a measuring tool in the evaluation and assessment of the learning process. The serious game-based assessment approach is seen as giving students the opportunity to undergo a less formal test process while still providing accurate information on their achievement. In the study conducted by (Malaquias, Malaquias, Fernanda Francielle de Oliveira, Borges, & Zambra, 2018), the results show that potential benefits of serious games on the academic achievement of students provides empirical evidence on the impact of serious games on students’ self-discipline. It was found that students who were able to demonstrate the maximum ability in the serious games played also had a high reliability index in terms of their own discipline. Meanwhile, a study conducted by (Kato & de Klerk, 2017) concludes that the assessment approach or educational assessment through serious games can be part of an effective formative evaluation because of its interactive testing features in line with innovative instructional technology, which is also can act as an alternative assessment tool to be further implemented as summative assessments and standardized assessments.
3. Methodology
This study implemented a need analysis study based on future user perception on the previous literacy skill and ICT skill needed, as well as user satisfaction analysis of the serious game-based assessment applied. Therefore, the survey technique was implemented with 122 respondents. In the analysis phase, the need analysis was carried out. The first part if this survey consists of the information on the application requirements of the Serious Games application of the Malay Language literacy assessment. The second part of this survey consists of user satisfaction analysis on the overall serious game-based assessment develop for this study. The survey was conducted on students of primary level using binary scale as according to the respondent level of cognitive. The data was analyzed statistically and two set of reports were performed; 1) Need analysis, and 2) User satisfaction.
4. Research Finding
The demographical findings are as the following. It involved a sample of 122 children throughout Malaysia.
Based on Figure 1 shown, the majority of respondents were from rural areas with 63.5 percent while 34.5 percent of respondents were urban children. 52.9 percent of the respondents were girls, while 47.1 percent of the respondents were boys. The main job of the father/guardian of the respondents is a public worker of 41.3 percent. 33.1 percent are private employees, 24.8 percent are self-employed fathers/guardians, while 0.8 percent of fathers/guardians do not work. With regards to the household income of parents/guardians, it was found that 51.2 percent of the respondents were in the Medium40 (M40) and Top20 (T20) household groups while 48.8 percent of the respondents were among households earning less than RM3855 in the B40 household group. 38.3 percent of respondents aged 7 years, while 9.7 percent of respondents aged 9 years.
Based on Figure 2, it was discovered that the majority of respondents have at least a home cellphone at 86 or 71.1 percent. A total of 61 or 50.4 percent of respondents revealed that they also had a computer or laptop or notebook. Only 30 respondents or 24.8 percent have mobile phones, while 2 or 1.7 percent of respondents do not have any computer or mobile device.
4.1. Perception Analysis
The aim of the first section of the survey, was to obtain information on child readiness on any form of assessment in the existing formal education system as well as their perceptions of the self-assessment system. As such, six items were developed to achieve the purpose of obtaining such information. Therefore, Table 1
Figure 1. Respondent demographic analysis.
Table 1. Student perception on Malay Language Literacy Assessment.
shows descriptive analysis of students’ perceptions on the existing language literacy assessment they have been through.
Table 1 shows the perception of children on the existing language literacy assessment and the tendency of children to implement self-empowerment and enrichment activities. Based on the questionnaire, more than 65 percent of respondents were positive towards the statement presented in this section. In conclusion, the findings of the student perception construct on Malay Literacy Assessment give a clear picture to the researcher on the development needs of the Serious Games Literacy Malay Language Instrument as a good alternative as well as instruments that would be of value to the existing forms of assessment and assessment of language.
The second part of the questionnaire (Table 2) looks at perception, interest and tendency of children towards Online/Video Games. The findings for this construct could potentially be crucial in Serious Games development in Malay literacy instruments.
Table 2 shows the perception, interest and tendency of children against game games either online or in video games. The findings of the questionnaire showed that over 50 percent agreed with all the statements presented in this construct. In
Table 2. Students’ perception and interest on Online/Video Games.
conclusion, the analysis of the findings of the perceptions, interest and tendency of respondents to Online/Video Games shows a high inclination of children to any form of Online/Video Games game. This is supported by a high percentage of consent exceeding 70 percent of all statements that have been raised.
The third part of the survey (Table 3) investigates children’s perceptions, interests and preferences towards technological tools.
Table 3 shows the perceptions, interests and preferences of children towards technological tools. Based on the findings of the survey, more than 70 percent of respondents agreed with all the statements submitted. 76.86 percent of respondents agreed that the use of the device of the technology device for example cellphone or computer is a good thing. 85.95 respondents agreed that the use of technology device tools such as mobile phones or computers can make work or life more attractive. In fact, 86.78 percent of respondents acknowledge that the use of technology device tools such as mobile phones or computers is fun and 80.17 percent of respondents acknowledge that they like to use technology devices such as mobile phones and computers in everyday life. In summary, the findings analysis for this construct shows that the majority of respondents are very optimistic and positive towards the use of technology in their daily lives especially in the learning aspects.
4.2. Serious-Game Based Assessment Implementation Phase
Table 3 shows descriptive analysis of students’ perceptions on the examination system in the form of examination as well as the existing language literacy filters they have been through (Figure 3 & Figure 4).
4.3. User’s Perception towards Serious Game-Based Assessment
122 perception’s analysis on the serious game-based language literacy assessment were analyzed as shown in the tables below. The findings obtained as user implement the application and evaluate the application on the questionnaire distributed.
Table 3. Student perception and interest on technology (device/gadget).
Figure 3. Students trying out the serious game-based language literacy assessment.
Figure 4. Users achievement in the serious game-based language literacy assessment.
The findings show user satisfaction and perception on the overall application develop for this study.
4.3.1. User Perception on Serious Games as an Alternative Assessment
Five items were used to determine user perception towards alternative assessment as part of the language literacy formative assessment as follow;
Based on Figure 5(a) on the aspect of alternative assessment, more than 90 percent of respondents agreed with the statements stated. The average respondents’ consent to this construct was 90.8 per cent with 96.6 per cent respondents admitting that they liked learning or responding to tests using these serious game rules. While 95.7 percent of respondents acknowledge that they are ready to repeat the test at any time. However, more than 20 percent of respondents acknowledge that they need the guidance of others to use serious games application for this Malay literacy assessment instrument.
4.3.2. User’s Perception on Application Clarity
Six items were used to determine user perception towards application clarity on serious game-based assessment develop as follow;
(a)(b)(c)
Figure 5. (a) Alternative assessment; (b) Application clarity; (c) Emotional stimulus.
Based on Figure 5(b), the application clarity aspect, over 80 percent of respondents agreed with the statements expressed. The average respondents’ consent to this construct was 86.9 percent. 91.5 percent of respondents admit that they really love the type of games in this serious games instrument.
4.3.3. User’s Perception on Serious Games as an Emotional Stimulus
Five items were used to determine user’s perception on serious games as an emotional stimulus, as follow;
Based on Figure 5(c), in terms of emotional stimulus, more than 85 percent of respondents agreed with the statements expressed. The average respondent’s consent to this construct was 90.48 percent. 93 per cent of respondents admit that it’s like collecting additional bonuses (collecting coins) set in the game challenge. While 91.3 percent of respondents acknowledged that they were excited to spend the game fast.
5. Discussion and Conclusions
In summary, the finding analysis shows that the majority of respondents are very optimistic and positive towards the use of technology in their daily lives especially in the aspects of learning. In addition, the findings of this study provide evidence of respondent’s positive attitude towards current literacy assessment conducted. Hence, it is correlated; high tendency of respondents to the technological devices matched their tendencies in video/online games. The finding also shows positive perceptions towards testing and assessments of literacy and provides a good justification for the need to develop the Serious Games instrument of language literacy Malay parallel with the needs of digital skills among digital native.
For the analysis of the users’ perceptions of these serious Malay literacy games instruments, more than 75 percent of respondents agreed with all the statements expressed in the questionnaire distributed. This extremely high percentage of consensus analysis provides an overview of the quality of serious games produced in parallel with the objectives set. These findings also show the readiness and inclination of pupils as early as the primary school level for the process and form of technology-based learning.
In sum, the study has described the design and development of an online game for learning Malay language in Malaysian primary school. In addition, this study has identified the perception of the existing assessment and availability of technology, as well as an optimistic and positive response of students towards the use of technology in their daily lives especially in the learning aspect (Adnan & Ritzhaupt, 2018; Andersen, Na-songkhla, Hasse, Nordin, & Norman, 2018; Nordin, Norman, & Hamdan, 2018). Furthermore, this study has discovered about the positive attitude of the respondents towards the form of literacy assessment conducted. Therefore, the finding of this study signifies the need to develop a Serious Games instrument of language literacy Malay in line with the needs of digital skills in children to implement the future approach of language learning assessment for Malaysian primary school settings (Nordin, Norman, & Hamdan, 2018; Norman, Nordin, Din, Ally, & Dogan, 2015). However, further studies are needed, to establish the notion of informal and formative assessment as a future type of a promising approach of alternative assessment, and also refine the implementation of serious game-based assessment application for specific target users.
Acknowledgements
This research is funded by the Translational MRUN Rakan-RU Program Grant (Grant No. MRUN-RAKAN RU-2019-003/2) and Dana Pecutan Penerbitan FPend (Grant No. PP-FPEND-2019).