Systematic Review of Literature for Smartphones Technology Acceptance Using Unified Theory of Acceptance and Use of Technology Model (UTAUT)

Abstract

Systematic Review and Meta-analysis are techniques which attempt to associate the findings from similar studies and deliver quantitative summaries of the research literature [1]. The Systematic review of research literature identifies the common research methods, research design, sample size, parameters used, survey instruments, etc. used by the group of researchers. This study intends to fulfill this purpose in order to identify common research mythologies, dependent variables, sample sizes, moderators and mediators used in the field of analysing technology adoption based studies that utilizes the UTAUT2 model. This research collected over 59 published articles and conducted descriptive analytics. The results have revealed performance expectancy/perceived usefulness, trust and habit as the best predictors of consumer behavioural intentions towards the adoption of mobile application. Behavioural intention was the best predictor of use behaviour among the 57 articles selected. 274 was the mean sample size of research with 25 mean questionnaire items. SPSS and AMOS were the most common softwares used in all 57 studies, and 32 of those studies used UTAUT1 model while 14 researches incorporated the UTAUT2 model. There were also two promising predictors such as perceived risk on behavioural intention and habit on use behaviour.

Share and Cite:

Ahmed, M. , Everatt, J. , Fox-Turnbull, W. and Alkhezzi, F. (2023) Systematic Review of Literature for Smartphones Technology Acceptance Using Unified Theory of Acceptance and Use of Technology Model (UTAUT). Social Networking, 12, 29-44. doi: 10.4236/sn.2023.122002.

1. Introduction

Wolf [2] posits that good Systematic Reviews and Meta-analyses cover a large sample of relevant studies, which aids in the robustness of the conclusion and findings. Schmidt and Hunter [3], describe a four-step temporal sequence in conducting meta-analysis which begins by collecting research studies, followed by extracting information, followed next by meta-analysis methods to extract information, and then finally ends in presenting the results.

2. Research Background

UTAUT2 model has been widely used since its inception, and it has already gained more than 6000 citations in Google Scholar which includes widespread use from Information Science, Technology Adoption, Human Behaviour, and e-Learning. This gives empirical advantage and relevance for researchers to use UTAUT2 as the theoretical underpinning towards understanding technology adoption. This theory not only gives flexibility in a variety of settings, it also enables the addition of external variables. UTAUT2 studies are not limited only to the consumer user type alone. Researchers have deployed UTAUT2 to examine various users types such as users’ adoption of m-health [4], nurses’ willingness for home tele-health [5]. A robust understanding of such a widely used theory can only be possible after conducting large collections of literature reviews.

Since the advent of smartphones, numerous studies were conducted on technology adoption in the field of information and communication technology (ICT) worldwide. Conducting a systematic review of literature is expected to provide exciting context for individual technology acceptance and use research and what lies ahead in future. This research is an attempt to fill the gap in exploring the UTAUT2 central role in individual technology adoption research, a systematic review of the existing UTAUT2 studies that will provide insights, and the limitations of the model. It is also expected to lay the directions for future research. With this aim this research will attempt to:

1) identify common research mythologies;

2) most common dependent variable;

3) sample size;

4) moderator and mediators.

3. Research Methodology

The fundamental principal of this research methodology is descriptive analysis of literature specifically designed to more quickly and accurately identify trends, common dependent variables, sample sizes, the most common moderators and mediators identified as well as to eliminate biases. A systematic review is a research summary that addresses a focused question in a structured, reproducible manner, which may be often accompanied by a meta-analysis. Both systematic reviews and meta-analyses explore to identify all topics relevant to a specific question and to summarize and evaluate its validity.

This research conducted the systematic review and meta-analysis of literature by first criteria was to strictly selecting the relevant published literature for the last 10 years. This was due to the fact that Smartphone technology was invented around 2007. The other reason was that the derivation of the UTAUT model was in the year 2003 while the UTAUT2 model was conceived in 2012. The second criteria was considered for selecting the relevant literature adhering to Information and Communications Technology (ICT), mobile technologies, e-Learning and mobile learning technology acceptance in educational settings. Finally, the third criteria was to select the published research from varied geographical regions, as mentioned in Table 1.

The selection of the articles was conducted using Adobe Acrobat Processional software text find and Highlight script. This macro script identifies specified words and phrases across multiple documents tags, highlights and counts their respective occurrences in each article. This technique automated the selection of research articles defined by the criteria identified in Appendix B and resulted in recognizing 59 research articles. The next filtered the research articles to 49 after removing those studies which were not quantitative or were repetitive, those that did not discuss results and analysis; it also removed studies with large sample sizes (>500). The selection of literature for the meta-analysis of study was carried out after a comprehensive manual search from databases such as Science Direct, JSTOR, SAGE Online, Elsevier, ProQuest, Wiley Inter-Science, ACM Digital Library, Elsevier, and MIS Quarterly. The keywords identified in the criteria include “UTAUT”, “UTAUT2”, “Technology Acceptance”, “mobile learning”, “Smartphone”, “Technology acceptance in Engineering Education”, “Technology acceptance in Teacher Education”, “Technology Adoption” and “Behaviour Intention to Use Technology”.

A few publications were eliminated even though they met the above-mentioned criteria; this was because they did not conclude the results or findings of the research. Like any other statistical techniques, meta-analysis can also mislead if the selection and elimination criteria are not well defined or properly conducted. The required care and steps suggested by [3] [6]. This study incorporated all the necessary steps highlighted by to make sure that there is no unintended bias, errors or any skipped process in selecting the literature pool [6].

4. Meta-Analysis Results

The collected literature review data was classified into six main categories as highlighted in Table 2. The first category was “Descriptive information” which included the Code, Author, Year of publication, Technology investigated and the Geographical region of the study. The second group was “Statistical Power” which categorized sample size, number of constructs and number of survey items used. The third group “Software” identified software tools used and the Pilot study carried in the research. The fourth set “Model” identified the use

Table 1. Research article selection criteria.

Table 2. Meta-analysis classification criteria.

of UTAUT and UTAUT2 models by the research. The fifth group “Moderator” collected the moderators investigated by each study respectively. Finally, the sixth group identified types of descriptive statistics, inferential statistics, (exploratory factor analysis, model-fit, confirmatory factor analysis and scale evaluation) and other common statistical tests used by respective studies, as shown in Appendix A. These results were achieved after running a script in Adobe Acrobat Professional Batch Processing which allows to define a series of PDF document processing using actions. This action can be applied multiple more files, or to an entire content of the folder.

The list was sorted in the descending order by the year of publication. Each corresponding information was recorded with an “X” in the conforming entry, and only the information for the sample size, number of constructs and survey items was recorded against their actual values. Basic descriptive data analysis was carried out against each group to assess the average values to establish the assertion.

Statistical Power: The second set of meta-analyses assessed sample size, UTAUT constructs studied and average number of questions used in each study. The results identified that an average of 274 responses were collected per study, as well as an average of seven constructs per study. The meta-analysis identified that the average number of questionnaire items used per study was 25 as mentioned in Table 3.

The software applications used while analysing technology acceptance using UTAUT and UTAUT2 models were mostly IBM SPSS, IBM AMOS, PLS Graphs and LISREL. 29% of researchers used IBM SPSS for exploratory factor analysis, 16% of them used IBM AMOS for confirmatory factor analysis, the rest 27% of researchers used PLS Graph for confirmatory analysis. 6% of the researchers were found to have used a combination of IBM SPSS and AMOS for the same purpose. 2% were also found to be using the LISREL application for conducting factor analysis and for confirming the hypothesis of the research. With the above data it was evident that IBM SPSS and AMOS were found to be the most common software’s among the selected set of literature, as shown in Table 4.

Study Model: The systematic analysis of the literature review focused mainly on the studies that incorporated the UTAUT and UTAUT2 models which investigated technology acceptance. From the collection of research studies, a total of 65% investigated information technologies acceptance by using the UTAUT; while 29% research studies focused on the UTAUT2 model, as shown in Table 8.

Table 3. Sample size, UTAUT constructs and the no of questionnaires items frequency.

Table 4. Type of software applications used by the researchers.

An analysis of moderators used in technology acceptance revealed that a total of 67% of the studies investigated gender as a moderator and at the same time 63% of them investigated age as the moderating effect. A total of 47% of the studies had also incorporated other genders such as the experience of using technology, the educational level, etc. The analysis of the literature review also highlighted that a total of 18% of the studies had ran Pilot studies before conducting the main study as shown in Table 5.

Year of Publication: An analysis of the research publication year reveals that 2013 witnessed 27% of the studies from the pool of research publications selected for this literature review, with most of the studies focused on mobile technology acceptance, as illustrated in Table 6. The year 2012 witnessed the next highest published with a total of 16% of them investigating technology acceptance. Among those eight studies, three covered mobile technology acceptance. The years 2012 and 2010 had 16% and 12% published research with three of those studies covering mobile technology acceptance respectively. While in 2009, 2014, 2008, 2007 and 2006, all pooled 3 to 2 studies respectively.

Table 5. UTAUT models and moderators used by the researchers.

Table 6. Year of publication with the respective technologies.

A total of 27% studies out of 49 research journals covered mobile learning and about 8% research studies covered Smartphone technology acceptance. Among these four, only one study investigated Smartphones for ubiquitous learning (u-learning). The concept of U-Learning is an extension of basic mobile learning where learning content is accessed in various contexts and situations [7].

Region: It was found that the investigation of technology acceptance was being conducted among all regions of the globe. The region of Asia had seen 47% studies conducted with China registering most of the studies followed by Malaysia with 6 studies each. The second region investigating technology acceptance most (by using the two models) was Europe with 24% of the research studies. North America saw 8% of the studies followed by the Middle East with 6%, Oceania with 4% of the studies and finally South America with 1 study 2%, as illustrated in Table 7.

Table 7. Frequency of UTAUT models used against the regions and countries.

Meta-Analysis of Mobile Learning Technology Acceptance Studies: The next stage of meta-analysis focused on extracting studies which exclusively concentrated on assessing the acceptance of mobile technologies or mobile learning out of the final 49 research studies. A total of 23 research studies were identified after this criterion, as shown in Table 8. A total of nine studies focused exclusively on mobile learning.

This stage results were acquired with Adobe Acrobat Text batch process which can run searches to find specific text field in PDFs from the journal articles folder. A simple search term can run complex variables in one or more PDFs. Acrobat searches the PDF body text, layers, form fields, and digital signatures. Acrobat exports metadata, structures searches indexed structure tags and creates output as Comma Separated Values (CSV) file. It can be observed that most of the publications were reported after 2008 and about 12 studies accounting to 50% of the research were published in the years 2012 to 2014. The analysis also revealed that a total of nine studies focused on Mobile Learning, while ten research studies focused on varied Mobile technologies ranging from 3G, Mobile banking, Mobile computing etc. Finally, a total of four studies exclusively focused on Smartphone technology integration using UTAUT2 models.

Table 8. Research studies using mobile technologies and Smartphone.

Table 9 illustrates that the average sample size was 246, with an average of 7 constructs and about 24 items reported as part of the questionnaire for the 23 studies. A total of 50% of the studies among the 23 listed used IBM SPSS and AMOS, while a total of 90% used the UTAUT model to study technology acceptance. More than 65% of the studies assessed the effect of gender as a moderator while more than 60% of the 23 enlisted studies had conducted descriptive and inferential statistics using exploratory and confirmatory factor analysis techniques.

The research conducted by Pheeraphuttharangkoon, et al. [27] used the Unified Theory of Acceptance and Use of Technology (UTAUT) to assess the adult adoption of Smartphones by using the 50+ age demographic group. Data was collected with an online survey and a total of 204 completed replies. The path analysis found that observability, compatibility, social influence, facilitating conditions, effort expectancy and enjoyment were significant predictors of the use of Smartphones by adults over 50.

Table 9. Research studies using statistical power, software’s application.

The second research conducted by Shin, et al. [28] was aimed at understanding the primary factors influencing the user’s intention to continually use Smartphones as a ubiquitous learning tool. The aim was to enhance this tool’s usability and functionality by assessing the learner’s experience after collecting the data form ten South Korean Universities. The study incorporated the UTAUT model and confirmed its significance in predicting user attitudes and behavioural intentions towards using the Smartphone as a learning tool.

A similar study conducted by Pitchayadejanant [29] in using Smartphones, studied the significance of Perceived Value between the two groups of Smartphone users, by comparing iPhone and Blackberry users. The Structural Equation Model (SEM) technique was used and the results indicated that Perceived Value and Facilitating Conditions were the two strongest predictors of Behavior Intention to use Smartphones. Furthermore, Performance Expectancy, Effort Expectancy and Social Influence did not directly impact on Behavior Intention but they made a significant impact on the Perceived Value construct. This study concluded that Perceived Value is the mediating variable for Performance Expectancy, Effort Expectancy and Social Influence for the Behavior Intention to use Smartphones.

The fourth study assessed the empirical acceptance of Smartphones after comparing the four models [30] ; Model-1: Technology Acceptance Model (TAM); Model-2: TAM with Self-Efficacy; Model-3: Innovation and Diffusion Technology (IDT) and Model-4: TAM with IDT and Self-Efficacy. The study varied all the factors and combined them to collect the survey data. Results show that the relationships amongst constructs were similar with Self-efficacy being the strongest predictor of behavioral intention followed effort expectancy and facilitating condition. The results also show that organizational and environmental factors were driving the attitude towards Smartphone adoption.

5. Conclusions

There seems to be an increasing trend in studying user acceptance of technology in various settings, technologies, region, parameters and population sample. As the both UTAUT and the UTAUT2 model are relatively new, the amount of publications available is considerable with reliable results. The literature review of this research had found UTAUT and UTAUT2 models had been the predominant model for conducting research in the fields of acceptance and user perceptions of different technologies. The amount of research on the acceptance of Smartphone as mobile learning device and technologies is very limited. The findings of this study are a valuable addition to the research continuation of technology acceptance in the academia and particularly in tertiary education. The literature review conducted in this chapter investigated the underlying theories used as a foundation of the research methodology, the evolution of technology acceptance theories, and its dimensions, quantitative techniques, instrument design covering a large pool of research papers as part of the meta-analysis as explained earlier in this chapter. Factors influencing Smartphone as a mobile learning acceptance are identified through literature review, along with identifying the UTUAT2 moderators.

This research selects UTAUT2 model as the theoretical framework and aims in addressing the importance of further improvising the constructs and moderators to assess the acceptance of Smartphones in contextual environments.

Appendix A: Meta-Analysis Articles Results

Appendix B: Meta-Analysis, Scale Evaluation

Conflicts of Interest

The authors declare no conflicts of interest regarding the publication of this paper.

References

[1] Morris, S.B. (2007) Book Review. In: Hunter, J.E. and Schmidt, F.L., Eds., Methods of Meta-Analysis: Correcting Error and Bias in Research Findings, Sage Publications, Thousand Oaks, 184-187.
https://doi.org/10.1177/1094428106295494
[2] Wolf, F.M. (1986) Meta-Analysis: Quantitative Methods for Research Synthesis. Sage Publication, Thousand Oaks.
[3] Schmidt, F.L. and Hunter, J.E. (2004) Methods of Meta-Analysis: Correcting Error and Bias in Research Findings. 3rd Edition, Sage Publications, Thousand Oaks.
[4] Dwivedi, Y.K., Shareef, M.A., Simintiras, A.C., Lal, B. and Weerakkody, V. (2016) A Generalised Adoption Model for Services: A Cross-Country Comparison of mobile Health (M-Health). Government Information Quarterly, 33, 174-187.
https://doi.org/10.1016/j.giq.2015.06.003
[5] Van Houwelingen, C.T., Barakat, A., Best, R., Boot, W.R., Charness, N. and Kort, H.S. (2015) Dutch Nurses’ Willingness to Use Home Telehealth: Implications for Practice and Education. Journal of Gerontological Nursing, 41, 47-56.
https://doi.org/10.3928/00989134-20141203-01
[6] Stanley, T.D. (2001) Wheat from Chaff: Meta-Analysis as Quantitative Literature Review. The Journal of Economic Perspectives, 15, 131-150.
https://doi.org/10.1257/jep.15.3.131
[7] Admiraal, W., Lockhorst, D., Smit, B. and Weijers, S. (2013) The Integrative Model of Behavior Prediction to Explain Technology Use in Post-Graduate Teacher Education Programs in the Netherlands. International Journal of Higher Education, 2, 172-178.
https://doi.org/10.1257/jep.15.3.131
[8] Abu-Al-Aish, A. and Love, S. (2013) Factors Influencing Students’ Acceptance of M-Learning: An Investigation in Higher Education. The International Review of Research in Open and Distributed Learning, 14, 83-107.
https://doi.org/10.19173/irrodl.v14i5.1631
[9] Yang, S. (2013) Understanding Undergraduate Students’ Adoption of Mobile Learning Model: A Perspective of the Extended UTAUT2. Journal of Convergence Information Technology, 8, 969-979.
[10] Yang, P., Chiang, J., Liu, J., Wen, Y. and Chuang, K. (2010) An Efficient Cloud for Wellness Self-Management Devices and Services. Fourth International Conference on Genetic and Evolutionary Computing (ICGEC), Shenzhen, 13-15 December 2010, 767-770.
[11] Jambulingam, M. (2013) Behavioural Intention to Adopt Mobile Technology among Tertiary Students. World Applied Sciences Journal, 22, 1262-1271.
[12] Faaeq, M.K., Alqasa, K. and Al-Matari, E.M. (2015) Technology Adoption and Innovation of E-Government in Republic of Iraq. Asian Social Science, 11, 135-145.
https://doi.org/10.5539/ass.v11n3p135
[13] Nassuora, A.B. (2012) Students Acceptance of Mobile Learning for Higher Education in Saudi Arabia. American Academic & Scholarly Research Journal, 4, 24-30.
[14] Wang, M., Shen, R., Novak, D. and Pan, X. (2009) The Impact of Mobile Learning on Students’ Learning Behaviours and Performance: Report from a Large Blended Classroom. British Journal of Educational Technology, 40, 673-695.
https://doi.org/10.1111/j.1467-8535.2008.00846.x
[15] Jairak, K., Praneetpolgrang, P. and Mekhabunchakij, K. (2009) An Acceptance of Mobile Learning for Higher Education Students in Thailand. The Sixth International Conference on eLearning for Knowledge-Based Society, Thailand, 17-18 December 2009, 8.
[16] Liu, L., Miguel C.A., Rincon, R.A., Buttar, V., Ranson, Q. and Goertzen, D. (2015) What Factors Determine Therapists’ Acceptance of New Technologies for Rehabilitation—A Study Using the Unified Theory of Acceptance and Use of Technology (UTAUT). Disability and Rehabilitation, 37, 447-455.
https://doi.org/10.3109/09638288.2014.923529
[17] Wu, Y.L., Tao, Y.H. and Yang, P.C. (2007) Using UTAUT to Explore the Behavior of 3G Mobile Communication Users. IEEE International Conference on Industrial Engineering and Engineering Management, Singapore, 2-4 December 2007, 199-203.
https://doi.org/10.1109/IEEM.2007.4419179
[18] Raman, A. and Don, Y. (2013) Preservice Teachers’ Acceptance of Learning Management Software: An Application of the UTAUT2 Model. International Education Studies, 6, 157-164.
https://doi.org/10.5539/ies.v6n7p157
[19] Yu, C. (2012) Factors Affecting Individuals to Adopt Mobile Banking: Empirical Evidence from the UTAUT Model. Journal of Electronic Commerce Research, 13, 104-121.
[20] Moran, M., Hawkes, M. and Gayar, O.E. (2010) Tablet Personal Computer Integration in Higher Education: Applying the Unified Theory of Acceptance and Use Technology Model to Understand Supporting Factors. Journal of Educational Computing Research, 42, 79-101.
https://doi.org/10.2190/EC.42.1.d
[21] Zhang, X. and Venkatesh, V. (2018) From Design Principles to Impacts: A Theoretical Framework and Research Agenda. AIS Transactions on Human-Computer Interaction, 10, 105-128.
https://doi.org/10.17705/1thci.00106
[22] Carlsson, C., Carlsson, J., Hyvonen, K., Puhakainen, J. and Walden, P. (2006) Adoption of Mobile Devices/Services-Searching for Answers with the UTAUT. Proceedings of the 39th Annual Hawaii International Conference on System Sciences, Hawaii, 4-7 January 2006, 132a.
https://doi.org/10.1109/HICSS.2006.38
[23] Sundaravej, T. (2010) Empirical Validation of Unified Theory of Acceptance and Use of Technology Model. Journal of Global Information Technology Management, 13, 5-27.
https://doi.org/10.1080/1097198X.2010.10856507
[24] Williams, B., Brown, T. and Onsman, A. (2012) Exploratory Factor Analysis: A Five-Step Guide for Novices. Australasian Journal of Paramedicine, 8, 1-13.
https://doi.org/10.33151/ajp.8.3.93
[25] Abdulwahab, L., and Zulkhairi, M. (2012) Modeling the Determinants and Gender, Age and ethnicity Difference in Telecommunication Centre Acceptance. Research Journal of Information Technology, 4, 85-105.
https://doi.org/10.3923/rjit.2012.85.105
[26] Alrawashdeh, T., Muhairat, M., and Alqatawnah, S. (2012) Factors Affecting Acceptance of Web-Based Training System: Using Extended UTAUT and Structural Equation Modeling. International Journal of Computer Science, Engineering and Information Technology (IJCSEIT), 2, 45-54.
https://doi.org/10.5121/ijcseit.2012.2205
[27] Pheeraphuttharangkoon, S., Choudrie, J., Zamani, E. and Giaglis, G. (2014) Investigating the Adoption and Use of Smartphones in the UK: A Silver-Surfers Perspective. University of Hertfordshire, Hertfordshire.
https://uhra.herts.ac.uk/handle/2299/13507
[28] Shin, D.H., Shin, Y.J., Choo, H. and Beom, K. (2011) Smartphones as Smart Pedagogical Tools: Implications for Smartphones as U-Learning Devices. Computers in Human Behavior, 27, 2207-2214.
https://doi.org/10.1016/j.chb.2011.06.017
[29] Pitchayadejanant, K. (2011) Intention to Use of Smartphone in Bangkok Extended UTAUT Model by Perceived Value. Proceedings of the International Conference on Management Proceedings, Penang, June 2011, 160-172.
[30] Chen, J.V., Yen, D.C. and Chen, K. (2009) The Acceptance and Diffusion of the Innovative Smart Phone Use: A Case Study of a Delivery Service Company in Logistics. Information & Management, 46, 241-248.
https://doi.org/10.1016/j.im.2009.03.001

Copyright © 2024 by authors and Scientific Research Publishing Inc.

Creative Commons License

This work and the related PDF file are licensed under a Creative Commons Attribution 4.0 International License.