Rumi: An Intelligent Agent Enhancing Learning Management Systems Using Machine Learning Techniques

Abstract

The dramatic improvement of information and communication technology (ICT) has made an evolution in learning management systems (LMS). The rapid growth in LMSs has caused users to demand more advanced, automated, and intelligent services. This paper discusses how Artificial Intelligence and Machine Learning techniques are adopted to fulfill users’ needs in a social learning management system named “CourseNetworking”. The paper explains how machine learning contributed to developing an intelligent agent called “Rumi” as a personal assistant in CourseNetworking platform to add personalization, gamification, and more dynamics to the system. This paper aims to introduce machine learning to traditional learning platforms and guide the developers working in LMS field to benefit from advanced technologies in learning platforms by offering customized services.

Share and Cite:

Mohammad Jafari, B. , Zhao, M. and Jafari, A. (2022) Rumi: An Intelligent Agent Enhancing Learning Management Systems Using Machine Learning Techniques. Journal of Software Engineering and Applications, 15, 325-343. doi: 10.4236/jsea.2022.159019.

1. Introduction

During the past decade, Information and Communication Technology (ICT) has grown into our day-to-day lives. ICT has made a huge paradigm shift in global interactions and educational practices [1]. The dramatic improvement of information and communication technology (ICT) has shaped new concepts and structures for education and methods of course delivery to the point that it has led to the development of “Learning Management Systems”.

A learning Management System is a software application or web-authoring system which has become a powerful tool for conducting an e-learning environment [2]. LMSs are defined as online learning technologies for the creation, management, and delivery of course material [3] [4].

LMS includes various criteria from course management systems and content management systems to instructional management systems [5]. LMSs exceed traditional schooling to the point that they provide functionalities beyond instructional content such as management tracking, personalized instruction, and integration across the system [6].

LMSs have been developed from course systems that were originally introduced in the late 1990s and evolved to make a modern school experience [7]. They are now playing a significant part in enriching and facilitating learning all around the world, especially after the Covid-19 pandemic when the on-campus learning experience was no longer an option. The learning management systems lost prominence in recent years because they were considered by certain institutions as simple repositories [8]. But Covid-19 pandemic changed this vision completely and LMSs got more attention as a medium that allows students and teachers to maintain interaction with their academic institutions [8].

When LMSs first emerged, vendors had many opportunities to offer various services and features to satisfy users and define a basic structure for learning management systems. After the release of the first versions, users started getting smarter about their needs which elevated their expectations from LMSs. The change in demand led to the second phase of evolution in learning management systems [9].

LMSs have evolved a lot during the past few years. As online platforms evolved and with technology growing into our daily lives, people become more aware of their expectations from learning platforms and personalization became one of the most significant needs of users. Personalization can be defined as a process that changes the functionality, interface, information access, content, or distinctiveness of a system to increase its relevance to an individual or a category of individuals [10].

To meet the elevating user expectations, learning platforms must develop and transform continuously. This would not happen without the help of advanced technologies and techniques. One of the widely adopted technologies to achieve improvement in every domain is Artificial Intelligence (AI). Artificial intelligence is the intelligence demonstrated by machines instead of the human brain [11]. An Artificial Intelligence (AI) program is called Intelligent Agent. An Intelligent agent can perceive its environment and is capable of taking flexible actions that maximize the chance of reaching its goals and meeting the objectives [11] [12].

Intelligent agents are a new paradigm for developing software applications. Agent-based computing has been considered the next significant breakthrough in software development [13], and the new revolution in software [12] [14]. To make this breakthrough, intelligent agents must be responsive, proactive, and most importantly, social [12]. Intelligent agents have made great changes in a variety of fields like virtual assistants helping customer support, electronic mail filtering agents helping information management, patient monitoring agents improving health care systems, etc.

An integral part of an intelligent agent is learning. To fulfill the learning process, machine learning is used to develop intelligent agents. Machine learning is defined as a field of study that gives computers the ability to learn without being explicitly programmed [15]. It is one of today’s most rapidly growing technical areas, lying at the intersection of computer science and statistics, and the core of artificial intelligence [16]. Machine learning describes a set of techniques that are commonly used to solve a variety of real-world problems [17]. Machine learning has several applications from pattern recognition [18] to signal prediction [19].

CourseNetworking is a learning management system introducing Artificial Intelligence and machine learning techniques to learning platforms. It gives a personalized learning experience with a taste of entertainment to the users by an intelligent agent named “Rumi”. CourseNetworkig exceeds traditional platforms which could not offer customized content and personalized services to the users.

Rumi is designed to be a social personal assistant, a cool friend, and a caring buddy to all learners on CourseNetworking. Rumi increases engagement, adds more productivity to the systems using machine learning techniques, facilitates the learning process for students and lessens teaching milestones for teachers.

This paper argues how machine learning can be adopted by learning management systems to provide a better learning experience to the users. We first introduce CourseNetworking and Rumi, then we explain how we employed machine learning to design a more personalized learning platform.

2. Introducing Course Networking

CourseNetworking1 or CN is a next-generation Learning Management System (LMS) [20] with its foundation in academic social networking and sociocultural learning theory [21]. During the past decade, with Social Networking Sites (SNSs) gaining popularity, platforms like Facebook, Twitter, Yammer, and other similar platforms have been widely used for learning in higher education [22] [23] [24] [25]. Many studies found that SNSs can effectively enhance communication [26] [27], collaboration [28], community-building [29] [30], and engagement [22] [31]. However, public SNSs raise questions about student privacy [32] [33] and distractions when a platform also serves other purposes [34] [35]. Designed as an academic networking platform, CN came in to solve these problems. The sociocultural nature of CN also addresses several challenges that traditional LMSs face, including the issues with deriving learning motivation, engagement, and retention [36] [37]. CN is a combination of SNS and LMS, drawing the strengths from both types of platforms. As mentioned in the CN White Paper [38], CN not only supports course management but also connects learners and courses for new learning opportunities.

The mission of CN is to change the way the world learns through social, engaging, and global learning. In order to accomplish this goal, CN supports a series of unique features, such as posting and reflection, personalized networking tools, gamified reward systems (called “Anar Seeds”), digital badges and certificates, global classrooms, and a lifelong social ePortfolio. In order for the platform to serve global users and scale, it is hosted in the cloud through Amazon Web Services (AWS) and built upon a NoSQL data structure.

The CN platform was first launched in 2012 with seed funding from Indiana University. It was then developed, studied, and commercialized at IUPUI CyberLab2, a university-affiliated educational technology laboratory with over three decades of experience in eLearning research and development. As of summer 2022, CN has over two million users from over 160 countries. The user population ranges from high school, college students, to professionals, with the majority in higher education. Individual users around the world can visit thecn.com to sign up for a free CN account, create their free personal courses, and build a lifelong ePortfolio. Educational institutions and training organizations may license CN to access advanced features and services. As of today, faculty and scholars have documented the effectiveness of CN in engaging students, community building, and student success [39] [40] [41] [42].

Figure 1 is a screenshot of the homepage of a CN user. Rumi, the intelligent personal assistant, pops open from the top of the page introducing himself. Under that is the main page that contains a courses menu on the left and a post feed on the right. In the post feed, users can use their Networks and Communities to filter posts and network with like-minded others. They can also make posts to these Networks and Communities and comment on others’ posts. To post to a course and participate in course learning activities, they will need to enter a course from the left menu that will take them to the LMS portion of the CN.

3. Intelligent Agent Rumi

CN started as a social LMS in 2012. Since then, additional features and services were developed each year to enrich and strengthen the CN environment. In 2015, CN Post3 was released as a Learning Tool Interoperability (LTI) plug-in to complement traditional LMSs with social learning and gamification. In 2017, the CN life-long ePortfolio4 became available for every CN user to build and maintain their online personal branding [43]. In 2022, the CN Zoom App5 was launched to give Zoom users a seamless LMS experience during and after Zoom meetings. Within each of these products, Rumi, a digital personal assistant,

Figure 1. CN homepage.

delivers recommendations and reminders to provide personalized learning to individual CN users.

Rumi was launched to CN end users in October 2020 after several years of research and development at IUPUI CyberLab. As a digital personal assistant, Rumi is powered by Artificial Intelligence (AI) and machine learning algorithms. It offers a series of services to end users, such as announcements, community and connection recommendations, learning and teaching tips, and others. IUPUI CyberLab team has been continuously refining existing algorithms and adding new services to Rumi.

Rumi was launched within CN, which makes CN among one of the first LMSs and ePortfolio platforms that provide AI and machine learning integrated services. In fact, Rumi is designed to be potentially employed by any learning platform. It could be developed as an LTI plug-in later to be integrated within open source LMSs such as Moodle and Sakai or within commercial LMSs and ePortfolio systems.

The concept of Rumi was first introduced in [44]. This paper suggests that multiple intelligent agents perform teaching and learning tasks on behalf of teachers and learners. These intelligent agents may perform as a teaching assistant, a tutor, or a secretary. They can communicate with end users through a combination of text, graphics, speech, and facial expression, and voice recognition.

Based on history, Rumi was a famous 13th-century Persian sage and poet who represented knowledge and wisdom. To bring the intelligent agent emotionally closer to end users, we designed the persona of our Rumi as an intelligent and modern-looking male in his mid 30’s. He plays the roles of a digital mentor, personal teaching assistant, career advisor, caring classmate, and cool friend. Figure 2 illustrates Rumi’s face which may appear happy, neutral, or sad depending on the messages he delivers.

4. Rumi, Personalization, and Machine Learning

Nowadays, every research and development task has an element of artificial intelligence. One of the most important subsets of AI is machine learning. Machine learning is now making a significant contribution to all areas more than ever and it has enhanced the success pace in each of them from detecting Alzheimer’s disease in medical fields [45] to self-driving cars [25]. Learning management systems (LMS) are no exception. Employing machine learning in LMS can make a great paradigm shift and start a new age in the LMS area by fulfilling users’ elevated expectations.

Figure 2. Rumi with happy, neutral, and sad face.

One of the newly shaped user expectations is personalization. Personalization is becoming the primary success factor in every domain, especially social media. Advances in technology have made users demand to receive more personalized experiences which has made personalization more important than ever. Personalized content saves time for users by providing relevant content and appears to be designed for each user individually. Personalized content captures user preferences and interests. It improves the user experience and enhances user loyalty by offering value to them. As personalization becomes more of an expected norm across all types of online platforms and services each year [46], numerous companies are taking advantage of interactive technology to personalize their interactions with users [47].

Personalization is one of the most outstanding factors in increasing engagement, especially in Learning Management Systems. Utilizing a personalized learning platform equips students, teachers, and all other users with an advanced tool to spur engagement and receive relevant messages and content.

The integration of personalization in various products turned rapidly from an unnecessary luxury to a commodity that is expected by customers [46]. The expectation made all companies adopt personalization so they would not fall behind the curve. Personalization is employed in CourseNetworking as the primary objective of the intelligent agent “Rumi” to meet elevated user expectations. It must be mentioned that personalization is not the only goal of Rumi. Rumi offers other services with different objectives too.

Personalization agents can be used in different ways. One of them is agents used as advice-giving systems to provide recommendations to each individual and another is the agents generating personalized content based on the user’s profile [47]. Rumi delivers personalized experiences in two ways, first by offering customized announcements and messages to the user, and second by considering user preferences while making any recommendations. This is where machine learning and AI come into the picture. Personalization is one of the key applications in machine learning with widespread usage in various industries [46]. Machine Learning offers a set of different techniques allowing one-to-one personalization.

Machine learning algorithms use statistical and probabilistic approaches to analyze datasets to find trends. Finding these trends helps the algorithms learn the preferences and interests of the users and recommend contents, tips, connections, etc. based on their interests.

Rumi is developed to be user-centered by benefitting from several machine learning algorithms. Rumi uses the users’ information to get to know the user better. The algorithm behind each personalized service requires different set of data to work on. Some services need the profile information such as institution and major while another service needs users posts and shared content. Each service uses different type of machine learning technique based on its goal. The algorithms get the relevant data as input, process the data and learn the preferences, then they make recommendations by using mathematical approaches.

More details about Rumi services are further explained in Section 6.

5. Rumi Services

In this section, we briefly explain what services machine learning integration can bring into learning management systems and how machine learning techniques can help eLearning platforms. Each of these services is explained below to briefly explain what services can be added to LMSs if they adopt machine learning and to show how artificial intelligence can contribute to developing new services in a learning platform.

5.1. Announcements

Rumi announcements send critical updates and information to end users, such as upcoming system maintenance, important campus events, and school schedule updates. Figure 3 is an example of Rumi announcements. Since Rumi announcements appear on the very top of each page, they are hard to miss. In addition, Rumi announcements are given the highest priority over all other services. This means when there is a new announcement, it will show up as the first message when the user visits the site. Both CN admins and institution admins have permission to create Rumi announcements. While creating an announcement, admins can specify its importance level. CN admin announcements are given higher priority over institution admin announcements, and announcements labeled with a higher importance level appear prior to announcements with a lower importance level.

5.2. Tips

Tips feature is a core service of Rumi. It gives users, both students, and instructors, individualized advice about CN features, learning and teaching practices, and resources. Currently, these tips are created by the CN team. They can be added, revised, or removed anytime. An example of a CN feature tip is that if a learner has edited their ePortfolio but never created a showcase, Rumi will show up introducing the showcase feature and providing a tutorial for the user to follow to create a showcase.

Right now, CN feature-related suggestions are the primary type of tips. However, the value and potential of tips about learning and teaching practices and resources are enormous. Some examples of learning practice tips are preparing

Figure 3. Rumi posting customized announcements to users.

for upcoming exams, beginning working on major assignments early before due dates, participating in social discussions with peers, and completing missed learning tasks. Some examples of teaching practice tips are grading missed assignment submissions, setting up social learning netiquette, and creating starter posts to warm up the course environment. When it comes to giving suggestions on learning and teaching resources, the tips may recommend Open Education Resources (OER) to students and instructors relevant to the course subjects.

Through AI algorithms, Rumi’s tips present two characteristics: individualized and helpful. This means that tips delivered to end users are specifically targeted to their needs. The following mechanics are implemented to ensure relevancy and helpfulness of tips to each CN user. First, Rumi looks into user usage data. An example would be if the system’s data shows that a user has not used a helpful feature, Rumi will provide a tip about that feature. Second, Rumi leverages keyword tagging to recommend relevant resources. CN supports hashtags in various places, even in assignments, quizzes, and gradebook. If a student receives a low score on an assignment tagged #CellStructure, Rumi will introduce additional materials about cell structure to the student to learn more about the topic. Third, the priority engine pushes out the most critical tips first, ensuring the helpfulness of the tips. When there are multiple relevant tips to suggest, the ones with a higher assigned priority level will show up first. Last, Rumi takes feedback from users to continuously improve the quality of his recommendations. If a user reports that they already know a tip, the tip will stop showing up to the user. An example of Rumi providing a tip to the user is shown below in Figure 4.

5.3. Community Recommendation6

CourseNetworking offers a network where users with similar interests can be grouped in a “community”. A community in CN is defined as a group of people sharing similar interests. Users can interact in these groups through sharing posts, polls, comments, or any documents and photos. They can also rate and react to posts and events to maintain the dynamics of social interaction on CN. A community can be created by each user if it is not created before. This feature allows users to make communities around any topic that they are interested in

Figure 4. Rumi giving tips to the user.

which is one of the great characteristics of CN. If the community already exists, any interested user can join it since all communities are publicly available on CN.

Communities get their names from the common interest of their members. It can be a skill, a major, an institution, an event, a location, etc. A tag with the community’s name would be added to the top of the user’s home feed when they create or join a community as shown in Figure 5. Users can filter their home feed content by clicking on the community tag they desire. By doing so, they can check out the content related to the community tag they clicked on. For instance, a user interested in “python” can create or join the “python” community and a tag with the name “python” would appear on their home feed. The user can access the content on the python community by clicking on its tag on the home feed.

Communities make a great opportunity for CN users to communicate, discover and socialize. Analyzing CN data revealed the fact that a significant portion of users has neither created nor joined a community. Also, the majority of the communities have very few members. To address this issue, the Community Recommendation service is offered by Rumi as shown in Figure 6. Rumi connects people as an intelligent agent and makes them more engaged. The more engaged users are, the more productive the social network is.

To encourage users to join a community, recommendations must be associated with their taste, personality, major, skill set, etc. Machine learning techniques are employed to find the most suitable communities for each user to recommend.

Figure 5. Communities joined or created by the user, on top of the home feed.

Figure 6. Rumi recommends communities to the users based on their interests.

To achieve this purpose, a modified version of item-to-item CF [49] called Neighboring Collaborative Filtering (NCF) is adopted and improved by utilizing a feedback structure. The name is derived from the general idea, which selects popular tags among the user’s neighbors as community recommendations. The neighbors of a target user are accounts that are related to that user in some way. Sharing various features can cause two users to be related including similar skills, location, field of study, organization, etc. Out of all these factors, the most influential ones including the field of study, previously joined communities, and social engagement are selected to define whether two individual users are considered neighbors.

5.4. Quote Competition7

CN users can add a tagline to their profile’s bio section. It can be a motivating sentence or a quote from a famous person. Quote Competition is a service offered by Rumi based on the users’ tagline, promoting gamification and adding a taste of entertainment to the platform. The competition is as follows: a pair of two quotes are shown to each user so they can choose the one they like more. If the user likes none of the quotes, they can request to get a new pair of quotes to vote. Each quote corresponds to a tagline that users submitted on CN. This service is shown in Figure 7.

During each round, Rumi picks a pair of quotes for each user from a pool consisting of all user-submitted taglines on CN except the user’s own tagline, quotes that were shown to that user before, and eliminated quotes. Rumi has a specific instruction to choose two quotes from the pool. The first quote is the one in the pool which is shown to users by Rumi less than others. The one that has the closest win rate (score/views) to the first quote is picked as the second quote that must compete with the first one. Users can check out quotes’ rankings and their own tagline rank by viewing a table called “Leaderboard”.

A score is assigned to each quote as a metric used for comparison among multiple quotes. Users preferring one quote to another, increments the winning

Figure 7. Quote competition service offered by Rumi.

quote’s score by one, while the other quote will have its score decremented by one. At the same time, the view counts of both quotes are incremented by one as they are both viewed by the user. Thus, if a user skips the first pair and opts for a new pair of quotes, the scores will remain unchanged, but the view count will increment by one for both quotes.

A new metric called win rate is calculated using score and view counts. The quotes with loss counts exceeding a certain threshold will be pulled out of the available quotes pool and eliminated from the competition. This group of quotes is referred to as eliminated quotes.

As the game progresses, more quotes are pulled out and fewer ones remain. The process goes on until only 50 quotes remain in the competition.

Rumi stores user feedback in the competition and finds the quotes that users like the most by ranking them based on the votes each receives from users. The ranking process takes place based on an ELO rating system [51]. Interaction records can be used as the label for training a neural network to reach a better understanding of the quote types each user prefers.

5.5. Connection Recommendation

Friend recommendation in social networks has been widely studied in recent years, which mainly focuses on social relationships and user interests [52]. Facebook, Twitter, Instagram, and many other social platforms offer friend recommendations to users using machine learning algorithms.

Rumi recommends friends to the users on CN as a service named “Connection Recommendation”. The service helps users get linked to each other and find new friends, connect to their classmates, get to know other students at their university, etc.

There are several factors to consider while choosing the right user to recommend to another one, including field of study, job position, age, nationality, language, gender, etc. However, some of these factors are more important than others, and they vary from one platform to another.

CN is a learning environment. Users use CN to learn, communicate, improve their skills, or share their achievements. This purpose helps narrow down the factors to consider for friend recommendations. Based on this purpose, the most important aspects of an ePortfolio for making a connection are determined by the IUPUI CyberLab team including skills, institution, location, etc.

To make more relevant recommendations, Rumi applies some rules in addition to filtering ePortfolios. As an example, Rumi does not recommend a user to another unless they have at least one mutual skill in their ePortfolio. Rumi does not recommend users whose ePortfolio is not visible to the other user. Also, users without profile pictures or bio are removed from Rumi’s recommendation pool since they do not provide enough information to the other user to decide whether they want to make a connection or not.

Rumi then sorts recommendations based on the user activity, Premium membership status, last activity date, etc. Users who are more active on CN get more chances to be reached by other users using the connection recommendation service.

Other than recommending similar users, Rumi is capable of considering user preferences determined directly by the user himself (Figure 8). To put in other words, users can set preferences other than their permanent interests to get connection recommendations. This feature is designed for the users who want to connect to the users with specific features in their ePortfolio. Assume a physics student using Rumi. Typically, she gets users majoring in physics as connection recommendations. But then there is a time when she needs help with a task in her programming course. She wants to get connected to someone majoring in computer engineering to ask for help. Rumi allows her to set new preferences for connection recommendation service to get a new set of recommendations.

Users can decide whether to connect to a recommended user using a follow button or skip the recommendation (Figure 9). Rumi receives the feedback and learns users’ permanent preferences based on that. The feedback helps Rumi make more relevant future recommendations.

Figure 8. Users can change default preferences on the connection recommendation service.

Figure 9. Connection recommendation service offered by Rumi.

5.6. Hashtag Recommendation

With the growth of blogging services, millions of posts are being generated on various platforms each second. Access to a large amount of content arises the need for an efficient way of filtering and categorizing the data. On social networks and microblogging services, users usually use hashtags, types of labels, or metadata tags, to make it easier to find messages with a specific theme or content [53].

Users on CN can create and share posts containing texts, documents, images, etc. They have access to all public posts, and they can view private posts shared with them on their home feed. This large amount of data makes users confused while looking for content they are interested in. Hashtags are innovative tools that become handy to overcome this challenge. They help to classify messages, improve searchability, and allow the organization to link messages to existing knowledge and action communities [54].

Not all users add a hashtag to the posts they share on CN. The reason behind this issue varies from being unaware of the hashtag concept to a lack of time to add proper hashtags to the content. As a personal assistant, Rumi takes the responsibility to suggest related hashtags to label the users’ posts. Rumi provides users with a list of possible hashtags before they finalize and submit their posts. Users can review the recommended hashtags and choose none or multiple ones from Rumi’s recommendation list to label their content. With these hashtags, users can easily search and manage their historical posts and track others’ posts [55].

Rumi is under development to recommend related hashtags to the content users create using a pop-up window containing a list of recommended hashtags. To do so, keyword extraction methods and hashtag recommendation algorithms in machine learning are compared for performance evaluation on CN content.

Unsupervised keyword extraction algorithms including SIFRank [56], Sent2Vec EmbedRank [57], Doc2Vec EmbedRank [57], KeyGames [58], Joint Modeling [59], KeyBert [60], Yake [61], Rake [62], etc. are implemented on user posts, and the performance is measured using Precision, Recall, and F1Score.

Moreover, topic models including Latent Semantic Analysis (LSA) [63] and Latent Dirichlet Allocation (LDA) [64] are also employed to evaluate well-known hashtag recommendation methods on CN data. Results and implementation steps would be discussed in future works.

6. Conclusion

Great achievements in information technology and communication have led to higher-level user expectations in Learning Management Systems including CourseNetworking. One of the advanced technologies helping companies meet user expectations is machine learning. This paper argues how machine learning can contribute to enhancing learning management systems, fulfilling user demands, and introducing a new age of e-learning. Machine learning techniques are employed in CN to create an intelligent agent named “Rumi” to personalize services and add more entertainment and dynamics to the system. Rumi has brought more engagement and personalized learning to CourseNetworking and, potentially, other learning platforms in the near future.

Acknowledgements

Since the launch of the Rumi project at the IUPUI CyberLab, several graduate students and professional software engineers have contributed to the research and development of the Rumi project. All graduate students who have worked on the Rumi project were the recipients of the Jafari Graduate Scholarship from Purdue School of Engineering and Technology.

This paper wishes to acknowledge the research and development contributions of both the Rumi and CourseNetworking teams. The Rumi team at IUPUI CyberLab included Maziar Aboualizadehbehbahani, Mahmood Hosseini, Amirreza Salamat, Emad Rahmaniazad, and Behafarid Mohammad Jafari. The CourseNetworking software engineering team includes David Zeng and Alvan Luo. And last, principal investigator of the Rumi Project, Ali Jafari, professor of Engineering and Technology and Director of the IUPUI CyberLab, and Mengyuan Zhao, Associate Director of R&D of the IUPUI CyberLab.

NOTES

1https://www.thecn.com.

2https://cyberlab.iupui.edu.

3https://www.thecn.com/cn-lti.

4https://www.thecn.com/eportfolio.

5https://marketplace.zoom.us/apps/6U53J8W9SHi9jcuB1oxqQw.

6The section is a summary of a study [48] by Emad Rahmaniazad while working as a graduate student at IUPUI CyberLab.

7The section is a summary of a study [50] by Amirreza Salamat while working as a graduate student at IUPUI CyberLab.

Conflicts of Interest

The authors declare no conflicts of interest regarding the publication of this paper.

References

[1] Economist Intelligence Unit Limited (2001) E-Readiness Rankings. EIU, New York.
[2] Srichanyachon, N. (2014) EFL Learners’ Perceptions of Using LMS. Turkish Online Journal of Educational Technology, 13, 30-35.
[3] Sabharwal, R., Chugh, R., Hossain, M.R. and Wells, M. (2018) Learning Management Systems in the Workplace: A Literature Review. 2018 IEEE International Conference on Teaching, Assessment, and Learning for Engineering, Wollongong, 4-7 December 2018, 387-393.
https://doi.org/10.1109/TALE.2018.8615158
[4] Turnbull, D., Chugh, R. and Luck, J. (2020) Learning Management Systems: An Overview. In: Tatnall, A., Ed., Encyclopedia of Education and Information Technologies, Springer, Berlin, 1052-1058.
https://doi.org/10.1007/978-3-030-10576-1_248
[5] Coates, H., James, R. and Baldwin, G. (2005) A Critical Examination of the Effects of Learning Management Systems on University Teaching and Learning. Tertiary Education and Management, 11, 19-36.
https://doi.org/10.1080/13583883.2005.9967137
[6] Watson, W. and Watson, S.L. (2007) An Argument for Clarity: What Are Learning Management Systems, What Are They Not, and What Should They Become.
[7] Sharma, M. and Srivastav, G. (2020) Study and Review of Learning Management System Software. In: Saini, H.S., Sayal, R., Govardhan, A. and Buyya, R., Eds., Innovations in Computer Science and Engineering, Springer, Berlin, 373-383.
https://doi.org/10.1007/978-981-15-2043-3_42
[8] Comendador, B.E.V., Rabago, L.W. and Tanguilig, B.T. (2016) An Educational Model Based on Knowledge Discovery in Databases (KDD) to Predict Learner’s Behavior Using Classification Techniques. 2016 IEEE International Conference on Signal Processing, Communications and Computing, Hong Kong, 5-8 August 2016, 1-6.
https://doi.org/10.1109/ICSPCC.2016.7753623
[9] Davis, B., Carmean, C. and Wagner, E.D. (2009) The Evolution of the LMS: From Management to Learning. e-Learning Guild, Santa Rosa.
[10] Fan, H. and Poole, M.S. (2006) What Is Personalization? Perspectives on the Design and Implementation of Personalization in Information Systems. Journal of Organizational Computing and Electronic Commerce, 16, 179-202.
https://doi.org/10.1207/s15327744joce1603&4_2
[11] Norvig, P.R. and Intelligence, S.A. (2002) A Modern Approach. Prentice Hall, Upper Saddle River.
[12] Jennings, N.R. (1998) Applications of Intelligent Agents. In: Jennings, N.R. and Wooldridge, M.J., Eds., Agent Technology: Foundations, Applications, and Markets, Springer, Berlin, 3-28.
https://doi.org/10.1007/978-3-662-03678-5_1
[13] Sargent, P. (1992) Back to School for a Brand New ABC. The Guardian, 12, 12-28.
[14] Ovum Report (1994) Intelligent Agents: The New Revolution in Software.
[15] Samuel, A.L. (2000) Some Studies in Machine Learning Using the Game of Checkers. IBM Journal of Research and Development, 44, 206-226.
https://doi.org/10.1147/rd.441.0206
[16] Jordan, M.I. and Mitchell, T.M. (2015) Machine Learning: Trends, Perspectives, and Prospects. Science (New York, N.Y.), 349, 255-260.
https://doi.org/10.1126/science.aaa8415
[17] Koza, J.R., Bennett, F.H., Andre, D. and Keane, M.A. (1996) Automated Design of Both the Topology and Sizing of Analog Electrical Circuits Using Genetic Programming. In: Gero, J.S. and Sudweeks, F., Eds., Artificial Intelligence in Design’96, Springer, Dordrecht, 151-170.
https://doi.org/10.1007/978-94-009-0279-4_9
[18] Bishop, C.M. and Nasrabadi, N.M. (2006) Pattern Recognition and Machine Learning. Vol. 4, No. 4, Springer, New York, 738.
[19] Ozyegen, O., Mohammadjafari, S., Cevik, M., Ethier, J. and Basar, A. (2022) An Empirical Study on Using CNNs for Fast Radio Signal Prediction. SN Computer Science, 3, 1-17.
https://doi.org/10.1007/s42979-022-01022-2
[20] Laohajaratsang, T. (2018) Designing Effective Pedagogical Approaches with Next-Generation LMS for Students in Higher Education. THAITESOL Journal, 31, 1-20.
[21] Vygotsky, L.S. and Cole, M. (1978) Mind in Society: Development of Higher Psychological Processes. Harvard University Press, Cambridge.
[22] Abella-García, V., Delgado-Benito, V., Ausín-Villaverde, V. and Hortigüela-Alcalá, D. (2019) To Tweet or Not to Tweet: Student Perceptions of the Use of Twitter on an Undergraduate Degree Course. Innovations in Education and Teaching International, 56, 402-411.
https://doi.org/10.1080/14703297.2018.1444503
[23] Borge, M., Ong, Y.S. and Goggins, S. (2020) A Sociocultural Approach to Using Social Networking Sites as Learning Tools. Educational Technology Research and Development, 68, 1089-1120.
https://doi.org/10.1007/s11423-019-09721-z
[24] Evans, C. (2014) Twitter for Teaching: Can Social Media Be Used to Enhance the Process of Learning? British Journal of Educational Technology, 45, 902-915.
https://doi.org/10.1111/bjet.12099
[25] Churcher, K., Downs, E. and Tewksbury, D. (2014) “Friending” Vygotsky: A Social Constructivist Pedagogy of Knowledge Building through Classroom Social Media Use. Journal of Effective Teaching, 14, 33-50.
[26] Pinto, M.B. (2014) The Use of Yammer in Higher Education: An Exploratory Study. The Journal of Educators Online, 11, 1-33.
https://eric.ed.gov/?id=EJ1020033
https://doi.org/10.9743/JEO.2014.1.5
[27] VanDoorn, G. and Eklund, A.A. (2013) Face to Facebook: Social Media and the Learning and Teaching Potential of Symmetrical, Sychronous Communication. Journal of University Teaching & Learning Practice, 10, Article No. 6.
https://doi.org/10.53761/1.10.1.6
[28] Sánchez, R.A., Cortijo, V. and Javed, U. (2014) Students’ Perceptions of Facebook for Academic Purposes. Computers & Education, 70, 138-149.
https://doi.org/10.1016/j.compedu.2013.08.012
[29] Aladsani, H.K. (2021) University Students’ Use and Perceptions of Telegram to Promote Effective Educational Interactions: A Qualitative Study. International Journal of Emerging Technologies in Learning, 16, 182-197.
https://doi.org/10.3991/ijet.v16i09.19281
[30] de Lima, M. and Zorrilla, M.E. (2017) Social Networks and the Building of Learning Communities: An Experimental Study of a Social MOOC. International Review of Research in Open and Distributed Learning, 18, 40-64.
https://doi.org/10.19173/irrodl.v18i1.2630
[31] Junco, R., Elavsky, C.M. and Heiberger, G. (2013) Putting Twitter to the Test: Assessing Outcomes for Student Collaboration, Engagement and Success. British Journal of Educational Technology, 44, 273-287.
https://doi.org/10.1111/j.1467-8535.2012.01284.x
[32] Waycott, J., Thompson, C., Sheard, J. and Clerehan, R. (2017) A Virtual Panopticon in the Community of Practice: Students’ Experiences of Being Visible on Social Media. The Internet and Higher Education, 35, 12-20.
https://doi.org/10.1016/j.iheduc.2017.07.001
[33] Wilson, C.D. (2013) Making Connections: Higher Education Meets Social Media. Change: The Magazine of Higher Learning, 45, 51-57.
https://doi.org/10.1080/00091383.2013.806201
[34] Nkhoma, M., Cong, H.P., Au, B., Lam, T., Richardson, J., Smith, R. and El-Den, J. (2015) Facebook as a Tool for Learning Purposes: Analysis of the Determinants Leading to Improved Students’ Learning. Active Learning in Higher Education, 16, 87-101.
https://doi.org/10.1177/1469787415574180
[35] Rambe, P. (2012) Constructive Disruptions for Effective Collaborative Learning: Navigating the Affordances of Social Media for Meaningful Engagement. Electronic Journal of e-Learning, 10, 132-146.
[36] Alhazmi, A.K. and Rahman, A.A. (2012) Why LMS Failed to Support Student Learning in Higher Education Institutions. 2012 IEEE Symposium on e-Learning, e-Management and e-Services, Kuala Lumpur, 21-24 October 2012, 1-5.
https://doi.org/10.1109/IS3e.2012.6414943
[37] Musbahtiti, K. and Muhammad, A. (2013) Improvement Quality of LMS through Application of Social Networking Sites. International Journal of Emerging Technologies in Learning, 8, 48-51.
https://doi.org/10.3991/ijet.v8i3.2669
[38] Jafari, A. and Baylor, A.L. (2012) From Course Management to Course Networking: Conceptualizing a New Learning Environment Based on Social Networking. United States of America.
[39] Berlin, K. and Weavera, K.V. (2021) Teaching Strategies Students Find Helpful in Online Learning Courses. College Teaching, 70, 319-327.
https://doi.org/10.1080/87567555.2021.1940814
[40] Cooney, E.M., Freije, E. and Zhao, M.A. (2020) Using ePortfolios to Facilitate Transfer Student Success. ASEE, Washington DC.
[41] Gavrin, A. and Lindell, R.S. (2017) Connecting Students’ Homework to Their Participation in a Course-Based Social Network.
[42] Scherzinger, L. (2021) CourseNetworking: How a Social Media Platform Can Connect Us in a Crisis. Journal of Teaching and Learning with Technology, 10, 397-399.
[43] Jafari, A. (2020) ePortfolio: A Self-Branding Tool for Students. CourseNetworking.
[44] Jafari, A. (2002) Conceptualizing Intelligent Agents for Teaching and Learning. EDUCAUSE Quarterly, 25, 28-34.
[45] Mohammadjafari, S., Cevik, M., Thanabalasingam, M. and Basar, A. (2021) Using ProtoPNet for Interpretable Alzheimer’s Disease Classification. Canadian Conference on AI, Vancouver, 25-28 May, 2021, 1-12.
https://doi.org/10.21428/594757db.fb59ce6c
[46] Goldenberg, D., Kofman, K., Albert, J., Mizrachi, S., Horowitz, A. and Teinemaa, I. (2021) Personalization in Practice: Methods and Applications. Proceedings of the 14th ACM International Conference on Web Search and Data Mining, Jerusalem, 8-12 March 2021, 1123-1126.
https://doi.org/10.1145/3437963.3441657
[47] Ho, S.Y. (2006) The Attraction of Internet Personalization to Web Users. Electronic Markets, 16, 41-50.
https://doi.org/10.1080/10196780500491162
[48] Rahmaniazad, E. (2021) Community Recommendation in Social Networks with Sparse Data (Version 1). Purdue University Graduate School, West Lafayette.
[49] Linden, G., Smith, B. and York, J. (2003) Amazon.com Recommendations: Item-to-Item Collaborative Filtering. IEEE Internet Computing, 7, 76-80.
https://doi.org/10.1109/MIC.2003.1167344
[50] Salamat, A. (2021) Heterogeneous Graph Based Neural Network for Social Recommendations with Balanced Random Walk Initialization (Version 1). Purdue University Graduate School, West Lafayette.
[51] Pelánek, R. (2016) Applications of the Elo Rating System in Adaptive Educational Systems. Computers & Education, 98, 169-179.
https://doi.org/10.1016/j.compedu.2016.03.017
[52] Cheng, S., Zhang, B., Zou, G., Huang, M. and Zhang, Z. (2019) Friend Recommendation in Social Networks Based on Multi-Source Information Fusion. International Journal of Machine Learning and Cybernetics, 10, 1003-1024.
https://doi.org/10.1007/s13042-017-0778-1
[53] Gong, Y. and Zhang, Q. (2016) Hashtag Recommendation Using Attention-Based Convolutional Neural Network. Proceedings of the Twenty-Fifth International Joint Conference on Artificial Intelligence, New York, 9-15 July 2016, 2782-2788.
[54] Saxton, G.D., Niyirora, J., Guo, C. and Waters, R.D. (2015) #AdvocatingForChange: The Strategic Use of Hashtags in Social Media Advocacy. Advances in Social Work, 16, 154-169.
https://doi.org/10.18060/17952
[55] Wei, Y., Cheng, Z., Yu, X., Zhao, Z., Zhu, L. and Nie, L. (2019) Personalized Hashtag Recommendation for Micro-Videos. Proceedings of the 27th ACM International Conference on Multimedia, Nice, 21-25 October 2019, 1446-1454.
https://doi.org/10.1145/3343031.3350858
[56] Sun, Y., Qiu, H., Zheng, Y., Wang, Z. and Zhang, C. (2020) SIFRank: A New Baseline for Unsupervised Keyphrase Extraction Based on Pre-Trained Language Model. IEEE Access, 8, 10896-10906.
https://doi.org/10.1109/ACCESS.2020.2965087
[57] Bennani-Smires, K., Musat, C., Hossmann, A., Baeriswyl, M. and Jaggi, M. (2018) Simple Unsupervised Keyphrase Extraction Using Sentence Embeddings. Proceedings of the 22nd Conference on Computational Natural Language Learning, Brussels, October 2018, 221-229.
https://doi.org/10.18653/v1/K18-1022
[58] Saxena, A., Mangal, M. and Jain, G. (2020) KeyGames: A Game Theoretic Approach to Automatic Keyphrase Extraction. Proceedings of the 28th International Conference on Computational Linguistics, Barcelona, 8-13 December 2020, 2037-2048.
https://doi.org/10.18653/v1/2020.coling-main.184
[59] Liang, X., Wu, S., Li, M. and Li, Z. (2021) Unsupervised Keyphrase Extraction by Jointly Modeling Local and Global Context. Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, Online and Punta Cana, November 2021, 155-164.
https://doi.org/10.18653/v1/2021.emnlp-main.14
[60] Grootendorst, M. (2020) Keybert: Minimal Keyword Extraction with Bert.
[61] Campos, R., Mangaravite, V., Pasquali, A., Jorge, A.M., Nunes, C. and Jatowt, A. (2018) Yake! Collection-Independent Automatic Keyword Extractor. 40th European Conference on IR Research, ECIR 2018, Grenoble, 26-29 March 2018, 806-810.
https://doi.org/10.1007/978-3-319-76941-7_80
[62] Rose, S., Engel, D., Cramer, N. and Cowley, W. (2010) Automatic Keyword Extraction from Individual Documents. In: Berry, M.W. and Kogan, J., Eds., Text Mining: Applications and Theory, John Wiley & Sons, Hoboken, 1-20.
https://doi.org/10.1002/9780470689646.ch1
[63] Landauer, T.K., Foltz, P.W. and Laham, D. (1998) An Introduction to Latent Semantic Analysis. Discourse Processes, 25, 259-284.
https://doi.org/10.1080/01638539809545028
[64] Blei, D.M., Ng, A.Y. and Jordan, M.I. (2003) Latent Dirichlet Allocation. Journal of Machine Learning Research, 3, 993-1022.

Copyright © 2024 by authors and Scientific Research Publishing Inc.

Creative Commons License

This work and the related PDF file are licensed under a Creative Commons Attribution 4.0 International License.