Share Videos, Not Pills: A Content Analysis of Prescription Drug Videos on YouTube for Presence of Behavior Change Theory ()
1. Introduction
Prescription drug abuse (PDA) is the fastest-growing drug problem in the United States, and the Centers for Disease Control and Prevention (CDC) considers it as a critical public health issue [1] . PDA is the intentional use of a medication either, 1) without a prescription, 2) in a way other than as prescribed, or 3) for the experience or feeling it causes. Whereas it is not a new problem, it is one that deserves renewed attention as rates of abuse and adverse effects continue to increase. About 1 in 9 youths aged 12 to 25 used prescription drugs nonmedically [2] . In 2009, nearly one-third of people aged 12 and over who used illicit drugs for the first time began by abusing a prescription drug [3] . Many prescription drug abusers, particularly teens, believe that these substances are safer than illicit drugs because they are prescribed by a healthcare professional and dispensed by a pharmacist [3] . PDA is likely to persist if these misperceptions and behaviors are not addressed with aggressive prevention efforts. Such efforts may involve elements of mass communication mediums that incorporate health behavior theory constructs, which have been shown to lead to behavior change [4] . Mass media communications, in the context of Internet-based resources, continue to show promise and are ideal for conveying positive health promotion messages [5] .
The use of mass media campaigns as a means of changing health behavior is not uncommon. In recent years, however, the landscape of health-communication has begun changing rapidly with the emergence of online social media, which is still in the early adoption stages [6] . Fostering sustainable behavior change through affordable, community-based social marketing has been a challenge for traditional mediums of mass media campaigns [7] . With few exceptions, the limited success of behavior change efforts for traditional campaigns can be traced to the failure to properly apply health behavior theory to the development and implementation of effective interventions [8] .
A proposed solution to the shortcomings of traditional media campaigns is the adoption of online mediums in which participatory social media plays a crucial role in health communication [9] . Social media combines the positive characteristics of both interpersonal and mass communication, making it a plausible utility for applying health behavior theory to promote behavior change [5] . Thus, online social networks have potential to serve as powerful vehicles to connect with social media users regarding drug use [10] . Addressing these inadequacies requires better analysis of effective public service announcement (PSA) production in online media outlets. The video-sharing website YouTube.com, for instance, is a social media site which presents a compelling platform for PSA distribution. YouTube.com allows users to publish and manage their own videos online, making it possible for amateur video producers to access a global audience. YouTube.com is one of the fastest growing sites in the United States, making it a potential resource for promoting beneficial and pro-social behaviors [11] . It is particularly salient as a potential platform for anti-drug PSAs since youths aged 12 - 17 comprise the largest demographic of viewers [12] .
To address PDA prevention, health promotion may benefit from moving beyond less-effective methods of PSA-production and adapting to an online media-rich environment, incorporating social media sites such as YouTube.com. The purpose of this study was to evaluate the extent to which YouTube.com PSAs include health behavior theory in their prevention of prescription drug abuse.
2. Methods
2.1. Study Design
The study design involved a content analysis of health behavior theory in prescription drug abuse public service announcements (PSA) available on YouTube.com. The instrument and methods used for in this study were adapted from instruments developed by Doshi et al. (2003), which was created to evaluate the integration of health behavior theory in physical activity websites, and Cowan et al. (2012), which was created to evaluate the use of health behavior theory in physical activity iPhone apps [13] [14] . Additionally, two other studies evaluating health messages on YouTube and the inclusion of health behavior theory have been conducted using similar methodology [15] [16] . Two graduate research assistants trained in health behavior theory coded the videos to assess key constructs of 4 major theories of behavior change.
2.2. Sample
The study sample was selected from among YouTube.com videos in October of 2012. Search terms used to identify the study sample included “Prescription drug PSA, short”, and 26 of the most commonly abused name-brand prescription drugs (i.e. “Adderall PSA, short”) [17] . Researchers added the word “short” to the search query to exclude all videos over 4 minutes in length because videos shorter in length are more likely to be viewed in there entirety than longer videos. Furthermore, only videos that were in English language and produced by an organization were included in the study sample. Table 1 includes a list of the search terms and the
number of videos for each search term that met the inclusion criteria. After the inclusion criteria were applied, the final study sample consisted of 209 videos.
2.3. Coding Procedure
An Excel spreadsheet was created to capture the video title, video URL, view count, and length so as to maintain a static sample. Then, two graduate research assistants coded the videos independently after inter-rater reliability was established. Coders watched the sample videos one-by-one, using a theory-based instrument to analyze the video content. Researchers then entered the coded data into an electronic database.
2.4. Measurement
The instrument included constructs from four prominent health behavior theories, which included: the Health Belief Model (HBM), the Transtheoretical Model (TTM), the Theory of Planned Behavior (TPB), and Social Cognitive Theory (SCT). The instrument was comprised of a total of 22 theory-based items. Table 2 displays the theoretical variables included in the instrument. The instrument also included additional items that described the videos including the number of video views, the sponsoring organization (non-governmental organization, government organization, business, non-professional organization), original intended media (e.g. YouTube.com, television, radio), the age of the target audience (young adults, adults, professionals, general audience, other), race/ethnicity of characters in the videos, relationships in the videos (parent to child, friendship, etc.), overt message (out of reach/hidden, don’t share, use only as prescribed, addiction recovery, other), tactics employed, and application of the precede-proceed model (predisposing factors, enabling factors, reinforcing factors).
2.5. Analysis
To verify the level of inter-rater reliability, the two coders independently coded a common 3% of the study videos. A Cohen’s kappa coefficient was calculated to measure inter-rater agreement (k = 0.59). This level of agreement is considered high to moderate agreement, and is an acceptable level of inter-rater agreement [18] . Next, the sample was divided in half, with each half being independently coded by one of the coders. A Cohen’s kappa coefficient was also calculated at the end of the coding on a common sample of 3% of the study videos (k
Table 2. Theory integration and variable measurement, n = 209.
aNote: 1 = Health belief model, 2 = Transtheoretical model, 3 = Theory of planned behavior, 4 = Social cognitive theory.
= 0.63). There was no rater drift during the coding. Each YouTube.com video was coded for 22 theoretical items (Yes—1 No—0). A total theory score was calculated by summing the values from each theoretical variable. Descriptive statistics were calculated for each variable.
3. Results
Characteristics of the study videos are described in Table 3. Non-Governmental organizations posted the largest quantity of videos (38%), followed by governmental organizations (27%) and then non-professional organizations (20%). Business represented the smallest portion of videos (15%). Most videos targeted a general or unspecified audience, and the most common message was that prescription drugs should be used only as prescribed. Other descriptive information is included in Table 3.
The mean total theory score was 3.26 (SD = 1.43) out of a possible twenty-two. Table 4 presents the top ten percent of study videos according to total theory score. This table also displays these videos’ use of each of the four health behavior theories included in the current study. The video with the highest total theory score, “Prescription Drug Abuse from Unison BHG”, used 83% of TPB constructs, 80% of SCT, 36% of HBM and 27% of TTM. Among the top 10% of study videos in total theory score, SCT constructs were coded most often and TTM constructs were coded least often.
Table 3. Descriptive information about YouTube.com study videos, n = 209.
Table 4. Table type styles (table caption is indispensable).
Note: HBM = Health Belief Model; TTM = Transtheoretical Model; SCT = Social Cognitive Theory; TPB = Theory of Planned Behavior.
4. Discussion
Theory-based interventions have been shown to be successful at changing health-related behavior [19] , and may provide an effective framework for PSA-production, both on the individual and organizational level. The current study analyzed the level of health behavior theory inclusion in 209 PSAs found on YouTube.com. Results indicated that most of the sampled videos did not include health behavior theory, a finding that is not unexpected given that YouTube.com is universally accessible to potential PSA-creators, most of whom likely lack formal training in health behavior theory and behavior change. More surprising is the finding that this lack of theory persisted across all observed groups, including NGOs/voluntary organizations, government organizations, and businesses. This low level of theory incorporation in organization-made PSAs highlights the need for collaboration between health behavior-change experts (e.g., public health professionals and certified health education specialists) and organizational PSA creators.
Those videos that did employ elements of health behavior theory typically used a selection of 3 common strategies: 1) general information about PDA, 2) information about benefits of not engaging in PDA, and 3) information about risks of PDA. All other behavioral change strategies were employed by only 11% or fewer of the sampled videos. This result coincided with the findings of Doshi et al. (2003), who concluded that online physical activity websites provided adequate knowledge-based information and guidelines, but incorporated very few theory-based strategies [14] . This and other research has concluded that there is a need for websites to improve interaction and to better tailor assistance to the needs of users, since these methods are expected to have greater impact on behavior change [20] . This is consistent with the traditional approach of health education that largely focuses on the dissemination of health information. While the provision of education is an important part of supporting health behavior change, comprehensive approaches involving more intensive efforts should be included [21] .
The absence of health behavior theory constructs in YouTube.com PDA PSAs presents an opportunity for health behavior specialists. The growing popularity of YouTube.com combined with the pressing need for theory-based PDA interventions should be incentive for health behavior change specialists to team with PSA developers in creating theory-based videos. Public health professionals can both provide expertise in health behavior change theory as well as advise video developers during the PSA developmental process. Video developers, meanwhile, might focus their efforts on creating videos with greater consumer appeal in order to boost the view counts of PSAs. A combination of these approaches might result in PSAs with greater effectiveness in deterring PDA. This study may also help clinicians, public health workers, and health educators make informed decisions about which YouTube PSAs to employ when attempting to combat PDA. These health professionals should take theory scores into account when selecting videos, and should have realistic expectations about the effectiveness of these videos in producing behavior change.
Strengths and Limitations
Although previous studies have assessed health-related YouTube.com videos for adherence to evidence-based practices, this is the first documented study to evaluate the presence of health behavior theory in YouTube.com videos. A major strength of this study is the use of a comprehensive evaluation tool adapted from Doshi et al. (2003). The results should be interpreted in the context of several limitations. First, it is common practice for YouTube.com users to copy videos and repost them to their own YouTube.com channels. As a result of this practice, a number of duplicate videos were found within the initial sample. For each set of duplicates, the video with the higher view count was retained and the others were removed from the study.
Furthermore, the broad search term “prescription drug PSA, short” might have been too general to return videos from all legitimate PDA campaigns. To address this challenge, a series of drug-specific YouTube.com searches were employed in order to include campaigns that might have been otherwise excluded by the general search. Lastly, the use of two video coders presented a limitation since the coding process is, to a certain extent, subjective. To address this challenge, the coders communicated throughout the study in order to adjudicate any discrepancies with respect to coding. To quantify the level of agreement, the coders performed two inter-rater reliability tests, one at the beginning of coding and one at the end. The concern regarding multiple coders was, in part, mitigated when the tests yielded Cohen’s kappa coefficients in the acceptable ranges for studies of this nature.
5. Conclusion
Most of the videos studied in this analysis utilized few theoretical constructs. However, there is a great potential for future partnership. Future steps may include the use of randomized control trials of YouTube.com videos to determine the efficacy of theory-based videos compared to videos that are not based on theory. Findings from this research, combined with the results of this study, would inform organizations that desire to create effective public service announcements. This also creates potential partnership opportunities between these organizations and health and behavior change experts, resulting in videos that incorporate theoretical constructs from established health behavior theories.