A Systematic Review of Literatures on Factors Associated with Educational and Academic Performance in Attention Deficit Hyperactivity Disorder ()
1. Introduction
Attention Deficit Hyperactivity Disorder (ADHD) is the most common neuropsychiatric disorder in children and adolescents (Polanczyk, de Lima, Horta, Biederman, & Rohde, 2007) . The prevalence rate is similar across countries in Europe and throughout the world and is estimated at 5.3% (Polanczyk et al., 2007) . Core symptoms of ADHD comprise inappropriate levels of inattention, hyperactivity and impulsivity (Goodman & Livingston, 2013) . Multiple follow-up studies have been published that show ADHD persists into adolescence and adulthood in around two-thirds of the population (Faraone, Biederman, & Mick, 2006; Lara et al., 2009) . Adult ADHD is estimated to have a worldwide-pooled prevalence of 4.4% (Polanczyk et al., 2007) . It has been shown that ADHD impairs major areas of life, including quality of life (QoL), social relations, family functioning, and education and occupational functioning (Danckaerts et al., 2009; Nijmeijer et al., 2008; Coghill et al., 2008; van der Kolk et al., 2014) .
DSM-IV criteria (Diagnostic and Statistical Manual of Mental Disorders, 4th edition) state that a diagnosis of ADHD is only confirmed if the child exhibits a number of inattentive, impulsive and hyperactive behaviors over a period of six months, which started before the age of seven, which should be present in school and at home, and which significantly impair daily functioning (American Psychiatric Association, 2000) . In practice, indeed problems in school often bring the child with ADHD to clinical attention (Loe & Feldman, 2007) . Numerous studies have reported on the association of ADHD and poorer grades, poorer reading and math standardized test scores, and increased grade retention (Loe & Feldman, 2007; Trampush, Miller, Newcorn, & Halperin, 2009; Rabiner, Anastopoulos, Costello, Hoyle, & Swartzwelder, 2008; DuPaul, Weyandt, O’Dell, & Varejao, 2009; Biederman et al., 2008) . Also, children with ADHD are more likely to use special educational services than children without ADHD (Hakkaart-van Roijen et al., 2007) . As several studies report on lower IQ (intelligence quotient) in children with ADHD compared to youth of the same age and gender without the disorder, it could be the case that IQ is related to the educational problems rather than specific ADHD symptoms (Biederman, Fried, Petty, Mahoney, & Faraone, 2012) . However, even when taking IQ into account, children with ADHD showed significant educational under-attainment relative to what would have been expected on their intellectual potential (Biederman et al., 2008) . Therefore, it could be the case that several factors together account for the lower average education achievements in children and adolescents with ADHD. It seems fair to conclude that there is a general consensus on a certain but not precisely defined negative impact of ADHD on school outcome. However, there is no consensus on the specific cause for this impact: is it the ADHD itself that causes the impact or are underlying factors at stake?
Given these considerations, this systematic review focuses on the following question: “Is it possible to identify factors that have been demonstrated to be associated with educational and academic performance in ADHD based on the current available evidence, and if so: which factors are those?” This research will contribute to understanding the impact of ADHD on educational and academic performance and will offer insights for studies or interventions to decrease the negative impact. To our knowledge, no other systematic review has been perfor- med on this specific topic so far.
2. Methods
A literature search on English-language articles was conducted using the PubMed® (Public Medline) database (biomedical literature from MEDLINE®-Medical Literature Analysis and Retrieval System Online, life science journals, and online books) to gain insight in the association of ADHD and educational and academic performance. The search was focused on articles published in PubMed from January 2000 till the final search that was conducted on October 13th 2014.
2.1. Guidelines Systematic Review
Assessment of the tracked records followed the PRISMA guidelines for methodology (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) (Moher, Liberati, Tetzlaff, & Altman, 2009) . PRISMA is the most often used methodology for reporting systematic reviews, expressing the aim of standardized reporting and enhancing the clarity of systematic reviews with a generic approach (Fleming, Koletsi, & Pandis, 2014) .
2.2. Identification and Screening
For this search, the Medical Subject Headings (MeSH®) for indexing PubMed citations were used, but no extra subheadings were selected. The key words were combined with the term “ADHD” using the PubMed Search Builder. The single MeSH term ADHD was used with selection of “Restrict to MeSH Major Topic”. The following broad terms were used and a filter was used during the search on publication date (2000 onwards), and language (English): MeSH term “education” with selection of “Restrict to MeSH Major Topic”.
Specific PubMed search:
“Attention Deficit Disorder with Hyperactivity” [Majr] AND (“Education” [Majr]) AND (“2000/01/01” [PDAT]: “2014/10/13” [PDAT]) AND (“English” [Filter]).
All search results were combined into a single master Reference Manager (RM) database. References within the master RM database were transferred to Excel and then screened independently by both AvdK and MvA based on title for the following keywords to identify articles of possible relevance: “ADHD”; “Attention Deficit Hyperactivity Disorder”; “Attention-Deficit Hyperactivity Disorder”; “Attention Deficit-Hyperactivity Disorder”; “Attention Deficit/Hyperactivity Disorder”; “Attention Deficit/Hyperactivity-Disorder”; “Attention-Deficit/ HyperactivityDisorder”; accompanied with either one of the keywords:
“(Special) education(al)”; “school(ing)”; “homework”; “IQ”; “(primary/high) school”; “student(s)”; “academy’, “academic(al)”; “college”; “graduation”; “university”; “training”; “class(room)”.
Articles were then screened by abstract by two authors, again independently (AvdK and MvA). The following in- and exclusion criteria were applied: Inclusion: ADHD needed to be the major area of interest of the study, but comorbidity was not necessarily an exclusion criterion. Studies were only included if they provided data an- alyses. The review aimed to include explanatory articles for the relationship between ADHD and poorer educational performance. Therefore, also articles presenting outcomes of a certain class-room intervention were included, since we assumed this could provide information on beneficial factors related to ADHD and educational outcome which in turn provide information on impacting features. Articles with a focus on for example working memory and ADHD were also included, as this could provide specific information on explanatory factors for the negative impact of ADHD on school outcome. If no abstract was available, this study was included for full-text selection to be sure not to miss relevant information. Articles were excluded if the study was descriptive or an essay not containing the generation of data. Studies with the clear aim of analyzing if ADHD in fact accounts for a lower grade point average, increased school drop-out or other factual representations of worse educational outcome were excluded, since the focus of our review was on explanatory variables and not on the relationship itself. Articles describing interventions for teachers and/or parents to overcome problems related to ADHD were excluded, since we wanted to provide an answer to possible associations related to the ADHD schoolchild/stu- dent rather than the teacher or parent. Studies on abuse of medication by non-ADHD adolescents or drug-abuse by ADHD students were excluded. Articles with a focus on diagnosing ADHD in a specific setting were excluded. In this review, the snowball procedure was not applied, since the research question was not as specific as can be in a search for clinical trials, so we decided to keep the focus on the PubMed results to increase replication possibilities. Disagreement regarding eligibility was resolved through discussion and mostly by inclusion of the article for full-text review. Table 1 provides an overview of the literature search.
2.3. Eligibility
Articles selected for full-text screening based on screening on title and abstract were then synthesized in a qualitative way by the two researchers (AvdK and MvA). There was no disagreement on articles selected for qualita-
Table 1. Table type styles Literature search.
tive analysis. Since the validity of a systematic review has more direct practical implications, possibility for synthesis and assessment of results was based on a flowchart presented by the Finnish Institute of Occupational Health (Verbeek, Ruotsalainen, & Hoving, 2012) . Based on the flowchart, results were analyzed by means of narrative synthesis, that is, describing the results as well as possible (Verbeek et al., 2012) . This method was chosen, since the various study elements (especially outcome) were not similar enough in structure between the different articles to combine results. This narrative process also provides ideas for implications for future research. The narrative approach was preferred over the levels of evidence method described by the Cochrane Back Review Group and the vote counting method, since these methods are mainly based on p-values.
There was no specific focus in this review on the way the diagnosis of ADHD was stated. This was decided, since no uniformly agreed upon diagnostic tool for ADHD exists. Therefore, no clear cut-off rule could be established regarding which diagnostic tool would be deemed valid and which would be not. In general, it is assumed that a clinical interview should be part of diagnosis to be able to incorporate ADHD symptoms and their impact, but also academic and social functioning should be assessed (Kutcher et al., 2004; Buitelaar, Wilens, Zhang, Ning, & Feldman, 2009) . However, five guidelines published by governmental organizations in Europe do not show consensus on the proper diagnostic process (Scottish Intercollegiate Guidelines Network (SIGN), 2009; Insituto superiore di sanita (ISS), 2009; Trimbos-instituut in opdracht van Landelijke Stuurgroep Multidisciplinaire Richtlijontwikkeling in de GGZ, 2005; National Institute of Health and Clinical Excellence (NICE), 2008; Arbeitsgemeinschaft ADHS (AG ADHS), 2007) . Therefore, we relied on the validity of the diagnosis of ADHD as stated by the authors of the included articles.
The first data extraction included country of origin, sample size, and research question. A second table was constructed based on main findings, and conclusions for the articles included.
3. Results
The master database included 376 records, no duplicates were found. These 376 records were screened by title for relevant articles. Of these, 185 articles were screened by abstract and 35 articles were identified for inclusion in the review. Figure 1 presents the screening process in more detail. For each of the studies included in the qualitative synthesis, Table 2 displays the country of origin, the number of participants and the research question. Table 3 presents the main outcomes per included study. The articles were grouped together based on their subject, these groups were not determined beforehand in order to be as inclusive as possible, but evolved based on the content of the articles eligible for inclusion. Meta-analysis was not feasible owing to the heterogeneity in outcomes reported across all study types included in the review; however, results per study type were combined and used for concluding statements.
The 35 articles selected were based on studies executed in several countries or regions, however, the United States of America (USA) was the main source of evidence: USA n = 24, Canada and Israel n = 2, Netherlands, Australia, Taiwan, Spain, Italy, Belgium, Germany n = 1, total of Europe n = 11. Most articles reported on an ADHD group and a group of controls (n = 25). Results are reported based on their content and their assigned domain. Topics were articles related to training, coaching, instruction, educational consultation; educational environment; pharmacological treatment; symptoms, symptom severity and persistence of symptoms; predictive factors or associations of ADHD with academic outcomes; self-concept; or working memory or a specific skill.
3.1. Training, Coaching, Instruction, Educational Consultation
A total of five studies were related to this domain, three from USA and two from Israel (Gol & Jarus, 2005; Shalev, Tsal, & Mevorach, 2007; Dupaul et al., 2006; Curtis, Chapman, Dempsey, & Mire, 2013; Parker, Hoffman, Sawilowsky, & Rolands, 2013) . The studies focused on the possible beneficial effect of certain types of training for school-children with ADHD (n = 4; age 6 - 13) and college students (year: freshman to senior)
Figure 1. Flow diagram of screened and included articles.
Table 2. Country of origin, sample size and research questions of selected articles.
USA: United states of America; NL: The Netherlands.
(Parker et al., 2013) . All five studies reported on beneficial effects of training, consultation or coaching on academic functioning. Effects were reported for specific tasks (math or reading), but also for the basic characteristics of ADHD related to externalizing behavior and attention problems with the largest influence on attention problems. Amongst others, coaching helped to be more self-regulated (ability to control one’s emotions, behavior, and desires in the face of external demands), which was reported by students (college sample), teachers (children with ADHD showed better motivation and study skills) and parents (reduction in symptoms of inattentiveness). So, training could improve attention in school and account for more self-regulated behavior.
3.2. Educational Environment or Tool
Four studies reported on educational environment or a tool used to deliver knowledge to either an ADHD or a control group (Origin Italy, USA, Belgium and Germany; respondent’s age 6 - 14 years) (Fabio & Antonietti, 2012; Adams, Finn, Moes, Flannery, & Rizzo, 2009; Imeraj et al., 2013; Lauth, Heubeck, & Mackowiak, 2006) . Topics related to acquiring and attaining knowledge, distraction, and behavior in general in relation to class conditions (class structures and academic content types). Children with ADHD were more distracted compared to controls and had a shorter on-task span during academic tasks (mathematics, language, and sciences). However, this shorter on-task span was not present during music and arts. Also, learning via a computer-based service yielded better results compared to traditional instruction and could specifically improve outcomes related to attention deficits. Another environmental outcome was better functioning while working in a small group compared to individual tasks or whole class work. Individual task work accounted for more problems than whole class work.
3.3. Pharmacological Treatment
Four studies were related to ADHD and pharmacological treatment, three were originated in USA, one in Spain (Miranda, Jarque, & Rosel, 2006; Evans et al., 2001; Dupaul et al., 2012; Advokat, Lane, & Luo, 2011) . Studies were focused on the effect of different types of pharmacotherapy (stimulants and non-stimulants) on study habits, academic achievement in general, ADHD symptoms and executive functioning. One of the studies was a double- blind, placebo-controlled study reporting a positive effect on symptom relieve (inattention and hyperactivity), but this study was not specifically designed to report on academic achievements (Dupaul et al., 2012) . The other studies reported beneficial effects of pharmacological treatment on concentration, planning, organization, executive functioning and working memory. More specifically to studying, effects on note-taking quality and homework completion were reported.
3.4. Symptoms, Symptom Severity and Persistence of Symptoms
The DSM-IV divides the symptoms of ADHD into two groups: symptoms of inattention and symptoms of hyperactivity-impulsivity (American Psychiatric Association, 2000) . Five studies reported on subtype symptoms,
Table 3. Outcomes and reported associations of selected articles.
symptom severity, and persistence of symptoms (Barnard, Stevens, To, Lan, & Mulsow, 2010; Kent et al., 2011; Norvilitis, Sun, & Zhang, 2010; Rabiner et al., 2008; Wu & Gau, 2013) . Four studies were USA based; one was executed in Taiwan (Wu & Gau, 2013) . One study was both related to pharmacological treatment (specifically with a stimulant) and subtype symptom class (Barnard et al., 2010) . The result was that especially inattentiveness was related to worse academic outcomes with effects on self-efficacy and depressive symptoms. Depressive symptoms independently turned out to be related to college and social adjustment. Baseline symptom severity turned out not to be significant predictors for grade point average, class attendance, or drop-out, although the ADHD group was significantly more absent and tardy compared to controls. Two studies reported on IQ and concluded on a significantly lower IQ for ADHD students (Kent et al., 2011; Wu & Gau, 2013) .
3.5. Predictive Factors or Associations of ADHD with Academic Outcomes
Two USA studies related to factors associated with ADHD and problems in college specifically (Meaux, Green, & Broussard, 2009; Blase et al., 2009) . One study also searched for factors that can help students with ADHD, although only 15 respondents were included in this qualitative study (Meaux et al., 2009) . Inattention turned out to be present to a larger extent compared to hyperactivity. Students with ADHD reported challenges to academic success due to difficulties in focus, completing work in time and poorer time management and organization skills. Coping with the ADHD and managing challenges in everyday life were also mentioned by the ADHD group related to difficulties with academic success. Depressive symptoms and emotional instability were present to a larger extent in the ADHD population.
3.6. Self-Concept
One’s self-concept (also called self-construction, self-identity, self-perspective or self-structure) is a collection of beliefs about oneself that includes elements such as academic performance gender roles, sexuality and racial identity and accounts for the regard for oneself as a person (Wilmshurst, Peele, & Wilmshurst, 2011) . Four studies from USA and one from Australia were focused on studies related to (predictors of low) self-esteem, ratings of own behavior, and psychological well-being (Shaw-Zirt, Popali-Lehane, Chaplin, & Bergman, 2005; Martin, 2014; Prevatt et al., 2012; Wilmshurst et al., 2011; Bussing, Zima, & Perwien, 2000) . All four studies were based on an ADHD group compared to controls. It is suggested that reported levels of self-esteem mediates the relation between ADHD and college adjustment. Next to that, children with ADHD reported significantly lower self-esteem and scores were lowest for children with ADHD and comorbid internalizing problems, especially in the areas of anxiety and popularity, although females tend to report better social skills. Medication use was not a predictor of lower self-esteem scores. Students’ capacity to successfully overcome setback and challenge (academic buoyancy) was significantly associated with outcomes for students with ADHD and also academic buoyancy was positively correlated with academic achievement and engagement. On the other hand, one study reported that students with ADHD were more engaged in the bias of thinking they are “better than average” (positive illusory bias), which is in contrast with lower self-esteem.
3.7. Working Memory or a Specific Skill
Working memory refers to the ability to temporarily maintain and manipulate information necessary for achieving a certain goal (Gropper, Gotlieb, Kronitz, & Tannock, 2014) . The largest group of studies (n = 9) reported on working memory or related to time estimation, explanatory style, or written expression (Sparks, Javorsky, & Philips, 2004; Gropper et al., 2014; Gropper & Tannock, 2009; Lineweaver et al., 2012; Jones, Craver-Lemley, & Barrett, 2008; Prevatt, Proctor, Baker, Garrett, & Yelland, 2011; Prins, Dovis, Ponsioen, ten, & van der Oord, 2011; Semrud-Clikeman & Harder, 2011; Shmulsky & Gobbo, 2007) . ADHD students display significant weaknesses in the auditory-verbal working memory tasks compared to controls and were significantly worse in time estimation abilities. When using computer-based working memory training with game elements, ADHD children showed better training performance, and better working memory outcomes compared to regular computer-based training, although students with ADHD trained with computerized working memory training also showed significantly greater improvements and self-reported fewer ADHD symptoms and cognitive failures. Executive function, written expression and passing of foreign language courses did not relate to significant differences between ADHD and control students.
4. Discussion
This systematic review focused on the question: Is it possible to identify factors that have been demonstrated to be associated with educational and academic performance in ADHD based on the current available evidence, and if so: which factors are those? This question was raised, since based on available literature it can be concluded that there is a certain negative impact of ADHD on school outcome, but without consensus on the specific cause for this impact. The study focused on articles presenting results of data-based analysis related to the main topic ADHD and specific keywords related to education. A total of 35 studies met the eligibility criteria for this analysis. They were analyzed by means of narrative synthesis since outcomes were too heterogeneous to combine results. The articles related to seven different domains; educational training, educational environment; pharmacological treatment; symptomatology, associations of ADHD with academic outcomes, self-concept, and specific skills.
One main finding stands out when trying to answer the question: is it the ADHD itself that causes the impact on educational achievements or are underlying factors at stake? When reviewing all included studies, the main source of problems seems to be associated with the inattentive symptoms of ADHD and not so much in the hyperactive or impulsive symptoms. This outcome is different than expected, since hyperactive symptoms, which are more prominently pronounced, are usually the main cause of referral to clinical evaluation, probably since teachers and other students experience burden of particularly those symptoms (Skounti, Philalithis, & Galanakis, 2007; Polanczyk et al., 2007) . It also has been reported that the prevalence of the hyperactive-impulsive subtype decreases when children get older, whereas the inattentive subtype increases (Nolan, Gadow, & Sprafkin, 2001) . This is a very important finding in the light of the results of this systematic review. The ongoing impact of ADHD, which frequently maintains into adulthood, seems to be associated with inattentiveness and according to our review, it is the inattentiveness that seems to be associated with educational performance. This yields important information as to which areas to target when it comes to opting for clinical or non-clinical interventions in order to mitigate the impact of the ADHD.
Studies relating to educational environment and content showed that ADHD children in general had a shorter on-task span, but were better able to perform in small group work, in music and art classes and in learning via a computer-based service, especially when including game-elements. ADHD students showed weaknesses in the auditory-verbal working memory. Studies reporting on training and coaching concluded on beneficial effects of different training types, with especially positive effects on inattentive symptoms and related behavior. Pharmacological treatment showed beneficial effects on concentration, planning, organization, executive functioning and working memory. Problems in school can also be related to occupational achievements, since individuals that are diagnosed with ADHD often continue to have problems during adulthood and into their working life (Barkley, Fischer, Smallish, & Fletcher, 2002) . The negative impact of ADHD on work performance of adults has been demonstrated in extensive surveys (de Graaf et al., 2008; Kessler et al., 2005) . ADHD is associated with 22 - 35 annual days of lost role performance compared to respondents without ADHD related to decrements in work performance or absence (de Graaf et al., 2008; Kessler et al., 2005) . These problems in working life might be mitigated when proper help is offered when in school.
A factor that might play a role in the large impact of inattentive symptoms on educational and academic outcomes is the existence of comorbidities. In ADHD, symptom overlap or comorbidity with other conditions is the rule rather than the exception (Rommelse et al., 2009; Gillberg et al., 2004) . In our review, ADHD was required to be the major area of interest of the study, but comorbidity was not necessarily an exclusion criterion. The review concluded that the inattentiveness also affected self-efficacy and depressive symptoms which in turn influence the relation between ADHD and educational and academic outcome. Also, children with ADHD are at high risk of adolescent depression (Chronis-Tuscano et al., 2010) . Next to the influence of inattentiveness on school outcome, our review found that depressive symptoms also influence the effect of ADHD and academic outcome. Another phenomenon frequently mentioned in this respect that could be involved in comorbidity and academic outcome is stigmatization (DosReis, Barksdale, Sherman, Maloney, & Charach, 2010) . Stigma can have a harmful effect on social functioning and can increase depressive symptoms (Shaw-Zirt et al., 2005) . Stigmatization can be obvious and direct, for example when a classmate makes a negative remark about the ADHD (DosReis et al., 2010) . Our review showed that social functioning of ADHD children improved after a social skills training and therefore potentially could reduce the harmful effect of stigmatization. Next, our review found that female participants in general reported better social skills than male participants do. Taking this into account, stigmatization might affect boys more than girls, due to more obvious symptoms (hyperactivity) and having less social skills to begin with.
As with all research, the value of a systematic review depends on what was done, what was found, what was reported and what was concluded (Moher et al., 2009) . A limitation of this review is related to its sources: selection of patients is not always clear. In our review, there was no specific focus on the method of diagnosing ADHD. This was decided upon, since no clear cut-of could be established of which ADHD diagnostic would be included. We choose not to focus on this specific aspect of the studies, since no evidence would have been left for inclusion in this review due to the lack of a uniform method of diagnosis. We therefore had to rely on the investigators’ discretion in guaranteeing the validity of the diagnosis of ADHD in their subjects. However, future studies might choose to specifically focus on method of diagnosing ADHD and the influence on educational outcomes. As described, comorbidity is often present in children and adolescents with ADHD. In the articles included in our review, we did not specifically focus on the existence of comorbidity or the moderating effect that comorbidity could have. Finally, treatment status of respondents was not always reported (adequately), so the establishment of a clear relationship between impact of ADHD and the mitigation by certain treatment types cannot properly be made.
This review highlights areas of interest for future studies. As school systems and referring systems differ between countries, it is recommendable to perform studies on the effect of ADHD in several countries at the same time. Finally, more longitudinal studies might contribute a lot to the knowledge on the effect of ADHD on education and academic performance and occupational performance later in life.
5. Conclusion
The main association of educational and academic problems seems to be the inattentive symptoms (or subtype) of ADHD. This outcome is different than expected, since hyperactive symptoms are more prominently pronounced. The answer to the question if the ADHD itself causes the impact on negative educational outcomes or that underlying factors at stake is that both seem to be true. The inattentive symptoms of ADHD tend to be associated with most of the problems experienced, but also other factors like educational environment, depression and self-concept seem to play a role. Since ADHD is considered a treatable disorder the negative impact on educational and academic outcome has the potential to be mitigated if patients are diagnosed and treated adequately (Weiss, Gadow, & Wasdell, 2006; Matza et al., 2004; Barkley, 2008) . More important for the patients at stake, next to a relief of clinical symptoms, proper help when diagnosed with ADHD might also help children and adults to achieve educational goals that now are sometimes out of reach. Especially, overcoming negative outcomes of inattentiveness should be a major focus, next to improvement of social skills to deal with everyday life in schools (especially in males). Simple interventions could be found in environmental changes, since children with ADHD showed better functioning while working in a small group. Lower education outcome in its turn will also have an economic impact in the end (Biederman et al., 2008) . More attention and support should be given to ADHD students to improve their chances in society and the economic influence of ADHD based on lower academic levels should be an important foundation when it comes to allocating resources to support ADHD patients.
NOTES
*Corresponding author.