Ability of the Mini-Mental State Examination to Predict the Neuropsychological Performance of Hispanic Patients with Minor Neurocognitive Disorder

Jorge A. Herrera Pino, Norella S. Jubiz Bassi, Jose Armas, Nora Dieguez

Medical Care Consortium, Inc. (MCCI), Miami, USA.
Neurobehavioral Institute of Miami, Miami, USA.

DOI: 10.4236/psych.2014.55044                

Abstract

The Mini-Mental State Examination is perhaps the most frequently used instrument to determine level of cognitive functioning. However, while it is cited in a wide range of research studies, it is not necessarily the focus of study itself. The purpose of this study was to establish the ability of the MMSE total score to predict the level of neurocognitive functioning of two samples of Hispanic patients with minor neurocognitive disorder in a battery of neuropsychological tests. Two samples of patients, one obtained in 2009 and a second one in 2013 were grouped into high scoring and low scoring in the MMSE. The results showed that the MMSE total score was predictive of the performance of both samples in neuropsychological tests designed to assess attention, language, non-verbal memory, and visual-constructional praxis. Scores in an auditory verbal memory task was not predicted by the total score of the MMSE. It was concluded that the MMSE could serve as a very adequate instrument to predict neurocognitive functioning in patients with memory complaints. The consistency of findings between the two independent samples gave further credence to this assertion.

Keywords

Mini-Mental State Examination, Neuropsychological Evaluation, Minor Neurocognitive Disorder, Mild Cognitive Impairment

1. Introduction

The Mini-Mestal State Examination (MMSE; Folstein, Folstein, & McHugh, 1975; Folstein et al., 2001, 2002) was proposed by its authors as a relatively quick measure of cognitive functioning. This is especially important for patients whose endurance or perseverance are poor, given their condition. Among these are primarily the elderly and the patients that suffer from symptoms of dementia or cognitive impairment. This instrument was also proposed as a standardized procedure that could be used more than once to assess cognitive decline.

The validity and reliability of the MMSE were initially reported by Fostein, Folstein and McHugh (1975) in two samples of patients with dementia, depression with cognitive impairment, and depression. The value of 20 points as a cutoff score between patients and controls was established on the basis of the examination of 137 patients and 63 healthy controls.

The MMSE is made up of 11 items, which yield a total score of 30 points. The areas of cognitive functioning assessed by this instrument are: orientation, memory, attention, language, and visual constructional praxis.

The MMSE is, perhaps, the instrument of its type of greater utilization in the field of brain-behavior assessment. However, it has not been until recently that frequent bibliographical references about this instrument itself in regards to dementia and other neurological disorders have been introduced. The MMSE is used frequently in a description of the characteristics of participant samples in a wide range of research, but it is not always itself the subject of study. Thus, a review of the literature that mentions the use of the MMSE reveals that the majority of studies are not about the instrument itself.

The use of the MMSE is at present almost universal. The literature shows that it has been used in research conducted in Sweden (Rönnlund et al., 2005; Dickerson et al., 2005), Holland (Spaan, Raaijmakers, & Jonker, 2005), France (Elbaz et al., 2005; Haubois et al., 2011; Bugnicourt et al., 2013), Argentina (Sarasola et al., 2005), the United States (Daniels et al., 2012; Buckingham et al., 2013), Finland (Alhola et al., 2005; Wikman & Summala, 2005), Canada (Alagiakrishnan et al., 2013), Italy (Caffarra et al., 2013), Australia (Faux et al., 2010; Cameron et al., 2012), Norway (Fjærtoft et al., 2011), Korea (Kim et al., 2010; Park et al., 2014), Belgium (Adam et al., 2005), Brazil (Alencar et al., 2010), China (Malhotra et al., 2013; Tsemg, et al., 2013) and Japan (Yajima et al., 2013), among others.

The MMSE has been used with a variety of patients suffering from a number of neurological and systemic conditions. Among these are dementias, including Alzheimer's disease (Sarasola et al., 2005; Foldi et al., 2005; Adam et al., 2005; O’Hara et al., 2005; Festa et al., 2005; Lipton et al., 2005; Bartzokis et al., 2006; Khachiyants & Kim, 2012; Malhotra et al., 2013; Caffarra et al., 2013; Razlighi et al., 2014). Mild cognitive impairment has also been traditionally a condition with which the MMSE has been frequently used (Boyle et al., 2005; Dickerson et al., 2005; Jack et al., 2005; Haubois et al., 2011; Cameron et al., 2012; Alagiakrishnan et al., 2013).

In 2013, with the advent of the fifth edition of the diagnostic and statistical manual of mental disorders (DSM- 5; American Psychiatric Association, 2013) what had been referred to previously as mild cognitive impairment was raised to the level of a formal diagnosis with the name of minor neurocognitive disorder.

The aim of the present study is to determine the ability of the MMSE to predict neurocognitive functioning in two samples of Hispanic patients who have complained to their primary care physicians of having memory difficulties in a battery of neuropsychological tests.

2. Methodology

2.1. Ethical Considerations

The study was approved by the Institutional Review Board of the Medical Care Consortium. Inc. (MCCI) as an archival, cross-sectional, quasi-experimental research.

2.2. Participants

The study included two independent samples of Hispanic patients that had been referred to the Cognitive Health Program of the Medical Care Consortium, Inc. (MCCI) for neuropsychological evaluation by their primary care physicians for complaining of memory difficulties, and thus, given a diagnosis of minor neurocognitive disorder. These patients were administered a battery of neuropsychological tests, including the MMSE. MCCI is a multicenter health care provider that offers primary and specialized medical services in out-patient settings.

The data for the first group was gathered in 2009. This sample was made up of 100 otherwise healthy patients, who were referred consecutively to the Cognitive Health Program of MCCI for neuropsychological evaluation by their primary care physicians for presenting memory complaints.

The 2009 sample was subsequently divided into two other groups, according to the scores obtained in the MMSE. A total of 30 participants were included in the low score group (MMSELS). The mean value of the total score of the MMSE for this group was 19.73, with a standard deviation of 2.57. Another 30 participants were included in the high score group (MMSEHS). The average total score of the MMSE for this group was 28.73, with a standard deviation of 0.73. A Student-t test of statistical significance showed that the difference between these two means was significant (p < 0.000).

The data for the second group was gathered in 2013. This group also consisted of 100 otherwise healthy patients of Hispanic origin that were seen consecutively for the purpose of administering a neuropsychological test battery, as referred by their primary care physicians. They were enrolled in the Cognitive Health Program of MCCI, where they subsequently received cognitive rehabilitation services (Herrera Pino et al., 2013).

The sample of 100 participants was divided into two groups, according to their performance in the MMSE. Of these, 30 participants were assigned to the low score group (MMSELS). The mean total score in the MMSE for this group was 20. 38 (sd = 2.37). A group of 30 participants was designated as the high score sample (MMSEHS). The mean value of the total score in the MMSE of this sample was 28.62 (sd = 0.70). A Student-t test of statistical significance revealed that these two means differed significantly (p < 0.000).

3. Instruments and Procedures

All participants in this study, including the 2009 and 2013 samples, were administered the MMSE, together with a battery of neuropsychological instruments configured in a process oriented eclectic paradigm. The neuropsychological instruments included in this battery were the written (SDW); and oral (SDO) administrations of the Symbol Digit Modalities Test (Smith, 1973, 1982, 2002), the Controlled Oral Word Association Test (COW; Lezak, Howieson, & Loring, 2004; Spreen & Strauss, 1998), and the Boston Naming Test (BNT; Kaplan, Goodglass, & Weintraub, 1983, 1996).

In addition to these, the administrations RAI (recall of the list in the first trial), RAV (recall of the list in the fifth trial), and RAD (recall of the list with a 20-minute delay) of the Rey Auditory Verbal Learning Test (Schmidt, 1996), the copy (ROC) and delayed (30 minutes) (ROM) administrations of the Rey Osterrieth Complex Figure Test (Rey, 2003; Meyers & Meyers, 1995), and the Revised Benton Visual Retention Test (BVR; Benton, 1974, 2002; Sivan, 1992) were also included in the battery of instruments administered to all of the participants of this research study. The neuropsychological tests were administered to all of the participants in this study in Spanish, as this was their preferred language.

4. Data Analysis

The differences between the mean values obtained by the MMSELS group and the MMSEHS group in the 2009 and 2013 samples in the different neuropsychological instruments administered to them were analyzed by means of the Student-t statistical procedure for independent means.

5. Results

As can be seen in Table 1, the demographics of the 2009 sample showed a significant difference in the mean total scores of the MMSE, as well as in their level of education. No significant difference was found in regards to the mean age value of both groups.

In Table 2, the differences between the mean values obtained by the MMSELS group and the MMSEHS group of the 2009 sample can be seen. The MMSE was able to predict to differences in these means in all of the measures taken, except two of them. In the RAI condition of administration of the Rey Auditory Verbal Learning Test, the patients had to recall as many words as they could from a list of 15 words presented to them aurally. It is interesting to note that both groups, MMSELS and MMSEHS, performed poorly in this task.

In the RAD condition of administration of the same instrument, the scores did not differ significantly either. This task required the patients to recall the list of 15 words that had been presented previously five times after a 20-minute delay. Once again, both groups performed poorly in this task.

Table 1. Demographics by group (2009) sample.                                                              

MMSELS = Mini Mental Status Exam Low Scoring; MMSEHS = Mini Mental Status Exam High Scoring; ( ) Standard Deviation ^*p ≤ 0.000; ^**p ≤ 0.001.

Table 2. Means and standard deviations in neuropsychological tests by group (2009 sample).                          

MMSELS = Mini Mental Status Exam Low Scoring; MMSEHS = Mini Mental Status Exam Low Scoring; SDO = Symbol Digit Modalities Oral; SDW = Symbol Digit Modalities Written; COW = Controlled Oral Word Association; BNT = Boston Naming Test; RAI = Rey Auditory Verbal Learning (I); RAV = Rey Auditory Verbal Learning (V); RAD = Rey Auditory Verbal Learning (D); ROC = Rey Osterrieth Complex Figure Copy; ROM = Rey Osterrieth Complex Figure Memory; BVR = Benton Visual Retention; ( ) Standard Deviation; ^*p ≤ 0.000.

Table 3 shows the demographic values for both the MMSELS and the MMSEHS groups in the 2013 sample. Just as it was the case with the 2009 sample, these groups differed significantly in their MMSE mean total scores, as well as in their level of education. However, no significant differences were noted in age.

An inspection of

Table 4 reveals that the differences between the mean values obtained by the MMSELS group and the MMSEHS group of the 2013 sample in the different neuropsychological instruments included in the battery administered to all study participants were statistically significant, except for the RAI condition of administration of the Rey Auditory Verbal Learning Test. Once again, the participants of both groups performed poorly in this task.

6. Discussion

The results obtained in the present study clearly contribute to lend further credence to the use of the MMSE in the process of assessing the cognitive status of patients with minor neurocognitive disorder. This instrument was Table 3. Demographics by group (2013 sample).                                                              

MMSELS = Mini Mental Status Exam Low Scoring; MMSEHS = Mini Mental Status Exam High Scoring; ( ) Standard Deviation; ^*p ≤ 0.000.

Table 4. Means and standard deviations in neuropsychological tests by group (2013 sample).                          

MMSELS = Mini Mental Status Exam Low Scoring; MMSEHS = Mini Mental Status Exam Low Scoring; SDO = Symbol Digit Modalities Oral; SDW = Symbol Digit Modalities Written; COW = Controlled Oral Word Association; BNT = Boston Naming Test; RAI = Rey Auditory Verbal Learning (I); RAV = Rey Auditory Verbal Learning (V); RAD = Rey Auditory Verbal Learning (D); ROC = Rey Osterrieth Complex Figure Copy; ROM = Rey Osterrieth Complex Figure Memory; BVR = Benton Visual Retention; ( ) Standard Deviation; ^*p ≤ 0.000; ^**p ≤ 0.002.

shown to be capable of predicting the performance of patients with minor neurocognitive disorder in a number of different neuropsychological instruments. In addition to this, the present study fulfills one of the most important premises in scientific research. The scientific method is based on the notion that it facilitates the replication of previous findings, in order to make knowledge stronger. Two totally independent samples of patients were used in this investigation, one sample studied in 2009 and a second sample in 2013.

An inspection of the results obtained by both samples, not only in the MMSE, but also in the neuropsychological instruments included in the battery used in the assessment of all participants, reveals more than acceptable level of consistency. In both samples, the MMSE was able to predict the performance of the participants of the study in a variety of higher cerebral functions assessed by the different instruments included in the battery used. This included the attentional and incidental memory processes assessed by both conditions of administration, oral and written, of the Symbol Digit Modalities Test, as well as the working memory and sustained attention abilities assessed by the Revised Benton Visual Retention Test.

The MMSE was also shown to be capable to predict in both samples of patients the language skills assessed by the Controlled Oral Word Association Test, as well as the naming function of language assessed by the Boston Naming Test. Visual constructional praxis and incidental visual memory assessed by the Rey Osterrieth Complex Figure Test were also among the higher cerebral functions predicted by the scores in the MMSE.

In the 2009 sample, the MMSE was not predictive of the auditory verbal learning memory functions assessed by the RAI and RAD conditions of administration of the Rey Auditory Verbal Learning Test, nor was it predictive of the values obtained in the RAI by both MMSELS and MMSRHS groups in the 2013 sample. A plausible explanation of these findings is that the patients included in this study may well have suffered from what, until 2013, was referred to as amnestic mild cognitive impairment.

7. Conclusions and Recommendations

The findings of this study support the use of the MMSE in the assessment process of patients with what has been previously known as mild cognitive impairment, and currently referred to as minor neurocognitive disorder. It should be noted, however, that any screening instrument, such as the MMSE runs the risk of producing a false negative finding. In the case of the MMSE, in particular, the literature shows that normative samples usually have a very tight distribution, reflected in very small values for the standard deviation. On the other hand, pathological samples have traditionally shown a much greater dispersion, as reflected in higher values for the standard deviation (Herrera Pino et al., 2007).

This is exactly the case of the scores obtained in the MMSE by both the 2009 and 2013 samples assessed in this study. In the 2009 sample, the mean value of the total score of the MMSE for the high-scoring group was 28.73, with a standard deviation of 0.78. The mean value in a total score of the MMSE for the high-scoring group in the 2013 sample was 28.62, with a standard deviation of 0.70. The standard deviation as a measure of dispersion did not even reach a value of one point in either of the samples.

In contrast to this, the mean MMSE total score for the low-scoring group of the 2009 sample was 19.73, with a corresponding standard deviation of 2.57. The mean MMSE total score value for the low-scoring group of the 2013 sample was 20.38, and the standard deviation was 2.37. It is interesting to note that in the review of the literature pertaining to the MMSE conducted by Herrera Pino et al. (2007), this type of finding was consistent across studies conducted even in different countries.

These findings mean that, whereas, the more cognitively intact samples do not vary greatly from their measure of central tendency, pathological or clinical samples may include individuals that even though they may have a relatively high score in the MMSE, they may still suffer from a significant degree of cognitive impairment, or even conditions such as dementia. A positive finding in the MMSE may well be taken as a solid basis for formulating diagnostic impression, but a negative finding needs to be further validated by the use of a more formal assessment procedure, such as a neuropsychological evaluation.

It is also recommended that the study be conducted with community living elderly individuals without any cognitive impairment or neurological condition. This will allow a better generalization of results to the population at large.

Conflicts of Interest

The authors declare no conflicts of interest.

References

[1]	Adam, S., Van der Linden, M., Collette, F., Lemauvais, L., & Salmon, E. (2005). Further Exploration of Controlled and Automatic Memory Processes in Early Alzheimer’s Disease. Neuropsychology, 19, 420-427. http://dx.doi.org/10.1037/0894-4105.19.4.420
[2]	Alagiakrishnan, K., Zhao, N., Mereu, L., Senior, P., & Senthilselvan, A. (2013). Montreal Cognitive Assessment Is Superior to Standardized Mini-Mental Status Exam in Detecting Mild Cognitive Impairment in the Middle-Aged and Elderly Patients with Type 2 Diabetes Mellitus. BioMedical Research International, 2013, 1-5. http://dx.doi.org/10.1155/2013/186106
[3]	Alencar, R. C., Cobas, R. A., & Gomes, M. B. (2010). Assessment of Cognitive Status in Patients with Type 2 Diabetes through the Mini-Mental Status Examination: A Cross-Sectional Study. Diabetology & Metabolic Syndrome, 2, 1-6. http://www.dmsjournal.com/content/2/1/10
[4]	Alhola, P., Tallus, M., Kilmala, M., Portin, R., & Polo-Kamola, P. (2005). Sleep Deprivation, Cognitive Performance, and Hormone Therapy in Postmenopausal Women. Menopause: The Journal of the North American Menopause Society, 12, 149-155.
[5]	American Psychiatric Association (2013). Diagnostic and Statistical Manual of Mental Disorders (5th ed.). Washington DC: American Psychiatric Association.
[6]	Bartzokis, G., Lu, P. H., Geschwind, D. H., Edwards, N., Mintz, J., & Cummings, J. L. (2006). Apolipoprotein E Genotype and Age-Related Myelin Breakdown in Healthy Individuals: Implications for Cognitive Decline and Dementia. Archives of General Psychiatry, 63, 63-72. http://dx.doi.org/10.1001/archpsyc.63.1.63
[7]	Benton, A. L. (1974). Revised Visual Retention Test (4th ed.). New York: The Psychological Corporation.
[8]	Benton, A. L. (2002). Test de Retención Visual de Benton: Manual (5th ed.). Madrid: TEA Ediciones, S.A.
[9]	Boyle, P. A., Wilson, R. S., Aggarwal, N. T., Arvanitakis, Z., Kelly, J., Bienias, J. L., & Bennert, D. A. (2005). Parkinsonian Signs in Subjects with Mild Cognitive Impairment. Neurology, 65, 1901-1908. http://dx.doi.org/10.1212/01.wnl.0000188878.81385.73
[10]	Buckingham, D. N., Mackor, K. M., Miller, R. M., Pullam, N. N., & Molloy, K. N. (2013). Comparing the Cognitive Screening Tools: MMSE and SLUMS. PURE Insights, 2, Article 3.
[11]	Bugnicourt, J. M., Godefroy, O., Chillon, J. M., Choukroun, G., & Massy, Z. A. (2013). Cognitive Disorders and Dementia in CKD: The Neglected Kidney-Brain Axis. Journal of the American Society of Nephrology, 24, 1-11. http://dx.doi.org/10.1681/ASN.2012050536
[12]	Caffarra, P., Gardini, S., Dieci, F., Copelli, S., Maset, L., Concari, L., Farina, L., & Grossi, E. (2013). The Qualitative Scoring MMSE Pentagon Test (QSPT): A New Method for Differentiating Dementia with Lewy Body from Alzheimer’s Disease. Behavioural Neurology, 27, 213-220.
[13]	Cameron, J., Worrall-Carter, L., Page, K., Stewart, S., & Ski, C. F. (2012). Screening for Mild Cognitive Impairment in Patients with Heart Failure: Montreal Cognitive Assessment versus Mini Mental State Exam. European Journal of Cardiovascular Nursing. http://dx.doi.org/10.1177/1474515111435606
[14]	Daniels, T. B., Brown, P. D., Felten, S. J., Wu, W., Buckner, J. C., Arusell, R. M., Curran, W. J.. Abrams, R. A., Schiff, D., & Shaw, E. G. (2011). Validation of EORTC Prognostic Factors for Adults with Lowgrade Glioma: A Report Utilizing Intergroup 86-72-51. International Journal of Radiation Oncology and Biological Physics, 81, 218-224. http://dx.doi.org/10.1016/j.ijrobp.2010.05.003
[15]	Dickerson, B. C., Salat, D. H., Greve, D. N., Chua, E. F., Rand-Giovannetti, E., Rentz, D. M., Bertram, L., Mullin, K., Tanzi, R. E., Blacker, D., Albert, M. S., & Sperling, R. A. (2005). Increased Hippocampal Activation in Mild Cognitive Impairment Compared to Normal Aging and AD. Neurology, 65, 404-411. http://dx.doi.org/10.1212/01.wnl.0000171450.97464.49
[16]	Elbaz, A., Ripert, M., Tavernier, B., Février, B., ureik, M., Gariépy, J., Alpérovich, A., & Tzourio, C. (2005). Common Carotid Artery Intima-Media Thickness, Carotid Plaques, and Walking Speed. Stroke, 36, 2198-2202. http://dx.doi.org/10.1161/01.STR.0000181752.16915.5c
[17]	Faux, N. G., Ritchieb, C. W., Gunna, A., Rembacha, A., Tsatsanisa, A., Bedod, J., Harrisone, J., Lannfeltf, L., Blennowg, K., Zetterbergg, H., Ingelssonf, M., Masters, C. I., Tanzih, R. E., Cummings, J. L., Herdjm, C. M., & Busha, A. I. (2010). PBT2 Rapidly Improves Cognition in Alzheimer’s Disease: Additional Phase II Analyses. Journal of Alzheimer’s Disease, 20, 509-516.
[18]	Festa, E. K., Insler, R. Z., Salmon, D. P., Paxton, J., Hamilton, J. M., & Heindel, W. C. (2005). Neocortical Desconnectivity Disrupts Sensory Integration en Alzheimer’s Disease. Neuropsychology, 19, 728-738. http://dx.doi.org/10.1037/0894-4105.19.6.728
[19]	Fjærtoft, H., Rohweder, G., & Indredavik, B. (2011). Stroke Unit Care Combined with Early Supported Discharge Improves 5-Year Outcome: A Randomized Controlled Trial. Stroke, 42, 1707-1711. http://dx.doi.org/10.1161/STROKEAHA.110.601153
[20]	Foldi, N. S., Schaeffer, L. A., White, R. E. C., Johnson, R., Berger, J. P., Carney, M. T., & Macina, L. O. (2005). Effect of Graded Levels of Physical Similarity and Density on Visual Attention in Patients with Alzheimer’s Disease. Neuropsychology, 19, 5-17. http://dx.doi.org/10.1037/0894-4105.19.6.728
[21]	Folstein, M. F., Folstein, S. E., & McHugh, P. R. (1975). “Mini-Mental State”: A Practical Guide for Grading the Cognitive State of Patients for the Clinician. Journal of Psychiatric Research, 12, 189-198. http://dx.doi.org/10.1016/0022-3956(75)90026-6
[22]	Folstein, M. F., Folstein, S. E., McHugh, P. R., & Fanjiang, G. (2002). MMSE Examen Cognoscitivo Mini-Mental. Madrid: TEA Ediciones, S.A.
[23]	Folstein, M. F., Folstein, S. E., McHugh, P. R., & Fanjiang, G. (2001). Mini-Mental Status Examination. Odessa, FL: Psychological Assessment Resources.
[24]	Haubois, G., Annweiler, C., Launay, C., Fantino, B., de Decker, L., Allali, G., & Beauchet, O. (2011). Development of a Short Form of Mini-Mental State Examination for the Screening of Dementia in Older Adults with a Memory Complaint: A Case Control Study. BMC Geriatrics, 11, 59-64. http://www.biomedcentral.com/1471-2318/11/59 http://dx.doi.org/10.1186/1471-2318-11-59
[25]	Herrera Pino, J. A., Armas, J., Dieguez, N., & Alarcon, E. (2013). Conceptual Foundations of a Cognitive Health Program for Hispanic Patients with Minor Neurocognitive Disorder. Psychology, 4, 23-28. http://dx.doi.org/10.4236/psych.2013.410A005
[26]	Herrera, J. A., & Vargas, J. L. (2007). Handbook of Neuropsychological Examination of Dementia. Coral Gables, FL: Interamerican Academy of Applied Cognitive Neuroscience.
[27]	Jack, C. R., Shiung, M. M., Weigand, S. D., O’Brien, P. C., Gunter, J. L., Boeve, B. F., Knopman, D. S., Smith, G. E., Ivnik, R. J., Tangalos, E. G., & Petersen, R. C. (2005). Brain Atrophy Rates Predict Subsequent Clinical Conversion in Normal Elderly and Amnestic MCI. Neurology, 65, 1227-1231. http://dx.doi.org/10.1212/01.wnl.0000180958.22678.91
[28]	Kaplan, E. F., Goodglass, H., & Weintraub, S. (1983). The Boston Naming Test (2nd ed.). Philadelphia, PA: Lea & Febiger.
[29]	Kaplan, E. F., Goodglass, H., & Weintraub, S. (1996). Test de Vocabulario de Boston (2da. ed.). Buenos Aires: Editorial Médica Panamericana.
[30]	Khachiyants, N., & Kim, L. (2012). Mini-Mental Status Examination Mapping to the Corresponding Brain Areas in Dementia. ATI-Applied Technologies & Innovations, 7, 55-58. http://www.academicpublishingplatforms.com
[31]	Kim, T. H., Jhoo, J. H., Park, H. J., Kim, J. L., Ryu, S. H., Moon, S. W., Choo, H., Lee, D. W., Yoon, J. C., Do, Y. J., Lee, S. B., Kim, M. D., & Kim, K. W. (2010). Korean Version of Mini Mental Status Examination for Dementia Screening and Its Short Form. Psychiatry Investigation, 7, 102-108. http://dx.doi.org/10.4306/pi.2010.7.2.102
[32]	Lezak, M. D., Howieson, D. D., & Loring, D. W. (2004). Neuropsychological Assessment (4th ed.). New York, NY: Oxford University Press.
[33]	Lipton, A. M., Ohman, K. A., Womack, K. B., Hynan, L. S., Ninman, E. T., & Lacritz, L. H. (2005). Subscores of the FAB Differentiate Frontotemporal Lobar Degeneration from AD. Neurology, 65, 726-731. http://dx.doi.org/10.1212/01.wnl.0000174437.73416.7b
[34]	Malhotra, C., Chan, A., Matchar, D., Seow, D., Chuo, A., & Do, Y. K. (2013). Diagnostic Performance of Short Portable Mental Status Questionnaire for Screening Dementia among Patients Attending Cognitive Assessment Clinics in Singapore. Annals of the Academy of Medicine Singapore, 42, 15-19.
[35]	Meyers, J. E., & Meyers, K. R. (1995). Rey Complex Figure Test and Recognition Trial. Odessa, FL: Psychological Assessment Resources.
[36]	O’Hara, R., Schroeder, C. M., Kraemer, H. C., Kryla, N., Cao, C., Miller, E., Schatzberg, A. F., Yesavage, J. A., & Murphy, G. M. (2005). Nocturnal Sleep Apnea/Hypopnea Is Associated with Lower Memory Performance in APOE ε4 Carriers. Neurology, 65, 642-644. http://dx.doi.org/10.1212/01.wnl.0000173055.75950.bf
[37]	Park, B., Jun, J. K., & Park, J. (2014). Cognitive Impairment and Depression in the Early 60s: Which Is More Problematic in Terms of Instrumental Activities of Daily Living? Geriatrics & Gerontology International, 14, 62-70. http://dx.doi.org/10.1111/ggi.12055
[38]	Razlighi, Q. R., Stallard, E., Brandt, J., Blacker, D., Albert, M., Scarmeas, N., Kinosian, B., Yashin, A. I., & Stern, J. (2014). A New Algorithm for Predicting Time to Disease Endpoints in Alzheimer’s Patients. Journal of Alzheimer’s Disease, 38, 1-14.
[39]	Rey, A. (2003). Test de Copia y Reproducción de Memoria de Figuras Complejas (8th ed.). Madrid: TEA Ediciones, S.A.
[40]	Ronnlund, M., Nyberg, L., Backman, L., & Nilsson, L. (2005). Stability, Growth, and Decline in Adult Life Span Development of Declarative Memory: Cross-Sectional and Longitudinal Data from a Population-Based Study. Psychology and Aging, 20, 3-18. http://dx.doi.org/10.1037/0882-7974.20.1.3
[41]	Sarasola, D., de Luján-Calcagno, M., Sabe, L., Crivelli, L., Torralba, T., Roca, M., García-Caballero, A., & Manes, F. (2005). El Addenbrooke’s Cognitive Examination en espanol para el diagnóstico de demencia y para la diferenciación entre enfermedad de Alzheimer y demencia frontotemporal. Revista de Neurología, 41, 717-721.
[42]	Schmidt, M. (1996). Rey Auditory Verbal Learning Test: A handbook. Los Angeles, CA: Western Psychological Services.
[43]	Sivan, A. B. (1992). Benton Visual Retention Test (5th ed.). San Antonio, TX: The Psychological Corporation.
[44]	Smith, A. (1973). Symbol Digit Modalities Test. Los Angeles, CA: Western Psychological Services.
[45]	Smith, A. (1982). Symbol Digit Modalities Test. Los Angeles, CA: Western Psychological Services.
[46]	Smith, A. (2002). SDMT: Test de Símbolos y Dígitos. Madrid: TEA Ediciones, S.A.
[47]	Spaan, P. E. J., Raaijmakers, J. G. W., & Jonker, C. (2005). Early Assessment of Dementia: The Contribution of Different Memory Components. Neuropsychology, 19, 629-640. http://dx.doi.org/10.1037/0894-4105.19.5.629
[48]	Spreen, O., & Strauss, E. (1998). A Compendium of Neuropsychological Tests (2nd ed.). New York, NY: Oxford University Press.
[49]	Wikman, A., & Summala, S. (2005) Aging and Time-Sharing in Highway Driving. Optometry and Vision Science, 82, 716-723.
[50]	Yajima, K., Matsushita, T., Sumitomo, H., Sakurai, H., Katayama, T., Kanno, K., Sakai, M., Shigeta, M., Shirabe, S., Nakano, T., Nishimura, K., Ueki, A., & Kitaoka, M. (2013). One-Minute Mental Status Examination for Category Fluency Is More Useful than Mini-Mental State Examination to Evaluate the Reliability of Insulin Self-Injection in Elderly Diabetic Patients Receiving Insulin Therapy. Journal of Diabetes Investigation. http://dx.doi.org/10.1111/jdi.12159