Evaluation of Expression Recognition Function in Autism Spectrum Disorder Using Near-Infrared Spectroscopy ()
1. Introduction
Autism Spectrum Disorder (ASD) is a developmental disorder that manifests in infancy. It is characterized by impaired interpersonal communication and reciprocal social interaction, in addition to limited and repetitive patterns of behaviors, interests, and activities [1] .
Although people with ASD exhibit a diverse pattern of behavior, the specificity in facial and expression recognition is a particularly important research theme. With ASD, the ability to infer others’ intentions and emotions from their expressions is impaired [2] , and people with ASD often show a prominent deficit in their interpersonal behaviors. Being able to recognize the faces and facial expressions of others is greatly involved in social development [3] , and the specificity in the recognition of expressions is believed to be a possible foothold for developing a treatment.
There have been reports that people with ASD look at the mouths and noses of others, rather than the eyes, which provide a stronger indication of physical expression [4] [5] [6] . The difficulties of expression recognition in people with ASD may be caused by atypical expression-processing. It was reported that when expression recognition was examined using five types of expression stimuli (happiness, sadness, anger, surprise, and neutral); people with ASD had a lower number of correct responses than those without ASD [5] .
In terms of brain regions involved in expression recognition, research using functional magnetic resonance imaging (fMRI) and Positron Emission Tomography (PET) revealed that the fusiform gyrus, superior temporal sulcus, amygdala, and inferior frontal gyrus are involved in this process [7] [8] [9] [10] . It has been found that the activation reaction in these brain regions is lower in people with ASD than in those without [11] [12] [13] [14] . Using fMRI, Schultz et al. [14] examined brain activity when people perceived faces and objects. Their results showed that in the face identification task, activation reaction of the fusiform gyrus facial area, which plays an important role in facial perception processing, was found to be lower in the ASD group than in the control group. Meanwhile, the activation reaction of the inferior temporal gyrus was found in the ASD group. Conversely, activation reaction of inferior temporal gyrus was found in the control group when perceiving objects.
Dapretto et al. measured brain activity when subjects are observing or imitating facial expressions and found that children with ASD had lower pars opercularis activity than typically developing children [11] . The pars opercularis is an important component of the Mirror Neuron System (MNS). Dapretto et al. proposed a mirror neuron disorder theory to be part of ASD pathology [11] .
A Near-Infrared Spectroscopy (NIRS) is a method of capturing change in cerebral blood flow associated with neural activities using near-infrared rays [15] . The fMRI and PET have excellent spatial resolution and are extremely effective in identifying sections exhibiting brain dysfunction. However, there are many difficulties in using fMRI and PET for people with ASD, as well as infants, because of their loud noise, physical restriction, and resulting exposure to radiation. By contrast, a NIRS is small in size and can be carried around [16] . After simply attaching a probe to the head, it can evaluate brain function easily and non-invasively. Furthermore, NIRS is not restrictive and has the advantage of allowing a real-time measurement when asking the subject to perform a task [17] [18] .
In recent years, there have been attempts to use NIRS to evaluate the prefrontal cortex functions of people with ASD. It has been reported that people with ASD show a decrease in activity in the prefrontal cortex while they are performing verbal fluency and executive function tasks [19] [20] . Kita et al. reported on the functional deficiency in the right inferior frontal gyrus, which is involved in recognizing one’s own face, in children with ASD [21] . Mori et al. [21] examined the activities in the frontal cortex, which is involved in imitation of expressions, of children with ASD and children with typical development. The activation of the inferior frontal gyrus on both sides was found to be significantly lower in children with ASD than in typically developing children [21] .
On the other hand, Hosokawa et al. examined the relationship between autistic tendencies and the frontal cortex blood mobilization in expression recognition tasks in healthy people [22] . Results showed that when a healthy person exhibited thoughts and behavioral patterns characteristic of ASD, it was difficult for them to recognize expressions, and they had decreased prefrontal cortex activity. However, studies that have used NIRS to evaluate the expression recognition function using people with ASD as subjects are still few in number [23] [24] .
Using the expressions of fear and happiness, Kamio et al. reported that the automatic processing of emotional faces had been impaired within an ASD group [25] . Nakamura et al. reported that in their PET study, the right hemisphere of the lateral inferior frontal gyrus was activated in healthy subjects during a conscious expression evaluation task [10] . Using the results of these reports, the present study uses two expression-processing tasks: one automatic and one conscious. We used NIRS to examine the blood mobilization in the frontal cortex of people with ASD when they were performing expression recognition tasks.
The objective of this study was to clarify the effectiveness of NIRS in identifying the functional abnormality of the frontal cortex during the expression-processing process of people with ASD.
2. Methods
2.1. Subjects
The subjects were twenty males aged between 18 and 22 years who had been diagnosed with ASD. The ASD group comprised of outpatients of Tokushima University Hospital who had been diagnosed by a specialist using DSM-V diagnostic criteria [1] . Most of the patients who participated in this study were diagnosed with ASD around 3 years of age. Those who were on medication during the examination, as well as those who exhibited clear symptoms of depression or mental illness, were excluded. Their intellectual level was evaluated using the Wechsler Adult Intelligence Scale, Fourth Edition. The control group was comprised of forty-five healthy, male university students who were matched with the ASD group in terms of age and sex. They attended Tokushima University and had no problems with their academics or general school life. In both groups, the degree of their autistic tendencies was evaluated using the Japanese edition of the Autism-Spectrum Quotient (AQ) [26] [27] . AQ is comprised of fifty items and is a self-administrated evaluation scale in which anyone, including healthy people, can be screened for autistic tendencies. The cut-off point is 33, with higher AQ scores indicating autistic tendencies. Each individual filled out the test after undergoing NIRS examination. In the ASD group, subjects and their guardians filled out the AQ together.
2.2. Expression Recognition Task
The expression recognition task was developed by referencing the facial expressions that Hosokawa et al. used eight facial expressions (anger, sadness, happiness, contempt, disgust, surprise, fear and neutral) [22] . Static images of Japanese models were selected from the ATR (ATR International Human Information Science Laboratories) face database containing eight facial expressions [28] . This face database includes images of the basic facial expressions of 60 male and 60 female Japanese models. The expressions were created by combining the eight expressions of six males and four females. The subject sat on a comfortable chair and viewed the faces on a computer screen. On a 15.6-in (screen size: 34.5 cm × 19.4 cm) laptop, 25 × 19.4 cm photographs of facial expressions were presented. The visual range was approximately 50 cm, but the positions and angles were adjusted so that the photos were easy for the subjects to see according to personal factors such as height and body build. The subjects were asked to identify the sex of each person in the photo and the type of expression they exhibited by touching a piece of paper with “male”, “female”, and the eight expression types printed on it. The paper was positioned in front of the screen where the subjects could easily reach out and indicate with their finger. The subjects were asked not to make major movements with their head and eyebrows during the testing.
Task 1: automatic expression-processing task
This task was to measure the activation reaction in the prefrontal cortex during an automatic expression-processing process that did not mediate recognition processing. With the control task, the subjects were shown random pictures of expressionless men and women on the computer screen every two seconds, and were asked to determine which gender they were. In the activation task, pictures of men and women with the seven non-neutral expressions (happiness, sadness, anger, disgust, surprise, fear, and contempt) were shown randomly every two seconds, and the subjects were asked to select only which gender they were by pointing with their fingers.
Task 2: conscious expression-processing task
This task was to measure the activation reaction when subjects consciously identified the facial expression. The same computer and photographs of facial expressions from Task 1 were used. The control task involved showing photographs of expressionless men and women on the computer every four seconds, with the subjects being asked to indicate with their fingers both the gender of the models in the photographs as well as which of them were expressionless. In the activation task, photographs of 7 types of non-neutral facial expressions were shown at random every four seconds, with the subjects asked to select the gender and the expression with their fingers. The number of correct responses and incorrect responses of expression recognition in these tasks were used to calculate the rate of correct responses.
2.3. NIRS Data Collection Methods
NIRS measurements were performed using ETG4000, a 24-channel NIRS system (Hitachi Medical Corporation, Tokyo, Japan), at two wavelengths of near-infrared light (695 and 830 nm), the absorption of which was measured, and concentration changes of oxygenated hemoglobin (oxy-Hb) and deoxygenated hemoglobin (deoxy-Hb) were calculated using the difference of absorbance based on the Beer-Lambert law. The distances between injector and detector were 3.0 cm, and it was determined that the machine measures points 2 - 3 cm beneath the scalp, that is, the surface of the cerebral cortices. The probes of the NIRS machines were symmetrically placed on a subject’s bilateral frontal regions. Two plastic shells to which nine optodes were attached were symmetrically fixed on the left and right forehead. The probes on the bilateral frontal region measured the relative concentrations of oxy-Hb and deoxy-Hb changes at 12 measurement points in a 6 × 6-cm area in the left and right hemispheres, respectively, with the lowest probes positioned along the Fp1-Fp2 line, according to the international 10/20 electrode system used for electroencephalography. The distances from the midline to the most medial and the most lateral probes were 3.0 and 9.0 cm, respectively. Ch3 and Ch8 correspond to the left inferior frontal gyrus (Broca’s area) [29] . The time resolution of the NIRS machine was set at 0.1 second.
The control task (60 seconds) and the activation task (60 seconds) were alternated three times each for both Task 1 and Task 2. After the concentration changes of oxy-Hb were added, the variation in NIRS signal (changes in concentration of oxy-Hb) was calculated by subtracting the control task result from the activation task result, and the result was used as a statistical analysis subject.
2.4. Data Analysis
The group comparison of age, years of education, AQ, rate of correct expression responses during Task 2, and change in the concentration of oxy-Hb, were done using the Mann-Whitney-U test. The correlation between these groups was calculated using the Spearman’s rank correlation coefficient. The comparison of the left and the right for each channel of NIRS signal variation (change in the concentration of oxy-Hb) was examined using the paired t-test. The statistical analysis was done using SPSS 24 (SPSS Inc., Chicago, IL, USA). The level of statistical significance was set at 0.05.
A priori power of the study was estimated using G*power (version 3.1) [30] . Sufficient sample size of this study using an alpha 0.05, a power of 0.95, Two-tailed test: Mann-Whitney-U test’s computed desired sample size was 18; paired t test’s computed desired sample size was 54; and the Correlation’s computed desired sample size was 46, and based on the aforementioned assumptions.
2.5. Ethical Considerations
This research study was approved by the Tokushima University Hospital Ethics Board (No. 1671). Subjects were assured that their personal information would be protected, and the results of the study would only be reported as aggregate data, and used only for research purposes. The purpose and procedure of the study were explained to all subjects and informed consent was obtained from the subjects. A similar explanation was given to the guardians of ASD patients and students under the age of 20, and in these cases, consent was obtained from the guardians.
3. Results
The ASD group was comprised of 20 males (age; range: 18 - 22, median: 20.5 years old; all subjects were right-handed). The IQ of the ASD group was between 95 and 114 (median: 103). The control group consisted of 45 right-handed males (age; range: 18 - 22, median: 21.0 years old). The number of years of education for the ASD group was between 12 and 16 (median: 13) and between 12 and 16 (median: 15) for the control group, with the control group having a significantly higher number of years of education (p < 0.001). The AQ for the ASD group was between 23 and 46 (median: 35) and between 8 and 33 (median: 17) for the control group (Table 1).
3.1. AQ and Rate of Correct Expression Response
The relationship between AQ and rate of overall correct expression is displayed in a distribution map (Figure 1). In the ASD group, AQ was plotted in high positions, and the correct response rates were plotted in low positions. Although no correlation was found in either the ASD group or the contrast group, when the relationship between AQ and rate of correct expression response was examined after combining the two groups, a negative correlation (ρ = −0.40 p < 0.001) was found.
When the ASD group and the control group were compared, the AQ was significantly
Mann-Whitney-U test; IQ: Wechsler Adult Intelligence Scale, Fourth Edition; AQ: Autism-Spectrum Quotient.
Figure 1. The correlation between AQ and rate of overall correct expression response. When the ASD group and control group were combined and examined together, it showed a negative correlation between AQ and rate of correct responses (ρ = −0.40 p < 0.001).
higher in the ASD group than in the control group (p < 0.001), and the rate of overall correct expression response was significantly lower in the ASD group than in the control group (p < 0.001). In the rate of each correct expression response, the rates of “fear” “contempt” “disgust” and “surprise” were significantly lower in the ASD group than in the control group (Table 2). In the ASD group, it was noticeable that the expression of “fear” was wrongly answered as “sadness” or “surprise”. Many cases with ASD mistook the expression of “disgust” for “anger”, and the expression of “contempt” for “disgust”.
3.2. Comparison of NIRS Signal Variation (Oxy-Hb Concentration Changes) in the Expression Recognition Task
Figure 2 shows the mean trend graph of change in the concentration of oxy-Hb in the ASD group and control group in Task 1 (automatic expression-processing
Table 2. The group comparison for rate of correct expression response.
Mann-Whitney-U test.
Figure 2. The change in the concentration of oxy-Hb in Task 1. (a) = ASD group (n = 20); (b) = control group (n = 45). Grand average waveform of hemoglobin concentration changes during the task 1 for ASD group and control group. Red, oxygenated hemoglobin (oxy-Hb); blue, deoxygenated hemoglobin (deoxy-Hb); green, total hemoglobin (total-Hb). Black arrow, activation task period. In the automatic expression-processing task, both the ASD and control groups showed virtually no activation of the prefrontal cortex. Ch.18.20.21 was found to have significantly decreased in the control group (p < 0.05, Mann-Whitney-U test). The left and the right differences for each channel of NIRS signal variation (change in the concentration of oxy-Hb) did not show significant differences by the paired t-test.
task). Virtually no activation of the prefrontal cortex was seen in the automatic expression-processing task, in either the ASD or control groups. Rather, in the control group, the medial prefrontal showed lower activation. The channel (ch.) 18.20.21 significantly decreased in the control group when compared to that in the ASD group (p < 0.05). In both groups, no difference between the left and the right in the variation (change in the concentration of oxy-Hb) of the NIRS signal in each channel was found.
Figure 3 shows the mean trend graph of change in the concentration of oxy-Hb for the ASD and control groups in Task 2 (conscious expression-processing task). Although activation in the left and right lateral prefrontal cortex was found in the control group, the activation of the prefrontal cortex was poor for the ASD group, with a minor activation seen in the posterior section. Compared to the control
Figure 3. The change in the concentration of oxy-Hb in Task 2. (a) = ASD group (n = 20); (b)=control group (n = 45). The left and right lateral prefrontal cortex was activated in the control group. In the ASD group, the frontal cortex activation was poor and a mild activation was found in the posterior section. The activation of the Ch.1.3.4.6.14.16.17 of the ASD group was significantly weaker than that in the control group (p < 0.05). The activation of Ch. 23 (▲) was significantly stronger in the ASD group than in the control group (p < 0.05, Mann-Whitney-U test). The left and the right differences for each channel of NIRS signal variation (change in the concentration of oxy-Hb) did not show significant differences by the paired t-test.
group, the activation of Ch.1.3.4.6.14.16.17 was significantly weaker in the ASD group (p < 0.05). In contrast, the activation of Ch. 23 was significantly stronger in the ASD group than in the control group (p < 0.05). In both groups, the difference between the left and right in the variation (change in the concentration of oxy-Hb) of the NIRS signal of each channel was not found.
4. Discussion
In this study, the median AQ score was 35 points for the ASD group and 17 points for the control group, with the ASD group having significantly higher AQ scores. However, an overlap in the ranges was seen, with the scores ranging from 23 - 46 points in the ASD group, and from 8 - 33 points in the healthy group. Furthermore, when the control and ASD groups were combined in order to examine the relationship between the AQ and the overall correct response rate, a negative correlation was found. This indicates that continuity is seen in the healthy men and those with autism within the same spectrum.
Howard et al. reported that recognizing the expression of fear was particularly difficult for people with ASD [31] . People with ASD are said to have difficulties understanding other people’s expressions and emotions because they do not look at the eyes, and can only perceive expressions in segments rather than as a whole [4] [5] . It has been found that in individuals with ASD, the amygdala becomes excessively activated by looking at the eyes [32] . Since the excessive activation of the amygdala may cause people with ASD to feel fear, it is believed that they avoid looking at others’ eyes for this reason [33] . There are also reports that people with ASD tend to focus on the lower half of the face [5] . In this study, the rate of overall correct expression response was significantly lower in the ASD group than in the control group. In particular, the correct response rate for fear, disgust, and contempt were lower for individuals with ASD. The shape of the eyes and the position of the eyebrows play a large part in these expressions. It was considered that people with ASD cannot correctly recognize these expressions because they do not look at the eyes in order to differentiate between them.
Nakadoi et al. [23] used NIRS to evaluate the automatic processing process of the expression of fear among people with ASD. As a result, they reported that the activation reaction of the prefrontal cortex of the ASD group is significantly lower than that of the control group. However, Task 1 in the present study, which examines the automatic expression-processing process, found no activation in the prefrontal cortex for either the ASD or control groups. Unlike the study by Nakadoi et al. [23] in which a task only used the expression of “fear”, the present study used various expressions other than “fear” for its task. The reason of discrepancy between the results of above two studies could be attributed to differences in the presented photographs.
The control group in Task 1 showed a decrease in the concentration of oxy-Hb in the medial prefrontal cortex. Such a decrease was not found in the ASD group. When a healthy person starts a task, the activities of the medial prefrontal cortex and its adjacent regions decrease. These regions comprise a “default mode network”, which operates during a quiet period and is believed to be involved in processing related to introspection and high-order sociability [34] . Research has begun to address the fact that in people with ASD, deactivation in this region when performing the task does not occur [35] . The result of this research may reflect difficulty in regulating the default mode network for people with ASD.
Nakamura et al. reported that in their PET studies, the lateral inferior frontal gyrus of the right hemisphere was activated for healthy subjects when performing a conscious expression evaluation task [10] . The non-verbal communication of gestures, expression, and voice fluctuation are believed to be controlled predominantly by the right hemisphere, unlike in verbal communication [36] [37] [38] . In this study, the activation of the right and left lateral prefrontal cortex was found in the control group during the conscious expression-processing task (Task 2); however, no difference between the left and the right was found. This result could be attributed to the left verbal area (Broca’s area) being activated when the subjects were asked to select the expression name printed on paper. In the ASD group, no activation at the lateral prefrontal cortex was found. Instead, the posterior prefrontal cortex showed mild activation. With ASD, a functional disorder exists in the prefrontal cortex in expression recognition, suggesting a possibility that the ASD group processed the expressions in a manner different from the control group. These findings show the usefulness of NIRS in detecting brain function disorder in the expression-processing process of people with ASD, and it could recommend that NIRS can be used to aid the diagnosis of ASD.
Mori et al. reported that by practicing imitation of expressions, people with ASD have experienced improvements in the activation reaction of their prefrontal cortex [21] . The function for perceiving and recognizing faces has been reported to develop immediately after birth and continue up until young adulthood [39] . As such, it was believed that the prefrontal cortex function can be improved in people with ASD by training them to identify expressions from an early age. NIRS can repeatedly measure cerebral blood flow in real-time and was considered to be useful in setting effective tasks and judging the effects of training.
5. Limitations
There are several limitations of the present study. The first limitation is that the sample size of the ASD group was small, and that only men served as subjects. Since ASD occurs less frequently in women, there have not been many studies on whether ASD in women displays significant differences in cognitive and neural functions when compared to ASD in men. In the future, women with ASD also need to be examined. The second limitation is that the intellectual level of the control group was not evaluated. There is a significant difference in the number of years of education, and this was not matched to the ASD group. As such, there is a possibility that the control group has a higher intellect, given that there was a significant difference in the number of years of education, and failing to match this properly may have had an effect on the results. The third limitation is that the evaluation of autistic properties was only conducted using the AQ. In the future, evaluations using the Autism Diagnostic Interview-Revised (ADI-R), the Pervasive Developmental Disorders Autism Spectrum Disorders Rating Scale (PARS), and other scales should be conducted, in order to examine the relationship between autistic properties and the NIRS findings.
6. Conclusion
The present study succeeded in using NIRS to show that the expression-processing process of people with ASD differs to that of people without ASD. The automatic expression-processing task saw no activation in the prefrontal cortex in either the ASD or control groups. In the control group, the concentration of oxy-Hb within the medial prefrontal cortex had in fact, decreased. This decrease was not found in the ASD group. With the conscious expression-processing task, the ASD group did not show activation of the lateral prefrontal cortex when compared to the control group. In the ASD group, a mild activation was seen in the posterior section of the prefrontal cortex instead. The expression-processing process of the ASD group was considered different from that of the control group. For these reasons, NIRS might be effective in detecting brain function disorder in the expression-processing process of people with ASD.
Acknowledgements
The authors would like to thank subjects, patients and all staff members of the hospital who have helped this research. And we also would like to express our deep gratitude to the academic supervisors.
Competing Interests
The authors declare that they have no competing interests.
Author’s Contributions
KF was responsible for the idea behind this study and its structure. KF was also responsible for the measurement and evaluation of NIRS. KM was responsible in diagnosing autism and recruiting autistic patients. KM, SN, KT, and HT were responsible in recruiting regular subjects and aided with NIRS measurements. TT conducted the statistical analysis.