Diagnostic Assessment and Mathematical Difficulties: An Experimental Study of Dyscalculia ()
Received 18 May 2016; accepted 6 June 2016; published 9 June 2016
1. Introduction
Diagnostic assessment strategies have widely been used to enhance student achievement across different subject areas [1] . More specifically, such programs were designed and implemented to assess and support the learning of students with learning difficulties in reading (Dyslexia), writing (Dysgraphia), and Mathematics (Dyscalculia) [1] . Research has shown that students who undergo such programs show significant improvement in their abilities once the program’s implementation is completed. Diagnostic assessment strategies allow teachers to provide a dynamic learning and teaching environment that enables them to accommodate different, individual student needs and abilities. Furthermore, another advantage of implementing diagnostic assessment program is that it helps teachers utilize different educational tools in order to achieve the educational goals.
The purpose of this study is to investigate the effect of implementing a diagnostic assessment strategy on students who are diagnosed with dyscalculia. The researchers aim at providing further evidence for the usefulness of such programs in the treatment of learning difficulties in general, and mathematics difficulties specifically.
The study attempted to answer the following research questions:
1) Is there a statistically significant difference between pre- and post-test scores for the treatment group?
2) Is there a statistically significant difference between pre- and post-test scores for the control group?
2. Literature Review
Researchers agree that dyscalculia appears as a problem in learning arithmetic facts and calculation procedures. The question which remains unanswered relates to the underlying deficits which cause these problems. Various candidates have been put forward, including dyslexic difficulties, memory difficulties, spatial difficulties and attentional difficulties. However, many of the studies which have been designed to relate these “underlying” abilities to dyscalculia have confounded them with numerical processing abilities [10] .
Researchers have continuously studied the possibilities and different instructional strategies that can be used in order to assist the learning process of students with mathematical learning difficulties. For example, [11] conducted a study utilizing specific instruction directed towards specific mathematical skills, such as counting and found that dyscalculic students who received specific instruction outperformed their peers who did not receive specialized instruction. Similarly, [12] implemented an intervention that focuses on basic numeracy skills as well as conceptual knowledge and concluded that children with mathematics difficulties benefit significantly from the intervention.
Other researchers utilized computer assisted training to dyscalculic students as the intervention method [13] [14] , and found that students benefited from the intervention. Moreover, [1] conducted a study in which they implemented a training program for students with mathematics difficulties and students diagnosed with dyscalculia; their findings suggest that individualized instruction as well specific instruction on mathematical tasks benefits both groups of students. Moreover, researchers have suggested that specific mathematics intervention at early ages can be used to prevent future mathematics difficulties [15] .
In this article, the researchers report the findings of implementing a diagnostic assessment teaching strategy in order to improve the mathematical and numeracy skills of students diagnosed with dyscalculia.
3. Methodology
3.1. Context
The study was implemented in the context of the public school system is the Kingdom of Saudi Arabia. Three elementary schools were randomly selected from a pool of 20 elementary schools within the Eastern Province, which include a resource room for children with special needs. Public schools in KSA offer accommodations for students with diagnosed special needs through resource rooms within the same school building. Students are pulled out of regular classrooms and placed in resource rooms for individual instruction in the content area in which they have learning difficulties.
3.2. Research Design
The research design for this study is an experimental design in which two groups were randomly selected. The first group (Group A) was assigned to the treatment (Diagnostic Assessment Program), and the second group (Group B) was assigned as the control group. The treatment group included 26 students from two different schools, who had been diagnosed by the ministry of Education in Saudi Arabia with severe learning difficulties in mathematics (Dyscalculia), and each group was utilized as a separate treatment group to measure if any individual differences might affect the outcome of the treatment and the control group included 15 students from one school who were also diagnosed with dyscalculia.
Resource room teachers in the schools that were assigned as the treatment groups underwent a training program for two weeks on the implementation of the Diagnostic Assessment strategy. Teachers, who teach the control group, did not receive any specific training. All groups were given a pre-test and a post-test (Diagnostic Assessment of Basic Mathematics Skills). Table 1 shows the distribution and percentages of students within each of the groups.
3.3. Instruments
3.3.1. Diagnostic Teaching Program
The program was designed on the basis of the common core standards for mathematics, which are applied in a majority of KSA schools. Those Standards or dimensions include: 1) Number recognition (D1) and Number Sense (D2), Ordering Numbers (D3), and Rounding (D4). 2) Basic Arithmetic which includes addition (D5), subtraction (D6), multiplication (D7) and division (D8).
Students are given a lesson for each learning objective, as well as a diagnostic assessment at the end of each lesson in order to measure their mastery of the learning objective. If students demonstrated 80% mastery of the lesson’s objective, the teacher would then move on to the next lesson. However, if students were not able to achieve the desired level of mastery for that lesson, the teacher would then design and deliver a second lesson on the same learning objective using different teaching strategies as well as different learning materials for the lesson based on the feedback from the diagnostic assessment results. Table 2 shows a three lesson plan for three learning objectives within the program as an example.
3.3.2. Diagnostic Assessment of Basic Mathematical Skills
The assessment utilized in this study is a self-designed assessment that measures basic mathematical skills for the elementary school levels. The forty test items were designed based on a thorough analysis of the curriculum as well as comparison with several other tests and assessments utilized by schools within Saudi Arabia, as well as standardized international assessments of basic mathematical skills. Twenty items were developed for each of the learning objectives that cover: 1) Number recognition and Number Sense, Ordering Numbers, and Rounding. 2) Basic Arithmetic which includes addition, subtraction, multiplication and division. The test is designed to identify the strengths and weaknesses of students with regards to specific learning objectives or mathematical skills. The test also helps identify whether a student has achieved the minimum mastery level in order to build or construct further mathematical concepts that will be taught in future units of instruction. Items are graded on a True/False basis, where correct answers received one point and incorrect answers received zero points.
3.3.3. Validity and Reliability
To validate the instrument, the Diagnostic Assessment of Basic Mathematics Skills (DABMS) was evaluated by a panel of five university professors at Dammam University and two school teachers in order to check each item on the test and verify that they measure the targeted mathematical skills and are directly related to the learning objectives specified in the program description.
![]()
Table 1. Student distributions in treatment and control groups.
![]()
Table 2. A two lesson example from the diagnostic assessment program.
To test the reliability of the instrument, the researchers implemented the test on a group of students (N = 31) twice with a period of three weeks in between the test and re-test. A reliability coefficient of 0.78 was found.
4. Data Analysis and Results
Data analysis showed that there were no statistically significant differences in students’ scores on the pretest between the control group and either of the treatment groups. Moreover, there were no statistically significant differences between the control groups on the pretest scores. This suggests that all students in all three groups had similar levels of mathematical understanding and abilities at the beginning of this experiment.
Data analysis after the post-test revealed a statistically significant difference in scores between the control group and both treatment group A and treatment group B. This suggests that students who were in the classes where the diagnostic assessment strategy was implemented improved more than those who received regular instruction with regard to their mathematical abilities.
Table 3 shows the mean scores and standard deviations that were calculated for both treatment groups, as well as the control group for the pre-test and the post-test. The mean score for Treatment group A was 34.856, and for Treatment group B 35.578, while the mean score for the control group was 25.139. To measure the effectiveness of the treatment program an analysis of covariance test was conducted on the total scores as shown in Table 4.
Table 4 shows there exists statistically significant differences between the treatment groups and the control groups. The effect size was 0.812, which means that the treatment program was very effective in improving students’ mathematical abilities.
Table 5 shows the results of a T-test to compare between the two treatment groups with regard to the post-test scores. The results showed no statistically significant differences between treatment group A and treatment group B on the Post-test scores. This suggests that both groups benefited from the treatment equally, and that all students in both groups showed similar improvement in mathematical abilities.
To further test for differences between the control group and the treatment groups on the specific eight dimensions within the DABMS test, means and standard deviations were calculated for the pre and post-tests (see Table 6) and a Multivariate Analysis of Covariance (MANCOVA) was conducted (See Table 7). The results showed that there was no statistically significant difference between the control group and the treatment groups on dimension on (D1, Number Recognition), while there were statistically significant differences between the control group and the treatment group on all other seven dimensions D2, D3, …, D8. Which further emphasizes the effectiveness of the diagnostic assessment program.
5. Conclusions
The main goal of this study was to investigate the effectiveness of implementing a diagnostic assessment strategy
![]()
Table 3. Means and standard deviations of pre and post tests.
![]()
Table 5. Independent sample t-test.
of instruction in helping students with dyscalculia improve their mathematical abilities. Two treatment groups and one control group were randomly selected, and given instruction in mathematics for a period of two months.
The findings revealed that students who were in the treatment groups and received diagnostic assessment based instruction showed more improvement than students in the control group, which suggested that the diagnostic assessment strategy was effective in significantly improving dyscalculic students’ mathematical abilities.
![]()
Table 6. Means and standard deviations of pre and post test.
This finding further supports the findings of previous studies (i.e. Fuchs et al., 2010; Kauffman, Handl, and Thony, 2003) that found that certain types of specialized instruction can improve the mathematical abilities and performance of Dyscalculic students
![]()
Table 7. Multivariate analysis of covariance.
The findings of this study suggest a need for further development and implementation of specific diagnostic assessment based programs in order to assist students with dyscalculia in becoming more able to overcome their mathematical difficulties, especially in early years.
NOTES
![]()
*Corresponding author.