Real Time Speed Bump Detection Using Gaussian Filtering and Connected Component Approach ()
Received 30 March 2016; accepted 20 April 2016; published 12 July 2016
1. Introduction
Driver assistance system is an important module in Intelligent Transportation System (ITS). The system is developed to alert a driver or to interact directly on the vehicle for safety and better driving. DAS includes Driver drowsiness detection, Adaptive cruise control (ACC), Lane departure warning system, Traffic sign recognition, Wrong-way driving warning, automotive navigation system, etc. In addition to that here we focused on obstacle detection in road side like speed bump, poth holes, etc.
Speed bumps are constructed across the road to avoid over speed in restricted area. The most critical thing is preventing remedy leading to the cause of accident. Because many speed bumps are constructed without proper permission. Un-notification of speed bump over high speed is harmful for patients in transit, pregnant women, rapid wear and tear and damage to vehicles. So we develop a system that services the end user driver using image processing concepts―Gaussian filtering, Median filtering and Connected Component Approach. This paper is organized as follows: Chapter 2 describes the background and related works and Chapter 3 refers data collection. The proposed methodology is covered in Chapter 4 and result and discussion are covered in Chapter 5. Finally conclusion and future scope are explained in Chapter 6.
2. Background and Related Works
The earlier approach of speed bump detection is achieved using dedicated sensors, three-axis accelerometer, Smart Phone and Image Processing.
Using Sensors: Hull et al. developed a distributed mobile sensor computing system, [1] . The system built with set of sensors embedded in vehicles to collect and process data and send it to portal based upon the continuous queries which are processed by continuous query processor on remote nodes. In paper [2] [3] real-time free space detection system is implemented using a medium-cost LIDAR sensor and a low cost camera. In paper [4] [5] the speed bump detection is done with bump recorder, pedometer, three-dimensional gyro sensor and GPS. The drawback of using sensor is miss classification of speed bump.
Smartphone: Nericell [6] used mobile Smartphone to monitor road and traffic conditions. It detected potholes, braking, bumps and honks using accelerometer, microphone, GSM radio and GPS sensors inbuilt in smart phones. One constraint is the phone must be oriented along the vehicle’s axis before analyzing the signals. Patrol system [7] uses 3-axis accelerometer and GPS mounted on the dashboard to monitor road surface. Wolverine [8] method uses Smartphone sensors for traffic state monitoring and detection of bumps without orientation constrain. They give 10% false negative rate for bump detection. The work carried out in paper [9] [10] is using a mobile smartphone, they demonstrated an applications that are integrated inside an automobile to evaluate a vehicle’s condition, such as gear shifts and overall road conditions, including bumps, potholes, rough road, uneven road, and smooth road. The mobile smartphone holds GPS, microphones, and a Bosch BMA150 3-axis accelerometer. And also in paper [11] - [13] they implemented an early warning system that uses a smart phone and accelerometer to alert the driver in advance when the vehicle is approaching a speed breaker. Gunjan Chugh [9] gave a summarized paper on road condition detection using dedicated sensors and smart phones. In the same paper they highlighted the disadvantage of using smart phones and GPS for speed bump. The drawbacks of the using smartphone system are vibration patterns of sensor data, benign events, GPS error, network overload, delay and battery draining. One of the most common methodology for speed bump detection is using smartphone, the problem arises because of its hard code nature. It is so called, since the detection of speed bump is based on the previous history not based on current scenario so it is unfit for real time scenario.
Image processing: In paper [14] they proposed a methodology to detect speed bump using Disparity, Border detection, Morphological Image processing, canny edge detector concepts. A simple edge detection methodology can’t be suitable to detect speed bump in real-time. K. Ganesan [15] proposed an image processing approach to detect obstacles on road using a monocular IR camera. Their main focus is to compensate shadows in the road Using Open Source Computer Vision (OpenCV). In the work on paper [16] the speed bump are detected using morphological and projection analysis. Compare to the previous work on image processing accuracy rate is improved for all category of speed bump and this new methodology also suitable for non-marking speed bump.
The developed system is applicable for trained and untrained routes whereas the smartphone method is applicable only for trained routes.
3. Experimental Setup
The image is captured by locating the camera in front of the vehicle. Camera location and orientation outside the car should be aligned in such a way that focuses on the roads to capture the speed bump image. The database consists of nearly 1500 image including all category. The category is grouped based on the pattern, size and width of the speed bump. All the data collected by the camera are stored on the memory and processed. A 5 MB pixel camera along with a Raspberry Pi is involved in this system. Raspberry is the processing unit interfaced with camera and alerting system. In the proposed work, video is captured via camera and the frames are converted into image files under the hand of converting unit. In the next stage the proposed methodology computation are executed. And finally based on speed bump detection the driver is alerted either by means of alarm or warning indicator. Figure 1 shows the experimental setup flowchart.
4. Proposed Methodology
The proposed methodology involves 4 stages as shown in Figure 2. The first stage is preprocessing which prepare the input image before doing the actual process. For the resultant image we apply Gaussian and Median filtering followed by image subtraction. The ensuing subtracted image is converted to binary image and finally from connected component approach speed bump parameter are computed.
4.1. Pre-Processing
Pre-processing is an important procedure which helps to remove the unwanted information like noise and strengthens the required information in an image. In projected method the preprocessing involve 1) Resize to standard size 2) RGB to Gray scale conversion [17] .
4.1.1. Resize to Standard Size
Resize is mandatory to reduce the computational complexity. All input image are resized to 140 × 320 size. The focus is to detect the presence speed bump so we go for granular analysis. The original image is shown in Figure 3.
4.1.2. Convert RGB to Gray Scale Image
An RGB image is altered to gray scale image [18] by using (1). The corresponding gray scale image is displayed in Figure 4. Human eyes are more sensitive to green color than red and blue color so green is assumed high value and the formula for computing luminosity is given by
(1)
where
R―Red component of the image;
G―Green component of the image;
B―Blue component of the image.
4.2. Image Filtering and Subtraction
4.2.1. Apply Gaussian Filtering
The significance of a low pass Gaussian filtering is to remove noise by blurring the image and remove the high frequency component of the image. Here the environmental noise like sand particle in the road, uneven road conditions are eliminated by the influence of Gaussian filtering. The degree of smoothness depends on the value of standard deviation and kernel size chosen. (2) refers the Gaussian filtering where σ refers the standard deviation, σ2 = variance. In Gaussian curve [19] more weights are at the center and reduced towards the end which distinguish it from the other filter like mean filters (uniformly weighted)
(2)
We assume the standard deviation 2 and kernel function of size 49. The kernel size is assumed higher value since the focus are on granular not on fine image according to the application. In speed bump detection we are not in need of detailed information. The Gaussian filter output at this stage is shown in the Figure 5.
4.2.2. Median Filtering
Median filtering is a nonlinear filter which are good in reducing impulsive noise but the specialty is they safeguard the edges in an image as opposite to linear smoothing filters [20] . For the Gaussian output we apply median filtering of size 31 × 31. Among the 961 value it choose the median value, the size of the filter is assumed high for easy computation and at the same time we ensure to maintain the required information. The output at this stage is as shown in Figure 6.
4.2.3. Image Subtraction
Subtracting the median filter output from Gaussian filtering output highlight the edge variation [17] . The resulting output is added with a number 127 to perform Binary image. Figure 7 displays the subtracted image.
4.3. Binary Image and Connected Component
4.3.1. Covert to Binary Image
The subtracted image is converted to binary image by a simple technique named thresholding [17] . Deciding
threshold value is usually a tough job, but in our work it is very simple because of the nature of application. At the end of this stage the image are seen as binary image with highlighting the white region and removing the unwanted region as exposed in Figure 8. By viewing the result, there is a possibility of highlight some noise. To remove such noise we move on to next stage called connected component approach.
4.3.2. Analysis Connected Component
At this stage we apply area open operation of connected component method to stay back with area above a threshold value and remove other noisy region [18] . The threshold level is set nominal such that it contains only the white pattern on the speed bump. The output of this process is revealed in Figure 9.
4.4. Predict Speed Bump
The resulting output pattern can be trained using neural network to recognize the speed bump and alert the
Table 1. Result of true positive and true negative percentage category wise.
Table 2. Resultant output of proposed method for different categories.
driver by means of an audio signal or reducing the speed of the vehicle automatically.
5. Result and Discussion
In India it is not an easy task to categories the speed bumps due to lots of variation in the construction. The variation is seen in terms of their pattern, color, length, width, and height. For the analysis we categories the speed bump only based on color and pattern irrespective to their dimensionality. To determine the performance of the system 2 parameter are consider namely True Positive, True Negative. True Positive means identifying the Presence of Speed bump as Presence whereas True Negative implies the Presence of Speed bump as Absence.
Category 1 is the most common type consists of 500 samples in which 460 sample are identified correctly as speed bump the remaining 40 are not recognized since the marking is below the threshold level that happens due to fading and noise. Table 1 shows the True Positive and True Negative Percentage for each category. From the analysis, we concluded that the category 1, 2, 3 and 4 achieve nearly 90% detection rate on Speed bump detection except category 5 which obtain only less percentage. This infers that the speed bump with marking can be easy identified compare to unmarking speed bump. The performance of the system is reduced due to the fading and unwanted noise on the marking speed bump. Thus the proposed methodology suits very well for the road with proper condition. Even though category 5 does not have marking over it the detection of speed bump happens since the top layer of speed bump is above the threshold value. Table 2 contains a sample collection of input image for each category and its corresponding processed output. The result clearly shows that speed bumps constructed with proper marking are detected easily irrespective of unsmooth road condition and even when the marking is not perfect.
6. Conclusion and Future Scope
In this paper, we have proposed a novel method of speed bump detection using Gaussian, median filtering, image subtraction, binary image conversion and connected component approach concepts that alert the driver during his driving. In particular this methodology suits very well to the real time scenario for the painted speed bump though their pattern, color and dimensionality and road condition varies. In addition it partially identifies illegal speed bumps (speed bumps that falls under category 5). This methodology is robust and effortless to implement in standalone machine that avoids congestion in networking (GPS), saving battery of smartphones while driving. The future scope of the proposed work is detection of bumps in night vision and bad illumination condition like raining and mist.