On-road Anomaly Detection by Multimodal Sensor Analysis and Multimedia Processing

Orhan F., EREN P. E.

Conference on Video Surveillance and Transportation Imaging Applications, San-Francisco, Costa Rica, 3 - 05 February 2014, vol.9026 identifier identifier

  • Publication Type: Conference Paper / Full Text
  • Volume: 9026
  • Doi Number: 10.1117/12.2038700
  • City: San-Francisco
  • Country: Costa Rica
  • Middle East Technical University Affiliated: Yes


The use of smartphones in Intelligent Transportation Systems is gaining popularity, yet many challenges exist in developing functional applications. Due to the dynamic nature of transportation, vehicular social applications face complexities such as developing robust sensor management, performing signal and image processing tasks, and sharing information among users. This study utilizes a multimodal sensor analysis framework which enables the analysis of sensors in multimodal aspect. It also provides plugin-based analyzing interfaces to develop sensor and image processing based applications, and connects its users via a centralized application as well as to social networks to facilitate communication and socialization. With the usage of this framework, an on-road anomaly detector is being developed and tested. The detector utilizes the sensors of a mobile device and is able to identify anomalies such as hard brake, pothole crossing, and speed bump crossing. Upon such detection, the video portion containing the anomaly is automatically extracted in order to enable further image processing analysis. The detection results are shared on a central portal application for online traffic condition monitoring.