Video-Based Vehicle Detection and Tracking Using Spatiotemporal Maps
Abstract
Surveillance video cameras have been increasingly deployed along roadways over the past decade. Automatic traffic data collection through surveillance video cameras is highly desirable; however, sight-degrading factors and camera vibrations make it an extremely challenging task. In this paper, a computer-vision–based algorithm for vehicle detection and tracking is presented, implemented, and tested. This new algorithm consists of four steps: user initialization, spatiotemporal map generation, strand analysis, and vehicle tracking. It relies on a single, environment-insensitive cue that can be easily obtained and analyzed without camera calibration. The proposed algorithm was implemented in Microsoft Visual C++ using OpenCV and Boost C++ graph libraries. Six test video data sets, representing a variety of lighting, flow level, and camera vibration conditions, were used to evaluate the performance of the new algorithm. Experimental results showed that environmental factors do not significantly impact the detection accuracy of the algorithm. Vehicle count errors ranged from 8% to 19% in the tests, with an overall average detection accuracy of 86.6%. Considering that the test scenarios were chosen to be challenging, such test results are encouraging.
Get full access to this article
View all access and purchase options for this article.
References
1. Traffic Detector Handbook, 2nd ed. Institute of Transportation Engineers, Washington, D.C., 1998.
2. Wang Y., and Nihan N. L. Can Single-Loop Detectors Do the Work of Dual-Loop Detectors? ASCE Journal of Transportation Engineering, Vol. 129, No. 2, 2003, pp. 169–176.
3. Michalopoulos P. G. Vehicle Detection Video Through Image Processing: The Autoscope System. IEEE Transactions on Vehicular Technology, Vol. 40, No. 1, 1991, pp. 21–29.
4. Gupte S., Masoud O., Martin R. F. K., and Papanikolopoulos N. P. Detection and Classification of Vehicles. IEEE Transactions on Intelligent Transportation Systems, Vol. 3, No. 1, 2002, pp. 37–47.
5. Kanhere N. K., Birchfield S. T., Sarasua W. A., and Whitney T. C. Real-Time Detection and Tracking of Vehicle Base Fronts for Measuring Traffic Counts and Speeds on Highways. In Transportation Research Record: Journal of the Transportation Research Board, No. 1993, Transportation Research Board of the National Academies, Washington, D.C., 2007, pp. 155–164.
6. Zhang G., Avery R. P., and Wang Y. Video-Based Vehicle Detection and Classification System for Real-Time Traffic Data Collection Using Uncalibrated Video Cameras. In Transportation Research Record: Journal of the Transportation Research Board, No. 1993, Transportation Research Board of the National Academies, Washington, D.C., 2007, pp. 138–147.
7. Autoscope. Image Sensing Systems, Inc. www.autoscope.com/. Accessed July 14, 2008.
8. Traficon. www.traficon.com/. Accessed July 14, 2008.
9. Avery R. P., Zhang G., Wang Y., and Nihan N. L. Investigation into Shadow Removal from Traffic Images. In Transportation Research Record: Journal of the Transportation Research Board, No. 2000, Transportation Research Board of the National Academies, Washington, D.C., 2007, pp. 70–77.
10. Sun Z., Bebis G., and Miller R. On-Road Vehicle Detection Using Optical Sensors: A Review. Proc., 7th International IEEE Conference on Intelligent Transportation Systems, Washington, D.C., 2004, pp. 585–590.
11. Pang C. C. C., Lam W. W. L., and Yung N. H. C. A Method for Vehicle Count in the Presence of Multiple-Vehicle Occlusions in Traffic Images. IEEE Transactions on Intelligent Transportation Systems, Vol. 8, No. 3, 2007, pp. 441–459.
12. Kollery D., Daniilidisy K., and Nagelyz H.-H. Model-Based Object Tracking in Monocular Image Sequences of Road Traffic Scenes. International Journal of Computer Vision, Vol. 10, No. 3, 1993, pp. 257–281.
13. Tomasi C., and Kanade T. Detection and Tracking of Point Features. Carnegie Mellon University Technical Report CMU-CS-91-132. Carnegie Mellon University, Pittsburgh, Pa., 1991.
14. Beymer D., McLauchlan P., Coifman B., and Malik J. A Real-Time Computer Vision System for Measuring Traffic Parameters. Proc., IEEE Conference on Computer Vision and Pattern Recognition, Washington, D.C., 1997, pp. 495–501.
15. Kanhere N. K., and Birchfield S. Real-Time Incremental Segmentation and Tracking of Vehicles at Low Camera Angles Using Stable Features. IEEE Transactions on Intelligent Transportation Systems, Vol. 9, No. 1, 2008, pp. 148–160.
16. Niyogi S. A., and Adelson E. H. Analyzing and Recognizing Walking Figures in XYT. Proc., IEEE Conference on Computer Vision and Pattern Recognition, Washington, D.C., 1994, pp. 469–474.
17. Liu A., and Yang Z. Video Vehicle Detection Algorithm Through Spatio-Temporal Slices Processing. Proc., 2nd IEEE/ASME International Conference on Mechatronic and Embedded Systems and Applications, Washington, D.C., 2006, pp. 1–5.
18. Canny J. A Computational Approach to Edge Detection. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 8, No. 6, 1986, pp. 679–698.
19. Gonzalez R. C., and Woods R. E. Digital Image Processing. Prentice Hall, Upper Saddle River, N.J., 2000.
20. Shapiro L. G., and Stockman G. C. Computer Vision. Prentice Hall, Upper Saddle River, N.J., 2001.
21. Cormen T. H., Leiserson C. E., Rivest R. L., and Stein C. Introduction to Algorithms, 2nd ed. MIT Press and McGraw-Hill, New York, 2001, pp. 540–549.
22. BOOST C++ Library. www.boost.org/. Accessed July 13, 2008.
23. Open Source Computer Vision Library (OpenCV). Intel, Inc. www.intel.com/technology/computing/opencv/. Accessed July 13, 2008.
Cite article
Cite article
Cite article
OR
Download to reference manager
If you have citation software installed, you can download article citation data to the citation manager of your choice
Information, rights and permissions
Information
Published In
Article first published online: January 1, 2009
Issue published: January 2009
Authors
Metrics and citations
Metrics
Journals metrics
This article was published in Transportation Research Record: Journal of the Transportation Research Board.
VIEW ALL JOURNAL METRICSArticle usage*
Total views and downloads: 62
*Article usage tracking started in December 2016
Altmetric
See the impact this article is making through the number of times it’s been read, and the Altmetric Score.
Learn more about the Altmetric Scores
Articles citing this one
Receive email alerts when this article is cited
Web of Science: 0
Crossref: 24
- Arterial Vehicle Trajectory Reconstruction Based on Stopbar Video Sens...
- Cooperative multi-camera vehicle tracking and traffic surveillance wit...
- Traffic-Informed Multi-Camera Sensing (TIMS) System Based on Vehicle R...
- A New Method for Validating and Generating Vehicle Trajectories From S...
- Automated Truck Taxonomy Classification Using Deep Convolutional Neura...
- Vehicle Detection and Tracking for 511 Traffic Cameras With U-Shaped D...
- Enhanced Spatial–Temporal Map-Based Video Analytic Platform and Its Lo...
- UrbanNet: Leveraging Urban Maps for Long Range 3D Object Detection
- Object Classification with Roadside LiDAR Data Using a Probabilistic N...
- Longitudinal-Scanline-Based Arterial Traffic Video Analytics with Coor...
- A longitudinal scanline based vehicle trajectory reconstruction method...
- Vision-based surveillance system for monitoring traffic conditions
- Traffic Velocity Estimation From Vehicle Count Sequences
- Performance Evaluation of Video Analytics for Traffic Incident Detecti...
- An Unlicensed Taxi Identification Model Based on Big Data Analysis
- Signal Timing Detection Based on Spatial–Temporal Map Generated from C...
- Vehicle Tracking System based on Videotaping Data
- Full-Body Occlusion Handling and Density Analysis in Traffic Video-Sur...
- Measuring Signalized Intersection Performance in Real-Time With Traffi...
- Developing Operating Mode Distribution Inputs for MOVES with a Compute...
- Flexible, Mobile Video Camera System and Open Source Video Analysis So...
- Calibration of a New Microsimulation Package for the Evaluation of Tra...
- eyeDog
- Safety performance measures: a comparison between microsimulation and ...
Figures and tables
Figures & Media
Tables
View Options
Get access
Access options
If you have access to journal content via a personal subscription, university, library, employer or society, select from the options below:
loading institutional access options
Alternatively, view purchase options below:
Purchase 24 hour online access to view and download content.
Access journal content via a DeepDyve subscription or find out more about this option.
