Short-Term Traffic Flow Prediction with Regime Switching Models
Abstract
Accurate short-term prediction of traffic parameters is a critical component for many intelligent transportation system applications. Traffic flow is subject to abrupt disturbances because of various unexpected events (e.g., accidents, weather-induced disruption) that may change the underlying dynamics and the stability of the data generation process. Short-term prediction models that do not account for these changes produce biased and less accurate predictions. This paper proposes a new adaptive approach to short-term prediction that explicitly accounts for occasional regime changes by using statistical change-point detection algorithms. In this context, the expectation maximization and the CUSUM (cumulative sum) algorithms are implemented to detect shifts in the mean level of the process in real time. Autoregressive integrated moving average models are used for developing the forecasting models while the process mean is monitored by the two detection algorithms. The intercept of the forecasting models is updated on the basis of the detected shifts in the mean level to adapt to any potential new regimes. The proposed approach is tested on real-world loop data sets. The results show significant improvements in prediction accuracy compared with traditional autoregressive integrated moving average models with fixed parameters.
Get full access to this article
View all access and purchase options for this article.
References
1. Smith B. L., Williams B. M., and Oswald R. K. Comparison of Parametric and Nonparametric Models for Traffic Flow Forecasting. Transportation Research C, Vol. 10, 2002, pp. 303–321.
2. Stathopoulos A., and Karlaftis M. G. A Multivariate State Space Approach for Urban Traffic Flow Modeling and Prediction. Transportation Research C, Vol. 11, 2003, pp. 121–135.
3. Williams B. M., and Hoel L. A. Modeling and Forecasting Vehicular Traffic Flow As a Seasonal ARIMA Process: Theoretical Basis and Empirical Results. Journal of Transportation Engineering, Vol. 129, No. 6, 2003, pp. 664–672.
4. Smith B. L., and Demetsky M. J. Traffic Flow Forecasting: Comparison of Modeling Approaches. Journal of Transportation Engineering, Vol. 123, No. 4, 1997, pp. 261–266.
5. Okutani I., and Stephanedes Y. Dynamic Prediction of Traffic Volume Through Kalman Filtering Theory. Transportation Research B, Vol. 18, 1984, pp. 1–11.
6. Whittaker J., Garside S., and Lindveld K. Tracking and Predicting a Network Traffic Process. International Journal of Forecasting, Vol. 13, 1997, pp. 51–61.
7. Wang Y., and Papageorgiou M. Real-Time Freeway Traffic State Estimation Based on Extended Kalman Filter: A General Approach. Transportation Research B, Vol. 39, 2005, pp. 141–167.
8. Yang F., Yin Z., Liu H. X., and Ran B. Online Algorithm for Recursive Short-Term Traffic Prediction. In Transportation Research Record: Journal of the Transportation Research Board, No. 1879, Transportation Research Board of the National Academies, Washington, D.C., 2004, pp. 1–8.
9. Vlahogianni E. I., Golias J. C., and Karlaftis M. G. Short-Term Traffic Forecasting: Overview of Objectives and Methods. Transport Reviews, Vol. 24, No. 5, 2004, pp. 533–557.
10. Sun L., and Zhou J. Development of Multiregime Speed-Density Relationships by Cluster Analysis. In Transportation Research Record: Journal of the Transportation Research Board, No. 1934, Transportation Research Board of the National Academies, Washington, D.C., 2005, pp. 64–71.
11. Tollway's Travel Times Sometimes Stuck in Jam. Chicago Tribune, July 11, 2005. www.chicagotribune.com.
12. van Lint J. W. C., Hoogendoorn S. P., and van Zuylen H. J. Freeway Travel Time Prediction with State-Space Neural Networks Modeling: State-Space Dynamics with Recurrent Neural Networks. In Transportation Research Record: Journal of the Transportation Research Board, No. 1811, Transportation Research Board of the National Academies, Washington, D.C., 2002, pp. 30–39.
13. Zhang X., and Rice J. A. Short-term Travel Time Prediction. Transportation Research C, Vol. 11, 2003, pp. 187–210.
14. Tavana H., and Mahmassani H. S. Estimation and Application of Dynamic Speed-Density Relations by Using Transfer Function Models. In Transportation Research Record: Journal of the Transportation Board, No. 1710, TRB, National Research Council, Washington, D.C., 2000, pp. 47–57.
15. Huynh N., Mahmassani H. S., and Tavana H. Adaptive Speed Estimation Using Transfer Function Models for Real-Time Dynamic Traffic Assignment Operation. In Transportation Research Record: Journal of the Transportation Research Board, No. 1783, Transportation Research Board of the National Academies, Washington, D.C., 2002, pp. 55–65.
16. Qin X., and Mahmassani H. S. Adaptive Calibration of Dynamic Speed–Density Relations for Online Network Traffic Estimation and Prediction Applications. In Transportation Research Record: Journal of the Transportation Research Board, No. 1876, Transportation Research Board of the National Academies, Washington, D.C., 2004, pp. 82–89.
17. Hansen B. E. The New Econometrics of Structural Change: Dating Breaks in U.S. Labor Productivity. The Journal of Economic Perspectives, 2001, Vol. 15, No. 4, pp. 117–128.
18. Pesaran M. H., and Timmermann A. How Costly Is It to Ignore Breaks When Forecasting the Direction of a Time Series? International Journal of Forecasting, Vol. 20, No. 3, 2004, pp. 411–425.
19. Clements M. P., and Hendry D. F. Intercept Correction and Structural Change. Journal of Applied Econometrics, Vol. 11, No. 5, 1996, pp. 475–494.
20. Box G. E. P., and Jenkins G. M. Time-Series Analysis: Forecasting and Control. Holden Day, San Francisco, Calif., 1976.
21. Williams B. M. Multivariate Vehicular Traffic Flow Prediction: Evaluation of ARIMAX Modeling. In Transportation Research Record: Journal of the Transportation Research Board, No. 1776, TRB, National Research Council, Washington, D.C., 2001, pp. 194–200.
22. Wei W. S. W. Time Series Analysis: Univariate and Multivariate Methods. Addison-Wesley, Inc., Boston, Mass., 1990.
23. Ghosh B., Basu B., and O'Mahony M. Time-Series Modeling for Forecasting Vehicular Traffic Flow in Dublin. Presented at 84th Annual Meeting of the Transportation Research Board, Washington, D.C., 2005.
24. Dempster A. P., Laird N. M., and Rubin D. B. Maximum Likelihood from Incomplete Data Via the EM Algorithm. Journal of the Royal Statistical Society, Series B, Vol. 39, 1977, pp. 1–37.
25. Hastie T., Tibshirani R., and Friedman J. The Elements Statistical Learning: Data Mining, Inference, and Prediction. Springer, New York, 2001, pp. 236–240.
26. McLachlan G., and Peel D. Finite Mixture Models. Wiley, New York, 2000.
27. Page E. S. Continuous Inspection Schemes. Biometrika, Vol. 41, 1954, pp. 100–115.
28. Montgomery C. D. Introduction to Statistical Quality Control. John Wiley and Sons, Inc., New York, 1996.
29. Kemp K. W. The Average Run Length of the Cumulative Sum Chart When a V-Mask Is Used. Journal of the Royal Statistical Society, Series B, Vol. 23, 1961, pp. 149–153.
30. Ewan W. D., and Kemp K. W. Sampling Inspection of Continuous Processes with No Autocorrelation Between Successive Results. Biometrika, Vol. 47, 1960, pp. 363–380.
31. Lucas J. M., and Crosier R. B. Fast Initial Response for CUSUM Schemes: Give Your CUSUM a Head Start. Technometrics, Vol. 24, No. 3, 1982, pp. 199–205.
32. Schmid W. CUSUM Control Schemes for Gaussian Processes. Statistical Papers, Vol. 38, 1997, pp. 191–217.
33. Brook D., and Evans D. A. An Approach to the Probability Distribution of CUSUM Run Length. Biometrika, Vol. 59, No. 3, 1972, pp. 539–549.
34. Moustakides G. V. Optimal Stopping Times for Detecting Changes in Distributions. Annals of Statistics, Vol. 14, 1986, pp. 1379–1387.
Cite article
Cite article
Cite article
OR
Download to reference manager
If you have citation software installed, you can download article citation data to the citation manager of your choice
Information, rights and permissions
Information
Published In
Article first published: January 2006
Issue published: January 2006
Authors
Metrics and citations
Metrics
Journals metrics
This article was published in Transportation Research Record: Journal of the Transportation Research Board.
VIEW ALL JOURNAL METRICSArticle usage*
Total views and downloads: 87
*Article usage tracking started in December 2016
Altmetric
See the impact this article is making through the number of times it’s been read, and the Altmetric Score.
Learn more about the Altmetric Scores
Articles citing this one
Receive email alerts when this article is cited
Web of Science: 0
Crossref: 41
- Cloud Model-Based Fuzzy Inference System for Short-Term Traffic Flow P...
- On the prediction of intermediate-to-long term bus section travel time...
- Detecting Changes in the Spatiotemporal Pattern of Bike Sharing: A Cha...
- Detection of operating mode changes, without a priori model and in unc...
- Dynamic Multi-View Coupled Graph Convolution Network for Urban Travel ...
- Multivariate Correlation-aware Spatio-temporal Graph Convolutional Net...
- Urban Expressway Congestion Forewarning Based on Slope Change of Traff...
- Traffic state prediction using conditionally Gaussian observed Markov ...
- Detecting the Demand Changes of Bike Sharing: A Bayesian Hierarchical ...
- Deep learning based origin-destination prediction via contextual infor...
- Attention meets long short-term memory: A deep learning network for tr...
- A Method for Daily Traffic Flow Parameter Forecasting Combining the Im...
- Features injected recurrent neural networks for short-term traffic spe...
- Input data selection for daily traffic flow forecasting through contex...
- The Cyber-Physical-Social Transition Tensor Service Framework
- Daily Traffic Flow Forecasting Through a Contextual Convolutional Recu...
- SeqST-GAN
- Multi-task Adversarial Spatial-Temporal Networks for Crowd Flow Predic...
- Active mode recognition of dynamic systems
- Capsules TCN Network for Urban Computing and Intelligence in Urban Tra...
- Neuro-Fuzzy Modeling of Data Singular Spectrum Decomposition and Traff...
- Hybrid machine learning algorithm and statistical time series model fo...
- A Multitask Learning Model for Traffic Flow and Speed Forecasting
- Short-Term Traffic Flow Forecasting via Multi-Regime Modeling and Ense...
- Traffic flow prediction based on combination of support vector machine...
- Short-term vessel traffic flow forecasting by using an improved Kalman...
- DeepTrend 2.0: A light-weighted multi-scale traffic prediction model u...
- Large-Scale Traffic Congestion Prediction Based on the Symmetric Extre...
- Daily long-term traffic flow forecasting based on a deep neural networ...
- Traffic Prediction of Congested Patterns
- Transfer Knowledge Between Sub-regions for Traffic Prediction Using De...
- Dynamic factor model for network traffic state forecast
- A Match-Then-Predict Method for Daily Traffic Flow Forecasting Based o...
- Deep Learning with Non-parametric Regression Model for Traffic Flow Pr...
- An Optimized Hybrid Lane-Based Short-Term Urban Traffic Forecasting Us...
- Speed prediction from mobile sensors using cellular phone‐based traffi...
- Adaptive traffic parameter prediction: Effect of number of states and ...
- Short-term traffic flow rate forecasting based on identifying similar ...
- Bayesian Dynamic Linear Model with Switching for Real-Time Short-Term ...
- Random Process Model for Urban Traffic Flow Using a Wavelet-Bayesian H...
- Traffic Prediction of Congested Patterns
Figures and tables
Figures & Media
Tables
View Options
Get access
Access options
If you have access to journal content via a personal subscription, university, library, employer or society, select from the options below:
loading institutional access options
Alternatively, view purchase options below:
Purchase 24 hour online access to view and download content.
Access journal content via a DeepDyve subscription or find out more about this option.
