A survey of parameter and state estimation in queues
2021, Queueing Systems
https://doi.org/10.1007/S11134-021-09688-WAbstract
We present a broad literature survey of parameter and state estimation for queueing systems. Our approach is based on various inference activities, queueing models, observations schemes, and statistical methods. We categorize these into branches of research that we call estimation paradigms. These include: the classical sampling approach, inverse problems, inference for noninteracting systems, inference with discrete sampling, inference with queueing fundamentals, queue inference engine problems, Bayesian approaches, online prediction, implicit models, and control, design, and uncertainty quantification. For each of these estimation paradigms, we outline the principles and ideas, while surveying key references. We also present various simple numerical experiments. In addition to some key references mentioned here, a periodically-updated comprehensive list of references dealing with parameter and state estimation of queues will be kept in an accompanying annotated bibliography.
References (131)
- Alouf, S., Nain, P., and Towsley, D. Inferring network characteristics via moment-based estimators. In INFOCOM 2001. Twentieth Annual Joint Conference of the IEEE Computer and Communications Societies. Proceedings. IEEE (2001), vol. 2, IEEE, pp. 1045-1054.
- Antunes, N., Jacinto, G., and Pacheco, A. Probing a M/G/1 queue with general input and service times. ACM SIGMETRICS Performance Evaluation Review 41, 3 (2014), 34-36.
- Antunes, N., Jacinto, G., Pacheco, A., and Wichelhaus, C. Estimation of the traffic in- tensity in a piecewise-stationary M t /G t /1 queue with probing. ACM SIGMETRICS Performance Evaluation Review 44, 2 (2016), 3-5.
- Armero, C. Bayesian analysis of M/M/1/∞/FIFO queues. Bayesian statistics 2 (1985), 613- 618.
- Armero, C. Bayesian inference in Markovian queues. Queueing Systems 15, 1 (1994), 419-426.
- Armero, C., and Bayarri, M. Bayesian prediction in M/M/1 queues. Queueing Systems 15, 1 (1994), 401-417.
- Armero, C., and Bayarri, M. Prior assessments for prediction in queues. The Statistician 43, 1 (1994), 139-153.
- Armony, M., and Plambeck, E. The impact of duplicate orders on demand estimation and capacity investment. Management science 51, 10 (2005), 1505-1518.
- Asanjarani, A., and Nazarathy, Y. Parameter and state estimation in queues and related stochastic models: A bibliography. arXiv preprint arXiv:1701.08338 (2020).
- Asanjarani, A., and Nazarathy, Y. The Role of Information in System Stability with Partially Observable Servers. Methodology and Computing in Applied Probability 22 (2020), 949-968.
- Asanjarani, A., Nazarathy, Y., and Taylor, G. Queueing Estimation Survey. https://github.com/yoninazarathy/QueueingEstimationSurvey, 2020.
- Asmussen, S. Applied probability and queues (stochastic modeling and applied probability series, vol. 51). Springer Science & Business Media, 2010.
- Asmussen, S., Nerman, O., and Olsson, M. Fitting phase-type distributions via the EM algorithm. Scandinavian Journal of Statistics 23, 4 (1996), 419-441.
- Au, L., Byrnes, G., Bain, C., Fackrell, M., Brand, C., Campbell, D., and Taylor, P. Predicting overflow in an emergency department. IMA Journal of Management Mathematics 20, 1 (2009), 39-49.
- Ausín, M., Wiper, M., and Lillo, R. Bayesian estimation for the M/G/1 queue using a phase-type approximation. Journal of Statistical Planning and Inference 118, 1-2 (2004), 83- 101.
- Baccelli, F., Kauffmann, B., and Veitch, D. Inverse problems in queueing theory and internet probing. Queueing Systems 63, 1 (2009), 59-107.
- Bandi, C., Bertsimas, D., and Youssef, N. Robust queueing theory. Operations Research 63, 3 (2015), 676-700.
- Basawa, I., Bhat, U., and Lund, R. Maximum likelihood estimation for single server queues from waiting time data. Queueing Systems 24, 1 (1996), 155-167.
- Basawa, I., Bhat, U., and Zhou, J. Parameter estimation using partial information with applications to queueing and related models. Statistics & Probability Letters 78, 12 (2008), 1375-1383.
- Basawa, I., and Prabhu, N. Large sample inference from single server queues. Queueing Systems 3, 4 (1988), 289-304.
- Bertsimas, D., and Servi, L. Deducing queueing from transactional data: the queue inference engine, revisited. Operations Research 40 (1992), S217-S228.
- Bhat, U., Miller, G., and Rao, S. Statistical analysis of queueing systems. Chapter in: Frontiers in queueing (ed. J.H. Dshalalow) (1997), 351-394.
- Bhat, U., and Rao, S. Statistical analysis of queueing systems. Queueing Systems 1, 3 (1987), 217-247.
- Bingham, N., and Pitts, S. Non-parametric estimation for the M/G/∞ queue. Annals of the Institute of Statistical Mathematics 51, 1 (1999), 71-97.
- Bingham, N., and Pitts, S. Nonparametric inference from M/G/l busy periods. Stochastic Models 15, 2 (1999), 247-272.
- Bladt, M., and Sørensen, M. Statistical inference for discretely observed Markov jump processes. Journal of the Royal Statistical Society: Series B (Statistical Methodology) 67, 3 (2005), 395-410.
- Blanghaps, N., Nov, Y., and Weiss, G. Sojourn time estimation in an M/G/∞ queue with partial information. Journal of Applied Probability 50, 4 (2013), 1044-1056.
- Bolstad, W., and Curran, J. Introduction to Bayesian statistics. John Wiley & Sons, 2016.
- Boxma, O., and Vlasiou, M. On queues with service and interarrival times depending on waiting times. Queueing Systems 56, 3-4 (2007), 121-132.
- Bramson, M. Stability of queueing networks. Springer, 2008.
- Brillinger, D. Cross-spectral analysis of processes with stationary increments including the stationary G/G/∞ queue. The Annals of Probability 2, 5 (1974), 815-827.
- Brockwell, P., Davis, R., and Fienberg, S. Time series: theory and methods: theory and methods. Springer Science & Business Media, 1991.
- Brown, M. An M/G/∞ estimation problem. The Annals of Mathematical Statistics 41, 2 (1970), 651-654.
- Carson, J., and Law, A. Conservation equations and variance reduction in queueing simula- tions. Operations Research 28, 3-part-i (1980), 535-546.
- Chen, H., and Yao, D. Fundamentals of queueing networks: Performance, asymptotics, and optimization ( stochastic modelling and applied probability series, vol. 46), vol. 46. Springer Science & Business Media, 2013.
- Chen, T., Walrand, J., and Messerschmitt, D. Parameter estimation for partially ob- served queues. Communications, IEEE Transactions on 42, 9 (1994), 2730-2739.
- Clarke, A. Maximum likelihood estimates in a simple queue. The Annals of Mathematical Statistics 28, 4 (1957), 1036-1040.
- Cohen, J. The single server queue (applied. Mathematics and mechanics, vol. 8). North-Holland Amsterdam, 1982.
- Comert, G., and Cetin, M. Queue length estimation from probe vehicle location and the impacts of sample size. European Journal of Operational Research 197, 1 (2009), 196-202.
- Conti, P. Large sample Bayesian analysis for Geo/G/1 discrete-time queueing models. The Annals of Statistics 27, 6 (1999), 1785-1807.
- Cox, D. Some problems of statistical analysis connected via congestion. In Proc. Symp. on Congestion Theory (1965), pp. 289-316.
- Daley, D., and Servi, L. Exploiting Markov chains to infer queue length from transactional data. Journal of Applied Probability 29, 3 (1992), 713-732.
- Daley, D., and Servi, L. A two-point Markov chain boundary-value problem. Advances in Applied Probability 25, 3 (1993), 607-630.
- Daley, D., and Servi, L. Estimating waiting times from transactional data. INFORMS Journal on Computing 9, 2 (1997), 224-229.
- Daley, D., and Servi, L. Moment estimation of customer loss rates from transactional data. Journal of Applied Mathematics and Stochastic Analysis 11, 3 (1998), 301-310.
- den Boer, A., and Mandjes, M. Convergence rates of Laplace-transform based estimators. Bernoulli 23, 4A (2017), 2533-2557.
- Dimitrijevic, D. Inferring most likely queue length from transactional data. Operations Re- search Letters 19, 4 (1996), 191-199.
- Dinh, T., Andrew, L., and Nazarathy, Y. Architecture and robustness tradeoffs in speed- scaled queues with application to energy management. International Journal of Systems Science 45, 8 (2014), 1728-1739.
- Dong, J., and Whitt, W. Stochastic grey-box modeling of queueing systems: fitting birth- and-death processes to data. Queueing Systems 79, 3-4 (2015), 391-426.
- Dong, J., and Whitt, W. Using a birth-and-death process to estimate the steady-state distribution of a periodic queue. Naval Research Logistics (NRL) 62, 8 (2015), 664-685.
- Duffie, D., and Glynn, P. Estimation of continuous-time Markov processes sampled at random time intervals. Econometrica 72, 6 (2004), 1773-1808.
- Duffy, K., and Meyn, S. Estimating Loynes' exponent. Queueing Systems 68, 3-4 (2011), 285-293.
- Edelmann, D., and Wichelhaus, C. Nonparametric inference for queueing networks of Geom X /G/∞ queues in discrete time. Advances in Applied Probability 46, 3 (2014), 790-811.
- Fearnhead, P. Filtering recursions for calculating likelihoods for queues based on inter- departure time data. Statistics and Computing 14, 3 (2004), 261-266.
- Foss, S., and Konstantopoulos, T. An overview of some stochastic stability methods (special issue: network design, control and optimization). Journal of the Operations Research Society of Japan 47, 4 (2004), 275-303.
- Frey, J., and Kaplan, E. Queue inference from periodic reporting data. Operations Research Letters 38, 5 (2010), 420-426.
- Glynn, P., Melamed, B., and Whitt, W. Estimating customer and time averages. Opera- tions research 41, 2 (1993), 400-408.
- Glynn, P., and Torres, M. Parametric estimation of tail probabilities for the single-server queue. Chapter in Frontiers in Queueing: Models and Applications in Science and Engineering (ed. J.H. Dshalalow) (1997), 449-462.
- Glynn, P., and Whitt, W. A central-limit-theorem version of L= λW. Queueing Systems 1, 2 (1986), 191-215.
- Glynn, P., and Whitt, W. Indirect estimation via L = λW . Operations Research 37, 1 (1989), 82-103.
- Glynn, P., and Zeevi, A. Estimating tail probabilities in queues via extremal statistics. analysis of communication networks: Call centres, traffic and performance, 135-158. Fields Inst. Commun 28 .
- Goldenschluger, A. Nonparametric estimation of the service time distribution in the M/G/∞ queue. Advances in Applied Probability 48, 4 (2016), 1117-1138.
- Goldenshluger, A. The M/G/∞ estimation problem revisited. Bernoulli 24, 4A (2018), 2531-2568.
- Goldenshluger, A., and Koops, D. T. Nonparametric estimation of service time character- istics in infinite-server queues with nonstationary Poisson input. Stochastic Systems 9, 3 (2019), 183-207.
- Grübel, R. Stochastic models as functionals: some remarks on the renewal case. Journal of Applied Probability 26, 2 (1989), 296-303.
- Grübel, R., and Pitts, S. A functional approach to the stationary waiting time and idle period distributions of the GI/G/1 queue. The Annals of Probability 20, 4 (1992), 1754-1778.
- Grübel, R., and Wegener, H. Matchmaking and testing for exponentiality in the M/G/∞ queue. Journal of Applied Probability 48, 1 (2011), 131-144.
- Hall, P., and Park, J. Nonparametric inference about service time distribution from indirect measurements. Journal of the Royal Statistical Society: Series B (Statistical Methodology) 66, 4 (2004), 861-875.
- Hansen, M., and Pitts, S. Nonparametric inference from the M/G/1 workload. Bernoulli 12, 4 (2006), 737-759.
- Heckmuller, S., and Wolfinger, B. Reconstructing arrival processes to G/D/1 queueing systems and tandem networks. In Performance Evaluation of Computer & Telecommunication Systems, 2009. SPECTS 2009. International Symposium on (2009), vol. 41, IEEE, pp. 361-368.
- Heckmüller, S., and Wolfinger, B. Reconstructing arrival processes to discrete queueing systems by inverse load transformation. Simulation 87, 12 (2011), 1033-1047.
- Hei, X., Bensaou, B., and Tsang, D. A light-weight available bandwidth inference method- ology in a queueing analysis approach. In Communications, 2005. ICC 2005. 2005 IEEE Inter- national Conference on (2005), vol. 1, IEEE, pp. 120-124.
- Hei, X., Bensaou, B., and Tsang, D. Model-based end-to-end available bandwidth inference using queueing analysis. Computer Networks 50, 12 (2006), 1916-1937.
- Hernandez-Lerma, O., and Marcus, S. Adaptive control of service in queueing systems. Systems & Control Letters 3, 5 (1983), 283-289.
- Ibrahim, R., and Whitt, W. Wait-time predictors for customer service systems with time- varying demand and capacity. Operations Research-Baltimore 59, 5 (2011), 1106-1118.
- Insua, D., Wiper, M., and Ruggeri, F. Bayesian analysis of M/Er/1 and M/H k /1 queues. Queueing Systems 30, 3 (1998), 289-308.
- Jones, L. Inferring balking behavior from transactional data. Operations Research 47, 5 (1999), 778-784.
- Jones, L. Remarks on queue inference from departure data alone and the importance of the queue inference engine. Operations Research Letters 40, 6 (2012), 503-505.
- Jones, L., and Larson, R. Efficient computation of probabilities of events described by order statistics and applications to queue inference. ORSA Journal on Computing 7, 1 (1995), 89-100.
- Kauffmann, B. Inverse problems in bandwidth sharing networks. In Proceedings of the 24th International Teletraffic Congress (2012), International Teletraffic Congress, p. 6.
- Ke, J., and Chu, Y. Comparison on five estimation approaches of intensity for a queueing system with short run. Computational Statistics 24, 4 (2009), 567-582.
- Kelly, F. Reversibility and stochastic networks. Cambridge University Press, 2011.
- Kiessler, P., and Lund, R. Technical note: Traffic intensity estimation. Naval Research Logistics (NRL) 56, 4 (2009), 385-387.
- Kim, S., and Whitt, W. Estimating waiting times with the time-varying Little's law. Proba- bility in the Engineering and Informational Sciences 27, 4 (2013), 471-506.
- Kim, S., and Whitt, W. Statistical analysis with Little's law. Operations Research 61, 4 (2013), 1030-1045.
- Kim, S., Whitt, W., and Cha, W. A data-driven model of an appointment-generated arrival process at an outpatient clinic. INFORMS Journal on Computing 30, 1 (2018), 181-199.
- Krishnasamy, S., Arapostathis, A., Johari, R., and Shakkottai, S. On learning the cµ rule in single and parallel server networks. In 2018 56th Annual Allerton Conference on Communication, Control, and Computing (Allerton) (2018), IEEE, pp. 153-154.
- Larson, R. The queue inference engine: deducing queue statistics from transactional data. Management Science 36, 5 (1990), 586-601.
- Latouche, G., Ramaswami, V., Sethuraman, J., Sigman, K., Squillante, M., and Yao, D. Matrix-Analytic Methods in Stochastic Models (Springer proceedings in mathematics & statistics, vol. 27). Springer Science & Business Media, 2012.
- Mandelbaum, A., and Zeltyn, S. Estimating characteristics of queueing networks using transactional data. Queueing Systems 29, 1 (1998), 75-127.
- Mandjes, M., Patch, B., and Walton, N. Detecting Markov chain instability: a Monte Carlo approach. Stochastic Systems 7, 2 (2017), 289-314.
- Mandjes, M., and Ravner, L. Hypothesis testing for a Lévy-driven storage system by Poisson sampling. Stochastic Processes and their Applications 133 (2020), 41-73.
- Mcgrath, M., Gross, D., and Singpurwalla, N. A subjective Bayesian approach to the theory of queues I-Modeling. Queueing Systems 1, 4 (1987), 317-333.
- McGrath, M., and Singpurwalla, N. A subjective Bayesian approach to the theory of queues II-Inference and information in M/M/1 queues. Queueing Systems 1, 4 (1987), 335-353.
- McVinish, R., and Pollett, P. Constructing estimating equations from queue length data. preprint.
- Nam, S., Kim, S., and Sung, D. Estimation of available bandwidth for an M/G/1 queueing system. Applied Mathematical Modelling 33, 8 (2009), 3299-3308.
- Neal, R. Slice sampling. Annals of statistics 31, 3 (2003), 705-741.
- Novak, A., and Watson, R. Determining an adequate probe separation for estimating the arrival rate in an M/D/1 queue using single-packet probing. Queueing Systems 61, 4 (2009), 255-272.
- Nozari, A., and Whitt, W. Estimating average production intervals using inventory mea- surements: Little's law for partially observable processes. Operations research 36, 2 (1988), 308-323.
- Pagurek, B., Stanford, D. A., and Woodside, C. M. Optimal prediction of times and queue lengths in the M/G/1 queue. Journal of the Operational Research Society 39, 6 (1988), 585-593.
- Park, J., Kim, Y. B., and Willemain, T. Analysis of an unobservable queue using arrival and departure times. Computers & Industrial Engineering 61, 3 (2011), 842-847.
- Pickands III, J., and Stine, R. Estimation for an M/G/∞ queue with incomplete informa- tion. Biometrika 84, 2 (1997), 295-308.
- Pin, F., Veitch, D., and Kauffmann, B. Statistical estimation of delays in a multicast tree using accelerated EM. Queueing Systems 66, 4 (2010), 369-412.
- Pitts, S. Nonparametric estimation of the stationary waiting time distribution function for the GI/G/1 queue. The Annals of Statistics 22, 3 (1994), 1428-1446.
- Ramirez-Cobo, P., Lillo, R., Wilson, S., and Wiper, M. Bayesian inference for double Pareto lognormal queues. The Annals of Applied Statistics 4, 3 (2010), 1533-1557.
- Ravner, L., Boxma, O., and Mandjes, M. Estimating the input of a Lévy-driven queue by Poisson sampling of the workload process. Bernoulli 25, 4B (2019), 3734-3761.
- Reynolds, J. The covariance structure of queues and related processes-a survey of recent work. Advances in Applied Probability 7, 2 (1975), 383-415.
- Rodrigo, A., and Vazquez, M. Large sample inference in retrial queues. Mathematical and Computer Modelling 30, 3-4 (1999), 197-206.
- Ross, J., Taimre, T., and Pollett, P. Estimation for queues from queue length data. Queueing Systems 55, 2 (2007), 131-138.
- Schruben, L., and Kulkarni, R. Some consequences of estimating parameters for the M/M/1 queue. Operations Research Letters 1, 2 (1982), 75-78.
- Schweer, S., and Wichelhaus, C. Nonparametric estimation of the service time distribution in the discrete-time GI/G/∞ queue with partial information. Stochastic Processes and their Applications 125, 1 (2015), 233-253.
- Schweer, S., and Wichelhaus, C. Nonparametric estimation of the service time distribution in discrete-time queueing networks. Stochastic Processes and their Applications 130, 8 (2020), 4643 -4666.
- Senderovich, A., Leemans, S., Harel, S., Gal, A., Mandelbaum, A., and van der Aalst, W. Discovering queues from event logs with varying levels of information. In Interna- tional Conference on Business Process Management (2016), Springer, pp. 154-166.
- Senderovich, A., Weidlich, M., Gal, A., and Mandelbaum, A. Queue mining-predicting delays in service processes. In International Conference on Advanced Information Systems En- gineering (2014), Springer, pp. 42-57.
- Senderovich, A., Weidlich, M., Gal, A., and Mandelbaum, A. Queue mining for delay prediction in multi-class service processes. Information Systems 53 (2015), 278-295.
- Senderovich, A., Weidlich, M., Gal, A., Mandelbaum, A., Kadish, S., and Bun- nell, C. Discovery and validation of queueing networks in scheduled processes. In Advanced Information Systems Engineering (2015), Springer, pp. 417-433.
- Sharma, V., and Mazumdar, R. Estimating traffic parameters in queueing systems with local information. Performance Evaluation 32, 3 (1998), 217-230.
- Stanford, D., Pagurek, B., and Woodside, C. Optimal prediction of times and queue lengths in the GI/M/1 queue. Operations Research 31, 2 (1983), 322-337.
- Sutton, C., and Jordan, M. Bayesian inference for queueing networks and modeling of internet services. The Annals of Applied Statistics 5, 1 (2011), 254-282.
- Thiongane, M., Chan, W., and l'Ecuyer, P. New history-based delay predictors for service systems. In 2016 Winter Simulation Conference (WSC) (2016), IEEE, pp. 425-436.
- Thiruvaiyaru, D., and Basawa, I. Empirical Bayes estimation for queueing systems and networks. Queueing Systems 11, 3 (1992), 179-202.
- Thiruvaiyaru, D., Basawa, I., and Bhat, U. Estimation for a class of simple queueing networks. Queueing Systems 9, 3 (1991), 301-312.
- Van der Aalst, W., Weijters, T., and Maruster, L. Workflow mining: Discovering process models from event logs. IEEE transactions on knowledge and data engineering 16, 9 (2004), 1128-1142.
- Wang, W., and Casale, G. Maximum Likelihood Estimation of Closed Queueing Network Demands from Queue Length Data. ACM SIGMETRICS Performance Evaluation Review 43, 2 (2015), 45-47.
- Wang, W., Casale, G., Kattepur, A., and Nambiar, M. Maximum likelihood estima- tion of closed queueing network demands from queue length data. In Proceedings of the 7th ACM/SPEC on International Conference on Performance Engineering (2016), pp. 3-14.
- Whitt, W. Predicting queueing delays. Management Science 45, 6 (1999), 870-888.
- Whitt, W. Stochastic-process limits: an introduction to stochastic-process limits and their application to queues. Springer Science & Business Media, 2002.
- Whitt, W. Fitting birth-and-death queueing models to data. Statistics and Probability Letters 82 (2012), 998-1004.
- Woodside, C., Stanford, D., and Pagurek, B. Optimal prediction of queue lengths and delays in G i /M/M multiserver queues. Operations research 32, 4 (1984), 809-817.
- Zhang, L., Xia, C., Squillante, M., and Mills, W. Workload service requirements analysis: A queueing network optimization approach. In Modeling, Analysis and Simulation of Computer and Telecommunications Systems, 2002. MASCOTS 2002. Proceedings. 10th IEEE International Symposium on (2002), IEEE, pp. 23-32.
- Zheng, S., and Seila, A. Some well-behaved estimators for the M/M/1 queue. Operations Research Letters 26, 5 (2000), 231-235.