The Annals of Applied Probability

A general limit theorem for recursive algorithms and combinatorial structures

Ralph Neininger and Ludger Rüschendorf
Source: Ann. Appl. Probab. Volume 14, Number 1 (2004), 378-418.

Abstract

Limit laws are proven by the contraction method for random vectors of a recursive nature as they arise as parameters of combinatorial structures such as random trees or recursive algorithms, where we use the Zolotarev metric. In comparison to previous applications of this method, a general transfer theorem is derived which allows us to establish a limit law on the basis of the recursive structure and the asymptotics of the first and second moments of the sequence. In particular, a general asymptotic normality result is obtained by this theorem which typically cannot be handled by the more common $\ell_2$ metrics. As applications we derive quite automatically many asymptotic limit results ranging from the size of tries or $m$-ary search trees and path lengths in digital structures to mergesort and parameters of random recursive trees, which were previously shown by different methods one by one. We also obtain a related local density approximation result as well as a global approximation result. For the proofs of these results we establish that a smoothed density distance as well as a smoothed total variation distance can be estimated from above by the Zolotarev metric, which is the main tool in this article.

First Page: Show Hide
Primary Subjects: 60F05, 68Q25
Secondary Subjects: 68P10
Full-text: Open access
Links and Identifiers

Permanent link to this document: http://projecteuclid.org/euclid.aoap/1075828056
Digital Object Identifier: doi:10.1214/aoap/1075828056
Mathematical Reviews number (MathSciNet): MR2023025
Zentralblatt MATH identifier: 1041.60024

References

Aho, A. V., Hopcroft, J. E. and Ullman, J. D. (1983). Data Structures and Algorithms. Addison--Wesley, Reading, MA.
Mathematical Reviews (MathSciNet): MR666695
Zentralblatt MATH: 0487.68005
Baeza-Yates, R. A. (1987). Some average measures in $m$-ary search trees. Inform. Process. Lett. 25 375--381.
Mathematical Reviews (MathSciNet): MR905782
Digital Object Identifier: doi:10.1016/0020-0190(87)90215-8
Zentralblatt MATH: 0653.68058
Bai, Z.-D., Hwang, H.-K., Liang, W.-Q. and Tsai, T.-H. (2001). Limit theorems for the number of maxima in random samples from planar regions. Electron. J. Probab. 6.
Mathematical Reviews (MathSciNet): MR1816046
Bai, Z.-D., Hwang, H.-K. and Tsai, T.-H. (2002). Berry--Esseen bounds for the number of maxima in planar regions. Electron J. Probab. 8.
Mathematical Reviews (MathSciNet): MR1986841
Burton, R. and Rösler, U. (1995). An $L_2$ convergence theorem for random affine mappings. J. Appl. Probab. 32 183--192.
Mathematical Reviews (MathSciNet): MR1316801
Chen, W.-M., Hwang, H.-K. and Chen, G.-H. (1999). The cost distribution of queue-mergesort, optimal mergesorts, and power-of-2 rules. J. Algorithms 30 423--448.
Mathematical Reviews (MathSciNet): MR1671856
Digital Object Identifier: doi:10.1006/jagm.1998.0986
Zentralblatt MATH: 0923.68045
Chern, H.-H. and Hwang, H.-K. (2001). Phase changes in random $m$-ary search trees and generalized quicksort. Random Structures Algorithms 19 316--358.
Mathematical Reviews (MathSciNet): MR1871558
Chern, H.-H., Hwang, H.-K. and Tsai, T.-H. (2002). An asymptotic theory for Cauchy--Euler differential equations with applications to the analysis of algorithms. J. Algorithms 44 177--225.
Mathematical Reviews (MathSciNet): MR1933199
Digital Object Identifier: doi:10.1016/S0196-6774(02)00208-0
Zentralblatt MATH: 1030.68114
Cramer, M. (1997). Stochastic analysis of the merge--sort algorithm. Random Structures Algorithms 11 81--96.
Mathematical Reviews (MathSciNet): MR1608192
Cramer, M. and Rüschendorf, L. (1995). Analysis of recursive algorithms by the contraction method. Athens Conference on Applied Probability and Time Series Analysis. Lecture Notes in Statist. 114 18--33. Springer, New York.
Mathematical Reviews (MathSciNet): MR1466705
Zentralblatt MATH: 0858.60036
Devroye, L. (1991). Limit laws for local counters in random binary search trees. Random Structures Algorithms 2 303--315.
Mathematical Reviews (MathSciNet): MR1109697
Devroye, L. (2003). Limit laws for sums of functions of subtrees of random binary search trees. SIAM J. Comput. 32 152--171.
Mathematical Reviews (MathSciNet): MR1954858
Digital Object Identifier: doi:10.1137/S0097539701383923
Zentralblatt MATH: 1029.68076
Dobrow, R. P. and Fill, J. A. (1999). Total path length for random recursive trees. Combin. Probab. Comput. 8 317--333.
Mathematical Reviews (MathSciNet): MR1723646
Digital Object Identifier: doi:10.1017/S0963548399003855
Zentralblatt MATH: 0946.05077
Fill, J. A. (1996). On the distribution of binary search trees under the random permutation model. Random Structures Algorithms 8 1--25.
Mathematical Reviews (MathSciNet): MR1368848
Flajolet, P. and Golin, M. (1994). Mellin transforms and asymptotics. The mergesort recurrence. Acta Inform. 31 673--696.
Mathematical Reviews (MathSciNet): MR1300060
Digital Object Identifier: doi:10.1007/BF01177551
Zentralblatt MATH: 0818.68064
Flajolet, P., Gourdon, X. and Martínez, C. (1997). Patterns in random binary search trees. Random Structures Algorithms 11 223--244.
Mathematical Reviews (MathSciNet): MR1609509
Geiger, J. (2000). A new proof of Yaglom's exponential limit law. In Algorithms, Trees Combinatorics and Probability (D. Gardy and A. Mokkadem, eds.) 245--249. Birkhäuser, Basel.
Mathematical Reviews (MathSciNet): MR1798303
Zentralblatt MATH: 0967.60089
Grübel, R. and Rösler, U. (1996). Asymptotic distribution theory for Hoare's selection algorithm. Adv. in Appl. Probab. 28 252--269.
Mathematical Reviews (MathSciNet): MR1372338
Hubalek, F., Hwang, H.-K., Lew, W., Mahmoud, H. M. and Prodinger, H. (2002). A multivariate view of random bucket digital search trees. J. Algorithms 44 121--158.
Mathematical Reviews (MathSciNet): MR1933197
Digital Object Identifier: doi:10.1016/S0196-6774(02)00210-9
Zentralblatt MATH: 1010.68047
Hwang, H.-K. (1996). Asymptotic expansions of the mergesort recurrences. Acta Inform. 35 911--919.
Mathematical Reviews (MathSciNet): MR1656104
Digital Object Identifier: doi:10.1007/s002360050147
Zentralblatt MATH: 0910.68058
Hwang, H.-K. (1998). Limit theorems for mergesort. Random Structures Algorithms 8 319--336.
Mathematical Reviews (MathSciNet): MR1603254
Hwang, H.-K. (2001). Lectures on asymptotic analysis given at McGill Univ., Montreal.
Hwang, H.-K. and Neininger, R. (2002). Phase change of limit laws in the quicksort recurrence under varying toll functions. SIAM J. Comput. 31 1687--1722.
Mathematical Reviews (MathSciNet): MR1954876
Digital Object Identifier: doi:10.1137/S009753970138390X
Zentralblatt MATH: 1008.68166
Hwang, H.-K. and Tsai, T.-H. (2002). Quickselect and Dickman function. Combin. Probab. Comput. 11 353--371.
Mathematical Reviews (MathSciNet): MR1918722
Digital Object Identifier: doi:10.1017/S0963548302005138
Zentralblatt MATH: 1008.68044
Jacquet, P. and Régnier, M. (1988). Normal limiting distribution of the size and the external path length of tries. Technical Report RR-0827, INRIA-Rocquencourt.
Jacquet, P. and Régnier, M. (1988). Normal limiting distribution of the size of tries. In Performance'87 209--223. North-Holland, Amsterdam.
Mathematical Reviews (MathSciNet): MR1024828
Jacquet, P. and Szpankowski, W. (1995). Asymptotic behavior of the Lempel--Ziv parsing scheme and digital search trees. Theoret. Comput. Sci. 144 161--197.
Mathematical Reviews (MathSciNet): MR1337757
Digital Object Identifier: doi:10.1016/0304-3975(94)00298-W
Kirschenhofer, P., Prodinger, H. and Szpankowski, W. (1989). On the balance property of Patricia tries: External path length viewpoint. Theoret. Comput. Sci. 68 1--17.
Mathematical Reviews (MathSciNet): MR1022654
Digital Object Identifier: doi:10.1016/0304-3975(89)90115-1
Zentralblatt MATH: 0678.68042
Kirschenhofer, P., Prodinger, H. and Szpankowski, W. (1989). On the variance of the external path length in a symmetric digital trie. Discrete Appl. Math. 25 129--143.
Mathematical Reviews (MathSciNet): MR1031267
Digital Object Identifier: doi:10.1016/0166-218X(89)90050-4
Kirschenhofer, P., Prodinger, H. and Szpankowski, W. (1994). Digital search trees again revisited: The internal path length perspective. SIAM J. Comput. 23 598--616.
Mathematical Reviews (MathSciNet): MR1274646
Digital Object Identifier: doi:10.1137/S0097539790189368
Zentralblatt MATH: 0819.68067
Knuth, D. E. (1973). The Art of Computer Programming 3. Addison--Wesley, Reading, MA.
Mathematical Reviews (MathSciNet): MR378456
Kodaj, B. and Móri, T. F. (1997). On the number of comparisons in Hoare's algorithm ``FIND.'' Studia Sci. Math. Hungar. 33 185--207.
Mathematical Reviews (MathSciNet): MR1454110
Lew, W. and Mahmoud, H. M. (1994). The joint distribution of elastic buckets in multiway search trees. SIAM J. Comput. 23 1050--1074.
Mathematical Reviews (MathSciNet): MR1293274
Digital Object Identifier: doi:10.1137/S009753979223023X
Zentralblatt MATH: 0820.68037
Mahmoud, H. M. (1992). Evolution of Random Search Trees. Wiley, New York.
Mathematical Reviews (MathSciNet): MR1140708
Zentralblatt MATH: 0762.68033
Mahmoud, H. M. (2000). Sorting. A Distribution Theory. Wiley, New York.
Mathematical Reviews (MathSciNet): MR1784633
Mahmoud, H. M. and Pittel, B. (1989). Analysis of the space of search trees under the random insertion algorithm. J. Algorithms 10 52--75.
Mathematical Reviews (MathSciNet): MR987097
Digital Object Identifier: doi:10.1016/0196-6774(89)90023-0
Zentralblatt MATH: 0685.68060
Mahmoud, H. M. and Smythe, R. T. (1991). On the distribution of leaves in rooted subtrees of recursive trees. Ann. Appl. Probab. 1 406--418.
Mathematical Reviews (MathSciNet): MR1111525
Mahmoud, H. M. and Smythe, R. T. (1992). Asymptotic joint normality of outdegrees of nodes in random recursive trees. Random Structures Algorithms 3 255--266.
Mathematical Reviews (MathSciNet): MR1164839
Mahmoud, H. M., Modarres, R. and Smythe, R. T. (1995). Analysis of quickselect: An algorithm for order statistics. RAIRO Inform. Théor. Appl. 29 255--276.
Mathematical Reviews (MathSciNet): MR1359052
Mahmoud, H. M., Smythe, R. T. and Szymański, J. (1993). On the structure of random plane-oriented recursive trees and their branches. Random Structures Algorithms 4 151--176.
Mathematical Reviews (MathSciNet): MR1206674
Neininger, R. (2001). On a multivariate contraction method for random recursive structures with applications to Quicksort. Random Structures Algorithms 19 498--524.
Mathematical Reviews (MathSciNet): MR1871564
Neininger, R. and Rüschendorf, L. (1999). On the internal path length of $d$-dimensional quad trees. Random Structures Algorithms 15 25--41.
Mathematical Reviews (MathSciNet): MR1698407
Neininger, R. and Rüschendorf, L. (2002). Rates of convergence for Quicksort. J. Algorithms 44 52--62.
Mathematical Reviews (MathSciNet): MR1932677
Digital Object Identifier: doi:10.1016/S0196-6774(02)00206-7
Zentralblatt MATH: 1010.68049
Pittel, B. (1999). Normal convergence problem? Two moments and a recurrence may be the clues. Ann. Appl. Probab. 9 1260--1302.
Mathematical Reviews (MathSciNet): MR1728562
Digital Object Identifier: doi:10.1214/aoap/1029962872
Project Euclid: euclid.aoap/1029962872
Zentralblatt MATH: 0960.60014
Rachev, S. T. (1991). Probability Metrics and the Stability of Stochastic Models. Wiley, New York.
Mathematical Reviews (MathSciNet): MR1105086
Zentralblatt MATH: 0744.60004
Rachev, S. T. and Rüschendorf, L. (1994). On the rate of convergence in the CLT with respect to the Kantorovich metric. In Probability in Banach Spaces (J. Hoffmann-Jorgensen, J. Kuelbs and M. B. Marcus, eds.) 9 193--207. Birkhäuser, Boston.
Mathematical Reviews (MathSciNet): MR1308518
Rachev, S. T. and Rüschendorf, L. (1995). Probability metrics and recursive algorithms. Adv. in Appl. Probab. 27 770--799.
Mathematical Reviews (MathSciNet): MR1341885
Rösler, U. (1991). A limit theorem for ``Quicksort.'' RAIRO Inform. Théor. Appl. 25 85--100.
Mathematical Reviews (MathSciNet): MR1104413
Rösler, U. (1992). A fixed point theorem for distributions. Stochastic Process. Appl. 42 195--214.
Mathematical Reviews (MathSciNet): MR1176497
Digital Object Identifier: doi:10.1016/0304-4149(92)90035-O
Zentralblatt MATH: 0761.60015
Rösler, U. (2001). On the analysis of stochastic divide and conquer algorithms. Algorithmica 29 238--261.
Mathematical Reviews (MathSciNet): MR1887306
Rösler, U. and Rüschendorf, L. (2001). The contraction method for recursive algorithms. Algorithmica 29 3--33.
Mathematical Reviews (MathSciNet): MR1887296
Schachinger, W. (2001). Asymptotic normality of recursive algorithms via martingale difference arrays. Discrete Math. Theor. Comput. Sci. 4 363--397.
Mathematical Reviews (MathSciNet): MR1877529
Senatov, V. V. (1980). Some uniform estimates of the convergence rate in the multidimensional central limit theorem. Theory Probab. Appl. 25 745--759.
Mathematical Reviews (MathSciNet): MR595137
Smythe, R. T. and Mahmoud, H. M. (1994). A survey of recursive trees. Teor. Īmovīr. ta Mat. Statist. 51 1--29.
Mathematical Reviews (MathSciNet): MR1445048
Szpankowski, W. (2001). Average Case Analysis of Algorithms on Sequences. Wiley, New York.
Mathematical Reviews (MathSciNet): MR1816272
Zentralblatt MATH: 0968.68205
Tenenbaum, G. (1995). Introduction to Analytic and Probabilistic Number Theory. (C. B. Thomas, transl.). Cambridge Univ. Press.
Mathematical Reviews (MathSciNet): MR1342300
Zolotarev, V. M. (1976). Approximation of the distributions of sums of independent random variables with values in infinite-dimensional spaces. Theory Probab. Appl. 21 721--737.
Mathematical Reviews (MathSciNet): MR517338
Zolotarev, V. M. (1977). Ideal metrics in the problem of approximating distributions of sums of independent random variables. Theory Probab. Appl. 22 433--449.
Mathematical Reviews (MathSciNet): MR455066

2012 © Institute of Mathematical Statistics

The Annals of Applied Probability

The Annals of Applied Probability