We consider long-run averages of additive functionals on infinite discrete-state Markov chains, either continuous or discrete in time. Special cases include long-run average costs or rewards, stationary moments of the components of ergodic multi-dimensional Markov chains, queueing network performance measures, and many others. By exploiting Foster-Lyapunov-type criteria involving drift conditions for the finiteness of long-run averages we determine suitable finite subsets of the state space such that the truncation error is bounded. Illustrative examples demonstrate the application of this method.

We study k-divisible partition structures, which are families of random set partitions whose block sizes are divisible by an integer k = 1, 2,.... In this setting, exchangeability corresponds to the usual invariance under relabeling by arbitrary permutations; however, for k > 1, the ordinary deletion maps on partitions no longer preserve divisibility, and so a random deletion procedure is needed to obtain a partition structure. We describe explicit Chinese restaurant-type seating rules for generating families of exchangeable k-divisible partitions that are consistent under random deletion. We further introduce the notion of Markovian partition structures, which are ensembles of exchangeable Markov chains on k-divisible partitions that are consistent under a random process of Markovian deletion. The Markov chains we study are reversible and refine the class of Markov chains introduced in Crane (2011).

We extend the Kalman-Bucy filter to the case where both the system and observation processes are driven by finite dimensional Lévy processes, but whereas the process driving the system dynamics is square-integrable, that driving the observations is not; however it remains integrable. The main result is that the components of the observation noise that have infinite variance make no contribution to the filtering equations. The key technique used is approximation by processes having bounded jumps.

In this paper we characterize the mean and the distribution of the first exit time of a Lévy flight from a bounded region in N-dimensional spaces. We characterize tight upper and lower bounds on the tail distribution of the first exit time, and provide the exact asymptotics of the mean first exit time for a given range of step-length distribution parameters.

Consider a spectrally negative risk process where, on ruin, the deficit is immediately paid, and the process restarts from 0. When the process reaches a threshold b, all the surplus above b is paid as dividend. Applying the theory of exit times for a spectrally negative Lévy process and its reflection at the maximum and at the minimum, we obtain recursive formulae for the following moments. (i) The moments of the discounted loss until the process reaches b. This is equivalent to the moments of the discounted dividends in the dual model under the barrier strategy. (ii) The moments of the discounted loss for models with and without a dividend barrier for the infinite horizon. (iii) The moments of the discounted dividends for the infinite horizon.

In this paper we derive the exact asymptotics of the probability of Parisian ruin for self-similar Gaussian risk processes. Additionally, we obtain the normal approximation of the Parisian ruin time and derive an asymptotic relation between the Parisian and the classical ruin times.

Kuroda and Nagai (2002) stated that the factor process in risk-sensitive control asset management is stable under the Föllmer-Schweizer minimal martingale measure. Fleming and Sheu (2002) and, more recently, Föllmer and Schweizer (2010) observed that the role of the minimal martingale measure in this portfolio optimization is yet to be established. In this paper we aim to address this question by explicitly connecting the optimal wealth allocation to the minimal martingale measure. We achieve this by using a `trick' of observing this problem in the context of model uncertainty via a two person zero sum stochastic differential game between the investor and an antagonistic market that provides a probability measure. We obtain some startling insights. Firstly, if short selling is not permitted and the factor process evolves under the minimal martingale measure, then the investor's optimal strategy can only be to invest in the riskless asset (i.e. the no-regret strategy). Secondly, if the factor process and the stock price process have independent noise, then, even if the market allows short-selling, the optimal strategy for the investor must be the no-regret strategy while the factor process will evolve under the minimal martingale measure.

In a defaultable market, an investor trades having only partial information about the behavior of the market. Taking into account the intraday stock movements, the risky asset prices are modelled by marked point processes. Their dynamics depend on an unobservable process, representing the amount of news reaching the market. This is a marked point process, which may have common jump times with the risky asset price processes. The problem of hedging a defaultable claim is studied. In order to discuss all these topics, in this paper we examine stochastic control problems using backward stochastic differential equations (BSDEs) and filtering techniques. The goal of this paper is to construct a sequence of functions converging to the value function, each of these is the unique solution of a suitable BSDE.

We propose a method to generate a max-stable process in C[0, 1] from a max-stable random vector in R^d by generalizing the max-linear model established by Wang and Stoev (2011). For this purpose, an interpolation technique that preserves max-stability is proposed. It turns out that if the random vector follows some finite-dimensional distribution of some initial max-stable process, the approximating processes converge uniformly to the original process and the pointwise mean-squared error can be represented in a closed form. The obtained results carry over to the case of generalized Pareto processes. The introduced method enables the reconstruction of the initial process only from a finite set of observation points and, thus, a reasonable prediction of max-stable processes in space becomes possible. A possible extension to arbitrary dimensions is outlined.

We take a fresh look at the classical problem of runs in a sequence of independent and identically distributed coin tosses and derive a general identity/recursion which can be used to compute (joint) distributions of functionals of run types. This generalizes and unifies already existing approaches. We give several examples, derive asymptotics, and pose some further questions.

Using backward stochastic difference equations (BSDEs), this paper studies dynamic convex risk measures for risky positions in a simple discrete-time, binomial tree model. A relationship between BSDEs and dynamic convex risk measures is developed using nonlinear expectations. The time consistency of dynamic convex risk measures is discussed in the binomial tree framework. A relationship between prices and risks is also established. Two particular cases of dynamic convex risk measures, namely risk measures with stochastic distortions and entropic risk measures, and their mathematical properties are discussed.

In this paper we establish the central limit theorem for a class of stochastic partial differential equations and as an application derive this theorem for two widely studied population models: super-Brownian motion and the Fleming-Viot process.

In this paper we develop a prelimit analysis of performance measures for importance sampling schemes related to small noise diffusion processes. In importance sampling the performance of any change of measure is characterized by its second moment. For a given change of measure, we characterize the second moment of the corresponding estimator as the solution to a partial differential equation, which we analyze via a full asymptotic expansion with respect to the size of the noise and obtain a precise statement on its accuracy. The main correction term to the decay rate of the second moment solves a transport equation that can be solved explicitly. The asymptotic expansion that we obtain identifies the source of possible poor performance of nevertheless asymptotically optimal importance sampling schemes and allows for a more accurate comparison among competing importance sampling schemes.

In this paper we study the mixing time of certain adaptive Markov chain Monte Carlo (MCMC) algorithms. Under some regularity conditions, we show that the convergence rate of importance resampling MCMC algorithms, measured in terms of the total variation distance, is O(n^-1). By means of an example, we establish that, in general, this algorithm does not converge at a faster rate. We also study the interacting tempering algorithm, a simplified version of the equi-energy sampler, and establish that its mixing time is of order O(n^-1/2).

We study congestion periods in a finite fluid buffer when the net input rate depends upon a recurrent Markov process; congestion occurs when the buffer content is equal to the buffer capacity. Similarly to O'Reilly and Palmowski (2013), we consider the duration of congestion periods as well as the associated volume of lost information. While these quantities are characterized by their Laplace transforms in that paper, we presently derive their distributions in a typical stationary busy period of the buffer. Our goal is to compute the exact expression of the loss probability in the system, which is usually approximated by the probability that the occupancy of the infinite buffer is greater than the buffer capacity under consideration. Moreover, by using general results of the theory of Markovian arrival processes, we show that the duration of congestion and the volume of lost information have phase-type distributions.

Consider an absolutely continuous distribution on [0, ∞) with finite mean μ and hazard rate function h(t) ≤ b for all t. For bμ close to 1, we would expect F to be approximately exponential. In this paper we obtain sharp bounds for the Kolmogorov distance between F and an exponential distribution with mean μ, as well as between F and an exponential distribution with failure rate b. We apply these bounds to several examples. Applications are presented to geometric convolutions, birth and death processes, first-passage times, and to decreasing mean residual life distributions.

This paper is concerned with the Birnbaum importance measure of a component in a binary coherent system. A representation for the Birnbaum importance of a component is obtained when the system consists of exchangeable dependent components. The results are closely related to the concept of the signature of a coherent system. Some examples are presented to illustrate the results.

We extend the infinite-allele simple branching process of Griffiths and Pakes (1988) allowing the offspring to change types and labels. The model is developed and limit theorems are given for the growth of the number of labels of a specific type. We also discuss the asymptotics of the frequency spectrum. Finally, we present an application of the model's use in tumorigenesis.

We study the asymptotics of the survival probability for the critical and decomposable branching processes in a random environment and prove Yaglom-type limit theorems for these processes. It is shown that such processes possess some properties having no analogues for the decomposable branching processes in a constant environment.

In this paper we investigate the limiting behavior of the failure rate for the convolution of two or more life distributions. In a previous paper on mixtures, Block, Mi and Savits (1993) showed that the failure rate behaves like the limiting behavior of the strongest component. We show a similar result here for convolutions. We also show by example that unlike a mixture population, the ultimate direction of monotonicity does not necessarily follow that of the strongest component.

In this paper we consider the stationary PH/M/c queue with deterministic impatience times (PH/M/c+D). We show that the probability density function of the virtual waiting time takes the form of a matrix exponential whose exponent is given explicitly by system parameters.