Efficient Analysis of Probabilistic Programs with an Unbounded Counter
Authors | |
---|---|
Year of publication | 2014 |
Type | Article in Periodical |
Magazine / Source | Journal of the ACM |
MU Faculty or unit | |
Citation | |
Doi | http://dx.doi.org/10.1145/2629599 |
Field | Informatics |
Keywords | Markov chains; model-checking; one-counter automata |
Description | We show that a subclass of infinite-state probabilistic programs that can be modeled by probabilistic one-counter automata (pOC) admits an efficient quantitative analysis. We start by establishing a powerful link between pOC and martingale theory, which leads to fundamental observations about quantitative properties of runs in pOC. In particular, we provide a “divergence gap theorem”, which bounds a positive non-termination probability in pOC away from zero. Using these observations, we show that the expected termination time can be approximated up to an arbitrarily small relative error in polynomial time, and the same holds for the probability of all runs that satisfy a given omega-regular property encoded by a deterministic Rabin automaton. |
Related projects: |