CIVILICA We Respect the Science
(ناشر تخصصی کنفرانسهای کشور / شماره مجوز انتشارات از وزارت فرهنگ و ارشاد اسلامی: ۸۹۷۱)

Accelerating Iterative Methods for Bounded Reachability Probabilities in Markov Decision Processes

عنوان مقاله: Accelerating Iterative Methods for Bounded Reachability Probabilities in Markov Decision Processes
شناسه ملی مقاله: JR_CKE-3-2_003
منتشر شده در در سال 1400
مشخصات نویسندگان مقاله:

Mohammadsadegh Mohagheghi - Department of Computer science, Vali-e-Asr University of Rafsanjan, Rafsanjan, Iran.

خلاصه مقاله:
Probabilistic model checking is a formal method for verification of the quantitative and qualitative properties of computer systems with stochastic behaviors. Markov Decision Processes (MDPs) are well-known formalisms for modeling this class of systems. Bounded reachability probabilities are an important class of properties that are computed in probabilistic model checking. Iterative numerical computations are used for this class of properties. A significant draw-back of the standard iterative methods is the redundant computations that do not affect the final results of the computations, but increase the running time of the computations. The study proposes two new approaches to avoid redundant computations for bounded reachability analysis. The general idea of these approaches is to identify and avoid useless numerical computations in iterative methods for computing bounded reachability probabilities.

کلمات کلیدی:
Probabilistic model checking, Iterative numerical methods, Bounded Reachability probabilities, Markov decision processes

صفحه اختصاصی مقاله و دریافت فایل کامل: https://civilica.com/doc/1465757/