Turnpike Phenomenon for Markov Decision Processes
This book provides a comprehensive examination of the structure of approximate optimal policies in Markov decision processes (MDPs) with finite state spaces, as well as approximate optimal solutions for deterministic discrete-time optimal control problems. At its core, the monograph delves into the...
שמור ב:
| מחבר ראשי: | |
|---|---|
| מחבר תאגידי: | |
| פורמט: | אלקטרוני ספר אלקטרוני |
| שפה: | אנגלית |
| יצא לאור: |
Cham :
Springer Nature Switzerland : Imprint: Springer,
2025.
|
| מהדורה: | 1st ed. 2025. |
| סדרה: | SpringerBriefs in Mathematics,
|
| נושאים: | |
| גישה מקוונת: | https://doi.org/10.1007/978-3-032-00854-1 |
| תגים: |
הוספת תג
אין תגיות, היה/י הראשונ/ה לתייג את הרשומה!
|
MARC
| LEADER | 00000nam a22000005i 4500 | ||
|---|---|---|---|
| 001 | 978-3-032-00854-1 | ||
| 003 | DE-He213 | ||
| 005 | 20260906083137.0 | ||
| 007 | cr nn 008mamaa | ||
| 008 | 251001s2025 sz | o |||| 0|eng d | ||
| 020 | |a 9783032008541 |9 978-3-032-00854-1 | ||
| 024 | 7 | |a 10.1007/978-3-032-00854-1 |2 doi | |
| 050 | 4 | |a QA402.5-402.6 | |
| 050 | 4 | |a QA315-316 | |
| 072 | 7 | |a PBU |2 bicssc | |
| 072 | 7 | |a MAT042000 |2 bisacsh | |
| 072 | 7 | |a PBU |2 thema | |
| 082 | 0 | 4 | |a 519.6 |2 23 |
| 082 | 0 | 4 | |a 515.64 |2 23 |
| 100 | 1 | |a Zaslavski, Alexander J. |e author. |4 aut |4 http://id.loc.gov/vocabulary/relators/aut | |
| 245 | 1 | 0 | |a Turnpike Phenomenon for Markov Decision Processes |h [electronic resource] / |c by Alexander J. Zaslavski. |
| 250 | |a 1st ed. 2025. | ||
| 264 | 1 | |a Cham : |b Springer Nature Switzerland : |b Imprint: Springer, |c 2025. | |
| 300 | |a 1 online resource (X, 133 p. 1 illus.). | ||
| 336 | |a text |b txt |2 rdacontent | ||
| 337 | |a computer |b c |2 rdamedia | ||
| 338 | |a online resource |b cr |2 rdacarrier | ||
| 341 | 0 | |b PDF/UA-1 |2 onix | |
| 341 | 0 | |b Table of contents navigation |2 onix | |
| 341 | 0 | |b Single logical reading order |2 onix | |
| 341 | 0 | |b Use of colour is Not sole means of conveying information |2 onix | |
| 341 | 0 | |b Use of high contrast between text and background colour |2 onix | |
| 341 | 0 | |b Next / Previous structural navigation |2 onix | |
| 341 | 0 | |b All Non-decorative content supports reading without sight |2 onix | |
| 347 | |a text file |b PDF |2 rda | ||
| 490 | 1 | |a SpringerBriefs in Mathematics, |x 2191-8201 | |
| 505 | 0 | |a 1. Introduction -- 2. Uniqueness and stability of optimal policies -- 3. Existence of an overtaking optimal policy -- 4. A weak turnpike property -- 5. Convex Markov decision processes -- 6. Turnpike properties for MDPs with perturbations -- 7. Controllability properties -- 8. Optimal control problems with singleton-turnpikes -- 9. Conclusions. | |
| 520 | |a This book provides a comprehensive examination of the structure of approximate optimal policies in Markov decision processes (MDPs) with finite state spaces, as well as approximate optimal solutions for deterministic discrete-time optimal control problems. At its core, the monograph delves into the turnpike property, a concept introduced by P. Samuelson, which suggests that optimal solutions are largely determined by the objective function, independent of interval length or endpoint conditions. Key concepts include the uniqueness and stability of minimizing Markov actions, the existence of overtaking optimal policies, and the asymptotic and weak turnpike properties. The authors meticulously examine these phenomena across various classes of MDPs, employing a Baire category approach to demonstrate the generic nature of these properties. The book also addresses the impact of perturbations on cost functions, ensuring the stability of turnpike properties. This monograph is an essential resource for researchers and scholars in the fields of operations research, applied mathematics, and control theory. It provides valuable insights into the intricate dynamics of MDPs and optimal control systems, making it a must-read for anyone seeking to deepen their understanding of these complex topics. | ||
| 532 | 8 | |a Accessibility summary: This PDF has been created in accordance with the PDF/UA-1 standard to enhance accessibility. It includes screen reader support, bookmarks for easy navigation, keyboard-friendly links and forms, and searchable, selectable text. We recognise the importance of accessibility and welcome queries about accessibility for any of our products. If you have a question or an access need, please get in touch with us via https://www.springernature.com/gp/info/accessibility Please Note that a more accessible version of this eBook is available as an EPUB. | |
| 532 | 8 | |a Inaccessible, or known limited accessibility | |
| 532 | 8 | |a No reading system accessibility options actively disabled | |
| 532 | 8 | |a Publisher contact for further accessibility information: accessibilitysupport@springernature.com | |
| 588 | |a Print version record. | ||
| 650 | 0 | |a Mathematical optimization. | |
| 650 | 0 | |a Calculus of variations. | |
| 650 | 0 | |a Probabilities. | |
| 650 | 0 | |a System theory. | |
| 650 | 0 | |a Control theory. | |
| 650 | 1 | 4 | |a Calculus of Variations and Optimization. |
| 650 | 2 | 4 | |a Probability Theory. |
| 650 | 2 | 4 | |a Systems Theory, Control. |
| 710 | 2 | |a SpringerLink (Online service) | |
| 773 | 0 | |t Springer Nature eBook | |
| 776 | 0 | 8 | |i Printed edition: |z 9783032008534 |
| 776 | 0 | 8 | |i Printed edition: |z 9783032008558 |
| 830 | 0 | |a SpringerBriefs in Mathematics, |x 2191-8201 | |
| 856 | 4 | 0 | |u https://doi.org/10.1007/978-3-032-00854-1 |
| 912 | |a ZDB-2-SMA | ||
| 912 | |a ZDB-2-SXMS | ||
| 912 | |a ZDB-2-251 | ||
| 950 | |a Mathematics and Statistics (SpringerNature-11649) | ||
| 950 | |a Mathematics and Statistics (R0) (SpringerNature-43713) | ||
| 950 | |a Focus Bundle Mathematics and Statistics (SpringerNature-85421) | ||