Optimization and Games for Controllable Markov Chains Numerical Methods with Application to Finance and Engineering /

This book considers a class of ergodic finite controllable Markov's chains. The main idea behind the method, described in this book, is to develop the original discrete optimization problems (or game models) in the space of randomized formulations, where the variables stand in for the distribut...

Volledige beschrijving

Bewaard in:
Bibliografische gegevens
Hoofdauteurs: Clempner, Julio B. (Auteur), Poznyak, Alexander (Auteur)
Coauteur: SpringerLink (Online service)
Formaat: Elektronisch E-boek
Taal:Engels
Gepubliceerd in: Cham : Springer Nature Switzerland : Imprint: Springer, 2024.
Editie:1st ed. 2024.
Reeks:Studies in Systems, Decision and Control, 504
Onderwerpen:
Online toegang:https://doi.org/10.1007/978-3-031-43575-1
Tags: Voeg label toe
Geen labels, Wees de eerste die dit record labelt!

MARC

LEADER 00000nam a22000005i 4500
001 978-3-031-43575-1
003 DE-He213
005 20260810114717.0
007 cr nn 008mamaa
008 231213s2024 sz | o |||| 0|eng d
020 |a 9783031435751  |9 978-3-031-43575-1 
024 7 |a 10.1007/978-3-031-43575-1  |2 doi 
050 4 |a TA329-348 
050 4 |a TA345-345.5 
072 7 |a TBJ  |2 bicssc 
072 7 |a TEC009000  |2 bisacsh 
072 7 |a TBJ  |2 thema 
082 0 4 |a 620  |2 23 
100 1 |a Clempner, Julio B.  |e author.  |0 (orcid)0000-0002-5918-4671  |1 https://orcid.org/0000-0002-5918-4671  |4 aut  |4 http://id.loc.gov/vocabulary/relators/aut 
245 1 0 |a Optimization and Games for Controllable Markov Chains  |h [electronic resource] :  |b Numerical Methods with Application to Finance and Engineering /  |c by Julio B. Clempner, Alexander Poznyak. 
250 |a 1st ed. 2024. 
264 1 |a Cham :  |b Springer Nature Switzerland :  |b Imprint: Springer,  |c 2024. 
300 |a 1 online resource (XVIII, 332 p. 99 illus.).  |b 94 illus. in color. 
336 |a text  |b txt  |2 rdacontent 
337 |a computer  |b c  |2 rdamedia 
338 |a online resource  |b cr  |2 rdacarrier 
341 0 |b Table of contents navigation  |2 onix 
341 0 |b Single logical reading order  |2 onix 
341 0 |b Short alternative textual descriptions  |2 onix 
341 0 |b Use of color is not sole means of conveying information  |2 onix 
341 0 |b Use of high contrast between text and background color  |2 onix 
341 0 |b Next / Previous structural navigation  |2 onix 
341 0 |b All non-decorative content supports reading without sight  |2 onix 
347 |a text file  |b PDF  |2 rda 
490 1 |a Studies in Systems, Decision and Control,  |x 2198-4190 ;  |v 504 
505 0 |a Controllable Markov Chains -- Multiobjective Control -- Partially Observable Markov Chains -- Continuous-Time Markov Chains -- Nash and Stackelberg Equilibrium -- Best-Reply Strategies in Repeated Games -- Mechanism design -- Joint Observer and Mechanism Design -- Bargaining Games or How to Negotiate -- Multi-Traffic Signal-Control Synchronization -- Non-cooperative bargaining with unsophisticated agents -- Transfer Pricing as Bargaining -- Index. 
520 |a This book considers a class of ergodic finite controllable Markov's chains. The main idea behind the method, described in this book, is to develop the original discrete optimization problems (or game models) in the space of randomized formulations, where the variables stand in for the distributions (mixed strategies or preferences) of the original discrete (pure) strategies in the use. The following suppositions are made: a finite state space, a limited action space, continuity of the probabilities and rewards associated with the actions, and a necessity for accessibility. These hypotheses lead to the existence of an optimal policy. The best course of action is always stationary. It is either simple (i.e., nonrandomized stationary) or composed of two nonrandomized policies, which is equivalent to randomly selecting one of two simple policies throughout each epoch by tossing a biased coin. As a bonus, the optimization procedure just has to repeatedly solve the time-average dynamic programming equation, making it theoretically feasible to choose the optimum course of action under the global restriction. In the ergodic cases the state distributions, generated by the corresponding transition equations, exponentially quickly converge to their stationary (final) values. This makes it possible to employ all widely used optimization methods (such as Gradient-like procedures, Extra-proximal method, Lagrange's multipliers, Tikhonov's regularization), including the related numerical techniques. In the book we tackle different problems and theoretical Markov models like controllable and ergodic Markov chains, multi-objective Pareto front solutions, partially observable Markov chains, continuous-time Markov chains, Nash equilibrium and Stackelberg equilibrium, Lyapunov-like function in Markov chains, Best-reply strategy, Bayesian incentive-compatible mechanisms, Bayesian Partially Observable Markov Games, bargaining solutions for Nash and Kalai-Smorodinsky formulations, multi-traffic signal-control synchronization problem, Rubinstein's non-cooperative bargaining solutions, the transfer pricing problem as bargaining. 
532 8 |a Accessibility summary: This PDF does not fully comply with PDF/UA standards, but does feature limited screen reader support, described non-text content (images, graphs), bookmarks for easy navigation and searchable, selectable text. Users of assistive technologies may experience difficulty navigating or interpreting content in this document. We recognize the importance of accessibility, and we welcome queries about accessibility for any of our products. If you have a question or an access need, please get in touch with us at accessibilitysupport@springernature.com. 
532 8 |a No reading system accessibility options actively disabled 
532 8 |a Publisher contact for further accessibility information: accessibilitysupport@springernature.com 
588 |a Print version record. 
650 0 |a Engineering mathematics. 
650 0 |a Engineering  |x Data processing. 
650 0 |a Dynamics. 
650 0 |a Nonlinear theories. 
650 1 4 |a Mathematical and Computational Engineering Applications. 
650 2 4 |a Applied Dynamical Systems. 
650 2 4 |a Engineering Mathematics. 
700 1 |a Poznyak, Alexander.  |e author.  |4 aut  |4 http://id.loc.gov/vocabulary/relators/aut 
710 2 |a SpringerLink (Online service) 
773 0 |t Springer Nature eBook 
776 0 8 |i Printed edition:  |z 9783031435744 
776 0 8 |i Printed edition:  |z 9783031435768 
776 0 8 |i Printed edition:  |z 9783031435775 
830 0 |a Studies in Systems, Decision and Control,  |x 2198-4190 ;  |v 504 
856 4 0 |u https://doi.org/10.1007/978-3-031-43575-1 
912 |a ZDB-2-ENG 
912 |a ZDB-2-SXE 
950 |a Engineering (SpringerNature-11647) 
950 |a Engineering (R0) (SpringerNature-43712)