PKK Library

Your cart is empty.

Welcome to P K Kelkar Library, Online Public Access Catalogue (OPAC)

Normal view MARC view ISBD view

Numerical Methods for Controlled Stochastic Delay Systems

By: Kushner, Harold J [author.].
Contributor(s): SpringerLink (Online service)0.
Material type: materialTypeLabelBookSeries: Systems & Control: Foundations & Applications0.Publisher: Boston : Birkh�user Boston, 2008. Description: XX, 282 p. 37 illus. online resource.Content type: text Media type: computer Carrier type: online resourceISBN: 9780817646219.Subject(s): Mathematics | Mathematical analysis | Analysis (Mathematics) | Dynamics | Ergodic theory | System theory | Numerical analysis | Operations research | Management science | Probabilities.1 | Mathematics.2 | Systems Theory, Control.2 | Probability Theory and Stochastic Processes.2 | Analysis.2 | Numerical Analysis.2 | Operations Research, Management Science.2 | Dynamical Systems and Ergodic Theory.2DDC classification: 519 Online resources: Click here to access online
Contents:
Examples and Introduction -- Weak Convergence and Martingales -- Stochastic Delay Equations: Models -- Approximations to the Dynamical Models -- The Ergodic Cost Problem -- Markov Chain Approximations: Introduction -- Markov Chain Approximations: Path and Control Delayed. -- Path and Control Delayed: Continued -- A Wave Equation Approach.
In: Springer eBooks0Summary: The Markov chain approximation methods are widely used for the numerical solution of nonlinear stochastic control problems in continuous time. This book extends the methods to stochastic systems with delays. Because such problems are infinite-dimensional, many new issues arise in getting good numerical approximations and in the convergence proofs. Useful forms of numerical algorithms and system approximations are developed in this work, and the convergence proofs are given. All of the usual cost functions are treated as well as singular and impulsive controls. A major concern is on representations and approximations that use minimal memory. Features and topics include: * Surveys properties of the most important stochastic dynamical models, including singular control, and those for diffusion and reflected diffusion models. * Gives approximations to the dynamical models that simplify the numerical problem, but have only small effects on the behavior. * Develops an ergodic theory for reflected diffusions with delays, as well as model simplifications useful for numerical approximations for average cost per unit time problems. * Provides numerical algorithms for models with delays in the path, or path and control, with reduced memory requirements. * Develops transformations of the problem that yield more efficient approximations when the control, driving Wiener process, and/or reflection processes might be delayed, as well as the path. * Presents examples with applications to control and modern communications systems. The book is the first on the subject and will be of interest to all those who work with stochastic delay equations and whose main interest is in either the use of the algorithms or the underlying mathematics. An excellent resource for graduate students, researchers, and practitioners, the work may be used as a graduate-level textbook for a special topics course or seminar on numerical methods in stochastic control.
    average rating: 0.0 (0 votes)
Item type Current location Call number Status Date due Barcode Item holds
PK Kelkar Library, IIT Kanpur
Available EBK10315
Total holds: 0

Examples and Introduction -- Weak Convergence and Martingales -- Stochastic Delay Equations: Models -- Approximations to the Dynamical Models -- The Ergodic Cost Problem -- Markov Chain Approximations: Introduction -- Markov Chain Approximations: Path and Control Delayed. -- Path and Control Delayed: Continued -- A Wave Equation Approach.

The Markov chain approximation methods are widely used for the numerical solution of nonlinear stochastic control problems in continuous time. This book extends the methods to stochastic systems with delays. Because such problems are infinite-dimensional, many new issues arise in getting good numerical approximations and in the convergence proofs. Useful forms of numerical algorithms and system approximations are developed in this work, and the convergence proofs are given. All of the usual cost functions are treated as well as singular and impulsive controls. A major concern is on representations and approximations that use minimal memory. Features and topics include: * Surveys properties of the most important stochastic dynamical models, including singular control, and those for diffusion and reflected diffusion models. * Gives approximations to the dynamical models that simplify the numerical problem, but have only small effects on the behavior. * Develops an ergodic theory for reflected diffusions with delays, as well as model simplifications useful for numerical approximations for average cost per unit time problems. * Provides numerical algorithms for models with delays in the path, or path and control, with reduced memory requirements. * Develops transformations of the problem that yield more efficient approximations when the control, driving Wiener process, and/or reflection processes might be delayed, as well as the path. * Presents examples with applications to control and modern communications systems. The book is the first on the subject and will be of interest to all those who work with stochastic delay equations and whose main interest is in either the use of the algorithms or the underlying mathematics. An excellent resource for graduate students, researchers, and practitioners, the work may be used as a graduate-level textbook for a special topics course or seminar on numerical methods in stochastic control.

There are no comments for this item.

Log in to your account to post a comment.

Powered by Koha