Skip to main content

Lund University Publications

LUND UNIVERSITY LIBRARIES

Adaptive dual control

Wittenmark, Björn LU (2002)
Abstract
The paper discusses the solution to the optimal adaptive control problem over an extended time horizon. This leads to a controller that have dual features, i.e., tt uses control actions as well as probing actions. The solution of the optimal dual control problem is intractable from a computational point of view. Approximations to obtain simpler suboptimal dual controllers are thus important. There are many different approaches how to obtain suboptimal dual controllers. Many of the approximations use a cautious controller as a starting point and introduce different active probing features. This can be done by including a term in the loss function that reflects the quality of the estimates of the parameters of the process. To introduce a... (More)
The paper discusses the solution to the optimal adaptive control problem over an extended time horizon. This leads to a controller that have dual features, i.e., tt uses control actions as well as probing actions. The solution of the optimal dual control problem is intractable from a computational point of view. Approximations to obtain simpler suboptimal dual controllers are thus important. There are many different approaches how to obtain suboptimal dual controllers. Many of the approximations use a cautious controller as a starting point and introduce different active probing features. This can be done by including a term in the loss function that reflects the quality of the estimates of the parameters of the process. To introduce a dual feature this term must be a function of the control signal that is going to be determined and it should also contain information about the quality of the parameter estimates. The suboptimal dual controllers should also be such that they easily can be used for higher-order systems. (Less)
Please use this url to cite or link to this publication:
author
organization
publishing date
type
Chapter in Book/Report/Conference proceeding
publication status
published
subject
keywords
Bellman equation, hyperstate, cautious controller, turn-off phenomena, dynamic programming, stochastic control, Dual control, adaptive control, separation principle, certainty equivalence principle
host publication
Control Systems, Robotics and Automation, Encyclopedia of Life Support Systems (EOLSS), Developed under the auspices of the UNESCO
editor
Unbehauen, Heinz
publisher
Eolss Publishing CO. Ltd.
language
English
LU publication?
yes
id
84240366-f38f-4a2d-b458-5550e59d8b3c (old id 537560)
alternative location
http://www.eolss.net
date added to LUP
2016-04-04 11:31:10
date last changed
2018-11-21 21:05:22
@inbook{84240366-f38f-4a2d-b458-5550e59d8b3c,
  abstract     = {{The paper discusses the solution to the optimal adaptive control problem over an extended time horizon. This leads to a controller that have dual features, i.e., tt uses control actions as well as probing actions. The solution of the optimal dual control problem is intractable from a computational point of view. Approximations to obtain simpler suboptimal dual controllers are thus important. There are many different approaches how to obtain suboptimal dual controllers. Many of the approximations use a cautious controller as a starting point and introduce different active probing features. This can be done by including a term in the loss function that reflects the quality of the estimates of the parameters of the process. To introduce a dual feature this term must be a function of the control signal that is going to be determined and it should also contain information about the quality of the parameter estimates. The suboptimal dual controllers should also be such that they easily can be used for higher-order systems.}},
  author       = {{Wittenmark, Björn}},
  booktitle    = {{Control Systems, Robotics and Automation, Encyclopedia of Life Support Systems (EOLSS), Developed under the auspices of the UNESCO}},
  editor       = {{Unbehauen, Heinz}},
  keywords     = {{Bellman equation; hyperstate; cautious controller; turn-off phenomena; dynamic programming; stochastic control; Dual control; adaptive control; separation principle; certainty equivalence principle}},
  language     = {{eng}},
  publisher    = {{Eolss Publishing CO. Ltd.}},
  title        = {{Adaptive dual control}},
  url          = {{http://www.eolss.net}},
  year         = {{2002}},
}