AI & ML
Data-Driven Continuous-Time LQR: Linking Reinforcement Learning and Behavioral System Theory
arXiv eess.SY0 views
arXiv:2604.27922v2 Announce Type: replace-cross Abstract: Behavioral system theory and reinforcement learning (RL) have independently developed data-driven approaches to the continuous-time LQR problem, yet their respective methods have largely evolved in separation. We connect these two adjacent lines of work by studying their data-driven parameterizations, namely a closed-loop (CL) parameterization from behavioral system theory and an integral RL (IRL) parameterization. The CL parameterization characterizes the closed-loop system via a matrix that satisfies equality constraints. While this parameterization has been extensively studied for discrete-time systems, we adapt key results to the continuous-time setting and develop a policy iteration (PI) scheme, derive an algebraic Riccati equation, and introduce an alternative convex program. The IRL parameterization utilizes off-policy data to perform policy evaluation, which is used for PI or value iteration. Within the IRL framework, we derive a policy gradient flow and propose convex programs for the LQR problem. Finally, we provide a unified treatment of these parameterizations that enables a systematic understanding of existing approaches, and clarifies their structural relationships.
Source:https://arxiv.org/abs/2604.27922PreviousXIT: Exploration and Exploitation Informed Trees for Active Gas Distribution Mapping in Unknown EnvironmentsNextA Measure-Theoretic Formulation of Behavioral Systems
Related posts
Scientists May Have Discovered a Massive Starless Galaxy
0Wired
Why my dataclass test failed when the values matched
0dev.to
A pre-launch mobile app testing checklist for small teams
0dev.to
How to Check a PDF’s Metadata: Acrobat, Windows, macOS and the Command Line
0dev.to
![AMR AI and Embodied Intelligence — Ch.20: Multi Agent Robotics [KR]](https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Fzd2oflt3xqsm741q8o02.png)
AMR AI and Embodied Intelligence — Ch.20: Multi Agent Robotics [KR]
0dev.to
![AMR AI and Embodied Intelligence — Ch.21: AI Safety for Robotics [KR]](https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2F9sq8mphrqy5pbxzp0qga.png)
AMR AI and Embodied Intelligence — Ch.21: AI Safety for Robotics [KR]
0dev.to