Open Source
Dynamic Strategy Selection
arXiv stat.ML0 views
arXiv:2307.04754v4 Announce Type: replace-cross Abstract: We consider the problem of dynamically selecting among competing strategies using observable predictors. To mitigate estimation noise and excessive switching, we regularise the estimated policy with a switching cost, which may exceed actual transaction costs when these are too small to provide sufficient regularisation. Since switching costs make current choices affect future decisions, we formulate the problem using dynamic programming. The optimal policy is estimated using a reinforcement learning algorithm based on iterated regressions, making the procedure simple to implement. We apply the method to monthly rotation among momentum, value, profitability, and defensive U.S. equity factors over a sample of about 60 years. Using a parsimonious set of state variables, the estimated policy outperforms both the myopic dynamic policy and the best fixed factor in hindsight in out-of-sample evaluation. Under weak conditions, we show theoretically that the decision rule estimated from empirical data is asymptotically consistent for the unknown optimal decision rule. Simulation results illustrate the finite-sample relevance of these asymptotic results.
Source:https://arxiv.org/abs/2307.04754PreviousLearning to Incentivize Perfect-Knowledge Agents with Unobserved RewardsNextWhen the Agent Learns Too: Learning to Incentivize with Unobserved Rewards
Related posts
On solid angles and simplex shape measures
0arXiv cs.NA
Improving the performance of regularized Stokeslet simulations using Rosenbrock time integration methods
0arXiv cs.NA
DUP: Detection-guided Unlearning for Backdoor Purification in Language Models
0arXiv cs.CR
Catastrophic Overfitting is Weight Drift the Training Loss Cannot See
0arXiv cs.CR
Interactive World Simulation with Cosmos for Physical AI
0arXiv cs.RO
cuRoboV2-Fast: Fast Torque-Limited Collision-Free Motion Planning
0arXiv cs.RO