AI & ML
Learned Controllers for Agile Quadrotors in Pursuit-Evasion Games
arXiv cs.RO0 views
arXiv:2506.02849v4 Announce Type: replace Abstract: We study one-versus-one (1v1) quadrotor pursuit-evasion, where a pursuer and an evader are trained with reinforcement learning (RL). Direct adversarial RL tends to be unstable because opponent policies change during training, causing non-stationarity, forgetting, and strategy cycling. We propose Asynchronous Multi-Stage Population-Based training, inspired by Policy-Space Response Oracles (PSRO). Proximal Policy Optimization (PPO) trains responses against previously learned opponents held fixed during each stage. The uniform variant, AMSPB-U, samples opponents equally, while AMSPB-P combines hard prioritized fictitious self-play (PFSP) with uniform exploration to emphasize currently difficult opponents. In cross-evaluations against learned opponents, both variants improve pursuit-evasion balance over latest-opponent training. AMSPB-P scores highest while retaining competence against earlier strategies. Across varied starting positions and after larger-arena retraining, both population variants retain higher average success across the two roles than latest-opponent training. Hardware experiments with two 10 cm, approximately 40 g Crazyflie brushless quadrotors demonstrate zero-shot sim-to-real transfer against baseline controllers and learned adversaries across 42 flights. Recorded flights include captures of evaders reaching robust peak speeds of 3.31 m/s and accelerations of 17.95 m/s^2, with pursuer flight speeds up to 4.87 m/s.
Source:https://arxiv.org/abs/2506.02849PreviousLearning-based Autonomous Oversteer Control and Collision AvoidanceNextWiFi-based Global Localization in Large-Scale Environments Leveraging Structural Priors from osmAG
Related posts
How Sumitomo Life’s leaders helped teams adopt ChatGPT Enterprise
0OpenAI Blog
Elon Musk says: ‘I’m not MAGA’
0TechCrunch
Microsoft CEO Satya Nadella explains why he asked 60K employees to quit
0TechCrunch
Uneven light-guide glow: check tooth pitch 2.0-2.5mm vs 1.0-1.2mm before
0dev.to

How I Learn System Design Through an Open-Source Repo
0dev.to

Robot dog payloads for data center inspection: thermal, acoustic and asset reading
0dev.to