by B. Sukhija, M. Turchetta, D. Lindner, A. Krause, S. Trimpe, D. Baumann
Abstract:
Learning optimal control policies directly on physical systems is challenging. Even a single failure can lead to costly hardware damage. Most existing model-free learning methods that guarantee safety, i.e., no failures, during exploration are limited to local optima. This work proposes GoSafeOpt as the first provably safe and optimal algorithm that can safely discover globally optimal policies for systems with high-dimensional state space. We demonstrate the superiority of GoSafeOpt over competing model-free safe learning methods in simulation and hardware experiments on a robot arm.
Reference:
GoSafeOpt: Scalable safe exploration for global optimization of dynamical systems B. Sukhija, M. Turchetta, D. Lindner, A. Krause, S. Trimpe, D. BaumannIn Artificial Intelligence Journal (AIJ), 2023
Bibtex Entry:
@inproceedings{sukhija2022scalable,
author = {Bhavya Sukhija and Matteo Turchetta and David Lindner and Andreas Krause and Sebastian Trimpe and Dominik Baumann},
booktitle = {Artificial Intelligence Journal (AIJ)},
month = {July},
title = {GoSafeOpt: Scalable safe exploration for global optimization of dynamical systems},
year = {2023}}