AUTHOR=Kazanzides Peter , Vagvolgyi Balazs P. , Pryor Will , Deguet Anton , Leonard Simon , Whitcomb Louis L. TITLE=Teleoperation and Visualization Interfaces for Remote Intervention in Space JOURNAL=Frontiers in Robotics and AI VOLUME=8 YEAR=2021 URL=https://www.frontiersin.org/journals/robotics-and-ai/articles/10.3389/frobt.2021.747917 DOI=10.3389/frobt.2021.747917 ISSN=2296-9144 ABSTRACT=
Approaches to robotic manufacturing, assembly, and servicing of in-space assets range from autonomous operation to direct teleoperation, with many forms of semi-autonomous teleoperation in between. Because most approaches require one or more human operators at some level, it is important to explore the control and visualization interfaces available to those operators, taking into account the challenges due to significant telemetry time delay. We consider one motivating application of remote teleoperation, which is ground-based control of a robot on-orbit for satellite servicing. This paper presents a model-based architecture that: 1) improves visualization and situation awareness, 2) enables more effective human/robot interaction and control, and 3) detects task failures based on anomalous sensor feedback. We illustrate elements of the architecture by drawing on 10 years of our research in this area. The paper further reports the results of several multi-user experiments to evaluate the model-based architecture, on ground-based test platforms, for satellite servicing tasks subject to round-trip communication latencies of several seconds. The most significant performance gains were obtained by enhancing the operators’ situation awareness