Fine-tuning LLMs for Autonomous Spacecraft Control: A Case Study Using Kerbal Space Program

Autor: Carrasco, Alejandro, Rodriguez-Fernandez, Victor, Linares, Richard
Rok vydání: 2024
Předmět:
Druh dokumentu: Working Paper
DOI: 10.5281/zenodo.13885579
Popis: Recent trends are emerging in the use of Large Language Models (LLMs) as autonomous agents that take actions based on the content of the user text prompt. This study explores the use of fine-tuned Large Language Models (LLMs) for autonomous spacecraft control, using the Kerbal Space Program Differential Games suite (KSPDG) as a testing environment. Traditional Reinforcement Learning (RL) approaches face limitations in this domain due to insufficient simulation capabilities and data. By leveraging LLMs, specifically fine-tuning models like GPT-3.5 and LLaMA, we demonstrate how these models can effectively control spacecraft using language-based inputs and outputs. Our approach integrates real-time mission telemetry into textual prompts processed by the LLM, which then generate control actions via an agent. The results open a discussion about the potential of LLMs for space operations beyond their nominal use for text-related tasks. Future work aims to expand this methodology to other space control tasks and evaluate the performance of different LLM families. The code is available at this URL: \texttt{https://github.com/ARCLab-MIT/kspdg}.
Comment: ESA SPAICE Conference 2024. arXiv admin note: text overlap with arXiv:2404.00413
Databáze: arXiv