Accelerating Hyperparameter Tuning of a Deep Learning Model for Remote Sensing Image Classification

Autor: Marcel Aach, Rocco Sedona, Andreas Lintermann, Gabriele Cavallaro, Helmut Neukirchen, Morris Riedel
Jazyk: angličtina
Rok vydání: 2022
Zdroj: IEEE 263-266 (2022). doi:10.1109/IGARSS46834.2022.9883257
2022 IEEE International Geoscience and Remote Sensing Symposium, IGARSS 2022, Kuala Lumpur, Malaysia, 2022-07-17-2022-07-22
Popis: Deep Learning models have proven necessary in dealing with the challenges posed by the continuous growth of data volume acquired from satellites and the increasing complexity of new Remote Sensing applications. To obtain the best performance from such models, it is necessary to fine-tune their hyperparameters. Since the models might have massive amounts of parameters that need to be tuned, this process requires many computational resources. In this work, a method to accelerate hyperparameter optimization on a High-Performance Computing system is proposed. The data batch size is increased during the training, leading to a more efficient execution on Graphics Processing Units. The experimental results confirm that this method reduces the runtime of the hyperparameter optimization step by a factor of 3 while achieving the same validation accuracy as a standard training procedure with a fixed batch size.
Databáze: OpenAIRE