Training a Hyperdimensional Computing Classifier Using a Threshold on Its Confidence.

Autor: Smets L; Department of Computer Science, IDLab (University of Antwerp -- imec), 2000 Antwerp, Belgium Laura.Smets@uantwerpen.be., Van Leekwijck W; Department of Computer Science, IDLab (University of Antwerp -- imec), 2000 Antwerp, Belgium Werner.Vanleekwijck@uantwerpen.be., Tsang IJ; Department of Computer Science, IDLab (University of Antwerp -- imec), 2000 Antwerp, Belgium Inton.Tsang@imec.be., Latré S; Department of Computer Science, IDLab (University of Antwerp -- imec), 2000 Antwerp, Belgium Steven.Latre@imec.be.
Jazyk: angličtina
Zdroj: Neural computation [Neural Comput] 2023 Nov 07; Vol. 35 (12), pp. 2006-2023.
DOI: 10.1162/neco_a_01618
Abstrakt: Hyperdimensional computing (HDC) has become popular for light-weight and energy-efficient machine learning, suitable for wearable Internet-of-Things devices and near-sensor or on-device processing. HDC is computationally less complex than traditional deep learning algorithms and achieves moderate to good classification performance. This letter proposes to extend the training procedure in HDC by taking into account not only wrongly classified samples but also samples that are correctly classified by the HDC model but with low confidence. We introduce a confidence threshold that can be tuned for each data set to achieve the best classification accuracy. The proposed training procedure is tested on UCIHAR, CTG, ISOLET, and HAND data sets for which the performance consistently improves compared to the baseline across a range of confidence threshold values. The extended training procedure also results in a shift toward higher confidence values of the correctly classified samples, making the classifier not only more accurate but also more confident about its predictions.
(© 2023 Massachusetts Institute of Technology.)
Databáze: MEDLINE