Design and implementation of a convolutional neural network on an edge computing smartphone for human activity recognition

Autor: Tahmina Zebin, Krikor B. Ozanyan, Niels Peek, Patricia Scully, Alexander J. Casson
Jazyk: angličtina
Rok vydání: 2019
Předmět:
General Computer Science
Computer science
Wearable computer
02 engineering and technology
tensorflow lite
01 natural sciences
Convolutional neural network
Activity recognition
edge computing
Robustness (computer science)
convolutional neural networks
0202 electrical engineering
electronic engineering
information engineering

General Materials Science
activity recognition
Edge computing
activity recongintion
business.industry
Deep learning
Quantization (signal processing)
010401 analytical chemistry
General Engineering
deep learning
0104 chemical sciences
Computer engineering
TensorFlow Lite
Convolutional neural networks
020201 artificial intelligence & image processing
lcsh:Electrical engineering. Electronics. Nuclear engineering
Artificial intelligence
business
lcsh:TK1-9971
Feature learning
Zdroj: Zebin, T, Scully, P J, Peek, N, Casson, A & Ozanyan, K 2020, ' Design and implementation of a convolutional neural network on an edge computing smartphone for human activity recognition ', IEEE Access, vol. 7 . https://doi.org/10.1109/ACCESS.2019.2941836
IEEE Access, Vol 7, Pp 133509-133520 (2019)
Popis: Edge computing aims to integrate computing into everyday settings, enabling the system to be context-aware and private to the user. With the increasing success and popularity of deep learning methods, there is an increased demand to leverage these techniques in mobile and wearable computing scenarios. In this paper, we present an assessment of a deep human activity recognition system's memory and execution time requirements, when implemented on a mid-range smartphone class hardware and the memory implications for embedded hardware. This paper presents the design of a convolutional neural network (CNN) in the context of human activity recognition scenario. Here, layers of CNN automate the feature learning and the influence of various hyper-parameters such as the number of filters and filter size on the performance of CNN. The proposed CNN showed increased robustness with better capability of detecting activities with temporal dependence compared to models using statistical machine learning techniques. The model obtained an accuracy of 96.4% in a five-class static and dynamic activity recognition scenario. We calculated the proposed model memory consumption and execution time requirements needed for using it on a mid-range smartphone. Per-channel quantization of weights and per-layer quantization of activation to 8-bits of precision post-training produces classification accuracy within 2% of floating-point networks for dense, convolutional neural network architecture. Almost all the size and execution time reduction in the optimized model was achieved due to weight quantization. We achieved more than four times reduction in model size when optimized to 8-bit, which ensured a feasible model capable of fast on-device inference.
Databáze: OpenAIRE