RILOD: Near Real-Time Incremental Learning for Object Detection at the Edge
| Autor: | Junting Zhang, Serafettin Tasci, Dawei Li, Shalini Ghosh, Larry Heck, Jingwen Zhu |
|---|---|
| Rok vydání: | 2019 |
| Předmět: |
FOS: Computer and information sciences
050101 languages & linguistics Computer Science - Artificial Intelligence Computer science Computer Vision and Pattern Recognition (cs.CV) Feature extraction Computer Science - Computer Vision and Pattern Recognition Machine Learning (stat.ML) 02 engineering and technology Machine learning computer.software_genre Statistics - Machine Learning Minimum bounding box Component (UML) 0202 electrical engineering electronic engineering information engineering 0501 psychology and cognitive sciences Edge computing business.industry 05 social sciences Object (computer science) Pipeline (software) Object detection Artificial Intelligence (cs.AI) Feature (computer vision) 020201 artificial intelligence & image processing Artificial intelligence business computer |
| Zdroj: | SEC |
| DOI: | 10.48550/arxiv.1904.00781 |
| Popis: | Object detection models shipped with camera-equipped edge devices cannot cover the objects of interest for every user. Therefore, the incremental learning capability is a critical feature for a robust and personalized object detection system that many applications would rely on. In this paper, we present an efficient yet practical system, RILOD, to incrementally train an existing object detection model such that it can detect new object classes without losing its capability to detect old classes. The key component of RILOD is a novel incremental learning algorithm that trains end-to-end for one-stage deep object detection models only using training data of new object classes. Specifically to avoid catastrophic forgetting, the algorithm distills three types of knowledge from the old model to mimic the old model's behavior on object classification, bounding box regression and feature extraction. In addition, since the training data for the new classes may not be available, a real-time dataset construction pipeline is designed to collect training images on-the-fly and automatically label the images with both category and bounding box annotations. We have implemented RILOD under both edge-cloud and edge-only setups. Experiment results show that the proposed system can learn to detect a new object class in just a few minutes, including both dataset construction and model training. In comparison, traditional fine-tuning based method may take a few hours for training, and in most cases would also need a tedious and costly manual dataset labeling step. Comment: Camera-ready for ACM/IEEE SEC 2019 |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|