Inspection of Imprint Defects in Stamped Metal Surfaces Using Deep Learning and Tracking
Autor: | Ricardo Dutra da Silva, Leyza Baldo Dorini, Sylvio Biasuz Block, Rodrigo Minetto |
---|---|
Rok vydání: | 2021 |
Předmět: |
Computer science
business.industry Deep learning 020208 electrical & electronic engineering Detector Pattern recognition 02 engineering and technology Stamping Tracking (particle physics) Convolutional neural network Control and Systems Engineering 0202 electrical engineering electronic engineering information engineering Artificial intelligence Electrical and Electronic Engineering Precision and recall business |
Zdroj: | IEEE Transactions on Industrial Electronics. 68:4498-4507 |
ISSN: | 1557-9948 0278-0046 |
DOI: | 10.1109/tie.2020.2984453 |
Popis: | This article focuses on the automatic detection and classification of imprint defects on the surface of metal parts. This innovative research had collaboration with a multinational industry, which provided a system to capture images of vehicle parts as well as information about defects, their frequency, and quality requirements. As our main contribution, we propose a framework that combines detection, classification, and tracking in a synergistic way to assist the automotive industry. We use a state-of-the-art convolutional neural network, known as RetinaNet, to detect and classify imprint defects. We explore the temporal coherence in consecutive frames by tracking detected regions so as to reduce false alarms—unstable candidate regions that are rarely (re)detected many times—or to fix the classification of regions that are alternated classified as mild or severe imprint across frames. In our experiments, we achieve a mean average precision of $76\%$ to detect and classify mild and severe defects, outperforming state-of-the-art detectors for static images. For severe imprints only, we achieve precision and recall values of $90\%$ and $92\%$ , respectively. These are promising results that could also benefit other industrial applications such as inspection of fissures, holes, wrinkles, and scratches, that also use image sequences. |
Databáze: | OpenAIRE |
Externí odkaz: |