A modular system for behaviour analytics from airborne full-motion video

Autor: Huiwen You, Andrew J. Macdonald, Anne Webster, Jonathan Plante, Alexander Braun, Michael Lim, Fouad Faraj, Austin Beauchamp, Kevin Kasa, Leigh Martin-Boyd, Ken Wong, Andrew Stewart
Rok vydání: 2021
Předmět:
Zdroj: Artificial Intelligence and Machine Learning for Multi-Domain Operations Applications III.
DOI: 10.1117/12.2584816
Popis: The next generation of multi-domain airborne platforms will provide military operators with unparalleled sensor data streams spanning video, radar, and other sensor inputs. These expanded sensor capabilities will substantially increase access to critical, near-real time surveillance. However, the process of interpreting video feeds places a significant burden on intelligence operators, a demand that can be addressed by AI-based algorithms. AI-based tools complement the aerial footage processing tasks performed by full motion video analysts. In this work, we introduce a new aerial pattern of life dataset and describe our latest algorithmic developments, which uses deep learning to gain an understanding of a scene’s patterns of life. This approach allows anomalies, outliers from standard patterns of life, to be identified using supervised and unsupervised learning approaches. Herein, we describe our deep learning models and our corresponding microservices software architecture. The patterns of life and anomaly detection performance is measured through analysis of video from this new remotely piloted aerial system (RPAS) flight campaign dataset.
Databáze: OpenAIRE