Q-Learning Based Cognitive Domain Ontology Representation and Solving on Low Power Computing Platforms

Autor: Nayim Rahman, Tanvir Atahary, Chris Yakopcic, Tarek M. Taha, Scott Douglass
Jazyk: angličtina
Rok vydání: 2024
Předmět:
Zdroj: IEEE Access, Vol 12, Pp 131-147 (2024)
Druh dokumentu: article
ISSN: 2169-3536
DOI: 10.1109/ACCESS.2023.3346908
Popis: Cognitive agents make systems autonomous through the process of decision automation by mining an existing knowledge repository at run time. These processes can often be highly compute intensive, and would thus run slowly on the low-power computing platforms typically seen in autonomous systems. This paper examines how knowledge be represented in a Q-table and proposes a novel fast algorithm to mine that knowledge based on constraints. We evaluate this approach for the knowledge mining process of a specific agent: Cognitively Enhanced Complex Event Processing (CECEP). Within CECEP, knowledge is represented using Cognitive Domain Ontologies (CDO), and is mined using situational inputs and constraints. This is a novel approach to store information and is able to accommodate CDOs with millions of solutions. To show that the approach can run on low power hardware in real-time, this algorithm was executed on two low-power minicomputing platforms - Intel’s NUC and Asus’s Tinker Board. At present, no other optimized CDO solvers can generate solutions on these platforms. The algorithm generated the same amount of solutions as a GPU-enabled optimized path-based forward checking CDO solver, while consuming around 7.7 and 5.15 times less energy (Joules) on the NUC and Tinker Board respectively.
Databáze: Directory of Open Access Journals