Towards Machine Learning in Distributed Array DBMS: Networking Considerations

Autor:	Ramon Antonio Rodriges Zalipynis
Rok vydání:	2021
Předmět:	Computer simulation Computer science business.industry Big data Cloud computing Base (topology) Machine learning computer.software_genre Matrix multiplication Array DBMS Virtual machine Management system Artificial intelligence business computer
Zdroj:	Machine Learning for Networking ISBN: 9783030708658 MLN
DOI:	10.1007/978-3-030-70866-5_19
Popis:	Computer networks are veins of modern distributed systems. Array DBMS (Data Base Management Systems) operate on big data which is naturally modeled as arrays, e.g. Earth remote sensing data and numerical simulation. Big data makes array DBMS to be distributed and highly utilize computer networks. The R&D area of array DBMS is relatively young and machine learning is just paving its way to array DBMS. Hence, existing work is this area is rather sparse and is just emerging. This paper considers distributed, large matrix multiplication (LMM) executed directly inside array DBMS. LMM is the core operation for many machine learning techniques on big data. LMM directly inside array DBMS is not well studied and optimized. We present novel LMM approaches for array DBMS and analyze the intricacies of LMM in array DBMS including execution plan construction and network utilization. We carry out performance evaluation in Microsoft Azure Cloud on a network cluster of virtual machines, report insights derived from the experiments, and present our vision for the future machine learning R&D directions based on LMM directly inside array DBMS.
Databáze:	OpenAIRE
Externí odkaz:	https://explore.openaire.eu/search/publication?articleId=doi_________::529d088719eab95ed47f052fb13cd04b https://doi.org/10.1007/978-3-030-70866-5_19 Zobrazit plný text záznamu