Data Intensive Query Processing for Large RDF Graphs Using Cloud Computing Tools
Autor: | Murat Kantarcioglu, Latifur Khan, Bhavani Thuraisingham, Mohammad Farhan Husain |
---|---|
Rok vydání: | 2010 |
Předmět: |
Information retrieval
Distributed database Database Computer science RDF Schema InformationSystems_DATABASEMANAGEMENT computer.file_format Linked data Ontology (information science) computer.software_genre Query language RDF/XML Data modeling Query plan Simple Knowledge Organization System SPARQL World Wide Web Consortium RDF Cwm computer Semantic Web RDF query language computer.programming_language |
Zdroj: | IEEE CLOUD |
Popis: | Cloud computing is the newest paradigm in the IT world and hence the focus of new research. Companies hosting cloud computing services face the challenge of handling data intensive applications. Semantic web technologies can be an ideal candidate to be used together with cloud computing tools to provide a solution. These technologies have been standardized by the World Wide Web Consortium (W3C). One such standard is the Resource Description Framework (RDF). With the explosion of semantic web technologies, large RDF graphs are common place. Current frameworks do not scale for large RDF graphs. In this paper, we describe a framework that we built using Hadoop, a popular open source framework for Cloud Computing, to store and retrieve large numbers of RDF triples. We describe a scheme to store RDF data in Hadoop Distributed File System. We present an algorithm to generate the best possible query plan to answer a SPARQL Protocol and RDF Query Language (SPARQL) query based on a cost model. We use Hadoop's MapReduce framework to answer the queries. Our results show that we can store large RDF graphs in Hadoop clusters built with cheap commodity class hardware. Furthermore, we show that our framework is scalable and efficient and can easily handle billions of RDF triples, unlike traditional approaches. |
Databáze: | OpenAIRE |
Externí odkaz: |