Visualization and clustering by 3D cellular automata: Application to unstructured data

Autor: Hamou, Reda Mohamed, Amine, Abdelmalek, Lokbani, Ahmed Chaouki, Simonet, Michel
Rok vydání: 2012
Předmět:
Zdroj: International Journal Of Data Mining And Emerging Technologies. 2-1 (2012) 15-25
Druh dokumentu: Working Paper
DOI: 10.5958/j.2249-3212.2.1.003
Popis: Given the limited performance of 2D cellular automata in terms of space when the number of documents increases and in terms of visualization clusters, our motivation was to experiment these cellular automata by increasing the size to view the impact of size on quality of results. The representation of textual data was carried out by a vector model whose components are derived from the overall balancing of the used corpus, Term Frequency Inverse Document Frequency (TF-IDF). The WorldNet thesaurus has been used to address the problem of the lemmatization of the words because the representation used in this study is that of the bags of words. Another independent method of the language was used to represent textual records is that of the n-grams. Several measures of similarity have been tested. To validate the classification we have used two measures of assessment based on the recall and precision (f-measure and entropy). The results are promising and confirm the idea to increase the dimension to the problem of the spatiality of the classes. The results obtained in terms of purity class (i.e. the minimum value of entropy) shows that the number of documents over longer believes the results are better for 3D cellular automata, which was not obvious to the 2D dimension. In terms of spatial navigation, cellular automata provide very good 3D performance visualization than 2D cellular automata.
Comment: 10 pages, 8 figures
Databáze: arXiv