Simple but Effective Porn Query Recognition by k-NN with Semantic Similarity Measure.

Autor: Fu, Shunkai, Desmarais, Michel C., Pi, Bingfeng, Zhou, Ying, Wang, Weilei, Zou, Gang, Han, Song, Rao, Xunrong
Zdroj: Advances in Data & Web Management (9783642006715); 2009, p3-14, 12p
Abstrakt: Access to sexual information has to be given some restricts on commercial search engine. Compared with filtering porn contents directly, we prefer to recognize porn queries and recommend appropriate ones considering several potential advantages. However, how to recognize them in an automatic way is not a trivial job due that its short length, in most scenarios, doesn΄t allow enough information for machine to make correct decision. In this paper, a simple but effective solution is proposed to recognize porn queries as exist in very large query log. Instead of checking purely if there are sensitive words contained in the queries, which may work for some cases but has obvious limitations, we go a little further by collecting and studying the semantic content of queries. Our experiments with real data demonstrate that small cost in training a k-Nearest Neighbor classifier (k-NN) will bring us quite impressive classification performance, especially the recall. [ABSTRACT FROM AUTHOR]
Databáze: Complementary Index