Towards Ethical Content-Based Detection of Online Influence Campaigns
| Autor: | Crothers, Evan, Japkowicz, Nathalie, Viktor, Herna |
|---|---|
| Rok vydání: | 2019 |
| Předmět: | |
| Zdroj: | 2019 IEEE 29th International Workshop on Machine Learning for Signal Processing (MLSP), Pittsburgh, PA, USA, 2019, pp. 1-6 |
| Druh dokumentu: | Working Paper |
| DOI: | 10.1109/MLSP.2019.8918842 |
| Popis: | The detection of clandestine efforts to influence users in online communities is a challenging problem with significant active development. We demonstrate that features derived from the text of user comments are useful for identifying suspect activity, but lead to increased erroneous identifications when keywords over-represented in past influence campaigns are present. Drawing on research in native language identification (NLI), we use "named entity masking" (NEM) to create sentence features robust to this shortcoming, while maintaining comparable classification accuracy. We demonstrate that while NEM consistently reduces false positives when key named entities are mentioned, both masked and unmasked models exhibit increased false positive rates on English sentences by Russian native speakers, raising ethical considerations that should be addressed in future research. Comment: To appear in "Special Session on Machine learning for Knowledge Discovery in the Social Sciences" at IEEE Machine Learning for Signal Processing Workshop (MLSP) 2019 |
| Databáze: | arXiv |
| Externí odkaz: |
|