Detecting Asks in Social Engineering Attacks: Impact of Linguistic and Structural Knowledge

Autor: Brodie Mather, Bryanna Hebenstreit, Tomek Strzalkowski, Bonnie J. Dorr, Archna Bhatia, Alan Zemel, Samira Shaikh, Zhuo Cheng, Adam Dalton, Sashank Santhanam

Publikováno v: AAAI

Social engineers attempt to manipulate users into undertaking actions such as downloading malware by clicking links or providing access to money or sensitive information. Natural language processing, computational sociolinguistics, and media-specific

Externí odkaz: https://explore.openaire.eu/search/publication?articleId=doi_________::8442098099899b3d372b1bde06122490
https://doi.org/10.1609/aaai.v34i05.6269

The GEM Benchmark: Natural Language Generation, its Evaluation and Metrics

Autor: Thibault Sellam, Vikas Raunak, Cristina Garbacea, Simon Mille, Tatsunori Hashimoto, Miruna-Adriana Clinciu, Ankur P. Parikh, Angelina McMillan-Major, Samira Shaikh, Kaustubh Dhole, Pawan Sasanka Ammanamanchi, Anuoluwapo Aremu, Laura Perez-Beltrachini, Marco Antonio Sobrevilla Cabezudo, Juan Diego Rodriguez, Sashank Santhanam, Bodhisattwa Prasad Majumder, Dhruv Kumar, Esin Durmus, Dipanjan Das, Wei Xu, Wanyu Du, Vitaly Nikolaev, Faisal Ladhak, Moin Nadeem, Chris Chinenye Emezue, Varun Gangal, Diyi Yang, Yangfeng Ji, João Sedoc, Aman Madaan, Shailza Jolly, Saad Mahamood, Karmanya Aggarwal, Emiel van Miltenburg, Antoine Bosselut, Salomey Osei, Jiawei Zhou, Yufang Hou, Harsh Jhamtani, Niranjan Ramesh Rao, Anastasia Shimorina, Shashi Narayan, Akhila Yerukola, Nishant Subramani, Sebastian Gehrmann, Hendrik Strobelt, Khyathi Raghavi Chandu, Yacine Jernite, Tosin P. Adewumi, Mihir Kale, Khyati Mahajan, Andre Niyongabo Rubungo, Pedro Henrique Martins, Ondřej Dušek, Mounica Maddela

Publikováno v: Proceedings of the 1st Workshop on Natural Language Generation, Evaluation, and Metrics (GEM 2021)
Proceedings of the 1st Workshop on Natural Language Generation, Evaluation, and Metrics (GEM 2021), Aug 2021, Online, France. pp.96-120, ⟨10.18653/v1/2021.gem-1.10⟩
Tilburg University-PURE
Proceedings of the 1st Workshop on Natural Language Generation, Evaluation, and Metrics (GEM 2021), 96-120
STARTPAGE=96;ENDPAGE=120;TITLE=Proceedings of the 1st Workshop on Natural Language Generation, Evaluation, and Metrics (GEM 2021)

International audience; We introduce GEM, a living benchmark for natural language Generation (NLG), its Evaluation, and Metrics. Measuring progress in NLG relies on a constantly evolving ecosystem of automated metrics, datasets, and human evaluation

Externí odkaz: https://explore.openaire.eu/search/publication?articleId=doi_dedup___::56549f809a95ad121bc57aac47f790d8
https://doi.org/10.18653/v1/2021.gem-1.10

Learning to Plan and Realize Separately for Open-Ended Dialogue Systems

Autor: Bryanna Hebenstreit, Brodie Mather, Bonnie J. Dorr, Alan Zemel, Tomek Strzalkowski, Samira Shaikh, Archna Bhatia, Adam Dalton, Sashank Santhanam, Zhuo Cheng

Publikováno v: EMNLP (Findings)

Achieving true human-like ability to conduct a conversation remains an elusive goal for open-ended dialogue systems. We posit this is because extant approaches towards natural language generation (NLG) are typically construed as end-to-end architectu

Externí odkaz: https://explore.openaire.eu/search/publication?articleId=doi_dedup___::9ac875e42e7f347081d3d545755ed5e8
http://arxiv.org/abs/2009.12506

Understanding the Impact of Experiment Design for Evaluating Dialogue System Output

Autor: Sashank Santhanam, Samira Shaikh

Publikováno v: Proceedings of the The Fourth Widening Natural Language Processing Workshop.

Evaluation of output from natural language generation (NLG) systems is typically conducted via crowdsourced human judgments. To understand the impact of how experiment design might affect the quality and consistency of such human judgments, we design

Externí odkaz: https://explore.openaire.eu/search/publication?articleId=doi_________::72fcceb44612a90913e5d53d54f97f78
https://doi.org/10.18653/v1/2020.winlp-1.33

Can You Verifi This? Studying Uncertainty and Decision-Making About Misinformation Using Visual Analytics

Autor: Alireza Karduni, Ryan Wesslen, Sashank Santhanam, Isaac Cho, Svitlana Volkova, Dustin Arendt, Samira Shaikh, Wenwen Dou

Publikováno v: Proceedings of the International AAAI Conference on Web and Social Media. 12

We describe a novel study of decision-making processes around misinformation on social media. Using a custom-built visual analytic system, we presented users with news content from social media accounts from a variety of news outlets, including outle

Externí odkaz: https://explore.openaire.eu/search/publication?articleId=doi_________::d096af25a070ca749dd5b03c9281e4b6
https://doi.org/10.1609/icwsm.v12i1.15014