Zobrazeno 1 - 10
of 59
pro vyhledávání: '"Mark D. Smucker"'
Publikováno v:
ACM Transactions on Information Systems. 39:1-21
Assessors make preference judgments faster and more consistently than graded judgments. Preference judgments can also recognize distinctions between items that appear equivalent under graded judgments. Unfortunately, preference judgments can require
Externí odkaz:
https://explore.openaire.eu/search/publication?articleId=doi_________::95fed476df03e6e384d5133c6f5e1ca1
https://doi.org/10.1145/3451161
https://doi.org/10.1145/3451161
Publikováno v:
Proceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval.
Externí odkaz:
https://explore.openaire.eu/search/publication?articleId=doi_________::3fb2f10677992bd785f50eb5343f6e6c
https://doi.org/10.1145/3477495.3531812
https://doi.org/10.1145/3477495.3531812
Publikováno v:
Information Retrieval Journal. 23:1-26
This study uses a novel simulation framework to evaluate whether the time and effort necessary to achieve high recall using active learning is reduced by presenting the reviewer with isolated sentences, as opposed to full documents, for relevance fee
Externí odkaz:
https://explore.openaire.eu/search/publication?articleId=doi_dedup___::ce48cfcafeea38b53f5a23022aff9cd5
https://doi.org/10.1007/s10791-019-09361-0
https://doi.org/10.1007/s10791-019-09361-0
Publikováno v:
SIGIR
The offline evaluation of search requires us to define a standard against which we measure the quality of results returned by a ranker. Frequently this standard is defined in absolute terms through relevance grades, but it can also be defined in rela
Externí odkaz:
https://explore.openaire.eu/search/publication?articleId=doi_________::d0e1c358556591a6bcba1fea99024260
https://doi.org/10.1145/3404835.3462947
https://doi.org/10.1145/3404835.3462947
Publikováno v:
CHIIR
Information retrieval researchers often use eye-tracking to gain insights into searchers' decision making processes. In this paper, we present a visualizing method for summarizing the gaze patterns of multiple searchers on search engine result pages
Externí odkaz:
https://explore.openaire.eu/search/publication?articleId=doi_________::70b1ee297364cc0590bdc7f39f61d212
https://doi.org/10.1145/3406522.3446041
https://doi.org/10.1145/3406522.3446041
Publikováno v:
CIKM
NDCG and similar measures remain standard for the offline evaluation of search, recommendation, question answering and similar systems. These measures require definitions for two or more relevance levels, which human assessors then apply to judge ind
Externí odkaz:
https://explore.openaire.eu/search/publication?articleId=doi_________::99dffcec3e760151985b72dc55b1430e
https://doi.org/10.1145/3340531.3411915
https://doi.org/10.1145/3340531.3411915
Publikováno v:
CHIIR
The majority of US Internet users have searched the internet for health-related information. When people conduct these health searches, searching for information about medical treatments is among the more common reasons. While being a convenient and
Externí odkaz:
https://explore.openaire.eu/search/publication?articleId=doi_________::17a148ba61f9d0862d55058ead1cb2d6
https://doi.org/10.1145/3343413.3377961
https://doi.org/10.1145/3343413.3377961
Autor:
Mustafa Abualsaud, Mark D. Smucker
Publikováno v:
CIKM
To determine key factors that affect a user's behavior with search results, we conducted a controlled eye-tracking study of users completing search tasks using both desktop and mobile devices. We focus our investigation on users' behavior from their
Externí odkaz:
https://explore.openaire.eu/search/publication?articleId=doi_________::b7c3ef34cb4cf2047f3ed42092489061
https://doi.org/10.1145/3357384.3358041
https://doi.org/10.1145/3357384.3358041
Autor:
Mark D. Smucker
Publikováno v:
Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval.
Externí odkaz:
https://explore.openaire.eu/search/publication?articleId=doi_________::519e0eb4a40278298240ea228adf3e24
https://doi.org/10.1145/3349676
https://doi.org/10.1145/3349676
Autor:
Mark D. Smucker, Nimesh Ghelani, Haotian Zhang, Amira Ghenai, Gordon V. Cormack, Shahin Rahbariasl, Mustafa Abualsaud, Maura R. Grossman
Publikováno v:
SIGIR
A team of six assessors used Dynamic Sampling (Cormack and Grossman 2018) and one hour of assessment effort per topic to form, without pooling, a test collection for the TREC 2018 Common Core Track. Later, official relevance assessments were rendered
Externí odkaz:
https://explore.openaire.eu/search/publication?articleId=doi_________::844cd6fca1e1be226f345788d60ed208
https://doi.org/10.1145/3331184.3331354
https://doi.org/10.1145/3331184.3331354