Measuring Job Search Effectiveness
| Autor: | Alfan Farizki Wicaksono |
|---|---|
| Rok vydání: | 2019 |
| Předmět: |
Information retrieval
ComputingMilieux_THECOMPUTINGPROFESSION Computer science User modeling media_common.quotation_subject 02 engineering and technology Set (abstract data type) Seekers Ranking 020204 information systems 0202 electrical engineering electronic engineering information engineering Mean reciprocal rank 020201 artificial intelligence & image processing Learning to rank Quality (business) Metric (unit) media_common |
| Zdroj: | SIGIR |
| Popis: | Users of online job search websites interact with ranked lists of job summaries generated in response to queries, hoping to identify one or more jobs of interest. Hence, the quality of job search rankings becomes a primary factor that affects user satisfaction. In this work, we propose methodologies and measures for evaluating the quality of job search rankings from a user modeling perspective. We start by investigating job seekers' behavior when they are interacting with the generated rankings, leveraging job search interaction logs from Seek.com, a well-known Australasian job search website. The output of this investigation will be an accurate model of job seekers that will be incorporated into an effectiveness metric. Recent proposals for job search ranking models used using two types of metrics to evaluate the quality of the ranking generated by the models: (1) offline metrics, such as NDCG@k (k is set to the number of job summaries shown in the first page), Prec@1, or Mean Reciprocal Rank (MRR); and (2) online metrics, such as click-through rate and job application rate [3, 6]. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|