Evaluation measure for group-based record linkage
| Autor: | Charini Nanayakkara, Peter Christen, Eilidh Garrett, Thilina Ranbaduge |
|---|---|
| Rok vydání: | 2021 |
| Předmět: |
Group based
Information Systems and Management Computer science Health Informatics computer.software_genre birth-bundling lcsh:HB848-3697 Robustness (computer science) Evaluation methods lcsh:Demography. Population. Vital events Data mining historical record linkage Precision and recall Cluster analysis computer Record linkage clustering Information Systems Demography Population Data Science |
| Zdroj: | International Journal of Population Data Science International Journal of Population Data Science, Vol 4, Iss 1 (2019) |
| ISSN: | 2399-4908 |
| Popis: | Introduction The robustness of record linkage evaluation measures is of high importance since linkage techniques are assessed based on these. However, minimal research has been conducted to evaluate the suitability of existing evaluation measures in the context of linking groups of records. Linkage quality is generally evaluated based on traditional measures such as precision and recall. As we show, these traditional evaluation measures are not suitable for evaluating groups of linked records because they evaluate the quality of individual record pairs rather than the quality of records grouped into clusters. Objectives We highlight the shortcomings of traditional evaluation measures and then propose a novel method to evaluate clustering quality in the context of group-based record linkage. Methods The proposed linkage evaluation method assesses how well individual records have been allocated into predicted groups/clusters with respect to ground-truth data. We first identify the best representative predicted cluster for each ground-truth cluster and, based on the resulting mapping, each record in a ground-truth cluster is assigned to one of seven categories. These categories reflect how well the linkage technique assigned records into groups. Results We empirically evaluate our proposed method using real-world data and show that it better reflects the quality of clusters generated by three group-based record linkage techniques. We also show that traditional measures such as precision and recall can produce ambiguous results whereas our method does not. Conclusions The proposed evaluation method provides unambiguous results regarding the assessed group-based record linkage approaches. The method comprises of seven categories which reflect how each record was predicted, providing more detailed information about the quality of the linkage result. This will help to make better-informed decisions about which linkage technique is best suited for a given linkage application. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|