Evaluation of freely available data profiling tools for health data research application: a functional evaluation review

Autor: Ben Gordon, Clara Fennessy, Susheel Varma, Jake Barrett, Enez McCondochie, Trevor Heritage, Oenone Duroe, Richard Jeffery, Vishnu Rajamani, Kieran Earlam, Victor Banda, Neil Sebire
Rok vydání: 2022
Předmět:
Zdroj: BMJ Open. 12:e054186
ISSN: 2044-6055
DOI: 10.1136/bmjopen-2021-054186
Popis: ObjectivesTo objectively evaluate freely available data profiling software tools using healthcare data.DesignData profiling tools were evaluated for their capabilities using publicly available information and data sheets. From initial assessment, several underwent further detailed evaluation for application on healthcare data using a synthetic dataset of 1000 patients and associated data using a common health data model, and tools scored based on their functionality with this dataset.SettingImproving the quality of healthcare data for research use is a priority. Profiling tools can assist by evaluating datasets across a range of quality dimensions. Several freely available software packages with profiling capabilities are available but healthcare organisations often have limited data engineering capability and expertise.Participants28 profiling tools, 8 undergoing evaluation on synthetic dataset of 1000 patients.ResultsOf 28 potential profiling tools initially identified, 8 showed high potential for applicability with healthcare datasets based on available documentation, of which two performed consistently well for these purposes across multiple tasks including determination of completeness, consistency, uniqueness, validity, accuracy and provision of distribution metrics.ConclusionsNumerous freely available profiling tools are serviceable for potential use with health datasets, of which at least two demonstrated high performance across a range of technical data quality dimensions based on testing with synthetic health dataset and common data model. The appropriate tool choice depends on factors including underlying organisational infrastructure, level of data engineering and coding expertise, but there are freely available tools helping profile health datasets for research use and inform curation activity.
Databáze: OpenAIRE