Methodological Gaps in Predicting Mental Health States from Social Media
Autor: | John M. Kane, Sindhu Kiranmai Ernala, Asra F. Rizvi, Kristin A. Candan, Munmun De Choudhury, Michael L. Birnbaum, William A. Sterling |
---|---|
Rok vydání: | 2019 |
Předmět: |
education.field_of_study
Operationalization 05 social sciences Applied psychology Population Construct validity 020207 software engineering 02 engineering and technology Mental health External validity 0202 electrical engineering electronic engineering information engineering 0501 psychology and cognitive sciences Internal validity Proxy (statistics) Psychology education 050107 human factors Sampling bias |
Zdroj: | CHI |
DOI: | 10.1145/3290605.3300364 |
Popis: | A growing body of research is combining social media data with machine learning to predict mental health states of individuals. An implication of this research lies in informing evidence-based diagnosis and treatment. However, obtaining clinically valid diagnostic information from sensitive patient populations is challenging. Consequently, researchers have operationalized characteristic online behaviors as "proxy diagnostic signals" for building these models. This paper posits a challenge in using these diagnostic signals, purported to support clinical decision-making. Focusing on three commonly used proxy diagnostic signals derived from social media, we find that predictive models built on these data, although offer strong internal validity, suffer from poor external validity when tested on mental health patients. A deeper dive reveals issues of population and sampling bias, as well as of uncertainty in construct validity inherent in these proxies. We discuss the methodological and clinical implications of these gaps and provide remedial guidelines for future research. |
Databáze: | OpenAIRE |
Externí odkaz: |