Detecting substance-related problems in narrative investigation summaries of child abuse and neglect using text mining and machine learning

Date

2019-12
Language
English

Embargo Lift Date

Committee Members

Degree

Degree Year

Department

Grantor

Journal Title

Journal ISSN

Volume Title

Found At

Elsevier

Abstract

Background State child welfare agencies collect, store, and manage vast amounts of data. However, they often do not have the right data, or the data is problematic or difficult to inform strategies to improve services and system processes. Considerable resources are required to read and code these text data. Data science and text mining offer potentially efficient and cost-effective strategies for maximizing the value of these data.

Objective The current study tests the feasibility of using text mining for extracting information from unstructured text to better understand substance-related problems among families investigated for abuse or neglect.

Method A state child welfare agency provided written summaries from investigations of child abuse and neglect. Expert human reviewers coded 2956 investigation summaries based on whether the caseworker observed a substance-related problem. These coded documents were used to develop, train, and validate computer models that could perform the coding on an automated basis.

Results A set of computer models achieved greater than 90% accuracy when judged against expert human reviewers. Fleiss kappa estimates among computer models and expert human reviewers exceeded .80, indicating that expert human reviewer ratings are exchangeable with the computer models.

Conclusion These results provide compelling evidence that text mining procedures can be a cost-effective and efficient solution for extracting meaningful insights from unstructured text data. Additional research is necessary to understand how to extract the actionable insights from these under-utilized stores of data in child welfare.

Description

item.page.description.tableofcontents

item.page.relation.haspart

Cite As

Perron, B. E., Victor, B. G., Bushman, G., Moore, A., Ryan, J. P., Lu, A. J., & Piellusch, E. K. (2019). Detecting substance-related problems in narrative investigation summaries of child abuse and neglect using text mining and machine learning. Child Abuse & Neglect, 98, 104180. https://doi.org/10.1016/j.chiabu.2019.104180

ISSN

Publisher

Series/Report

Sponsorship

Major

Extent

Identifier

Relation

Journal

Child Abuse & Neglect

Rights

Publisher Policy

Source

Author

Alternative Title

Type

Article

Number

Volume

Conference Dates

Conference Host

Conference Location

Conference Name

Conference Panel

Conference Secretariat Location

Version

Author's manuscript

Full Text Available at

This item is under embargo {{howLong}}