Predicting short-term suicidal thoughts in adolescents using machine learning: developing decision tools to identify daily level risk after hospitalization

Psychol Med. 2023 May;53(7):2982-2991. doi: 10.1017/S0033291721005006. Epub 2021 Dec 9.

Abstract

Background: Mobile technology offers unique opportunities for monitoring short-term suicide risk in daily life. In this study of suicidal adolescent inpatients, theoretically informed risk factors were assessed daily following discharge to predict near-term suicidal ideation and inform decision algorithms for identifying elevations in daily level risk, with implications for real-time suicide-focused interventions.

Methods: Adolescents (N = 78; 67.9% female) completed brief surveys texted daily for 4 weeks after discharge (n = 1621 observations). Using multi-level classification and regression trees (CARTSs) with repeated 5-fold cross-validation, we tested (a) a simple prediction model incorporating previous-day scores for each of 10 risk factors, and (b) a more complex model incorporating, for each of these factors, a time-varying person-specific mean over prior days together with deviation from that mean. Models also incorporated missingness and contextual (study week, day of the week) indicators. The outcome was the presence/absence of next-day suicidal ideation.

Results: The best-performing model (cross-validated AUC = 0.86) was a complex model that included ideation duration, hopelessness, burdensomeness, and self-efficacy to refrain from suicidal action. An equivalent model that excluded ideation duration had acceptable overall performance (cross-validated AUC = 0.78). Models incorporating only previous-day scores, with and without ideation duration (cross-validated AUC of 0.82 and 0.75, respectively), showed relatively weaker performance.

Conclusions: Results suggest that specific combinations of dynamic risk factors assessed in adolescents' daily life have promising utility in predicting next-day suicidal thoughts. Findings represent an important step in the development of decision tools identifying short-term risk as well as guiding timely interventions sensitive to proximal elevations in suicide risk in daily life.

Keywords: Adolescents; daily diary; ecological momentary assessment; just-in-time adaptive intervention; machine learning; risk algorithm; suicidal ideation.

MeSH terms

  • Adolescent
  • Hospitalization
  • Humans
  • Machine Learning
  • Patient Discharge
  • Risk Factors
  • Suicidal Ideation*
  • Suicide*