Risk-Taking clinical trials at UCSF

As most adolescents visit a healthcare provider once a year, health behavior change interventions linked to clinic-based health information technologies hold significant promise for improving healthcare quality and subsequent behavioral health outcomes for adolescents (Baird, 2014, Harris, 2017). Recognizing the potential to leverage recent advances in machine learning and interactive narrative environments, the investigators are now well positioned to design health behavior change systems that extend the reach of clinicians to realize significant impacts on behavior change for adolescent preventive health. The proposed project centers on the design, development, and evaluation of a clinically-integrated health behavior change system for adolescents. CHANGEGRADIENTS will introduce an innovative reinforcement learning-based feedback loop in which adolescent patients interact with personalized behavior change interactive narratives that are dynamically personalized and realized in a rich narrative-centered virtual environment. CHANGEGRADIENTS will iteratively improve its behavior change models using policy gradient methods for Reinforcement Learning (RL) designed to optimize adolescents' achieved behavior change outcomes. This in turn will enable CHANGEGRADIENTS to generate more effective behavior change narratives, which will then lead to further improved behavior change outcomes. With a focus on risky behaviors and an emphasis on alcohol use, adolescents will interact with CHANGEGRADIENTS to develop an experiential understanding of the dynamics and consequences of their alcohol use decisions. The proposed project holds significant transformative potential for (1) producing theoretical and practical advances in how to realize significant impacts on adolescent health behavior change through novel interactive narrative technologies integrated with policy-based reinforcement learning, (2) devising sample-efficient policy gradient methods for RL that produce personalized behavior change experiences by integrating theoretically based models of health behavior change with data-driven models of interactive narrative generation, and (3) promoting new models for integrating personalized health behavior change technologies into clinical care that extend the effective reach of clinicians.