Inform, Coach, Relate, Listen: Auditing LLM Caregiving Support Roles

This study examines the impact of different support roles—Inform, Coach, Relate, and Listen—on the safety profiles of language models used in caregiving contexts, specifically for Alzheimer's Disease and Related Dementias. Evaluating three models (GPT-4o-mini, Llama-3.1-8B-Instruct, and MedGemma-1.5-4b-it) against baseline conditions, the research highlights how the chosen support role influences interactional risks and perceived quality. The release of approximately 90,000 annotated responses provides a valuable resource for enhancing the safety and effectiveness of LLMs in conversational support applications.