CineCap: Structured Reasoning with Spatio-Temporal Anchors for Cinematographic Video Captioning

CineCap is a newly proposed framework for cinematographic video captioning that integrates structured reasoning with spatio-temporal anchors and employs reinforcement learning to enhance caption comprehensiveness and accuracy. It addresses the challenges of inferring professional cinematographic concepts from visual cues and generating precise descriptions across multiple dimensions. The framework is evaluated using CineCap Bench, a new benchmark of 472 annotated video-caption pairs, demonstrating superior performance over existing models and setting a new state of the art in this domain. The code and model checkpoint are publicly accessible, facilitating further research and development in video understanding and generation.