Blocking Visual Leakage: Visually-Agnostic Text Decomposition for Composed Video Retrieval

Citations

WEB OF SCIENCE

0
Citations

SCOPUS

0

초록

Composed Video Retrieval (CVR) requires retrieving a target video by modifying a reference video according to a textual query. While pioneer benchmarks like WebVid-CoVR focused on simple attribute manipulation or general content changes, the field has evolved to demand sophisticated reasoning over complex modification logic. Reflecting this shift, recent benchmarks like FineCVR introduce structured modification intents comprising Retained, Injected, and Excluded components. However, in this challenging setting, existing methods often suffer from ‘Visual Leakage,’ where visual signals from the reference video bias the text interpretation during cross-attention. To address this, we propose VAD-CVR, a novel framework that strictly decouples text decomposition from visual processing using an LLM-based Explicit Span Decomposer. We distill the reasoning capabilities of a Large Language Model into a lightweight tagger to extract precise semantic roles without visual interference. Leveraging these disentangled embeddings, we introduce Role-Aware Temporal Gating, which employs an active suppression mechanism to attenuate visual features corresponding to excluded text while highlighting preserved context. Furthermore, our Injected-Prioritized Fusion module assigns structural importance to injected cues to overcome reference dominance. Experiments on FineCVR-1M demonstrate that our method achieves state-of-the-art performance with an R@1 of 29.15%, proving its capability in robust intent interpretation.

키워드

Composed Video Retrieval; Multi-Modal Alignment; Text to Video Retrieval; Video Understanding; Visual Leakage
제목
Blocking Visual Leakage: Visually-Agnostic Text Decomposition for Composed Video Retrieval
저자
Hwang, Jinkwon; Ma, Minuk; Pham, Trung X.; Kim, Junyeong
DOI
10.1007/978-3-032-31930-2_45
발행일
2027
유형
Proceedings Paper
저널명
Lecture Notes in Computer Science
권
16825
페이지
669 ~ 684