상세 보기
Blocking Visual Leakage: Visually-Agnostic Text Decomposition for Composed Video Retrieval
- Hwang, Jinkwon;
- Ma, Minuk;
- Pham, Trung X.;
- Kim, Junyeong
WEB OF SCIENCE
0SCOPUS
0초록
Composed Video Retrieval (CVR) requires retrieving a target video by modifying a reference video according to a textual query. While pioneer benchmarks like WebVid-CoVR focused on simple attribute manipulation or general content changes, the field has evolved to demand sophisticated reasoning over complex modification logic. Reflecting this shift, recent benchmarks like FineCVR introduce structured modification intents comprising Retained, Injected, and Excluded components. However, in this challenging setting, existing methods often suffer from ‘Visual Leakage,’ where visual signals from the reference video bias the text interpretation during cross-attention. To address this, we propose VAD-CVR, a novel framework that strictly decouples text decomposition from visual processing using an LLM-based Explicit Span Decomposer. We distill the reasoning capabilities of a Large Language Model into a lightweight tagger to extract precise semantic roles without visual interference. Leveraging these disentangled embeddings, we introduce Role-Aware Temporal Gating, which employs an active suppression mechanism to attenuate visual features corresponding to excluded text while highlighting preserved context. Furthermore, our Injected-Prioritized Fusion module assigns structural importance to injected cues to overcome reference dominance. Experiments on FineCVR-1M demonstrate that our method achieves state-of-the-art performance with an R@1 of 29.15%, proving its capability in robust intent interpretation.
키워드
- 제목
- Blocking Visual Leakage: Visually-Agnostic Text Decomposition for Composed Video Retrieval
- 저자
- Hwang, Jinkwon; Ma, Minuk; Pham, Trung X.; Kim, Junyeong
- 발행일
- 2027
- 유형
- Proceedings Paper
- 권
- 16825
- 페이지
- 669 ~ 684
- 언어
- ENG
- 출판사
- Springer Science and Business Media Deutschland GmbH
- 발행국가
- 미국
- 분량
- 16 페이지
- ISSN
- E 1611-3349
P 0302-9743