상세 보기
Beyond Co-existence: Measuring Attribute Binding Hallucinations in Audio-Language Models
- Kim, Mingi;
- Kwon, Minchol;
- Ma, Minuk;
- Pham, Trung X.;
- Kim, Junyeong
WEB OF SCIENCE
0SCOPUS
0초록
Recent advancements in Audio-Language Models (ALMs) have enabled impressive capabilities in understanding and reasoning about complex acoustic scenes. However, these models frequently suffer from hallucinations, generating plausible but factually incorrect descriptions. Existing evaluation methods rely on discriminative, closed-ended prompts that focus on detecting the simple existence of sounds, failing to assess whether models correctly associate attributes with their sources. We define this critical failure mode as Attribute Binding Hallucination—where a model may detect both ‘man’ and ‘crying’ yet incorrectly bind them. We quantitatively expose this evaluation gap: while models achieve near-perfect accuracy on existence checks, they fail to reject mismatched attribute-object pairs with near-zero accuracy. To address this, we propose the Attribute Binding Evaluation Framework (ABEF), a methodology that measures fine-grained relational failures in open-ended responses, along with a synthetic dataset to rigorously isolate binding errors. Our experiments reveal that attribute binding hallucination is pervasive, with error rates exceeding 74%, indicating that high detection accuracy does not imply true compositional understanding. All code and datasets are available at https://github.com/1kmmk1/ALM_Hallucination.
키워드
- 제목
- Beyond Co-existence: Measuring Attribute Binding Hallucinations in Audio-Language Models
- 저자
- Kim, Mingi; Kwon, Minchol; Ma, Minuk; Pham, Trung X.; Kim, Junyeong
- 발행일
- 2027
- 유형
- Proceedings Paper
- 권
- 16825
- 페이지
- 383 ~ 396
- 언어
- ENG
- 출판사
- Springer Science and Business Media Deutschland GmbH
- 발행국가
- 미국
- 분량
- 14 페이지
- ISSN
- E 1611-3349
P 0302-9743