CLIP 기반 분석을 통한 한국 신사실파 작가 분류

Identification of Korean Neo-Realism Artists Through CLIP-Based Analysis

초록

This study proposes a methodology for analyzing artwork features and classifying artists using image data. Unlike prior research focused on Western artworks, it builds and utilizes a dataset of Korean Neo-Realism (i.e. Shinsasilpa) artists. The image encoder of the CLIP model transformed the semantic features of the artwork into a vector space and, by learning together with the textual description, more deeply understood the meaning of the image. Furthermore, hue information via RGB and HSV color space analysis, and texture characteristics through GLCM-based analysis. These features were integrated into representative feature vectors and analyzed with K-means clustering, achieving 87.4% classification accuracy. Visualization results demonstrated the model's effectiveness in identifying image similarities and accurately classifying artworks in an unsupervised learning context, while highlighting unique hue and texture characteristics of each cluster, revealing formal and artistic tendencies in artworks.

키워드

컴퓨테이셔널 분석; 한국 회화; 신사실파; 대조적 언어-이미지 사전 학습; K-평균 군집화; Computational analysis; Korean Painting; Neo-Realism; CLIP-based analysis; K-means clustering
제목
CLIP 기반 분석을 통한 한국 신사실파 작가 분류
제목 (타언어)
Identification of Korean Neo-Realism Artists Through CLIP-Based Analysis
저자
백서현; 박소정; 박소은; 임유민; 이보아; 최종원
DOI
10.9708/jksci.2024.29.12.317
발행일
2024-12
저널명
한국컴퓨터정보학회논문지
권
29
호
12
페이지
317 ~ 328