상세 보기
FlexGPU: A Flexible and Efficient Scheduler for GPU Sharing Systems
- Chen, Qichen;
- Lee, Hyojeong;
- Yeom, Heon Young;
- Son, Yongseok
WEB OF SCIENCE
2SCOPUS
2초록
The graphics processing unit (GPU) is extensively used in diverse domains, such as finance, machine learning, and image processing. The GPU can be underutilized as multiple applications may not share the same GPU concurrently owing to a memory oversubscription issue. For example, when applications that require fewer computational resources but a larger GPU memory are running instantaneously, the GPU memory may be insufficient; consequently, the number of GPU applications running simultaneously is restricted, decreasing GPU utilization. Further, it can even stop the execution of applications that are running on the GPU. To this end, we propose FlexGPU, which schedules the kernels of the GPU applications that run on the same GPU according to their features. This framework 1) schedules the kernel at the launching time according to its features to improve GPU utilization and 2) temporarily checkpoints and restores non-dependent content in the GPU memory to/from the host memory, which avoids oversubscription of the GPU when out-of-memory failure occurs and allows more kernels to run concurrently on the GPU. The experimental results show that compared to existing methods, our approach demonstrates a 7 times improvement in performance in terms of execution time and enables a 2.5 times increase in the concurrent execution of applications.
- 제목
- FlexGPU: A Flexible and Efficient Scheduler for GPU Sharing Systems
- 저자
- Chen, Qichen; Lee, Hyojeong; Yeom, Heon Young; Son, Yongseok
- 발행일
- 2020-05
- 유형
- Proceedings Paper
- 저널명
- 2020 20TH IEEE/ACM INTERNATIONAL SYMPOSIUM ON CLUSTER, CLOUD AND INTERNET COMPUTING (CCGRID 2020)
- 페이지
- 300 ~ 309
- 언어
- ENG
- 출판사
- IEEE COMPUTER SOC
- 발행국가
- 미국
- 분량
- 10 페이지
- ISSN
- P 0000-0000