ScaleDFS: Accelerating Decentralized and Private File Sharing via Scaling Directed Acyclic Graph Processing

  • Song, Mansub; 
  • Nguyen, Lan Anh; 
  • Kim, Sunggon; 
  • Eom, Hyeonsang; 
  • Son, Yongseok
Citations

WEB OF SCIENCE

0
Citations

SCOPUS

1

초록

This paper introduces a novel file system, ScaleDFS, designed to accelerate decentralized file sharing for a private network, leveraging the potential of scaling file management based on directed acyclic graph (DAG) on modern hardware. Specifically, in ScaleDFS, we first design a DAG builder that parallelizes the construction of DAG nodes for a file while preserving critical orders to speed up the uploading process. Second, we introduce a DAG reader that retrieves leaf DAG nodes in parallel without graph traversal assisted by a devised DAG cache to accelerate the downloading process. Finally, we present a DAG remover that rapidly identifies obsolete DAG nodes/data and removes them in parallel to mitigate the garbage collection overhead without compromising consistency. We implement ScaleDFS based on IPFS and demonstrate that ScaleDFS outperforms IPFS by up to 3.7×, 1.8×, and 12.6× in realistic file, private blockchain, and gateway workloads, respectively.

키워드

decentralized file system; merkle-DAG; private network
제목
ScaleDFS: Accelerating Decentralized and Private File Sharing via Scaling Directed Acyclic Graph Processing
저자
Song, Mansub; Nguyen, Lan Anh; Kim, Sunggon; Eom, Hyeonsang; Son, Yongseok
DOI
10.1145/3625549.3658690
발행일
2024-06
유형
Proceedings Paper
저널명
HPDC 2024 - Proceedings of the 33rd International Symposium on High-Performance Parallel and Distributed Computing
페이지
295 ~ 308