상세 보기
Energy-Aware Scalability Analysis and Design of Heterogeneous-Hybrid PIM for Edge AI
- Jeon, Sangmin;
- Lee, Kyeongwon;
- Lee, Kangju;
- Lee, Woojoo
SCOPUS
0초록
Edge-AI inference on IoT and embedded platforms must satisfy real-time latency under strict energy and cost constraints. Processing-in-Memory (PIM) reduces data movement, but volatile-memory PIM suffers from high standby energy, and NVM-based hybrid PIMs often rely on fixed data placement under dynamic inference demand. This paper presents HH-PIM, a heterogeneous–hybrid PIM architecture with high-performance (HP) and low-power (LP) clusters, each integrating MRAM–SRAM hybrid banks. HH-PIM enables demand-aware weight placement across HP/LP × MRAM/SRAM regions, using SRAM under peak load for latency and MRAM-backed retention with power gating during low-demand intervals. We formulate time-sliced inference as an energy-minimizing weight-placement problem and solve it using dynamic programming, with energy-minimizing placement states precomputed in a look-up table for the formulated discrete placement problem. An energy-aware scalability analysis further captures the convex trade-off between execution-time reduction and logic/idle-power overhead, guiding energy-optimal module-count selection under real-time constraints. RTL implementation with RISC-V–based processor integration shows that HH-PIM achieves up to 86.23% (59.87% on average) energy savings over a volatile-memory PIM baseline across three TinyML CNN workloads and six dynamic scenarios, validating the predicted energy–scalability trend.
키워드
- 제목
- Energy-Aware Scalability Analysis and Design of Heterogeneous-Hybrid PIM for Edge AI
- 저자
- Jeon, Sangmin; Lee, Kyeongwon; Lee, Kangju; Lee, Woojoo
- 발행일
- 2026
- 유형
- Article
- 언어
- ENG
- 출판사
- Institute of Electrical and Electronics Engineers Inc.
- 발행국가
- 미국
- ISSN
- E 1937-4151
P 0278-0070