Energy-Aware Scalability Analysis and Design of Heterogeneous-Hybrid PIM for Edge AI

  • Jeon, Sangmin; 
  • Lee, Kyeongwon; 
  • Lee, Kangju; 
  • Lee, Woojoo
Citations

SCOPUS

0

초록

Edge-AI inference on IoT and embedded platforms must satisfy real-time latency under strict energy and cost constraints. Processing-in-Memory (PIM) reduces data movement, but volatile-memory PIM suffers from high standby energy, and NVM-based hybrid PIMs often rely on fixed data placement under dynamic inference demand. This paper presents HH-PIM, a heterogeneous–hybrid PIM architecture with high-performance (HP) and low-power (LP) clusters, each integrating MRAM–SRAM hybrid banks. HH-PIM enables demand-aware weight placement across HP/LP × MRAM/SRAM regions, using SRAM under peak load for latency and MRAM-backed retention with power gating during low-demand intervals. We formulate time-sliced inference as an energy-minimizing weight-placement problem and solve it using dynamic programming, with energy-minimizing placement states precomputed in a look-up table for the formulated discrete placement problem. An energy-aware scalability analysis further captures the convex trade-off between execution-time reduction and logic/idle-power overhead, guiding energy-optimal module-count selection under real-time constraints. RTL implementation with RISC-V–based processor integration shows that HH-PIM achieves up to 86.23% (59.87% on average) energy savings over a volatile-memory PIM baseline across three TinyML CNN workloads and six dynamic scenarios, validating the predicted energy–scalability trend.

키워드

Edge AI Processors; Energy-Aware Design; Heterogeneous-Hybrid Architecture; Non-Volatile Memory Systems; Processing-in-Memory; PIM; Scalability Analysis
제목
Energy-Aware Scalability Analysis and Design of Heterogeneous-Hybrid PIM for Edge AI
저자
Jeon, Sangmin; Lee, Kyeongwon; Lee, Kangju; Lee, Woojoo
DOI
10.1109/TCAD.2026.3723175
발행일
2026
유형
Article
저널명
IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems