Deng-Feng Wang

HEIRS-PS: Hybrid 3-D RRAM- and SRAM-CIM for Pipelined Sparse Multitask Transformer Acceleration

Multitask transformers have garnered widespread attention for fast task adaptation at edge. However, in addition to matrix–vector multiplication (MVM) with static and dynamic weights in the data-intensive transformer, task adaptation introduces new challenge of weight updating. Besides, while sparsity can help mitigate...