Full-duplex speech models execute dense model inference for every audio frame throughout a live interaction. This uniform framewise schedule creates sustained GPU load across dialogue states whose computation has strong, reusable temporal structure. ReFrame formulates full-duplex inference as a silence-aware computatio...
Zhen-Hui Zhou, Guan-Yi Chen, Jin-Tiao Wei et al.· 0 citations
Data-intensive GPU applications increasingly rely on NVMe SSDs to extend GPU memory. NVIDIA GPU Direct Storage (GDS) enables direct SSD-GPU transfers via PCIe peer-to-peer DMA, eliminating host staging. However, GDS retains three key limitations: (1) its control path traverses the kernel for every I/O request, introduc...
Jin-Tiao Wei, Guan-Yi Chen, Qi Chen et al.· 0 citations
Modern AI and data analytics workloads have terabyte-scale datasets, making GPUs access storage frequently. GPUDirect Storage allows the data path from SSD to GPU to bypass CPU memory. However, the file system shared by the CPU and GPU still runs on the CPU. Existing GPU file systems cache metadata to avoid frequent ac...
Qi Chen, Guan-Yi Chen, Yu-Jie Ren et al.· Proceedings of the 18th ACM...· 0 citations
Bulk memory copying (memcpy) is a dominant operation in modern data centers, driven by storage engines, in-memory databases, and caches. The emergence of heterogeneous memory (CXL, persistent memory, remote NUMA) further increases the volume of concurrent memory copy operations, making it easier to saturate the shared...
Ze-Cheng Li, Jian Zhang· Proceedings of the 18th ACM...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.