Tian Jin

Self-Orchestrating Language Models: Leveraging Semantic Dependence for Efficient Inference

Large language models (LLMs) demonstrate impressive capabilities, but their deployment presents significant efficiency challenges. Autoregressive decoding imposes substantial inference latency and under-utilizes hardware accelerators in low batch size regimes. Discrete diffusion models can generate in parallel but stru...