Jun Dong

SignGPT: Toward LLM-Mediated Sign Language Interaction through Gloss-Free Translation and Generation

Large language models (LLMs) provide limited support for sign language interaction. Unifying sign language translation (SLT) and generation (SLG) to enable sign language as both input and output can reduce switching between separate models during sign-text interaction. We present SignGPT, a unified, pose-based framewor...