Existing continual-learning methods protect parameters, replayed examples, or Euclidean feature subspaces. When applied to hyperbolic multimodal models, they do not explicitly preserve the Lorentz geometry that jointly encodes within-modality similarity, cross-modal correspondence, and semantic hierarchy; sequential up...
Jia-Hong Liu, Ming Shen, Xiao-Hao Liu et al.· 0 citations
WIDER is proposed, a lightweight spectral regularizer for implicit CoT that improves matched implicit CoT baselines, while mechanistic analyses reveal higher effective rank, lower dominant-direction energy, and reduced redundancy among latent steps.
This lecture-style tutorial covers hyperbolic methods for data organization, retrieval, and memory layers in foundation-model systems: manifold operations, scalable neural primitives, retrieval-aware pipelines, recommendation and knowledge systems, agent memory, multimodal and scientific data modeling, and lifecycle op...
Jiahong Liu, Menglin Yang, Irwin King· Proceedings of the 32nd ACM...· 0 citations
The Geometric Space, Architecture and Learning Objective for Large Pre-Trained Models (GALOP) workshop is an accepted half-day KDD 2026 workshop that examines how geometric principles can make large pretrained models more expressive, robust, interpretable, and efficient.
Meng-Lin Yang, Jia-Hong Liu, Lucas Vinh Tran et al.· Proceedings of the 32nd ACM...· 1 citation
Large pretrained models have reshaped artificial intelligence, yet their Euclidean design assumptions often limit their ability to model hierarchy, curvature, symmetry, and heterogeneous relations in real-world data. The Geometric Space, Architecture and Learning Objective for Large Pre-Trained Models (GALOP) workshop...
Menglin Yang, Jiahong Liu, Lucas Vinh Tran et al.· Proceedings of the 32nd ACM...· 0 citations
Foundation models are increasingly deployed as agentic data-and-memory systems built on pretrained parameters, retrieval corpora, external knowledge stores, and persistent interaction histories. For the Knowledge Discovery and Data Mining (KDD) community, this matters because recommendation, search, temporal modeling,...
Jiahong Liu, Menglin Yang, Irwin King· Proceedings of the 32nd ACM...· 0 citations
This work proposes FlatLand, a novel personalized federated learning method that embeds different clients'data in tailored Lorentz space of hyperbolic geometry, and develops a parameter decoupling strategy that separates heterogeneous information from common knowledge, enabling direct aggregation without requiring clie...
Jiahong Liu, Ram Samarth, Xinyu Fu et al.· 0 citations
MGAL is the first multilingual, granularity- and position-aware long-context benchmark, constructed from United Nations reports spanning 8K to 128K tokens across the six official UN languages, and finds that LLMs perform well at word-level tasks but struggle with coarser-grained ones.
Chunhan Li, Chenglin Xu, Zongyang Zhang et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.