We introduce LimiX-2, a new model in the LimiX family, developed through model and data scaling guided by our previously established scaling laws. LimiX-2 adopts the Contextual Mechanism Networks (CMNs) paradigm and is pretrained with Context-Conditional Masked Modeling (CCMM). CMNs shifts the organizing principle of i...
Xing-Xuan Zhang, Gang Ren, Hao Yuan et al.· 2 citations
Structured data such as tabular data, time series and graphs powers many core data mining applications including recommendation, forecasting and user behavior analysis. Conventional approaches such as statistical models, classical machine learning methods and deep neural networks have achieved strong results. Yet most...
Peng Cui, Xing-Xuan Zhang, Han-Jia Ye et al.· Proceedings of the 32nd ACM...· 0 citations
GTAlign is proposed, a surprisingly simple yet effective Graph-to-Table Alignment framework for text-free Graph Foundation Model, and a community-guided continual pre-training, where pseudo-labels derived from graph community are used to construct few-shot prediction episodes.
Chunyu Hu, Tianyin Liao, Ge Lan et al.· arXiv.org· 0 citations
This tutorial presents a systematic overview of this emerging paradigm of tabular foundation models, which treats tables as a common representation that can capture information from tabular data, time series, and graphs within a shared learning framework.
Peng Cui, Xingxuan Zhang, Han-Jia Ye et al.· Proceedings of the 32nd ACM...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.