LOBERT: Generative AI Foundation Model for Limit Order Book Messages
This work introduces LOBERT, a general-purpose encoder-only foundation model for LOB data suitable for downstream fine-tuning and achieves leading performance in tasks such as predicting mid-price movements and next messages, while reducing the required context length compared to previous methods.