Scaling Sequence Learning under Production Latency Constraints
Capturing complex user behavior patterns has been shown to be valuable for prediction models in ads ranking. However, scaling user history modeling in online ranking is constrained by inference cost. While complexity can be offloaded to upstream models, transfer efficiency to the online model is limited, making it impo...