Post-Boundary Bridge: Must Local Attention Go Global Between Global Layers?
Post-Boundary Bridge (PBB), which preserves causal attention within blocks and adds direct connections across their boundaries, shows that targeted boundary exchange can preserve model quality while enabling faster, more memory-efficient local attention between global layers.