Generative Embedding Benchmark: How Much Information Survives in a Dense Embedding?
The Generative Embedding Benchmark (GEB) is introduced, in which a decoder answers questions using only a frozen embedding and question text, without access to the original image or intermediate visual features, showing that generative readout exposes information bottlenecks that separability-based evaluation does not...