Do Large Language Models Capture the Diversity in their Training Data?
The concavity of the matrix-based conditional entropy functional is proved, which makes the resulting entropy-constrained projection a convex optimization problem, and a scalable mirror-descent algorithm for its implementation is developed.
You-Qi Wu, F. Farnia
· 0 citations