Does a Shared Temperature Imply a Shared Angular Scale in Probabilistic Contrastive Learning?
In probabilistic contrastive learning, a shared temperature is commonly interpreted as a shared similarity scale, but this interpretation does not hold for high-dimensional distributional class representations. We study the exact von Mises-Fisher (vMF) probabilistic score used by ProCo when representation dimension and...
Ning-Kang Peng, Qian-Feng Yu, Jing Mao et al.
· 0 citations