Hold-out Digits experiments show that retaining the input mean or correcting the output bias improves median product error over round-to-nearest in all four tested bit-width and calibration-size settings.
Piyush Sao, N. Miniskar, Pedro Valero-Lara et al.· 0 citations
The problem of minimizing error in quantized matrix multiplication is considered and the full-gauge optimum is characterized and the cost of preserving row and column indices is quantized.
Piyush Sao, N. Miniskar, Pedro Valero-Lara et al.· 1 citation
The Johnson-Lindenstrauss (JL) lemma guarantees that a random projection of $n$ points to $m=O(\varepsilon^{-2}\log n)$ dimensions preserves pairwise squared distances within relative error $\varepsilon$ with high probability, and this dimension order is asymptotically optimal. In high dimensions, however, distances co...
An exact finite-dimensional identity is derived for the expected squared product error under independent, zero-mean entrywise errors with known variance fields; it holds exactly for non-overloading subtractive dither and for independent stochastic rounding, and is empirically assess deterministic round-to-nearest (RTN)...
Piyush Sao, N. Miniskar, Pedro Valero-Lara et al.· arXiv.org· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.