We have 4 of 17 papers
We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.
Not the right person? Other researchers publish under this name.
Jev is a commercial System One model from TypeSafe AI that does not generate text: given a state and typed questions, it returns a choice from fixed options, a position on a rubric, or the probability that a statement is true, with probabilities the vendor describes as calibrated. Such models target small decisions in...
This work studies whether a carefully domain-adapted retrieval-augmented generation pipeline closes the gap between compact and compact model quality in financial institutions under dense, frequently amended rulebooks.
Deployment of Large Language Models (LLMs) on memory-constrained edge devices relies heavily on aggressive post-training quantization. However, evaluating these models is largely based on zero-shot task accuracy, which depends solely on argmax predictions and is insensitive to changes in the underlying predictive distr...
This work proposes Correctness Agreement, a decision-level metric that can measure the intersection of correct predictions between the base model and its quantized variant, and finds that the base and quantized variants usually have a shift in behavior even when accuracy and perplexity are preserved.
We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.
