Most KV-cache eviction methods ask, in effect, which memory appeared important while reading the prompt? We instead ask which memory will matter while answering? Since decoding queries are unavailable at eviction time, prior future-aware methods rely on pseudo-responses or synthetic future-query estimates. We cast fixe...
Ahsan Bilal, Muhammad Ahmed Mohsin, Muhammad Umer et al.· 1 citation
Sarse Relaxed Regularized Regression Rule-Fit is proposed, an intrinsically interpretable algorithm for both classification and regression that produces compact and stable rule sets without sacrificing performance, demonstrating that interpretability and predictive reliability need not be mutually exclusive.
Results show that test-time compute can be more effective when used to refine sampled trajectories rather than only to sample more candidates or rely on verifier-guided selection.
Ahsan Bilal, Muhammad Ahmed Mohsin, Muhammad Umer et al.· 0 citations
This work evaluates Qwen2.5-7B-Instruct under INT8 and INT4 quantization on RGB and HotpotQA, measuring both accuracy and faithfulness with a hallucination detector, NLI entailment, and an LLM judge.
Atta Ul Asad, Ahsan Bilal, Muhammad Ali et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.