An intermediate architecture is explored, in which the cloud-written program defers bounded questions over user data to a small local model through an ordinary function call, which improves the success rate of a code-only agent in all six combinations of backbone model and test partition.
Boris Radovič, Marco Canini, Veljko Pejović· 0 citations
CALM-MAS is proposed, a congestion-aware serving framework for LLM applications that treats LLM test-time computation as an elastic resource, dynamically adjusting the compute profile of admitted tasks to tame congestion.
Mouheb Ben Nasr, Muhammad Bilal, Alessandro Cornacchia et al.· Proceedings of the 17th ACM...· 0 citations
This work introduces CoLEDS, a method for profiling unlabeled client datasets with minimal computational overhead that yields federatively trained models that are better aligned with individual data distributions and enables appropriate model assignment even for clients that do not participate in federated training.
Boris Radovič, Marco Canini, V. Pejović· Data mining and knowledge di...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.