Skip to content
#edge computing Open access

Enabling Large Model Inference in Dynamic and Heterogeneous Mobile Robots by Incorporating Collaborative Inference and Model Context Protocol

Nov 2026 · Italian National Conference on Sensors · 0 citations · 17 references

TL;DR

This framework seamlessly integrates collaborative inference between edge servers and mobile robots, supporting inference of large models by relying on local resources instead of remote cloud-based resources and can allow heterogeneous robotic peers to seamlessly join the system through MCP, a standardized interface for modern AI applications.

Abstract

Modern robotic systems increasingly rely on transformer-based AI models to process sensor input and support high-level decision making. However, due to limited GPU resources in each ego robot, it is difficult to run a large model locally. Outsourcing the model inference to cloud providers could address this issue, which however suffers from limitations including unreliable network connection, high latency, and high monetary cost. In this work, we have developed an effective decision making framework for robotic systems by leveraging a few state-of-the-art technologies, such as collaborative inference and model context protocol (MCP). Our framework seamlessly integrates collaborative inference between edge servers and mobile robots, supporting inference of large models by relying on local resources instead of remote cloud-based resources. It excels in a few feature designs. First, it is designed for mobile robot deployments where the available computing resources may change over time. This is achieved by introducing “anchors”, adding redundant nodes to hold the model partitions, and switching among model variants of different sizes. Second, it can allow heterogeneous robotic peers to seamlessly join the system through MCP, a standardized interface for modern AI applications. We have implemented a prototype of the proposed framework and experimentally validated its efficiency.

Read PDF

Similar papers

#computer vision Review Sep 2017

Agile Software Development Methods: Review and Analysis

This publication proposes a definition and a classification of agile software development approaches and analyses ten software development methods that can be characterized as being "agile" against the defined criterion.

P. Abrahamsson, O. Salo, Jussi Ronkainen et al. · 727 citations · ⚡54
#computer vision Jun 2008

The impact of agile practices on communication in software development

The study shows that agile practices improve both informal and formal communication, but indicates that, in larger development situations involving multiple external stakeholders, a mismatch of adequate communication mechanisms can sometimes even hinder the communication.

M. Pikkarainen, Jukka Haikara, O. Salo et al. · 401 citations · ⚡48
#machine learning Review Open access Oct 2014

Software development in startup companies: A systematic mapping study

The results indicate that software engineering work practices are chosen opportunistically, adapted and configured to provide value under the constrains imposed by the startup context.

Nicolò Paternoster, Carmine Giardino, M. Unterkalmsteiner et al. · 394 citations · ⚡54

Related blog posts

MIT News · Artificial Intelligence Nov 17, 2026

Learning the language of machine learning

By studying the computational foundations of language learning, Associate Professor Jacob Andreas builds intelligent systems that can communicate effectively with humans.

Microsoft Research Blog Oct 29, 2026

Microsoft Research Focus – Edition #97

Host Sowbhagya Suresh shares some of the latest news and cutting-edge research from across Microsoft—from understanding the challenges facing coding agents to uncovering how people use AI at work and improving extended-range weather forecasting. The post Microsoft Research Focus – Edition #97 appeared first on Microsoft Research.

MIT News · Artificial Intelligence Oct 28, 2026

Making machines that can listen

Professor Paris Smaragdis develops computers with superhuman hearing for applications like speech recognition, music understanding, and environmental monitoring.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.