MCPGen: Benchmarking LLMs on Executable MCPWorkflow Development
MCPGen is introduced, an executable benchmark for Model Context Protocol (MCP) workflow development that evaluates three diagnostic tasks: workflow reconstruction, tool creation, and backward-compatible workflow extension and evaluates 11 representative LLMs in a single-turn foundation-model setting.
Yingxuan Yang, Jia-Qi Liu, Li-Rui Guan et al.
· 0 citations