Beyond Static Endpoints: Tool Programs as an Interface for Flexible Agentic Web Services

ToolPro has been introduced as a novel interface for LLM-based agents, allowing for dynamic and flexible interactions with web services through executable tool programs that encapsulate multi-step workflows with explicit effect types. It employs techniques such as constraint-guided program construction and effect-aware replay, significantly improving efficiency by reducing end-to-end latency by up to 53.4% and client-side traffic by up to 96.1%. This advancement is crucial for practitioners as it enhances the capability of agents to perform complex tasks more effectively, especially in scenarios with high network latency and intricate workflows.