Skip to main content

Module rpc_transport

Module rpc_transport 

Source
Expand description

RPC-backed StreamSpawner and ToolCaller for ChatApp inference.

Deduplicated from shell_handlers.rs and service.rs — both callers now use make_chat_spawner and (optionally) make_tool_caller from this module.

Functions§

make_chat_spawner
Build a StreamSpawner that drives inference via ModelClient.
make_tool_caller
Build a ToolCaller backed by the MCP ZMQ service.