Expand description
OAIService - OpenAI-compatible HTTP API
The HTTP server handles OpenAI API requests and uses authenticated RPC clients to reach Model, Policy, and Registry services.
§Architecture
HTTP Clients ──► HTTP Server (Axum) ──► OAIService
│
├──► ModelClient ──► ModelService
└──► PolicyClient ──► PolicyService§Usage
OAIService is typically started via the factory system:
ⓘ
// In config.toml
[services]
startup = ["event", "registry", "policy", "model", "oai"]
[oai]
host = "0.0.0.0"
port = 8080Structs§
- OAIService
- OAIService - OpenAI-compatible HTTP API
Constants§
- SERVICE_
NAME - Service name for registry and logging