Skip to main content

Module oai

Module oai 

Source
Expand description

OAIService - OpenAI-compatible HTTP API

The HTTP server handles OpenAI API requests and uses authenticated RPC clients to reach Model, Policy, and Registry services.

§Architecture

HTTP Clients ──► HTTP Server (Axum) ──► OAIService
                       │
                       ├──► ModelClient ──► ModelService
                       └──► PolicyClient ──► PolicyService

§Usage

OAIService is typically started via the factory system:

ⓘ
// In config.toml
[services]
startup = ["event", "registry", "policy", "model", "oai"]

[oai]
host = "0.0.0.0"
port = 8080

Structs§

OAIService
OAIService - OpenAI-compatible HTTP API

Constants§

SERVICE_NAME
Service name for registry and logging