pub enum InferenceResponseVariant {
Show 34 variants
Success,
Error(ErrorInfo),
GenerateStreamResult(StreamInfo),
ModelInfoResult(ModelInfo),
IsReadyResult(bool),
ApplyChatTemplateResult(String),
CreateLoraResult,
LoadLoraResult,
SaveLoraResult,
UnloadLoraResult,
HasLoraResult(bool),
SetSessionResult,
ClearSessionResult,
ReleaseSessionResult,
HealthCheckResult(HealthStatus),
TttWritebackResult,
TttEvictResult,
TrainStepResult(TrainStepResult),
TttZeroResult,
GetDeltaStatusResult(DeltaStatusResult),
SaveAdaptationResult(SaveAdaptationResult),
SnapshotDeltaResult(SnapshotDeltaResult),
TrainStepStreamResult(StreamInfo),
ExportPeftAdapterResult(ExportPeftResult),
MergeLoraResult,
CreateLoraStreamResult(StreamInfo),
LoadLoraStreamResult(StreamInfo),
SaveLoraStreamResult(StreamInfo),
SaveAdaptationStreamResult(StreamInfo),
SnapshotDeltaStreamResult(StreamInfo),
ExportPeftAdapterStreamResult(StreamInfo),
MergeLoraStreamResult(StreamInfo),
EmbedResult(EmbedImagesResponse),
GetLayerProfileResult(LayerProfileResult),
}Expand description
Response variants for the InferenceResponseVariant service.
Variants§
Success
Error(ErrorInfo)
GenerateStreamResult(StreamInfo)
ModelInfoResult(ModelInfo)
IsReadyResult(bool)
ApplyChatTemplateResult(String)
CreateLoraResult
LoadLoraResult
SaveLoraResult
UnloadLoraResult
HasLoraResult(bool)
SetSessionResult
ClearSessionResult
ReleaseSessionResult
HealthCheckResult(HealthStatus)
TttWritebackResult
TttEvictResult
TrainStepResult(TrainStepResult)
TttZeroResult
GetDeltaStatusResult(DeltaStatusResult)
SaveAdaptationResult(SaveAdaptationResult)
SnapshotDeltaResult(SnapshotDeltaResult)
TrainStepStreamResult(StreamInfo)
ExportPeftAdapterResult(ExportPeftResult)
MergeLoraResult
CreateLoraStreamResult(StreamInfo)
LoadLoraStreamResult(StreamInfo)
SaveLoraStreamResult(StreamInfo)
SaveAdaptationStreamResult(StreamInfo)
SnapshotDeltaStreamResult(StreamInfo)
ExportPeftAdapterStreamResult(StreamInfo)
MergeLoraStreamResult(StreamInfo)
EmbedResult(EmbedImagesResponse)
GetLayerProfileResult(LayerProfileResult)
Implementations§
Source§impl InferenceResponseVariant
impl InferenceResponseVariant
Sourcepub fn parse_response(bytes: &[u8]) -> Result<InferenceResponseVariant>
pub fn parse_response(bytes: &[u8]) -> Result<InferenceResponseVariant>
Parse a response from raw bytes.
Trait Implementations§
Source§impl Debug for InferenceResponseVariant
impl Debug for InferenceResponseVariant
Auto Trait Implementations§
impl Freeze for InferenceResponseVariant
impl RefUnwindSafe for InferenceResponseVariant
impl Send for InferenceResponseVariant
impl Sync for InferenceResponseVariant
impl Unpin for InferenceResponseVariant
impl UnsafeUnpin for InferenceResponseVariant
impl UnwindSafe for InferenceResponseVariant
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
§impl<T> Instrument for T
impl<T> Instrument for T
§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more§impl<T> Pointable for T
impl<T> Pointable for T
§impl<T> PolicyExt for Twhere
T: ?Sized,
impl<T> PolicyExt for Twhere
T: ?Sized,
§impl<T> ServiceExt for T
impl<T> ServiceExt for T
§fn map_response_body<F>(self, f: F) -> MapResponseBody<Self, F>where
Self: Sized,
fn map_response_body<F>(self, f: F) -> MapResponseBody<Self, F>where
Self: Sized,
Apply a transformation to the response body. Read more
§fn trace_for_http(self) -> Trace<Self, SharedClassifier<ServerErrorsAsFailures>>where
Self: Sized,
fn trace_for_http(self) -> Trace<Self, SharedClassifier<ServerErrorsAsFailures>>where
Self: Sized,
High level tracing that classifies responses using HTTP status codes. Read more
§fn trace_for_grpc(self) -> Trace<Self, SharedClassifier<GrpcErrorsAsFailures>>where
Self: Sized,
fn trace_for_grpc(self) -> Trace<Self, SharedClassifier<GrpcErrorsAsFailures>>where
Self: Sized,
High level tracing that classifies responses using gRPC headers. Read more