pub struct InferenceInstanceId { /* private fields */ }Expand description
Tenant/model/replica identity used for placement and endpoint derivation.
The tenant is accepted only after it came from EnvelopeContext::domain().
It is never derived from subject text or caller-supplied model input.
Implementations§
Source§impl InferenceInstanceId
impl InferenceInstanceId
pub fn new(verified_tenant: &str, model_ref: &str, replica: u16) -> Result<Self>
pub fn tenant(&self) -> &str
pub fn model_ref(&self) -> &str
pub fn replica(&self) -> u16
Sourcepub fn service_name(&self) -> String
pub fn service_name(&self) -> String
Opaque, deterministic name safe for registries and process managers.
pub fn iroh_key_purpose(&self) -> String
Sourcepub fn ipc_transport(&self, runtime_dir: &Path) -> TransportConfig
pub fn ipc_transport(&self, runtime_dir: &Path) -> TransportConfig
Same-host cross-process dial target for a subprocess placement.
Trait Implementations§
Source§impl Clone for InferenceInstanceId
impl Clone for InferenceInstanceId
Source§fn clone(&self) -> InferenceInstanceId
fn clone(&self) -> InferenceInstanceId
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for InferenceInstanceId
impl Debug for InferenceInstanceId
Source§impl Hash for InferenceInstanceId
impl Hash for InferenceInstanceId
Source§impl PartialEq for InferenceInstanceId
impl PartialEq for InferenceInstanceId
Source§fn eq(&self, other: &InferenceInstanceId) -> bool
fn eq(&self, other: &InferenceInstanceId) -> bool
Tests for
self and other values to be equal, and is used by ==.impl Eq for InferenceInstanceId
impl StructuralPartialEq for InferenceInstanceId
Auto Trait Implementations§
impl Freeze for InferenceInstanceId
impl RefUnwindSafe for InferenceInstanceId
impl Send for InferenceInstanceId
impl Sync for InferenceInstanceId
impl Unpin for InferenceInstanceId
impl UnsafeUnpin for InferenceInstanceId
impl UnwindSafe for InferenceInstanceId
Blanket Implementations§
§impl<T> AnySync for T
impl<T> AnySync for T
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
§impl<T> CallHasher for T
impl<T> CallHasher for T
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Compare self to
key and return true if they are equal.§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Checks if this value is equivalent to the given key. Read more
§impl<T> FutureExt for T
impl<T> FutureExt for T
§fn with_context(self, otel_cx: Context) -> WithContext<Self>
fn with_context(self, otel_cx: Context) -> WithContext<Self>
§fn with_current_context(self) -> WithContext<Self>
fn with_current_context(self) -> WithContext<Self>
§impl<T> Identity for Twhere
T: ?Sized,
impl<T> Identity for Twhere
T: ?Sized,
§impl<T> Instrument for T
impl<T> Instrument for T
§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more§impl<T> Pointable for T
impl<T> Pointable for T
§impl<T> PolicyExt for Twhere
T: ?Sized,
impl<T> PolicyExt for Twhere
T: ?Sized,
§impl<T> ServiceExt for T
impl<T> ServiceExt for T
§fn map_response_body<F>(self, f: F) -> MapResponseBody<Self, F>where
Self: Sized,
fn map_response_body<F>(self, f: F) -> MapResponseBody<Self, F>where
Self: Sized,
Apply a transformation to the response body. Read more
§fn trace_for_http(self) -> Trace<Self, SharedClassifier<ServerErrorsAsFailures>>where
Self: Sized,
fn trace_for_http(self) -> Trace<Self, SharedClassifier<ServerErrorsAsFailures>>where
Self: Sized,
High level tracing that classifies responses using HTTP status codes. Read more
§fn trace_for_grpc(self) -> Trace<Self, SharedClassifier<GrpcErrorsAsFailures>>where
Self: Sized,
fn trace_for_grpc(self) -> Trace<Self, SharedClassifier<GrpcErrorsAsFailures>>where
Self: Sized,
High level tracing that classifies responses using gRPC headers. Read more