pub enum KvQuantMode {
None,
Int8,
Nf4,
Fp4,
}Expand description
KV-cache storage encoding / quantization mode.
Mirrors the Cap’n Proto KVQuantType (none/int8/nf4/fp4) but is
owned here so the fingerprint is independent of schema codegen. Convert at
the engine boundary with a match.
Variants§
None
Full precision (FP16/BF16).
Int8
8-bit integer quantization.
Nf4
4-bit NormalFloat.
Fp4
4-bit FloatingPoint.
Implementations§
Source§impl KvQuantMode
impl KvQuantMode
Sourcepub fn as_canonical_str(&self) -> &'static str
pub fn as_canonical_str(&self) -> &'static str
Canonical lowercase name used for display and hashing.
Trait Implementations§
Source§impl Clone for KvQuantMode
impl Clone for KvQuantMode
Source§fn clone(&self) -> KvQuantMode
fn clone(&self) -> KvQuantMode
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for KvQuantMode
impl Debug for KvQuantMode
Source§impl Default for KvQuantMode
impl Default for KvQuantMode
Source§fn default() -> KvQuantMode
fn default() -> KvQuantMode
Returns the “default value” for a type. Read more
Source§impl Display for KvQuantMode
impl Display for KvQuantMode
Source§impl Hash for KvQuantMode
impl Hash for KvQuantMode
Source§impl PartialEq for KvQuantMode
impl PartialEq for KvQuantMode
Source§fn eq(&self, other: &KvQuantMode) -> bool
fn eq(&self, other: &KvQuantMode) -> bool
Tests for
self and other values to be equal, and is used by ==.impl Copy for KvQuantMode
impl Eq for KvQuantMode
impl StructuralPartialEq for KvQuantMode
Auto Trait Implementations§
impl Freeze for KvQuantMode
impl RefUnwindSafe for KvQuantMode
impl Send for KvQuantMode
impl Sync for KvQuantMode
impl Unpin for KvQuantMode
impl UnsafeUnpin for KvQuantMode
impl UnwindSafe for KvQuantMode
Blanket Implementations§
§impl<T> AnySync for T
impl<T> AnySync for T
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
§impl<T> CallHasher for T
impl<T> CallHasher for T
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Compare self to
key and return true if they are equal.§impl<Q, K> Equivalent<K> for Q
impl<Q, K> Equivalent<K> for Q
§fn equivalent(&self, key: &K) -> bool
fn equivalent(&self, key: &K) -> bool
Checks if this value is equivalent to the given key. Read more
§impl<T> FutureExt for T
impl<T> FutureExt for T
§fn with_context(self, otel_cx: Context) -> WithContext<Self>
fn with_context(self, otel_cx: Context) -> WithContext<Self>
§fn with_current_context(self) -> WithContext<Self>
fn with_current_context(self) -> WithContext<Self>
§impl<T> Identity for Twhere
T: ?Sized,
impl<T> Identity for Twhere
T: ?Sized,
§impl<T> Instrument for T
impl<T> Instrument for T
§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more§impl<T> Pointable for T
impl<T> Pointable for T
§impl<T> PolicyExt for Twhere
T: ?Sized,
impl<T> PolicyExt for Twhere
T: ?Sized,
§impl<T> ServiceExt for T
impl<T> ServiceExt for T
§fn map_response_body<F>(self, f: F) -> MapResponseBody<Self, F>where
Self: Sized,
fn map_response_body<F>(self, f: F) -> MapResponseBody<Self, F>where
Self: Sized,
Apply a transformation to the response body. Read more
§fn trace_for_http(self) -> Trace<Self, SharedClassifier<ServerErrorsAsFailures>>where
Self: Sized,
fn trace_for_http(self) -> Trace<Self, SharedClassifier<ServerErrorsAsFailures>>where
Self: Sized,
High level tracing that classifies responses using HTTP status codes. Read more
§fn trace_for_grpc(self) -> Trace<Self, SharedClassifier<GrpcErrorsAsFailures>>where
Self: Sized,
fn trace_for_grpc(self) -> Trace<Self, SharedClassifier<GrpcErrorsAsFailures>>where
Self: Sized,
High level tracing that classifies responses using gRPC headers. Read more
§fn follow_redirects(self) -> FollowRedirect<Self>where
Self: Sized,
fn follow_redirects(self) -> FollowRedirect<Self>where
Self: Sized,
§impl<T> ToCompactString for Twhere
T: Display,
impl<T> ToCompactString for Twhere
T: Display,
§fn try_to_compact_string(&self) -> Result<CompactString, ToCompactStringError>
fn try_to_compact_string(&self) -> Result<CompactString, ToCompactStringError>
Fallible version of [
ToCompactString::to_compact_string()] Read more§fn to_compact_string(&self) -> CompactString
fn to_compact_string(&self) -> CompactString
Converts the given value to a [
CompactString]. Read more