pub struct GenerationQualityMetrics {
pub perplexity: f32,
pub avg_entropy: f32,
pub entropy_variance: f32,
pub repetition_ratio: f32,
pub token_count: u32,
}Expand description
Aggregated quality metrics from a generation (~24 bytes)
These metrics can be used for:
- Quality scoring in self-supervised RL
- Monitoring generation quality
- Detecting degraded model performance
Fields§
§perplexity: f32Perplexity: exp(-avg_log_prob) Lower = model is more confident in its generations Typical range: 1.0 (perfect) to 100+ (very uncertain)
avg_entropy: f32Average entropy of probability distributions (in nats) Lower = more decisive token selection Typical range: 0.0 (deterministic) to ~10.0 (very uncertain)
entropy_variance: f32Variance of entropy across tokens Lower = more consistent confidence throughout generation
repetition_ratio: f32Ratio of repeated n-grams to total n-grams Lower = less repetitive output Range: 0.0 (no repeats) to 1.0 (all repeats)
token_count: u32Number of tokens generated
Implementations§
Source§impl GenerationQualityMetrics
impl GenerationQualityMetrics
Sourcepub fn is_concerning(&self) -> bool
pub fn is_concerning(&self) -> bool
Check if metrics indicate potentially problematic generation
Trait Implementations§
Source§impl Clone for GenerationQualityMetrics
impl Clone for GenerationQualityMetrics
Source§fn clone(&self) -> GenerationQualityMetrics
fn clone(&self) -> GenerationQualityMetrics
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for GenerationQualityMetrics
impl Debug for GenerationQualityMetrics
Source§impl Default for GenerationQualityMetrics
impl Default for GenerationQualityMetrics
Source§fn default() -> GenerationQualityMetrics
fn default() -> GenerationQualityMetrics
Returns the “default value” for a type. Read more
Source§impl<'de> Deserialize<'de> for GenerationQualityMetrics
impl<'de> Deserialize<'de> for GenerationQualityMetrics
Source§fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
fn deserialize<__D>(__deserializer: __D) -> Result<Self, __D::Error>where
__D: Deserializer<'de>,
Deserialize this value from the given Serde deserializer. Read more
Source§impl Serialize for GenerationQualityMetrics
impl Serialize for GenerationQualityMetrics
impl Copy for GenerationQualityMetrics
Auto Trait Implementations§
impl Freeze for GenerationQualityMetrics
impl RefUnwindSafe for GenerationQualityMetrics
impl Send for GenerationQualityMetrics
impl Sync for GenerationQualityMetrics
impl Unpin for GenerationQualityMetrics
impl UnsafeUnpin for GenerationQualityMetrics
impl UnwindSafe for GenerationQualityMetrics
Blanket Implementations§
§impl<T> AnySync for T
impl<T> AnySync for T
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
§impl<T> FutureExt for T
impl<T> FutureExt for T
§fn with_context(self, otel_cx: Context) -> WithContext<Self>
fn with_context(self, otel_cx: Context) -> WithContext<Self>
§fn with_current_context(self) -> WithContext<Self>
fn with_current_context(self) -> WithContext<Self>
§impl<T> Identity for Twhere
T: ?Sized,
impl<T> Identity for Twhere
T: ?Sized,
§impl<T> Instrument for T
impl<T> Instrument for T
§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more§impl<T> Pointable for T
impl<T> Pointable for T
§impl<T> PolicyExt for Twhere
T: ?Sized,
impl<T> PolicyExt for Twhere
T: ?Sized,
§impl<T> ServiceExt for T
impl<T> ServiceExt for T
§fn map_response_body<F>(self, f: F) -> MapResponseBody<Self, F>where
Self: Sized,
fn map_response_body<F>(self, f: F) -> MapResponseBody<Self, F>where
Self: Sized,
Apply a transformation to the response body. Read more
§fn trace_for_http(self) -> Trace<Self, SharedClassifier<ServerErrorsAsFailures>>where
Self: Sized,
fn trace_for_http(self) -> Trace<Self, SharedClassifier<ServerErrorsAsFailures>>where
Self: Sized,
High level tracing that classifies responses using HTTP status codes. Read more
§fn trace_for_grpc(self) -> Trace<Self, SharedClassifier<GrpcErrorsAsFailures>>where
Self: Sized,
fn trace_for_grpc(self) -> Trace<Self, SharedClassifier<GrpcErrorsAsFailures>>where
Self: Sized,
High level tracing that classifies responses using gRPC headers. Read more