pub enum ModelArchitecture {
Show 13 variants
Llama {
version: u8,
},
Gemma,
Qwen {
version: u8,
is_moe: bool,
context_length: usize,
},
Phi {
version: u8,
},
Mistral,
Starcoder,
Falcon,
GPTNeoX,
GPTOSS {
total_params_b: u16,
active_params_b: f32,
num_experts: usize,
experts_per_token: usize,
},
GPTJ,
Janus {
base_architecture: Box<ModelArchitecture>,
vision_encoder: VisionEncoderType,
has_generation: bool,
},
Qwen3_5,
Custom(String),
}Expand description
Supported model architectures
Variants§
Llama
Meta’s Llama family (1/2/3)
Gemma
Google’s Gemma
Qwen
Alibaba’s Qwen (including Qwen3 with GQA and sparse attention)
Fields
Phi
Microsoft’s Phi
Mistral
Mistral AI models
Starcoder
BigCode’s Starcoder
Falcon
TII’s Falcon
GPTNeoX
EleutherAI’s GPT-NeoX
GPTOSS
OpenAI GPT-OSS (120B/20B MoE models)
Fields
GPTJ
GPT-J (EleutherAI’s 6B model)
Janus
Janus multimodal vision-language model
Fields
§
base_architecture: Box<ModelArchitecture>Base language model architecture (usually Llama)
§
vision_encoder: VisionEncoderTypeType of vision encoder
Qwen3_5
Alibaba Qwen3.5 hybrid GatedDeltaNet/full-attention (dense and MoE variants)
Custom(String)
Custom/unknown architecture
Implementations§
Source§impl ModelArchitecture
impl ModelArchitecture
Sourcepub fn supports_mqa(&self) -> bool
pub fn supports_mqa(&self) -> bool
Check if architecture supports multi-query attention
Sourcepub fn supports_gqa(&self) -> bool
pub fn supports_gqa(&self) -> bool
Check if architecture supports grouped-query attention
Sourcepub fn supports_moe(&self) -> bool
pub fn supports_moe(&self) -> bool
Check if architecture uses Mixture of Experts
Sourcepub fn supports_sparse_attention(&self) -> bool
pub fn supports_sparse_attention(&self) -> bool
Check if architecture supports sparse attention
Trait Implementations§
Source§impl Clone for ModelArchitecture
impl Clone for ModelArchitecture
Source§fn clone(&self) -> ModelArchitecture
fn clone(&self) -> ModelArchitecture
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for ModelArchitecture
impl Debug for ModelArchitecture
Source§impl PartialEq for ModelArchitecture
impl PartialEq for ModelArchitecture
Source§fn eq(&self, other: &ModelArchitecture) -> bool
fn eq(&self, other: &ModelArchitecture) -> bool
Tests for
self and other values to be equal, and is used by ==.impl StructuralPartialEq for ModelArchitecture
Auto Trait Implementations§
impl Freeze for ModelArchitecture
impl RefUnwindSafe for ModelArchitecture
impl Send for ModelArchitecture
impl Sync for ModelArchitecture
impl Unpin for ModelArchitecture
impl UnsafeUnpin for ModelArchitecture
impl UnwindSafe for ModelArchitecture
Blanket Implementations§
§impl<T> AnySync for T
impl<T> AnySync for T
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
§impl<T> FutureExt for T
impl<T> FutureExt for T
§fn with_context(self, otel_cx: Context) -> WithContext<Self>
fn with_context(self, otel_cx: Context) -> WithContext<Self>
§fn with_current_context(self) -> WithContext<Self>
fn with_current_context(self) -> WithContext<Self>
§impl<T> Identity for Twhere
T: ?Sized,
impl<T> Identity for Twhere
T: ?Sized,
§impl<T> Instrument for T
impl<T> Instrument for T
§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more§impl<T> Pointable for T
impl<T> Pointable for T
§impl<T> PolicyExt for Twhere
T: ?Sized,
impl<T> PolicyExt for Twhere
T: ?Sized,
§impl<T> ServiceExt for T
impl<T> ServiceExt for T
§fn map_response_body<F>(self, f: F) -> MapResponseBody<Self, F>where
Self: Sized,
fn map_response_body<F>(self, f: F) -> MapResponseBody<Self, F>where
Self: Sized,
Apply a transformation to the response body. Read more
§fn trace_for_http(self) -> Trace<Self, SharedClassifier<ServerErrorsAsFailures>>where
Self: Sized,
fn trace_for_http(self) -> Trace<Self, SharedClassifier<ServerErrorsAsFailures>>where
Self: Sized,
High level tracing that classifies responses using HTTP status codes. Read more
§fn trace_for_grpc(self) -> Trace<Self, SharedClassifier<GrpcErrorsAsFailures>>where
Self: Sized,
fn trace_for_grpc(self) -> Trace<Self, SharedClassifier<GrpcErrorsAsFailures>>where
Self: Sized,
High level tracing that classifies responses using gRPC headers. Read more