Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
7 changes: 4 additions & 3 deletions ARCHITECTURE.md
Original file line number Diff line number Diff line change
Expand Up @@ -31,6 +31,7 @@ which models are supported on Spyre.
| Gemma 4 12B | gemma4\_unified | 256 / 512 | 128 / 256 | Yes | Yes | Yes | Yes |
| Gemma 4 12B Base | gemma4\_unified | 256 / 512 | 128 / 256 | Yes | Yes | Yes | Yes |
| Gemma 4 31B | gemma4 | 256 / 512 | 128 / 256 | Yes | Yes | Yes | Yes |
| Gemma 4 31B Instruct | gemma4 | 256 / 512 | 128 / 256 | Yes | Yes | Yes | Yes |
| Gemma 3 1B | gemma3\_text | 256 | 128 | Yes | Yes | Yes | Yes |
| GPT-2 124M | gpt2 | 64 | n/a (no RoPE) | Yes | Yes | Yes | Yes |
| GPT-Neo 125M | gpt_neo | 64 | n/a (no RoPE) | Yes | Yes | Yes | Yes |
Expand Down Expand Up @@ -112,8 +113,8 @@ single-token decode path (seq_len=1), not an adapter issue.
> adapter or verify a checkpoint, update *only* this file (and the badge
> counts in README.md, noted below).

**Coverage:** 27 adapters · 46 verified checkpoints · 100+ compatible models.
The 46 verified rows are 29 generative + 13 embedding + 4 vision-language (see the
**Coverage:** 27 adapters · 47 verified checkpoints · 100+ compatible models.
The 47 verified rows are 30 generative + 13 embedding + 4 vision-language (see the
Verified Checkpoints tables above). `hf_siglip_vision` and `hf_pixtral_vision` are
vision-tower components used by VLM adapters rather than standalone model adapters.
Granite Vision 4.1 is verified both as a text backbone (generative) and as a full VLM.
Expand Down Expand Up @@ -141,7 +142,7 @@ pattern, norms, and weight layout.
| hf\_phi3.py | phi3 | 1 | Phi-3 mini 4k/128k, Phi-3 small 8k |
| hf\_granitemoehybrid.py | granitemoehybrid | 2 | Granite 4.0 Micro |
| hf\_smollm3.py | smollm3 | 1 | — |
| hf\_gemma4.py | gemma4\_unified / gemma4 (dense) | 3 | Not E2B/E4B (PLE) or 26B-A4B (MoE). |
| hf\_gemma4.py | gemma4\_unified / gemma4 (dense) | 4 | Not E2B/E4B (PLE) or 26B-A4B (MoE). |
| hf\_gemma4\_mm.py | gemma4\_unified (multimodal) | 1 | Gemma 4 31B (dense unified VLM). Not E2B/E4B (PLE) or 26B-A4B (MoE). |
| hf\_gemma3.py | gemma3\_text / gemma3 (dense) | 2 | Gemma 3 4B/12B/27B (text decoder of the multimodal checkpoints); EmbeddingGemma (bidirectional embedder). Not Gemma 3n (PLE). |
| hf\_olmo.py | olmo | 1 | OLMo 7B |
Expand Down
2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -14,7 +14,7 @@ from `transformers`.

## Supported Models

**30 adapters · 46 verified checkpoints · 100+ compatible models**
**30 adapters · 47 verified checkpoints · 100+ compatible models**

Coverage spans **generative** (causal-LM), **embedding** (sentence-transformers),
**vision-language** (image→text), and **speculative-decoding drafter** models — from
Expand Down
1 change: 1 addition & 0 deletions hf_adapters/auto_spyre_model.py
Original file line number Diff line number Diff line change
Expand Up @@ -187,6 +187,7 @@
"google/gemma-4-12b": torch.bfloat16,
"google/gemma-4-12B-it": torch.bfloat16,
"google/gemma-4-31b": torch.bfloat16,
"google/gemma-4-31b-it": torch.bfloat16,
"ibm-granite/granite-4.0-1b-base": torch.float32,
"ibm-granite/granite-4.0-1b": torch.float32,
}
Expand Down
8 changes: 8 additions & 0 deletions tests/model_registry.py
Original file line number Diff line number Diff line change
Expand Up @@ -240,6 +240,14 @@ def _include_gated() -> bool:
"dtype": "bfloat16",
"is_gated": True,
},
"gemma4_31b_it": {
"name": "Gemma 4 31B Instruct",
"path": "google/gemma-4-31b-it",
"adapter": "hf_gemma4.py",
"size": "31b",
"dtype": "bfloat16",
"is_gated": True,
},
# DSpark speculative-decoding drafters (block proposers). kind="dspark_draft"
# keeps them out of the generate-based causal-LM harnesses (see CAUSAL_PATHS);
# tests/spyre/test_dspark_draft_spyre.py exercises the block-propose path.
Expand Down
Loading