embedl/Cosmos-Reason2-2B-W4A16-Edge2-FlashHead
Image-Text-to-Text ā¢ 2B ā¢ Updated ā¢ 1.09k ā¢ 7
Jonna Matthiesen
JonnaMat
AI & ML interests
None yet
Recent Activity
liked a model 5 days ago
embedl/Cosmos-Reason2-2B-W4A16-Edge2-FlashHead posted an update 5 days ago
ā” FlashHead benchmarks for Llama 3.2, Gemma 3, and Qwen3 are now on https://huggingface.co/spaces/embedl/Edge-Inference-Benchmarks !
These are some of the models used in the FlashHead paper - now easier to explore and compare interactively.
š Jetson AGX Thor (tok/s, batch=1):
- Llama-3.2-1B: 77 ā 285 (FlashHead+W4A16, 3.7x)
- Llama-3.2-3B: 34 ā 112 (3.3x)
- Gemma-3-1B: 79 ā 153 (1.9x)
- Qwen3-1.7B: 49 ā 189 (3.8x)
- Qwen3-0.6B: 140 ā 177 (1.3x)
ā
Accuracy matches baseline on MMLU-Pro, IFEval, BBH, TruthfulQA, GSM8K.
updated a model 5 days ago
embedl/Qwen3-1.7B-FlashHead-W4A16Organizations
liked a
model 5 days ago
posted an update 5 days ago
Post
92
ā” FlashHead benchmarks for Llama 3.2, Gemma 3, and Qwen3 are now on embedl/Edge-Inference-Benchmarks !
These are some of the models used in the FlashHead paper - now easier to explore and compare interactively.
š Jetson AGX Thor (tok/s, batch=1):
- Llama-3.2-1B: 77 ā 285 (FlashHead+W4A16, 3.7x)
- Llama-3.2-3B: 34 ā 112 (3.3x)
- Gemma-3-1B: 79 ā 153 (1.9x)
- Qwen3-1.7B: 49 ā 189 (3.8x)
- Qwen3-0.6B: 140 ā 177 (1.3x)
ā Accuracy matches baseline on MMLU-Pro, IFEval, BBH, TruthfulQA, GSM8K.
These are some of the models used in the FlashHead paper - now easier to explore and compare interactively.
š Jetson AGX Thor (tok/s, batch=1):
- Llama-3.2-1B: 77 ā 285 (FlashHead+W4A16, 3.7x)
- Llama-3.2-3B: 34 ā 112 (3.3x)
- Gemma-3-1B: 79 ā 153 (1.9x)
- Qwen3-1.7B: 49 ā 189 (3.8x)
- Qwen3-0.6B: 140 ā 177 (1.3x)
ā Accuracy matches baseline on MMLU-Pro, IFEval, BBH, TruthfulQA, GSM8K.
updated 11
models 5 days ago
embedl/Qwen3-1.7B-FlashHead-W4A16
2B ā¢ Updated ā¢ 140 ā¢ 3
embedl/gemma-3-1b-it-FlashHead-W4A16
1B ā¢ Updated ā¢ 148 ā¢ 3
embedl/Llama-3.2-3B-Instruct-FlashHead-W4A16
4B ā¢ Updated ā¢ 100 ā¢ 4
embedl/Llama-3.2-1B-Instruct-FlashHead-W4A16
2B ā¢ Updated ā¢ 81 ā¢ 6
embedl/Cosmos-Reason2-2B-W4A16-Edge2-FlashHead
Image-Text-to-Text ā¢ 2B ā¢ Updated ā¢ 1.09k ā¢ 7
embedl/Qwen3-1.7B-FlashHead
2B ā¢ Updated ā¢ 113 ā¢ 3
embedl/Qwen3-0.6B-FlashHead
0.6B ā¢ Updated ā¢ 85 ā¢ 4
embedl/gemma-3-270m-it-FlashHead
0.3B ā¢ Updated ā¢ 212 ā¢ 3
embedl/gemma-3-1b-it-FlashHead
1.0B ā¢ Updated ā¢ 138 ā¢ 3
embedl/Llama-3.2-3B-Instruct-FlashHead
3B ā¢ Updated ā¢ 83 ā¢ 4
embedl/Llama-3.2-1B-Instruct-FlashHead
1B ā¢ Updated ā¢ 72 ā¢ 4
updated a
dataset 6 days ago
updated a
Space 6 days ago