inference-optimization/gpt-oss-120b-ckpt4-speculator.eagle3
0.9B • Updated
• 29
Inference Optimization
community
AI & ML interests
None defined yet.
Recent Activity
View all activity
inference-optimization/gpt-oss-120b-ckpt3-speculator.eagle3
0.9B • Updated
• 45
inference-optimization/Qwen3-Coder-Next.w4a16
Text Generation • 12B • Updated
• 1.64k
inference-optimization/Qwen3-32B-Thinking-speculator.eagle3
Text Generation • 2B • Updated
• 29
inference-optimization/DeepSeek-R1-NVFP4-FP8-BLOCK
397B • Updated
• 52
inference-optimization/Llama-3.2-3B-Instruct_7_bits_mode_heuristic
3B • Updated
• 15
inference-optimization/Llama-3.2-3B-Instruct_7_bits_mode_noise
3B • Updated
• 13
inference-optimization/Llama-3.2-3B-Instruct_7_bits_mode_hybrid
3B • Updated
• 14
inference-optimization/Llama-3.2-3B-Instruct_6.5_bits_mode_heuristic
3B • Updated
• 15
inference-optimization/Llama-3.2-3B-Instruct_6.5_bits_mode_noise
3B • Updated
• 15
inference-optimization/Llama-3.2-3B-Instruct_6.5_bits_mode_hybrid
3B • Updated
• 14
inference-optimization/Llama-3.2-3B-Instruct_6_bits_mode_heuristic
3B • Updated
• 14
inference-optimization/Llama-3.2-3B-Instruct_6_bits_mode_noise
3B • Updated
• 15
inference-optimization/Llama-3.2-3B-Instruct_6_bits_mode_hybrid
3B • Updated
• 14
inference-optimization/Llama-3.2-3B-Instruct_5.5_bits_mode_heuristic
3B • Updated
• 14
inference-optimization/Llama-3.2-3B-Instruct_5.5_bits_mode_noise
3B • Updated
• 13
inference-optimization/Llama-3.2-3B-Instruct_5.5_bits_mode_hybrid
3B • Updated
• 15
inference-optimization/Llama-3.2-3B-Instruct_5_bits_mode_heuristic
3B • Updated
• 15
inference-optimization/Llama-3.2-3B-Instruct_5_bits_mode_noise
3B • Updated
• 14
inference-optimization/Llama-3.2-3B-Instruct_5_bits_mode_hybrid
3B • Updated
• 14
inference-optimization/Llama-3.2-1B-Instruct_7_bits_mode_noise
1B • Updated
• 31
inference-optimization/Llama-3.2-1B-Instruct_6.5_bits_mode_noise
1B • Updated
• 29
inference-optimization/Llama-3.2-1B-Instruct_6.5_bits_mode_hybrid
1B • Updated
• 31
inference-optimization/Llama-3.2-1B-Instruct_6_bits_mode_noise
1B • Updated
• 29
inference-optimization/Llama-3.2-1B-Instruct_6_bits_mode_hybrid
1B • Updated
• 31
inference-optimization/Llama-3.2-1B-Instruct_5.5_bits_mode_heuristic
1B • Updated
• 32
inference-optimization/Llama-3.2-1B-Instruct_5.5_bits_mode_noise
1B • Updated
• 30
inference-optimization/Llama-3.2-1B-Instruct_5.5_bits_mode_hybrid
1B • Updated
• 30
inference-optimization/Llama-3.2-1B-Instruct_5_bits_mode_heuristic
1B • Updated
• 28
inference-optimization/Llama-3.2-1B-Instruct_5_bits_mode_noise
1B • Updated
• 31