RedHatAI/Llama-3.1-8B-Instruct
Text Generation
• 8B • Updated
• 1.27k
• • 5
RedHatAI/DeepSeek-R1-quantized.w4a16
Text Generation
• 104B • Updated
• 40
• 7
RedHatAI/Meta-Llama-3-8B-Instruct-FP8-KV
Text Generation
• 8B • Updated
• 13k
• • 8
RedHatAI/Qwen3-4B-FP8-dynamic
Text Generation
• 4B • Updated
• 1.84k
• 1
RedHatAI/Devstral-Small-2507-quantized.w8a8
Text Generation
• 24B • Updated
• 43
• 1
RedHatAI/Devstral-Small-2507-quantized.w4a16
Text Generation
• 4B • Updated
• 8
• 2
RedHatAI/Devstral-Small-2507-FP8-Dynamic
Text Generation
• 24B • Updated
• 32
• 4
RedHatAI/gpt-oss-120b-FP8-dynamic
Text Generation
• 117B • Updated
• 1.73k
• 12
RedHatAI/SmolLM3-3B-FP8-dynamic
Text Generation
• 3B • Updated
• 522
• 1
RedHatAI/gemma-3n-E2B-it-quantized.w4a16
Image-Text-to-Text
• 4B • Updated
• 83
• 1
RedHatAI/gemma-3n-E2B-it-quantized.w8a8
Image-Text-to-Text
• 5B • Updated
• 7
• 2
RedHatAI/gemma-3n-E4B-it-quantized.w4a16
Image-Text-to-Text
• 4B • Updated
• 203
RedHatAI/gemma-3n-E4B-it-quantized.w8a8
Image-Text-to-Text
• 8B • Updated
• 13
RedHatAI/gemma-3n-E2B-it-FP8-dynamic
Image-Text-to-Text
• 5B • Updated
• 194
• 2
RedHatAI/SmolLM3-3B-quantized.w4a16
0.9B • Updated
• 48
• 1
RedHatAI/Qwen2.5-VL-72B-Instruct-quantized.w4a16
Image-Text-to-Text
• 13B • Updated
• 440
• 8
RedHatAI/Llama-3.2-3B-Instruct-quantized.w8a8
Text Generation
• 4B • Updated
• 405
• 1
RedHatAI/Mistral-Small-3.2-24B-Instruct-2506-FP8
Image-Text-to-Text
• Updated
• 510
• 7
RedHatAI/ToolACE-2-Llama-3.1-8B-FP8-dynamic
RedHatAI/watt-tool-8B-FP8-dynamic
8B • Updated
• 1
RedHatAI/Qwen3-0.6B-FP8-BLOCK
0.6B • Updated
• 6.55k
RedHatAI/Qwen3-32B-NVFP4A16
Text Generation
• 19B • Updated
• 317
• 2
RedHatAI/Llama-3.1-70B-Instruct-NVFP4A16
Text Generation
• 41B • Updated
• 1
RedHatAI/Llama-4-Maverick-17B-128E-Instruct-quantized.w4a16
Image-Text-to-Text
• 59B • Updated
• 199
• 1
RedHatAI/Magistral-Small-2506-FP8
Updated
• 21.6k
• 6
RedHatAI/gemma-3-4b-it-quantized.w8a8
Image-Text-to-Text
• 5B • Updated
• 473
• 1
RedHatAI/gemma-3-12b-it-quantized.w8a8
Image-Text-to-Text
• 13B • Updated
• 5.46k
• 3
RedHatAI/gemma-3-27b-it-quantized.w8a8
Image-Text-to-Text
• 29B • Updated
• 1.31k
• 7