INT4 LLMs for vLLM
Collection
Accurate INT4 quantized models by Neural Magic, ready for use with vLLM! • 16 items • Updated
• 12
Sean Bayly
swtb
AI & ML interests
Computer Vision, NLP, Medical Imaging
Recent Activity
new activity
3 days ago
Qwen/Qwen3.5-35B-A3B-GPTQ-Int4:Smaller model quants new activity
about 1 month ago
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-NVFP4:Tool use crash the model new activity
about 1 month ago
nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-FP8:NVFP4 support Organizations
upvoted a collection 7 months ago