Quantizing Large Language Models for Code Generation: A Differentiated Replication
Paper • 2503.07103 • Published • 8
Quantization for Code Generation
Collection of AQLM quantized models from the paper "Quantizing Large Language Models for Code Generation: A Differentiated Replication"
-
-
Devy1/CodeLlama-7b-hf-AQLM-8bit-rnd-4x15
Text Generation • 4B • Updated • 3 -
Devy1/CodeLlama-7b-hf-AQLM-4bit-rnd-2x15
Text Generation • 2B • Updated -
Devy1/CodeLlama-7b-hf-AQLM-3bit-rnd-2x12
Text Generation • 2B • Updated -
Devy1/CodeLlama-7b-hf-AQLM-3bit-rnd-finetuned-2x12
Text Generation • 2B • Updated • 1 -
Devy1/CodeLlama-7b-hf-AQLM-2bit-rnd-1x15
Text Generation • 1B • Updated -
Devy1/CodeLlama-7b-hf-AQLM-2bit-rnd-finetuned-1x15
Text Generation • 1B • Updated -
Devy1/DeepSeek-Coder-6.7b-base-AQLM-8bit-rnd-4x15
Text Generation • 4B • Updated • 6 -
Devy1/DeepSeek-Coder-6.7b-base-AQLM-4bit-rnd-2x15
Text Generation • 2B • Updated • 4 -
Devy1/DeepSeek-Coder-6.7b-base-AQLM-3bit-rnd-2x12
Text Generation • 2B • Updated -
Devy1/DeepSeek-Coder-6.7b-base-AQLM-3bit-rnd-finetuned-2x12
Text Generation • 2B • Updated -
Devy1/DeepSeek-Coder-6.7b-base-AQLM-2bit-rnd-1x15
Text Generation • 1B • Updated • 1 -
Devy1/DeepSeek-Coder-6.7b-base-AQLM-2bit-rnd-finetuned-1x15
Text Generation • 1B • Updated • 1 -
Devy1/CodeLlama-7b-hf-AQLM-8bit-mixed-4x15
Text Generation • 4B • Updated -
Devy1/CodeLlama-7b-hf-AQLM-8bit-code-4x15
Text Generation • 4B • Updated -
Devy1/CodeLlama-7b-hf-AQLM-4bit-mixed-2x15
Text Generation • 2B • Updated • 28 -
Devy1/CodeLlama-7b-hf-AQLM-4bit-code-2x15
Text Generation • 2B • Updated • 2 -
Devy1/CodeLlama-7b-hf-AQLM-3bit-mixed-2x12
Text Generation • 2B • Updated • 6 -
Devy1/CodeLlama-7b-hf-AQLM-3bit-mixed-finetuned-2x12
Text Generation • 2B • Updated • 1 -
Devy1/CodeLlama-7b-hf-AQLM-3bit-code-2x12
Text Generation • 2B • Updated -
Devy1/CodeLlama-7b-hf-AQLM-3bit-code-finetuned-2x12
Text Generation • 2B • Updated -
Devy1/CodeLlama-7b-hf-AQLM-2bit-code-1x15
Text Generation • 1B • Updated -
Devy1/CodeLlama-7b-hf-AQLM-2bit-code-finetuned-1x15
Text Generation • 1B • Updated -
Devy1/DeepSeek-Coder-6.7b-base-AQLM-8bit-mixed-4x15
Text Generation • 4B • Updated -
Devy1/DeepSeek-Coder-6.7b-base-AQLM-8bit-code-4x15
Text Generation • 4B • Updated -
Devy1/DeepSeek-Coder-6.7b-base-AQLM-4bit-mixed-2x15
Text Generation • 2B • Updated -
Devy1/DeepSeek-Coder-6.7b-base-AQLM-4bit-code-2x15
Text Generation • 2B • Updated • 1 -
Devy1/DeepSeek-Coder-6.7b-base-AQLM-3bit-mixed-2x12
Text Generation • 2B • Updated -
Devy1/DeepSeek-Coder-6.7b-base-AQLM-3bit-mixed-finetuned-2x12
Text Generation • 2B • Updated • 1 -
Devy1/DeepSeek-Coder-6.7b-base-AQLM-3bit-code-2x12
Text Generation • 2B • Updated -
Devy1/DeepSeek-Coder-6.7b-base-AQLM-3bit-code-finetuned-2x12
Text Generation • 2B • Updated -
Devy1/DeepSeek-Coder-6.7b-base-AQLM-2bit-code-1x15
Text Generation • 1B • Updated • 4 -
Devy1/DeepSeek-Coder-6.7b-base-AQLM-2bit-code-finetuned-1x15
Text Generation • 1B • Updated • 4 -
Devy1/CodeLlama-7b-hf-AQLM-2bit-mixed-1x15
Text Generation • 1B • Updated • 4 -
Devy1/CodeLlama-7b-hf-AQLM-2bit-mixed-finetuned-1x15
Text Generation • 1B • Updated • 3 -
Devy1/CodeLlama-13b-hf-AQLM-2bit-mixed-1x15
Text Generation • 2B • Updated -
Devy1/CodeLlama-13b-hf-AQLM-2bit-mixed-finetuned-1x15
Text Generation • 2B • Updated • 1 -
Devy1/CodeLlama-34b-hf-AQLM-2bit-mixed-1x15
Text Generation • 5B • Updated -
Devy1/CodeLlama-34b-hf-AQLM-2bit-mixed-finetuned-1x15
Text Generation • 5B • Updated • 2 -
Devy1/DeepSeek-Coder-1.3b-base-AQLM-2bit-mixed-1x14
Text Generation • 0.3B • Updated • 2 -
Devy1/DeepSeek-Coder-1.3b-base-AQLM-2bit-mixed-finetuned-1x14
Text Generation • 0.3B • Updated • 2 -
Devy1/DeepSeek-Coder-6.7b-base-AQLM-2bit-mixed-1x15
Text Generation • 1B • Updated • 4 -
Devy1/DeepSeek-Coder-6.7b-base-AQLM-2bit-mixed-finetuned-1x15
Text Generation • 1B • Updated • 3 -
Devy1/DeepSeek-Coder-33b-base-AQLM-2bit-mixed-1x15
Text Generation • 5B • Updated • 2 -
Devy1/DeepSeek-Coder-33b-base-AQLM-2bit-mixed-finetuned-1x15
Text Generation • 5B • Updated • 3