Collection of Quantized Models for MoE
Krishna Teja Chitty-Venkata
krishnateja95
AI & ML interests
LLM Optimization, Neural Architecture Search, Quantization, Pruning
Recent Activity
updated
a model
1 day ago
inference-optimization/Meta-Llama-3.1-8B-Instruct-NVFP4-FP8-Dynamic_6.5-bits
updated
a model
1 day ago
inference-optimization/Meta-Llama-3.1-8B-Instruct-NVFP4-FP8-Dynamic_6.25-bits
updated
a model
1 day ago
inference-optimization/Meta-Llama-3.1-8B-Instruct-NVFP4-FP8-Dynamic_6.0-bits
Organizations
models
57
krishnateja95/llama_3_2_11b_lora_nas_vsr_qkvogudfc_64
Updated
krishnateja95/llama_3_2_11b_lora_nas_vsr_gud_64
Updated
•
2
krishnateja95/llama_3_2_11b_lora_nas_vsr_gud_64_searched
Updated
•
1
krishnateja95/llama_3_2_11b_lora_nas_vsr_qkvogudfc_64_searched
Updated
•
1
krishnateja95/llama_3_2_11b_lora_nas_vsr_qk_64
Updated
krishnateja95/llama_3_2_11b_lora_nas_vsr_qk_64_searched
Updated
•
1
krishnateja95/llama_3_2_11b_lora_nas_hitab_qkvogudfc_64
Updated
•
1
krishnateja95/llama_3_2_11b_lora_nas_hitab_qkvogudfc_64_searched
Updated
krishnateja95/llama_3_2_11b_lora_nas_hitab_gud_64
Updated
krishnateja95/llama_3_2_11b_lora_nas_hitab_qk_64
Updated
•
5