BioMistral/BioMistral-7B-AWQ-QGS128-W4-GEMM
Text Generation • 7B • Updated • 259 • 6
Models Quantization
-
-
BioMistral/BioMistral-7B-AWQ-QGS128-W4-GEMV
Text Generation • 7B • Updated • 20 • 1 -
BioMistral/BioMistral-7B-SLERP-AWQ-QGS128-W4-GEMM
Text Generation • 7B • Updated • 1 • 1 -
BioMistral/BioMistral-7B-TIES-AWQ-QGS128-W4-GEMM
Text Generation • 7B • Updated • 4 -
BioMistral/BioMistral-7B-DARE-AWQ-QGS128-W4-GEMM
Text Generation • 7B • Updated • 14 • 3 -
BioMistral/BioMistral-7B-BnB.8
Text Generation • 7B • Updated • 14 -
BioMistral/BioMistral-7B-BnB.4
Text Generation • 7B • Updated • 13 • 1 -
BioMistral/BioMistral-7B-Zephyr-Beta-SLERP-AWQ-QGS128-W4-GEMM
Text Generation • 7B • Updated • 3 -
BioMistral/BioMistral-7B-GGUF
Text Generation • 7B • Updated • 768 • 20 -
BioMistral/BioMistral-7B-DARE-GGUF
Text Generation • 7B • Updated • 496 • 10