Custom GGUF quants of Meta’s Llama-3.2-Instruct's finetunes, where the Output Tensors are quantized to Q8_0 or F32 and the Embeddings are kept @F32
Joseph
Joseph717171
AI & ML interests
None yet
Recent Activity
liked
a model
about 3 hours ago
NousResearch/nomos-1
liked
a model
4 days ago
EssentialAI/rnj-1-instruct
liked
a model
7 days ago
unsloth/Ministral-3-14B-Instruct-2512-GGUF
Organizations
Custom GGUF quants of Llama-3.1-8B-Instruct fine-tunes, where the Output Tensors are quantized to Q8_0 while the Embeddings are kept at F32. 🧠🔥🚀
-
Joseph717171/DeepHermes-3-Llama-3.1-8B-Preview-OQ8_0-F32.EF32.IQ4_K-Q8_0-GGUF
8B • Updated • 256 • 1 -
Joseph717171/Hermes-3-Llama-3.1-8B-OQ8_0-F32.EF32.IQ4_K-Q8_0-GGUF
8B • Updated • 371 • 2 -
Joseph717171/Llama-3.1-SuperNova-Lite-8.0B-OQ8_0-F32.EF32.IQ4_K-Q8_0-GGUF
8B • Updated • 430 • 2 -
Joseph717171/Hermes-3-Llama-3.1-8B_TIES_with_base_Embeds_Initialized_dtypeF32-OQ8_0-F32.EF32.IQ4_K-Q8_0-GGUF
8B • Updated • 29 • 1
Custom GGUF quants of Meta’s Llama-3.2-Instruct's finetunes, where the Output Tensors are quantized to Q8_0 or F32 and the Embeddings are kept @F32
Custom GGUF quants of Llama-3.1-8B-Instruct fine-tunes, where the Output Tensors are quantized to Q8_0 while the Embeddings are kept at F32. 🧠🔥🚀
-
Joseph717171/DeepHermes-3-Llama-3.1-8B-Preview-OQ8_0-F32.EF32.IQ4_K-Q8_0-GGUF
8B • Updated • 256 • 1 -
Joseph717171/Hermes-3-Llama-3.1-8B-OQ8_0-F32.EF32.IQ4_K-Q8_0-GGUF
8B • Updated • 371 • 2 -
Joseph717171/Llama-3.1-SuperNova-Lite-8.0B-OQ8_0-F32.EF32.IQ4_K-Q8_0-GGUF
8B • Updated • 430 • 2 -
Joseph717171/Hermes-3-Llama-3.1-8B_TIES_with_base_Embeds_Initialized_dtypeF32-OQ8_0-F32.EF32.IQ4_K-Q8_0-GGUF
8B • Updated • 29 • 1
models
39
Joseph717171/Imatrices
Updated
•
6
Joseph717171/Gpt-OSS-20B-MXFP4-GGUF
21B
•
Updated
•
71
•
1
Joseph717171/Modelz
15B
•
Updated
•
372
•
4
Joseph717171/Jinx-gpt-OSS-20B-MXFP4-GGUF
21B
•
Updated
•
211
•
6
Joseph717171/Gpt-OSS-20B-BF16-Unquantized
21B
•
Updated
•
27
•
1
Joseph717171/Llama-3.1-8B-Instruct-UD-OQ8_0-F32.EQ8_0-F32.IQ4_K-Q8_0-GGUF
8B
•
Updated
•
409
•
2
Joseph717171/Llama-3.1-SuperNova-Lite-8.0B-OQ8_0-F32.EF32.IQ4_K-Q8_0-GGUF
8B
•
Updated
•
430
•
2
Joseph717171/DeepHermes-3-Llama-3.1-8B-Preview-OQ8_0-F32.EF32.IQ4_K-Q8_0-GGUF
8B
•
Updated
•
256
•
1
Joseph717171/DeepHermes-3-Mistral-24B-Preview-OQ8_0-F32.EQ8_0-F32.IQ4_K-Q8_0-GGUF
24B
•
Updated
•
208
•
1
Joseph717171/DeepHermes-3-Llama-3.2-3B-Preview-OQ8_0-F32.EQ8_0-F32.IQ4_K-Q8_0-GGUF
3B
•
Updated
•
153
•
1
datasets
0
None public yet