Kooten
/

BagelMIsteryTour-v2-8x7B-3.5bpw-exl2

Text Generation

text-generation-inference

Model card Files Files and versions

vram

#2

by rakmik - opened Mar 20, 2025

rakmik

Mar 20, 2025

requirements vram

How many GB of the model does it need vram?

Kooten

Owner Mar 22, 2025

At 8192 ctx it will fit on a 24GB gpu

rakmik

Mar 23, 2025

thank you

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment