Amazing model. FP8 Support please.

#10
by rjmehta - opened

Thanks. FP8 quant will help a lot.

JD Open Source org

The fp8 version will be released soon. Stay tuned.

JD Open Source org

Hi @rjmehta , the fp8 version is ready. Hope you enjoy it!

Mingke977 changed discussion status to closed

Sign up or log in to comment