Hugging Face's logo

aws-neuron
/
zephyr-7b-beta-neuron

Text Generation
Transformers
PyTorch
English
mistral
Generated from Trainer
inferentia2
neuron
conversational
text-generation-inference
Model card Files
xet
Community
2
jburtoft commited on
Commit
93f2c05
·
verified ·
1 Parent(s): d6d7528

Update README.md

Browse files

Added redirect for Optimum support

Files changed (1) hide show
  1. README.md +4 -0
README.md CHANGED
@@ -30,6 +30,10 @@ prompt_template: '<|system|>
30
 
31
  '
32
  ---
 
 
 
 
33
  # Neuronx model for Zephyr-7b-beta
34
 
35
  This repository contains [AWS Inferentia2](https://aws.amazon.com/ec2/instance-types/inf2/) and [neuronx](https://awsdocs-neuron.readthedocs-hosted.com/en/latest/) compatible checkpoints for [HuggingFaceH4/zephyr-7b-beta](https://huggingface.co/HuggingFaceH4/zephyr-7b-beta).
 
30
 
31
  '
32
  ---
33
+ # Please read
34
+ Zephyr is now supported by optimum. See [aws-neuron/zephyr-7b-seqlen-2048-bs-4-cores-2](https://huggingface.co/aws-neuron/zephyr-7b-seqlen-2048-bs-4-cores-2) for an updated model.
35
+
36
+
37
  # Neuronx model for Zephyr-7b-beta
38
 
39
  This repository contains [AWS Inferentia2](https://aws.amazon.com/ec2/instance-types/inf2/) and [neuronx](https://awsdocs-neuron.readthedocs-hosted.com/en/latest/) compatible checkpoints for [HuggingFaceH4/zephyr-7b-beta](https://huggingface.co/HuggingFaceH4/zephyr-7b-beta).