Update README.md

README.md

@@ -11,4 +11,35 @@ tags:
 ---
 # **Llama-3.2-3B-Math-Oct**
 
-Llama-3.2-3B-Math-Oct is a math role-play model designed to solve mathematical problems and enhance the reasoning capabilities of 3B-parameter models. These models have proven highly effective in context understanding, reasoning, and mathematical problem-solving, based on the Llama 3.2 architecture.
+Llama-3.2-3B-Math-Oct is a math role-play model designed to solve mathematical problems and enhance the reasoning capabilities of 3B-parameter models. These models have proven highly effective in context understanding, reasoning, and mathematical problem-solving, based on the Llama 3.2 architecture.
+
+
+# **Use with transformers**
+
+Starting with `transformers >= 4.43.0` onward, you can run conversational inference using the Transformers `pipeline` abstraction or by leveraging the Auto classes with the `generate()` function.
+
+Make sure to update your transformers installation via `pip install --upgrade transformers`.
+
+```python
+import torch
+from transformers import pipeline
+
+model_id = "meta-llama/Llama-3.2-3B-Instruct"
+pipe = pipeline(
+    "text-generation",
+    model=model_id,
+    torch_dtype=torch.bfloat16,
+    device_map="auto",
+)
+messages = [
+    {"role": "system", "content": "You are a pirate chatbot who always responds in pirate speak!"},
+    {"role": "user", "content": "Who are you?"},
+]
+outputs = pipe(
+    messages,
+    max_new_tokens=256,
+)
+print(outputs[0]["generated_text"][-1])
+```
+
+Note: You can also find detailed recipes on how to use the model locally, with `torch.compile()`, assisted generations, quantised and more at [`huggingface-llama-recipes`](https://github.com/huggingface/huggingface-llama-recipes)