Update README.md
Browse files
README.md
CHANGED
|
@@ -118,7 +118,7 @@ license_name: llama4
|
|
| 118 |
<p style="margin-bottom: 0;">
|
| 119 |
<em><a href="https://docs.unsloth.ai/basics/tutorial-how-to-run-and-fine-tune-llama-4">Read our Guide</a> to see how to Fine-tune & Run Llama 4 correctly.</em>
|
| 120 |
</p>
|
| 121 |
-
|
| 122 |
|MoE Bits|Type|Disk Size|HF Link|Accuracy|
|
| 123 |
|:-|:-|:-|:-|:-|
|
| 124 |
|1.78bit|IQ1\_S|**122GB**|[Link](https://huggingface.co/unsloth/Llama-4-Maverick-17B-128E-Instruct-GGUF/tree/main/UD-IQ1_S)|Ok|
|
|
@@ -128,6 +128,8 @@ license_name: llama4
|
|
| 128 |
|3.5-bit|Q3\_K\_XL|**193GB**|[Link](https://huggingface.co/unsloth/Llama-4-Maverick-17B-128E-Instruct-GGUF/tree/main/UD-Q3_K_XL)|Great|
|
| 129 |
|4.5-bit|Q4\_K\_XL|**243GB**|[Link](https://huggingface.co/unsloth/Llama-4-Maverick-17B-128E-Instruct-GGUF/tree/main/UD-Q4_K_XL)|Best|
|
| 130 |
|
|
|
|
|
|
|
| 131 |
**Chat template/prompt format:**
|
| 132 |
```
|
| 133 |
<|header_start|>user<|header_end|>\n\nWhat is 1+1?<|eot|><|header_start|>assistant<|header_end|>\n\n
|
|
|
|
| 118 |
<p style="margin-bottom: 0;">
|
| 119 |
<em><a href="https://docs.unsloth.ai/basics/tutorial-how-to-run-and-fine-tune-llama-4">Read our Guide</a> to see how to Fine-tune & Run Llama 4 correctly.</em>
|
| 120 |
</p>
|
| 121 |
+
|
| 122 |
|MoE Bits|Type|Disk Size|HF Link|Accuracy|
|
| 123 |
|:-|:-|:-|:-|:-|
|
| 124 |
|1.78bit|IQ1\_S|**122GB**|[Link](https://huggingface.co/unsloth/Llama-4-Maverick-17B-128E-Instruct-GGUF/tree/main/UD-IQ1_S)|Ok|
|
|
|
|
| 128 |
|3.5-bit|Q3\_K\_XL|**193GB**|[Link](https://huggingface.co/unsloth/Llama-4-Maverick-17B-128E-Instruct-GGUF/tree/main/UD-Q3_K_XL)|Great|
|
| 129 |
|4.5-bit|Q4\_K\_XL|**243GB**|[Link](https://huggingface.co/unsloth/Llama-4-Maverick-17B-128E-Instruct-GGUF/tree/main/UD-Q4_K_XL)|Best|
|
| 130 |
|
| 131 |
+
Currently text only is supported.
|
| 132 |
+
|
| 133 |
**Chat template/prompt format:**
|
| 134 |
```
|
| 135 |
<|header_start|>user<|header_end|>\n\nWhat is 1+1?<|eot|><|header_start|>assistant<|header_end|>\n\n
|