Instructions to use DISLab/Gen-8B-R2 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use DISLab/Gen-8B-R2 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("question-answering", model="DISLab/Gen-8B-R2")# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("DISLab/Gen-8B-R2") model = AutoModelForCausalLM.from_pretrained("DISLab/Gen-8B-R2") - Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -75,14 +75,9 @@ Note that this prompt outputs both extracted relevant sentences and the answer t
|
|
| 75 |
The output follows a consistent format as seen in an example below.
|
| 76 |
|
| 77 |
```
|
| 78 |
-
|
| 79 |
-
- The estimated number of deaths is 150-300,000, mainly Jews.
|
| 80 |
-
|
| 81 |
-
Answer: The estimated number of deaths at Chelmno is 150-300,000, mainly Jews.
|
| 82 |
```
|
| 83 |
|
| 84 |
-
The number of extracted sentences vary depending on the QA.
|
| 85 |
-
|
| 86 |
### Recommended Generation Parameters
|
| 87 |
|
| 88 |
```python
|
|
|
|
| 75 |
The output follows a consistent format as seen in an example below.
|
| 76 |
|
| 77 |
```
|
| 78 |
+
The estimated number of deaths at Chelmno is 150-300,000, mainly Jews.
|
|
|
|
|
|
|
|
|
|
| 79 |
```
|
| 80 |
|
|
|
|
|
|
|
| 81 |
### Recommended Generation Parameters
|
| 82 |
|
| 83 |
```python
|