jeanlee/kmhas_korean_hate_speech
Viewer • Updated • 110k • 243 • 23
How to use Now100/kmhas_electra_binary with Transformers:
# Use a pipeline as a high-level helper
from transformers import pipeline
pipe = pipeline("text-classification", model="Now100/kmhas_electra_binary") # Load model directly
from transformers import AutoTokenizer, AutoModelForSequenceClassification
tokenizer = AutoTokenizer.from_pretrained("Now100/kmhas_electra_binary")
model = AutoModelForSequenceClassification.from_pretrained("Now100/kmhas_electra_binary")# Load model directly
from transformers import AutoTokenizer, AutoModelForSequenceClassification
tokenizer = AutoTokenizer.from_pretrained("Now100/kmhas_electra_binary")
model = AutoModelForSequenceClassification.from_pretrained("Now100/kmhas_electra_binary")한국어 문장에서 혐오 발언 여부를 분류하는 이진 텍스트 분류 모델.
기반 모델: beomi/KcELECTRA-base-v2022
학습에는 KMHAS 한국어 혐오 표현 데이터셋 사용
beomi/KcELECTRA-base-v2022| Metric | Value |
|---|---|
| Accuracy | 0.91 |
| Precision | 0.91 |
| Recall | 0.91 |
| F1-score | 0.91 |
클래스별 성능:
from transformers import AutoTokenizer, AutoModelForSequenceClassification
model = AutoModelForSequenceClassification.from_pretrained("now100/kmhas_electra_binary")
tokenizer = AutoTokenizer.from_pretrained("now100/kmhas_electra_binary")
text = "개새끼들이 나라를 망치고 있다."
inputs = tokenizer(text, return_tensors="pt")
outputs = model(**inputs)
label = outputs.logits.argmax(dim=1).item()
print("예측 결과:", "non-hate" if label == 1 else "hate")
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-classification", model="Now100/kmhas_electra_binary")