Edit Models filters

Model Tree

meta-llama/Llama-3.1-8B-Instruct

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

409

Full-text search

Active filters: llama.cpp, meta-llama/Llama-3.1-8B-Instruct

bartowski/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • 8B • Updated Dec 1, 2024 • 242k • 346

unsloth/Llama-3.1-8B-Instruct-GGUF

Text Generation • 8B • Updated May 9, 2025 • 8.79k • 36

ia-espirita/andre-luiz-ai

Text Generation • 8B • Updated 4 days ago • 33 • 2

AlicanKiraz0/Cybersecurity-BaronLLM_Offensive_Security_LLM_Q6_K_GGUF

Text Generation • 8B • Updated Jun 4, 2025 • 1.5k • 210

YorkieOH10/Meta-Llama-3.1-8B-Instruct-Q8_0-GGUF

Text Generation • 8B • Updated Jul 23, 2024 • 276 • 9

DevQuasar-4/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • 8B • Updated Dec 4, 2024 • 66 • 2

leafspark/Meta-Llama-3.1-8B-Instruct-Q2_K-GGUF

Text Generation • 8B • Updated Jul 23, 2024 • 21

legraphista/Meta-Llama-3.1-8B-Instruct-IMat-GGUF

Text Generation • 8B • Updated Jul 27, 2024 • 314 • 6

brittlewis12/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • 8B • Updated Jul 27, 2024 • 407 • 2

MaziyarPanahi/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • 8B • Updated Jul 23, 2024 • 158k • 34

lmstudio-community/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • 8B • Updated Jul 28, 2024 • 96.2k • 256

Ren6767/Meta-Llama-3.1-8B-Instruct-Q8_0-GGUF

Text Generation • 8B • Updated Jul 23, 2024 • 1

mtsdurica/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 23, 2024 • 54

SanctumAI/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • 8B • Updated Sep 11, 2024 • 22k • 18

backyardai/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • 8B • Updated Jul 24, 2024 • 190 • 1

HeRksTAn/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 23, 2024 • 13

xyottax/Meta-Llama-3.1-8B-Instruct-Q3_K_S-GGUF

Text Generation • 8B • Updated Jul 23, 2024 • 39

rumbleFTW/Meta-Llama-3.1-8B-Instruct-Q8_0-GGUF

Text Generation • 8B • Updated Jul 23, 2024 • 11 • 1

Ayylex/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 23, 2024 • 7 • 1

3Simplex/Meta-Llama-3.1-8B-Instruct-gguf

Text Generation • 8B • Updated Jul 27, 2024 • 97 • 2

Kondara/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 24, 2024 • 31

MugenYume/Meta-Llama-3.1-8B-Instruct-Q4_K_S-GGUF

Text Generation • 8B • Updated Jul 24, 2024 • 34

ddarolf/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 24, 2024 • 3

starble-dev/Meta-Llama-3.1-8B-Instruct-GGUF

8B • Updated Jul 24, 2024 • 61

kowlick/Meta-Llama-3.1-8B-Instruct-Q8_0-GGUF

Text Generation • 8B • Updated Jul 24, 2024 • 1

gaianet/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • 8B • Updated Feb 8, 2025 • 5.13k

shenzhi-wang/Llama3.1-8B-Chinese-Chat

Text Generation • 8B • Updated Jul 29, 2024 • 7.38k • • 264

adrlau/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 24, 2024 • 52

Pranav102999/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 24, 2024 • 12

joshnader/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Jul 24, 2024 • 7.84k • 2