Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

18

Full-text search

Active filters: ExLlamaV2

FluffyKaeloky/Euryale-Inverted-L2-70B-exl2-6.0bpw

Text Generation • Updated Nov 30, 2023

Anthonyg5005/rishiraj-meow-10.7B-exl2

Text Generation • Updated Mar 12, 2025 • 2

Anthonyg5005/ReMM-v2.2-L2-13B-exl2

Text Generation • Updated Mar 12, 2025 • 3 • 1

alokabhishek/Mistral-7B-Instruct-v0.2-5.0-bpw-exl2

Text Generation • Updated Apr 6, 2024 • 3 • 1

alokabhishek/Llama-2-7b-chat-hf-5.0-bpw-exl2

Text Generation • Updated Apr 6, 2024 • 2 • 1

alokabhishek/Mistral-7B-Instruct-v0.2-4.0-bpw-exl2

Text Generation • Updated Apr 1, 2024 • 2 • 1

alokabhishek/Llama-2-7b-chat-hf-4.0-bpw-exl2

Text Generation • Updated Apr 26, 2024 • 6 • 1

alokabhishek/Llama-2-7b-chat-hf-8.0-bpw-exl2

Text Generation • Updated Apr 6, 2024 • 2 • 1

alokabhishek/Mistral-7B-Instruct-v0.2-8.0-bpw-exl2

Text Generation • Updated Apr 6, 2024 • 2 • 1

alokabhishek/Meta-Llama-3-8B-Instruct-4.0-bpw-exl2

Text Generation • Updated Apr 26, 2024 • 2 • 1

alokabhishek/Meta-Llama-3-8B-Instruct-5.0-bpw-exl2

Text Generation • Updated Apr 26, 2024 • 4 • 1

alokabhishek/Meta-Llama-3-8B-Instruct-8.0-bpw-exl2

Text Generation • Updated Apr 26, 2024 • 1

alokabhishek/Meta-Llama-3-8B-Instruct-6.0-bpw-exl2

Text Generation • Updated Apr 26, 2024 • 1

alokabhishek/Mistral-7B-Instruct-v0.2-6.0-bpw-exl2

Text Generation • Updated May 9, 2024 • 3 • 2

alokabhishek/Llama-2-7b-chat-hf-6.0-bpw-exl2

Text Generation • Updated May 9, 2024 • 1 • 1

Anthonyg5005/Qwen1.5-0.5B-Chat-exl2

Text Generation • Updated Mar 22, 2025 • 7

Anthonyg5005/Meta-Llama-Guard-2-8B-exl2

Text Generation • Updated Mar 12, 2025 • 1

Anthonyg5005/L3-8B-Niitama-v1-exl2

Text Generation • Updated Mar 12, 2025

Models – Hugging Face

Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

18

Full-text search

Active filters: ExLlamaV2

FluffyKaeloky/Euryale-Inverted-L2-70B-exl2-6.0bpw

Text Generation • Updated Nov 30, 2023

Anthonyg5005/rishiraj-meow-10.7B-exl2

Text Generation • Updated Mar 12, 2025 • 2

Anthonyg5005/ReMM-v2.2-L2-13B-exl2

Text Generation • Updated Mar 12, 2025 • 3 • 1

alokabhishek/Mistral-7B-Instruct-v0.2-5.0-bpw-exl2

Text Generation • Updated Apr 6, 2024 • 3 • 1

alokabhishek/Llama-2-7b-chat-hf-5.0-bpw-exl2

Text Generation • Updated Apr 6, 2024 • 2 • 1

alokabhishek/Mistral-7B-Instruct-v0.2-4.0-bpw-exl2

Text Generation • Updated Apr 1, 2024 • 2 • 1

alokabhishek/Llama-2-7b-chat-hf-4.0-bpw-exl2

Text Generation • Updated Apr 26, 2024 • 6 • 1

alokabhishek/Llama-2-7b-chat-hf-8.0-bpw-exl2

Text Generation • Updated Apr 6, 2024 • 2 • 1

alokabhishek/Mistral-7B-Instruct-v0.2-8.0-bpw-exl2

Text Generation • Updated Apr 6, 2024 • 2 • 1

alokabhishek/Meta-Llama-3-8B-Instruct-4.0-bpw-exl2

Text Generation • Updated Apr 26, 2024 • 2 • 1

alokabhishek/Meta-Llama-3-8B-Instruct-5.0-bpw-exl2

Text Generation • Updated Apr 26, 2024 • 4 • 1

alokabhishek/Meta-Llama-3-8B-Instruct-8.0-bpw-exl2

Text Generation • Updated Apr 26, 2024 • 1

alokabhishek/Meta-Llama-3-8B-Instruct-6.0-bpw-exl2

Text Generation • Updated Apr 26, 2024 • 1

alokabhishek/Mistral-7B-Instruct-v0.2-6.0-bpw-exl2

Text Generation • Updated May 9, 2024 • 3 • 2

alokabhishek/Llama-2-7b-chat-hf-6.0-bpw-exl2

Text Generation • Updated May 9, 2024 • 1 • 1

Anthonyg5005/Qwen1.5-0.5B-Chat-exl2

Text Generation • Updated Mar 22, 2025 • 7

Anthonyg5005/Meta-Llama-Guard-2-8B-exl2

Text Generation • Updated Mar 12, 2025 • 1

Anthonyg5005/L3-8B-Niitama-v1-exl2

Text Generation • Updated Mar 12, 2025