LLM Local
← Back
Can this model run on my GPU?
Model
Select model family
Llama 3.1
Llama 3.2
Qwen 2.5
Gemma 2
DeepSeek V3
DeepSeek R1
Mistral
Mixtral
Phi 3
Size
Select model first
GPU
Select GPU
RTX 3060 12GB
RTX 3070 8GB
RTX 3080 10GB
RTX 3080 Ti 12GB
RTX 3090 24GB
RTX 4060 8GB
RTX 4060 Ti 16GB
RTX 4070 12GB
RTX 4070 Ti 12GB
RTX 4080 16GB
RTX 4090 24GB
RTX 5070 Ti 16GB
RTX 5080 16GB
RTX 5090 32GB
RTX A6000 48GB
A100 40GB
A100 80GB
H100 80GB
L40S 48GB