Open-weight local AI models

Open-Source Local AI Model Finder

Choose models your machine can actually run. The catalog covers common open-source and open-weight model families from Ollama, LM Studio, Hugging Face, and official model releases. Enter your device configuration, then rank matching models by task-specific performance.

Catalog size

76

open-weight entries

Model families

15

providers and families

Usable estimate

11 GB

for selected hardware

Query this device: 16 GB RAM · no dedicated GPU

Estimated usable model memory: 11 GB. Results update after you run the query.

Current rankings use this configuration.

Ranked results

76

Fits now

37

Fits or stretch

37

Gemma logo
Fits

Gemma 4 E4B

GoogleGemma terms

Edge-friendly multimodal assistant

Choose this when image input matters and you still want a compact model.

Parameters

E4B

Q4 size

9.6 GB

RAM floor

16 GB

VRAM target

10 GB

Performance

74/100

Pulls

n/a

chatreasoningvisioncodingWorkload match

Performance rank

Sorted within hardware fit group

#1

Install hint

ollama run gemma4:e4b
LM Studio model catalog
Mistral logo
Fits

Pixtral 12B

Mistral AIApache 2.0

Mistral local vision assistant

Good for open multimodal experiments with the Mistral ecosystem.

Parameters

12B

Q4 size

7.8 GB

RAM floor

16 GB

VRAM target

12 GB

Performance

70/100

Pulls

n/a

visionchatWorkload match

Performance rank

Sorted within hardware fit group

#2

Install hint

ollama run pixtral:12b
LM Studio model catalog
Mistral logo
Fits

Mistral NeMo 12B

Mistral AIApache 2.0

Efficient multilingual local chat

A good mid-size Mistral option for broad language coverage.

Parameters

12B

Q4 size

7.5 GB

RAM floor

16 GB

VRAM target

12 GB

Performance

69/100

Pulls

n/a

chatcodingWorkload match

Performance rank

Sorted within hardware fit group

#3

Install hint

ollama run mistral-nemo:12b
Mistral Small release notes
P
Fits

Phi-4 14B

MicrosoftMIT

Compact English reasoning

A practical option when you want stronger reasoning than tiny models.

Parameters

14B

Q4 size

9.1 GB

RAM floor

16 GB

VRAM target

12 GB

Performance

65/100

Pulls

n/a

reasoningchatcodingWorkload match

Performance rank

Sorted within hardware fit group

#4

Install hint

ollama run phi4:14b
Microsoft Phi product page
Gemma logo
Fits

Gemma 3 12B

GoogleGemma terms

Balanced multimodal local model

Good on Apple Silicon with enough unified memory or a 12 GB GPU.

Parameters

12B

Q4 size

8.2 GB

RAM floor

16 GB

VRAM target

12 GB

Performance

63/100

Pulls

n/a

chatvisionreasoningWorkload match

Performance rank

Sorted within hardware fit group

#5

Install hint

ollama run gemma3:12b
Google Gemma docs
Gemma logo
Fits

Gemma 4 E2B

GoogleGemma terms

Efficient edge multimodal use

Track this for compact visual assistants and quick local prototypes.

Parameters

E2B

Q4 size

5.5 GB

RAM floor

12 GB

VRAM target

6 GB

Performance

63/100

Pulls

n/a

chatvisionWorkload match

Performance rank

Sorted within hardware fit group

#6

Install hint

ollama run gemma4:e2b
LM Studio model catalog
Gemma logo
Fits

Gemma 4 12B

GoogleGemma terms

Fast workstation multimodal model

Good on Apple Silicon with enough unified memory or 12 GB plus GPUs.

Parameters

12B

Q4 size

7.6 GB

RAM floor

16 GB

VRAM target

12 GB

Performance

62/100

Pulls

n/a

chatreasoningvisioncodingWorkload match

Performance rank

Sorted within hardware fit group

#7

Install hint

ollama run gemma4:12b
LM Studio model catalog
Qwen logo
Fits

Qwen3 8B

AlibabaApache 2.0

Default open local assistant

Strong everyday pick for multilingual chat, coding, and reasoning on consumer hardware.

Parameters

8B

Q4 size

5.2 GB

RAM floor

16 GB

VRAM target

6 GB

Performance

62/100

Pulls

n/a

chatcodingreasoningWorkload match

Performance rank

Sorted within hardware fit group

#8

Install hint

ollama run qwen3:8b
Qwen3 official release
Llama logo
Fits

Llama 3.2 Vision 11B

MetaLlama license

Local image understanding

A practical option for screenshots, visual Q&A, and document images.

Parameters

11B

Q4 size

7.5 GB

RAM floor

16 GB

VRAM target

12 GB

Performance

61/100

Pulls

n/a

visionchatWorkload match

Performance rank

Sorted within hardware fit group

#9

Install hint

ollama run llama3.2-vision:11b
Meta Llama release notes
Granite logo
Fits

Granite 3.3 8B Instruct

IBMApache 2.0

Permissive local business model

Good candidate for private enterprise assistants and RAG evaluation.

Parameters

8B

Q4 size

5 GB

RAM floor

16 GB

VRAM target

8 GB

Performance

61/100

Pulls

n/a

chatcodingreasoningWorkload match

Performance rank

Sorted within hardware fit group

#10

Install hint

ollama run granite3.3:8b
IBM Granite
Qwen logo
Fits

Qwen2.5-Coder 7B

AlibabaApache 2.0

Small coding assistant

A practical code-focused model for local autocomplete, review, and refactor prompts.

Parameters

7B

Q4 size

4.7 GB

RAM floor

16 GB

VRAM target

6 GB

Performance

60/100

Pulls

n/a

codingchatWorkload match

Performance rank

Sorted within hardware fit group

#11

Install hint

ollama run qwen2.5-coder:7b
Ollama model library
Mistral logo
Fits

Mistral 7B Instruct

Mistral AIApache 2.0

Classic lightweight local assistant

A stable baseline model for general local chat and tool experiments.

Parameters

7B

Q4 size

4.4 GB

RAM floor

8 GB

VRAM target

6 GB

Performance

59/100

Pulls

n/a

chatcodingWorkload match

Performance rank

Sorted within hardware fit group

#12

Install hint

ollama run mistral:7b
Mistral Small release notes
Qwen logo
Fits

Qwen2.5-VL 7B

AlibabaApache 2.0

Local visual question answering

Use when screenshots, charts, receipts, or documents matter more than pure text speed.

Parameters

7B

Q4 size

5.5 GB

RAM floor

16 GB

VRAM target

8 GB

Performance

55/100

Downloads

n/a

visionchatWorkload match

Performance rank

Sorted within hardware fit group

#13

Install hint

huggingface-cli download Qwen/Qwen2.5-VL-7B-Instruct
Qwen3 official release
DeepSeek logo
Fits

DeepSeek-R1 Distill Llama 8B

DeepSeekMIT

Reasoning on common GPUs

A popular local R1 size for RTX 3060-class hardware.

Parameters

8B

Q4 size

5.2 GB

RAM floor

16 GB

VRAM target

8 GB

Performance

54/100

Pulls

n/a

reasoningcodingchatWorkload match

Performance rank

Sorted within hardware fit group

#14

Install hint

ollama run deepseek-r1:8b
DeepSeek R1 on Hugging Face
DeepSeek logo
Fits

DeepSeek-R1 Distill Qwen 7B

DeepSeekMIT

Small local reasoning

Use for math, logic, and step-by-step problem solving on consumer hardware.

Parameters

7B

Q4 size

4.7 GB

RAM floor

16 GB

VRAM target

6 GB

Performance

52/100

Pulls

n/a

reasoningcodingchatWorkload match

Performance rank

Sorted within hardware fit group

#15

Install hint

ollama run deepseek-r1:7b
DeepSeek R1 on Hugging Face
Gemma logo
Fits

Gemma 3 4B

GoogleGemma terms

Small multimodal assistant

A compact option when image input matters but hardware is limited.

Parameters

4B

Q4 size

3 GB

RAM floor

8 GB

VRAM target

CPU / unified

Performance

52/100

Pulls

n/a

chatvisionWorkload match

Performance rank

Sorted within hardware fit group

#16

Install hint

ollama run gemma3:4b
Google Gemma docs
Qwen logo
Fits

Qwen3 4B

AlibabaApache 2.0

Balanced small-device assistant

Good first model for 8 GB to 16 GB machines when speed matters.

Parameters

4B

Q4 size

2.8 GB

RAM floor

8 GB

VRAM target

CPU / unified

Performance

51/100

Pulls

n/a

chatcodingreasoningWorkload match

Performance rank

Sorted within hardware fit group

#17

Install hint

ollama run qwen3:4b
Qwen3 official release
P
Fits

Phi-4 Multimodal

MicrosoftMIT

Small multimodal Microsoft model

Supports text, vision, and audio-style multimodal workflows depending on runtime support.

Parameters

5.6B

Q4 size

4.3 GB

RAM floor

16 GB

VRAM target

8 GB

Performance

50/100

Downloads

n/a

visionchatWorkload match

Performance rank

Sorted within hardware fit group

#18

Install hint

huggingface-cli download microsoft/Phi-4-multimodal-instruct
Microsoft Phi product page
P
Fits

Phi-4 Mini Instruct

MicrosoftMIT

Small English reasoning

A compact model for local assistants, classification, and structured reasoning prompts.

Parameters

3.8B

Q4 size

2.6 GB

RAM floor

8 GB

VRAM target

CPU / unified

Performance

50/100

Pulls

n/a

chatreasoningWorkload match

Performance rank

Sorted within hardware fit group

#19

Install hint

ollama run phi4-mini
Microsoft Phi product page
O
Fits

OLMo 2 7B Instruct

Ai2Apache 2.0

Fully open research baseline

Choose OLMo when training data and model transparency matter.

Parameters

7B

Q4 size

4.8 GB

RAM floor

16 GB

VRAM target

6 GB

Performance

49/100

Downloads

n/a

chatWorkload match

Performance rank

Sorted within hardware fit group

#20

Install hint

huggingface-cli download allenai/OLMo-2-1124-7B-Instruct
Ai2 OLMo
Granite logo
Fits

Granite 4.0 Tiny

IBMApache 2.0

Next-generation Granite evaluation

Track this for Apache-licensed business deployment tests.

Parameters

Tiny MoE

Q4 size

4 GB

RAM floor

8 GB

VRAM target

CPU / unified

Performance

49/100

Downloads

n/a

chatcodingWorkload match

Performance rank

Sorted within hardware fit group

#21

Install hint

huggingface-cli download ibm-granite/granite-4.0-tiny-preview
IBM Granite
L
Fits

LLaVA 7B

LLaVAApache 2.0

Classic local image chat

A widely supported visual assistant for screenshots and simple image questions.

Parameters

7B

Q4 size

4.7 GB

RAM floor

16 GB

VRAM target

8 GB

Performance

48/100

Pulls

n/a

visionchatWorkload match

Performance rank

Sorted within hardware fit group

#22

Install hint

ollama run llava:7b
Ollama LLaVA page
Llama logo
Fits

Llama 3.2 3B

MetaLlama license

Small general assistant

A lightweight Meta open-weight option for simple local use.

Parameters

3B

Q4 size

2 GB

RAM floor

8 GB

VRAM target

CPU / unified

Performance

45/100

Pulls

n/a

chatcodingWorkload match

Performance rank

Sorted within hardware fit group

#23

Install hint

ollama run llama3.2:3b
Meta Llama release notes
M
Fits

Molmo 7B-D

Ai2Apache 2.0

Open visual reasoning research

A transparent vision-language model family for local multimodal tests.

Parameters

7B

Q4 size

5.5 GB

RAM floor

16 GB

VRAM target

8 GB

Performance

43/100

Downloads

n/a

visionchatWorkload match

Performance rank

Sorted within hardware fit group

#24

Install hint

huggingface-cli download allenai/Molmo-7B-D-0924
Ai2 OLMo
Granite logo
Fits

Granite 3.3 2B Instruct

IBMApache 2.0

Small enterprise-friendly assistant

Apache-licensed model for teams that care about permissive licensing.

Parameters

2B

Q4 size

1.5 GB

RAM floor

4 GB

VRAM target

CPU / unified

Performance

41/100

Pulls

n/a

chatcodingWorkload match

Performance rank

Sorted within hardware fit group

#25

Install hint

ollama run granite3.3:2b
IBM Granite
Qwen logo
Fits

Qwen3 1.7B

AlibabaApache 2.0

Low-memory local assistant

A better floor than sub-1B models when you need basic coding help on small devices.

Parameters

1.7B

Q4 size

1.3 GB

RAM floor

4 GB

VRAM target

CPU / unified

Performance

39/100

Pulls

n/a

chatcodingWorkload match

Performance rank

Sorted within hardware fit group

#26

Install hint

ollama run qwen3:1.7b
Qwen3 official release
Llama logo
Fits

Llama 3.2 1B

MetaLlama license

Tiny local chat

Runs almost everywhere and is useful for local automation tests.

Parameters

1B

Q4 size

0.9 GB

RAM floor

4 GB

VRAM target

CPU / unified

Performance

35/100

Pulls

n/a

chatWorkload match

Performance rank

Sorted within hardware fit group

#27

Install hint

ollama run llama3.2:1b
Meta Llama release notes
Gemma logo
Fits

Gemma 3 1B

GoogleGemma terms

Tiny Google open model tests

Useful for mobile-adjacent experiments and low-memory chat.

Parameters

1B

Q4 size

0.8 GB

RAM floor

4 GB

VRAM target

CPU / unified

Performance

34/100

Pulls

n/a

chatWorkload match

Performance rank

Sorted within hardware fit group

#28

Install hint

ollama run gemma3:1b
Google Gemma docs
Qwen logo
Fits

Qwen3 0.6B

AlibabaApache 2.0

Tiny local chat and quick smoke tests

Runs on almost any laptop, but keep expectations modest for coding and reasoning.

Parameters

0.6B

Q4 size

0.6 GB

RAM floor

4 GB

VRAM target

CPU / unified

Performance

31/100

Pulls

n/a

chatWorkload match

Performance rank

Sorted within hardware fit group

#29

Install hint

ollama run qwen3:0.6b
Qwen3 official release
DeepSeek logo
Fits

DeepSeek-R1 Distill Qwen 1.5B

DeepSeekMIT

Tiny reasoning experiments

Good for testing reasoning prompts locally before moving to larger R1 distills.

Parameters

1.5B

Q4 size

1.1 GB

RAM floor

4 GB

VRAM target

CPU / unified

Performance

29/100

Pulls

n/a

reasoningchatWorkload match

Performance rank

Sorted within hardware fit group

#30

Install hint

ollama run deepseek-r1:1.5b
DeepSeek R1 on Hugging Face
Hunyuan logo
Fits

Tencent Hunyuan 1.8B Instruct

TencentTencent Hunyuan license

Tiny Hunyuan local tests

Useful when you want a very small Chinese-English local model.

Parameters

1.8B

Q4 size

1.4 GB

RAM floor

4 GB

VRAM target

CPU / unified

Performance

28/100

Downloads

n/a

chatWorkload match

Performance rank

Sorted within hardware fit group

#31

Install hint

huggingface-cli download tencent/Hunyuan-1.8B-Instruct
Tencent Hunyuan Hugging Face
E
Fits

E5-Mistral 7B Instruct

MicrosoftMIT

Large instruction embeddings

Use when retrieval quality matters more than embedding throughput.

Parameters

7B

Q4 size

4.8 GB

RAM floor

16 GB

VRAM target

8 GB

Performance

37/100

Downloads

n/a

embedding

Performance rank

Sorted within hardware fit group

#32

Install hint

huggingface-cli download intfloat/e5-mistral-7b-instruct
Ollama embedding models
E
Fits

BGE-M3

BAAIMIT

Multilingual RAG retrieval

A strong embedding pick for multilingual search and hybrid retrieval workflows.

Parameters

568M

Q4 size

1.2 GB

RAM floor

4 GB

VRAM target

CPU / unified

Performance

0/100

Pulls

n/a

embedding

Performance rank

Sorted within hardware fit group

#33

Install hint

ollama pull bge-m3
Ollama embedding models
E
Fits

Jina Embeddings v3

Jina AICC BY-NC 4.0

Multilingual document embeddings

Check license terms before commercial usage; useful for local multilingual evaluation.

Parameters

572M

Q4 size

1.2 GB

RAM floor

4 GB

VRAM target

CPU / unified

Performance

0/100

Downloads

n/a

embedding

Performance rank

Sorted within hardware fit group

#34

Install hint

huggingface-cli download jinaai/jina-embeddings-v3
Ollama embedding models
E
Fits

Snowflake Arctic Embed L

SnowflakeApache 2.0

Enterprise-style local retrieval

A permissive embedding model for private search pipelines.

Parameters

334M

Q4 size

0.8 GB

RAM floor

4 GB

VRAM target

CPU / unified

Performance

0/100

Downloads

n/a

embedding

Performance rank

Sorted within hardware fit group

#35

Install hint

huggingface-cli download Snowflake/snowflake-arctic-embed-l
Ollama embedding models
E
Fits

mxbai-embed-large

MixedbreadApache 2.0

Higher-quality local embeddings

Good default when embedding quality matters more than model size.

Parameters

335M

Q4 size

0.7 GB

RAM floor

4 GB

VRAM target

CPU / unified

Performance

0/100

Pulls

n/a

embedding

Performance rank

Sorted within hardware fit group

#36

Install hint

ollama pull mxbai-embed-large
Ollama embedding models
E
Fits

nomic-embed-text

NomicApache 2.0

Local semantic search

Use for private RAG indexes, document search, and lightweight retrieval.

Parameters

137M

Q4 size

0.3 GB

RAM floor

4 GB

VRAM target

CPU / unified

Performance

0/100

Pulls

n/a

embedding

Performance rank

Sorted within hardware fit group

#37

Install hint

ollama pull nomic-embed-text
Ollama embedding models
Llama logo
Upgrade

Llama 3.3 70B

MetaLlama license

Large general open-weight assistant

A common baseline for strong local text performance on large rigs.

Parameters

70B

Q4 size

43 GB

RAM floor

128 GB

VRAM target

48 GB

Performance

82/100

Pulls

n/a

chatcodingreasoningWorkload match

Performance rank

Sorted within hardware fit group

#38

Install hint

ollama run llama3.3:70b
Meta Llama release notes
Mistral logo
Upgrade

Mixtral 8x7B

Mistral AIApache 2.0

MoE general assistant

Still useful for local MoE experiments and multilingual workloads.

Parameters

46.7B MoE

Q4 size

26 GB

RAM floor

64 GB

VRAM target

24 GB

Performance

82/100

Pulls

n/a

chatcodingreasoningWorkload match

Performance rank

Sorted within hardware fit group

#39

Install hint

ollama run mixtral:8x7b
Mistral Small release notes
Mistral logo
Upgrade

Mistral Small 3.1 24B

Mistral AIApache 2.0

High-quality local assistant

Strong when you need low-latency function calling and multimodal input.

Parameters

24B

Q4 size

15 GB

RAM floor

32 GB

VRAM target

24 GB

Performance

82/100

Downloads

n/a

chatcodingvisionWorkload match

Performance rank

Sorted within hardware fit group

#40

Install hint

huggingface-cli download mistralai/Mistral-Small-3.1-24B-Instruct-2503
Mistral Small release notes
Mistral logo
Upgrade

Mistral Small 3.2 24B

Mistral AIApache 2.0

Updated 24B multimodal assistant

A newer Small-family option for instruction following, vision, and tool use.

Parameters

24B

Q4 size

15 GB

RAM floor

32 GB

VRAM target

24 GB

Performance

82/100

Downloads

n/a

chatcodingvisionWorkload match

Performance rank

Sorted within hardware fit group

#41

Install hint

huggingface-cli download mistralai/Mistral-Small-3.2-24B-Instruct-2506
LM Studio model catalog
Llama logo
Upgrade

Llama 4 Maverick

MetaLlama license

Very large local AI infrastructure

Treat this as a data-center candidate, not a normal desktop install.

Parameters

17B active MoE

Q4 size

250 GB

RAM floor

512 GB

VRAM target

160 GB

Performance

74/100

Downloads

n/a

chatvisionreasoningWorkload match

Performance rank

Sorted within hardware fit group

#42

Install hint

huggingface-cli download meta-llama/Llama-4-Maverick-17B-128E-Instruct
Meta Llama release notes
Qwen logo
Upgrade

Qwen3 235B-A22B

AlibabaApache 2.0

Server-class open-weight deployment

Track this for cluster or multi-GPU servers rather than normal desktops.

Parameters

235B MoE

Q4 size

150 GB

RAM floor

256 GB

VRAM target

80 GB

Performance

74/100

Downloads

n/a

chatcodingreasoningWorkload match

Performance rank

Sorted within hardware fit group

#43

Install hint

huggingface-cli download Qwen/Qwen3-235B-A22B
Qwen3 official release
Llama logo
Upgrade

Llama 4 Scout

MetaLlama license

Long-context multimodal servers

Open-weight Llama 4 model for server-side local deployment planning.

Parameters

17B active MoE

Q4 size

90 GB

RAM floor

192 GB

VRAM target

80 GB

Performance

74/100

Downloads

n/a

chatvisionreasoningWorkload match

Performance rank

Sorted within hardware fit group

#44

Install hint

huggingface-cli download meta-llama/Llama-4-Scout-17B-16E-Instruct
Meta Llama release notes
Qwen logo
Upgrade

Qwen3 32B

AlibabaApache 2.0

Workstation-grade open model

A serious local upgrade for coding, agent workflows, and difficult reasoning tasks.

Parameters

32B

Q4 size

20 GB

RAM floor

64 GB

VRAM target

24 GB

Performance

74/100

Pulls

n/a

chatcodingreasoningWorkload match

Performance rank

Sorted within hardware fit group

#45

Install hint

ollama run qwen3:32b
Qwen3 official release
Gemma logo
Upgrade

Gemma 4 31B

GoogleGemma terms

Frontier local workstation model

A larger Gemma option for capable desktops and local multimodal workflows.

Parameters

31B

Q4 size

20 GB

RAM floor

64 GB

VRAM target

24 GB

Performance

74/100

Pulls

n/a

reasoningcodingvisionchatWorkload match

Performance rank

Sorted within hardware fit group

#46

Install hint

ollama run gemma4:31b
LM Studio model catalog
Qwen logo
Upgrade

Qwen3 30B-A3B

AlibabaApache 2.0

Efficient MoE reasoning

Mixture-of-experts design can offer strong quality without activating every parameter.

Parameters

30B MoE

Q4 size

18 GB

RAM floor

48 GB

VRAM target

16 GB

Performance

74/100

Pulls

n/a

chatcodingreasoningWorkload match

Performance rank

Sorted within hardware fit group

#47

Install hint

ollama run qwen3:30b-a3b
Qwen3 official release
Gemma logo
Upgrade

Gemma 3 27B

GoogleGemma terms

High-quality local multimodal work

Best reserved for 24 GB GPUs, high-memory Macs, or larger systems.

Parameters

27B

Q4 size

17 GB

RAM floor

48 GB

VRAM target

24 GB

Performance

74/100

Pulls

n/a

chatvisionreasoningWorkload match

Performance rank

Sorted within hardware fit group

#48

Install hint

ollama run gemma3:27b
Google Gemma docs
Gemma logo
Upgrade

Gemma 4 26B-A4B

GoogleGemma terms

Efficient larger multimodal model

Useful when you want a larger Gemma family model without activating every parameter.

Parameters

26B MoE

Q4 size

16.5 GB

RAM floor

48 GB

VRAM target

24 GB

Performance

74/100

Pulls

n/a

chatreasoningvisionWorkload match

Performance rank

Sorted within hardware fit group

#49

Install hint

ollama run gemma4:26b-a4b
LM Studio model catalog
Granite logo
Upgrade

Granite 4.0 Small

IBMApache 2.0

Business-grade open model testing

A larger Granite candidate for teams standardizing on Apache-licensed models.

Parameters

Small MoE

Q4 size

12 GB

RAM floor

32 GB

VRAM target

16 GB

Performance

71/100

Downloads

n/a

chatcodingreasoningWorkload match

Performance rank

Sorted within hardware fit group

#50

Install hint

huggingface-cli download ibm-granite/granite-4.0-small-preview
IBM Granite
Kimi logo
Upgrade

Kimi K2 Instruct

Moonshot AIModified MIT

Large open agentic model

Track this for hosted local infrastructure, coding agents, and long-context analysis.

Parameters

1T MoE

Q4 size

600 GB

RAM floor

768 GB

VRAM target

240 GB

Performance

70/100

Downloads

n/a

codingreasoningchatWorkload match

Performance rank

Sorted within hardware fit group

#51

Install hint

huggingface-cli download moonshotai/Kimi-K2-Instruct
Moonshot Kimi K2 repository
MiniMax logo
Upgrade

MiniMax M2

MiniMaxModified MIT

Open-weight server assistant

Evaluate license and deployment constraints before production use.

Parameters

MoE

Q4 size

280 GB

RAM floor

512 GB

VRAM target

160 GB

Performance

70/100

Downloads

n/a

chatcodingreasoningWorkload match

Performance rank

Sorted within hardware fit group

#52

Install hint

huggingface-cli download MiniMaxAI/MiniMax-M2
MiniMax M2 repository
Qwen logo
Upgrade

Qwen3 14B

AlibabaApache 2.0

Higher-quality local reasoning

Useful when 8B is not consistent enough and you still want practical local speed.

Parameters

14B

Q4 size

9 GB

RAM floor

24 GB

VRAM target

12 GB

Performance

65/100

Pulls

n/a

chatcodingreasoningWorkload match

Performance rank

Sorted within hardware fit group

#53

Install hint

ollama run qwen3:14b
Qwen3 official release
Qwen logo
Upgrade

Qwen2.5-Coder 14B

AlibabaApache 2.0

Local repository edits

A useful middle tier when 7B misses framework details but 32B is too heavy.

Parameters

14B

Q4 size

9 GB

RAM floor

24 GB

VRAM target

12 GB

Performance

65/100

Pulls

n/a

codingchatWorkload match

Performance rank

Sorted within hardware fit group

#54

Install hint

ollama run qwen2.5-coder:14b
Ollama model library
MiniMax logo
Upgrade

MiniMax M2.5

MiniMaxModified MIT

Updated MiniMax local server track

A large open-weight candidate for organizations with inference clusters.

Parameters

MoE

Q4 size

280 GB

RAM floor

512 GB

VRAM target

160 GB

Performance

62/100

Downloads

n/a

chatcodingreasoningWorkload match

Performance rank

Sorted within hardware fit group

#55

Install hint

huggingface-cli download MiniMaxAI/MiniMax-M2.5
MiniMax M2 repository
MiniMax logo
Upgrade

MiniMax M2.7

MiniMaxModified MIT

Newest MiniMax open-weight candidate

Use as a research and infrastructure planning entry until local runtimes mature.

Parameters

MoE

Q4 size

280 GB

RAM floor

512 GB

VRAM target

160 GB

Performance

62/100

Downloads

n/a

chatcodingreasoningWorkload match

Performance rank

Sorted within hardware fit group

#56

Install hint

huggingface-cli download MiniMaxAI/MiniMax-M2.7
MiniMax M2 repository
Hunyuan logo
Upgrade

Tencent Hunyuan Large

TencentTencent Hunyuan license

Large local infrastructure reference

Track for server deployments and China-market open model coverage.

Parameters

389B MoE

Q4 size

240 GB

RAM floor

512 GB

VRAM target

160 GB

Performance

62/100

Downloads

n/a

chatcodingreasoningWorkload match

Performance rank

Sorted within hardware fit group

#57

Install hint

huggingface-cli download tencent/Tencent-Hunyuan-Large
Tencent Hunyuan Hugging Face
GLM logo
Upgrade

GLM-4.5

Z.aiMIT

Cluster-class open agent model

Useful for tracking frontier open-weight systems, but not ordinary local desktops.

Parameters

355B MoE

Q4 size

220 GB

RAM floor

512 GB

VRAM target

160 GB

Performance

62/100

Downloads

n/a

chatcodingreasoningWorkload match

Performance rank

Sorted within hardware fit group

#58

Install hint

huggingface-cli download zai-org/GLM-4.5
Z.ai GLM-4.5 repository
GLM logo
Upgrade

GLM-4.5 Air

Z.aiMIT

Large open agent model

A high-capability open model for servers with strong memory budgets.

Parameters

106B MoE

Q4 size

65 GB

RAM floor

128 GB

VRAM target

80 GB

Performance

62/100

Downloads

n/a

chatcodingreasoningWorkload match

Performance rank

Sorted within hardware fit group

#59

Install hint

huggingface-cli download zai-org/GLM-4.5-Air
Z.ai GLM-4.5 repository
O
Upgrade

OLMo 3 32B

Ai2Apache 2.0

Fully open large-model research

A larger transparent model family entry for reproducible AI research.

Parameters

32B

Q4 size

20 GB

RAM floor

64 GB

VRAM target

24 GB

Performance

62/100

Downloads

n/a

chatreasoningWorkload match

Performance rank

Sorted within hardware fit group

#60

Install hint

huggingface-cli download allenai/OLMo-3-32B
Ai2 OLMo
GLM logo
Upgrade

GLM-4.7 Flash

Z.aiMIT

Efficient GLM deployment

A lighter GLM-family option for local servers and larger workstations.

Parameters

30B-A3B MoE

Q4 size

18 GB

RAM floor

48 GB

VRAM target

24 GB

Performance

62/100

Downloads

n/a

chatcodingreasoningWorkload match

Performance rank

Sorted within hardware fit group

#61

Install hint

huggingface-cli download zai-org/GLM-4.7-Flash
Z.ai GLM-4.5 repository
O
Upgrade

OLMo 2 13B Instruct

Ai2Apache 2.0

Transparent open-model evaluation

A good comparison point for fully open training pipelines.

Parameters

13B

Q4 size

8.5 GB

RAM floor

24 GB

VRAM target

12 GB

Performance

60/100

Downloads

n/a

chatreasoningWorkload match

Performance rank

Sorted within hardware fit group

#62

Install hint

huggingface-cli download allenai/OLMo-2-1124-13B-Instruct
Ai2 OLMo
L
Upgrade

LLaVA 13B

LLaVAApache 2.0

Stronger local image chat

Use this when the 7B model misses details and you have enough memory.

Parameters

13B

Q4 size

8 GB

RAM floor

24 GB

VRAM target

12 GB

Performance

59/100

Pulls

n/a

visionchatWorkload match

Performance rank

Sorted within hardware fit group

#63

Install hint

ollama run llava:13b
Ollama LLaVA page
Llama logo
Upgrade

Llama 3.2 Vision 90B

MetaLlama license

Large local vision servers

Use this only on serious multi-GPU or high-memory systems.

Parameters

90B

Q4 size

56 GB

RAM floor

128 GB

VRAM target

80 GB

Performance

50/100

Pulls

n/a

visionreasoning

Performance rank

Sorted within hardware fit group

#64

Install hint

ollama run llama3.2-vision:90b
Meta Llama release notes
DeepSeek logo
Upgrade

DeepSeek-R1 Distill Llama 70B

DeepSeekMIT

Large local reasoning servers

Better suited to multi-GPU rigs or high-memory Apple Silicon systems.

Parameters

70B

Q4 size

43 GB

RAM floor

128 GB

VRAM target

48 GB

Performance

50/100

Pulls

n/a

reasoningcoding

Performance rank

Sorted within hardware fit group

#65

Install hint

ollama run deepseek-r1:70b
DeepSeek R1 on Hugging Face
Qwen logo
Upgrade

Qwen2.5-VL 32B

AlibabaApache 2.0

Large local multimodal analysis

A workstation-class option for documents, diagrams, UI review, and visual reasoning.

Parameters

32B

Q4 size

22 GB

RAM floor

64 GB

VRAM target

24 GB

Performance

50/100

Downloads

n/a

visionreasoning

Performance rank

Sorted within hardware fit group

#66

Install hint

huggingface-cli download Qwen/Qwen2.5-VL-32B-Instruct
Qwen3 official release
Qwen logo
Upgrade

Qwen2.5-Coder 32B

AlibabaApache 2.0

High-quality local coding

One of the strongest widely used open coding models for local workstations.

Parameters

32B

Q4 size

20 GB

RAM floor

64 GB

VRAM target

24 GB

Performance

50/100

Pulls

n/a

codingreasoning

Performance rank

Sorted within hardware fit group

#67

Install hint

ollama run qwen2.5-coder:32b
Ollama model library
DeepSeek logo
Upgrade

DeepSeek-R1 Distill Qwen 32B

DeepSeekMIT

Serious local reasoning

Use when answer quality matters more than speed and you have workstation memory.

Parameters

32B

Q4 size

20 GB

RAM floor

64 GB

VRAM target

24 GB

Performance

50/100

Pulls

n/a

reasoningcoding

Performance rank

Sorted within hardware fit group

#68

Install hint

ollama run deepseek-r1:32b
DeepSeek R1 on Hugging Face
Mistral logo
Upgrade

Devstral Small 24B

Mistral AIApache 2.0

Agentic coding tasks

A code-agent oriented open model for repository-level work.

Parameters

24B

Q4 size

15 GB

RAM floor

32 GB

VRAM target

24 GB

Performance

50/100

Downloads

n/a

coding

Performance rank

Sorted within hardware fit group

#69

Install hint

huggingface-cli download mistralai/Devstral-Small-2505
LM Studio model catalog
Mistral logo
Upgrade

Codestral 22B

Mistral AIMistral research license

Code completion and generation

Use for code-specific workflows; check license terms before commercial deployment.

Parameters

22B

Q4 size

13 GB

RAM floor

32 GB

VRAM target

16 GB

Performance

49/100

Pulls

n/a

coding

Performance rank

Sorted within hardware fit group

#70

Install hint

ollama run codestral:22b
Mistral Small release notes
L
Upgrade

LLaVA 34B

LLaVAApache 2.0

Large local visual assistant

A workstation-class LLaVA model for more demanding visual tasks.

Parameters

34B

Q4 size

21 GB

RAM floor

64 GB

VRAM target

24 GB

Performance

46/100

Pulls

n/a

visionreasoning

Performance rank

Sorted within hardware fit group

#71

Install hint

ollama run llava:34b
Ollama LLaVA page
P
Upgrade

Phi-4 Reasoning

MicrosoftMIT

Reasoning-focused Phi workflows

Pick this over base Phi-4 when step-by-step problem solving is the main job.

Parameters

14B

Q4 size

9.3 GB

RAM floor

24 GB

VRAM target

12 GB

Performance

42/100

Downloads

n/a

reasoningcoding

Performance rank

Sorted within hardware fit group

#72

Install hint

huggingface-cli download microsoft/Phi-4-reasoning
Microsoft Phi product page
DeepSeek logo
Upgrade

DeepSeek-R1 Distill Qwen 14B

DeepSeekMIT

Better local math and logic

A sensible upgrade when 7B and 8B distills are too brittle.

Parameters

14B

Q4 size

9 GB

RAM floor

24 GB

VRAM target

12 GB

Performance

41/100

Pulls

n/a

reasoningcoding

Performance rank

Sorted within hardware fit group

#73

Install hint

ollama run deepseek-r1:14b
DeepSeek R1 on Hugging Face
Kimi logo
Upgrade

Kimi K2.6

Moonshot AIModified MIT

Native multimodal agentic model

A server-scale candidate for teams tracking open agent models.

Parameters

1T MoE

Q4 size

600 GB

RAM floor

768 GB

VRAM target

240 GB

Performance

38/100

Downloads

n/a

codingreasoningvision

Performance rank

Sorted within hardware fit group

#74

Install hint

huggingface-cli download moonshotai/Kimi-K2.6
Moonshot Kimi K2 repository
DeepSeek logo
Upgrade

DeepSeek-R1

DeepSeekMIT

Cluster-scale open reasoning

Reference the full model for server planning, not single-desktop installation.

Parameters

671B MoE

Q4 size

404 GB

RAM floor

512 GB

VRAM target

160 GB

Performance

38/100

Downloads

n/a

reasoningcoding

Performance rank

Sorted within hardware fit group

#75

Install hint

huggingface-cli download deepseek-ai/DeepSeek-R1
DeepSeek R1 on Hugging Face
M
Upgrade

Molmo 72B

Ai2Apache 2.0

Large open visual reasoning

Use on high-memory systems when smaller vision models lack accuracy.

Parameters

72B

Q4 size

45 GB

RAM floor

128 GB

VRAM target

48 GB

Performance

38/100

Downloads

n/a

visionreasoning

Performance rank

Sorted within hardware fit group

#76

Install hint

huggingface-cli download allenai/Molmo-72B-0924
Ai2 OLMo