LMFinder
Q

Qwen 2.5 72B

Reviewed 2026-06-16
Alibaba (Ollama)ollama/qwen2.5-72b
Context
128K
Price
Free
Tooling
4/5
Deploy
Local (self-hosted)

Best for

  • Agentic workflows and tool calling
  • Writing and editing code
  • Complex reasoning and analysis
  • Private, offline use on your own hardware

Skip if

  • You don't have a 40GB+ GPU
  • You want a managed, zero-setup API

Capability scores

Tool calling4/5
Multi-step reasoning4/5

Specifications

Context window
128K tokens
VRAM
~40GB
License
apache-2.0
Pricing
Free to run · needs ~40GB GPU
Deployment
Local (self-hosted)

Our take

Qwen 2.5 72B from Alibaba (Ollama) offers a 128K-token context window and is well-suited to strong tool calling, multi-step reasoning, coding. It runs on your own hardware, so there is no per-token cost and your data stays private (plan for roughly 40GB of VRAM).

Watch for the trade-offs: there is no managed API — you run and maintain it yourself.

Compare to

Hermes 3 8B (Llama)
NousResearch (Ollama)
128K context · Free to run · needs ~8GB GPU
Llama 3.3 70B
Meta (Ollama)
128K context · Free to run · needs ~40GB GPU
Qwen 2.5 32B
Alibaba (Ollama)
128K context · Free to run · needs ~20GB GPU
Best Local LLMs for Hermes Agent →Best LLMs for Agents & Tools →Local & Open-Weight LLMs →

Not sure this is the one?

Describe your project and let LMFinder rank the field for your exact constraints.

Describe your project →