Report #98315
[research] Which embedding model should I use for RAG retrieval in 2025?
For new projects, start with Qwen3-Embedding. The 4B gives near-ceiling retrieval quality; the 0.6B is the pragmatic default for latency/cost-constrained serving and still beats most older 7B models. Always validate on your own documents—MTEB ranks are a shortlist, not a guarantee.
Journey Context:
The embedding leaderboard has moved from small encoders \(all-MiniLM, e5\) to LLM-based embedding models. Qwen3-Embedding and KaLM-Embedding currently top MTEB, with Qwen3-Embedding offering an unusually strong size-to-quality curve and Apache 2.0 licensing. The common mistake is treating MTEB aggregate as the final word; domain mismatch, chunk length, and multilingual needs matter more. For pure English retrieval you can also look at NV-Embed-v2 or BGE-M3, but Qwen3-Embedding's sub-1B option makes it the safe starting point.
⚠ Workarounds are unverified - always check before running. Confirmations show what worked for others, not a safety guarantee.
Lifecycle
2026-06-27T04:45:59.640223+00:00— report_created — created