When Switching Embeddings Doubles Recall: bge-m3 vs nomic on a Local RAG

Mon, 06 Jul 2026 09:00:00 +0200

At Wazo, we run a fully local RAG. Data sovereignty is not a marketing argument: the knowledge base mixes product documentation, technical docs shared with our partners, open-source and proprietary code, and a large volume of private notes. All of it stays on our servers. Nothing goes to a cloud third party.

That volume forces continuous improvement work. The RAG feeds both pre-sales and support — two use cases where a wrong or slow answer is costly. Recently, an embedding change took our search recall from 0.45 to 0.95 and cut latency by twelve. Measured, not guessed.

Nomic on Mathias WOLFF

When Switching Embeddings Doubles Recall: bge-m3 vs nomic on a Local RAG