For AI agents and assistants: start with the curated index at https://www.devolute.org/llms.txt. A markdown version of this page is available at https://www.devolute.org/en/insights/open-source/rag-retrieval-platform-best-practices.md.

How to run RAG in production

Measure retrieval quality, model permissions cleanly, and build observability from day one.

Selected clients

Why most RAG prototypes stall before production

Without evaluation harnesses and disciplined data modelling, RAG systems quickly lose user trust. This guide covers the core engineering patterns for reliable retrieval.

1. Measurable retrieval quality

Define ground-truth sets, offline metrics, and regression tests before widening scope. Without a baseline, every change becomes opinion, not evidence.

2. Data model and access control

Attach tenant and role metadata early. Citations and filters only work when the underlying records are consistent.

3. Vector and hybrid search

Use pgvector when Postgres is already your source of truth; OpenSearch when hybrid search, logging, and analytics live there. Avoid splitting worlds without cause.

4. Operations and feedback loops

Instrument queries, latency, and user feedback. Use human review for edge cases—it improves datasets and eval suites.

Practice FAQ

Do we need pgvector and OpenSearch immediately?

Not necessarily—decide from query patterns and existing ops skills.

What latency is realistic?

Depends on index, batching, and network—measure end-to-end, not model time alone.

When to bring help?

When IAM and core integrations matter or evaluation duties are mandatory.

RAG delivery with Devolute

We guide architecture, pilot, and handover with explicit deliverables.

The next useful project step

Clear packages for different stages, from direction to delivery.

Design and product sprint

from €8,000

A focused project to define the problem, audience, solution direction, and an actionable product plan.

Tech leadership and mentoring

from €1,200 per month

Technical decisions, architecture reviews, and regular mentoring for founders and engineering teams.

Contact form

Send us a short message and we usually reply within one business day.

Christian Wörle

Your contact person

Christian Wörle

Technical Lead

contact@devolute.org