Discussion on "Your RAG demo works. But is it production-ready ?"

Mete Mertkan · 2026-10-31T14:54:31.195Z

Beyond RAG: Evolving an Enterprise Retrieval Engine Through Better Architecture A RAG demo is relatively easy to build. Load a few documents, split them into chunks, generate embeddings, store those v

Hashing content plus tenant metadata into the doc ID handles retries well. A revised policy PDF hashes to a new ID, though, so as far as I can tell the old version's chunks stay indexed next to the new ones. I didn't see a superseded state in the lifecycle. Is retiring old versions part of the ingestion episode?

Exactly, i see ingestion as a strategy for retrieving it later. Let's discuss that when I publish the next episode. Thanks for your input, appreciate it

The profile precedence chain is useful, but startup validation only covers values already known at startup. Request-level overrides arrive later and can still produce an invalid or unexpectedly expensive effective profile even if every named YAML profile is valid.

I would validate the fully resolved configuration per request, including bounds on top_k, candidate depth, and context budget, while keeping authorization constraints outside the override mechanism. Recording that resolved profile with the retrieval trace would also let you reproduce a result without guessing which defaults and overrides were active when it was served.

Thanks for the input, this is the first episode of the series where I will deep dive into different parts of the project. Request-level validation and reproducibility are definitely important pieces of production-ready retrieval. Where I will touch upon on the following episodes.

In the next episode, I'm going to focus on document ingestion — another critical part of the RAG pipeline. I'll explore how to make ingestion more reliable, handle different document structures, and deal with failures without leaving the knowledge base in an inconsistent state.

There's a lot more to RAG than retrieval! More coming soon. 🚀

Search Hashnode

Your RAG demo works. But is it production-ready ?

Responses4