Building RAG properly: chunking, evaluation, reranking
Most RAG fails at retrieval, not generation. Build a golden set, measure recall@k, run chunking experiments, add a reranker when data says so.
Retrieval-augmented generation done properly — chunking, retrieval evaluation, reranking, and the vector index underneath.
Most RAG fails at retrieval, not generation. Build a golden set, measure recall@k, run chunking experiments, add a reranker when data says so.
ANN search trades accuracy for speed. How HNSW graphs and IVF-PQ quantisation work, which knobs move recall, and how to choose an index.
Retrieval-augmented generation in plain Python: split a PDF into chunks, find the relevant ones, and let Claude answer using only those. No vector database required.
Newsletter
Free essays on learning, Python, and ML — no account required. We’ll only email when there’s something worth reading.