## Break Your Own RAG Pipeline Before Users Do A small adversarial test set that catches the retrieval failures your evaluation set never will ## Introduction Retrieval-augmented generation (RAG) answers questions using information retrieved from a set of documents. That document collection is called a corpus. A typical evaluation sends a well-written question to a tidy corpus and checks whether the retriever returns the correct passage. Production document collections rarely stay tidy. Old pages remain searchable after a policy changes. Users type "warehuse" instead of "warehouse." Optical…