← Back to Portfolio

RAG Evaluation Framework

Project information

  • Type: Internal tooling (built at Moderna)

RAG Evaluation Framework

Using hexagonal architecture, I implemented a pluggable framework to evaluate different RAG options for chunking, vector DB, search, retrieval, and augmentation.

This wasn't just a design exercise — it drove real tuning decisions using a curated "hero set" of 10 semantic and 10 keyword evaluation cases as the benchmark, letting me compare retrieval configurations against measurable results rather than guesswork.