In progress
Enterprise RAG System with LLM-as-a-Judge
Hybrid-retrieval RAG with an LLM judge that scores every answer for faithfulness, relevance and toxicity.
What it does
A retrieval-augmented generation system for enterprise documents that also grades its own answers.
- Hybrid retrieval: dense embeddings (
text-embedding-3-small) in Qdrant, combined with BM25 keyword search. - LLM-as-a-Judge: a second model with Pydantic structured outputs scores each answer for faithfulness, context relevance and toxicity.
- Observability: async PostgreSQL logging of query trails, latency and scores.
- Frontend: React + TypeScript with streaming answers, citations and Recharts analytics.
- Shipping: Docker Compose, with CI/CD on GitHub Actions.