maaz.code logo
Simple view

In progress

Enterprise RAG System with LLM-as-a-Judge

Hybrid-retrieval RAG with an LLM judge that scores every answer for faithfulness, relevance and toxicity.

  • Python
  • FastAPI
  • React
  • TypeScript
  • LangChain
  • PostgreSQL
  • Qdrant
  • Docker

What it does

A retrieval-augmented generation system for enterprise documents that also grades its own answers.

  • Hybrid retrieval: dense embeddings (text-embedding-3-small) in Qdrant, combined with BM25 keyword search.
  • LLM-as-a-Judge: a second model with Pydantic structured outputs scores each answer for faithfulness, context relevance and toxicity.
  • Observability: async PostgreSQL logging of query trails, latency and scores.
  • Frontend: React + TypeScript with streaming answers, citations and Recharts analytics.
  • Shipping: Docker Compose, with CI/CD on GitHub Actions.