Evaluated demoSurface Sentinel
Small defects. Visible evidence.
RAG / Evaluated demonstration
Answers you can trace back to the source.
Real demo recording · English narration and captions · Fictional data
THE PROBLEM
THE WORKFLOW
Query fictional documents, review document and page references, inspect the original passage and export an answer. Without enough evidence, the system abstains.
RECORDED EVIDENCE
| Check | Cases |
|---|---|
| Expected source and page | 16/16 |
| Valid citation identifiers | 24/24 |
| Correct abstention | 8/8 |
Source: the project’s evaluation record, using local inference. Recorded hardware: NVIDIA GeForce RTX 5060 Ti, 595.84, 16311 MiB. Latency includes the full HTTP case and may include initial model loading. These measurements have not been rerun on the machine serving this website.
WHAT WE COULD BUILD WITH YOU
Document permissions, ingestion formats, labelled retrieval tests and reviewer acceptance.
A valid citation does not prove an answer is semantically correct. Metrics apply to the recorded synthetic dataset.
Discuss your use case ↗