Support assistant over 2,000 internal articles
RAG on an open 8B modelIllustrative scenario based on a typical SMB knowledge base. Before: a public chat API with pasted context. After: a private retrieval pipeline with citations.
- Answer grounded in sourceSometimes
- p50 latency~1.9 s
- Cost / 1M tokens€9.80
- Data leaving the EUYes
- Answer grounded in sourceiAlways cited
- p50 latencyi~0.7 s
- Cost / 1M tokensi€1.40
- Data leaving the EUiNo