Use case 01
Private assistant over policies and regulation
A bank wants an internal assistant that answers staff questions about procedures, CBN circulars and product terms, citing the source. None of the documents may leave the bank's network.
Technologies
- Open-weight LLM
- GPU inference server
- OpenSearch
- Apache Kafka
- Kubernetes
- MinIO
- OpenMetadata
Expected outcome
Staff get sourced answers in seconds; the bank keeps every document, prompt and answer inside its own perimeter.
Metric: Answers grounded in cited sources, 0 external calls
- 1Ingest documents. Policies, circulars and manuals pulled from document stores with permissions preserved per document.
- 2Chunk and embed. Text split, embedded with an open-weight model and stored with metadata for filtering.
- 3Index for retrieval. Vectors and keywords indexed together; hybrid search returns passages the user is allowed to see.
- 4Generate with citations. An open-weight LLM answers from retrieved passages only and links each claim to its source.
- 5Evaluate and monitor. A test set of real staff questions scored on every model or prompt change before release.
- 6Audit every answer. Prompts, retrieved passages and responses logged in-country with retention for review.