Self-Hosted AI RAG Agent for Internal Knowledge
A building inspection company engaged Osher Digital to develop a self-hosted AI retrieval-augmented generation (RAG) question-and-answer agent. The agent, accessible via full-screen interface or chat bubble on the company intranet, handles staff queries using the internal knowledge base, government legislation, and ISO standards.
Overview
WA Building Inspections sought an AI solution to manage frontline staff questions without constant senior management input. Osher Digital delivered a private, self-hosted RAG agent running in Docker with a local vector database. Staff now access accurate responses instantly on the intranet, improving response times and allowing the owner to focus on strategic tasks.
About the client
WA Building Inspections provides building inspection services across Western Australia. The company maintains an extensive internal knowledge base, complies with government legislation, and adheres to ISO standards. With growing staff numbers, the owner handled increasing volumes of operational and compliance queries, limiting time for core business activities.
Problem
Staff relied on the owner for answers to questions about procedures, legislation, and standards. This created bottlenecks, delayed responses, and interrupted the owner’s schedule. Existing documentation was available but required manual searches, leading to inconsistent answers and reduced efficiency.
Solution
Osher Digital built a self-hosted AI RAG agent trained on the company’s internal knowledge base, relevant government legislation, and ISO standards. The agent operates privately within the company’s infrastructure.
Key components include:
- Docker container for deployment and management.
- Local vector database for fast, secure retrieval.
- Full-screen display or chat bubble interface on the intranet.
- Retrieval-augmented generation to ensure responses are grounded in source documents.
- Responses include links to source documents in chat responses.
The system remains fully under company control with no external data exposure.
Business Improvements
- Staff now resolve routine queries independently, with the owner involved only in complex cases.
- Responses are delivered instantly and consistently reference the exact source documents.
- The owner has redirected time previously spent on repetitive questions toward business development and client relationships.
- Team confidence in compliance and procedural accuracy has increased due to reliable, legislation-grounded answers.
- The solution operates entirely on existing infrastructure with no external dependencies.
Ready to streamline your operations?
Get in touch for a free consultation to see how we can streamline your operations and increase your productivity.