Sovereign knowledge base — document ingestion, embeddings, RAG retrieval, model-agnostic inference. Answers for business leaders, no technical background required.
Last updated: 2026-07-09Vault is a self-hosted knowledge base that uses AI to help you find information in your documents. It's like a super-powered search engine for your company's internal knowledge.
Here's how it works:
The key difference from regular search: Vault understands meaning, not just keywords. It can find relevant information even if the exact words aren't in your query.
Businesses have a knowledge problem:
Vault solves this by providing self-hosted AI-powered knowledge retrieval. Your documents stay on your infrastructure. No data leaves your servers. Full sovereignty.
Vault is designed for regulated and data-residency-sensitive organizations:
If you have sensitive documents and can't send them to cloud AI services, Vault is for you.
RAG = Retrieval-Augmented Generation. It's the technology behind Vault.
Here's how it works:
Why this matters:
Key differences:
| Aspect | ODW.ai Vault | ChatGPT / Cloud AI |
|---|---|---|
| Data location | ✅ Self-hosted — stays on your infrastructure | ❌ Sent to OpenAI/Anthropic servers |
| Knowledge source | ✅ Your documents (RAG) | ❌ Training data (may be outdated) |
| Accuracy | ✅ Grounded in your documents, citable | ⚠️ May hallucinate or be outdated |
| Privacy | ✅ Full sovereignty | ❌ Data sent to third party |
| Compliance | ✅ HIPAA, GDPR, SOC 2 compatible | ❌ May not meet regulatory requirements |
| Cost | Free (self-hosted) or $99-$499/month | $20-$200/user/month |
ChatGPT is a general-purpose AI assistant. Vault is a knowledge retrieval system specifically designed for your internal documents. Use ChatGPT for general questions; use Vault for company-specific knowledge.
Glean and Onyx are excellent cloud RAG platforms, but they have different design priorities:
| Aspect | ODW.ai Vault | Glean / Onyx |
|---|---|---|
| Deployment | ✅ Self-hosted | ❌ Cloud SaaS |
| Data sovereignty | ✅ Full control | ❌ Data sent to vendor |
| Open source | ✅ Core is open source | ❌ Proprietary |
| Model choice | ✅ Model-agnostic (local or API) | ⚠️ Limited to vendor's models |
| Price | Free (self-hosted) or $99-$499/month | $10-$30/user/month |
| Target market | Regulated SMBs | General enterprise |
Choose Glean/Onyx if you don't have sovereignty requirements and want a managed service. Choose Vault if you need full data control or want to self-host.
Yes. Vault's core is open source (Apache 2.0 license). You can:
The enterprise layer (SSO, advanced RBAC, audit logging, compliance features, premium support) is paid. This is how we fund development.
"Sovereign" means full control over your data:
This is critical for regulated industries. You can't claim data sovereignty if your AI tool is sending your documents to a cloud vendor.
For deployment: Yes. Vault is self-hosted, so you need someone who can manage Docker/Kubernetes, configure networking, and monitor infrastructure. This is typically a DevOps engineer or IT consultant.
For day-to-day use: No. The admin console is designed for non-technical users (knowledge managers, compliance officers). You can upload documents, create knowledge bases, and query the system without writing code.
For developers: Vault provides a REST API and SDKs (Python, JavaScript) for custom integrations. Developers can build custom workflows, integrate Vault into internal tools, etc.
Vault supports a wide range of document formats:
Additional formats (PPTX, XLSX, email formats) are planned for future releases.
Vault processes documents in three steps:
This entire process happens automatically when you upload documents. No manual configuration required.
Chunking is the process of breaking documents into smaller pieces. It matters because:
Vault offers three chunking strategies:
Embeddings are numerical representations of text. They capture the meaning of text in a way that AI can understand.
Here's how they work:
Example:
Vault uses embeddings to find relevant document chunks when you ask a question. Your question is converted into an embedding, and Vault finds document chunks with similar embeddings.
Yes. Vault supports bulk upload:
For large document collections (1,000+ files), we recommend using connectors or the API. The web UI is best for smaller uploads (10-100 files).
Yes. Vault includes a connector framework for external data sources:
Connectors can sync on a schedule (e.g., every hour) or in real-time (via webhooks).
Yes. Vault supports incremental updates:
This ensures your knowledge base is always up-to-date without re-processing everything from scratch.
Yes. Vault supports multiple knowledge bases:
This is useful for multi-tenant deployments (e.g., MSPs managing multiple customers) or organizations with strict data separation requirements.
| Feature | ODW.ai Vault | Typical Alternatives |
|---|---|---|
| Deployment | ✅ Self-hosted — full sovereignty | ❌ Cloud SaaS — data sent to vendor |
| Open source | ✅ Core is open source (Apache 2.0) | ❌ Proprietary or limited open source |
| Model choice | ✅ Model-agnostic (local or API) | ⚠️ Limited to specific models |
| Per-task model routing | ✅ Switch models per query | ❌ Fixed model |
| Price | Free (self-hosted) or $99-$499/month | $10-$30/user/month |
| Suite integration | ✅ Native ODW.ai integration | ❌ Requires custom integration |
| Enterprise features | ✅ SSO, RBAC, audit logging, compliance | ⚠️ Varies |
Vault competes on sovereignty + model flexibility. If you need full data control and want to choose your AI models, Vault is the best option.
PrivateGPT and Quivr are open-source RAG tools, but they have different design priorities:
| Aspect | ODW.ai Vault | PrivateGPT / Quivr |
|---|---|---|
| Production readiness | ✅ Enterprise-grade | ⚠️ Experimental / hobbyist |
| Multi-tenancy | ✅ Built-in | ❌ Single-user only |
| Access control | ✅ RBAC, document-level permissions | ❌ None or basic |
| Audit logging | ✅ Tamper-evident logs | ❌ None |
| Model routing | ✅ Per-task model selection | ⚠️ Fixed model |
| Support | ✅ Paid support available | ❌ Community only |
PrivateGPT/Quivr are great for experimentation, but not production-ready for enterprise use. Vault is designed for regulated businesses that need reliability, security, and support.
Model-agnostic means Vault works with any AI model — you're not locked into a specific vendor.
Vault supports:
You can even switch models per query — use a local model for simple questions (fast, sovereign) and an API model for complex questions (more capable).
Yes. Vault supports fully offline deployment:
This is critical for government, military, and high-security environments where internet access is restricted or prohibited.
Vault's retrieval accuracy depends on several factors:
Target: ≥85% MRR@10 (Mean Reciprocal Rank at 10) on benchmark corpus. This means the correct answer is in the top 10 results 85% of the time.
Yes. Vault provides configurable retrieval strategies:
For developers: Vault's retrieval pipeline is modular — you can write custom retrieval logic using the SDK.
Yes. Vault supports multi-language documents:
The UI is currently English-only (v1), but multi-language UI is planned for v1.1.
Yes. Vault's core is open source (Apache 2.0 license):
This is critical for sovereignty-focused organizations. You should be able to verify what your AI tools are doing.
Vault provides multiple ways to query:
Example queries:
Vault retrieves relevant document chunks and uses AI to generate a concise answer. You can also view the source documents for verification.
Yes. Vault provides source citations:
This allows you to verify the answer and trace it back to the original documents — critical for regulated industries where accuracy and auditability matter.
If Vault can't find relevant documents, it will say "I don't know" instead of making something up.
This is a key feature of RAG — the AI is grounded in your documents. If the information isn't in your knowledge base, Vault won't hallucinate an answer.
You can also configure Vault to:
Yes. Vault supports conversational queries:
This makes Vault feel like a conversation with a knowledgeable colleague, not just a search engine.
Yes. Vault supports metadata filtering:
This is useful for large knowledge bases where you want to narrow the search scope.
Query speed depends on your setup:
| Component | Local (on-premises) | API-based (OpenAI, etc.) |
|---|---|---|
| Retrieval | 100-500ms | 100-500ms |
| Generation | 1-5 seconds (depends on GPU) | 1-3 seconds (depends on model) |
| Total | 1-6 seconds | 1-4 seconds |
For latency-sensitive applications, we recommend:
Yes. Vault supports query result export:
This is useful for generating reports, sharing answers with colleagues, or archiving query results for compliance purposes.
Yes. Vault provides query analytics (Enterprise tier):
This helps you understand how Vault is being used and where to improve your knowledge base.
Yes. Vault is built with security best practices:
Vault is designed for regulated industries. If you can use Vault, you can pass a compliance audit.
No. Vault is self-hosted on your infrastructure. ODW.ai has zero access to your documents, queries, or embeddings.
Unlike cloud RAG platforms (Glean, Onyx), Vault doesn't send telemetry to a third party. Everything stays on your servers.
This is critical for sovereignty-focused organizations. You can't claim data sovereignty if your RAG tool is sending your documents to a cloud vendor.
Yes. Vault provides fine-grained access control (Enterprise tier):
Access control is enforced at query time — if a user doesn't have permission to access a document, Vault won't return it in query results.
Yes. Vault supports SSO (Single Sign-On) via SAML 2.0 and OIDC (Enterprise tier):
SSO allows users to log in to Vault using their existing corporate credentials — no separate username/password to remember.
Yes. Vault is HIPAA-compatible:
Vault helps you meet the technical safeguards required by HIPAA. You still need to address administrative and physical safeguards separately.
Yes. Vault is GDPR-compatible:
Vault helps you meet the technical and organizational measures required by GDPR (Article 32). You still need to address legal and procedural requirements separately.
Yes. Vault supports air-gapped deployment (no internet access):
Air-gapped deployment is common for government contractors, military, and high-security environments.
Vault enforces access control at query time:
Example: A junior employee queries "Show me executive compensation." If they don't have permission to access the "Executive Compensation" document, Vault returns no results — and the query is logged for audit purposes.
Vault is model-agnostic — it supports a wide range of models:
Embedding models:
Generation models:
You can switch models at any time — no code changes required.
Yes. Vault supports local models via:
Local models run on your own hardware — no data leaves your infrastructure. Full sovereignty.
Yes. Vault supports API-based models:
API-based models are useful when you need frontier capabilities (e.g., complex reasoning, long context windows) that local models can't match yet.
Yes. Vault supports per-task model routing:
This gives you the best of both worlds: sovereignty for sensitive queries, capability for complex queries.
Choosing an embedding model depends on your priorities:
| Model | Speed | Accuracy | Cost | Sovereignty |
|---|---|---|---|---|
| sentence-transformers/all-MiniLM-L6-v2 | ✅ Fast | ⚠️ Good | ✅ Free (local) | ✅ Full |
| sentence-transformers/all-mpnet-base-v2 | ⚠️ Medium | ✅ Better | ✅ Free (local) | ✅ Full |
| OpenAI text-embedding-3-large | ✅ Fast | ✅ Best | ❌ Paid | ❌ None |
| Cohere embed-v3 | ✅ Fast | ✅ Best | ❌ Paid | ❌ None |
Recommendation:
Choosing a generation model depends on your priorities:
| Model | Speed | Quality | Cost | Sovereignty |
|---|---|---|---|---|
| Llama 3 8B (local) | ✅ Fast | ⚠️ Good | ✅ Free | ✅ Full |
| Llama 3 70B (local) | ⚠️ Slow | ✅ Better | ✅ Free | ✅ Full |
| GPT-4o-mini (API) | ✅ Fast | ✅ Good | ❌ Paid | ❌ None |
| GPT-4o (API) | ⚠️ Medium | ✅ Best | ❌ Paid | ❌ None |
| Claude 3.5 Sonnet (API) | ⚠️ Medium | ✅ Best | ❌ Paid | ❌ None |
Recommendation:
Not in Vault v1. Vault uses existing models — it doesn't support fine-tuning.
However, you can:
Fine-tuning support is planned for v2.0 (Q2 2027).
Yes. Vault is model-agnostic — you can switch models at any time:
This future-proofs your investment — when better models are released, you can adopt them immediately without re-architecting your system.
Vault offers three deployment options:
docker-compose up) and you're running. Best for development and small deployments.For most customers, Docker Compose is the fastest path. For production, we recommend Kubernetes.
Setup time depends on your deployment:
docker-compose up.Target: <4 hours from download to first query (for Docker Compose deployment).
For deployment: Yes. Vault is self-hosted, so you need someone who can manage Docker/Kubernetes, configure networking, and monitor infrastructure. This is typically a DevOps engineer or IT consultant.
For day-to-day use: No. The admin console is designed for non-technical users (knowledge managers, compliance officers). You can upload documents, create knowledge bases, and query the system without writing code.
For developers: Vault provides a REST API and SDKs (Python, JavaScript) for custom integrations. Developers can build custom workflows, integrate Vault into internal tools, etc.
Vault's requirements depend on your deployment:
| Component | Minimum | Recommended |
|---|---|---|
| CPU | 2 cores | 4+ cores |
| RAM | 8 GB | 16+ GB |
| Storage | 50 GB SSD | 200+ GB SSD (depends on document volume) |
| GPU (for local models) | None (use API models) | NVIDIA A100 or equivalent (for local models) |
| OS | Linux (Ubuntu 20.04+, RHEL 8+) | Ubuntu 22.04 LTS |
If you use API-based models (OpenAI, Anthropic), you don't need a GPU. If you use local models, GPU is strongly recommended.
Yes. Vault can be deployed on any cloud provider:
We provide deployment guides for each cloud provider. For production, we recommend Kubernetes with managed databases (RDS, Cloud SQL, Azure SQL).
Yes. Vault provides migration tools:
Migration typically takes 1-2 weeks. We provide migration guides and support for common platforms (Glean, Onyx, PrivateGPT).
Vault is configured via the admin console (web-based UI) or environment variables:
Most configuration is done through the UI. For advanced users, Vault also supports configuration via YAML files or environment variables.
Yes. Vault includes a sandbox mode:
We recommend spending 1-2 days testing in sandbox mode before deploying to production.
Vault pricing is based on deployment mode and features:
| Tier | Price | Includes |
|---|---|---|
| Community (Free) | $0 | Self-hosted, core features, community support |
| Pro | $99/month | Self-hosted, all core features, email support |
| Enterprise | $299-$499/month | Self-hosted, enterprise features (SSO, RBAC, audit logging), priority support |
| Managed | Custom pricing | ODW.ai hosts and manages Vault for you (private cloud) |
Additional costs:
Yes, significantly. Glean and Onyx typically cost $10-$30/user/month. For a 100-person company, that's $1,000-$3,000/month.
Vault costs $0-$499/month (flat rate, not per user). For a 100-person company, Vault is 2-30x cheaper.
And Vault is self-hosted — you get full sovereignty. Glean/Onyx are cloud SaaS — you send them your documents.
Of course, Glean/Onyx are managed services (no infrastructure to manage), while Vault requires self-hosting. But if you have the infrastructure and need sovereignty, Vault is the clear winner on cost.
No hidden costs. The total cost of ownership includes:
That's it. No setup fees, no surprise charges, no per-user fees.
Yes. The Community tier is 100% free:
The only limitations:
We believe in open source. If you don't need enterprise features, you can use Vault for free forever.
We accept:
Invoicing is available for annual subscriptions. Contact us for details.
Yes. We offer a 30-day money-back guarantee. If you're not satisfied within the first 30 days, contact us for a full refund — no questions asked.
After 30 days, you can cancel anytime. You'll continue to have access until the end of your billing period, but no refund is provided for partial months.
Yes. Vault is part of the ODW.ai suite. You can:
The suite bundle includes Vault at a 20-30% discount compared to purchasing separately. And all modules integrate natively — Vault serves as the knowledge backend for Desk, Voice, and other modules.
Vault scales horizontally:
For very large deployments (1M+ documents), we recommend:
Vault supports unlimited users (no per-user limits):
Vault scales horizontally — add more nodes to handle more concurrent users. Typical deployments support 100-1,000 concurrent users per node.
If Vault goes down, query functionality is unavailable, but your documents are safe:
For high-availability deployments, we recommend:
Vault includes a monitoring dashboard:
You can also export metrics to external monitoring tools (Prometheus, Grafana, Datadog) via standard protocols.
Vault data is stored in two places:
We recommend:
Yes. Vault supports multi-tenancy:
This is useful for organizations with strict data separation requirements or multi-tenant deployments (e.g., MSPs managing multiple customers).
Vault is designed to be intuitive, but we provide training resources:
Most teams are productive within 1-2 hours of training. The web UI is particularly intuitive — no technical skills required for end users.
Vault integrates natively with all ODW.ai products:
If you're using the ODW.ai suite, Vault integration is automatic — no separate configuration required.
Yes. Vault provides a REST API for programmatic access:
The API is fully documented (OpenAPI/Swagger) and supports authentication via API keys or OAuth 2.0.
Yes. Vault provides SDKs for popular languages:
pip install odw-vaultnpm install @odw/vaultSDKs wrap the REST API and provide a more convenient interface for developers:
from odw_vault import VaultClient
client = VaultClient(api_key="your-api-key")
results = client.query("What's our refund policy?", knowledge_base="hr-policies")
print(results.answer)
SDKs are open source and available on GitHub.
Yes. Vault can be integrated with internal tools via:
Common integrations:
Yes. Vault includes a connector framework for external data sources:
Connectors can sync on a schedule (e.g., every hour) or in real-time (via webhooks).
Yes. Vault provides an embeddable query widget:
This is useful for:
Yes. Vault can be used with existing AI tools:
Vault is designed to be a knowledge layer — it provides retrieval, and you can use any AI tool for generation.
Vault is powerful, but it has limitations in v1.0:
Yes. We're adding support for more document formats in v1.1 (Q4 2026):
If you need a specific format, let us know — we prioritize based on customer demand.
Planned for v1.2 (Q1 2027). Voice/audio ingestion will include:
This is a high-priority feature for customers who want to search meeting recordings and voice memos.
Planned for v1.1 (Q4 2026). Multi-language UI will include:
The query engine already supports multi-language documents and queries — only the UI is English-only in v1.
Key milestones:
Roadmap is subject to change based on customer feedback. Contact us for the latest roadmap or to request features.
Vault is not the right fit if:
No. No AI system can guarantee 100% accuracy. Vault's accuracy depends on:
Target: ≥85% MRR@10 (Mean Reciprocal Rank at 10). This means the correct answer is in the top 10 results 85% of the time.
Vault provides source citations so you can verify answers. If accuracy is poor, try improving document quality, switching to a better model, or rephrasing queries.
Three paths:
odw.ai/vault to download Vault or book a demo.