Skip to main content
Fine-tune knowledge base behavior with advanced configuration options. Retrieval Settings

​
Search Methods

​
Retrieval Settings

How many chunks to retrieve:Recommendations:
  • 5-10 chunks: Most use cases
  • 3-5 chunks: Quick answers, cost-sensitive
  • 10-20 chunks: Complex questions, comprehensive answers
Trade-offs:
  • More chunks = more context but slower and costlier
  • Fewer chunks = faster but may miss information
Filter out low-relevance chunks:Range: 0.0 (all results) to 1.0 (exact match only)Recommendations:
  • 0.5-0.6: Lenient, more results
  • 0.7: Balanced, good default
  • 0.8+: Strict, high precision
Size of document segments:Options:
  • 256 tokens: Precise, more chunks needed
  • 512 tokens: Balanced, recommended default
  • 1024 tokens: More context per chunk
Considerations:
  • Smaller chunks = more precise but need more retrievals
  • Larger chunks = more context but less precise
Overlap between consecutive chunks:Typical: 50-100 tokensPurpose:
  • Prevents information loss at boundaries
  • Ensures continuity of context
  • Improves retrieval quality

​
Embedding Models

ModelQualitySpeedCostBest For
FastEmbed (Default)⭐⭐⭐⚡⚡⚡💰Most general use cases
OpenAI Embeddings⭐⭐⭐⭐⭐⚡⚡💰💰💰Critical applications, maximum accuracy
Multilingual Models⭐⭐⭐⭐⚡⚡💰💰International documents, 100+ languages
FastEmbed provides the best balance of quality, speed, and cost for most use cases. Upgrade to OpenAI for mission-critical applications or multilingual models for international content.

​
Advanced Features

Filter by custom metadata fields:Examples:
  • Only documents from “Engineering” department
  • Only documents tagged “2024”
  • Only documents by specific author
  • Only documents of type “Policy”
Configuration:
{
  "metadata_filter": {
    "department": "Engineering",
    "year": "2024",
    "doc_type": "Technical Spec"
  }
}
Control how sources are cited:Options:
  • Include page numbers
  • Show file names
  • Display chunk IDs
  • Add custom metadata in citations
Example Output:
Source: Installation Guide.pdf, Page 3
Department: Engineering
Last Updated: 2024-01-15

Managing Through Flows

Automate knowledge base operations with flows