Vectara's models
Vectara's advanced end-to-end agentic models have pioneered enterprise-grade agent context and accuracy.
Best-of-breed models at every stage
- Query
A question from a person or an agent
- BoomerangRetrieval model
- Stateless hybrid search
- Coarse-grained sorting of results
- SlingshotReranker model
Fine-grained sorting of results
- MockingbirdGenerative LLM
Knows how to form accurate answers based on results
- HHEMHallucination evaluation
Detects hallucinations by checking the response against the results
- Your data
Expresses meaning in words (tokens)
- Vector database
Stores meaning in vectors
- Response + factual consistency score
Boomerang v2
Documentation
Boomerang’s performance benchmarks
Performance details (September 2026)Semiconductor Retrieval Benchmark
Boomerang v1 is text-only. Amazon Nova 2 MM can't embed a figure with its caption.
| Model | Text, nDCG@10 | Image only, nDCG@5 | Image with captions, nDCG@5 |
|---|---|---|---|
| Boomerang v2 | 0.615 | 0.612 | 0.758 |
| Boomerang v1 | 0.520 | Text-only | Text-only |
| Gemini Embedding 2 | 0.586 | 0.710 | 0.662 |
| Qwen3-VL-Embedding-2B | 0.424 | 0.503 | 0.679 |
| Amazon Nova 2 MM | 0.558 | 0.535 | Text/image-only |
Text and Image Retrieval
Boomerang v1 is text-only.
| Model | BEIR (14), nDCG@10 | MIRACL (9), nDCG@10 | Visual documents (24), nDCG@5 | Images (12), P@1 |
|---|---|---|---|---|
| Boomerang v2 | 0.470 | 0.539 | 0.709 | 0.640 |
| Boomerang v1 | 0.455 | 0.481 | Text-only | Text-only |
Trade-Off Between Quality and Embedding Size
Semiconductor text retrieval, each model at its default embedding size
Slingshot
Documentation
Slingshot’s performance benchmarks
Performance details (May 2024)Vectara rerank vs other models, by domain
Higher is better
| Model | Dev | Shopping | News | Wiki | Social/Forum |
|---|---|---|---|---|---|
| Vectara Rerank | 0.85 | 0.45 | 0.57 | 0.85 | 0.79 |
| Cohere Rerank V3 | 0.84 | 0.41 | 0.55 | 0.84 | 0.79 |
| BCE-reranker-base | 0.82 | 0.40 | 0.51 | 0.82 | 0.76 |
| Mono MT5 | 0.81 | 0.40 | 0.48 | 0.81 | 0.74 |
| BGE-reranker-base | 0.81 | 0.37 | 0.45 | 0.81 | 0.75 |
Vectara rerank vs other models, by language
Higher is better
| Model | Chinese | Thai | Telugu | Hindi | Bengali | Korean | Japanese | Arabic | Swahili |
|---|---|---|---|---|---|---|---|---|---|
| Vectara Rerank | 0.52 | 0.68 | 0.68 | 0.59 | 0.73 | 0.61 | 0.56 | 0.70 | 0.67 |
| Cohere Rerank V3 | 0.61 | 0.71 | 0.71 | 0.60 | 0.78 | 0.67 | 0.61 | 0.74 | 0.69 |
| Mono MT5 | 0.52 | 0.66 | 0.60 | 0.56 | 0.67 | 0.58 | 0.52 | 0.63 | 0.62 |
| BCE-reranker-base | 0.45 | 0.60 | 0.54 | 0.51 | 0.63 | 0.57 | 0.49 | 0.61 | 0.48 |
| BGE-reranker-base | 0.46 | 0.52 | 0.60 | 0.34 | 0.56 | 0.45 | 0.33 | 0.56 | 0.53 |
Mockingbird v3 MM

Mockingbird’s performance benchmarks
Development process (October 2026)Semiconductor Benchmarks
MMCircuitEval: public multimodal circuit benchmark
| Model | Internal Semiconductor Benchmark | MMCircuitEval |
|---|---|---|
| Mockingbird V3 MM | 0.6573 | 0.4763 |
| GPT-6 Astra | 0.6545 | 0.4796 |
| Inkling-Small | 0.6922 | 0.4734 |
| Gemma4 31B Base | 0.5781 | 0.4572 |
General Knowledge and Reasoning
| Model | MMLU-Pro |
|---|---|
| Mockingbird V3 MM | 0.7315 |
| GPT-6 Astra | 0.9017 |
| Inkling-Small | 0.8661 |
| Gemma4 31B Base | 0.8459 |
Hughes Hallucination Evaluation Model (HHEM)
Documentation
Our Hallucination Evaluation Model is a first-of-its-kind initiative to proffer a commercially available and open-source model that addresses the accuracy and level of hallucination in LLMs.

HHEM’s hallucination detection performance benchmarks
Performance details (August 2024)Hallucination detection, F1 score
Higher is better
| Model | AggreFact-SOTA | RAGTruth-QA | RAGTruth-Summarization |
|---|---|---|---|
| HHEM v2 | 68.6% | 67.1% | 55.6% |
| GPT-4 | 63.9% | 57.8% | 40.6% |
| GPT-3.5 Turbo | 60.9% | 25.0% | 29.7% |
Remembering a champion of responsible AI
The Hughes Hallucination Evaluation Model honors Dr. Simon Mark Hughes, a pioneering machine learning engineer at Vectara. His research on AI hallucination detection, before his passing in 2023, continues to shape industry efforts toward truthful and reliable AI outputs.

Create AI Agents in minutes
Vectara is the Agent OS for trusted enterprise AI: governed, grounded, auditable agents with real-time policy and factual-consistency enforcement.
