Which AI can you trust for baseline knowledge?
By Anthony Vincent Caracappa, Founder and Self-Directed Space Researcher, Viventine Space Systems · updated
Space history and orbital mechanics: facts and calculations that do not change.
On their own: Claude Fable 5.1, Claude Haiku 5.5, Claude Opus 5.5, Claude Sonnet 5.5, Grok 4.7. With Orbit Sentinel tools: Claude Fable 5.1, Claude Haiku 5.5, Claude Opus 5.5, Claude Sonnet 5.5, Grok 4.7, Gemma 4 12B.
| AI | Closed-book | With Orbit Sentinel tools | n | ||||
|---|---|---|---|---|---|---|---|
| right / wrong | range | declined | right / wrong | range | declined | ||
| Claude Fable 5.1 Anthropic | 100 / 0 | 87–100 | 0 | 100 / 0 | 87–100 | 0 | 25×2 |
| Claude Haiku 5.5 Anthropic | 100 / 0 | 87–100 | 0 | 99 / 1 | 84–100 | 0 | 25×3 |
| Claude Opus 5.5 Anthropic | 100 / 0 | 87–100 | 0 | 100 / 0 | 87–100 | 0 | 25×3 |
| Claude Sonnet 5.5 Anthropic | 100 / 0 | 87–100 | 0 | 100 / 0 | 87–100 | 0 | 25×3 |
| Grok 4.7 xAI | 96 / 0 | 80–99 | 4 | 98 / 0 | 83–100 | 2 | 25×2 |
| Gemma 4 12B Google | 92 / 8 | 67–99 | 0 | 89 / 3 | 70–97 | 8 | 23×3 |
| gpt-oss 20B OpenAI | 75 / 17 | 55–88 | 8 | 85 / 7 | 67–94 | 8 | 25×3 |
| DeepSeek-R1 14B DeepSeek | 58 / 42 | 39–76 | 0 | — | 24×1 | ||
% right / % wrong per cell; color is the verdict (green trust it, amber verify, red don't use). Range is the 95% interval for % right, counting each question once; n is questions × runs for the tools track.