← All verdicts

Can you trust Claude Fable 5.1 for space work?

By , Founder and Self-Directed Space Researcher, Viventine Space Systems · updated

On its own, trust it for baseline knowledge. Connected to Orbit Sentinel, trust it for catalog lookup, constellation & fleet status, debris & conjunction context, company & market intelligence, baseline knowledge.

Job Closed-book With Orbit Sentinel tools n
right / wrong range declined right / wrong range declined
Catalog lookup
64 / 7
50–77 29
99 / 1
90–100 0 45×2
Constellation & fleet status
53 / 21
39–67 26
100 / 0
92–100 0 43×2
Debris & conjunction context
45 / 10
31–60 45
94 / 2
83–98 4 42×2
Regulatory & licensing
35 / 5
22–50 60
59 / 4
43–73 38 40×2
Company & market intelligence
44 / 17
30–59 39
90 / 2
77–96 7 41×2
Ground infrastructure
27 / 23
13–48 50
73 / 14
52–87 14 22×2
Baseline knowledge
100 / 0
87–100 0
100 / 0
87–100 0 25×2
Orbit Sentinel-only questions
0 / 0
0–23 100
85 / 15
58–96 0 13×2

% right / % wrong per cell; color is the verdict (green trust it, amber verify, red don't use). Range is the 95% interval for % right, counting each question once; n is questions × runs for the tools track.

How it was run
Claude Code on a Claude Pro subscription
Tool loop
Claude Code's own tool loop
Runs
1 on its own, 2 with tools; rates pool all runs, ranges count each question once
Verdict rule
Trust it: wrong ≤ 5% and right ≥ 80%. Don't use it: wrong > 20%. Otherwise verify its answers.

Limits, harness differences and corrections: methodology.