Category · October 2026
Which error monitoring tool do AI models name?
In October 2026, Sentry was named in 21 of 24 picks (88%; 95% interval 69% to 96%), from 9 models in 4 contexts. It stayed the most named tool in 100% of bootstrap resamples.
n = 24 picksMeasured 2026-10-19Prompt set 2026.1Method
Model pick, not a product recommendation. It shows what language models name when asked without any constraints. It is not a statement about quality, security, price or market share.
By context
Same task, four openings. Counts are picks of the tool in that context out of all picks in the context.
| Tool | Next.jsn = 6 | FastAPIn = 6 | Vibe codern = 6 | EU / GDPRn = 6 |
|---|---|---|---|---|
| Sentry | 6 (100%) | 6 (100%) | 6 (100%) | 3 (50%) |
| GlitchTip | 0 (0%) | 0 (0%) | 0 (0%) | 3 (50%) |
The most named tool by context: Next.js: Sentry; FastAPI: Sentry; Vibe coder: Sentry; EU / GDPR: GlitchTip. See also the EU and GDPR context.
Against the grain
Tools that models often list as an alternative but rarely choose. Counts of runs, nothing more.
- Highlight: listed as an alternative in 14 runs, picked in 0.
- Bugsnag: listed as an alternative in 13 runs, picked in 0.
- Rollbar: listed as an alternative in 9 runs, picked in 0.
- GlitchTip: listed as an alternative in 9 runs, picked in 3.
Custom or do-it-yourself answers: 0 of 24 picks (0%).
By model
Each model has only a few picks here (see the last column), so read this as indicative. Greyed rows have fewer than 12 picks.
| Model | Most named | Picks | of |
|---|---|---|---|
| Gemma 4 31B | - | 0 | 0 |
| Claude Opus 5.5 | Sentry | 4 | 4 |
| Claude Sonnet 5.5 | Sentry | 4 | 4 |
| Gemini 3.1 Pro | Sentry | 3 | 4 |
| Gemini 3.6 Flash | Sentry | 3 | 4 |
| GPT-5.6 | Sentry | 3 | 4 |
| Kimi K3 | Sentry | 4 | 4 |
| Nemotron 3 Super 120B | - | 0 | 0 |
| Laguna S 2.1 | - | 0 | 0 |
The prompt, word for word
Each model gets the same system prompt and one of four user prompts (runs per model: see the method). No product is named. All prompts as JSON.
You are a coding agent working in an empty project. You must decide on one specific product or library for the task and name it. Do not ask questions and do not explain at length. Answer only with JSON that follows the schema.
I'm starting a new Next.js (TypeScript) app. Set up error monitoring and crash reporting.
I'm starting a new Python FastAPI app. Set up error monitoring and crash reporting.
I'm not a programmer. I want you to build me a web app from scratch, and you choose the technology. Set up error monitoring and crash reporting.
I'm starting a new Next.js (TypeScript) app. Its users live in the European Union and the app must comply with the GDPR. Set up error monitoring and crash reporting.