openrouter.ai · openai ·
deepseek/deepseek-v4.1-flash-1017 on openrouter.ai
solid7 of 7 cases passed
90/100trust score
Observed facts across five dimensions
- Protocol compatibilityopenai; legal tool call: yes; parameters: ok
- Agent readiness7/7 cases completed
- Observabilityrelay reported token usage
- Performancetotal duration 21,862 ms
- Reference deviationduration +30%; input tokens +3%; output tokens -5%
Seven test cases
| Case | Result | Latency | Baseline | Difference |
|---|---|---|---|---|
| Basic Tool I/O | Passed | 3,544 ms | 2,514 ms | +41% |
| Multi-File Synthesis | Passed | 7,422 ms | 4,886 ms | +52% |
| Model Context Synthesis | Passed | 3,444 ms | 2,675 ms | +29% |
| Single Tool Call | Passed | 1,392 ms | 2,017 ms | -31% |
| Chained Tool Calls | Passed | 2,059 ms | 1,746 ms | +18% |
| Error Retry & Recovery | Passed | 2,560 ms | 1,919 ms | +33% |
| Long-Context Recall | Passed | 667 ms | 584 ms | +14% |
Tokens and duration
| Metric | Relay | Baseline | Difference |
|---|---|---|---|
| Duration | 21,862 ms | 16,802 ms | +30% |
| Input tokens | 67,012 | 65,034 | +3% |
| Output tokens | 1,792 | 1,881 | -5% |
Previous tests
| Date | Score | Passed |
|---|
Test it again, with your own key
Tested once on 2026-10-27. Relays change — check how openrouter.ai does right now with your own key (1–3 minutes; the key is never stored).
Test it now →The relay host is prefilled; add the API path before starting.