Free tool
Score your tool schemas against 4,749 public servers
Paste the tools/list JSON your
server returns. You get your undescribed-parameter rate, your description collisions and
your schema token cost, each next to the same figure measured across 4,749 servers in our survey.
It runs entirely in this tab. Your schema is never uploaded, and there is no request to remove — how it works.
The whole JSON-RPC response, the result object,
or just the array of tools — any of the three.
What it measures
Four things, all of them properties of a schema sitting still. None of them needs a model in the loop, and none of them can tell you how often a model actually gets it wrong — that needs traffic, which is the other half of this.
Undescribed parameters
21.5%
A parameter with no description is a parameter the model guesses at. It has the name and the type, and that is the whole brief.
Description collisions
17.7%
Tools whose description contains no word that its siblings do not also use. Clear English that still cannot tell a model which tool to pick.
Schema token cost
~1,251 tokens
Your whole tool list is sent on every connection, whether or not a single tool gets called.
Undeclared closed sets
857 parameters
A parameter that names its valid values in prose and then leaves the schema an open string.
Parameters are counted at the top level
— inputSchema.properties, not nested object properties.
That is what the survey counted, so it is what a comparison can be made against.
Collisions are measured within your paste. A tool's description is distinctive relative to the other tools you gave it, so pasting half your server will flatter it.
Tokens are bytes ÷ 4, the same estimate the survey uses. Close enough to compare servers, not exact for a bill. Size is measured re-serialised, so pretty-printing your paste does not change the score.
Nothing here grades correctness. A zero-distinctive description can be perfectly good writing — three of the four examples in the survey are — and a schema that scores clean can still fail constantly for reasons no schema shows.