We’re in the process of submitting our MCP to the app directory, and get the error “Tool scan failed: Internal service error”.
Troubleshooting:
The OAuth flow successfully ran.
Using ngrok we confirmed our service was called & returned a valid 200 response for the tool/list.
Our full MCP is ~54k tokens, resulting in the 500 error.
We truncated the tool/list, and found that the tool scan worked when the MCP definition was below ~32k tokens. This worked with any arrangement of tools; the max-size seemed to be the only limitation.
I’ve submitted a support request to support with specific identifiers. Given the response status is 500, is this a bug?
After ~2 months, OpenAI got back to me. They said they have no plans to change this limit; we ended up completely re-working our MCP to fit under the token limit. Support said:
• Each individual tool definition must be under 5,000 tokens. This includes the tool name, description, and input schema.
• All tools combined (including name, description, and input schema) must be less than 16000 tokens.