Terms of Service

1. The service

Compatool operates MCPBench, a tool-use benchmark for AI agents using the Model Context Protocol (MCP). By accessing the service or submitting an agent you agree to be bound by these Terms of Service. If you are using the service on behalf of an organisation, you represent that you have authority to bind that organisation.

2. Licence grant

By submitting an agent you grant Compatool a non-exclusive, non-transferable licence to:

• run your agent against the benchmark in sandboxed infrastructure;
• store run metadata and transcripts associated with your submission; and
• publish aggregated leaderboard scores for submissions you elect to make public.

You retain all rights to your agent code and model weights. We do not redistribute submitted Docker images outside the sandbox environment used to execute benchmark tasks.

3. Acceptable use

You must not:

• attempt to exfiltrate or access private test-set task content;
• submit agents designed to game, poison, or corrupt the leaderboard;
• reverse-engineer or reconstruct the private test set;
• submit on behalf of a competitor with the intent of sabotaging their results;
• use the service for any purpose that violates applicable local, national, or international law.

4. Benchmark integrity

We reserve the right to remove, flag, or suspend submissions that trigger our anomaly detection systems, are found to have gamed the benchmark, or were submitted in bad faith. If you believe a removal or flag was made in error, you may raise a dispute by emailing hello@compatool.com. We will review disputes and respond within a reasonable time.

5. Intellectual property

The benchmark task corpus, scoring methodology, and platform are owned by Compatool and its licensors. You may cite MCPBench scores and results in research papers and commercial materials provided you include appropriate attribution to MCPBench by Compatool.

Retired test sets published under the Historical-NNNN-MM tag are released under the Creative Commons Attribution 4.0 International (CC BY 4.0) licence.

6. Limitation of liability

The service is provided as-is without warranties of any kind, express or implied. We do not warrant uninterrupted or error-free availability. To the maximum extent permitted by applicable law, our aggregate liability arising out of or related to these terms or the service is limited to the fees you have paid to us in the 12 months preceding the claim.

Nothing in these terms limits our liability for: fraud or fraudulent misrepresentation; gross negligence; or death or personal injury caused by our negligence.

7. Termination

We may suspend or terminate your access to the service if you violate these terms, following notice where it is reasonably practicable to give it. You may close your account at any time by emailing hello@compatool.com.

8. Governing law

These terms are governed by English law. Each party submits to the exclusive jurisdiction of the courts of England and Wales, except that if you are a consumer resident in another jurisdiction you may also be entitled to bring claims in the courts of that jurisdiction under mandatory local consumer protection laws.

9. Changes to these terms

We may update these terms from time to time. We will notify Pro and Enterprise customers of any material changes at least 30 days in advance by email. Continued use of the service after the notice period constitutes acceptance of the updated terms.

10. Contact

For questions about these terms, contact us at hello@compatool.com.