MCPVault

test_suite.create

MCP tool from Opik MCP by comet-ml

Create an evaluation test suite.

How to use it

test_suite.create is exposed by the Opik MCP MCP server. Add the server to your MCP client (Claude Desktop, Cursor, Windsurf and others), and the test_suite.create tool becomes available to the model automatically. See the full listing for setup details and every tool this server provides.

Install Opik MCP

$npx @modelcontextprotocol/inspector uvx opik-mcp
FULL OPIK MCP LISTING

Other tools in Opik MCP (15)

ask_ollie

For investigative questions, cross-entity synthesis, or anything that needs

comment.create

Attach a free-text comment to a trace, span, or thread.

experiment_item.create

Attach trace + datasetitem rows to an experiment.

experiment.create

Create an experiment scoped to a test suite.

list

Browse a collection with optional name filter and pagination. Project-scoped

prompt_version.save

Save a new prompt version (creates the prompt by name if missing).

read

One tool for any "show me X" question. Takes an entitytype plus an id

run_experiment

Run an evaluation experiment end-to-end via Ollie. Takes a single

schema

Inspect the exact JSON shape and required fields of any write operation before

score.create

Attach a numeric feedback score to a trace, span, or thread.

span.create

Log a span on an existing trace (or a batch).

test_suite_item.upsert

Upsert items into a test suite (always the envelope shape).

trace.create

Log a single trace (or a batch). Parent for spans / scores / comments.

trace.update

Finalize or amend an existing trace.

write

Universal write dispatcher. Pass operation + data and the dispatcher