MCPVault

run_experiment

MCP tool from Opik MCP by comet-ml

Run an evaluation experiment end-to-end via Ollie. Takes a single

How to use it

run_experiment is exposed by the Opik MCP MCP server. Add the server to your MCP client (Claude Desktop, Cursor, Windsurf and others), and the run_experiment tool becomes available to the model automatically. See the full listing for setup details and every tool this server provides.

Install Opik MCP

$npx @modelcontextprotocol/inspector uvx opik-mcp
FULL OPIK MCP LISTING

Other tools in Opik MCP (15)

ask_ollie

For investigative questions, cross-entity synthesis, or anything that needs

comment.create

Attach a free-text comment to a trace, span, or thread.

experiment_item.create

Attach trace + datasetitem rows to an experiment.

experiment.create

Create an experiment scoped to a test suite.

list

Browse a collection with optional name filter and pagination. Project-scoped

prompt_version.save

Save a new prompt version (creates the prompt by name if missing).

read

One tool for any "show me X" question. Takes an entitytype plus an id

schema

Inspect the exact JSON shape and required fields of any write operation before

score.create

Attach a numeric feedback score to a trace, span, or thread.

span.create

Log a span on an existing trace (or a batch).

test_suite_item.upsert

Upsert items into a test suite (always the envelope shape).

test_suite.create

Create an evaluation test suite.

trace.create

Log a single trace (or a batch). Parent for spans / scores / comments.

trace.update

Finalize or amend an existing trace.

write

Universal write dispatcher. Pass operation + data and the dispatcher