LangSmith
Give the Sazabi agent tools to query LLM tracing projects, runs, datasets, and evaluations from your LangSmith organization.
About
LangSmith is an MCP connector that gives the Sazabi agent tools to query LLM tracing projects, runs, datasets, and evaluations. LangSmith's hosted Remote MCP server authenticates via OAuth 2.1 with dynamic client registration. When you connect, pick the LangSmith Cloud region your organization lives in — GCP US (the default), GCP EU, GCP APAC, or AWS US — so the connection targets the matching regional host and authorization server. Once connected, agents can browse tracing projects, inspect runs and their traces, and look up datasets and evaluation results.
What the agent can do:
- Browse LangSmith tracing projects
- Inspect runs, traces, and their inputs and outputs
- Look up datasets and dataset examples
- Review evaluation results and experiments
Prerequisites
- A LangSmith account
- Permission to authorize third-party OAuth applications in your LangSmith organization
Set up in the dashboard
Configure connectors in the dashboard under Settings > MCP connectors.
Open the connector
Find LangSmith in Settings > MCP connectors.
Authorize
Select the LangSmith Cloud region where your organization lives (GCP US, GCP EU, GCP APAC, or AWS US). Start the connection; Sazabi redirects you to LangSmith to authorize, then back.
Set up with the CLI
You can also connect LangSmith with the Sazabi CLI (installed and authenticated — see sazabi mcp-connectors reference).
LangSmith authenticates over OAuth, so the CLI opens a browser to complete authorization:
sazabi mcp-connectors connect langsmithAdd --read-only to restrict the connector to read-only tools, or --project-id <project> to target a specific project. In --json mode the command prints an authorization URL to open, then polls until the connection completes. Confirm the result with sazabi mcp-connectors list.
Verify
Open the connector's connection page under Settings > MCP connectors and confirm Sazabi lists the tools it discovered. Then, in a thread, ask the agent to use one of those tools and confirm it runs. If no tools appear, confirm the connection is authorized (OAuth) or the key/header is correct (token auth).
Troubleshooting
No tools discovered — Disconnect and reconnect from Settings > MCP connectors; confirm you selected the correct region for your LangSmith organization.
Connection shows needs attention — The authorization or key may have expired or been revoked; reconnect from Settings > MCP connectors.