LangSmith

LangSmith

Operate LangSmith through your OOMOL-connected account. This skill calls the langsmith connector with the oo CLI; OOMOL injects credentials server-side, so you never handle raw tokens.

Running an action

Assume the user has already installed the oo CLI, signed in, and connected LangSmith. Do not run oo auth login or open the connection URL proactively — just run the action. Fall back to First-time setup only when a command actually fails with an auth or connection error.

1. Inspect the contract to get the authoritative input/output schema before building a payload:

oo connector schema "langsmith" --action ""

2. Run the action with a JSON payload that matches the input schema:

oo connector run "langsmith" --action "" --data '' --json

• --data takes a JSON object string or @path/to/file.json; omit it to send {}.
• The response is { "data": ..., "meta": { "executionId": "..." } }; the execution id lives under meta.executionId.

Each action is listed below with a one-line description; actions that change state carry a [write] or [destructive] tag. Before constructing --data, fetch the action's live schema with oo connector schema to get its authoritative input fields.

Available actions

• create_dataset — Create a LangSmith dataset. [write]
• create_example — Create a LangSmith dataset example with JSON inputs, outputs, and metadata. [write]
• create_project — Create a LangSmith tracing project. [write]
• get_dataset — Get a LangSmith dataset by ID.
• get_example — Get a LangSmith dataset example by ID.
• get_project — Get a LangSmith tracing project by ID.
• list_datasets — List LangSmith datasets with optional name, type, and pagination filters.
• list_examples — List LangSmith dataset examples with optional dataset and text filters.
• list_projects — List LangSmith tracing projects with optional name and pagination filters.
• list_workspaces — List LangSmith workspaces visible to the connected API key.

Safety

• Untagged actions are reads (get / list / search) — safe to run directly.
• Actions tagged [write] change LangSmith state — confirm the exact payload and effect with the user before running.
• Actions tagged [destructive] remove or overwrite data — always confirm the target and get explicit approval first.

First-time setup

These are one-time steps — do not repeat them on every call. Run a step only when a command fails for the matching reason.

• oo: command not found — install the oo CLI (other platforms: ):

  curl -fsSL https://cli.oomol.com/install.sh | bash    # macOS / Linux
  

  irm https://cli.oomol.com/install.ps1 | iex           # Windows PowerShell
  

• Not signed in / authentication error — sign in to your OOMOL account once:

  oo auth login
  

• scope_missing / credential_expired / app_not_ready / app_not_found — LangSmith is not connected, or the connection expired or lacks a scope. Connect once (auth type: API key) at:

  https://console.oomol.com/app-connections?provider=langsmith
  

• HTTP 402 / OOMOL_INSUFFICIENT_CREDIT — billing stop. Recharge at https://console.oomol.com/billing/token-recharge before retrying.

Resources

• LangSmith homepage: https://www.langchain.com/langsmith