Skip to content

test(langchain,partners): disable pytest-benchmark under xdist to silence PytestBenchmarkWarning - #37901

Merged
Mason Daugherty (mdrxy) merged 1 commit into
masterfrom
mdrxy/ci/benchmark-disable
Jun 4, 2026
Merged

test(langchain,partners): disable pytest-benchmark under xdist to silence PytestBenchmarkWarning#37901
Mason Daugherty (mdrxy) merged 1 commit into
masterfrom
mdrxy/ci/benchmark-disable

Conversation

@mdrxy

Copy link
Copy Markdown
Member

Test targets run with -n auto, which makes pytest-benchmark (present via langchain-tests) auto-disable itself and emit a PytestBenchmarkWarning once per xdist worker. Passing --benchmark-disable turns the plugin off explicitly so the warning never fires, matching what core and langchain_v1 already do.

Changes

  • Add --benchmark-disable to the -n auto test targets across langchain (unit) and 14 partner packages' integration targets: anthropic, chroma, deepseek, exa, fireworks, groq, huggingface, mistralai, nomic, ollama, openai, openrouter, qdrant, xai.
  • Deliberately excluded text-splitters and model-profiles: their test group doesn't install pytest-benchmark, so the flag would fail with unrecognized arguments. Verified by importing the plugin under each package's actual dependency group before editing.

…ence `PytestBenchmarkWarning`

Test targets run with `-n auto`, which makes `pytest-benchmark` (present via `langchain-tests`) auto-disable itself and emit a `PytestBenchmarkWarning` once per xdist worker. Passing `--benchmark-disable` turns the plugin off explicitly so the warning never fires, matching what `core` and `langchain_v1` already do.

## Changes
- Add `--benchmark-disable` to the `-n auto` test targets across `langchain` (unit) and 14 partner packages' integration targets: `anthropic`, `chroma`, `deepseek`, `exa`, `fireworks`, `groq`, `huggingface`, `mistralai`, `nomic`, `ollama`, `openai`, `openrouter`, `qdrant`, `xai`.
- Deliberately excluded `text-splitters` and `model-profiles`: their `test` group doesn't install `pytest-benchmark`, so the flag would fail with `unrecognized arguments`. Verified by importing the plugin under each package's actual dependency group before editing.
@github-actions github-actions Bot added anthropic `langchain-anthropic` package issues & PRs chroma `langchain-chroma` package issues & PRs deepseek `langchain-deepseek` package issues & PRs exa `langchain-exa` package issues & PRs fireworks `langchain-fireworks` package issues & PRs groq `langchain-groq` package issues & PRs huggingface `langchain-huggingface` package issues & PRs integration PR made that is related to a provider partner package integration internal langchain `langchain` package issues & PRs langchain-classic `langchain-classic` package issues & PRs mistralai `langchain-mistralai` package issues & PRs nomic `langchain-nomic` package issues & PRs ollama `langchain-ollama` package issues & PRs openai `langchain-openai` package issues & PRs openrouter `langchain-openrouter` package issues & PRs qdrant `langchain-qdrant` package issues & PRs size: XS < 50 LOC tests PRs made that add, modify, or remove tests xai `langchain-xai` package issues & PRs labels Jun 4, 2026
@mdrxy
Mason Daugherty (mdrxy) merged commit 3b99917 into master Jun 4, 2026
225 checks passed
@mdrxy
Mason Daugherty (mdrxy) deleted the mdrxy/ci/benchmark-disable branch June 4, 2026 17:25
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

anthropic `langchain-anthropic` package issues & PRs chroma `langchain-chroma` package issues & PRs deepseek `langchain-deepseek` package issues & PRs exa `langchain-exa` package issues & PRs fireworks `langchain-fireworks` package issues & PRs groq `langchain-groq` package issues & PRs huggingface `langchain-huggingface` package issues & PRs integration PR made that is related to a provider partner package integration internal langchain `langchain` package issues & PRs langchain-classic `langchain-classic` package issues & PRs mistralai `langchain-mistralai` package issues & PRs nomic `langchain-nomic` package issues & PRs ollama `langchain-ollama` package issues & PRs openai `langchain-openai` package issues & PRs openrouter `langchain-openrouter` package issues & PRs qdrant `langchain-qdrant` package issues & PRs size: XS < 50 LOC tests PRs made that add, modify, or remove tests xai `langchain-xai` package issues & PRs

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant