API Reference¶

evaluatorq exposes two interfaces:

• Python API — the SDK, documented below from each package's __all__.
• CLI Reference — the evaluatorq / eq commands.

Python packages¶

• evaluatorq — Core evaluation API — evaluatorq(), DataPoint, job, built-in evaluators.
• evaluatorq.redteam — Adversarial red teaming — red_team(), targets, OWASP frameworks.
• evaluatorq.simulation — Multi-turn agent simulation — simulate(), user-simulator + judge.
• evaluatorq.openresponses — OpenAI Responses API integration.
• evaluatorq.tracing — OpenTelemetry tracing helpers.
• evaluatorq.integrations — Third-party agent integrations (LangChain, LangGraph, …).