Expectations

Expectations define how an eval case passes or fails.

Available categories

• Deterministic expectations
• LLM-as-judge expectations
• Custom expectations
• Dataset evals
• Conversation evals

More expectation types can be added over time.

For method signatures and return values, see the API reference.