Class TrajectoryInOrderMatchSpec (1.79.0)

TrajectoryInOrderMatchSpec(mapping=None, *, ignore_unknown_fields=False, **kwargs)

Spec for TrajectoryInOrderMatch metric - returns 1 if tool calls in the reference trajectory appear in the predicted trajectory in the same order, else 0.

Methods

TrajectoryInOrderMatchSpec

TrajectoryInOrderMatchSpec(mapping=None, *, ignore_unknown_fields=False, **kwargs)

Spec for TrajectoryInOrderMatch metric - returns 1 if tool calls in the reference trajectory appear in the predicted trajectory in the same order, else 0.