[DO NOT MERGE] Raise Not Applicable exception for tool-based evaluators in case of no tool calls/no tool definitions provided#44470

Open

salma-elshafey wants to merge 8 commits intomainfrom

selshafey/update_not_applicable_behavior

Commits on Dec 16, 2025

Ensure tool calls in tool call accuracy evaluator include the 'arguments' field + test cases
salma-elshafey
committed
Ensure arguments field in Tool Input Accuracy Evaluator + test case
salma-elshafey
committed
Throw exception in case of insufficient tool definitions provided
salma-elshafey
committed

Commits on Dec 18, 2025

Raise not applicable exception in case of no tool calls/no(t enough) tool definitions
salma-elshafey
committed
Update failed output category to failed execution
salma-elshafey
committed
Add error category verification in tests
salma-elshafey
committed
Update test comments
salma-elshafey
committed
Merge remote-tracking branch 'upstream/main' into selshafey/update_not_applicable_behavior
salma-elshafey
committed