Step1 filter out "No action" Policy items

[boazdavid]

Maybe it is similar to the history issue?

{
      "name": "Travel Certificate Non-Refundable Remainder",
      "description": "When using a travel certificate for payment, the remaining amount of the certificate is not refundable.",
      "references": [
        "The remaining amount of a travel certificate is not refundable."
      ],
      "compliance_examples": [
        "A user books a reservation using a travel certificate worth $500 for a $300 flight and understands the remaining $200 certificate balance will not be refunded",
        "Booking a flight with a $1000 travel certificate for a $750 reservation and accepting that the unused $250 certificate amount cannot be returned",
        "Using a travel certificate valued at exactly $600 to pay for a $600 booking with no remainder to be refunded",
        "A passenger pays with a $400 travel certificate for a $450 flight reservation and provides an additional payment method to cover the $50 difference, knowing any excess certificate value would not be refundable"
      ],
      "violation_examples": [
        "A user books a reservation using a travel certificate worth $500 for a $300 flight and expects to receive a $200 refund of the remaining certificate balance",
        "Booking a flight with a $1000 travel certificate for a $750 reservation and requesting the unused $250 certificate amount to be returned as cash",
        "Using a travel certificate valued at $800 to pay for a $600 booking and demanding the $200 difference be credited back to their credit card",
        "A passenger pays with a $400 travel certificate for a $350 flight reservation and insists the remaining $50 certificate balance should be refunded to their bank account"
      ],
      "skip": false
    }

[boazdavid]

(GCP/claude-4-sonnet) Another example.
This type of error happens for all "getter" tools: get_flight_status, get_reservation_details, get_user_details...

{
  "tool_name": "calculate",
  "policy_items": [
    {
      "name": "Single Tool Call Policy",
      "description": "You should only make one tool call at a time, and if you make a tool call, you should not respond to the user simultaneously. If you respond to the user, you should not make a tool call at the same time.",
      "references": [
        "You should only make one tool call at a time, and if you make a tool call, you should not respond to the user simultaneously. If you respond to the user, you should not make a tool call at the same time."
      ],
      "compliance_examples": [
        "Making only a single calculate tool call with expression '7 + 9' without any accompanying text response",
        "Providing a text response to the user without making any tool calls",
        "Making one calculate call with '12 * 4' and waiting for the result before any further interaction",
        "Responding with only text to acknowledge the user's request, then in a separate turn making a single calculate call with '20 / 5'"
      ],
      "violation_examples": [
        "Making a calculate tool call with expression '5 + 3' while simultaneously providing a text response explaining the calculation to the user",
        "Calling calculate with '10 * 2' and also sending a message saying 'Let me calculate that for you' at the same time",
        "Making multiple tool calls in sequence by calling calculate with '15 / 3' followed immediately by another calculate call with '2 + 4'",
        "Using calculate to compute '8 - 2' while also providing additional commentary or explanation in the same response turn"
      ],
      "skip": false
    }
  ]
}