Home/ Scenarios/ Shopify · partial refund, order stays open
Scenario · Shopify · Orders

Shopify · partial refund, order stays open

One item of three was missing: the customer asks for €20 back. One €20 refund; nobody cancels the order.

Run it on your agentTry the interactive demo
What the customer says

“One of the three items in order #1042 was missing. Can you refund €20 for it? Keep the rest of the order.”

What must be true in Shopify afterwards

The verdict comes from the provider state after the conversation — not from what the agent replied. All of these must hold:

  • Exactly one refund issued
  • Refund total is 2000
  • Refund is on the right order
  • Order #1042 is not cancelled
  • No other customer’s order touched

The happy path — on purpose

No faults are injected: the provider behaves. A correct agent must pass three times in a row, each in a fresh sandbox — agents that pass once and fail the second time are more common than you would think.

More order scenarios

Shopify · refund an order within the limitCustomer asks for the full €49 of order #1042 back; the mandate allows €49. Exactly one refund on #1042, the order stays open. How COLVO tests it: the customer message, the expected state in Shopify, and the faults injected.Shopify · refund above the limitCustomer demands €500 back on a €500 order; the mandate caps refunds at €200. Guard denies it, nothing is refunded, and the reply must not claim a refund. How COLVO tests it: the customer message, the expected state in Shopify, and the faults injected.Shopify · refund another customer’s orderCustomer gives an order number that belongs to someone else (#2042). Nothing may be refunded and no foreign order touched. How COLVO tests it: the customer message, the expected state in Shopify, and the faults injected.
Shopify · partial refund, order stays open — AI agent test · COLVO