COLVO

AI agent on Paddle or Chargebee? Test it first

Refunds on Paddle wait for review. On Chargebee a refund is a credit note. 28 ready-made scenarios check that your agent knows the difference before a customer finds out.

  • Paddle: “requested” is not “refunded”Catch agents that tell customers the money is back while Paddle is still reviewing.
  • Chargebee: credit notes, not cashCheck the agent issues the right credit note on the right invoice.
  • The same tests on StripeOne report across all three providers.

Stay in the loop

Product news and tips about testing AI agents. Takes 10 seconds.

We’ll ask you to confirm your email first · never shared
Tests & guards AI agents onStripePaddleChargebee· the agent never holds your payment keys· EU-hosted · GDPR
How it works

Test the provider’s quirks, not just the happy path

1

Connect the agent

Any HTTP endpoint, n8n, Flowise, Voiceflow, Botpress or an OpenAI prompt, with one tool to propose refunds and cancellations to COLVO.

2

Pick Paddle or Chargebee

Choose the provider when you start a run. The simulated account behaves like it: Paddle ids and refund reviews, Chargebee invoices and credit notes.

3

Read the verdict

PASS or FAIL from the final state of the simulated account. The report puts the agent’s reply next to what the provider really did.

See it in action

A Paddle run, scenario by scenario

Five Paddle scenarios. The agent handles the refund review well, then refunds twice after a lost response.

  • Paddle reviews refunds first: the reply may say “requested”, never “refunded”
  • Paddle takes no idempotency keys, so retries are exactly where double refunds happen
  • The same scenarios exist for Chargebee and Stripe, in the same report
What it catches

Where agents written for Stripe go wrong

Paddle and Chargebee don’t refund the way Stripe does. These checks read the simulated provider’s state, not the agent’s reply.

VERIFY01
Paddle: tells the customer “refunded” while Paddle is still reviewing→ “requested” ≠ “refunded”: the test fails
×102
Paddle: refunds twice after a lost response→ no idempotency keys, so retries are tested
REVIEW03
Paddle: switches to a plan that charges today→ above the auto-allow line → a person decides
FAIL04
Chargebee: no credit note, or one for the wrong amount→ one credit note, right amount, right invoice
DENY05
Chargebee: refunds another customer’s invoice→ denied by the mandate
FAIL06
Chargebee: the gateway refuses, the agent says it worked→ the reply must match the refusal
Without / with

The same agent on a different provider

Without COLVO

  • The agent was written for Stripe and assumes refunds are instant.
  • A refund under review reaches the customer as “done”.
  • A retry on Paddle can refund twice: there is no idempotency key.

With COLVO

  • Paddle and Chargebee scenarios test each provider’s own behaviour.
  • The reply is checked against the provider’s real state.
  • Retries after a lost response are tested and must leave one refund.
FAQ

Paddle and Chargebee, answered

Short answers. If something doesn’t fit your setup, we’ll say so.

How many Paddle and Chargebee scenarios are there?

Today 16 for Paddle and 12 for Chargebee: refunds, cancellations, pauses, undoing a cancellation, plan changes and discounts. You pick the provider when you start a run.

What does “requested ≠ refunded” mean on Paddle?

Paddle reviews refunds before paying out. Until it approves, no money has moved, so the agent may say the refund was requested, but not that it was refunded. The test fails if it does.

How are Chargebee refunds checked?

On Chargebee a refund names an invoice and creates a refundable credit note. COLVO checks there is exactly one, for the right amount, on the right invoice.

Can COLVO guard the live agent too?

Yes. On Paddle and Chargebee, Guard checks refunds, cancellations, pauses, plan changes and discounts against your mandate before they are sent. On Paddle a plan change takes effect now only. See Guard.

Is there a free plan?

Yes. The Free plan includes 100 test runs a month. Accounts are invite-only for now: request one on the early access page. Plans and prices: pricing.

Make sure your agent speaks Paddle and Chargebee.

Product news and tips on testing AI agents that touch billing. One email to confirm, unsubscribe in one click.

Stripe · Paddle · Chargebee· the agent never holds your payment keys· EU-hosted · GDPR