Vendor Due Diligence
Test a vendor's AI agent against your policies and use cases before you sign.
The problem
A vendor demo shows the best case; you need to know how the agent handles yours.
What we do
- Tests built from your policies and use cases
- Side-by-side results when comparing vendors
What you receive
- Findings per vendor and a comparison
What you provide
- Your policies and use cases
- Vendor contacts
Limits
- A buyer cannot authorize testing of a vendor's system: we need the vendor's consent or sandbox, or a terms-permitted public test with the vendor informed
- No opinion on the vendor's security or organization beyond tested behavior
Results describe behavior within the tested scope and configuration. They give you independent evidence for security reviews, audits and compliance work; certification itself is issued by accredited bodies.
Availability and independence
Pilot: Procedure designed and deliverable with existing tools, but not yet delivered to a client. Sold under pilot terms. Procedure designed and deliverable with existing tools, but not yet delivered to a client. Sold under pilot terms.
Pilot deliveries are scoped in writing, tell you it is an early delivery, and follow the same review and evidence rules as any engagement.
Independent evaluation: we had no hand in building or advising on your agent, and our price is fixed before testing starts, so the results don't change what we're paid.
Modules
Optional, quoted separately
- Multi-vendor comparisonWorks through public chatPilot: Procedure designed and deliverable with existing tools, but not yet delivered to a client. Sold under pilot terms.
What is covered
The test areas this service always includes, with their status at the access level it uses.
- Vendor agent testing before purchaseIs the vendor's bot as good as the demo?Pilot: Procedure designed and deliverable with existing tools, but not yet delivered to a client. Sold under pilot terms.
- Unauthorized commitmentsCan my bot promise something we don't offer?Available now: Built into the TrendLab evaluation engine and used in sealed runs.
- Invented discounts, coupons, price matchesCan it give away margin?Available now: Built into the TrendLab evaluation engine and used in sealed runs.
- Contradicting published policyDoes it say the same thing as our Terms?Available now: Built into the TrendLab evaluation engine and used in sealed runs.
- Wrong prices, plans or termsDoes it quote the right price?Available now: Built into the TrendLab evaluation engine and used in sealed runs.
- Accepting forged "earlier agreements"Can a customer fake a promise?Available now: Built into the TrendLab evaluation engine and used in sealed runs.