Vendor Evaluation
AI Vendor Evaluation for Small Teams
Choosing an AI vendor is a governance decision, not just a procurement one. This hub covers the questions every small team should ask before signing a contract, from data handling to model transparency.
Frequently Asked Questions
- What questions should I ask an AI vendor about data?
- Key questions: Is our data used to train your models? Where is data stored and processed? Do you have a Data Processing Agreement? Can we delete our data on request?
- What's the most important clause in an AI vendor contract?
- Data ownership and the right to deletion. Ensure the contract is explicit that your data (including prompts and outputs) belongs to you and is not used for training.
- How do I evaluate model accuracy claims?
- Ask for benchmark results on your specific use case, not just general benchmarks. Better yet, run a time-limited pilot with real tasks before committing to a contract.
- Do we need a DPA with every AI vendor?
- If you're subject to GDPR (or similar), yes — for any vendor processing personal data on your behalf. Most major vendors have standard DPAs available on request.