TL;DR: The OpenAI API does not use your inputs or outputs for model training by default. This is a significant governance advantage over ChatGPT consumer products, but it does not cover the developer-side risks: logging practices, API key management, and PII sent in prompts.
Most AI governance discussions focus on ChatGPT, the consumer and team product line that most employees interact with directly. But many small teams also have developers using the OpenAI API to build internal tools, automate workflows, or power product features. The API has a distinct governance profile that is worth understanding separately.
The short version: the OpenAI API is more privacy-protective by default than ChatGPT consumer products, because it does not train on your data. But the governance risks shift from OpenAI's side to your side. What you log, how you manage API keys, and whether you send PII to the API are questions only your team can answer.
How the API differs from ChatGPT
When you interact with ChatGPT through the web interface or mobile app on a consumer account, your conversations may be used to improve OpenAI's models by default. You can opt out, but the default is permissive.
The OpenAI API operates under a different policy. Since March 2023, OpenAI has not used API inputs or outputs to train or fine-tune its models by default. This is not an opt-out; it is the default for all API customers.
The rationale is that API customers are typically building products or integrations. Their use cases often involve sensitive or proprietary data that they need assurance will not be incorporated into model training. OpenAI's response was to make no-training the default for the API tier.
This distinction matters enormously for small teams whose developers are using the API to build features on top of GPT-4o, o-series models, or other OpenAI models. If your developer is sending customer support queries, internal documents, or business data to the OpenAI API to process, that data is not being used to train future models. It is a substantively different privacy position than consumer ChatGPT.
For context on how this compares to other providers' API policies, see Privacy-first AI API no training GDPR CCPA.
What OpenAI's API terms actually say
No-training default: API inputs and outputs are not used to train OpenAI models unless you explicitly opt in. This applies from the moment you start using the API, with no configuration required on your end.
30-day default retention: OpenAI retains API request and response data for 30 days for safety monitoring and abuse detection. This is a holding period, not storage for training purposes. After 30 days, the data is deleted. During this 30-day window, OpenAI employees may review data for safety purposes (for example, to investigate reports of abuse or to verify policy compliance).
Zero data retention: Enterprise API customers can request zero data retention, meaning OpenAI does not store inputs or outputs after the API call completes. There is no 30-day buffer. This is appropriate for applications handling highly sensitive data, but it does require requesting it specifically and is not available to all API customers by default.
SOC 2 Type II: OpenAI is SOC 2 Type II certified. This covers security controls relevant to API infrastructure.
DPA availability: OpenAI provides a Data Processing Agreement for API customers. Unlike some enterprise AI agreements, the API DPA does not require an enterprise-scale contract; it is accessible to API customers generally. This includes Standard Contractual Clauses for GDPR-compliant international data transfers.
GDPR compliance: OpenAI has published GDPR documentation, appoints EU representatives, and provides SCCs. For EU customers using the API, the DPA plus SCCs is the standard mechanism for compliance. Data is processed in the US; EU data residency is not available for the OpenAI API.
Governance risks specific to API usage
The no-training default removes the main risk associated with consumer ChatGPT. But it does not remove all risk; it moves the governance responsibility toward your team.
Risk 1: Developer-side logging. OpenAI does not store your API data beyond 30 days by default. But your application might. Many developers log API request and response payloads for debugging, quality monitoring, or analytics. Those logs may contain whatever sensitive data was in the prompt: customer names, document contents, financial figures. Your log storage, access controls, and retention policy govern that data, not OpenAI's.
If you are logging API calls, audit what you are logging. Full request/response logging is often more than you need for debugging. Consider logging only metadata (latency, token count, model used, error codes) rather than full payload content. If you need to log content for quality purposes, apply redaction to PII before logging.
Risk 2: API keys exposed in code. API key exposure is the most common security failure in API-based development. Keys committed to version control, hardcoded in client-side code, included in error messages, or shared in Slack are all common failure modes. A leaked API key allows anyone to make API calls billed to your account, potentially processing large volumes of data under your organization's credentials.
Use secrets management tools (environment variables, AWS Secrets Manager, HashiCorp Vault, or similar) to store API keys. Never commit API keys to source control. Use pre-commit hooks to detect accidental key exposure. Generate separate keys for development, staging, and production environments.
Risk 3: No built-in PII detection. The OpenAI API processes whatever you send it. It does not automatically detect or flag personal data, health information, financial account numbers, or other sensitive content in your prompts. If your application is passing user-submitted content to the API without filtering, you are responsible for any PII that goes through.
For applications that handle user data, build a pre-processing step that scrubs or pseudonymizes PII before sending it to the API. For internal tools, establish a clear policy on what types of data are permitted in prompts. Medical records, financial account details, and passwords should never be sent to the API.
Risk 4: Overly broad API key access. If your entire development team shares a single API key, or if the key is embedded in a deployed application with broad access, the blast radius of a leak is large. Rotate API keys regularly and limit which team members and which applications have key access.
Risk 5: Missing spend controls. The OpenAI API is billed by usage. Without spend limits, a runaway application, a prompt injection attack, or a compromised API key can generate significant unexpected charges. Set hard spending limits in the OpenAI platform for each API key.
Comparison: OpenAI API vs ChatGPT plans
| Criterion | OpenAI API | ChatGPT Team | ChatGPT Enterprise |
|---|---|---|---|
| Trains on your data? | No (default) | No (default) | No |
| Data retention | 30 days (safety monitoring) | Not used for training; chat history stored | Not used for training; configurable |
| Zero retention option? | Yes (enterprise API, on request) | No | Configurable |
| DPA available? | Yes | Yes | Yes |
| SOC 2 Type II? | Yes | Yes | Yes |
| GDPR SCCs provided? | Yes | Yes | Yes |
| Audit logs | No built-in logging | Limited | Full admin audit logs |
| PII detection | None (developer responsibility) | None (user responsibility) | None (user responsibility) |
| Admin controls | None (key-based) | Team admin console | Enterprise admin console |
| EU data residency | No | No | No |
| Spend controls | API-level spending limits | Team billing controls | Enterprise billing |
The API is the most privacy-protective of the three in terms of training policy, but it has no admin controls, no audit logs, and no PII detection. It trades enterprise management features for direct programmatic access. Organizations using the API at scale need to build governance controls themselves rather than relying on platform controls.
API governance checklist
This checklist covers the developer-side governance controls that OpenAI's platform does not provide:
API key management:
- One API key per application or environment (not shared organization-wide)
- Keys stored in environment variables or secrets management, not in code
- Pre-commit hooks to detect accidental key commits to version control
- Spending limits set for each key in the OpenAI platform
- Key rotation schedule documented (minimum: quarterly, or immediately after any suspected exposure)
- Access list reviewed: who has access to each API key?
Data handling in prompts:
- Policy documented on what data types may appear in prompts (e.g., no medical records, no financial account numbers, no passwords)
- PII scrubbing or pseudonymization applied before sending user data to the API
- Prompt templates reviewed for any hardcoded sensitive information
Logging and monitoring:
- Audit what your application logs from API calls: is full payload logging necessary?
- Log retention period defined and enforced for any API call logs
- Access controls on API call logs (who can see logged prompt/response content?)
- Anomaly detection on API usage (unusual volume spikes may indicate key exposure)
GDPR and compliance:
- DPA obtained from OpenAI and on file
- SCCs reviewed and documented for EU data transfers
- Data flow documentation updated to show that the OpenAI API is in the processing chain for affected systems
- Retention practices aligned: 30-day OpenAI retention vs. your organization's retention policy
Ongoing:
- OpenAI API usage policies reviewed annually (or when OpenAI announces policy updates)
- Developer team briefed on this checklist and any updates
For context on how the API fits into the broader OpenAI product comparison, see ChatGPT team vs enterprise compliance 2026 and the three-way comparison in ChatGPT vs Claude vs Gemini enterprise compliance 2026.
For developer-facing security controls that go beyond data privacy, including API supply chain and model integrity questions, see AI supply chain security checklist 2026. If your team is using Model Context Protocol for tool integrations, MCP server security governance checklist 2026 covers the specific governance requirements for that architecture.
Related reading
- Anthropic vs OpenAI GDPR compliance 2026
- AI vendor DPA tracker 2026
- Shadow AI governance tools visibility tech teams
- Privacy-first AI API no training GDPR CCPA
- OpenAI's New Deal Policy: 3 AI Governance Steps Every Small Team Must Ta
- AI Data Privacy for Small Teams: 9-Tool DPA Table + GDPR/CCPA Checklist
- Best AI Tools for Small Teams: Compliance and Governance Ratings (2026)
- GDPR-Compliant AI Assistants: Claude, ChatGPT Enterprise, Gemini, and Mistr
