General-purpose AI obligations under the EU AI Act
The GPAI provisions of the EU AI Act introduce obligations for foundation model providers. This piece explains what GPAI means, which obligations apply, and what deployers of GPAI-powered systems need to understand.
The EU AI Act introduced a dedicated framework for general-purpose AI (GPAI) models — the foundation models that underpin most modern AI products. Chapter V of the Act applies to providers of GPAI models, creating obligations that are distinct from the high-risk system obligations in Chapters II and III, and that interact with those obligations in ways that affect organisations building products on top of foundation models.
This piece explains what GPAI means under the Act, which obligations apply to providers at each tier, and — critically for most enterprise readers — what deployers of GPAI-powered systems need to understand and document about the underlying models they use.
What is a GPAI model
The EU AI Act defines a general-purpose AI model as an AI model trained with a large amount of data using self-supervision at scale that displays significant generality and is capable of competently performing a wide range of distinct tasks.
In practice, this definition covers the major foundation models: large language models like GPT-4, Claude, and Llama; multimodal models; and large-scale image and code generation models. The definition is intended to capture models that are “general purpose” in that they were not designed for a single specific application.
What a GPAI model is not is a deployed AI system. The distinction matters: the GPAI provisions apply to the model itself, as made available by the provider. The downstream system that uses the GPAI model — the product or application built on top of it — is a separate AI system with its own classification and its own obligations.
Provider vs deployer for GPAI
For GPAI models, the provider is the organisation that trains the model and places it on the EU market — OpenAI, Anthropic, Google, Meta, Mistral, and similar organisations. These are GPAI providers.
An enterprise organisation that accesses the model via API to build a product or internal tool is a downstream provider — a provider of the downstream AI system built on top of the GPAI model. This organisation is not a GPAI provider; it is the provider of a separate AI system.
The distinction matters because the obligations are different:
- GPAI model provider — must satisfy Chapter V obligations: technical documentation, downstream provider information, copyright compliance, and (for systemic-risk models) adversarial testing and incident reporting.
- Downstream system provider — must classify their downstream system under the standard tier framework and satisfy whichever obligations apply to that tier. If the downstream system is high-risk, the provider must satisfy Articles 9–15, regardless of whether the GPAI model it uses has its own obligations.
Standard GPAI — transparency obligations
All GPAI model providers must publish technical documentation covering the model's training methodology, the data used in training, the computational requirements for training and inference, and the model's capabilities and known limitations.
They must also make available to downstream providers — organisations building products on top of the model — the information and documentation they need to satisfy their own high-risk obligations. This is the transparency bridge between the GPAI framework and the downstream system framework: the GPAI provider must disclose what downstream providers need in order to document their systems.
In practice, the major GPAI providers satisfy the standard transparency obligation through model cards, system cards, and terms of service documentation. The adequacy of that disclosure for downstream Annex IV documentation purposes is an active area of discussion — the current state is that disclosure exists but is not always sufficient for the depth that Annex IV requires.
The GPAI transparency obligation creates a supply chain of disclosure: the GPAI provider discloses to the downstream provider, who uses that disclosure to build their Annex IV documentation. Where the GPAI provider's disclosure is incomplete, the downstream provider has a documentation gap that cannot be filled internally.
Standard GPAI — copyright compliance
Article 53(1)(c) and (d) require GPAI providers to comply with EU copyright law in relation to their training data, and to publish a publicly available summary of the training data used. This is the copyright compliance obligation that has attracted significant attention from rights holders and publishers.
The practical implication for downstream providers and deployers is that they can reference the GPAI provider's published copyright compliance summary as part of their own data governance documentation. This does not transfer the liability — if the GPAI provider's training data included infringing content, the provider bears the copyright liability, not the downstream user — but it does create a documented chain of accountability.
Systemic-risk GPAI — additional obligations
Models trained using more than 10^25 FLOPs of compute are presumed to present systemic risk and must satisfy additional obligations under Articles 55–56. This threshold approximately corresponds to GPT-4-scale training at the time of the Act's adoption, though the European AI Office can update the threshold by delegated act.
The additional systemic-risk obligations are more operationally intensive:
- Adversarial testing — red-team testing against systemic risks (CBRN capabilities, large-scale cybersecurity risks, democratic process interference), conducted before market placement and after significant updates.
- Incident reporting — report serious incidents to the European AI Office within defined timeframes.
- Cybersecurity measures — technical measures protecting the model weights and training pipeline, proportionate to the systemic risk posed.
- Energy efficiency reporting — document energy consumption during training and inference.
GPAI model obligations — standard vs systemic-risk tier
- Technical documentation covering training methodology, data used, computational requirements, and model capabilities and limitations
- Information and documentation for downstream providers — what they need to build compliant systems on top
- Copyright compliance policy — a publicly available summary of training data used, sufficient to support copyright obligations
- Compliance with EU copyright law in relation to training data
- All standard GPAI obligations
- Adversarial testing and red-teaming against systemic risks — conducted before market placement and after significant updates
- Incident reporting to the AI Office — serious incidents and near-misses that could constitute systemic risk
- Cybersecurity measures and physical access protections proportionate to the model's risk profile
- Energy efficiency documentation — reporting on energy consumption during training and inference
What deployers of GPAI-powered systems need to know
Most enterprise organisations are not GPAI providers — they are deployers of systems that use GPAI models as a component. Their obligations come from their role as downstream system providers or deployers, not from the GPAI framework directly. But the GPAI framework affects what they can document about the systems they deploy.
Deployers of GPAI-powered systems — information needs vs provider disclosure obligations
| Area | What the deployer needs | What the GPAI provider must disclose | Deployer action |
|---|---|---|---|
| Model documentation | Technical documentation about the GPAI model's capabilities, limitations, and training methodology | Information and documentation for downstream providers under Article 53(1)(b) — must be sufficient to build a compliant system on top | Request the downstream provider documentation from the GPAI model provider; document any gaps in what is disclosed |
| Copyright compliance | Assurance that the model was trained on legally permissible data; relevant for downstream liability exposure | Publicly available summary of training data used and compliance with EU copyright law — Article 53(1)(d) | Review the published copyright compliance summary; document reliance on the provider's disclosure in the system's Annex IV data governance section |
| Known limitations | The model's documented failure modes, capability limits, and known risks relevant to the deployment context | Technical documentation covering capabilities and limitations — Article 53(1)(a) | Map the GPAI model's documented limitations to the specific risks in the deployment context; document any limitations that create control gaps |
| High-risk classification interaction | Clarity on whether the downstream system built on the GPAI model is itself high-risk under Annex III | For systemic-risk GPAI models: information about which downstream use cases may result in high-risk classification | Classify the downstream system independently under Annex III — the GPAI model's tier does not determine the downstream system's tier |
The critical practical implication is that Annex IV documentation for a high-risk downstream system built on a GPAI model will have gaps in the data governance section (section 4) unless the GPAI provider discloses sufficient training data information. These gaps should be documented explicitly — “the model provider has not disclosed sufficient training data detail to satisfy this requirement” — rather than left blank. Documented gaps are defensible; undocumented gaps are not.
Evidence for AI security reviews of GPAI-powered systems
An AI security review of a system built on a GPAI model must address the GPAI layer explicitly. The review cannot assess what the model provider has not disclosed — but it can document what has been disclosed, what the gaps are, and what controls the downstream system implements to manage the risks created by those gaps.
The specific areas where a security review of a GPAI-powered system adds value are:
- Prompt injection risk assessment — GPAI models are susceptible to prompt injection via input, documents, and tool results. The review should assess the attack surface specific to the deployment context.
- Output validation controls — the review should assess whether outputs from the GPAI model are validated before being used to make or influence decisions, and whether the validation is proportionate to the risk.
- Data boundary controls — for systems that pass personal or sensitive data to the GPAI model (via the API), the review should assess whether data minimisation controls are in place and whether the API terms of service permit the data sharing that is occurring.
- Model provider dependency documentation — the review should document which model provider is used, what version, and what happens if the provider changes the model or its terms of service.
For a broader treatment of GPAI-specific security risks, see our guides on prompt injection and LLM supply chain security.
Blog
Get new posts in your inbox
AI security review, OWASP Agentic Top 10, ISO 42001 evidence, and what AI Committees actually need. No cadence promises — we publish when there's something worth reading.
Review GPAI-powered systems with the right framework
Drel's AI security review process covers the GPAI model layer — documenting what the model provider discloses, what the control gaps are, and what downstream controls are needed for the deployment context.
A note on scope: Drel reviews assessed systems against documented architecture, configuration and intent. It does not ingest live telemetry from production environments. Dispositions reflect the assessed system at the time of review and the re-assessment triggers that govern when the disposition must be revisited.