The EU AI Act and Knowledge-Base Assistants: What Actually Applies
Most knowledge-base assistants built on retrieval-augmented generation (RAG) fall into the EU AI Act's minimal or limited-risk category, which means a transparency notice rather than a full conformity assessment. But that isn't automatic: how the assistant is used, not just how it's built, determines the obligations. This article walks through the risk tiers, the cases where a document Q&A tool could tip into high-risk territory, and what the Act leaves entirely untouched.
Not legal advice
This article explains the general structure of Regulation (EU) 2024/1689 (the EU AI Act) as it applies to document-grounded assistants. It is not a substitute for advice from counsel familiar with your specific deployment, sector and user base.
What the EU AI Act Regulates, in Plain Terms
The EU AI Act is a product-safety-style regulation. Instead of banning AI outright, it sorts AI systems into risk tiers and attaches obligations to each tier. It applies to providers (the organization that builds or substantially modifies an AI system) and deployers (the organization that uses it to serve its own users or customers), and it has extraterritorial reach similar to the GDPR: if your assistant's output reaches people located in the EU, the Act can apply even if your company is based in the United States. If you need a refresher on how RAG assistants actually work before mapping obligations onto them, see What Is RAG (Retrieval-Augmented Generation)? A Practical Guide and the AI and LLM Glossary for Professionals for the vocabulary regulators and lawyers use.
The Four Risk Tiers, and Where RAG Assistants Usually Land
The Act sorts AI systems into four tiers. A knowledge-base assistant that answers questions from an internal handbook, a product manual, or a public FAQ almost always sits in the bottom two tiers, unless it is deployed inside one of the sensitive use cases listed in Annex III of the regulation.
EU AI Act risk tiers for a typical RAG assistant
| Tier | Typical example | What it requires |
|---|---|---|
| Unacceptable risk | Social scoring, manipulative subliminal techniques, real-time biometric categorization in public spaces for law enforcement (narrow exceptions) | Prohibited outright; essentially never applies to a document Q&A tool |
| High-risk | An assistant that screens job applicants, scores creditworthiness, or is embedded in a regulated medical, safety or law-enforcement workflow | Conformity assessment, risk management system, technical documentation, human oversight, logging |
| Limited risk (transparency) | A customer-support or internal knowledge-base chatbot that answers employee or customer questions | Disclose that the user is interacting with an AI system (Article 50) |
| Minimal risk | Internal search tool, documentation assistant with no user-facing chat interface | No specific obligation under the Act, though other laws (GDPR, consumer protection) may still apply |
When a Knowledge-Base Assistant Could Be Classified as High-Risk
The content being retrieved rarely drives the classification; the use case does. A help-desk bot answering questions from a return policy is low-risk. The same technology, pointed at resumes to help decide who gets an interview, is a different animal.
Annex III use cases to watch
- Employment: screening, shortlisting or evaluating candidates, or monitoring employee performance based on retrieved HR records.
- Access to essential services: assistants that help decide eligibility for credit, insurance pricing or public benefits.
- Education: tools that assess students or control access to educational institutions based on retrieved records.
- Law enforcement, migration and justice: assistants that support decisions in these domains, even indirectly.
- Critical infrastructure: safety components in energy, water or transport systems.
Deployer vs provider obligations
If you build the assistant yourself, you are the provider and carry the heaviest obligations in a high-risk scenario: a risk management system, technical documentation, logging capable of reconstructing how an answer was produced, and human oversight mechanisms. If you simply deploy a knowledge-base product that someone else built, you are usually a deployer with lighter but still real duties: using the system as intended, monitoring its outputs, and keeping records. Teams building assistants for HR, legal or compliance workflows specifically should read RAG for Legal, HR and Compliance Teams: Use Cases, Pitfalls and a Safe Rollout Plan before wiring a retrieval assistant into anything resembling an Annex III decision.
Transparency Obligations That Apply Almost Always (Article 50)
Even outside the high-risk tier, Article 50 of the Act imposes a baseline transparency duty on systems intended to interact directly with natural persons: people must be informed they are talking to an AI system, unless that is obvious from context. For a knowledge-base assistant this typically means a short, persistent notice near the chat interface (something as simple as "Answers are generated by AI from the documents in this knowledge base") and, where the assistant produces summaries or paraphrased text rather than verbatim quotes, a clear indication that the content is AI-generated.
This is also where good RAG design and legal compliance overlap. An assistant that cites the exact passages it used, rather than producing an unsourced paragraph, makes the "this is AI, and here is where it came from" disclosure much easier to satisfy honestly, and it gives users a way to verify the answer themselves. On Kopik, every answer in the default mode comes with cited passages from the source documents, which is also the practical habit described in Document Q&A With Citations: How to Check an AI Answer.
What the AI Act Does Not Cover
It's just as important to know the boundaries of the regulation, because a lot of what people assume falls under the AI Act actually belongs to other laws.
- Document storage and retention. The Act regulates the AI system's behavior, not how long you keep the underlying PDFs or who can access them. Data protection law (GDPR, and for US companies, state privacy statutes) governs that.
- Copyright in the source material. Using copyrighted documents to ground an assistant's answers raises copyright questions that the AI Act does not resolve; that sits with national copyright law and the EU's text-and-data-mining exceptions.
- General-purpose model obligations. If you build a RAG assistant on top of a third-party language model, the heavier transparency and documentation duties for general-purpose AI models fall on the model provider, not on you, in most cases.
- Purely internal R&D and testing. Systems not yet placed on the market or put into service for real users are generally outside scope until deployment.
- Personal data handling specifics. The Act doesn't replace GDPR's rules on lawful basis, data minimization or cross-border transfer; those still apply in full to whatever documents you index. See GDPR and RAG: What to Check Before You Put Documents Into a Knowledge Base for that separate checklist.
A Practical Compliance Checklist for RAG Assistants
- Inventory every assistant in use across the company, including ones built by individual teams without central IT involvement (so-called shadow AI).
- For each one, write down who uses it, what decisions (if any) its answers feed into, and whether any Annex III use case is even loosely involved.
- Classify each assistant into a risk tier and document the reasoning, even for the minimal-risk ones; a one-paragraph justification is enough and saves time if a regulator or a customer later asks.
- Add a visible AI-disclosure notice to any assistant that talks directly to employees, customers or the public.
- Prefer architectures that cite sources rather than freely paraphrase, so users and auditors can trace every answer back to a document. See How to Evaluate a RAG System: Retrieval Metrics, Faithfulness and Citation Accuracy for how to measure this.
- Keep logs of queries and answers for high-traffic or high-stakes assistants, with retention periods aligned to your data protection policy rather than kept indefinitely by default.
- Review vendor contracts for AI tools to confirm who holds provider obligations and who holds deployer obligations; this is often unclear in off-the-shelf SaaS agreements.
- Revisit the classification whenever the assistant's scope changes, for example when an internal FAQ tool gets repurposed to help screen job applicants.
Private vs public knowledge bases change the picture
A private knowledge base queried only by your own staff through an API or an MCP client carries a different risk profile than a public-facing chatbot serving thousands of unknown users. Keep that distinction in your documentation: it affects both the AI Act transparency analysis and your GDPR data-minimization story.
None of this requires a new engineering team. Most of the checklist above is documentation and interface work layered on top of a retrieval pipeline you may already have, or could build in an afternoon. Kopik lets you create a knowledge base from PDFs, Word files or Markdown, choose between a cited-answer mode and a raw-passages-only mode, and keep the base private so only your own API keys can query it, which simplifies both the transparency notice and the data-governance side of the analysis above.
Build a traceable knowledge-base assistant
Start from your own documents: create a knowledge base, keep it private or list it in the catalogue, and get cited answers through the website, a REST API, or an MCP server for Claude, Cursor and ChatGPT.
Keeping This Current
The AI Act's obligations phase in over several years: prohibited practices became applicable in February 2025, obligations for general-purpose AI model providers in August 2025, and most high-risk system requirements in August 2026, with an extended transition to August 2027 for high-risk AI embedded as a safety component in products already regulated under other EU product-safety law. If your assistant touches any Annex III use case, confirm the current applicability date for your specific category before assuming you have more runway than you actually do.
Frequently asked questions
Does the EU AI Act apply to a US company with no EU office?
It can. The Act applies based on where the output is used, not where the provider is incorporated. If your knowledge-base assistant serves users located in the EU, or its output is used in the EU, the Act's obligations can reach a US-based provider or deployer.
Is a customer-support RAG chatbot automatically high-risk?
No. Answering questions from a help center, product manual or policy document is a classic limited-risk use case. It only becomes high-risk if it's deployed inside one of the specific Annex III contexts, such as screening job candidates or determining access to credit or public benefits.
What exactly does Article 50 require me to show users?
A clear, reasonably prominent notice that the user is interacting with an AI system, unless that would be obvious from context. For a chat-style knowledge-base assistant, a persistent label near the input box is typically sufficient.
Do I need a CE marking for a knowledge-base assistant?
Only if it qualifies as a high-risk AI system under the Act, in which case conformity assessment and CE marking apply much like other regulated products. Minimal and limited-risk assistants don't require this.
How does the AI Act interact with GDPR for a RAG system?
They're separate but overlapping regimes. The AI Act governs how the AI system itself must behave and be disclosed; GDPR governs the personal data inside the documents you index, including lawful basis, retention and data subject rights. You typically need to satisfy both, which is why a GDPR-specific review of your source documents is still necessary even for a low-risk assistant.
Does using a third-party language model shift my obligations?
Partly. The heaviest transparency and documentation duties for general-purpose AI models sit with the model provider. But as the party deploying the assistant on top of that model, you still carry deployer obligations, including the Article 50 transparency notice and, if applicable, high-risk duties tied to how you use the assistant.
Get the Kopik newsletter
New knowledge bases, RAG guides and product news. One email every week or two, unsubscribe in one click.
By subscribing you agree to receive our newsletter. We never share your address.