The EU AI Act: two steps forward, one step back

Medlir Mema
Briefing
AI Governance
Published
19
March 2024
10
minute read

In a historic first, the European Parliament approved on March 13, 2024, the Artificial Intelligence Act. The vote is one of the final steps before a process - that started more than three years ago with the European Commission’s April 2021 proposal - is brought to an end by May or June of this year. Adopting a risk-based approach, which according to EU officials ensures the future proofing of the legislation, the EU AI Act has the potential to become an important AI governance model. That is both good and bad news.

AI Definition

To begin with, the EU AI Act consolidates the definitional debate on AI systems by borrowing from the OECD definition and proposing under Article 3 of the AI Act that AI systems are “a machine-based system designed to operate with varying levels of autonomy, that may exhibit adaptiveness after deployment and that, for explicit or implicit objectives, infers, from the input it receives, how to generate outputs such as predictions, content, recommendations, or decisions that can influence physical or virtual environments.”

The definition may be considered by some as too broad. However, at a time when the group of governmental experts on lethal autonomous weapons (LAWS) meeting under the auspices of the Convention on Certain Conventional Weapons (CCW) have found it difficult, if not impossible, to make any meaningful progress on the issue of the definition of LAWS, EU’s decision to adopt the OECD definition is wise, efficient, and likely to further institutionalize what is increasingly becoming a widely accepted and recognized definition.

A Risk-Based Approach

In what is perhaps one of the more innovative aspects of the legislation, the AI Act, as mentioned, adopts a risk-based approach and categorizes AI systems under four rubrics – unacceptable risks, high risks, limited risks, and minimal risks – based on the level of threat they pose. Whereas minimal risks include technologies and applications “such as AI-enabled video games or spam filters,” and limited risks include AI systems intended to directly interact with persons, such as chatbots, and are governed by less stringent regulations, the same can’t be said with regards to unacceptable risk and high risk systems.

Unacceptable risk applications include practices such as social scoring by governmental bodies, exploitation of vulnerable groups, predictive policing, and AI-enabled indiscriminate surveillance practices, which according to the EU constitute a “clear threat to the fundamental rights of people.” AI systems that may lead to these applications are banned within the EU and violations are punished by the imposition of hefty fines of “up to 35 million Euros or 7% of global annual revenue (whichever is higher), [compared to] €15 million or 3% for violations of the AI act’s obligations and €7,5 million or 1,5% for the supply of incorrect information.”

Protection of fundamental rights

The legislation goes some way towards addressing some of the main concerns of civil society, which had consistently lobbied against allowing such practices and AI-enabled technologies to permeate the public space. Despite such concessions, civil society and human rights advocates have expressed serious reservations regarding the final draft of the legislation approved by the European Parliament. At the heart of their criticism, lies the exceptions provided in legislation for law enforcement. Organizations like Article 19, for example, have taken issue with the AI Act’s failures “to completely ban the use, among others, of emotional recognition technologies and real-time remote biometric identification in publicly-accessible spaces,” arguing that there should be no allowance made for the use of these technologies by law enforcement in real time or after the fact.

Others lament the fact that the EU's “list of high-risk systems fails to capture the many AI systems used in the migration context and which, eventually, will not be subjected to the obligations of this Regulation. The list excludes dangerous systems such as biometric identification systems, fingerprint scanners, or forecasting tools used to predict, interdict, and curtail migration.” The concern here arises from the fact that while the AI Act foresees that all AI systems regardless of their risk categorization must comply with EU regulation between 6 months and 2 years from the entry into force of the law, “AI used as part of EU large-scale databases in migration, such as Eurodac, the Schengen Information System, and ETIAS  will not have to be compliant with the Regulation until 2030.”

National security exceptions constitute a third and related source of concern for many who see in the legislation a carte blanche for national security institutions to carve out space for the use of “the most nefarious kind of AI, one which invades the right to privacy of often the most marginalized and vulnerable groups.” Worse, there is a perception that by surrendering to pressure from law enforcement authorities and national security voices, the EU AI Act has created a “parallel legal framework when AI is deployed by law enforcement, migration, and national security authorities,” which is likely to weaken EU’s normative and institutional power on AI global governance.

General Purpose AI Systems and Foundation Models

One area where the new legislation is likely to have a significant, and potentially market-defining impact, are the demands for data transparency. Negotiators of the EU AI Act insisted that “in order to increase transparency on the data that is used in the pre-training and training of general-purpose AI models, including text and data protected by copyright law, it is adequate that providers of such models draw up and make publicly available a sufficiently detailed summary of the content used for training the general-purpose model.” Companies like OpenAI, already under pressure from US domestic regulators as well as competitors like Elon Musk’s xAI, who have expressed concern both about the lack of transparency on the part of OpenAI as well as the latter’s insistence to maintain the code closed.

Additionally, foundation models that are considered high impact or high risk due to their above average performance parameters and which have been adjudged to pose a systemic risk along the value chain must submit to a stricter regime which includes abiding by strict transparency obligations ahead of deployment. Fundamental Rights Impact Assessment for High-Risk AI Systems, as reflected in Article 29a of the EU AI Act, requires that “deployers that are bodies governed by public law or private operators providing public services and operators deploying high-risk systems perform an assessment of the impact on fundamental rights that the use of the system may produce.”

Additionally, the data transparency requirement and the fundamental rights impact assessment for high risk AI systems are both seen as challenging existing practices and operating procedures among the world’s largest companies developing general purpose AI systems. This includes the necessity for companies to adopt more rigorous and transparent data governance frameworks, ensuring the traceability and accountability of AI systems throughout their lifecycle. Also, companies may need to allocate additional resources for ongoing monitoring and evaluation of AI systems’ impact on fundamental rights, leading to a reevaluation of their risk management strategies and potentially influencing their business models to prioritize transparency and ethical integrity.

EU AI Office

Finally, one of the main concerns regarding the EU AI Act is the question of relevance and responsiveness. On this count, it is worth noting that the European Commission released its proposal in April 2021 in response a series of EU-wide initiatives including a 2017 European Council call for a “sense of urgency to address emerging trends’ including ‘issues such as artificial intelligence …, while at the same time ensuring a high level of data protection, digital rights and ethical standards,” followed by additional calls from various EU institutions in 2019, 2020, and 2021.

Remarkably, however, many of these developments were soon overtaken by the impressive performance of OpenAI’s ChatGPT, which turned the attention of the policy makers and of the general public towards the promise of large language models, thus rendering moot much of the regulatory framework that EU officials had envisioned. OpenAI’s unexpected and spectacular growth then serves as a reminder of the disruptive nature of emerging technologies, underlining the difficulty of anticipating the appropriate regulatory framework for what in effect are unknown unknowns.

Here, the EU's risk-based approach is likely to serve it well at least in the short term, even though most EU officials and observers have serious concerns about whether or not by the time the AI Act comes fully into effect, any of the legislation will be relevant given the advances in technology. In part to mitigate these concerns, the EU legislation established under Article 55b the European AI office, a European AI Board, and a Scientific Panel of Independent Experts, among others.

Conclusion

The EU AI Act represents a significant step forward in regulating AI technology within the European Union and beyond. Its importance lies in its potential to safeguard fundamental rights, ensure consumer protection, and foster innovation while addressing the risks associated with AI deployment. The Act introduces a comprehensive framework that promotes transparency, accountability, and trust in AI systems.

However, the EU AI Act, while aiming to regulate artificial intelligence for the protection of civil liberties, introduces concerns regarding surveillance and national security exceptions. The Act's broad allowances for national security purposes could lead to unchecked government surveillance, potentially infringing upon privacy rights and denial of fundamental rights for the most vulnerable segments of our society. The Act's vague language and loopholes may facilitate the development of opaque surveillance systems, undermining transparency and accountability while prioritizing security over fundamental freedoms.

Despite these challenges, the EU AI Act represents a crucial foundation for shaping the future of AI governance, both within the EU and globally. Its emphasis on balancing innovation with ethical considerations reflects a proactive approach towards harnessing the potential benefits of AI technology while mitigating its risks. Moving forward, it will be essential to monitor the implementation of the Act closely, ensuring that it strikes the right balance between fostering innovation and protecting societal values and rights.

AI Governance

AI, Sustainable Development and the Future of Education: A Governance Imperative

ai-sustainable-development-and-the-future-of-education-a-governance-imperative

Commentary

Global Education

August 17, 2026

Financing Syria's Recovery: The EU and a Fragile Economic Opening

financing-syrias-recovery-the-eu-and-a-fragile-economic-opening

Briefing

Global Economy

August 12, 2026

European Defence: The European Union Framework as a Dead End

european-defence-the-european-union-framework-as-a-dead-end

Briefing

Peace and Security

July 22, 2026

The New Development Bank Joins the Shift Towards Nuclear Energy Financing

the-new-development-bank-joins-the-shift-towards-nuclear-energy-financing

Commentary

Global Economy

July 13, 2026

An Issue Area Approach to Defending Global Governance

an-issue-area-approach-to-defending-global-governance

Briefing

Peace and Security

July 2, 2026

Europe’s Defence Supply Chains Need Africa and the Global South

europes-defence-supply-chains-need-africa-and-the-global-south

Commentary

Global Economy

June 12, 2026

Retrenchment as Policy Failure: Aid Cuts, the Post-UNITAMS Vacuum, and Sudan's Civilian Crisis

retrenchment-as-policy-failure-aid-cuts-the-post-unitams-vacuum-and-sudans-civilian-crisis

Briefing

Peace and Security

May 28, 2026

The Illusion of AI Sovereignty: Mapping the Five-Layer AI Stack

the-illusion-of-ai-sovereignty-mapping-the-five-layer-ai-stack

Commentary

AI Governance

May 15, 2026

Towards a Science for Diplomacy? The U7+ Alliance and the Strategic Repositioning of Universities in Global Governance

towards-a-science-for-diplomacy-the-u-7-alliance-and-the-strategic-repositioning-of-universities-in-global-governance

Commentary

Global Education

April 27, 2026

The Capability Overhang: Cognition and Labor in the Age of AI

the-capability-overhang-cognition-and-labor-in-the-age-of-ai

Commentary

AI Governance

April 9, 2026

The UN80 Initiative as a Productive Failure: Between Geopolitical Disruptions and Organizational Path Dependency

the-un80-initiative-as-a-productive-failure-between-geopolitical-disruptions-and-organizational-path-dependency

Analysis

Peace and Security

March 31, 2026

Higher Education at a Crossroads: Why Europe’s Universities Must Lead, Not Merely Comply

higher-education-at-a-crossroads-why-europes-universities-must-lead-not-merely-comply

Commentary

Global Education

February 23, 2026

What Comes After the US-Israel Strikes on the Islamic Republic?

what-comes-after-the-us-israel-strikes-on-the-islamic-republic

Commentary

Peace and Security

December 19, 2025

Do You Know What’s in Your Skies? Emerging Challenges for Civil Aviation Governance

do-you-know-whats-in-your-skies-emerging-challenges-for-civil-aviation-governance

Commentary

AI Governance

December 18, 2025

Knowledge creation in times of scarce resources in higher education

knowledge-creation-in-times-of-scarce-resources-in-higher-education

Commentary

Global Education

November 10, 2025

Justice-Ready Digital Public Infrastructure: Building a Third Layer of Trust for Democratic Resilience

justice-ready-digital-public-infrastructure-building-a-third-layer-of-trust-for-democratic-resilience

Briefing

AI Governance

October 23, 2025

Is a Greener Future for AI Possible?

is-a-greener-future-for-ai-possible

Commentary

AI Governance

October 20, 2025

Silencing Dissent: How the Tech Backlash Threatens Transitional Justice

silencing-dissent-how-the-tech-backlash-threatens-transitional-justice

Commentary

AI Governance

October 2, 2025

Holding NATO Together and Keeping the US Engaged: Strategic Implications of the Hague Summit

holding-nato-together-and-keeping-the-us-engaged-strategic-implications-of-the-hague-summit

Analysis

Peace and Security

September 9, 2025

Reforming the UN during a financial crisis: a foreseeable failure to align money, mandates, and majorities?

reforming-the-un-during-a-financial-crisis-a-foreseeable-failure-to-align-money-mandates-and-majorities

Briefing

Peace and Security

July 9, 2025

How do we measure the quality of education?

how-do-we-measure-the-quality-of-education

Commentary

Global Education

April 28, 2025

Bound to Fail? The Limits of Diplomacy in the Russia–Ukraine War and the Future of European Security

bound-to-fail-the-limits-of-diplomacy-in-the-russia-ukraine-war-and-the-future-of-european-security

Commentary

Peace and Security

April 8, 2025

A major shift in global higher education is underway: why collective leadership and governance are more important than ever

a-major-shift-in-global-higher-education-is-underway-why-collective-leadership-and-governance-are-more-important-than-ever

Commentary

Global Education

March 26, 2025

AI's Fast-Forward Button: Can We Harness Innovation Without Sacrificing Safety?

ais-fast-forward-button-can-we-harness-innovation-without-sacrificing-safety

Commentary

AI Governance

March 10, 2025

Parliaments in the EU enlargement process: Strengthening capacities of accession country parliaments under the evolving enlargement methodology

parliaments-in-the-eu-enlargement-process-strengthening-capacities-of-accession-country-parliaments-under-the-evolving-enlargement-methodology

Report

Democracy and Human Rights

January 30, 2025

Synthetic Biology and the Future of Global Environmental Governance

synthetic-biology-and-the-future-of-global-environmental-governance

Analysis

Global Environmental Governance

January 28, 2025

Towards a Global Agency for Governing Artificial General Intelligence: Challenges and Perspectives

towards-a-global-agency-for-governing-artificial-general-intelligence-challenges-and-perspectives

Report

AI Governance

January 14, 2025

Normalizing Russia can become Trump’s biggest mistake, but it’s not too late to prevent it

normalizing-russia-can-become-trumps-biggest-mistake-but-its-not-too-late-to-prevent-it

Commentary

Peace and Security

January 13, 2025

Stabilizing Europe’s Security Architecture after the Russo-Ukraine War? The Future of Conventional Arms Control in Europe

stabilizing-europes-security-architecture-after-the-russo-ukraine-war-the-future-of-conventional-arms-control-in-europe

Briefing

Peace and Security

November 20, 2024

INTERPOL: Challenges and Opportunities for the New Secretary General

interpol-challenges-and-opportunities-for-the-new-secretary-general

Commentary

Peace and Security

November 7, 2024

A Fork in the Road? The Kazan Summit of the BRICS

a-fork-in-the-road-the-kazan-summit-of-the-brics

Briefing

Peace and Security

October 30, 2024

UN Summit of the Future and Development: The Way Forward

un-summit-of-the-future-and-development-the-way-forward

Briefing

AI Governance

October 24, 2024

ECOWAS after the ‘Triple Withdrawal’ and the creation of the Alliance of Sahel States

ecowas-after-the-triple-withdrawal-and-the-creation-of-the-alliance-of-sahel-states-challenges-and-ways-ahead-for-regional-security-governance

Analysis

Peace and Security

October 7, 2024

Rushing to Peace, Racing to War: The Challenge of a Just Settlement

rushing-to-peace-racing-to-war-the-challenge-of-a-just-settlement

Commentary

Peace and Security

September 30, 2024

UN Summit of the Future: A Critical Moment for Global AI Governance

un-summit-of-the-future-a-critical-moment-for-global-ai-governance

Commentary

AI Governance

September 20, 2024

Shattered Security: Gender And Coups In Guinea, Mali, And Burkina Faso

shattered-security-gender-and-coups-in-guinea-mali-and-burkina-faso

Briefing

Peace and Security

June 26, 2024

Before the Peace Summit: Testing Multilateralism and Ukrainian Diplomacy

before-the-peace-summit-testing-multilateralism-and-ukrainian-diplomacy

Commentary

Peace and Security

June 14, 2024

The On-Going Quest for Teaching Excellence

the-on-going-quest-for-teaching-excellence

Commentary

Global Education

June 11, 2024

Deepening EU-Japan-US Cooperation on Critical and Emerging Technologies

deepening-eu-japan-us-cooperation-on-critical-and-emerging-technologies

Commentary

AI Governance

May 7, 2024

UNRWA’s Funding Freeze was Unjustified and Undermined Good Governance

unrwas-funding-freeze-was-unjustified-and-undermined-good-governance

Briefing

Democracy and Human Rights

April 25, 2024

Israel’s Non-implementation of the ICJ’s Provisional Measures: International Law Must Be Upheld

israels-non-implementation-of-the-icjs-provisional-measures-international-law-must-be-upheld

Briefing

Democracy and Human Rights

April 2, 2024

The EU AI Act: two steps forward, one step back

the-eu-ai-act-two-steps-forward-one-step-back

Briefing

AI Governance

March 19, 2024

The Council of Europe’s draft AI Treaty: balancing national security, innovation and human rights?

the-council-of-europes-draft-ai-treaty-balancing-national-security-innovation-and-human-rights

Commentary

AI Governance

March 18, 2024

The Ukrainian Peace Formula: content, evolution and diplomatic outreach

the-ukrainian-peace-formula-content-evolution-and-diplomatic-outreach

Analysis

Peace and Security

February 26, 2024

What developments in AI tell us about the future of governance models

what-developments-in-ai-tell-us-about-the-future-of-governance-models

Commentary

AI Governance

February 21, 2024

Whither the Global Governance of Protecting Civilians? An Initial Assessment of the ICJ’s Decision on South Africa v. Israel of 26 January 2024

whither-the-global-governance-of-protecting-civilians-an-initial-assessment-of-the-icjs-decision-on-south-africa-v-israel-of-26-january-2024

Analysis

Democracy and Human Rights

February 14, 2024

How Ukraine uses AI to fight Russian information operations

how-ukraine-uses-ai-to-fight-russian-information-operations

Commentary

AI Governance

February 12, 2024

Got trust? Global governance of emerging technologies

got-trust-global-governance-of-emerging-technologies

Commentary

AI Governance

November 28, 2023

Last minute national objections to the EU’s AI Act are a mistake. Here’s why

rolling-back-the-ai-act-is-a-mistake-heres-why

Commentary

AI Governance

November 27, 2023

Contributions of Latin America and the Caribbean to UN Peace Operations and Recommendations to Increase this Participation

new-ggi-advice-report-latin-american-and-caribbean-countries-contributions-to-un-peacekeeping

Report

Peace and Security

October 12, 2023

Armed Conflict in Nagorno-Karabakh: Crisis, Exodus, and Ethnic Cleansing

armed-conflict-in-nagorno-karabakh-crisis-exodus-and-ethnic-cleansing

Briefing

Peace and Security

October 9, 2023

Thinking of Eloho – One Year On

thinking-of-eloho-one-year-on

Commentary

Peace and Security

August 12, 2023

The Strategic Compass and the EU's Security & Defence Partnerships

the-strategic-compass-implementing-the-partnership-dimension-in-the-area-of-security-and-defence

Report

Peace and Security

July 23, 2023

Franco-German Perspectives: Europe's Moment of Geopolitics

franco-german-perspectives-europes-moment-of-geopolitics

Commentary

Peace and Security

June 2, 2023

A Comprehensive Mapping of National Higher Education Teaching Qualification schemes, Requirements and Provisions for the Promotion and Reward of Teaching Excellence

a-comprehensive-mapping-of-national-higher-education-teaching-qualification-schemes-requirements-and-provisions-for-the-promotion-and-reward-of-teaching-excellence

Report

Global Education

June 1, 2023

Stefaan de Rynck 'Inside the deal: How the EU got Brexit Done'

stefaan-de-ryncks-inside-the-deal-how-the-eu-got-brexit-done

Commentary

Global Education

April 5, 2023

NATO Allies and the Protection of Civilians

nato-allies-and-the-protection-of-civilians

Analysis

Peace and Security

January 11, 2023

Why Jettison Erasmus? The negative consequences for the UK of walking away

why-jettison-erasmus

Commentary

Global Education

January 1, 2021

Doing less with more? The difficult return of Western troop contributing countries to UN Peacekeeping

doing-less-with-more

Analysis

Peace and Security

November 2, 2020

The European Union's Role in International Economic Fora – Paper 4: The IMF

the-european-unions-role-in-international-economic-fora-paper-4-the-imf

Report

Global Economy

September 1, 2015

Civil Society Reforms in Uzbekistan: More than Government Chicanery?

civil-society-reforms-in-uzbekistan-more-than-government-chicanery

Briefing

Peace and Security

January 1, 2014

Assessing the EU’s Joint Communication on the Comprehensive Approach: Implications for EU Crisis Response and Conflict Prevention

assessing-the-eus-joint-communication-on-the-comprehensive-approach

Briefing

Peace and Security

December 15, 2013

The EU Foreign Policy of My Dreams: Ten Wishes

the-eu-foreign-policy-of-my-dreams-ten-wishes

Views from Practice

Peace and Security

December 12, 2013

The Middle East as weapons of mass destruction free zone: A proposal to overcome the deadlock

the-middle-east-as-weapons-of-mass-destruction-free-zone-a-proposal-to-overcome-the-deadlock

Views from Practice

Peace and Security

October 15, 2013

From a Militarized to a Humanized Responsibility to Protect

from-a-militarized-to-a-humanized-responsibility-to-protect-integrating-the-red-cross-and-red-crescent-into-rtop-to-respond-to-natural-disasters-and-global-climate-change

Analysis

Global Environmental Governance

June 1, 2013

Leading the Peacebuilding Commission: An Institutional History in the Making

leading-the-peacebuilding-commission-an-institutional-history-in-the-making

Views from Practice

Peace and Security

March 1, 2013

Anticipating the “Final” Arms Trade Treaty Conference: Eight Concrete Proposals

anticipating-the-final-arms-trade-treaty-conference-eight-concrete-proposals

Analysis

Peace and Security

February 1, 2013

Report for the Inquiry into the European External Action Service – EU sub-committee on External Affairs of the House Of Lords

report-for-the-inquiry-into-the-european-external-action-service---eu-sub-committee-on-external-affairs-of-the-house-of-lords

Briefing

Peace and Security

December 1, 2012

Government and the Process of Governance in Africa

government-and-the-process-of-governance-in-africa

Analysis

Peace and Security

November 1, 2012

The Responsibility to Protect and the Responsibility while Protecting: Friends or Foes?

the-responsibility-to-protect-and-the-responsibility-while-protecting-friends-or-foes

Analysis

Democracy and Human Rights

September 15, 2012

Montenegro’s Accession To The EU: Taking Stock And Suggesting Areas For Progress

montenegros-accession-to-the-eu-taking-stock-and-suggesting-areas-for-progress

Briefing

Democracy and Human Rights

August 1, 2012

Electing Freedom? Key Challenges For Libya After The 7 July 2012 Election

electing-freedom-key-challenges-for-libya-after-the-7-july-2012-election

Briefing

Peace and Security

August 1, 2012

The Somali Crisis and the EU: Moving Onshore and Committing to Somalia

the-somali-crisis-and-the-eu-moving-onshore-and-committing-to-somalia

Analysis

Peace and Security

July 1, 2012

United Nations - European Union Cooperation in the Field of Peacekeeping: Challenges and Prospects

united-nations-european-union-cooperation-in-the-field-of-peacekeeping-challenges-and-prospects

Analysis

Peace and Security

June 1, 2012

Widening The Huntress’s Reach: Legal And Strategic Aspects Of A New Atalanta Mandate

legal-and-strategic-aspects-of-a-new-atalanta-mandate

Briefing

Democracy and Human Rights

April 15, 2012

The Biological Weapons Convention, Bioterrorism And The Life Sciences

the-biological-weapons-convention-bioterrorism-and-the-life-sciences

Briefing

Peace and Security

April 1, 2012

A Democratic Justification for Military and Non-military Humanitarian Intervention

a-democratic-justification-for-military-and-non-military-humanitarian-interventions

Analysis

Democracy and Human Rights

April 1, 2012

Climate Change and Security: Adapting the Discussion to the Evidence

climate-change-and-security

Briefing

Global Environmental Governance

March 15, 2012

The United Nations Entity for Gender Equality and the Empowerment of Women (UN Women)

the-united-nations-entity-for-gender-equality-and-the-empowerment-of-women-un-women

Backgrounder

Peace and Security

September 1, 2011

The International Criminal Court and Kenya’s Post-election Violence

the-international-criminal-court-and-kenyas-post-election-violence

Analysis

Democracy and Human Rights

July 15, 2011

The United Nations Peacebuilding Architecture: Background Note

the-united-nations-peacebuilding-architecture-background-note

Briefing

Peace and Security

March 1, 2011

European Civilian Crisis Management Capacities: Bridging The Resources Gap?

european-civilian-crisis-management-capacities-bridging-the-resources-gap

Briefing

Peace and Security

January 15, 2011

The Changing Constellation of Power and Resistance in the Global Debate over Agrofuels

the-changing-constellation-of-power-and-resistance-in-the-global-debate-over-agrofuels

Analysis

Global Environmental Governance

January 1, 2011