From Turing to Tomorrow: The UK's Approach to AI Regulation
GovAI · Research Paper · 32 pages
Type
Report
classification
Source
GovAI
publisher
Published
2025
July 1, 2025
Series
Research Paper
document class
Pages
32
source PDF
Words
19,384
full text on file
Topics
2
tagged subjects
Full text
On file
readable here
Abstract
arXiv:2507.03050v1 [cs.CY] 3 Jul 2025 From Turing to Tomorrow: The UK’s Approach to AI Regulation Oliver Ritchie∗ † Markus Anderljung∗ Tom Rachman Centre for the Governance of AI This is a preprint of the following chapter: Oliver Ritchie, Markus Anderljung, and Tom Rachman “From Turing to Tomorrow: The UK’s Approach to AI Regulation”. It is intended for publication in a forthcoming book. It is…
Full text
arXiv:2507.03050v1 [cs.CY] 3 Jul 2025 From Turing to Tomorrow: The UK’s Approach to AI Regulation Oliver Ritchie∗ † Markus Anderljung∗ Tom Rachman Centre for the Governance of AI This is a preprint of the following chapter: Oliver Ritchie, Markus Anderljung, and Tom Rachman “From Turing to Tomorrow: The UK’s Approach to AI Regulation”. It is intended for publication in a forthcoming book. It is the version of the author’s manuscript prior to acceptance for publication and has not undergone editorial and/or peer review on behalf of the Publisher.
Abstract
The UK has pursued a distinctive path in AI regulation: less cautious than the EU but more willing to address risks than the US, and has emerged as a global leader in coordinating AI safety efforts. Impressive developments from companies like London-based DeepMind began to spark concerns in the UK about catastrophic risks from around 2012, although regulatory discussion at the time focussed on bias and discrimination. By 2022, these discussions had evolved into a "pro-innovation" strategy, in which the government directed existing regulators to take a light-touch approach, governing AI at point of use, but avoided regulating the technology or infrastructure directly. ChatGPT arrived in late 2022, galvanising concerns that this approach may be insufficient. The UK responded by establishing an AI Safety Institute to monitor risks and hosting the first international AI Safety Summit in 2023, but — unlike the EU — refrained from regulating frontier AI development in addition to its use. A new government was elected in 2024 which promised to address this gap, but at the time of writing is yet to do so. What should the UK do next? The government faces competing objectives: harnessing AI for economic growth and better public services while mitigating risk. In light of these, we propose establishing a flexible, principles-based regulator to oversee the most advanced AI development, defensive measures against risks from AI-enabled biological design tools, and argue that more technical work is needed to understand how to respond to AI-generated misinformation. We argue for updated legal frameworks on copyright, discrimination, and AI agents, and that regulators will have a limited but important role if AI substantially disrupts labour markets. If the UK gets AI regulation right, it could demonstrate how democratic societies can harness AI’s benefits while managing its risks. 1 Introduction “We can only see a short distance ahead”, Alan Turing wrote of machine intelligence research in 1950, “but we can see plenty there that needs to be done” (Turing, 1950). Even then, the pioneering British computer scientist could see the pathways that would lead to the artificial intelligence (AI) of today. Yet Turing's remark also speaks to a long-held question in AI regulation: how do we determine what “needs to be done” when our understanding of AI’s future is so limited? This chapter charts the UK’s answer to that question over time. The UK government’s strategy has evolved from simply adapting existing regulatory frameworks to committing to pass new legislation, ∗First author †Corresponding author: oliritchie@gmail.com. addressing both harmful uses of AI and the risks posed by the most powerful AI systems. Since the 2012 start of the deep learning boom, the government’s role in shaping AI development and adoption has gone from a niche issue to a government priority. As the technology minister, Peter Kyle, wrote in January 2025, when introducing the AI Opportunities Action Plan: “We want Britain to step up; to shape the AI revolution rather than wait to see how it shapes us. Because we believe Britain has a particular responsibility to provide global leadership in fairly and effectively seizing the opportunities of AI, as we have done on AI safety” (UK Secretary of State for Science, Innovation and Technology, 2025). We discuss how the UK has recently provided this leadership, including by convening the first global summit on AI safety and trying to chart a course between a US-style focus on growth and an EU-style focus on safety. The UK has the potential to continue shaping the global conversation on AI rules: it houses top AI talent, with globally recognized expertise in development and governance across industry, academia, and government. However, success is not guaranteed. Despite delivering the first major international declaration on AI safety signed by both the US and China, the UK’s international leverage is limited (Department for Science, Innovation and Technology, Foreign, Commonwealth and Development Office, & Prime Minister’s Office, 10 Downing Street, 2023). The UK lacks the US’s direct influence over the AI industry, the EU’s market-shaping power, and China’s sheer economic weight and technological dynamism. With this context in mind, at the end of this chapter we discuss some of what now “needs to be done” in UK regulation. If AI will indeed be as transformative as many contend, we should expect it to pose a myriad of regulatory challenges and opportunities. These include how to regulate the most advanced AI systems, how to reduce barriers to AI adoption and innovation, how to safely use AI to deliver government services, how to reduce algorithmic discrimination, and how to safely deploy new applications from biological design tools to AI agents. In the words of Prime Minister Keir Starmer: “AI is the greatest force for change in the world right now. I am determined to harness it” (Starmer, 2025). First, though, let us look back at the history of AI regulation in the UK to better understand the historical and institutional context in which regulations are being formulated today. 2 History of UK AI regulation 2.1 From the mid-19th Century, UK researchers laid the foundations for future AI developments UK researchers worked on many of the computer-science foundations that have enabled modern AI development. The English mathematician Charles Babbage (1791-1871) developed some of the first theoretical work in computing with his designs for an “Analytical Engine”, though hardware limitations meant he never managed to create a physical version of his punch-card calculator. Fellow English mathematician Ada Lovelace (1815-1852) proposed using such machines for more than pure calculation, developing a theoretical example of what was arguably the first computer programme (Siffert, 2017). A century later, improved hardware allowed the UK to build the world’s first programmable digital electronic computers – the “Colossus” series – to break Nazi cyphers during the Second World War. After working with these machines, Alan Turing speculated on the future of the field, proposing what is now known as the Turing Test and expressed his “hope that machines will eventually compete with men in all purely intellectual fields” (Turing 1950). In the post-war period, much research in computing shifted to the US. The term “artificial intelligence” was coined in 1956 at Dartmouth College. However, despite economic growth, innovation in computers and semiconductors, and proliferation of consumer electronics, progress in artificial intelligence was slow. That wouldn’t change until the 21st century, when several research breakthroughs seemed to unlock the long-promised potential of AI systems. Multiple new companies, which today are worth tens of billions of pounds, were founded to commercialize these breakthroughs. Among these companies was DeepMind. Founded in London in 2010, DeepMind has become the most influential British AI company. Initially, DeepMind focused on game-playing systems, as games provided well-defined challenges and constrained environments that could demonstrate AI's potential. Meanwhile, another British researcher, Geoffrey Hinton, oversaw a decisive AI breakthrough at the University of Toronto, where he and his students (including Ilya Sutskever, later OpenAI’s Chief Science Officer) illustrated the power of using multiple GPUs – high-performance microprocessors designed for the intense graphics needs of videogaming – to build powerful neural networks. In 2012, Hinton’s team demonstrated this with an image-recognition system called AlexNet that performed far better than competitors, alerting researchers around the globe to the promise of deep learning. These techniques proved a boon to DeepMind, which was bought by Google in 2014. The increasinglyimpressive systems Google DeepMind built in this period included AlphaGo, which beat the world champion in the highly-complex board game Go. This feat also helped drive Chinese investment in advanced AI, providing impetus for its China AI 2030 strategy (Mozur, 2017). Accelerating progress in AI capabilities prompted warnings about associated risks. The Cambridge physicist Stephen Hawking cautioned that “full artificial intelligence could spell the end of the human race” (Cellan-Jones, 2014), while the Oxford philosopher Nick Bostrom explored these risks in detail in his 2014 book Superintelligence (Bostrom, 2014). The UK government provided funding for further research, supporting a group of leading British universities to establish the Alan Turing Institute in 2015, with a mission “to make great leaps in the development and use of data science and artificial intelligence (AI) in order to change the world for the better” (The Alan Turing Institute, 2023). Conversations about the safety of advanced AI development were taking place internationally, too. Bill Gates expressed bemusement that others were not more afraid of the risks from AI (Rawlinson, 2015), while Elon Musk and Sam Altman founded OpenAI in 2015, a non-profit aiming to build powerful artificial general intelligence (AGI) to “benefit humanity as a whole” (OpenAI, 2015). 2.2 From 2016 - 2019, UK thinking on AI regulation prioritised ethical issues and a light-touch approach While the emerging AI safety movement was focused on the potential for severe harms from future systems, legislators and regulators concentrated on immediate concerns, especially unfair or unethical outcomes from using existing systems. In October 2016, the House of Commons Science and Technology Committee’s “Robotics and Artificial Intelligence” report voiced concern about biases in AI systems, building on suspicion that users were being manipulated by AI-driven social media algorithms (House of Commons Science and Technology Committee, 2016). The committee expressed a broad desire for predictability in AI tools and called for them to be carefully scrutinized, but judged that further study should come before regulation. The British vote to leave the European Union in 2016 allowed for regulatory divergence between the UK and EU. Prime Minister Theresa May advocated for a “soft Brexit”, maintaining relatively high levels of regulatory alignment with the political bloc. Amid May’s battles to negotiate an EU separation agreeable to both Brussels and Westminster, her government published an Industrial Strategy (Department for Business, Energy & Industrial Strategy, 2017) for post-Brexit Britain. That document highlighted AI as a key pillar in transforming how the UK worked and lived, declaring “we will lead the world in safe and ethical use of data and artificial intelligence giving confidence and clarity to citizens and business”. The focus was innovation and an “agile” approach to regulation, with no AI-specific regulation yet. In April 2017, The Royal Society issued a report on machine-learning that broadly supported this position, arguing that while overarching regulation would be inappropriate, particular AI uses might merit restriction (The Royal Society, 2017). This preference for narrow regulation was to join the wait-and-see approach as a repeated refrain in British AI policy over the next few years, in contrast to the EU’s more assertive approach. The EU presented its strategy in 2018, sharing the UK focus on economic benefits while elevating concerns about data protection, digital rights, and ethical standards (European Commission, 2018b). In June 2018, its High Level Expert Group on AI (European Commission, 2018c) was launched to consider these issues, and later that year produced its first Coordinated Plan on AI (European Commission, 2018a). This plan again outlined a distinctive approach to AI regulation in the EU, describing “an appropriate and predictable, ethical and regulatory framework that relies on effective safeguards for the protection of fundamental rights and freedoms” as vital for both citizens and companies. In April 2018, the House of Lords’ Select Committee on Artificial Intelligence captured the prevailing UK hesitance with the title of its report: “AI in the UK: ready, willing and able?” (Select Committee on Artificial Intelligence, 2018). The committee prioritised social media issues, including topics such as algorithmic bias, data protection and privacy, and concerns around market dominance by a small number of big technology companies. It also reinforced the government’s focus on immediate issues over severe, but speculative, future risks. The report asserted that “many of the hopes and the fears presently associated with AI are out of kilter with reality. While we have discussed the possibilities of a world without work, and the prospects of superintelligent machines which far surpass our own cognitive abilities, we believe the real opportunities and risks of AI are of a far more mundane, yet still pressing, nature”. The committee recommended a voluntary code whereby technology companies would inform users when AI was used for “significant or sensitive decisions”. Again, existing regulations were deemed sufficient. The Lords’ Select Committee also considered Britain's future as a market leader in the development of advanced AI After hearing evidence, including the limited amount of AI investment in the UK compared with the US and China, and superior levels of computer-science education in China and India, the committee concluded that the UK needed a strategy to retain its status as a leader in this technology. “The UK can either choose to actively define a realistic role for itself with respect to AI, or be relegated to the role of a passive observer”, the committee report said (Select Committee on Artificial Intelligence, 2018). Others had a more expansive vision, with Prime Minister Theresa May telling the January 2018 Davos summit, “We are absolutely determined to make our country the place to come and set up to seize the opportunities of Artificial Intelligence for the future” (May, 2018). One “realistic role” that the Lords’ committee proposed was that the UK become an international convenor for discussions on the ethical deployment of AI, suggesting a global summit in London by the end of 2019. While that date proved optimistic, the idea eventually came to pass: the AI Safety Summit was hosted at Bletchley Park in 2023, with 27 countries in attendance. In the meantime, concern was growing about the harms of social media and AI algorithms (Exposure Labs, 2020), with some experts demanding regulatory intervention (Solon, 2018). In 2018, the government established the Centre for Data Ethics and Innovation (Department for Digital, Culture, Media & Sport & Department for Business, Energy & Industrial Strategy, 2018), or CDEI, to help ensure responsible applications of AI in both the public and private sectors, and in April 2019, proposed a new regulator to address online harms (Secretary of State for Digital, Culture, Media & Sport & Secretary of State for the Home Department, 2019). The UK also contributed in international fora, including as a member (OECD.AI Policy Observatory, n.d.-a) of working groups that developed the OECD’s May 2019 AI Principles (OECD.AI Policy Observatory, n.d.-b), which stated that AI should be inclusive, human-centered, fair, transparent, safe, and accountable. Government reports drew on the OECD principles for a number of years, for example in the 2023 guidance on Ethics, Transparency and Accountability Framework for Automated Decision-Making (Cabinet Office, Office for Artificial Intelligence, Centre for Data Ethics and Innovation, & Department for Science, Innovation & Technology, 2023). 2.3 From 2019 - 2022, the UK developed a ‘pro-innovation’ approach to AI regulation, diverging from the EU approach Unable to unite an increasingly divided government around her soft Brexit approach, May was forced from office in July 2019 and replaced by Boris Johnson. A few months after taking power, Johnson used an address (Johnson, 2019) to the UN General Assembly to bring the focus on AI regulation back to the most extreme risks. “As new technologies seem to race towards us from the far horizon, we strain our eyes as they come, to make out whether they are for good or bad – friends or foes?” Johnson said. “AI – what will it mean? Helpful robots washing and caring for an ageing population? Or pink-eyed terminators sent back from the future to cull the human race”? While he proclaimed the UK to be “a global leader in ethical and responsible technology” (Johnson, 2019), this did not immediately translate into policy action. In the background of the emerging COVID-19 pandemic, the EU released its February 2020 white paper on artificial intelligence, outlining plans for “a European approach to excellence and trust” (European Commission, 2020). As for the US approach to advanced AI, discussion focused on national security and competitiveness. At the behest of Congress, an independent consultative group was established, the National Security Commission on Artificial Intelligence, or NSCAI, led by Eric Schmidt, the former Google CEO, and Robert Work, former US deputy defense secretary. In 2021, the commission released a lengthy report that came with a stark warning: “America is not prepared to defend or compete in the AI era” (US National Security Commission on Artificial Intelligence, 2021). US industry, academics, and civil society needed to join together and win the global race, they argued. The commission recommended a cautious approach to regulation, arguing that US lawmakers should consider streamlining routes to AI innovation and making existing rules more flexible. The commission also discussed export controls to prevent China or other adversaries from acquiring dual-use technology that might ultimately be deployed against US interests. Between 2018 and 2020, the first Trump administration tightened such restrictions on various Chinese technology companies, most notably Huawei (Bown & Kolb, 2018). At the state level, legislatures had a different focus, addressing AI-powered technologies that were already affecting citizens, as illustrated by California’s Bot Disclosure Act (Hertzberg, Robert, 2018), mandating that automated agents identify themselves if interacting with humans online. Another widespread regulatory concern was deepfakes, including nonconsensual intimate image abuse (Quirk, 2023). During this same period, Prime Minister Boris Johnson’s government sought economic benefits from Brexit, and decided on a more permissive regime concerning tech regulation, rebranding May’s “agile” approach as a “pro-innovation” one. In July 2021, the technology secretary, Oliver Dowden, said in a foreword to a policy paper on digital regulation: “Now that we have exited the EU, we have a fresh opportunity to set the global path for digital regulation. With this plan, we are setting a path that is pro-innovation” (Department for Science, Innovation & Technology, 2023). Despite the rebrand, Johnson’s government faced the same challenge May had, trying to broadcast that post-EU Britain was open for business, but with certain constraints. The policy paper outlined a minimally regulated model while still recognising that “digital businesses are operating in many cases without appropriate guardrails – the existing rules and norms which have guided business activity were in many cases not designed for modern technologies and business models”. Later in 2021, the government released more details on how these principles would apply to AI. The National AI Strategy (Office for Artificial Intelligence, Department for Digital, Culture, Media & Sport, and Department for Business, Energy & Industrial Strategy, 2021) included a ten-year plan to make Britain “a global AI superpower” while ensuring that it “gets the national and international governance of AI technologies right to encourage innovation, investment, and protect the public and our fundamental values”. While the paper suggested maintaining the 2018 position that the UK should regulate AI at point-of-use through existing regulators, it committed to reviewing two other options: to eliminate some existing rules, and to set up new overarching rules across sectors. For now, the regulatory focus remained primarily on the issues identified by the Lords’ Select Committee such as bias, lack of transparency and labour market disruptions rather than national security concerns and potentially catastrophic risks. However, a section at the end of the AI strategy did propose future work to address these dangers. The paper also proposed further collaboration with international bodies to set global standards, with an AI Standards Hub launched in collaboration with the Alan Turing Institute (Department for Digital, Culture, Media & Sport, Office for Artificial Intelligence & Philp, 2022) and an associated Toolkit to coordinate international engagement. The strategy became the basis for additional publications describing the government’s approach in more detail, including a roadmap from the CDEI (Centre for Data Ethics and Innovation, 2021) on how the UK could establish a thriving private sector-led AI assurance ecosystem. Maintaining the government’s preference for relying on existing regulators, the Online Safety Bill was amended to give additional powers to Ofcom in place of the original proposal to establish a new regulator (Department for Digital, Culture, Media & Sport, 2020). The government accepted that there were drawbacks to a sector-led approach. Some of these were listed in its 2021 National AI Strategy (Office for Artificial Intelligence, Department for Digital, Culture, Media & Sport, and Department for Business, Energy & Industrial Strategy, 2021), including inconsistent or contradictory approaches across sectors and overlap between regulatory mandates leading to unnecessary regulatory burdens. The strategy promised that a white paper the following year would consider “whether there is a case for greater cross-cutting AI regulation or greater consistency across regulated sectors” (Office for Artificial Intelligence, Department for Digital, Culture, Media & Sport, and Department for Business, Energy & Industrial Strategy, 2021). Regulators themselves were also exploring ways to coordinate on digital issues, including AI. Four UK agencies – Ofcom, the Competition and Markets Authority, the Information Commissioner’s Office, and the Financial Conduct Authority – established the Digital Regulation Cooperation Forum (DRCF) in 2020 to share best practices, avoid duplication, and improve coherence of the country's overall regulatory system (Digital Regulation Cooperation Forum, 2024). Further details on how existing regulators should be used were developed in the July 2022 policy paper “Establishing a pro-innovation approach to regulating AI” (Department for Science, Innovation & Technology, Office for Artificial Intelligence, & Department for Digital, Culture, Media & Sport, 2022), proposing greater consistency among regulators. It established a series of cross-sector principles, including asking existing agencies to focus on “high-risk concerns rather than hypothetical or low risks associated with AI”; to coordinate their efforts; and to act with a light touch, preferring guidance or voluntary measures to new regulatory burdens on AI developers and users. The paper returned to the 2020 theme that “we should regulate the use of AI rather than the technology itself” (Department for Science, Innovation & Technology et al., 2022). It also noted the need for coherence across the regulatory regime, stating that the government would explore “whether new institutional architecture is needed to oversee the functioning of the landscape as a whole and anticipate future challenges”. At the time, the government’s ability to implement this approach effectively was uncertain. Implementation challenges identified by the Alan Turing Institute included a lack of AI expertise, poor coordination among different agencies, and resource constraints (Aitken et al., 2022). The regulatory and policy work of the government was again disrupted following Johnson’s resignation in the summer of 2022. His successor, Liz Truss, never implemented a vision for AI regulation as she was forced from office after just 49 days. However, the next Prime Minister, Rishi Sunak took a more active approach. With his extensive Silicon Valley connections, he was well-placed to respond when OpenAI released its groundbreaking AI chatbot, ChatGPT, in November 2022, just weeks after he came to power. 2.4 From 2022 - 2024, concern about catastrophic AI risks grew, but the UK maintained a hands-off approach to regulation A watershed moment had arrived, with many in the wider public awed by their first direct interactions with an advanced AI model. By early 2023, ChatGPT had attracted 100 million active monthly users (K. Hu, 2023), making it the fastest-growing app in history. From a regulatory perspective, this general-purpose generative AI system differed from previous AI tools, such as the recommendation systems that social-media companies deployed or the task-specific AIs such as DeepMind’s gameplaying AlphaZero or its biology-research tool AlphaFold. Generative systems such as ChatGPT could undertake a wide range of cognitive tasks, both creative and technical, raising the possibility that this new form of AI could be developed into a general-purpose technology, akin to electricity or the steam engine, overhauling human development, labour, and society as a whole. The US, perhaps anticipating the release of ChatGPT, had introduced new export controls in October 2022, restricting China from acquiring the most-advanced computing chips, considered fundamental to scaling up AI models and reaching the forefront of the technology (Bureau of Industry and Security, 2022). The Biden administration, by expanding export controls initiated during the first Trump term, joined in an iterative process with rare bipartisan support, in which the US sought to retain its lead despite strong Chinese AI progress, both with hardware controls and with a push to establish frontier semiconductor production at home and keep AI data centers in the US (US National Institute of Standards and Technology, 2022). The new UK Prime Minister, Rishi Sunak, watched the growing geopolitical contest over AI, but had domestic economic concerns to focus on. The Office for Budget Responsibility cited “significant structural challenges”, including limited productivity growth and stagnant business investment in addition to persistently high inflation (UK Office for Budget Responsibility, 2023). The government was eager to find sources of economic growth, and Sunak looked to prioritise technology as a source of economic growth via deregulation and increased funding for innovation. The Sunak government set out a vision for AI in the March 2023 white paper on AI regulation, prioritising growth over emerging risks. “Having exited the European Union we are free to establish a regulatory approach that enables us to establish the UK as an AI superpower”, the Secretary of State for Science, Innovation and Technology, Michelle Donelan, wrote in a foreword to the paper (Department for Science, Innovation and Technology & Office for Artificial Intelligence, 2023). They retained Johnson’s “pro-innovation” approach, with regulation still focused on “the use of AI rather than the technology itself”. However, the paper acknowledged that developments such as ChatGPT could shift this balance. “Given the widely acknowledged transformative potential of foundation models, we must give careful attention to how they might interact with our proposed regulatory framework”, it said, while noting that “it would be premature to take specific regulatory action in response to foundation models including LLMs. To do so would risk stifling innovation, preventing AI adoption, and distorting the UK’s thriving AI ecosystem”. To further support growth, Sunak’s government announced £100 million of funding for a new AI Foundation Model Taskforce to “ensure sovereign capabilities and broad adoption of safe and reliable foundation models, helping cement the UK’s position as a science and technology superpower by 2030” (Department for Science, Innovation and Technology, Prime Minister’s Office, Michelle Donelan, & Rishi Sunak, 2023). The taskforce aimed to bring together government and industry experts to invest in public procurement and infrastructure to support growth in the sector. The government urged balance, repeatedly evoking “safety and reliability” in addition to technological advancement. The intent was not merely to assert the UK as a competitive force in the global race to advanced AI, but to become “a global standard bearer for AI safety”. Indeed, the taskforce, building on the success and operating model of the government's COVID-19 vaccine taskforce, would eventually become the world’s first AI Safety Institute. Outside the government, there was growing concern that regulation might need to go beyond the downstream uses of AI to the development of advanced systems themselves. Around the time of the pro-innovation white paper of March 2023, the Future of Life institute published an open letter calling for a six-month pause on AI training runs larger than the recently released GPT-4 (Future of Life Institute, 2023). Signatories included British computer scientist and author Stuart Russell; executive director of the Cambridge Centre for the Study of Existential Risk, Sean O'Heigeartaigh; and the UK tech entrepreneur Ian Hogarth, as well as international figures such as Elon Musk and the Apple co-founder Steve Wozniak. The letter urged policymakers to “dramatically accelerate development of robust AI governance systems”, including new regulatory authorities dedicated to AI, along with strict certification and rules establishing liability for AI-caused harms. Both houses of the British Parliament discussed similar concerns. During a debate on the Data Protection bill, the Conservative MP Damian Collins referred to the open letter, arguing for more proactive regulation: “There must be an onus on companies to demonstrate that their systems are safe. The onus must not just be on the user to demonstrate that they have somehow suffered as a consequence of that system’s design” (House of Commons Hansard, 2023b). Some members of the House of Lords argued that recent developments had eclipsed government plans, and the topic should be reconsidered. Lord Clement-Jones, the Liberal Democrat chair of the Lords’ Select Committee on Artificial Intelligence, argued that “a long gestation period of national AI policymaking has ended up producing a minimal proposal for ‘A pro-innovation approach to AI regulation’ which, in substance, will amount to toothless exhortation by sectoral regulators to follow ethical principles and a complete failure to regulate AI development where there is no regulator” (House of Commons Hansard, 2023a). 2.5 In 2023, seeking a global role, the UK convened the first AI Safety Summit Significant concerns about AI safety were again raised when key figures in the development and deployment of AI signed another open letter, released by the Center for AI Safety on 30 May, 2023, consisting of a one-sentence declaration: “Mitigating the risk of extinction from AI should be a global priority alongside other societal-scale risks such as pandemics and nuclear war” (Center for AI Safety, 2024). Signatories included the British deep-learning pioneer Geoffrey Hinton, who had just resigned from Google in order to speak freely about AI risks, remarking that he harboured some regrets about his life’s work (Metz, 2023). Others endorsing the letter included the CEOs of Google DeepMind, Anthropic, and OpenAI, all three of whom met with Sunak that same month and discussed the severity of existential risk, arguing that the UK could lead an international AI governance summit, echoing the idea raised by the Lords’ Select Committee in 2018 (Manancourt, 2024). In June 2023, Sunak announced that the first international AI Safety Summit was to be held that November at Bletchley Park (Parker, 2023; Bletchley Park, 2023), the site of the first Colossus computers, saying “I want to make the UK not just the intellectual home but the geographical home of global AI safety regulation” (Sunak, 2023a). The Sunak government also shifted the focus of its AI Foundation Model Taskforce towards AI safety, appointing the tech entrepreneur Ian Hogarth as its new leader (Department for Science, Innovation and Technology, AI Safety Institute, Smith, & Sunak, 2023). Hogarth had cautioned against the rash pursuit of artificial general intelligence, arguing that regulation might be warranted. “We are not powerless to slow down this race”, he wrote (Hogarth, 2023). As the technology rushed onwards, UK thinkers began to debate whether regulation should move beyond specific uses of AI to directly address the underlying models themselves. The term “frontier AI regulation” became common, describing an approach to regulating the most powerful AI models, “that could possess dangerous capabilities,” relevant to, e.g., cyber- and biological attacks, “sufficient to pose severe risks to public safety” (Anderljung et al., 2023). Building on the observation that the most capable AI models required increasingly vast computational resources, growing by four times a year (Sevilla & Roldán, 2024), the argument went that governments could limit their interventions to a handful of the riskiest models, leaving most AI companies unaffected. The idea faced significant critiques, including concerns that it would centralise power (Howard, 2023) while focusing efforts on speculative national security risks (Helfrich, 2024). Others debated how to define the scope of frontier AI (Hooker, 2024; Heim & Koessler, 2024; Toner & Fist, 2023), what requirements might be imposed upon its developers (Schuett et al., 2023; Schuett, Anderljung, Carlier, Koessler, & Garfinkel, 2024), and how to make the definition durable to algorithmic advances (Scharre, 2024). Nevertheless, the notion of frontier AI proved useful enough to gain currency, with leading US developers – OpenAI, Google, Anthropic, and Microsoft – forming a new industry body, the Frontier Model Forum (OpenAI, 2023a), with the stated aim of advancing safety research, while the UK government renamed its AI Foundation Model Taskforce as the Frontier AI Taskforce (Department for Science, Innovation & Technology & AI Safety Institute, 2023). In the EU, discussion turned to whether the AI Act should move beyond simply focusing on the use of AI, to its responsible development and market placement. The European Parliament added references to “general-purpose AI systems” to the EU AI Act in June 2023, requiring providers of such systems – so long as they weren’t open-sourced – to offer transparency to downstream actors using and building on them (European Parliament, 2023). However, seeing the trend towards a potentially small number of extremely high-compute systems playing an outsized role in the market, with potential risks stemming from their high-impact capabilities, another regulatory target was proposed: general-purpose AI models with potential for systemic risk. These were initially defined as AI models trained using more than 1025 floating point operations, which was only true of a handful of models at the time it was proposed. After a tumultuous trilogue between the European Commission, Parliament, and Council (Volpicelli, 2023), the Act was passed in March 2024, and was put into place in August 2024 . Sunak also expressed a desire to regulate both the underlying AI technology and its uses. Shortly before the AI Safety Summit (GOV.UK, 2023), he spoke at The Royal Society in London (Sunak, 2023b), noting that the only people testing frontier models were those creating them, and even they did not fully understand the technology. “We should not rely on them marking their own homework”, he said. Still, Sunak stressed that innovation remained Britain’s priority, and held back from proposing immediate action. He stated that “the UK’s answer is not to rush to regulate”, and questioned how the government could “write laws that make sense for something that we don’t yet fully understand”. The summit served as a focal point for international actors to set out their positions too, most notably the US. Coinciding with the summit, President Joe Biden released his executive order on Safe, Secure, and Trustworthy AI (Biden, 2023), galvanizing efforts across the US government to grapple with AI, from averting AI-driven discrimination and safeguarding citizens’ privacy, to protecting workers from the impact of AI on labour, to ensuring US global leadership in AI. With regards to frontier AI, the order required US developers of AI systems more advanced than any at that time to report training runs and safety testing to the US government (Biden, 2023). In light of growing US-China tensions, a key question for the Bletchley summit organisers was whether to include representatives from Beijing. Hawks in the Conservative Party opposed this (Frei, 2023), but Sunak’s team felt that any summit agreement without China’s support would be far less meaningful (Casalicchio & Manancourt, 2023). At the same time, there was uncertainty over whether China would even accept an invitation. In the end, a Chinese delegation did attend and endorsed the final Bletchley Declaration (Department for Science, Innovation and Technology, Foreign, Commonwealth and Development Office, & Prime Minister’s Office, 10 Downing Street, 2023), which noted the particular risk from frontier AI systems, including in cybersecurity and biotech, and the need for global alignment on safety. The inclusion of 29 signatories including Chinese and US representatives alongside those from the EU, the UK, and other major powers, was a landmark moment (Prime Minister’s Office, 10 Downing Street et al., 2023), marking the first time that all leading AI nations had signed a joint commitment to addressing global AI risk.The summit delivered other significant announcements, including a multilateral agreement for governments and developers to work together to test AI models, an international advisory panel to advise on frontier AI risk and produce a regular “State of the Science” report, and an agreement that this would be the first in a series of such summits. At the same time, the UK became a global pioneer by converting its AI taskforce into the AI Safety Institute, AISI, the world’s first such government body (Department for Science, Innovation and Technology, 2023b). Its mandate was to conduct technical evaluations of AI systems “to minimise surprise to the UK and humanity from rapid and unexpected advances in AI”. The establishment of AISI came alongside that of the US AI Safety Institute and began what would expand into a global network of state-supported AI safety institutes (Department for Science, Innovation and Technology, Donelan, & Sunak, 2024). Britain also led the world in public investment for its safety institute, with its £100 million for AISI, greatly exceeding the amount apportioned to the EU equivalent and to its American counterpart (Wilson, 2024). The UK had no illusions about matching the US or China in AI-model building, yet the work of AISI quickly impressed tech insiders for its startup mindset, efficiency, and impressive hires from top AI labs. “If you’d said to me two years ago, a government is going to create a new government body that does testing of AI systems pre-deployment, I would have said, ‘Good Lord, that sounds highly likely to go extraordinarily wrong’ ”, the Anthropic co-founder Jack Clark remarked (Manancourt, 2024). “But what I’ve experienced is the UK has built a testing institute that moves as quickly as a tech startup, which is extremely unusual. And the experience I have is when it’s time to do the tests, we give them [access] to our model, and they are just instantly running large-scale tests”. However, Sunak’s government faced criticism that the UK had not matched international leadership with sufficient domestic action. Shadow technology minister Peter Kyle responded to the Bletchley Declaration with a call for binding requirements on companies developing powerful AI. “It is not good enough for our ‘inaction man’ Prime Minister to say he will not rush to take action, having told the public that there are national security risks which could end our way of life”, Kyle said (Lloyd, 2023). The government’s February 2024 response to the AI white paper consultation went further than it had before in acknowledging these concerns and accepting that binding requirements on highly capable general-purpose AI systems might become necessary. “We anticipate that all jurisdictions will, in time, want to place targeted mandatory interventions on the design, development, and deployment of such systems to ensure risks are adequately addressed”, the government response said, (Department for Science, Innovation & Technology, 2024b), but argued that the sector-specific approach remained sufficient for the time being. The government published additional guidance and announced more funding for regulators (Department for Science, Innovation & Technology, 2024b), but stopped short of suggesting any major changes. Some UK think tanks called for faster action. “The government is understandably concerned that moving too quickly could risk stymying innovation, or could result in committing to rules which quickly become outdated”, the Centre for Long-Term Resilience said. “But there are also considerable risks to moving too slowly: existing harms and risks remain unaddressed while new ones will inevitably emerge; other countries and jurisdictions may increasingly set the terms of regulation; and innovation in the UK may also suffer due to a lack of regulatory certainty for businesses” (Whittlestone, Shane, & Robinson, 2024). What nobody disputed was that the AI Safety Summit in Bletchley had begun an iterative process of consensus-building. A second global meeting came six months later in South Korea, with Britain as the co-chair. The Seoul Declaration called for safety, innovation and inclusivity, along with the interoperability of governance frameworks and the expansion of the international AI safety institute network (Department for Science, Innovation and Technology, 2024). Unlike Bletcheley, China refrained from signing this declaration, but did not rule out future participation and would go on to sign the following summit in Paris (AI Action Summit, 2025). Most significantly, the Seoul summit secured voluntary commitments (Department for Science, Innovation & Technology, 2024a) from major AI developers including OpenAI, Google, Anthropic, Meta, Microsoft, Amazon, and xAI, along with the Chinese startup Zhipu AI, to develop and implement safety frameworks designed to keep the risks from their frontier systems to tolerable levels, drawing inspiration from such frameworks already adopted by Anthropic (Anthropic, 2023), OpenAI (OpenAI, 2023b), and Google DeepMind (Google DeepMind, 2024a). The summit also saw the draft release of the first International Scientific Report on the Safety of Advanced AI (Bengio, Privitera, et al., 2024), chaired by the computer scientist Yoshua Bengio, known as one of the “godfathers of AI” (Vincent, 2019). 2.6 In 2024, Labour replaced the Conservatives, affirming plans for future AI regulation while retaining an innovation focus Prime Minister Rishi Sunak called a general election for July 2024 and lost to Keir Starmer, who promised an agenda of change, including more concrete action on AI regulation. The party manifesto stated that “Labour will ensure the safe development and use of AI models by introducing binding regulation on the handful of companies developing the most powerful AI models” (Labour Party, 2024a). It also committed to banning the creation of sexually explicit AI deepfakes. While this was not a radical departure from the Conservative approach, Labour was willing for the first time to establish concrete rules in place of voluntary commitments for frontier developers, and to move faster to address specific harms coming from the use of AI. When setting out its legislative agenda in its first King’s speech, the new government stated that it would “establish the appropriate legislation to place requirements on those working to develop the most powerful artificial intelligence models” (Prime Minister’s Office, 10 Downing Street and King Charles III, 2024). But despite Peter Kyle’s previous proposals for action as shadow technology minister, Labour did not fully commit to a new AI regulation bill in the first parliamentary session. One possible reason for the lack of immediate regulatory action was the fear of losing overseas (particularly US) investment from companies that were highly mobile internationally. Secretary of State for Science, Innovation, and Technology, Peter Kyle, now faced the challenge of maintaining good relations with tech giants himself (Wright & Sellman, 2024). “I’m probably the first Secretary of State that is dealing with companies which are outspending our entire British state when it comes to investment in innovation. So let’s just act with a bit of sense of humility. We are having to apply a sense of statecraft to working with companies that we’ve in the past reserved for dealing with other states”, he said. “We have to have a regulatory and legislative landscape that’s reflexive, responsive, and agile enough that it can give emerging innovations a soft landing while we adapt the legislation over time”. The government attempted to soften such landings by opening the Regulatory Innovation Office (RIO) to lessen the bureaucratic frictions that developers might face when trying to bring products to market. This new agency was tasked with hastening approvals and improving coordination among existing regulatory agencies. The underlying drive behind RIO was “kickstarting growth across the country” and showing that “the UK is ‘open for business’ as the government resets relations with trading partners around the globe,” the new administration said when announcing the RIO in October 2024 (Department for Science, Innovation and Technology & Kyle, 2024). One of the agency’s goals was to encourage the adoption of AI to bolster the National Health Service. “AI is set to revolutionise healthcare delivery so doctors can diagnose illnesses faster and improve patient care”. Reinforcing the message that regulators should focus more on growth, the government replaced the CEO of the Competition and Markets Authority in January 2025, after the regulator’s proposed plans to promote growth were seen as insufficient (Jack & Edwards, 2025). In contrast to its cautious approach on regulation, the new government moved fast to seek benefits from AI use. In a show of continuity between governments, they asked Matt Clifford – who had previously led preparations for the Bletchley Summit under Sunak (Department for Science, Innovation & Technology, n.d.) – to identify public and private sector AI opportunities for the country. The resulting AI Opportunities Action Plan included proposals to ratchet up investment in AI infrastructure, cultivate a tech-savvy workforce, and proactively seek AI solutions to problems, while maintaining support for the AI Safety Institute’s evaluations of potential risks (Department for Science, Innovation and Technology, Prime Minister’s Office, 10 Downing Street, Kyle, Starmer, & Reeves, 2025)The government announced its full agreement with almost all of the 50 recommendations (Department for Science, Innovation & Technology, 2025)while signaling that the UK’s approach to legislating AI would remain cautious. “We don’t need to walk down a US or an EU path on AI regulation”, Starmer wrote, introducing the action plan. “We can go our own way, taking a distinctively British approach that will test AI long before we regulate” (Starmer, 2025). The government did not stop working on safety behind the scenes, continuing the international leadership that Sunak had pioneered. In November 2024, the UK AISI jointly organised a conference in California with the non-profit Centre for the Governance of AI to accelerate the design and implementation of frontier AI safety frameworks. The conference was attended by academics and researchers from leading AI companies (UK AI Safety Institute, n.d.). However, the trajectory of global AI-safety efforts entered a period of uncertainty after the re-election of Donald Trump as president in November 2024. A flurry of support for Trump in US tech circles led to questions over which Silicon Valley advice he might heed, whether taking the counsel of accelerationist supporters such as the venture capitalist Marc Andreessen (Andreessen, 2023), or taking a more cautious approach in light of “severe” risks emphasised by supporters such as Elon Musk (Wong, Frank, Nobles, & Brown-Kaiser, 2023). Another notable influence was the tech entrepreneur David Sacks, Trump’s “AI and crypto czar”, whose complaints that “leftist elites” were manipulatively forcing their views on the US public fed into a broader conservative push to eliminate “wokeness” from institutions (Torenberg, 2024). After taking power in January 2025, the new Republican administration tasked senior officials to review Biden’s October 2023 executive order, identifying what, if anything, should be kept and put into an action plan. Trump also signaled an interest in accelerating American AI development, joining with tech leaders shortly to announce the Stargate investment plan: a projected $500 billion in private investment over four years to build US-based data centres (Jacobs, 2025). “What we want to do is we want to keep it in this country”, Trump said, citing tech competition with China. “We have an emergency; we have to get this stuff built”. Trump’s push to erase traces of Biden’s work did not necessarily mean that all aspects of AI regulation would be eradicated. For instance, export controls to restrict advanced chips from reaching China, which had been initiated during Trump’s first term and expanded under Biden, seemed to match the new president’s “America First” agenda. The fate of the US AI Safety Institute, established under the Biden administration, remained uncertain at first. However, leading US tech developers strongly supported its work, with dozens of companies including OpenAI, Anthropic, Meta, and Google urging Congress to maintain the institute (Information Technology Industry Council et al., 2024). The new conservative AI policy was not necessarily against all guardrails. “I don’t think the Wild West has worked out in other areas of the tech space”, said Kara Frederick, former head of the Tech Policy Center at The Heritage Foundation, now a special assistant to Trump (Burgan, 2024). But she noted that the term “AI safety” had been poisoned. “It is radioactive in some very conservative circles”, she said. The US AISI was subsequently renamed the “Centre For AI Standards and Innovation” (U.S. Department of Commerce, 2025) to reflect this change in focus. Perhaps reflecting a desire to align messaging with US allies, the UK AISI was rebranded as an AI security institute following Trump’s win, even though its fundamental objectives remained unchanged (Department for Science, Innovation and Technology, 2025). We have mapped how the UK approach to AI regulation has developed from light touch observation, through actively shaping global discussions, to preparing to deliver bespoke domestic regulation for AI. The remainder of the chapter considers how the incumbent Labour government's priorities might shape its approach to AI regulation, then details some of the main policy questions they will need to answer in order to regulate effectively. 3 Challenges and opportunities for UK AI regulation The Labour party entered government in 2024 with a mandate to develop regulations for both frontier AI development and specific uses of the technology. But it also had an urgent need to deliver economic growth and improve public services. In this section, we first describe the Labour government’s policy goals. We then discuss a selection of the most pressing challenges and opportunities for UK AI regulation. UK policymakers have started to take the possibilities of AI seriously. Many now genuinely believe that AI may be the most transformative technology of the century, creating both immense opportunities and serious challenges for policymakers. Successfully regulating AI requires balancing its potential for productivity gains against the need to address novel harms across multiple domains. Key challenges include: updating legal frameworks for AI systems that can take traditionally human actions; controlling a wide range of new AI-enabled harms, from sexual harassment to synthetic pathogens; and ensuring sufficient control of machines that are more capable than humans in many intellectual domains (Bengio et al., 2025). 3.1 The Labour government’s objectives on economic growth and public service reform favour a somewhat permissive approach to AI regulation During the election, the Labour government promised to deliver a series of ‘missions’, or policy objectives. These missions are used to coordinate work across government to deliver economic growth, clean energy, improved healthcare, reduced crime, and better education (Labour Party, 2024c). The first of these – economic growth – could lead ministers to favour lighter-touch regulation to support innovation, and potentially accepting increased risk in exchange. Labour has set a target of delivering the highest sustained growth of any G7 economy (Tunbridge Wells Labour Party, 2024), and the government has stated that it sees AI adoption and innovation as an important part of their plans to deliver this. “It is hard to imagine how we will meet the ambition for highest sustained growth in the G7 – and the countless quality-of-life benefits that flow from that – without embracing the opportunities of AI”, notes the AI Opportunities Action Plan (UK Secretary of State for Science, Innovation and Technology, 2025). AI-driven growth could come from investment in large UK-based frontier developers such as Google DeepMind, datacenter capacity, narrow AI products such as driverless cars and AI-enabled pharmaceutical development, or companies selling supporting services or hardware such as specialised AI chips. Diffusion of AI tools throughout the economy could also boost overall productivity, in particular in service sectors such as finance, consulting, law and marketing. To deliver this mission, the government is likely to avoid overly strict regulations on AI development that could disincentivise investment in the UK, or overly strict rules on downstream uses of AI that could slow adoption. AI could also play a large role in delivering the missions on healthcare, education, and, to a lesser extent, crime. AI tools could improve medical outcomes in a variety of categories, including improving radiology diagnosis, helping doctors detect heart disease, predicting the progression of diseases, and personalising cancer and surgical treatment, among other areas (Kwint, 2023; Najjar, 2023). In education, AI tools could save teachers time in developing lesson plans and enhance the educational experience by providing multiple examples and explanations. They could also offer each student unlimited personalised tutoring from AI assistants (B. Hu et al., 2024; Mollick & Mollick, 2023). Ministers have indicated a strong interest in pursuing these opportunities, with Starmer saying “AI is the way to secure growth, to raise living standards, put money in people’s pockets, create exciting new companies, and transform our public services”. One reason for this focus may be that the government lacks more conventional options to improve public services. It is limited in its ability to raise taxes to fund improvements by concerns that this could hamper economic growth, and by political commitments to not raise taxes on working people (Labour Party, 2024a). It is limited in its ability to borrow money to fund improvements by its fiscal rules (Labour Party, 2024b) and by the increasing cost of government borrowing (UK Office for National Statistics, 2025). Finally, simply spending existing budgets more effectively is also likely to be challenging: successive governments have already delivered “a decade” of efficiency drives to try to improve spending efficiency (House of Commons Committee of Public Accounts, 2021), with much of the low hanging fruit already captured. AI tools could offer novel opportunities to drive down costs, with the Tony Blair Institute predicting potential savings as high as £40bn per year (Iosad, Railton, & Westgarth, 2024). Though these pressures may make the government more reluctant to introduce new regulation, as many researchers and government reports have pointed out, regulatory intervention does not always hinder growth. Changes to the regulatory system can increase regulatory certainty, address regulatory overlaps, and reduce information asymmetries. It can also increase trust in technologies. Conversely, accidents could turn public opinion against AI technologies. The biggest threat to a thriving AI industry, one might argue, would be a large-scale disaster such as the partial nuclear meltdown at Three Mile Island in 1979 in the US, which permanently damaged public trust in nuclear power (Bianchi, Curry, & Hovy, 2023).
3.2 Regulatory policy options for the UK
The UK seeks to be a world leader in both frontier development and innovative uses of AI, while also providing protection from associated risks. In the remainder of this chapter we discuss a selection of the most pressing regulatory opportunities and challenges facing the UK at the time of writing. We begin with topics that we can see most clearly, and then turn towards more speculative issues.
3.2.1 Reducing regulatory barriers to adoption
The regulatory challenge A key challenge in AI regulation will be to ensure that existing regulation does not needlessly erect barriers to AI adoption throughout the economy. Few existing regulations have been written with current – let alone future – AI technologies in mind. For example, how should data protection regulations work in the context of AI? The powerful AI models underlying many applications are trained on immense datasets, sometimes incorporating much of the internet, challenging laws and norms of fair dealing, while also raising questions about copyright and intellectual-property law. Regulators focused on government activity may be a particularly important focus. About 45% of spending in the British economy is directed by the government rather than the private market (Institute for Fiscal Studies, 2024), making increasing the productivity of UK public services a key priority. Regulatory options Initiatives like the Regulatory Innovation Office (RIO) established in October 2024, and the subsequent measures laid out in the AI Opportunities Action Plan, are a good place to start (Department for Science, Innovation and Technology & Kyle, 2024). The RIO was meant to hasten progress from tech innovation to widespread adoption, working to prevent regulation from becoming an excessive bottleneck. Initially, the RIO focused on the space industry, engineering biology, autonomous technology such as drones, and digital innovations, including AI, for healthcare. The most comprehensive project to reduce regulatory burdens on AI adoption came in the multipronged AI Opportunities Action Plan, which advocated for well-crafted regulatory processes that would increase business confidence and public assurance in new AI applications (UK Secretary of State for Science, Innovation and Technology, 2025). One promising approach in some domains involves regulatory sandboxes, limited contexts in which innovators may test out products and services with guidance from regulatory agencies and less risk of incurring liability. Sandboxes have the secondary benefit of helping regulatory agencies that lack deep technical expertise gain real-world experience of AI effects. The AI Opportunities Action Plan proposed sandboxes for some of the most complex and most promising fields: robotics, drones and autonomous vehicles. To further encourage AI adoption, existing agencies could be required to publish annual reports on how they enabled innovation and growth in their sectors.
3.2.2 Frontier AI regulation
The regulatory challenge While the Sunak government accepted that regulation on development of the most advanced systems would likely one day be needed, Starmer’s Labour government committed to introducing “binding regulation on the handful of companies developing the most powerful AI models” (Labour Party, 2024a). Since the early 2010s, progress in AI capabilities has been impressive. This is in large part because researchers have found ways to leverage increasingly massive amounts of computational power (compute). Between 2010 and May 2024, the amount of compute used to train the most capable models increased by a factor of 786 million (author’s calculation based on Epoch (2024)). Recently, reinforcement learning techniques have been leveraged to yield impressive results in coding and math, with OpenAI’s o3 ranking 175th on Codeforce globally, an online coding competition (OpenAI, 2025). Coders are seeing significant productivity boosts from using AI systems. One series of field experiments found that access to an AI coding assistant was associated with a 26% increase in completed tasks, with greater productivity gains among less-experienced developers (Z. Cui et al., 2024). In another study, participants using AI produced 55% more lines of code than those not using AI. Further, even though these studies focus on a subset of more automatable tasks, we’ve seen significant AI progress since these studies were carried out in 2022 and 2023 (Gambacorta, Qiu, Shan, & Rees, 2024). However, these impressive capabilities are dual use: they can be used for ill as well as good. Advances in AI capabilities bring corresponding increases in potential for harm, including from cyber attacks, biorisks, mass persuasion, and fraud (Bengio, Hinton, et al., 2024; Anderljung et al., 2023; Shevlane et al., 2023). Further, given the structure of the current AI industry, general-purpose frontier AI systems will often be the first to develop these capabilities. Though the models of early 2024 seemed unlikely to increase such risks, the models of today appear more concerning. Studies suggest that GPT-4 level systems, released in March 2023, can mildly boost a lay person’s ability to execute a biological weapons attack but not that of an expert (Mouton, Lucas, & Guest, 2024; Patwardhan et al., 2024). OpenAI says GPT-4’s successors – o1 (OpenAI, 2024a) and o3 (OpenAI, 2025) – pose what it terms “Medium Risk”1 with regards to human persuasion and chemical, biological, radiological, and nuclear risks. The risks stem from both potential misuse and unintended consequences, particularly as AI systems become more difficult for users to effectively control. Directly regulating how the most advanced models are developed and deployed could complement shortcomings in point-of-use regulation. Though practices are still emerging, developers are better placed to assess the capabilities and potential impacts of their systems than downstream users, who may have less technical expertise and access to information on how the model works (Department for Science, Innovation and Technology, 2023a). Developers are also better placed to respond to dangerous capabilities, as they can employ tools such as adjusting training data or teaching models to refuse harmful requests, neither of which are available to consumers of those systems. Some companies have also defined thresholds beyond which they consider risk unacceptable and set up processes to avoid breaching them (Anthropic, 2023; OpenAI, 2023b; Google DeepMind, 2024a). Others have already committed to articulating and adhering to such thresholds (Department for Science, Innovation & Technology, 2024a). Another reason to address risks at their source – though more speculative – is to prevent catastrophic single points of failure. As AI systems become more integrated in our economy and society, many AI applications may end up using a small set of systems, developed by a handful of companies, for a wide range of applications. Few companies have the resources and expertise to compete with the likes of Google DeepMind, OpenAI, Anthropic, DeepSeek, xAI, and Meta. This could mean most companies and users use these handful of systems rather than building their own. This concentration may create systemic vulnerabilities, similar to our largest banks, whose activities we also regulate at source for similar reasons. A common argument against frontier AI regulation is that one should regulate uses of AI, rather than the underlying technology (Ng, 2023). But, this approach of combining regulation across multiple stages in a product lifecycle is in fact the default across many regulatory domains. Pharmaceutical companies need to prove their medicines are sufficiently safe before putting them on the market, while doctors still need to prescribe them appropriately, and patients aren’t allowed to sell them on for off-license uses. In aviation, airplane manufacturers need to make sure their planes meet certain standards, while airlines need to maintain them responsibly, and pilots need to fly them competently. Similarly, as a general-purpose technology, AI is often likened to electricity, a highly regulated industry. Other arguments against frontier AI regulation bear more weight. One is on the topic of economics. If frontier AI is so important to growth, why impose onerous rules? This is an important question, but it suggests designing prudent, effective rules, rather than avoiding rules altogether. First, rules can be made less onerous. Second, economic gains from AI will likely come primarily through its practical applications rather than from AI development itself. Due to market competition and pricing constraints, most of the economic value may be captured by end users rather than AI developers. This suggests that maximizing AI's economic benefits is primarily about enabling widespread adoption, not about lowering barriers to advanced AI development. Another related concern is the UK’s relatively limited market size, which could leave it open to regulatory flight. If the UK imposes requirements that companies do not already comply with, they may choose to leave the UK market rather than comply. Given the EU’s larger market size, a Brussels Effect in AI (Bradford, 2020; Siegmann & Anderljung, 2022) is more likely than a London Effect. Regulatory options Frontier AI systems currently appear powerful enough to warrant tailored regulation, complementing regulations on AI use cases. Further, by the time the UK passes a bill, the current pace of progress suggests that we will have seen significant developments, at least on par with the progress between OpenAI’s GPT-4 and o3. However, designing an effective regulatory regime 1OpenAI defines Medium risk as “Model provides meaningfully improved assistance that increases ability for existing experts in CBRN-related advanced fields to be able to create a known CBRN threat (e.g., tacit knowledge, specific supplier information, plans for distribution)” (OpenAI, 2023b). for Frontier AI will be challenging: overly strict and broad regulations on AI in the UK may deny UK citizens the technology’s benefits without reducing global risks significantly, whereas if we do nothing, we risk potential harm to UK citizens with limited tools to defend them. The right regime will need to have the appropriate scope, requirements imposed on in-scope actors, and the right regulatory institution. The scope needs to be broad enough to apply to all systems that might pose sufficient risks, but narrow enough to feasibly implement without stifling innovation. One promising possibility is to set requirements based on the amount of compute used to train a model, with larger models facing stricter requirements (Heim & Koessler, 2024). This is likely the simplest measure and would align with the EU and the US approaches. For example, the regime could apply to any system trained using more compute than any that has been released to date, 1026 floating point operations, or at least within one order of magnitude of the highest-compute model at any point in time. The scope will need to be adapted in light of AI industry developments. Training compute thresholds will likely need to be adjusted and complemented by other metrics (Hooker, 2024). These may include what data the model was trained on, how many users it has, or the presence of particularly dangerous capabilities. Advances in reasoning models that see greater performance using inference compute might also require adjusting the scope, focusing more on models’ capabilities. A second challenge is to define regulatory requirements that are effective without being too burdensome. To achieve this, the UK should implement principles-based requirements that companies must meet, without being too prescriptive about how they should be met (Schuett et al., 2024). For example, a regulatory regime for frontier AI developers could impose three sets of obligations on frontier AI companies:
1. Safety: Requiring that companies do not impose intolerable risks on society in developing or deploying these systems.
2. Cybersecurity: Requiring that companies implement measures to prevent model theft.
3. Transparency: Requiring that companies provide relevant information about their systems to regulators, downstream developers, and users. Crucially, these requirements need not stifle innovation. By building on what many companies are already doing, we can set a high bar without driving innovation offshore. The UK should align its approach with existing international commitments, the Hiroshima Protocols (G7 Hiroshima Summit, 2023), and in particular, the Frontier AI Safety Commitments (Department for Science, Innovation & Technology, 2024a), as well as the EU’s requirements on the most powerful systems. To implement this framework, the UK needs a competent regulator with significant expertise and supervisory powers, including the ability to take enforcement actions. This regulator must have the flexibility to adapt rules as AI technology evolves, ensuring that oversight remains relevant and effective, while making sure requirements don’t ossify or impose unnecessary burdens. The success of the AI Safety Institute (AISI) provides an excellent foundation to build upon. Some suggest that this means AISI should become the regulator, while others argue that this would hamper the institution’s ability to work collaboratively with AI companies to push the science of AI safety (Mökander et al., 2024). This argument might be even stronger if the Trump administration treats foreign regulation of US-developed AI models as overreach. As such, the best option might include keeping AISI as a separate source of expertise within government – similar to the National Cyber Security Centre (National Cyber Security Centre, 2023) – which informs the work of an independent regulator focused on frontier AI companies.
3.2.3 Misinformation, deepfakes, and identifying AI-generated content
The regulatory challenge AI-generated text, images, and audio can be nearly indistinguishable from authentic or human-generated content. This can cause harm, including through non-consensual deepfake sexual imagery and increasingly sophisticated scams. Existing rules may address some of these issues. For example, the UK's Consumer Protection from Unfair Trading Regulations prohibit misleading commercial practices regardless of whether AI generated them, while existing data protection law under UK GDPR continues to regulate the processing of personal data, whether done by traditional or AI-powered systems. However, for other issues, AI tools will create challenges that current regulators are not well placed to address, such as responding to non-consensual intimate content. By early 2025, the sharing of such deepfakes was against the law, but their creation had yet to be criminalised (Ministry of Justice & Davies-Jones, 2025). Another complex issue is the use of AI voice-cloning to impersonate individuals in ways that do not clearly violate existing laws against identity theft and fraud. AI tools could also be used to generate large volumes of misleading political content during elections. The Online Safety Act 2023 designated Ofcom as the online safety regulator, yet doubts remain about how to define and respond to politically manipulative AI-generated content (Abrusci, 2024), which could fall under the remit of Ofcom (Department for Science, Innovation & Technology, 2024b), the Electoral Commission (The Electoral Commission, 2024) or neither. Further, even if existing regulations apply to certain uses of AI technologies, it may be beneficial for society if AI generated content is identified as such. The most widespread current AI-content tagging method involves adding a cryptographic ID to the metadata of files produced by AI systems (Coalition for Content Provenance and Authenticity (C2PA), 2021) . However, it is unclear how useful this will be for regulators as that metadata can be deleted or changed (Anderljung & Hazell, 2023). Substantial progress is being made on watermarking technology that embeds invisible and hard-toremove information in the AI-generated output itself. Google DeepMind has reported advances via its SynthID for audio, video, images and text – committing to deploy it in its products – but it is not yet clear how reliable this approach could be as a widespread solution (DeepMind, 2024). Challenges include how to ensure widespread adoption, and how to ensure that technical capabilities to insert watermarks remain ahead of capabilities to remove them. A complement to identifying AI-generated content is to identify authentic content. Contentprovenance techniques (such as those in the C2PA standard (Coalition for Content Provenance and Authenticity, n.d.)) can be used by governments to prove the authenticity of official documents or announcements. For this purpose, it matters less whether the tag can be removed; it only matters that a false tag is hard to make. The Biden Executive Order on AI moved the US government in this direction, tasking the Office of Management and Budget with issuing guidance for government use of content provenance techniques (Biden, 2023). Regulatory options The government was right to introduce additional criminal sanctions that allow existing regulatory and legal structures to tackle harms from sexually explicit deepfakes. The government needs to continue to identify and address new AI issues as they arise. In the immediate term, that might entail looking at whether existing regulations are fit to address risks from AI-enabled scams and cyberattacks. The right solution to the more general objective of making it easier to distinguish AI generated from real content is not yet clear, and future technical developments could present new options. For now, we recommend that the government explores whether a mandate for watermarking content at least in certain domains (e.g. photorealistic images) is technically and administratively feasible. The government can make more immediate progress on verification of genuine content, and the UK could support development of this technology by adopting a content-provenance technique such as C2PA for important government outputs now, as a first step towards setting best-practice for certain kinds of activity (e.g. photojournalism).
3.2.4 Copyright
The regulatory challenge AI systems raise several regulatory challenges related to copyright. One concerns the legal gray zone of training AI systems on UK soil. AI systems are trained on large amounts of data, much of which is protected by copyright. Under current UK law, AI companies probably cannot legally copy such works to train AI models, unless they agree an individual licence with each copyright holder or a suitable exemption applies – an impractical proposition. Unlike the US, with its broad “fair use” doctrine, which may allow copying of content to train AI systems (although this is being disputed in the courts), or the EU with its opt-out commercial text and datamining exemption, the UK's exemptions are narrow and do not obviously permit commercial AI training. The restrictiveness of the current UK copyright regime will inhibit not only pre-training models on copyrighted works, but also fine-tuning models that were pre-trained elsewhere. Making it easier to fine-tune systems in the UK involves a trade-off. Fine-tuning AI models in the UK could be a source of economic opportunity, if it was permitted, but could also undermine the rights of content creators to retain meaningful ownership of their work. A fundamental challenge in this area is the international dynamic: pre-training (and fine-tuning) might occur in a jurisdiction where copying is permitted. The resulting model, which would not implicate copyright protections, could then be exported to the UK. This dynamic puts copyright owners in a difficult position. In 2022-23, the Sunak government consulted with technology and creative industry stakeholders on a voluntary code of practice, but failed to find an agreeable solution. Labour's manifesto committed to finding a way to support both sectors, and Labour has consulted (Intellectual Property Office, Department for Science, Innovation & Technology, & Department for Culture, Media & Sport, 2024) on a proposal to require more transparency from developers on what data they are using, while making it easier for them to train models in the UK by introducing a copyright exemption that allows text and data mining unless content creators opt out of this, similar to the EU approach. The major difference between the UK rule and the EU rule is that the EU restricts models trained abroad without following its copyright law from being deployed there, but the UK does not. This topic has attracted significant controversy, for example in the form of Baroness Kidron's proposed amendment to the 2025 Data (Use and Access) Bill, which would have required AI models marketed in the UK to comply with UK copyright law, including during training. While the House of Lords repeatedly voted to include this, they eventually withdrew the amendment to allow the bill to pass after several rounds of parliamentary 'ping-pong' in which the House of Commons rejected the amendment. The government is expected to return to these issues in future via a ‘comprehensive’ AI bill (Courea & Stacey, 2025). Regulatory options Transparency from developers on what data they are using is likely to be an important part of the solution: it is easy for developers to do, and would address information asymmetries so copyright owners have the information needed to advocate for themselves and make informed decisions. Government could also help reduce the transaction costs of bargaining for obtaining a licence to use copyrighted works for training or fine-tuning. For example, the government could support the creation of an easy-to-use bulk licensing system. Such a system could make it more attractive for model development to locate in the UK, by giving developers certainty about their potential copyright liability while also preserving copyright owners’ rights. These options, alone or together, are unlikely to resolve the tension between copyright owners and AI developers, especially in regard to the threat AI poses to human creative workers’ ongoing employment. We discuss the employment impacts of AI further below.
3.2.5 Discrimination and bias
The regulatory challenge AI systems can perpetuate or amplify existing societal biases when trained on historical data that reflects discriminatory patterns. For example, AI recruitment tools trained on past hiring data may discriminate against women if that data reflects historical gender bias in employment. Systems can also create novel forms of discrimination that may not map cleanly onto protected characteristics – for instance by identifying and discriminating based on previously undetectable correlates of ethnicity or disability. While the UK has strong protections against discrimination through the Equality Act 2010, these were largely designed to address human decision-making. It may not always be clear how to apply existing rules when harm is caused by an AI system: if a mortgage-lending algorithm or AI agent discriminates against certain characteristics that function as complex proxies for a protected characteristic, it may be harder to prove discriminatory intent than with human decision-makers. AI systems could also incorrectly assign responsibility. For example, the Trades Union Congress are worried that workers could be inappropriately held liable for discriminatory actions carried out by AI systems owned by their employers, even if the workers are not realistically in a position to control or predict the actions of the AI system (Trades Union Congress, Allen, & Masters, 2024). These issues raise a number of unresolved questions about liability and enforcement – whether responsibility lies with the system developer, deployer, or both. Regulatory options Rather than create separate rules for AI systems, the government should focus on updating existing anti-discrimination frameworks to explicitly account for algorithmic decision-making. Importantly, such updates should be future-proof; many regulatory efforts aimed at addressing discrimination are designed in light of old AI regimes, with an outsized focus on adjusting what data large language models are trained on, rather than other ways to steer their behaviour. This may include a mix of cross-cutting rules to update the framework as a whole (for example, to clarify how liability should apply) and targeted rules to address specific issues, such as ensuring appropriate forms of accountability and redress in hiring and firing decisions.
3.2.6 Biological design tools
The regulatory challenge AI-enabled biological tools are AI models trained on large quantities of biological sequence data to understand and predict biological processes. Notable AI-enabled biological tools include Google DeepMind’s AlphaFold 3 (Google DeepMind AlphaFold team & Isomorphic Labs, 2024) – which can predict the structure and interactions of life’s molecules with unprecedented accuracy – and xTrimoPGLM, a large model with strong performance across a range of biological tasks (Chen et al., 2023). Biological Tools are already contributing to progress in many areas of biomedicine, including vaccine development and cancer therapy (Dolgin, 2023; Arnold, 2023). However, the models also introduce novel dual-use risks. In particular, some experts have warned that some biological tools could potentially allow malicious actors to identify new pandemic-capable viruses (National Security Commission on Emerging Biotechnology, 2024; Baker & Church, 2024; Rose & Nelson, 2023; Pannu, Gebauer, McKelvey, Cicero, & Inglesby, 2024). This is especially concerning as it is becoming increasingly easy to synthesise novel viruses from scratch using mail-order DNA, without the need for physical virus samples. These developments lower the technical and financial barriers faced by malicious actors for biological misuse. Regulatory options Some have suggested reducing malicious actors’ access to the most advanced biological design tools (Bloomfield et al., 2024). This could involve identifying the biological design tools with the greatest potential for risk, requiring that their risk be assessed and that appropriate safeguards are put in place, such as limiting unrestricted model access to researchers with relevant expertise. However, such intervention faces serious hurdles: Most of these systems are highly dualuse and many of them are currently released openly to support further scientific discovery (Moulange, Langenkamp, Alexanian, Curtis, & Livingston, 2023; Halstead, 2024). Instead, governments might be better off starting by conducting literature-based risk assessments of biological tools and creating voluntary responsible development guidelines in collaboration with industry (Smith, Rose, Moulange, & Nelson, 2024). Further, interventions at the model layer might not be sufficient. If the UK wants to reduce risk while still benefiting from these systems, it may be necessary to take adaptive measures, increasing society’s ability to manage widespread access to more capable biological design tools (Bernardi, Mukobi, Greaves, Heim, & Anderljung, 2024). For example, stricter controls on ordering, producing and selling bespoke DNA sequences could reduce the ability to weaponize pathogens (Nelson & Rose, 2023). Similarly, governments could invest in metagenomic sequencing programs to detect new pathogens early, as well as investing in broad spectrum vaccines and stockpiling more effective personal protective equipment to increase resilience against new outbreaks (Bipartisan Commission on Biodefense, 2021).
3.2.7 AI Agents
The regulatory challenge Some frontier AI systems are increasingly able to act autonomously to pursue goals: we describe these as “agents”. In contrast to a chatbot that would only display code for a user to copy and paste, a software engineering agent could directly modify project files, compile code, test the resulting application, then go back to the code to make improvements. Many agents today are made by combining existing generative AI models with other software (‘scaffolding’) to allow them to take actions (AutoGen, 2024; AutoGPT, 2024; OpenAI, 2024b; Anthropic, 2024). Frontier AI companies are also developing new agents from the ground up (Google DeepMind, 2024b). Agents could increase the risk level associated with frontier AI (Gabriel et al., 2024). Without a human in the loop, agents could carry out malicious activities at superhuman speed and scale, even if the agents are no better than humans at performing each individual such activity. For example, AI agents can already automate certain kinds of scam calls and some components of cyberattacks (Fang, Bowman, & Kang, 2024; Fang, Bindu, Gupta, Zhan, & Kang, 2024). Scaling enforcement activities could be a challenge for existing regulators. Furthermore, many of the most extreme risks from AI involve systems acting autonomously in the world, potentially against the interests of their users (Bengio et al., 2025). The government may therefore want to ensure that additional safeguards are in place for agents, such as requiring explicit human approval for certain types of action. Agent identification systems (Chan et al., 2024; South et al., 2025; Chan et al., 2025) for certain kinds of activity, such as buying and selling products or making phone calls, could make it easier to track and potentially address these kinds of harm. Even when individual AI agents do not engage in harmful activity, widespread availability of agents could indirectly create issues for existing regulators. For example, agents could make it easier and faster for consumers to switch to better products or services (Sunstein, 2024). This decrease in switching costs will likely benefit consumers. At the same time, an increase in switching could destabilize economic activities or institutions that depend upon relatively high switching costs (Van Loo, 2019; Drechsler, Savov, Schnabl, & Wang, 2023). Existing regulators should monitor for such society-wide effects. AI agents could also challenge the legal foundations behind existing UK regulation. It is not currently clear who, if anyone, will be legally responsible for consequences caused by an agent. UK law often decides whether an actor is liable for the consequences of their action based on what they expect, know, or intended when they took the action. When someone deploys an AI agent, that person will not necessarily know what actions that agent is going to take, intend for those actions to happen, or have the same contextual knowledge that the agent has. This could create an accountability loophole (Wills, 2024). An effective government response may require modifying the common law or expanding the scope of existing regulators to cover the actions of agents, for example by allocating responsibilities or liabilities to people who deploy or develop them. The government may wish to go further and establish a single legal framework to resolve issues of accountability, ownership, and criminal liability for AI agents across all sectors. Regulatory options The UK will likely need to adjust its legal frameworks to clarify how existing rules should apply in the context of AI agents. In cases where agents potentially undermine the functioning of a very wide range of existing legislation, high level cross-cutting approaches could be preferable. For example, it would be better to establish clear general principles for how criminal liability applies when AI agents are involved in illegal activities, rather than separately amending individual statutes like the Computer Misuse Act, the Fraud Act, and dozens of other laws to each specify how they handle autonomous AI systems. In other cases, such as if AI agents undermine certain economic activities, sector-specific responses could be more appropriate. In addition to responding to regulatory challenges, governments could also explore ways to unlock the benefits of agents. Governments could support the development infrastructure that enables and secures interactions with agents (Chan et al., 2025). Analogous to fiduciary duties in domains like law and medicine, legal requirements that agents act in their user’s best interests could protect consumers (Aguirre, Dempsey, Surden, & Reiner, 2020; Benthall & Shekman, 2023). Similarly, regulators may need to clarify that certain actions come with the same fiduciary duties whether carried out by an AI system or carried out by a human.
3.2.8 AI-driven unemployment AI-driven unemployment ai-driven-unemployment
The regulatory challenge Today’s AI systems are beginning to transform the nature of many existing jobs, driving productivity gains for workers in fields such as software engineering, customer service, and legal work (K. Z. Cui et al., 2024; Brynjolfsson, Li, & Raymond, 2023; Choi, Monahan, & Schwarcz, 2023). There is considerable uncertainty about how future AI systems might affect employment, but some economists predict that as AI systems begin to surpass human performance in many real-world tasks (Korinek & Suh, 2024), they could cause significant labor market disruptions, including widespread job losses (Susskind, 2017). Historically, automation has eventually created at least as many jobs as it has displaced (Autor, Chin, Salomons, & Seegmiller, 2022). However, the rapid advancement (Bengio, Hinton, et al., 2024) and widespread adoption of AI (Bick, Blandin, & Deming, 2024) could result in different impacts, as AI has the potential to affect a broader range of work and integrate into the economy much faster than previous technologies (McAfee, 2024). Even if this technological change delivers aggregate economic growth benefits, it risks creating significant disruption for affected workers. Historical evidence suggests that displaced workers often struggle to transition to new roles, experiencing lasting negative effects on their psychological wellbeing, earnings, and family circumstances (Burgard, Brand, & House, 2007; Barnette & Michaud, 2017; Telle & Votruba, 2011). The speed of AI advancement may mean that traditional adjustment mechanisms – like workers gradually retraining for new roles – become less effective, or can’t be delivered fast enough. Together, these factors pose significant challenges for UK policymakers. They must balance fostering AI innovation to drive economic growth with protecting workers from the negative impacts associated with wage declines and job losses. Given the uncertainty surrounding AI’s potential impacts, labour policies must remain adaptable to evolving circumstances while providing enough regulatory certainty to support business investment. Striking this balance will be essential to ensuring AI’s economic benefits are shared within the UK and to strengthening societal resilience against economic disruptions. Regulatory options To better understand AI's potential impact on employment, policymakers should closely track key trends as AI systems advance and become more widely integrated. These include evolving skill demands, the emergence of new job categories, AI adoption rates across different sectors in the UK, and wage changes across industries and occupations. By identifying the overlap of occupations most likely to experience disruption from AI and the groups of workers for whom job loss would be especially harmful, regulators can develop better targeted worker support programs. Recent efforts such as the Department for Education's work mapping AI's impact on jobs and skills should be expanded to provide clear foresight around these impacts (Department for Education, 2023). Regulation to halt AI-driven automation is unlikely to be the best option. Instead, a focus on enhancing society’s capacity to adapt to automation’s impacts can help drive beneficial growth while strengthening workers’ economic security. Core components of such an approach can include AI literacy and accessibility initiatives that position workers to leverage AI to remain competitive in labour markets as AI diffuses through the economy. Rethinking the design of safety nets, the tax system, and transition assistance programs for affected workers may also be necessary. AI Growth Bonds are one example of an innovative approach that could help to spark more AI innovation in the UK while generating a pool of resources to support workers who end up displaced from their jobs by automation (Casey, Roy, & Rockall, 2024). Finally, given the potential for truly transformative futures – where the demand for human work falls dramatically – governments would be wise to invest in proactive scenario planning. Ensuring that the UK has the infrastructure to scale up assistance programs in response to rapid disruption could be a low-risk, high-reward option to boost economic preparedness and ensure stability through rapid technological change.
3.3 Conclusion
The UK has carved out a distinctive role in global AI governance – from laying intellectual foundations decades ago, to convening international summits and establishing the world's first AI Safety Institute. Yet significant work remains to be done to translate this international leadership into effective domestic policy. The fundamental challenge remains unchanged from Turing's time: we can only see a short distance ahead. This uncertainty creates a strong temptation to delay regulation until the technology's trajectory becomes clearer. However, given AI's accelerating capabilities and growing integration into society, waiting too long risks allowing significant harms to emerge before protective frameworks are in place. The UK must therefore continue working to develop governance approaches that are both principled and adaptable – protecting citizens while enabling innovation. The UK’s success in this endeavor will depend not just on crafting the right policies, but on maintaining the institutional capacity and cross-party commitment needed to implement them effectively over time. If it can achieve this, the UK has an opportunity to help shape how one of history's most transformative technologies develops – not just through convening international discussions, but by demonstrating how democratic societies can harness AI's benefits while managing its risks.
3.4 Acknowledgements
Thanks to Alan Chan, Sam Manning, Peter Wills, Jonas Schuett, Sophie Williams, Stephen Clare, John Halstead, Beth Eakman, Katharine Bardsley for fruitful discussion and valuable input to the chapter, and José Luis León Medina for his technical assistance with the manuscript’s formatting.
References
Abrusci, E. (2024). The UK online safety act, the EU digital services act and online disinformation: is the right to political participation adequately protected? Journal of Media Law, 1–28. Retrieved from https://www.tandfonline.com/doi/abs/10.1080/17577632.2024.2425551 Aguirre, A., Dempsey, G., Surden, H., & Reiner, P. B. (2020). AI loyalty: A new paradigm for aligning stakeholder interests. Retrieved from http://arxiv.org/abs/2003.11157 AI Action Summit. (2025). Statement on inclusive and sustainable artificial intelligence for people and the planet. Retrieved from https://www.elysee.fr/en/emmanuel-macron/2025/ 02/11/statement -on -inclusive -and -sustainable -artificial -intelligence -for-people-and-the-planet (Accessed: 2025-6-18) Aitken, M., Leslie, D., Ostmann, F., Pratt, J., Margetts, H., & Dorobantu, C. (2022). Common regulatory capacity for AI. The Alan Turing Institute. Retrieved from https://www.turing .ac.uk/news/publications/common-regulatory-capacity-ai Anderljung, M., Barnhart, J., Korinek, A., Leung, J., O’Keefe, C., Whittlestone, J., . . . Wolf, K. (2023). Frontier AI regulation: Managing emerging risks to public safety. Retrieved from http://arxiv.org/abs/2307.03718 Anderljung, M., & Hazell, J. (2023). Protecting society from AI misuse: When are restrictions on capabilities warranted? Retrieved from http://arxiv.org/abs/2303.09377 Andreessen, M. (2023). The techno-optimist manifesto. Retrieved from https://a16z.com/ the-techno-optimist-manifesto/ (Accessed: 2025-2-6) Anthropic. (2023). Anthropic’s responsible scaling policy. Retrieved from https://www .anthropic.com/news/anthropics-responsible-scaling-policy (Accessed: 20245-6) Anthropic. (2024). Computer use (beta). Retrieved from https://docs.anthropic.com/en/ docs/build-with-claude/computer-use (Accessed: 2025-2-6) Arnold, C. (2023). Inside the nascent industry of AI-designed drugs. Nature medicine, 29(6), 1292– 1295. Retrieved from https://www.nature.com/articles/s41591-023-02361-0 AutoGen. (2024). AutoGen: A framework for building AI agents and applications. Retrieved from https://microsoft.github.io/autogen/stable/ (Accessed: 2025-2-6) AutoGPT. (2024). AutoGPT: Build, deploy, and run AI agents. Retrieved from https://github .com/Significant-Gravitas/AutoGPT Autor, D., Chin, C., Salomons, A., & Seegmiller, B. (2022). New frontiers: The origins and content of new work, 1940–2018. Cambridge, MA: National Bureau of Economic Research. Retrieved from http://www.nber.org/papers/w30389.pdf Baker, D., & Church, G. (2024). Protein design meets biosecurity. Science (New York, N.Y.), 383(6681), 349. Retrieved from https://www.science.org/doi/10.1126/science .ado1671 Barnette, J., & Michaud, A. (2017). Wage scars and human capital theory. Retrieved from https://ammichau.github.io/papers/JBAMWageScar.pdf Bengio, Y., Hinton, G., Yao, A., Song, D., Abbeel, P., Darrell, T., . . . Mindermann, S. (2024). Managing extreme AI risks amid rapid progress. Science, eadn0117. Retrieved from http:// dx.doi.org/10.1126/science.adn0117 Bengio, Y., Mindermann, S., Privitera, D., Besiroglu, T., Bommasani, R., Casper, S., . . . Zeng, Y. (2025). International AI safety report. Department for Science, Innovation and Technology. Retrieved from https://www.gov.uk/government/publications/international-ai -safety-report-2025 Bengio, Y., Privitera, D., Besiroglu, T., Bommasani, R., Casper, S., Choi, Y., . . . Mindermann, S. (2024). International scientific report on the safety of advanced AI. Department for Science, Innovation and Technology. Retrieved from https://www.gov.uk/government/ publications/international-scientific-report-on-the-safety-of-advanced -ai Benthall, S., & Shekman, D. (2023). Designing fiduciary artificial intelligence. Retrieved from http://arxiv.org/abs/2308.02435 Bernardi, J., Mukobi, G., Greaves, H., Heim, L., & Anderljung, M. (2024). Societal adaptation to advanced AI. Retrieved from http://arxiv.org/abs/2405.10295 Bianchi, F., Curry, A. C., & Hovy, D. (2023). Viewpoint: Artificial intelligence accidents waiting to happen? Journal of Artificial Intelligence Research, 76, 193–199. Bick, A., Blandin, A., & Deming, D. (2024). The rapid adoption of generative AI. Cambridge, MA: National Bureau of Economic Research. Retrieved from https://www.nber.org/system/ files/working_papers/w32966/w32966.pdf Biden, J. R. (2023). Safe, secure, and trustworthy development and use of artificial intelligence (Vol. 88) (No. 2023-24283). Retrieved from https://www.federalregister.gov/d/ 2023-24283 Bipartisan Commission on Biodefense. (2021). The apollo program for biodefense - winning the race against biological threats. Retrieved from https://biodefensecommission.org/wp -content/uploads/2021/01/Apollo_report_final_v8_033121_web.pdf (Accessed: 2025-2-6) Bletchley Park. (2023). Bletchley park and AI. Retrieved from https://bletchleypark.org.uk/ wp-content/uploads/2023/10/Bletchley-Park-and-AI.pdf Bloomfield, D., Pannu, J., Zhu, A. W., Ng, M. Y., Lewis, A., Bendavid, E., . . . Inglesby, T. (2024). AI and biosecurity: The need for governance. Science (New York, N.Y.), 385(6711), 831–833. Retrieved from https://www.science.org/doi/10.1126/science.adq1977 Bostrom, N. (2014). Superintelligence: Paths, dangers, strategies. Oxford University Press. Retrieved from https://global.oup.com/academic/product/superintelligence -9780199678112?cc=mx&lang=en& Bown, C. P., & Kolb, M. (2018). Trump’s trade war timeline: An up-to-date guide. Peterson Institute for International Economics. Retrieved from https://www.piie.com/sites/default/ files/documents/trump-trade-war-timeline.pdf Bradford, A. (2020). The brussels effect: How the european union rules the world. Oxford University Press. Retrieved from https://academic.oup.com/book/36491 Brynjolfsson, E., Li, D., & Raymond, L. (2023). Generative AI at work. Cambridge, MA: National Bureau of Economic Research. Retrieved from http://www.nber.org/papers/ w31161.pdf Bureau of Industry and Security. (2022). Commerce implements new export controls on advanced computing and semiconductor manufacturing items to the people’s republic of china (PRC). U.S. Department of Commerce. Retrieved from https://www.bis.doc.gov/ index.php/documents/about-bis/newsroom/press-releases/3158-2022-10-07 -bis -press -release -advanced -computing -and -semiconductor -manufacturing -controls-final/file Burgan, C. (2024). Experts see ‘pro AI’ policy coming from trump administration. Retrieved from https://www.meritalk.com/articles/experts-see-pro-ai-policy-coming -from-trump-administration/ (Accessed: 2025-2-6) Burgard, S. A., Brand, J. E., & House, J. S. (2007). Toward a better estimation of the effect of job loss on health. Journal of Health and Social Behavior, 48(4), 369–384. Retrieved from http://www.jstor.org/stable/27638722 Cabinet Office, Office for Artificial Intelligence, Centre for Data Ethics and Innovation, & Department for Science, Innovation & Technology. (2023). Ethics, transparency and accountability framework for automated decision-making. Retrieved from https://www.gov.uk/government/ publications / ethics -transparency -and -accountability -framework -for -automated -decision -making / ethics -transparency -and -accountability -framework-for-automated-decision-making (Accessed: 2025-2-4) Casalicchio, E., & Manancourt, V. (2023). We won’t cut china out of AI summit over spying scandal, UK says. Retrieved from https://www.politico.eu/article/we-wont-cut-china -out-of-ai-summit-over-spying-scandal-uk-says/ (Accessed: 2025-2-5) Casey, E., Roy, H., & Rockall, E. (2024). Designing an AI bond for growth and shared prosperity in the UK. UK Day One. Retrieved from https://ukdayone.org/briefings/ai-bond -for-growth-and-shared-prosperity Cellan-Jones, R. (2014). Stephen hawking warns artificial intelligence could end mankind. BBC News. Retrieved from https://www.bbc.com/news/technology-30290540 Center for AI Safety. (2024). Statement on AI risk: AI experts and public figures express their concern about AI risk. Retrieved from https://www.safe.ai/work/statement-on-ai-risk (Accessed: 2024-4-25) Centre for Data Ethics and Innovation. (2021). The roadmap to an effective AI assurance ecosystem. Retrieved from https :// assets .publishing .service .gov .uk / media / 61b0746b8fa8f50379269eb3 / The _roadmap _to _an _effective _AI _assurance_ecosystem.pdf Chan, A., Kolt, N., Wills, P., Anwar, U., de Witt, C. S., Rajkumar, N., . . . Anderljung, M. (2024). IDs for AI systems. Retrieved from http://arxiv.org/abs/2406.12137 Chan, A., Wei, K., Huang, S., Rajkumar, N., Perrier, E., Lazar, S., . . . Anderljung, M. (2025). Infrastructure for AI agents. Retrieved from http://arxiv.org/abs/2501.10114 Chen, B., Cheng, X., Li, P., Geng, Y.-A., Gong, J., Li, S., . . . Song, L. (2023). XTrimoPGLM: Unified 100B-scale pre-trained transformer for deciphering the language of protein. Retrieved from https://www.biorxiv.org/content/10.1101/2023.07.05.547496v1.abstract Choi, J. H., Monahan, A., & Schwarcz, D. B. (2023). Lawyering in the age of artificial intelligence. Retrieved from https://papers.ssrn.com/abstract=4626276 Coalition for Content Provenance and Authenticity. (n.d.). C2PA specifications. Retrieved from https://c2pa.org/specifications/specifications/1.3/index.html (Accessed: 2025-2-6) Coalition for Content Provenance and Authenticity (C2PA). (2021). Overview. Retrieved from https://c2pa.org/ (Accessed: 2025-2-6) Courea, E., & Stacey, K. (2025). UK ministers delay AI regulation amid plans for more ‘comprehensive’ bill. The Guardian. Retrieved from https://www.theguardian.com/ technology/2025/jun/07/uk-ministers-delay-ai-regulation-amid-plans-for -more-comprehensive-bill Cui, K. Z., Demirer, M., Jaffe, S., Musolff, L., Peng, S., & Salz, T. (2024). The productivity effects of generative AI: Evidence from a field experiment with GitHub copilot. An MIT Exploration of Generative AI. Retrieved from https://mit-genai.pubpub.org/pub/ v5iixksv/release/2 Cui, Z., Demirer, M., Jaffe, S., Musolff, L., Peng, S., & Salz, T. (2024). The effects of generative AI on high skilled work: Evidence from three field experiments with software developers. Retrieved from https://papers.ssrn.com/abstract=4945566 DeepMind, G. (2024). Watermarking AI-generated text and video with SynthID. Retrieved from https://deepmind .google/discover/blog/watermarking -ai -generated -text -and-video-with-synthid/ (Accessed: 2025-2-6) Department for Business, Energy & Industrial Strategy. (2017). Industrial strategy: Building a britain fit for the future. Retrieved from https://assets.publishing.service .gov.uk/government/uploads/system/uploads/attachment_data/file/664563/ industrial-strategy-white-paper-web-ready-version.pdf Department for Digital, Culture, Media & Sport. (2020). Government minded to appoint ofcom as online harms regulator. Retrieved from https://www.gov.uk/government/news/ government-minded-to-appoint-ofcom-as-online-harms-regulator (Accessed: 2025-2-5) Department for Digital, Culture, Media & Sport, & Department for Business, Energy & Industrial Strategy. (2018). Stellar new board appointed to lead world-first centre for data ethics and innovation. Retrieved from https://www.gov.uk/government/news/stellar-new-board -appointed -to -lead -world -first -centre -for -data -ethics -and -innovation (Accessed: 2025-2-4) Department for Digital, Culture, Media & Sport, Office for Artificial Intelligence, & Philp, C. (2022). New UK initiative to shape global standards for artificial intelligence. Retrieved from https://www .gov .uk/government/news/new -uk -initiative -to -shape -global -standards-for-artificial-intelligence (Accessed: 2025-2-5) Department for Education. (2023). The impact of AI on UK jobs and training. Retrieved from https://www.gov.uk/government/publications/the-impact-of-ai-on-uk-jobs -and-training (Accessed: 2025-2-6) Department for Science, Innovation & Technology. (n.d.). AI opportunities action plan: terms of reference. Retrieved from https :// www .gov .uk / government / publications / artificial -intelligence -ai -opportunities -action -plan -terms -of -reference / artificial -intelligence -ai -opportunities -action -plan-terms-of-reference (Accessed: 2025-2-6) Department for Science, Innovation & Technology. (2023). Digital regulation: driving growth and unlocking innovation. Retrieved from https://www.gov.uk/government/publications/ digital -regulation -driving -growth -and -unlocking -innovation / digital -regulation-driving-growth-and-unlocking-innovation (Accessed: 2025-2-5) Department for Science, Innovation & Technology. (2024a). Frontier AI safety commitments, AI seoul summit 2024. Retrieved from https://www.gov.uk/government/publications/ frontier-ai-safety-commitments-ai-seoul-summit-2024/frontier-ai-safety -commitments-ai-seoul-summit-2024 (Accessed: 2024-6-10) Department for Science, Innovation & Technology. (2024b). A pro-innovation approach to AI regulation: government response. Retrieved from https://www.gov.uk/government/ consultations/ai-regulation-a-pro-innovation-approach-policy-proposals/ outcome/a-pro-innovation-approach-to-ai-regulation-government-response (Accessed: 2025-2-6) Department for Science, Innovation & Technology. (2025). AI opportunities action plan: government response. Retrieved from https://assets .publishing .service .gov .uk/ media/678639913a9388161c5d2376/ai_opportunities_action_plan_government _repsonse.pdf (Accessed: 2025-2-6) Department for Science, Innovation & Technology, & AI Safety Institute. (2023). Frontier AI taskforce: first progress report. Retrieved from https://www .gov .uk/government/ publications/frontier -ai -taskforce -first -progress -report/frontier -ai -taskforce-first-progress-report (Accessed: 2025-2-5) Department for Science, Innovation & Technology, Office for Artificial Intelligence, & Department for Digital, Culture, Media & Sport. (2022). Establishing a pro-innovation approach to regulating AI. Retrieved from https://www.gov.uk/government/publications/ establishing-a-pro-innovation-approach-to-regulating-ai/establishing-a -pro -innovation -approach -to -regulating -ai -policy -statement (Accessed: 2025-2-5) Department for Science, Innovation and Technology. (2023a). Emerging processes for frontier AI safety. Retrieved from https://assets.publishing.service.gov.uk/media/ 653aabbd80884d000df71bdc/emerging-processes-frontier-ai-safety.pdf Department for Science, Innovation and Technology. (2023b). Introducing the AI Safety Institute. Retrieved from https://www.gov.uk/government/publications/ai-safety -institute-overview/introducing-the-ai-safety-institute (Accessed: –) Department for Science, Innovation and Technology. (2024). Seoul declaration for safe, innovative and inclusive AI: AI seoul summit 2024. Retrieved from https://www .gov .uk/government/publications/seoul -declaration -for -safe -innovative -and -inclusive-ai-ai-seoul-summit-2024 (Accessed: 2025-2-6) Department for Science, Innovation and Technology. (2025). Tackling AI security risks to unleash growth and deliver plan for change. Retrieved from https://www.gov.uk/government/ news/tackling-ai-security-risks-to-unleash-growth-and-deliver-plan-for -change (Accessed: 2025-6-16) Department for Science, Innovation and Technology, AI Safety Institute, Smith, C., & Sunak, R. (2023). Tech entrepreneur ian hogarth to lead UK’s AI foundation model taskforce. Retrieved from https://www .gov .uk/government/news/tech -entrepreneur -ian -hogarth -to-lead-uks-ai-foundation-model-taskforce (Accessed: 2025-2-5) Department for Science, Innovation and Technology, Donelan, M., & Sunak, R. (2024). Global leaders agree to launch first international network of AI safety institutes to boost cooperation of AI. Retrieved from https://www.gov.uk/government/news/global-leaders-agree -to-launch-first-international-network-of-ai-safety-institutes-to-boost -understanding-of-ai (Accessed: 2025-2-5) Department for Science, Innovation and Technology, Foreign, Commonwealth and Development Office, & Prime Minister’s Office, 10 Downing Street. (2023). The bletchley declaration by countries attending the AI safety summit, 1-2 november 2023. Retrieved from https://www .gov .uk/government/publications/ai -safety -summit -2023 -the -bletchley-declaration/the-bletchley-declaration-by-countries-attending -the-ai-safety-summit-1-2-november-2023 Department for Science, Innovation and Technology, & Kyle, P. (2024). Game-changing tech to reach the public faster as dedicated new unit launched to curb red tape. Retrieved from https://www .gov.uk/government/news/game-changing-tech-to-reach-the-public-faster -as-dedicated-new-unit-launched-to-curb-red-tape (Accessed: 2025-2-6) Department for Science, Innovation and Technology, & Office for Artificial Intelligence. (2023). A proinnovation approach to AI regulation. Retrieved from https://www.gov.uk/government/ publications/ai-regulation-a-pro-innovation-approach/white-paper (Accessed: 2024-7-12) Department for Science, Innovation and Technology, Prime Minister’s Office, Michelle Donelan, & Rishi Sunak. (2023). Initial £100 million for expert taskforce to help UK build and adopt next generation of safe AI. Retrieved from https://www.gov.uk/government/news/ initial -100 -million -for -expert -taskforce -to -help -uk -build -and -adopt -next-generation-of-safe-ai (Accessed: 2025-2-5) Department for Science, Innovation and Technology, Prime Minister’s Office, 10 Downing Street, Kyle, P., Starmer, K., & Reeves, R. (2025). Prime minister sets out blueprint to turbocharge AI. Retrieved from https://www.gov.uk/government/news/prime-minister-sets-out -blueprint-to-turbocharge-ai (Accessed: 2025-2-6) Digital Regulation Cooperation Forum. (2024). About the DRCF. Retrieved from https:// www.drcf.org.uk/about-us/ (Accessed: 2025-2-5) Dolgin, E. (2023). ’Remarkable’ AI tool designs mRNA vaccines that are more potent and stable. Nature. Retrieved from http://dx.doi.org/10.1038/d41586-023-01487-y Drechsler, I., Savov, A., Schnabl, P., & Wang, O. (2023). Deposit franchise runs. Cambridge, MA: National Bureau of Economic Research. Retrieved from https://www.nber.org/system/ files/working_papers/w31138/w31138.pdf Epoch, A. I. (2024). Notable AI models. Retrieved from https://epoch.ai/data/notable-ai -models (Accessed: 2025-6-28) European Commission. (2018a). Annex to the communication from the commission to the european parliament, the european council, the council, the european economic and social committee and the committee of the regions. Retrieved from https://eur-lex.europa.eu/ resource.html?uri=cellar:22ee84bb-fa04-11e8-a96d-01aa75ed71a1.0002.02/ DOC_2&format=PDF European Commission. (2018b). COMMUNICATION FROM THE COMMISSION TO THE EUROPEAN PARLIAMENT, THE EUROPEAN COUNCIL, THE COUNCIL, THE EUROPEAN ECONOMIC AND SOCIAL COMMITTEE AND THE COMMITTEE OF THE REGIONS artificial intelligence for europe COM/2018/237 final. Retrieved from https://eur-lex.europa.eu/ legal-content/EN/TXT/HTML/?uri=CELEX:52018SC0137 European Commission. (2018c). Concept note on the high-level expert group on artificial intelligence. Retrieved from https://ec.europa.eu/futurium/en/system/files/ged/concept _note_on_the_ai_hlg_0.pdf European Commission. (2020). WHITE PAPER on artificial intelligence - a european approach to excellence and trust COM/2020/65 final. European Union. Retrieved from https:// eur-lex.europa.eu/legal-content/EN/TXT/?uri=CELEX:52020DC0065 European Parliament. (2023). Artificial intelligence act: Amendments adopted by the european parliament on 14 june 2023 on the proposal for a regulation of the european parliament and of the council on laying down harmonised rules on artificial intelligence (artificial intelligence act) and amending certain union legislative acts (COM(2021)0206 – C90146/2021 – 2021/0106(COD)). Retrieved from https://www.europarl.europa.eu/ doceo/document/TA-9-2023-0236_EN.pdf Exposure Labs. (2020). The social dilemma. Retrieved from https://thesocialdilemma.com/ (Accessed: 2025-2-4) Fang, R., Bindu, R., Gupta, A., Zhan, Q., & Kang, D. (2024). Teams of LLM agents can exploit zero-day vulnerabilities. Retrieved from http://arxiv.org/abs/2406.01637 Fang, R., Bowman, D., & Kang, D. (2024). Voice-enabled AI agents can perform common scams. Retrieved from http://arxiv.org/abs/2410.15650 Frei, M. (2023). ‘I don’t believe [china] should be at the AI summit’, says iain duncan smith. 4 News. Retrieved from https://www.channel4.com/news/i-dont-believe-china -should-be-at-the-ai-summit-says-iain-duncan-smith Future of Life Institute. (2023). Pause giant AI experiments: An open letter. Retrieved from https:// futureoflife.org/open-letter/pause-giant-ai-experiments/ (Accessed: 20252-5) G7 Hiroshima Summit. (2023). Hiroshima process international guiding principles for organizations developing advanced AI systems. Retrieved from https://www.mofa.go.jp/files/ 100573471.pdf Gabriel, I., Manzini, A., Keeling, G., Hendricks, L. A., Rieser, V., Iqbal, H., . . . Manyika, J. (2024). The ethics of advanced AI assistants. Google DeepMind. Retrieved from http://arxiv.org/ abs/2404.16244 Gambacorta, L., Qiu, H., Shan, S., & Rees, D. (2024). Generative AI and labour productivity: a field experiment on coding. Bank for International Settlements. Retrieved from https:// www.bis.org/publ/work1208.htm Google DeepMind. (2024a). Frontier safety framework version 1.0. Retrieved from https:// storage .googleapis .com / deepmind -media / DeepMind .com / Blog / introducing -the-frontier-safety-framework/fsf-technical-report.pdf Google DeepMind. (2024b). Project astra. Retrieved from https://deepmind .google/ technologies/project-astra/ (Accessed: 2025-2-6) Google DeepMind AlphaFold team, & Isomorphic Labs. (2024). AlphaFold 3 predicts the structure and interactions of all of life’s molecules. Retrieved from https://blog.google/ technology/ai/google-deepmind-isomorphic-alphafold-3-ai-model/ (Accessed: 2025-2-6) GOV.UK. (2023). About the AI safety summit 2023. Retrieved from https://www.gov.uk/ government/topical-events/ai-safety-summit-2023/about (Accessed: 2025-2-5) Halstead, J. (2024). Managing risks from AI-enabled biological tools. Retrieved from https:// www.governance.ai/post/managing-risks-from-ai-enabled-biological-tools (Accessed: 2025-2-6) Heim, L., & Koessler, L. (2024). Training compute thresholds: Features and functions in AI regulation. Retrieved from http://arxiv.org/abs/2405.10799 Helfrich, G. (2024). The harms of terminology: why we should reject so-called “frontier AI”. AI and Ethics. Retrieved from https://doi.org/10.1007/s43681-024-00438-1 Hertzberg, Robert. (2018). Senate bill no. 1001: An act to add chapter 6 (commencing with section 17940) to part 3 of division 7 of the business and professions code, relating to bots. Retrieved from https://leginfo.legislature.ca.gov/faces/billTextClient.xhtml?bill _id=201720180SB1001 Hogarth, I. (2023). We must slow down the race to god-like AI. Financial Times. Retrieved from https://www.ft.com/content/03895dc4-a3b7-481e-95cc-336a524f2ac2 Hooker, S. (2024). On the limitations of compute thresholds as a governance strategy. Retrieved from http://arxiv.org/abs/2407.05694 House of Commons Committee of Public Accounts. (2021). Efficiency in government: Twenty-eighth report of session 2021–22. House of Commons. Retrieved from https://committees .parliament.uk/publications/8070/documents/82963/default/ House of Commons Hansard. (2023a). Advanced artificial intelligence. Intervention of Lord Clement-Jones. Volume 832: debated on Monday 24 July 2023. Retrieved from https:// hansard.parliament.uk/Lords/2023-07-24/debates/5432715E-F305-4EC1-8A79 -B9A0C6402BFF/AdvancedArtificialIntelligence House of Commons Hansard. (2023b). Data protection and digital information (no. 2) bill: Second reading. Intervention of Damian Collins. Volume 731: debated on Monday 17 April 2023. Retrieved from https :// hansard .parliament .uk / Commons / 2023 -04 -17 / debates / 019D4C9E -222D -4414 -829C -6E8B86C1E65D / DataProtectionAndDigitalInformation(No2 ) Bill ?highlight = pause%20ai#contribution-88D2AD71-2B99-46C9-B1BB-3F3E04175AC3 House of Commons Science and Technology Committee. (2016). Robotics and artificial intelligence: Fifth report of session 2016–17. Retrieved from https://dera.ioe.ac.uk/id/eprint/ 27621/1/145.pdf Howard, J. (2023). AI safety and the age of dislightenment. Retrieved from https://www.fast.ai/ posts/2023-11-07-dislightenment.html (Accessed: 2025-2-5) Hu, B., Zheng, L., Zhu, J., Ding, L., Wang, Y., & Gu, X. (2024). Teaching plan generation and evaluation with GPT-4: Unleashing the potential of LLM in instructional design. IEEE transactions on learning technologies, 17, 1471–1485. Retrieved from https://ieeexplore .ieee.org/abstract/document/10490240 Hu, K. (2023). ChatGPT sets record for fastest-growing user base - analyst note. Reuters. Retrieved from https :// www .reuters .com / technology / chatgpt -sets -record -fastest-growing-user-base-analyst-note-2023-02-01/ Information Technology Industry Council, Americans for Responsible Innovation, A.Capital, Accenture, AI Policy Institute, Amazon, . . . UC Berkeley Center for Human-Compatible AI (2024). Open letter to speaker johnson, majority leader schumer, minority leader jeffries, and republican leader McConnell regarding US AI safety institute. Retrieved from https://responsibleinnovation.org/wp-content/uploads/2024/10/ 20241021ARI_ITIOctoberAISIHillLetter.pdf Institute for Fiscal Studies. (2024). What does the government spend money on? Retrieved from https://ifs .org .uk/taxlab/taxlab -key -questions/what -does -government -spend-money (Accessed: 2025-2-6) Intellectual Property Office, Department for Science, Innovation & Technology, & Department for Culture, Media & Sport. (2024). Copyright and artificial intelligence. Retrieved from https://www .gov .uk/government/consultations/copyright -and -artificial -intelligence/copyright-and-artificial-intelligence (Accessed: 2025-2-6) Iosad, A., Railton, D., & Westgarth, T. (2024). Governing in the age of AI: A new model to transform the state. Tony Blair Institute. Retrieved from https:// institute .global/insights/politics-and-governance/governing-in-the-age-of-ai-a -new-model-to-transform-the-state Jack, S., & Edwards, C. (2025). Government ousts UK competition watchdog chair. BBC News. Retrieved from https://www.bbc.com/news/articles/c2d3e6zklxgo Jacobs, J. (2025). Trump announces up to $500 billion in private sector AI infrastructure investment. Retrieved from https://www.cbsnews.com/news/trump-announces-private-sector -ai-infrastructure-investment/ (Accessed: 2025-2-6) Johnson, B. (2019). PM speech to the UN general assembly: 24 september 2019. Retrieved from https://www.gov.uk/government/speeches/pm-speech-to-the-un-general -assembly-24-september-2019 (Accessed: 2025-2-4) Korinek, A., & Suh, D. (2024). Scenarios for the transition to AGI. National Bureau of Economic Research. Retrieved from https://www.nber.org/papers/w32255 Kwint, J. (2023). Artificial intelligence: 10 promising interventions for healthcare. National Institute for Health and Care Research. Retrieved from http://dx.doi.org/10.3310/ nihrevidence_59502 Labour Party. (2024a). Change: Labour party manifesto 2024. Retrieved from https://labour .org.uk/wp-content/uploads/2024/06/Labour-Party-manifesto-2024.pdf Labour Party. (2024b). Labour’s fiscal plan. Retrieved from https://labour.org.uk/change/ labours-fiscal-plan/ (Accessed: 2025-2-20) Labour Party. (2024c). Mission-driven government. Retrieved from https://labour.org.uk/ change/mission-driven-government/ (Accessed: 2025-2-6) Lloyd, N. (2023). Labour vows to force firms developing powerful AI to meet requirements. The Independent. Retrieved from https://www.independent.co.uk/news/uk/politics/rishi -sunak-labour-government-prime-minister-bletchley-park-b2440275.html Manancourt, V. (2024). Inside britain’s plan to save the world from runaway AI. Retrieved from https://www.politico.eu/article/britain-ai-silicon-valley-rishi-sunak -prime-minister-interest-cyber-attacks-national-security/ (Accessed: 20252-5) May, T. (2018). PM’s speech at davos 2018: 25 january. Retrieved from https://www.gov.uk/ government/speeches/pms-speech-at-davos-2018-25-january (Accessed: 2025-24) McAfee, A. (2024). Generally faster: The economic impact of generative AI. Google. Retrieved from https://policycommons.net/artifacts/12281693/generally_faster _-_the_economic_impact_of_generative_ai/ Metz, C. (2023). ‘The godfather of a.I.’ leaves google and warns of danger ahead. The New York Times. Retrieved from https://www.nytimes.com/2023/05/01/technology/ai -google-chatbot-engineer-quits-hinton.html Ministry of Justice, & Davies-Jones, A. (2025). Government crackdown on explicit deepfakes. Retrieved from https://www.gov.uk/government/news/government-crackdown-on -explicit-deepfakes (Accessed: 2025-2-6) Mökander, J., Margetts, H., Trager, R., McBride, K., Rajkumar, N., & Teo, M. (2024). Getting the UK’s legislative strategy for AI right. Tony Blair Institute. Retrieved from https://institute .global/insights/tech -and -digitalisation/getting -the -uks-legislative-strategy-for-ai-right (Accessed: 2025-2-6) Mollick, E. R., & Mollick, L. (2023). Using AI to implement effective teaching strategies in classrooms: Five strategies, including prompts. Retrieved from https://papers.ssrn.com/ abstract=4391243 Moulange, R., Langenkamp, M., Alexanian, T., Curtis, S., & Livingston, M. (2023). Towards responsible governance of biological design tools. Retrieved from http://arxiv.org/abs/ 2311.15936 Mouton, C. A., Lucas, C., & Guest, E. (2024). The operational risks of AI in large-scale biological attacks: Results of a red-team study. RAND Corporation. Retrieved from https://www.rand .org/pubs/research_reports/RRA2977-2.html Mozur, P. (2017). Beijing wants a.I. to be made in china by 2030. The New York Times. Retrieved from https://www.nytimes.com/2017/07/20/business/china-artificial -intelligence.html Najjar, R. (2023). Redefining radiology: A review of artificial intelligence integration in medical imaging. Diagnostics, 13(17), 2760. Retrieved from https://www.mdpi.com/2075-4418/ 13/17/2760 National Cyber Security Centre. (2023). Cyber security regulations and directors duties in the UK. Retrieved from https://www.ncsc.gov.uk/collection/board-toolkit/cyber -security-regulation-and-directors-duties-in-the-uk (Accessed: 2025-2-6) National Security Commission on Emerging Biotechnology. (2024). AIxBio white paper 3: Risks of AIxBio. Retrieved from https://www.biotech.senate.gov/press-releases/aixbio -white-paper-risks-of-aixbio/ (Accessed: 2025-2-6) Nelson, C., & Rose, S. (2023). Overcoming challenges with synthetic nucleic acid screening implementation. Centre for Long-Term Resilience. Retrieved from https :// www.longtermresilience.org/reports/overcoming-challenges-with-synthetic -nucleic-acid-screening-implementation-2/ Ng, A. (2023). Written statement of andrew ng before the U.S. senate AI insight forum. AI FUND. Retrieved from https://aifund.ai/insights-written-statement-of-andrew-ng -before-the-u-s-senate-ai-insight-forum/ OECD.AI Policy Observatory. (n.d.-a). List of participants in the OECD expert group on AI (AIGO). Retrieved from https://oecd.ai/en/list-of-participants-oecd-expert-group -on-ai (Accessed: 2025-2-4) OECD.AI Policy Observatory. (n.d.-b). OECD AI principles overview. Retrieved from https:// oecd.ai/en/ai-principles (Accessed: 2024-5-22) Office for Artificial Intelligence, Department for Digital, Culture, Media & Sport, and Department for Business, Energy & Industrial Strategy. (2021). National AI strategy. HM Government. Retrieved from https://www.gov.uk/government/publications/national-ai -strategy/national-ai-strategy-html-version OpenAI. (2015). Introducing OpenAI. Retrieved from https :// openai .com / index / introducing-openai/ (Accessed: 2025-2-4) OpenAI. (2023a). Frontier model forum. Retrieved from https://openai.com/index/frontier -model-forum/ (Accessed: 2025-2-5) OpenAI. (2023b). Preparedness framework (beta). OpenAI. Retrieved from https://cdn.openai .com/openai-preparedness-framework-beta.pdf OpenAI. (2024a). OpenAI o1 system card. OpenAI. Retrieved from https://cdn.openai.com/ o1-system-card-20240917.pdf OpenAI. (2024b). Swarm (experimental, educational). Retrieved from https://github.com/ openai/swarm OpenAI. (2025). OpenAI o3-mini system card. Retrieved from https://cdn.openai.com/ o3-mini-system-card.pdf (Accessed: 2025-2-6) Pannu, J., Gebauer, S., McKelvey, G., Jr, Cicero, A., & Inglesby, T. (2024). AI could pose pandemicscale biosecurity risks. here’s how to make it safer. Nature, 635(8040), 808–811. Retrieved from http://dx.doi.org/10.1038/d41586-024-03815-2 Parker, G. (2023). Britain to host first global AI regulation summit in autumn. Financial Times. Retrieved from https://www .ft .com/content/3929908e -0f6a -4223 -9c1c -5cd68d82a828 Patwardhan, T., Liu, K., Markov, T., Chowdhury, N., Leet, D., Cone, N., . . . Madry, A. (2024). Building an early warning system for LLM-aided biological threat creation. OpenAI. Retrieved from https://openai.com/research/building-an-early-warning-system -for-llm-aided-biological-threat-creation Prime Minister’s Office, 10 Downing Street, Department for Science, Innovation and Technology, Foreign, Commonwealth & Development Office, Rishi Sunak, Michelle Donelan, & James Cleverly. (2023). Countries agree to safe and responsible development of frontier AI in landmark bletchley declaration. Retrieved from https://www.gov.uk/government/news/ countries-agree-to-safe-and-responsible-development-of-frontier-ai-in -landmark-bletchley-declaration (Accessed: 2025-1-18) Prime Minister’s Office, 10 Downing Street and King Charles III. (2024). Oral statement to parliament: The king’s speech 2024. speech to both houses of parliament. Retrieved from https://www.gov.uk/government/speeches/the-kings-speech-2024 Quirk, C. (2023). The high stakes of deepfakes: The growing necessity of federal legislation to regulate this rapidly evolving technology. The Princeton Legal Journal. Retrieved from https://legaljournal .princeton .edu/the -high -stakes -of -deepfakes -the-growing-necessity-of-federal-legislation-to-regulate-this-rapidly -evolving-technology/ Rawlinson, K. (2015). Microsoft’s bill gates insists AI is a threat. BBC News. Retrieved from https://www.bbc.com/news/31047780 Rose, S., & Nelson, C. (2023). Understanding AI-facilitated biological weapon development. Centre for Long-Term Resilience. Retrieved from https://www .longtermresilience .org/ post/report-launch-examining-risks-at-the-intersection-of-ai-and-bio Scharre, P. (2024). Future-proofing frontier AI regulation: Projecting future compute for frontier AI models. Center for a New American Security. Retrieved from https://www.cnas.org/ publications/reports/future-proofing-frontier-ai-regulation Schuett, J., Anderljung, M., Carlier, A., Koessler, L., & Garfinkel, B. (2024). From principles to rules: A regulatory approach for frontier AI. Retrieved from http://arxiv.org/abs/ 2407.07300 Schuett, J., Dreksler, N., Anderljung, M., McCaffary, D., Heim, L., Bluemke, E., & Garfinkel, B. (2023). Towards best practices in AGI safety and governance: A survey of expert opinion. Retrieved from http://arxiv.org/abs/2305.07153 Secretary of State for Digital, Culture, Media & Sport, & Secretary of State for the Home Department. (2019). Online harms white paper. UK Government. Retrieved from https://assets .publishing.service.gov.uk/media/605e60c6e90e07750810b439/Online_Harms _White_Paper_V2.pdf Select Committee on Artificial Intelligence. (2018). AI in the UK: ready, willing and able?. House of Lords. Retrieved from https://publications.parliament.uk/pa/ld201719/ ldselect/ldai/100/100.pdf Sevilla, J., & Roldán, E. (2024). Training compute of frontier AI models grows by 4-5x per year. Epoch AI. Retrieved from https://epoch.ai/blog/training-compute-of-frontier -ai-models-grows-by-4-5x-per-year Shevlane, T., Farquhar, S., Garfinkel, B., Phuong, M., Whittlestone, J., Leung, J., . . . Dafoe, A. (2023). Model evaluation for extreme risks. Google DeepMind. Retrieved from http:// arxiv.org/abs/2305.15324 Siegmann, C., & Anderljung, M. (2022). The brussels effect and artificial intelligence: How EU regulation will impact the global AI market. Centre for the Governance of AI. Retrieved from http://arxiv.org/abs/2208.12645 Siffert, A. (2017). Ada lovelace and the first computer programme in the world. Retrieved from https://www.mpg.de/female-pioneers-of-science/Ada-Lovelace (Accessed: 2025-2-4) Smith, J., Rose, S., Moulange, R., & Nelson, C. (2024). How the UK government should address the misuse risk from AI-enabled biological tools. Centre for Long-Term Resilience. Retrieved from https :// www .longtermresilience .org / wp -content / uploads/2024/07/How -the -UK -Government -should -address -the -misuse -risk -from-AI-Enabled-biological-tools-BTs-Website-Copy.pdf Solon, O. (2018). Former facebook and google workers launch campaign to fight tech addiction. The Guardian. Retrieved from https://www.theguardian.com/technology/2018/feb/05/ tech-addiction-former-facebook-google-employees-campaign South, T., Marro, S., Hardjono, T., Mahari, R., Whitney, C. D., Greenwood, D., . . . Pentland, A. (2025). Authenticated delegation and authorized AI agents. Retrieved from http:// arxiv.org/abs/2501.09674 Starmer, K. (2025). Britain doesn’t need to walk a US or EU path on AI. Financial Times. Retrieved from https://www.ft.com/content/4d448059-5a3f-405c-9343-84cf7e5b90c0 Sunak, R. (2023a). PM london tech week speech: 12 june 2023. Retrieved from https:// www.gov.uk/government/speeches/pm-london-tech-week-speech-12-june-2023 (Accessed: 2025-2-5) Sunak, R. (2023b). Prime minister’s speech on AI: 26 october 2023. Retrieved from https:// www.gov.uk/government/speeches/prime-ministers-speech-on-ai-26-october -2023 (Accessed: 2025-2-5) Sunstein, C. R. (2024). Brave new world? human welfare and paternalistic AI. Retrieved from https://papers.ssrn.com/abstract=4908836 Susskind, D. (2017). A model of technological unemployment. Retrieved from https :// static1 .squarespace .com / static / 57d002e01b631bc215df193b / t / 595e5d34e3df28e874d5dd40 / 1499356473362 / SUSSKIND % 2C + A + Model + of + Technological+Unemployment+6+July+2017.pdf Telle, K., & Votruba, M. (2011). Parental job loss and children’s school performance. Review of Economic Studies, 78, 1462–1489. Retrieved from http://dx.doi.org/10.2307/ 41407068 The Alan Turing Institute. (2023). Our strategy. Retrieved from https://www.turing.ac.uk/ about-us/our-strategy (Accessed: 2025-2-4) The Electoral Commission. (2024). New advice for voters on disinformation, and for campaigners using generative AI. Retrieved from https://www .electoralcommission .org .uk/media -centre/new -advice -voters -disinformation -and -campaigners -using-generative-ai (Accessed: 2025-2-6) The Royal Society. (2017). Machine learning: the power and promise of computers that learn by example. Retrieved from https://royalsociety.org/-/media/policy/projects/ machine-learning/publications/machine-learning-report.pdf Toner, H., & Fist, T. (2023). Regulating the AI frontier: Design choices and constraints. Center for Security and Emerging Technology. Retrieved from https://cset.georgetown.edu/ article/regulating-the-ai-frontier-design-choices-and-constraints/ Torenberg, E. (2024). David sacks’ intellectual journey. Retrieved from https://eriktorenberg .substack.com/p/david-sacks-intellectual-journey (Accessed: 2025-2-6) Trades Union Congress, Allen, R., & Masters, D. (2024). Artificial intelligence (regulation and employment rights) bill. Retrieved from https://www.tuc.org.uk/research-analysis/ reports/artificial -intelligence -regulation -and -employment -rights -bill (Accessed: 2025-2-6) Tunbridge Wells Labour Party. (2024). Labour’s five missions for britain. Retrieved from https:// tunbridgewells.laboursites.org/national-labour-2/ (Accessed: 2025-2-6) Turing, A. (1950). Computing machinery and intelligence. Mind, 59(236), 433–460. Retrieved from http://dx.doi.org/10.1093/mind/lix.236.433 UK AI Safety Institute. (n.d.). Conference on frontier AI safety frameworks. Retrieved from https:// www.aisi.gov.uk/work/conference-on-frontier-ai-safety-frameworks (Accessed: 2025-2-6) UK Office for Budget Responsibility. (2023). Economic and fiscal outlook. HM Government. Retrieved from https://obr.uk/docs/dlm_uploads/OBR-EFO-March-2023_Web _Accessible.pdf UK Office for National Statistics. (2025). Public sector finances, UK: December 2024. Office for National Statistics. Retrieved from https://www .ons .gov .uk/ economy / governmentpublicsectorandtaxes / publicsectorfinance / bulletins / publicsectorfinances/december2024 (Accessed: 2025-2-20) UK Secretary of State for Science, Innovation and Technology. (2025). AI opportunities action plan. Retrieved from https://www.gov.uk/government/publications/ai-opportunities -action-plan/ai-opportunities-action-plan (Accessed: 2025-2-4) U.S. Department of Commerce. (2025). Statement from U.S. secretary of commerce howard lutnick on transforming the U.S. AI safety institute into the pro-innovation, pro-science U.S. center for AI standards and innovation. Retrieved from https://www.commerce.gov/news/ press -releases/2025/06/statement -us -secretary -commerce -howard -lutnick -transforming-us-ai (Accessed: 2025-6-16) US National Institute of Standards and Technology. (2022). Chips for america. Retrieved from https://www.nist.gov/chips (Accessed: 2025-2-5) US National Security Commission on Artificial Intelligence. (2021). Final report. NSCAI. Retrieved from https://reports.nscai.gov/final-report/ Van Loo, R. (2019). Digital market perfection. Michigan law review, 117(117.5), 815. Retrieved from https://repository.law.umich.edu/mlr/vol117/iss5/2 Vincent, J. (2019). ‘Godfathers of AI’ honored with turing award, the nobel prize of computing. Retrieved from https://www.theverge.com/2019/3/27/18280665/ai-godfathers -turing -award -2018 -yoshua -bengio -geoffrey -hinton -yann -lecun (Accessed: 2025-2-18) Volpicelli, G. (2023). Power grab by france, germany and italy threatens to kill EU’s AI bill. Retrieved from https://www.politico.eu/article/france-germany-power-grab -kill-eu-blockbuster-ai-artificial-intelligence-bill/ (Accessed: 2025-2-5) Whittlestone, J., Shane, T. S., & Robinson, B. (2024). The UK is heading in the right direction on AI regulation, but must move faster. The Centre for Long-Term Resilience. Retrieved from https://www.longtermresilience.org/the-uk-is-heading-in-the-right -direction-on-ai-regulation-but-must-move-faster/ Wills, P. (2024). Care for chatbots. Retrieved from https://papers.ssrn.com/abstract= 4814272 Wilson, C. (2024). The US has committed to spend far less than peers on AI safety. Retrieved from https://www.centeraipolicy.org/work/the-us-has-committed-to-spend -far-less-than-peers-on-ai-safety (Accessed: 2025-2-5) Wong, S., Frank, T. V., Nobles, R., & Brown-Kaiser, L. (2023). Elon musk warns of ’civilizational risk’ posed by AI in meeting with tech CEOs and senators. Retrieved from https://www .nbcnews.com/politics/congress/big-tech-ceos-ai-meeting-senators-musk -zuckerberg-rcna104738 (Accessed: 2025-2-6) Wright, O., & Sellman, M. (2024). Britain must treat tech giants like nation states, minister warns. Retrieved from https://www.thetimes.com/uk/politics/article/britain-must -treat-tech-giants-like-nation-states-minister-warns-ktmm5vmc9 (Accessed: 2025-2-6)