Technological progress in neurotechnology and its military use is proceeding apace. As early as the 1970s, brain-machine interfaces have been the subject of study. By 2014, the UK’s Ministry of Defence was arguing that the development of artificial devices, such as artificial limbs, is ‘likely to see refinement of control to provide… new ways to connect the able-bodied to machines and computers.’ Today, brain-machine interface technology is being investigated around the world, including in Russia, China and South Korea.

Recent developments in the private sector are producing exciting new capabilities for people with disabilities and medical conditions. In early July, Elon Musk and Neuralink presented their ‘high-bandwidth’ brain-machine interface system, with small and flexible electrode threads packaged into a small device containing custom chips and to be inserted and implanted into the user’s brain for medical purposes.

In the military realm, in 2018, the United States’ Defense Advanced Research Projects Agency (DARPA) put out a call for proposals to investigate the potential of nonsurgical brain-machine interfaces to allow soldiers to ‘interact regularly and intuitively with artificially intelligent, semi-autonomous and autonomous systems in a manner currently not possible with conventional interfaces’. DARPA further highlighted the need for these interfaces to be bidirectional – where information is sent both from brain to machine (neural recording) and from machine to brain (neural stimulation) – which will eventually allow machines and humans to learn from each other.

This technology may provide soldiers and commanders with a superior level of sensory sensitivity and the ability to process a greater amount of data related to their environment at a faster pace, thus enhancing situational awareness. These capabilities will support military decision-making as well as targeting processes.

Neural recording will also enable the obtention of a tremendous amount of data from operations, including visuals, real-time thought processes and emotions. These sets of data may be used for feedback and training (including for virtual wargaming and for machine learning training), as well as for investigatory purposes. Collected data will also feed into research that may help researchers understand and predict human intent from brain signals – a tremendous advantage from a military standpoint.

Legal and ethical considerations

The flip side of these advancements is the responsibilities they will impose and the risks and vulnerabilities of the technology as well as legal and ethical considerations.

The primary risk would be for users to lose control over the technology, especially in a military context; hence a fail-safe feature is critical for humans to maintain ultimate control over decision-making. Despite the potential benefits of symbiosis between humans and AI, users must have the unconditional possibility to override these technologies should they believe it is appropriate and necessary for them to do so.

This is important given the significance of human control over targeting, as well as strategic and operational decision-making. An integrated fail-safe in brain-machine interfaces may in fact allow for a greater degree of human control over critical, time-sensitive decision-making. In other words, in the event of incoming missiles alert, while the AI may suggest a specific course of action, users must be able to decide in a timely manner whether to execute it or not.

Machines can learn from coded past experiences and decisions, but humans also use gut feelings to make life and death decisions. A gut feeling is a human characteristic that is not completely transferable, as it relies on both rational and emotional traits – and is part of the ‘second-brain’ and the gut-brain axis which is currently poorly understood. It is however risky to take decisions solely on gut feelings or solely on primary brain analysis—therefore, receiving a comprehensive set of data via an AI-connected brain-machine interface may help to verify and evaluate the information in a timely manner, and complement decision-making processes. However, these connections and interactions would have to be much better understood than the current state of knowledge. 

Fail-safe features are necessary to ensure compliance with the law, including international humanitarian law and international human rights law. As a baseline, human control must be used to 1) define areas where technology may or may not be trusted and to what extent, and 2) ensure legal, political and ethical accountability, responsibility and explainability at all times. Legal and ethical considerations must be taken into account from as early as the design and conceptualizing stage of these technologies, and oversight must be ensured across the entirety of the manufacturing supply chain.  

The second point raises the need to further explore and clarify whether existing national, regional and international legal, political and ethical frameworks are sufficient to cover the development and use of these technologies. For instance, there is value in assessing to what extent AI-connected brain-machine interfaces will affect the assessment of the mental element in war crimes and their human rights implications.

In addition, these technologies need to be highly secure and invulnerable to cyber hacks. Neural recording and neural stimulation will be directly affecting brain processes in humans and if an adversary has the ability to connect to a human brain, steps need to be taken to ensure that memory and personality could not be damaged.

Future questions

Military applications of technological progress in neurotechnology is inevitable, and their implications cannot be ignored. There is an urgent need for policymakers to understand the fast-developing neurotechnical capabilities, develop international standards and best practices – and, if necessary, new and dedicated legal instruments – to frame the use of these technologies.

Considering the opportunities that brain-machine interfaces may present in the realms of security and defence, inclusive, multi-stakeholder discussions and negotiations leading to the development of standards must include the following considerations:

• What degree of human control would be desirable, at what stage and by whom? To what extent could human users be trusted with their own judgment in decision-making processes?
• How could algorithmic and human biases, the cyber security and vulnerabilities of these technologies and the quality of data be factored into these discussions?
• How can ethical and legal considerations be incorporated into the design stage of these technologies?
• How can it be ensured that humans cannot be harmed in the process, either inadvertently or deliberately?
• Is there a need for a dedicated international forum to discuss the military applications of neurotechnology? How could these discussions be integrated to existing international processes related to emerging military applications of technological progress, such as the Convention on Certain Conventional Weapons (CCW) Group of Governmental Experts on Lethal Autonomous Weapons Systems?

New technology such as 5G, artificial intelligence, nanotechnology and robotics have become, now more than ever, intertwined with geopolitical, economic and trade interests. Leading powers are using new technology to exert power and influence and to shape geopolitics more generally.

The ongoing race between the US and China around 5G technology is a case in point. Amid these tensions, the impact on developing countries is not sufficiently addressed.

Arguably, the existing digital divide will increase leading developing countries to the early, if not hasty, adoption of new technology for fear of lagging behind. This could create opportunities but will also pose risks.

This panel discusses how new technology is changing the geopolitical landscape. It also discusses the role that stakeholders, including governments, play in the creation of standards for new technologies and what that means for its deployment in key markets technically and financially.

Finally, the panel looks at the issue from the perspective of developing countries, addressing the choices that have to be made in terms of affordability, development priorities and security concerns.

This event was organized with the kind support of DXC Technology.

The US and China have entered into an increasingly confrontational relationship over trade and technology. This may force Europe to make difficult choices between the two economic superpowers – or perform a balancing act. Although the recent US-China phase-1 trade deal has eased the relationship for now, the trade and technology tensions are a structural issue and are likely to persist.

The debate over Huawei’s participation in 5G networks is an example of how the UK and other countries may face competing priorities in economic, security and foreign policy. Can Europe avoid a binary choice between the US and China? Is it possible for the EU to position itself as a third global power in trade, technology and standard-setting? What strategies should Europeans adopt to keep the US and China engaged in the rules-based international order and what does the future hold for trade multilateralism?

Sir Simon Fraser will join us for a discussion on Europe’s future role between the US and China. Sir Simon is Managing Partner of Flint Global and Deputy Chairman of Chatham House. He previously served as Permanent Secretary at the Foreign and Commonwealth Office (FCO) and Head of the UK Diplomatic Service from 2010 to 2015. Prior to that he was Permanent Secretary at the UK Department for Business, Innovation and Skills. He has also served as Director General for Europe in the FCO and Chief of Staff to European Trade Commissioner Peter Mandelson.

We would like to take this opportunity to thank founding partner AIG and supporting partners Clifford Chance LLP, Diageo plc, and EY for their generous support of the Chatham House Global Trade Policy Forum.

Increasing agricultural productivity and adapting farming to climate change are central to Africa’s development prospects. There are important opportunities to enhance yields and increase resilience through the adoption of improved crop varieties. In some cases, biotechnology, and in particular genetic modification (GM), offers advantages over conventional plant-breeding approaches. Accordingly there are a various projects under way to develop new GM varieties for African farmers, ranging from drought-resistant maize to varieties of cassava, banana, sorghum, cowpea and sweet potato with resistance to pests and disease.

In addition to government funds, these projects have also attracted the support of influential donor agencies and philanthropic foundations. However, despite the expenditure of considerable resources, the potential of GM in Africa is not being realized. So far no GM trait developed for African farmers has been put to use.

Multiple barriers inhibit the development and adoption of pro-poor GM varieties in Africa. On the demand side, farmers may be reluctant to adopt GM varieties owing to a lack of export opportunities and distrust of the technology among local consumers. Farmers may also be concerned about exploitation by transnational seed companies (despite the fact that development of new GM technologies in Africa is dominated by the public sector). On the supply side, donor funding struggles to match the long timescales of research and development, while incentives among research scientists may be poorly aligned with farmer outcomes. Non-existent, poorly functioning or overly punitive regulatory regimes discourage investment.

The most important barriers – such as regulatory constraints, consumer distrust and weak farmer demand – must be understood in the context of wider social and political dynamics surrounding GM, typified by misinformation, polarized public discourse, and dysfunctional and opportunistic politics. The result is most GM projects becoming ‘stuck’ at the field trial stage without ever progressing to release. This ‘convenient deadlock’ of continual field trials allows governments to manage political risks by effectively balancing the demands of pro-GM and anti-GM lobbies – proponents of GM have a pipeline of technologies, while opponents are appeased by the failure of any to gain approval. The disabling socio-political environment for GM development in Africa greatly reduces the efficacy of investment in this technology.

This has two important implications. First, technology development needs to be located within a wider project of transformation that engages key actors – most notably politicians, policy-makers and farmers – as stakeholders from the outset, and includes strategies to address multiple demand- and supply-side barriers. Second, successful adoption is more likely in countries with less disabling political conditions, characterized by lower levels of consumer distrust and opposition, genuine farmer demand and demonstrable commitment from government. Focusing efforts and resources on a small number of ‘best bet’ countries will also allow donors and technology providers to support more ambitious, transformational projects led by national governments.

Summary

• There is a widespread sense that liberal democracy is in crisis, but little consensus exists on the specific nature and causes of the crisis. In particular, there are three prisms through which the crisis is usually seen: the rise of ‘populism’, ‘democratic deconsolidation’, and a ‘hollowing out’ of democracy. Each reflects normative assumptions about democracy.
• The exact role of digital technology in the crisis is disputed. Despite the widely held perception that social media is undermining democracy, the evidence for this is limited. Over the longer term, the further development of digital technology could undermine the fundamental preconditions for democracy – though the pace and breadth of technological change make predictions about its future impact difficult.
• Democracy functions in different ways in different European countries, with political systems on the continent ranging from ‘majoritarian democracies’ such as the UK to ‘consensual democracies’ such as Belgium and Switzerland. However, no type seems to be immune from the crisis. The political systems of EU member states also interact in diverse ways with the EU’s own structure, which is problematic for representative democracy as conventionally understood, but difficult to reform.
• Political parties, central to the model of representative democracy that emerged in the late 18th century, have long seemed to be in decline. Recently there have been some signs of a reversal of this trend, with the emergence of parties that have used digital technology in innovative ways to reconnect with citizens. Traditional parties can learn from these new ‘digital parties’.
• Recent years have also seen a proliferation of experiments in direct and deliberative democracy. There is a need for more experimentation in these alternative forms of democracy, and for further evaluation of how they can be integrated into the existing institutions and processes of representative democracy at the local, regional, national and EU levels.
• We should not think of democracy in a static way – that is, as a system that can be perfected once and for all and then simply maintained and defended against threats. Democracy has continually evolved and now needs to evolve further. The solution to the crisis will not be to attempt to limit democracy in response to pressure from ‘populism’ but to deepen it further as part of a ‘democratization of democracy’.