{"id":85902,"date":"2015-04-26T15:00:59","date_gmt":"2015-04-26T13:00:59","guid":{"rendered":"http:\/\/businesstech.co.za\/news\/?p=85902"},"modified":"2015-04-26T08:46:55","modified_gmt":"2015-04-26T06:46:55","slug":"killer-robots-in-the-cross-hairs-of-international-law","status":"publish","type":"post","link":"https:\/\/businesstech.co.za\/news\/hardware\/85902\/killer-robots-in-the-cross-hairs-of-international-law\/","title":{"rendered":"Killer robots in the cross hairs of international law"},"content":{"rendered":"

The future of lethal autonomous weapon systems (LAWS) \u2013 often referred to in the popular press as \u201ckiller robots<\/a>\u201d \u2013 remains uncertain following a week-long meeting in Geneva<\/a> to discuss their legality<\/a>.<\/p>\n

While the LAWS debate in Geneva was deeper and richer than previous discussions, key definitions \u2013 which are needed to word a protocol<\/a> to restrict them \u2013 remain unclear and up for continued debate.<\/p>\n

And with nations like the United Kingdom openly opposed to a ban<\/a>, a protocol may end up being blocked entirely, much to the chagrin of activists<\/a>.<\/p>\n

The British say existing international humanitarian law (IHL) is sufficient to regulate LAWS. While there was universal agreement among delegations that key IHL principles such as distinction<\/a>, proportionality<\/a> and precautions<\/a> in attack apply to LAWS, there were sharp differences of opinion as to whether machines can be programmed to observe such distinctions.<\/p>\n

The UK has taken the view that programming might in future represent an acceptable form of meaningful human control, and research into such possibilities should not be pre-emptively banned. In future, they might even reduce civilian casualties. The Czechs<\/a> (a NATO ally) also expressed caution about a ban.<\/p>\n

However, other nations repeated their calls for a ban, including Cuba<\/a> and Ecuador<\/a>.<\/p>\n

Down with the robots<\/h3>\n

Still, for the Campaign to Stop Killer Robots<\/a>, British opposition is surely a major concern. The UK has a veto on the UN Security Council. British allies such as Australia and the US might decline to support a ban. Battle lines have been drawn. Definitions will be critical.<\/p>\n

Clearly the British will defend their national interest in drone technology. BAE\u2019s Taranis<\/a> \u2013 the long range stealth drone under development by UK multinational defence contractor BAE Systems \u2013 is a likely candidate for some sort of \u201cstate of the art\u201d lethal autonomy.<\/p>\n

Interestingly, BAE Systems is also on the consortium that is developing the F-35 Lightning II<\/a>, widely said to be the last manned fighter the US will develop.<\/p>\n

Sooner or later there will be a trial dogfight between the F-35 and Taranis. It will be the Air Force equivalent of Kasparov vs Deep Blue<\/a>. In the long run, most analysts think air war will go the way of chess and become \u201cunsurvivable\u201d for human pilots.<\/p>\n

\"The<\/a>

The UK\u2019s position to stifle a ban on LAWS was a setback for the Campaign to Stop Killer Robots. Global Panorama\/Flickr, CC BY-SA<\/p><\/div>\n

Definitional issues<\/h3>\n

At the Geneva meeting, many nations and experts supported the idea of \u201cmeaningful human control\u201d of LAWS, including Denmark<\/a> and Maya Brehm<\/a>, from the Geneva Academy of International Humanitarian Law and Human Rights. Although others, such as France<\/a> and former British Former Air Commodore, W. H. Boothby<\/a>, thought it too vague.<\/p>\n

The Israelis<\/a> noted that \u201ceven those who did choose to use the phrase \u2018meaningful human control\u2019, had different understandings of its meaning”. Some say this means \u201chuman control or oversight of each targeting action in real-time\u201d. Others argue \u201cthe preset by a human of certain limitations on the way a lethal autonomous system would operate, may also amount to meaningful human control\u201d.<\/p>\n

It is perhaps a little disappointing that, after two meetings, basic definitions that would be needed to draft a Protocol VI of the Convention on Certain Conventional Weapons (CCW<\/a>) to regulate or ban LAWS remain nebulous.<\/p>\n

However, UN Special Rapporteur on extrajudicial, summary or arbitrary executions, Christoph Heyns<\/a>, has been impressed by the speed and also the \u201ccreativity and vigour\u201d that various bodies have brought to the discussions.<\/p>\n

Most nations accept that \u201cfully autonomous weapons\u201d that could operate without \u201cmeaningful human control\u201d are undesirable, though there is no agreement on the meaning of \u201cautonomous\u201d either.<\/p>\n

Some states, such as Palestine<\/a> and Pakistan<\/a>, are happy to put drones in this category and move to ban their production, sale and use now. Others, such as Denmark<\/a> and the Czech Republic<\/a>, maintain that no LAWS yet exist.<\/p>\n

This is another definitional problem. Paul Scharre\u2019s presentation<\/a> was a good summary of how we might break up autonomy into definable elements.<\/p>\n

Future of war<\/h3>\n

Aside from the definitional debates there were interesting updates from experts in the field of artificial intelligence (AI) and robotics.<\/p>\n

Face and gait recognition by AI, according to Stuart Russell<\/a>, is now at \u201csuperhuman\u201d levels. While he stressed this did not imply that robots could distinguish between combatant and civilian as yet, it is a step closer. Russell takes the view that \u201ccan robots comply with IHL?\u201d is the wrong question. It is more relevant to ask what the consequence of a robotic arms race would be.<\/p>\n

Patrick Lin<\/a> made interesting observations on the ethical notion of human dignity in the context of LAWS. Even if LAWS could act in accordance with IHL, taking of human life by machines violates a right to dignity that may even be more fundamental to the right to life.<\/p>\n

Jason Miller<\/a> spoke on moral psychology and interface design. Morally irrelevant situational factors can seriously compromise human moral performance and judgement.<\/p>\n

Michael Horowitz<\/a> presented polling data showing that people in India and the United States were not necessarily firmly opposed to LAWS. Horowitz\u2019s key finding was that context matters. What the LAWS is doing when cast in the pollster\u2019s story is significant. How you frame the question makes a significant difference to the approval numbers your poll generates.<\/p>\n

Overally, the meeting was a step forward in the debate around the status and legality of lethal autonomous weapons. Although that debate \u2013 and it implications on the future of warfare \u2013 is still far from settled.<\/p>\n

By Sean Welsh<\/strong>,\u00a0Doctoral Candidate in Robot Ethics at University of Canterbury<\/span><\/em><\/p>\n