Unveiling the Ethical Paradox: Human Oversight in the Age of Autonomous Weapons

“An algorithm must not be in full control of decisions which involve killing or harming humans.”

With these resolute words spoken by the Egyptian Representative at the United Nations General Assembly (UNGA) on 1st November 2023, the first-ever resolution was put forward on autonomous weapons, underscoring the pressing need for the international community to confront the challenges and ethical concerns posed by them.

The product of a decade-long international discourse and collaboration, this resolution, while not yet calling for negotiations, still marks a substantial step forward. Tabled by Austria and supported by a group of 43 co-sponsoring states, it explicitly recognises the possible negative consequences of autonomous weapon systems, including the risk of triggering an arms race, lowering the threshold for conflict, and facilitating proliferation to non-state actors. It also underscores the imperative of ensuring on-going, meaningful human control over the use of force in conflict situations where the potential for human casualties exists.

In an age where technology has blurred the lines between human decision-making and machine algorithms, preserving human judgment and empathy in matters of life and death is paramount. The continuous advancement of technology, notably in the domain of autonomous weapons, has disrupted established ethical norms and human control over warfare. With these highly advanced machines becoming increasingly integral to military tactics, it is vital to acknowledge the pressing requirement for significant human supervision and intervention.

The essence of the recent UNGA resolution lies in its acknowledgement of the fundamental principle of continued human control over autonomous systems. It recognises the inherent dangers of fully autonomous systems and relinquishing decisions to algorithms devoid of empathy, compassion, and moral judgment. The stark reality is that autonomous weapons, devoid of human intervention, can lead to unforeseen consequences, magnifying the risks of conflicts spiralling out of control.

Beyond the cinematic allure of sleek robots and intelligent machines, the true face of autonomous weapons is a disconcerting one. These systems lack the intricate tapestry of human experiences that shape our understanding of ethical conduct in times of war. Autonomous weapons, by their very nature, operate in a morally grey zone, devoid of the ethical compass that guides human soldiers in the heat of battle. The erosion of these ethical norms not only undermines the principles of humanity but also erodes the trust that nations place in each other during times of conflict.

Another alarming risk associated with autonomous weapons is the potential for unintended escalation. In the absence of human judgment, these autonomous systems can misinterpret situations and respond maliciously to ambiguous signals. The lack of human intervention and the speed at which autonomous weapons operate increases the likelihood of unintended escalation.

Autonomy in weaponry also introduces new security vulnerabilities as these sophisticated machines, reliant on intricate algorithms and interconnected networks, are more susceptible to hacking and exploitation. Malicious actors, ranging from hostile states to non-state groups, could potentially gain control over these weapons, turning them against their creators or using them for other nefarious purposes. This not only endangers national security but also undermines the very technology which nations are investing in for their defence, creating a paradoxical situation where advancements in technology become a liability.

Moreover, there is also the risk of exacerbating existing power imbalances on the global stage. Nations with advanced technological capabilities could wield these weapon systems as tools of dominance, further marginalising those with limited access. This power disparity not only perpetuates existing inequalities but also destabilises international relations, creating an environment ripe for conflicts based on asymmetrical power dynamics.

 

Crafting and eventually adopting effective regulations for autonomous weapons, thus becomes a paramount necessity to address all these and other inter-related challenges. While innovation will continue to propel the world into the future, it is essential to ensure that the very essence of humanity is not sacrificed at the altar of progress. Striking this balance requires international collaboration, transparency, and a shared commitment to upholding human dignity in the face of evolving warfare.

The UNGA resolution serves as a pivotal starting point as well as a call to action that transcends borders. It may compel states to confront the ethical quandaries posed by autonomous weapons, urging them to safeguard the values that define civilisation. As the world moves forward, it is incumbent upon all states to ensure that decisions involving human lives must always have human oversight. Only by doing so can we navigate the challenges of this new era and build a future where humanity and technology can coexist harmoniously.

The adoption of this resolution signifies not just a milestone in international diplomacy but also a beacon of hope for a world where innovation can co-exist harmoniously with ethics and empathy. It is the collective responsibility of the international community to ensure that this path leads to a future where humanity’s values remain at the heart of technological progress. Preserving human judgment and empathy is not just a moral obligation; it is a fundamental requirement to ensure the responsible use of these powerful tools.

Space-Based Surveillance: Insights from Contemporary Conflicts

The significance of space-based Intelligence, Surveillance, and Reconnaissance (ISR) systems has become increasingly prominent in modern warfare. Advanced space-based ISR capabilities, once the preserve of superpowers, are now accessible to an increasing number of states, altering the power dynamics in international conflicts. For instance, the war in Ukraine and the conflict in Gaza can be considered case studies for analyzing contemporary utilization of space-based ISR, underscoring the strategic value of space-based ISR and drawing attention to its complexities and challenges. The contrasting application of space assets in both conflicts offers a unique lens through which to view the evolving dynamics of techno-politics, particularly in the context of the burgeoning commercialization of the space sector.

Space-based ISR has played a crucial role in the Russo-Ukraine war, particularly in Ukraine’s defensive and counter-offensive strategies. Ukraine’s effective utilization of commercial satellites has proven to be a game-changer. Lacking an indigenous satellite programme, Ukraine has effectively leveraged commercial platforms to enhance its situational awareness by exposing Russian troop movements and fortifications while guiding Western-supplied long-range missiles to crucial Russian targets. Reportedly, over 200 commercial satellites have enabled Ukraine to offset Russia’s conventionally superior military and undermine its formidable space prowess by levelling the playing field with access to real-time battlefield ISR.

The accelerating commercialization of the space sector has facilitated the democratization of space technologies by lowering the barriers to entry, allowing non-spacefaring nations like Ukraine to exploit space-based assets for strategic and tactical gains without incurring the substantial financial burden of establishing a space programme. However, integrating commercial space assets against an established space power like Russia has introduced complexities. Russia has repeatedly levelled threats of targeting commercial satellites aiding Ukraine. However, any potential kinetic targeting of these private satellites operated by non-Ukrainian firms, mainly those in the US and Europe, carries grave geopolitical ramifications by increasing escalation and widening the conflict.

In contrast, the Israel-Hamas conflict has offered a different perspective on the utility and limitations of space-based ISR against an elusive non-state actor like Hamas. Despite Israel’s commendable satellite capabilities, evidenced by the launch of its most advanced spy satellite on 29th March 2023, Hamas’ coordinated attacks against Israel months later, on 7th October 2023, successfully circumvented Israeli space surveillance. The sheer scale of these attacks exposed Israeli over-reliance on technology in monitoring Gaza; space assets mainly offer unparalleled situational awareness, but they are not infallible in all circumstances against all kinds of adversaries. Their drawbacks are especially apparent in conflicts against non-state actors who employ guerrilla tactics and operate in densely populated urban environments to evade satellite and digital surveillance. Therefore, in asymmetrical warfare, space superiority does not guarantee tactical invulnerability.

Considering these conflicts as case studies, one notes both commonalities and divergences in the practical employment of space assets. Both cases underline the significance of space-based ISR; however, the nature of the adversaries—state vs non-state actors—and the types of warfare—conventional vs asymmetric—have led to differing applications and varying effectiveness. While Ukraine has used commercial satellites to counter a technologically superior adversary, Israel’s challenges have been countering non-state actors, who employ far less sophisticated technology and more elusive tactics. The contrast highlights space-based surveillance’s versatile but not omnipotent nature in modern warfare. This fact underscores the necessity for a hybrid approach towards acquiring actionable intelligence, augmenting space intelligence with on-ground human intelligence and real-time data analytics to address the challenges faced by space-based ISR.

Furthermore, a nuanced analysis of the role played by space assets in contemporary conflicts highlights two critical aspects: the broader disruptive impact of the interplay of technology and geopolitics as the commercialization of space continues with the proliferation of small and redundant mega-constellations such as that of Starlink. However, the increasing accessibility of space-based ISR capabilities will likely lead to widespread reliance on space assets in worldwide conflicts, necessitating new military strategies, and requiring international oversight for monitoring their proliferation and addressing the resulting geopolitical ramifications.

Commercial satellite imagery is another essential facet of modern conflicts. The provision of unrestricted imagery in Ukraine has been pivotal in rallying global support against Russian aggression by exposing Russian atrocities and resulting devastation. In contrast, the US had restricted the sale of advanced commercial imagery in Israel that would shed light on Israel’s destruction in Gaza, further negatively impacting global perceptions. The differing US policies towards allowing and restricting satellite imagery in Ukraine and Israel highlight the intersection of technology and varying geopolitical interests in modern warfare.

In light of these conflicts, it is clear that space-based surveillance and reconnaissance are not just tools of warfare but pivotal elements in the broader strategic and geopolitical calculus of nations. However, the commercialization of space-based ISR and the increasing access to high-resolution satellite imagery represents a double-edged sword, accompanying opportunities and challenges depending on whether they advance or undermine a state’s interests. As the world navigates the collective challenges confronted in space, the final frontier, a collaborative and regulated approach to space operations, will ensure global stability by responsibly harnessing the potential of space-based assets.