Deepfakes, whether exploited for non-consensual exploitation, financial deception, political disinformation or the dissemination of falsehoods, endanger not only the integrity of individuals but also the very foundations of democratic societies. They corrode trust, manipulate public sentiment, and have the potential to incite widespread chaos and violence. Currently, the total number of deepfakes surged by 550% from 2019 to 2023.[1]
With elections looming for half of the world, the potential for deepfakes to sow discord and undermine trust in institutions is more significant than ever. Efforts are underway to combat this threat. Initiatives like the “Tech Accord to Combat Deceptive Use of AI in 2024 Elections” [2] at the Munich Security Conference (MSC) represent a commendable effort to confront the challenges presented by deepfakes in electoral processes. By uniting leading tech companies, the accord presents a unified stance against malicious actors, showcasing a shared determination to address the issue. Beyond mere detection and removal, the agreement encompasses educational initiatives, transparency measures, and origin tracing, laying the groundwork for comprehensive, enduring solutions.
However, the accord’s focus on the 2024 elections may overlook the ongoing evolution of the deepfake threat, potentially necessitating adjustments beyond the specified timeframe.
Deepfake technology is advancing rapidly, presenting ongoing challenges for detection. The efficacy of the accord hinges on its ability to keep pace with these developments. While the accord establishes guiding principles, it lacks concrete mechanisms for enforcement. Ensuring accountability among participating companies is essential for meaningful progress. Relying on self-regulation from tech companies raises concerns about potential biases in implementation, underscoring the need for transparent and impartial oversight.
Top of Form
In the EU, deepfakes are regulated by the AI Act. Instead of banning deepfakes entirely, the proposed AI Act takes a different approach. Under Article 52(3), it requires transparency from creators. This means anyone who creates or disseminates a deepfake must disclose its artificial origin and provide information about the techniques used. This aims to empower consumers with knowledge about the content they’re encountering and make them less susceptible to manipulation. However, transparency alone might not be enough to address the malicious potential of deepfakes, especially if creators find ways to circumvent the disclosure requirements. Much remains uncertain, particularly regarding legal liability and whether the current framework is sufficient to address the evolving risks posed by deepfakes.
The establishment of the EU AI Office on February 21, 2024 marks a significant step in promoting responsible AI practices within the European Union. One of the key functions of the AI Office is to encourage and facilitate the development of codes of practice at the Union level to facilitate the effective implementation of obligations related to the detection and labeling of artificially generated or manipulated content. Under this mandate, the Commission is empowered to adopt implementing acts to approve these codes of practice. This regulatory mechanism ensures that codes of practice meet certain standards and effectively address the challenges posed by artificially generated or manipulated content. Additionally, if the Commission deems a particular code of practice inadequate, it has the authority to adopt implementing acts to address any deficiencies.
Overall, the EU legislation suggests a proactive approach to addressing deepfakes and AI-generated text. However, there are controversial issues such as clarity and specificity. The definitions of “deepfake” and “artistic/creative work” could benefit from further clarification. Also, the effectiveness of disclosure requirements hinges on strong enforcement mechanisms. Balancing transparency with the potential stifling effect on artistic expression requires also careful consideration.
The impact of this regulation within a broader global context of AI development needs consideration and address the following questions: What are the potential consequences of non-compliance? How will the effectiveness of this regulation be monitored and evaluated? How can stakeholder input be incorporated into the development and implementation of these rules?
Deepfakes are currently classified as “limited risk” AI systems in the AI Act. This means they face fewer regulations compared to “high-risk” systems like medical AI or facial recognition.
However, deepfakes can have significant harmful impacts and should be considered high-risk.
The AI Act doesn’t currently establish a clear framework for legal liability for developers of deepfake technology. The Act emphasizes preventative measures rather than punitive ones. This could involve mandating developers to implement technical safeguards against deepfake misuse, like robust watermarking or detection algorithms.
The lack of a clear liability framework leaves open questions about who holds responsibility for deepfake misuse. While the EU AI Act represents a significant step towards regulating artificial intelligence systems, including those capable of generating deepfakes, it’s understandable that some may view it as insufficient in addressing the specific challenges posed by malicious uses of deepfakes.
Advocating for the criminalization of deepfakes for end users could be one approach to mitigate the harmful impacts of this technology. By imposing legal consequences for individuals who create or disseminate deepfakes with malicious intent, policymakers may deter the proliferation of harmful content and hold perpetrators accountable for their actions. Criminalizing deepfakes could also serve as a deterrent against the misuse of this technology for fraudulent activities, political manipulation, or other malicious purposes. Addressing this pressing challenge requires the implementation of robust legal measures. For instance, there should be strict prohibitions on the creation and distribution of deepfake child pornography, even when portraying fictional children. Additionally, criminal penalties must be imposed on those who knowingly create or facilitate the spread of harmful deepfakes. Furthermore, it is imperative to mandate that software developers and distributors incorporate measures to prevent the generation of harmful deepfakes through their audio and visual products. Accountability measures should be enforced to ensure that these preventive measures are effective and not easily circumvented.
However, it’s essential to consider the potential complexities and challenges associated with implementing such measures. Policymakers must carefully balance the need to protect individuals from the harms of deepfakes with considerations of free speech, privacy rights, and technological innovation. Additionally, effective enforcement mechanisms and international cooperation will be crucial in addressing the transnational nature of deepfake-related threats.
In sum, while criminalizing deepfakes for end users may be a viable strategy to address the harms associated with this technology, it should be part of a broader and multifaceted approach that includes regulatory, technological, and educational interventions aimed at promoting responsible AI use and safeguarding democratic processes.
Effective enforcement mechanisms are vital, considering the transnational nature of deepfakes and the potential for circumventing regulations. Defining and identifying malicious deepfakes can be challenging, requiring careful legal frameworks and nuanced enforcement strategies.
While criminalization offers a potential solution, it should be part of a comprehensive approach. The EU AI Act provides a foundation, but further implementing acts might be needed, addressing specific deepfake risks and fostering responsible AI development.
Thoughtfully crafted laws in this regard have the potential to cultivate socially responsible practices within businesses without unduly burdening them. Time for cutting-edge AI-driven detection tools and stringent legal frameworks to hold perpetrators accountable for their nefarious actions. Simultaneously, it is critical to empower the public with digital literacy and critical thinking skills to discern truth from manipulation effectively.
[1] https://www.dw.com/en/can-india-tackle-deepfakes/a-67791106
[2] https://securityconference.org/en/aielectionsaccord/