• Social media platforms to present plans to curb deepfakes within 10 days.
• New regulations may impose penalties on deepfake creators and platforms.
• Platforms to focus on detection, misinformation prevention, reporting, and awareness.

Communications and IT minister Ashwini Vaishnaw has directed all social media platforms to submit their action plans within the next 10 days to address the growing issue of deepfakes and other misuse of AI-generated technologies. The minister emphasized that the government will incorporate the platforms' inputs into the formulation of new regulations that may include penalties for both creators and platforms hosting deepfakes.

Four Pillars of Action Plans

The platforms have been asked to present their action plans around four key areas:

Deepfake Detection and Misinformation Identification: Developing effective mechanisms to identify and flag deepfake content and misinformation.

Preventing Misinformation Spread: Implementing measures to curb the dissemination of deepfakes and misinformation across their platforms.

Strengthening Reporting Mechanisms: Streamlining and enhancing the process for users to report deepfake and misinformation-related incidents.

Increasing Public Awareness: Educating users about deepfakes, their potential harm, and how to distinguish them from genuine content.

Regulatory Framework and Penalties

Vaishnaw indicated that the new regulations will impose penalties on individuals who create or upload deepfakes. Additionally, the regulations are likely to establish guidelines for users to differentiate between deepfakes and authentic content.

Addressing Deepfakes in Advertising and Apps

The meeting also addressed the use of deepfakes in advertising. Discussions revolved around potential restrictions on apps that generate deepfakes and the implementation of controls for such apps.

Deepfake Technology and Its Impact

Deepfake technology utilizes AI to manipulate audio and video recordings, creating realistic yet misleading content. This technology gained prominence when actor Rashmika Mandanna's face was superimposed onto an embarrassing video earlier this month. Other celebrities like Katrina Kaif and Kajol have also been targeted by deepfakes.

Prime Minister Modi's Warning

Last week, Prime Minister Narendra Modi highlighted the potential threats posed by deepfakes.

Safe Harbor Immunity vs. Deepfake Measures

On Saturday, Vaishnaw warned social media platforms that their safe harbor immunity under the Information Technology Act could be revoked if they fail to take adequate measures against deepfakes. This immunity protects platforms from liability for user-generated content.

Upcoming Meeting

Minister of State for Electronics and IT, Rajeev Chandrasekhar, will hold another round of discussions with social media platforms on Friday.