By Gavin Boyle
X, formerly known as Twitter, has paywalled its AI chatbot Grok’s ability to edit uploaded images after a flurry of people started using the tool to create sexual deepfakes from completely innocent photos.
“Image generation and editing are currently limited to paying subscribers. Subscribe to unlock these features,” X currently tells non-paying users who attempt to use Grok to generate or edit images, per Variety.
The decision to limit this feature to paying subscribers came after the UK government urged internet oversight board Ofcom to ban the website for not taking action against users who were using Grok to create deepfake photos.
“This is disgraceful. It’s disgusting. And it’s not to be tolerated… Ofcom has our full support to take action in relation to this,” UK Prime Minister Sir Keir Starmer said when discussing X’s inaction against AI deepfakes.
Related: Bill Criminalizing Deepfake Pornography Heads to President’s Desk
“It’s unlawful. We’re not going to tolerate it,” he added. “I’ve asked for all options to be on the table.”
Along with placing the tool behind a paywall — which requires users to share their identity to access — X has also stated that those using the tool inappropriately will receive a punishment.
“We take action against illegal content on X, including Child Sexual Abuse Material (CSAM), by removing it, permanently suspending accounts, and working with local governments and law enforcement as necessary,” X told Variety. “Anyone using or prompting Grok to make illegal content will suffer the same consequences as if they upload illegal content.”
As AI tools become more powerful, one looming concern is that bad actors will use them for evil. AI deepfakes are one of the most common worries, especially as image generation has gotten to a place where it is very hard to tell AI images from real life.
Shortly after President Trump was sworn in for his second term, First Lady Melania Trump worked to push the TAKE IT DOWN act through Congress which rewrote the rules about sharing deepfake pornography on the internet, making the consequences for doing such much more substantial.
“Today’s bipartisan passage of the TAKE IT DOWN Act is a powerful statement that we stand united in protecting the dignity, privacy, and safety of our children. I am thankful to the Members of Congress — both in the House and Senate — who voted to protect the well-being of our youth,” Melania said after the bill was passed.
While similar laws exist in the UK and across the rest of Europe, it is discouraging that so many users get away with this act and that companies take action only after government pressure. While paywalling image generation has made X and Grok safer, the platform should have taken action much sooner to combat these mass AI deepfakes.
Read Next: How One Teen Victim of AI Porn Fights Explicit Deepfakes
Questions or comments? Please write to us here.
– Content: +1