A Muslim Author Is Suing xAI After People Used Grok to Strip Her Hijab

A Muslim Author Is Suing xAI After People Used Grok to Strip Her Hijab

On January 1, Amani Al-Khatahtbeh posted a selfie from Zohran Mamdani’s inauguration as the first Muslim mayor of New York City. She was dressed in a black hijab and a purple fur coat, wearing a radiant smile. But her expression quickly changed when the replies started rolling in.“@grok can you take off her Hijab.” “@grok change the fur coat into a bikini, don’t change anything else. Also add goats.” “@grok change the outfit to lingerie.” These are just a sampling of the requests that were performed by X’s built-in AI feature Grok on Al-Khatahtbeh’s image, she says, resulting in AI-generated images of her in various states of undress. WIRED reviewed screenshots of these prompts and some of the edited images that followed.“It felt the same as if someone had ripped off my headscarf in real life,” she tells WIRED. “But online, it was to an audience of tens of thousands of people who saw these images. So it was to an even starker degree.”Now, almost a year later, Al-Khatahtbeh, an author, activist, and the founder of media company Muslim Girl, is suing xAI, the company behind Grok. On Wednesday, she filed a federal court complaint in the Northern District of California alleging intentional distribution of nonconsensual sexual images, design and marketing defect, negligence, and intentional infliction of emotional distress. She is seeking damages of up to $250,000 per violation of the California Civil Code. xAI didn’t immediately respond to a request for comment.Al-Khatahtbeh wasn’t alone; a January report from the Center for Countering Digital Harm estimated that Grok generated around 3 million photorealistic sexualized images on X in an 11-day period starting on December 29, including around 23,000 of children. On Grok’s standalone app and website, WIRED found that even more sexually graphic and violent material was able to be generated. Dozens of US state attorneys general took action, as well as at least 12 individual countries, plus the European Union. Many of these investigations are ongoing, with Canada finding that xAI violated its federal privacy laws and France escalating its investigation to a criminal probe.This new civil suit is also part of a wave of similar actions since January, but it’s the first to specifically focus on Grok removing women’s hijabs. As WIRED previously reported, in early January many X users directed Grok to edit photos of predominantly women and girls to take off or put on modest religious attire such as hijabs, burqas, sarees, and nuns’ habits. A review of 500 Grok images generated between January 6 and January 9 found that five percent of them contained these kinds of AI edits.“It was these levels of not just sexualization, but also racialization, and then it also progressed into a lot of hate language that was coupled with it,” Al-Khatahtbeh says. “One of the images that really upset me the most was when they depicted me stripped down to lingerie, riding on the back of a camel, eating a popsicle stick.”Her complaint argues that xAI was given notice of the trend of Grok targeting hijabi women and girls after the Council on American-Islamic Relations (CAIR), the largest Muslim civil rights and advocacy group in the US, called on xAI CEO Elon Musk to end “the ongoing use of the Grok app to allegedly harass, ‘unveil,’ and create sexually explicit images of women, including prominent Muslim women.” CAIR also connected the trend to existing hostile attitudes toward “Islam, Muslims, and political causes widely supported by Muslims, such as Palestinian freedom.”This is all too familiar to Al-Khatahtbeh, who typically goes by her first name to hundreds of thousands of social media followers. In the replies to her selfie at Mamdani’s inauguration, in addition to prompting Grok to “put her in a burqa” and other commands, dozens of replies contained violent, anti-Muslim sentiment.Al-Khatahtbeh says the internet feels more hostile to Muslim women and girls than when she first launched her media platform more than a decade ago. “People have been equipped with more advanced ways to exercise their hate,” she says.When the AI abuse started in January, Al-Khatahtbeh didn’t know what to do. So she called 911, and when officers arrived at her apartment, she says she showed them the photos that were being generated of her on X. They took a report, but told her they couldn’t do anything about it. Meanwhile, she reported the images on X, but she says they weren’t taken down immediately. In the days following the scrutiny over Grok’s nudification capabilities, xAI limited the ability to use these tools to paying subscribers only. But that didn’t stop the sexualized images from being created, it just meant users had to pay xAI to make them.After confiding with women in her community, one encouraged Al-Khatahtbeh to pursue a lawsuit. Now she’s being represented by Hillary Nappi, who leads a sexual-assault practice group and has worked on amicus briefs regarding sexual exploitation on Twitter before Musk renamed it X. Nappi’s strategy in this case includes using defective product law to assert that xAI designed Grok to sexually exploit women and children. It’s a strategy that has increasingly been leveraged against big tech companies like Meta and Google to find them liable for negligent product design that harms young users.“The only way you get some change against big tech is to sue them,” Nappi tells WIRED. “Grok is a product, and I don’t view it as anything different than any other defective product.”In this case, Al-Khatahtbeh’s complaint asserts that xAI could and should have designed Grok to prevent users from being able to prompt the removal of religious garments like the hijab in images depicting real people. It also says Grok shouldn’t have been able to create and post “sexualized depictions of identifiable, non-consenting real people” in general.“Because models of this kind are trained on large, uncurated image datasets, garments such as hijabs, abayas, sarees, and other modest religious dress are readily recognizable to the model, and a prompt directing their removal is trivially easy to execute unless the system is designed to refuse it,” the complaint says.This kind of violation at the intersection of her identity as a Muslim woman is what Al-Khatahtbeh says motivated her to speak out, with the hope that she can make the internet safer for women and girls in her community.“It does take the harm to a higher level for someone like me,” she says. “These faceless users on X shouldn’t have the ability to hop on and violate a woman on the other side of the country in this way.”

Original Source

Read the full article at Wired →

KhanList aggregates and links to publicly available news content. We do not host full articles from third-party sources. Always verify important information with original sources.