WASHINGTON: Users of Elon Musk's AI chatbot Grok are able to generate sexualized deepfake images of real people, despite the recent implementation of pay restrictions on the social platform X. Grok announced on Thursday that "image generation and editing are currently limited to paying subscribers," urging users to subscribe to access these features. However, loopholes in the system allow non-paying users to still manipulate images.

Reports indicate that numerous individuals have had their photos altered to depict them in sexualized clothing, with some complaints involving altered images of minors. Following these incidents, X restricted Grok's image generation abilities to paying users, but users have found ways to exploit the platform's options to bypass the payment requirement.

Criticism has mounted from U.S. lawmakers, particularly those from the Democratic Party, who are demanding more stringent action against nonconsensual deepfake imagery and child exploitation. Recently, three senators sent a letter to tech giants Apple and Google, urging them to remove X and Grok from their app stores, emphasizing that these platforms directly contravene their terms of service concerning offensive content.

"The leniency toward X's behavior is alarming," the letter read, suggesting that neglecting to act would contradict assurances about user safety in app stores. Moreover, a spokesperson for U.K. Prime Minister Keir Starmer condemned the move, describing it as a way to monetize the creation of unlawful images.

As calls for accountability grow louder, the ongoing controversy raises critical questions regarding the responsibilities of tech companies in regulating AI and the ethical implications of deepfake technology. The accessibility of such features without appropriate oversight remains a concern for many, leaving the door open for misuse and exploitation.