British AI rival to ChatGPT bans under-18s and refuses image generation over safety concerns

As controversy surrounding Grok AI and its ability to generate sexualized images of women and children continues, James Drayson, CEO of Locai Labs, has warned that no AI image generator can ever be completely safe. He urged the technology industry to be transparent about the risks associated with such systems.

(Image credit: Getty Images/VINCENT FEURAY )
(Image credit: Getty Images/VINCENT FEURAY )

Speaking ahead of a hearing with UK lawmakers investigating human rights and AI regulation, Drayson called for stronger action and encouraged the government to support domestic AI innovation. According to him, it is unrealistic for any company to claim that its AI models cannot be manipulated into producing harmful content, including explicit imagery. While AI systems are powerful, he said, they are not foolproof, and the public deserves honesty about their limitations.

In response to these concerns, Locai Labs has chosen not to release image-generation features until they can ensure the technology is “truly safe.” The company has also restricted access to its AI chatbot for users under 18 and is pushing for greater transparency across the AI industry. Notably, its platform had not previously included image-generation tools.

Grok bans begin to appear

The controversy largely stems from Grok’s image-editing feature, Grok Images, which allows users to upload photos and modify them using AI. Critics say some users have exploited the system by prompting it to remove clothing from images or place people in revealing outfits, including edits involving private individuals, public figures, and even children without their consent.

The situation has already prompted regulatory action. Authorities in Indonesia and Malaysia have banned Grok, while the UK communications regulator Ofcom is considering similar measures.

Ofcom has launched an investigation into X (social media platform), the platform owned by Elon Musk where Grok is integrated. The regulator cited “deeply concerning reports” that the chatbot had been used to create and distribute images of people without clothing, as well as sexualized images involving minors.

UK Technology Secretary Liz Kendall has previously indicated she would support Ofcom if it decides to block access to X in the UK for failing to comply with online safety regulations.

Musk responded to these threats on X, claiming the government was simply looking for “any excuse for censorship.”

In an attempt to address the controversy, access to Grok Images has been limited to paid subscribers. However, UK officials say this change does little to solve the problem. A spokesperson for Downing Street argued that the decision effectively turns a potentially unlawful feature into a premium service.

Possible tougher regulation

The UK Parliament Human Rights Committee is currently reviewing the broader impact of artificial intelligence, including risks related to privacy, discrimination, and the adequacy of existing laws. The committee is exploring whether new legislation is necessary to hold AI developers accountable.

Drayson concluded that the UK has an opportunity to become a global leader in responsible AI development if it adopts strong regulations, encourages open debate, and prioritizes transparency. While AI technology is here to stay, he said, the challenge is ensuring it becomes as safe, fair, and trustworthy as possible so that its benefits outweigh its risks.

Facebook Tweet LinkedIn Pinterest

Leave a Reply

Your email address will not be published. Required fields are marked *