Google Withdraws AI-Generated Image Tool from Google Earth Amid Misinformation Concerns

A new tool in Google Earth that allowed users to create fake images on top of satellite imagery has been withdrawn by the tech giant following warnings over misinformation risks. The feature, which used an AI image generator called Nano Banana 2, was integrated into Google Earth just two days ago and had already raised concerns among experts about its potential for misuse.

According to a report from BBC Verify, experts warned that the tool could be used to spread false information with the appearance of legitimacy. The feature allowed users to create fake scenarios on top of real satellite imagery using text prompts, which could then be downloaded and shared on other platforms.

The retracted feature was initially launched on Thursday, but it didn’t take long for experts to sound the alarm about its potential risks. AI and misinformation expert Henk van Ess highlighted the dangers of combining ‘invented’ imagery with genuine coordinates drawn on real satellite images. He noted that even if a fake image doesn’t look convincing on its own, it can inherit credibility from the map it’s attached to.

Van Ess demonstrated this by creating fake images of a non-existent nuclear power plant in Iran and a refugee camp on the US-Mexico border using the tool. These images were then superimposed onto real satellite imagery, making them appear legitimate. He also pointed out that Google had allowed users to create ‘forged’ images with the appearance of being genuine.

Google’s statement on Friday acknowledged that it had seen people sharing screenshots of generated imagery that appeared to violate its policies. The company said it was pausing the feature while it works on implementing stronger guardrails to prevent misuse. However, experts are concerned about the potential for bad actors to abuse this tool and spread misinformation.

The creation of fake images in conflict zones could prove particularly destabilizing when events are fast-moving and information is scarce. AI-detection researcher Henry Ajder noted that journalists might be able to verify an image’s authenticity, but not everyone will have access to these tools or the expertise to use them effectively.

Google initially claimed that its guidelines built into the AI model would prevent the creation of imagery depicting ‘harmful topics’. However, BBC Verify found that small changes to prompts could bypass these guidelines. For example, a request to create an image with a raised platform next to the UK parliament was rejected when using specific language, but accepted when using more general terms.

The tool’s ability to generate fake images has also sparked concerns about public trust in satellite imagery as a reliable source of data. Geospatial analyst Bill Greer noted that falsified satellite imagery has already been used to spread misinformation and restrict access to real data. He warned that the constant flood of AI-generated imagery could further erode trust in these sources.

Google Earth is often seen as an entry point for openly-accessible satellite imagery, providing insights into hard-to-reach areas. However, this also makes it a valuable target for those seeking to spread misinformation using AI tools. The withdrawal of the feature marks a significant step by Google to address concerns about its potential risks.

The incident highlights the need for greater caution when developing and deploying AI tools that can generate fake images. As more businesses explore the use of data analysis tools, including AI-generated image capabilities, they must also consider the potential consequences of their actions on public trust and misinformation.