As the Google Chrome team worked on developing IA-based navigation functions using the company's Gemini models, they realized they had to go further to prevent everything from getting out of control. So they did the only thing they thought of: they created a wide alternative universe of the Internet that they control completely.
"Web-use" agents must be familiar with the Internet, know how to navigate real websites and platforms, and protect themselves against cyber attacks. Therefore, training them in limited test environments has a reduced effectiveness. In addition, models can develop what is known as "evaluation consciousness," where they behave differently when determining that they are in a test or simulation. On the other hand, unrefined agents on the Internet are a bad idea. That's where the Internet comes into play in alternative universes.
The "Mirror Dimension," which Google first details in a blog post, is a wide and diverse but isolated web ecosystem that the Chrome team controls completely. It includes a wide range of websites and platforms, including social networks, online shops and bank control panels, which are built with all the components and attributes of the real websites. Agents should interact with sites and perform tasks in Chrome as they would on the real internet. They also face resistance tests on the way, such as hidden command injection attacks, to test their defenses.
"Agents are not programmed, so you can't predict what you will find; the exploration space we need to address is huge, and the web is hostile," says Charles Qian, software engineer of the Chrome's IA security team. "Any user can enter any command on any website, so we really need to explore that space as thoroughly as we can. And we have observed that the agent begins to develop a mature sense of judgment when it comes to knowing what information is needed for a task and when it must be used by the user to obtain a confirmation.".
Creating and Population the Mirror Dimension was a challenge in itself
It should be wide and varied enough to represent the scale of the real web, while developing rapidly. To build it, the Chrome team brought together a large number of web site development agents and web applications, guided by an IA system specifically designed to create web services and realistic data flows, even in details such as introducing promotional codes on a shopping page or completing social media pages.
Although the whole environment is controlled by Google, Chrome is designed with so many user protections and validity checks that, to allow agents to use real Chrome (something crucial for precise training), researchers had to hack the browser and take elaborate measures, such as creating forged web certificates for validity checks, so that agents could have a normal experience. However, the team stresses that none of these attacks would be possible against regular Chrome users on the open network. All of these were made possible by the access and privileges of "god mode" type that the team has in an inherent way, as it controls the entire environment and the network.
Researchers say that, although the navigational agents they have been testing are harmless and lack cybercapabilities, their aim is to make the Mirror Dimension available to teams throughout Google so that more researchers have access to a safe and controlled environment for testing.
"We share this approach so that other teams, both internal and external, can consider doing so in this way. This is the first step; there will be a continuous investment in this approach to training models. And I imagine that as they become more sophisticated, we will have to continue to work in this environment to make it more and more realistic," concludes Doug Turner, Google's engineering director.
Article originally published in WIRD.com. Adapted by Alondra Flores.




