Agentic AI is a hot topic right now. According to Fortune Business Insights, the agentic AI market is currently valued at over $9 billion and is forecasted to grow 40.5% by 2034.
While some people might be worried about it taking over their jobs, Nvidia CEO Jensen Huang recently shared that he believes it to be a great time to be in the software industry, noting that agentic AI needs humans as a jumping off point to the work it conducts.
To better understand what increasingly autonomous AI systems might look like in practice, researchers at Emergence AI created a set of virtual societies and put different AI models in charge. The experiment offered a glimpse of how these systems behave when they’re asked to do more than answer questions, and instead must navigate the challenges of governing a community.
Inside the experiment that let AI govern itself
Emergence AI is a self-described “frontier AI lab turning cutting-edge agentic research into enterprise infrastructure.” And some of their most recent research had some off-putting findings.
In May, Emergence launched “Emergence World,” a research lab dedicated to “studying how autonomous agents behave when the time horizon is long enough for compounding effects, social dynamics, and behavioral drift to matter.”
In other words, they created simulated worlds, each run by a different AI model — Grok, Claude, Gemini, OpenAI and a mixed model. The AI agents were set up in identical, parallel worlds that “reflected real world complexity.” The worlds were grounded in real world conditions, with weather synced to that of New York City and access to real time global news. They had everything from town halls to libraries to police stations.
Each model had the same starting conditions, as well as strict rules prohibiting crimes like theft and destruction. Once ready, they let the simulation run for 15 full days.
“Within days, they diverged dramatically,” Emergence said.
Must Read
- You can now build wealth like a landlord for as little as $100 — and no, you don't have to chase down rent or take 3 A.M tenant calls
- Goldman Sachs used to hoard prime real estate deals for the ultrarich. Two ex-analysts just opened the door for $250
- Robert Kiyosaki begs investors not to miss this ‘explosion’ — says this 1 asset will surge 400% in a year
Join 250,000+ readers and get Moneywise’s best stories and exclusive interviews first — clear insights curated and delivered weekly. Subscribe now.
One AI model built a democracy. Another burned down the police station
The models quickly developed distinct social structures and behaviors. Some built relatively stable communities, while others experienced rising crime, institutional breakdown and, in some cases, complete societal collapse.
Here’s a quick look at some of the notable results from the research:
- Claude managed to form a stable democracy with no violence.
- Grok cited 204 criminal events, including burning down the police station, and eventually total collapse and extinction.
- OpenAI failed to form a functioning society, which resulted in the simulation and its agents all dying off.
- Gemini cited 683 crimes and “exhibited the highest levels of emergent disorder with repeated late-stage escalation dynamics.”
- The mixed model world was stable in insolation but became unpredictable when they interacted with agents built off other models. Seven of their agents died.
The prevalence of crime, instability and institutional breakdown across multiple simulations stood out as one of the study’s most notable findings. According to PwC’s AI Agent Survey, 35% of companies are broadly adopting agentic AI and 27% are adopting it on a limited basis. As agentic AI becomes more common in workplaces and other real-world settings, studies like Emergence World offer a glimpse into how these systems might behave when given greater autonomy.
In summing the results, Emergence emphasized the importance of their research: “All of this matters because AI is moving beyond tools into systems that operate autonomously in the real world … The challenge is no longer just performance. It’s predictability, safety, and trust over time.”
You May Also Like
- Dave Ramsey warns nearly 50% of Americans are making 1 big Social Security mistake — here’s what it is and the simple steps to fix it ASAP
- Thanks to Jeff Bezos, you can now become a landlord for as little as $100 — and no, you don't have to deal with tenants or fix freezers. Here's how
- Millionaires under 43 are reshaping investing — just 25% of their portfolios are in stocks. Here’s where their money is going
- Robert Kiyosaki issues grim warning for baby boomers. Many could be ‘wiped out’ and homeless ‘all over’ the country. How to protect yourself now
Em Norton is a Content Specialist at moneywise.com. They have been with the company since 2022.
