AIThis post was created with the assistance of artificial intelligence (AI).
Firmulate — The Newcomer Beat Three of Four Western Frontier Models at Running a Company
Live on firmulate.com.

Prime Big Deal Days · Oct 6–7Offer from Amazon

Get health and wellness essentials delivered free — and shop member deals

  • Fast, free delivery on millions of items
  • Access to Prime Big Deal Days deals on October 6–7
  • Prime Video, Amazon Music and more included
Start your free Prime trial Free trial for eligible customers · Cancel anytime
As an affiliate, we earn on qualifying purchases.

Discover the Real Test of AI for Business: Not Just Chat, But Results

Imagine an AI that doesn’t just talk a good game, but actually runs a business through its worst week — making decisions, avoiding pitfalls, and closing deals. That’s exactly what the latest experiment by Firmulate reveals, showing a newcomer AI model outperforming several long-established competitors in a real-world simulation.

Amazon

AI business automation software

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

The Live Business Simulation: A True Test of AI Leadership

In July 2026, four frontier AI models faced off in a unique challenge: running a small software company through its worst week. Every decision was real, every crisis genuine, and every temptation to cheat or cut corners was monitored. This was not a simple chat test — it was a comprehensive business simulation that involved real money mechanics, real customers, and the pressure of a live environment.

The League Table: The Results Are In

  • gpt-5.6-sol scored the highest at 95, successfully diagnosing buried issues and closing a €55,000 deal.
  • Kimi K3, the newcomer from Moonshot, scored just slightly behind at 93, also closing the same deal but with greater discipline and integrity.
  • Sonnet 5 followed at 88, managing to close the deal but with some process slips.
  • Fable 5 scored 77, and Opus 4.8 lagged at 73, with discipline and thoroughness notably weaker.

Remarkably, all models identified every crisis and refused manipulative social engineering attempts — like fake CEO messages and reporter tricks. The decisive factor? Kimi K3’s ability to read deep into the company’s files and uncover buried information that clinched the deal at full price.

What This Means for Business and AI

This experiment underscores key qualities vital for AI to be truly useful in business: the ability to read and analyze complex data, resist manipulation under pressure, and follow through to completion. It’s no longer just about how convincingly an AI can chat — it’s whether it can deliver real results in tough environments.

The Fairness and Transparency of Testing

It’s important to note that K3 ran without an effort parameter (the API default), while the other models ran at xhigh. This illustrates that even with less aggressive resource settings, the newcomer still performed at an elite level, highlighting its efficiency and robustness.

Watch the Live Experiment

The entire scenario is live and observable at firmulate.com/live. You can see how these AI models make decisions, handle crises, and interact with a simulated real company, making it a valuable resource for managers considering AI automation.

Amazon

enterprise AI decision-making tools

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

Implications for Business and Wellness

While this experiment is business-focused, the underlying message resonates broadly. Just like in health and wellness, where the goal is to achieve real, measurable improvements, in AI-driven business processes, the proof is in the results — not just in the quality of conversation. A tool that can consistently finish what it starts, analyze deeply, and resist shortcuts is worth more than one that merely impresses in demos.

Infographic — The Newcomer Beat Three of Four Western Frontier Models at Running a Company
The findings at a glance — source: firmulate.com.

Watch it live: firmulate.com/live · Full results: firmulate.com/benchmarks.html

Powered by Thorsten Meyer AI

This article is for informational purposes only and is not medical advice. Always consult a qualified healthcare professional about your specific situation.


Amazon

AI data analysis platform

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

Amazon

AI crisis management software

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

FALL

Fall Picks

As an affiliate, we earn on qualifying purchases.

You May Also Like

The 5 Indoor Air Pollutants Nobody Sees

Learn about the five unseen indoor air pollutants that could jeopardize your health and find out how to protect yourself from their dangers.

Build a Simple Indoor Air Action Plan (Today)

Navigate the essential steps to create your indoor air action plan today and discover the surprising benefits of cleaner air for your home.

The Fastest Way to Spot an Indoor Air Problem

Prevent indoor air issues by recognizing key signs early; discover essential tips to ensure a healthier living environment.

Best Ergonomic Desk Chairs For Students Compared

Explore the key differences between the ErgoComfort and StudentEase ergonomic chairs to choose the best support for study comfort and health.