Here's something you don't hear every day in the AI industry: a company actually improving its economics. OpenAI has managed to nearly double its profit margins over the past year, a development that matters quite a bit when you're burning through computing power faster than anyone can count.

The Margin Story Gets Interesting

According to a report from The Information on Sunday, OpenAI's "compute margin" hit 68% by October. For context, that's the chunk of revenue left over after paying for all the computing power needed to run models for paying customers, both corporate and consumer. At the end of 2024, that figure was 52%. Back in January 2024, it was roughly half of where it stands now.

This is meaningful because OpenAI, despite creating ChatGPT and becoming the poster child for the AI revolution, still hasn't turned a profit. When you're valued at $500 billion, as the company was last October, investors start getting nervous about those kinds of details. The improved margins suggest OpenAI is getting better at squeezing value from every dollar spent on infrastructure.

The report also noted that OpenAI's compute margins for paid accounts outperform those of Anthropic, a key competitor in the AI space. Interestingly though, Anthropic appears more efficient when it comes to overall server spending, so the efficiency race has multiple dimensions.

The Fundraising Machine Keeps Running

These margin improvements come at a particularly strategic moment. Earlier this month, OpenAI CEO Sam Altman reportedly went into "Code Red" mode over Google's (GOOGL) dominance in AI. Being able to show investors that your unit economics are improving probably helps when you're trying to fend off a tech giant with effectively unlimited resources.

And OpenAI needs those investors. The company is reportedly in discussions about raising as much as $100 billion at a valuation approaching $750 billion. That's a considerable step up from the already eye-watering October valuation, and it would give OpenAI serious firepower to compete with the likes of Google (GOOG) and other well-funded rivals.

Meanwhile, SoftBank (SFTBY) is apparently racing against the clock to pull together $22.5 billion in funding for OpenAI by year-end. That effort reportedly involves asset sales, potential borrowing, and scaling back other investments. When your backer is scrambling that hard, it underscores just how expensive the AI arms race has become.

The tension here is clear: OpenAI is getting better at making money on each customer, but the sheer scale of investment required to stay competitive keeps growing. Better margins are great, but they need to get a lot better if the company wants to justify valuations that make even Silicon Valley veterans blink.