Sirf Such

Truth that Matters. Stories that Impact

Sirf Such

Truth that Matters. Stories that Impact

Technology

Anthropic rival says companies can (mostly) skip the pricey models

On the same day that Anthropic went public in the largest IPO on record, with investor enthusiasm for the AI lab through the roof, far away at the Slush startup conference in Helsinki, the topic du jour was open-source everything.

That’s the enormous opportunity being chased by companies like Fireworks AI, as enterprises seek ways to avoid paying frontier prices for their AI needs.

Fireworks runs AI models for other businesses. It specializes in open-weight models, which anyone can download, and helps customers tune them on their own data so they run faster and cheaper than the models of Anthropic, OpenAI and other heavyweights and are harder for rivals to copy. Customers have included Uber, Shopify and Notion. Co-founder Chenyu Zhao and I spoke on stage toward the end of the day.

Zhao and many others believe companies are gravitating toward platforms like his because frontier models are pricey and, in most cases, he says, unnecessary unless you need the very latest and greatest generalized intelligence. There are also growing concerns that frontier labs absorb too much of their customers’ know-how, even if only through the prompts used to get answers, a worry Microsoft CEO Satya Nadella raised in July.

Fireworks has also gotten its first black eye, having disclosed two security incidents this fall. In one, hackers reached API keys and tokens stored as secrets for a limited number of accounts; in the other, attackers breached its cloud provider, made their way into a development system, and nabbed customer data, including billing records and some datasets.

Notion says AI chat transcripts from fewer than 1% of its workspaces were exposed, but it has disconnected from Fireworks. Uber says hackers stole the names, addresses, birth dates and driver’s license numbers of about 150,000 drivers through a vendor that TechCrunch identified as Fireworks. Fireworks will have to win back the confidence of customers like them.

Fireworks, assigned a $17.5 billion valuation by its investors in summer, is reportedly in “early talks” for yet another round, though Zhao declined to comment.

There’s money chasing everyone in the category, seems like. Rival companies Together AI and Baseten have announced massive rounds in recent months. On Wednesday, Palo Alto Networks said it will buy Applied Compute, which, like Fireworks, helps companies train and run custom AI models on their own data. The deal for the startup, founded just a year ago by former OpenAI researchers, is $4.5 billion, all of it in stock.

Here’s some of what Zhao had to say. This conversation has been edited for length and clarity.

You spent a decade at Google, including managing a 50-person engineering team on Google Cloud Vertex AI. Why leave when you did?

When you meet great co-founders, it’s obvious within five minutes that they’re really smart. I was sold after talking to Lin [Qiao] and Dima [Dzhulgakov]. It’s also important to find people who are genuinely nice, people you’ll enjoy working with.

How do you describe Fireworks to a CEO who has never heard of it?

I describe Fireworks as a specialized intelligence platform. OpenAI and Anthropic are building general intelligence. We use open models, which are often smaller, cheaper and faster, and let companies add their own data to specialize them. That way you own your AI rather than being beholden to giant AI conglomerates. If you’re just using Opus or Sonnet, that’s not a differentiator.

How far behind are open models right now?

A few years ago I’d have said a year, a year and a half. Then came DeepSeek and a waterfall of fantastic open models. These days it’s at most six months behind, probably closer to three.

If the models are so close behind, why are businesses slow to switch?

Frontier models are a household brand, and before you find product-market fit, using the best model is low risk. But once you pass 10,000 or 100,000 users and you’re spending $10,000 to $100,000 a month on tokens, it’s time to think about open source.

In July, Microsoft CEO Satya Nadella warned that companies using proprietary AI models pay twice, once in money and again in know-how. Do you think that warning had a material effect?

We think we’ll live in a two-model world, with frontier and open models in parallel. You want the best intelligence for high-level planning, but you don’t need a frontier model for basic arithmetic. That’s why there’s so much interest in routing, and why people now think about cost per task, not just cost per token.

Anthropic went public today. What do you think of its valuation? There’s one scenario in which it just continues to cement its place in this sort of oligopoly; there’s another where it starts to lose traction.

On the record: I’ll probably call my broker tonight and buy a few shares. This is a long-term bet. In 10 years AI usage will be at a completely different scale, and that takes an incredible amount of capital, which is why these companies are going public.

Fireworks has had a couple of security breaches recently. What do you tell customers?

Every company is probably seeing an unprecedented frequency of attacks. For our incident, a lot of the motivation was LLM jacking: hunting through providers for API keys and secrets to sell tokens on illicit marketplaces. Our promise is zero data retention for inference traffic, and there’s no indication that has been compromised.

Notion has disconnected from Fireworks. Did you lose other customers?

I don’t think I can publicly name the specific customers that were impacted. Some, such as Notion and Cursor, have gone public already. It was a small subset of our customers that had this data impact.

How did that customer data get exposed, given your zero-retention promise?

Notion was using batch prediction, where you upload a dataset that’s stored at rest, so it’s not a zero-retention product by nature. We’re moving those services to an online flow so we keep data only as long as we need it.

Jensen Huang left Nvidia last week, and Nvidia has backed Fireworks since 2024. Does that affect you?

It’s been a blow to the industry, and we feel for Jensen and his family. But Nvidia has always been a strong supporter of open source, and I don’t see that changing. We expect it to keep investing in Nemotron, and we’re excited to keep partnering with them.

When you purchase through links in our articles, we may earn a small commission. This doesn’t affect our editorial independence.

Source: techcrunch.com