👈 back to kenneth.io

Software-defined intelligence

June 2024

A quick riff: When I look at most AI companies in 2024, they're deploying a similar strategy: investing heavily to build proprietary foundational models and then creating a business around those models, either through a platform, a consumer business, or a combination of both.

In the consumer business, it's typically an app that showcases the model's capabilities to users, who then pay a monthly subscription fee.

On the platform side, the approach involves selling access to the foundational model via API-first products and charging based on usage.

That's it. All major AI companies follow the business model developed initially by OpenAI.

However, I'm not convinced this is the best approach moving forward.

If AI platform companies continue to only sell their foundational models as inference, they will become indistinguishable, leading to a race to the bottom.

Instead, they need to build true platforms that climb the abstraction ladder and create something more high-level, and that is software-defined intelligence.

By building a platform offering software-defined intelligence, your goal is to own the workflow of creating AI-powered products. You achieve this by providing a full spectrum of abstractions, enabling a seamless transition from low-level model inference to data storage, computing, agents, embedding, authorization, and an ecosystem for functionality and long-tail features such as function calling and actions.

This is what true platform building is all about: providing the primitives that abstract away the underlying technology. Most AI companies are far away from this, as they are too busy selling OpenAI-compatible inference-shovels, than building real platforms.

The value proposition for developers is that your platform offers better economics and primitives, allowing them to offload the cognitive overhead of building onto the platform. This means developers don't have to worry about inference scaling, model differences, or whether the models are locally or in the cloud. Instead, they use software-defined intelligence, leveraging your abstractions, SDKs, APIs, and whatever the future brings. The platform ensures the model runs securely, cost-effectively, and in the most privacy-sensitive way possible.

That's what AI platform companies should be selling: A higher-level platform that abstracts away the complexities of models, and treats them like processors in operating systems, where developers use well-defined primitives, and never need to know what is going on under the hood.

This approach moves them away from selling low-level models and positions them to capture more value; something differentiated.

Relevent reading