Running AI on-premise makes sense for multiple reasons including sovereignty, data control and in many cases cost. Granted I was a little early with this on-prem AI call in 2024 and 2025, but it appears there's traction now despite higher memory prices. Three data points:
- Dell's quarterly results were fueled by AI servers. The company noted that enterprises were refreshing their infrastructure for AI workloads.
- On Elastic's quarterly results, hybrid architecture was driving deals.
- MongoDB said its Enterprise Advanced was a key part of big deals in its most recent quarter. CEO CJ Desai said: "Because of a variety of issues related to AI for mission-critical applications, there is this trend where customers do want to keep their critical data estates on-prem. And this is not just only in financial services, we are seeing that in health care and other verticals like government. When I was in Europe and even in Asia, I'm also seeing there that there is a preference for those industries to also use MongoDB potentially with EA (Enterprise Advanced) and only certain workloads in the cloud."