Results

Leveraging Process Mining and GenAI to Optimize Software Development | BT150 Spotlight

Leveraging Process Mining and GenAI to Optimize Software Development | BT150 Spotlight

In the following BT150 Spotlight interview, Larry Dignan sits down with Eric Severinghaus, Co-CEO of Bloomfilter, to discuss how the company is leveraging process mining and #generativeAI to help customers optimize their software development practices.

Bloomfilter connects to the tools software teams already use to gather data on the software development lifecycle. They use process mining to identify areas of waste, rework, and compliance issues causing delays, security vulnerabilities, and production outages.

This conversation explores how Bloomfilter integrates genAI to analyze code changes, ensure requirements, and prioritize high-risk tasks needing additional testing and oversight. This helps orgs govern the increasing use of AI-driven software development and extract more business value from their processes. The discussion covers Bloomfilter's partnership strategy, predictions for the evolution of software development in 2025, and the key stakeholders driving the adoption of these process optimization solutions.

On <iframe width="560" height="315" src="https://www.youtube.com/embed/jeNCYDT_eV8?si=rL3liMGVQKlCHe92" title="YouTube video player" frameborder="0" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share" referrerpolicy="strict-origin-when-cross-origin" allowfullscreen></iframe>

Bloomfilter co-CEO Severinghaus on the intersection of process mining, software development

Bloomfilter co-CEO Severinghaus on the intersection of process mining, software development


Bloomfilter is looking to meld process mining and process intelligence with software development via a partnership with Celonis. The goal: make developing applications at scale more efficient.

The company will power the Celonis Software Development Lifecycle Management (SDLC) application. Celonis for SDLC powered by Bloomfilter will align business priorities with technology initiatives, measure financial impact of resources and map and analyze processes and recommend ways to be more efficient.

At Constellation Research's Connected Enterprise, I caught up with Erik Severinghaus, Co-founder and Co-CEO of Bloomfilter, to talk shop. Here are some of the takeaways.

The intersection of software development and process mining. Severinghaus said the combination of software development and process mining is designed to build software that is "more efficient, more predictable, more observable and more nimble."

While software development is scaling with generative AI code, enterprises need to focus on the underlying processes. Bloomfilter, which is built on the Celonis platform, pulls in data from tools including Atlassian's Jira, GitHub from Microsoft and GitLab to show how software development is being done.

Severinghaus said:

"We pull all the information about how the software development process is working, and then we use process mining technology to help a customer understand, where there's waste, inefficiency, rework and steps that are skipped or not in compliance with the company's process. These issues could lead to production outages and security vulnerabilities."

What process mining reveals. Process mining typically has a few surprises for enterprises and the biggest one in software development tends to be rework. "You connect to these systems and pull out the way the process moves and we find things like 40% to 45% of tasks require rework," said Severinghaus. "When you look at the business impact of all of that rework, it becomes really apparent why 78% of software is late, over budget or doesn't ship at all."

Bloomfilter monitors software development processes, software process adherence, allocation of costs and the value being generated.

Why process matters with generative AI. "Enterprises are increasingly using automated code systems and there are a lot of interesting places where process interacts with AI," said Severinghaus. "First we couldn't do this without AI, but when you think about the software development life cycle there are about 15 different tools being stitched together. Customers are using AI to build software and there's been less and less governance."

Severinghaus said process mining is a way to analyze software development and pull out what's important. One of the most important things to do is to assess risk. "We are using generative AI to stitch the process together to govern what's happening in an AI-driven SDLC," he said.

The C-level buyer. Severinghaus said the buyer of Bloomfilter varies since every company is a software company today. For software companies, the primary buyer of Bloomfilter is the CTO or chief product officer. In more mainline companies, CIOs tend to be the main buyers with the CFO and COO playing a big role. "They want observability and they want to see what's happening within this black box of software development translated into words they can understand," said Severinghaus.

What's next? Bloomfilter's partnership with Celonis gives it the ability to plug into more systems including Salesforce and ServiceNow to deliver process intelligence for SDLC. Severinghaus said governance will also become vital as AI agents are including in the software development process. "If 2024 was the year of throwing AI against the wall and see what use case sticks, 2025 is very much going to be the year of how we govern and get business value out of it," said Severinghaus.

Data to Decisions Future of Work Innovation & Product-led Growth Tech Optimization Next-Generation Customer Experience Digital Safety, Privacy & Cybersecurity AI GenerativeAI ML Machine Learning LLMs Agentic AI Analytics Automation Disruptive Technology Chief Information Officer Chief Technology Officer Chief Executive Officer Chief AI Officer Chief Data Officer Chief Analytics Officer Chief Information Security Officer Chief Product Officer

Who’s Afraid of Little Ole AI: Some Post Adobe MAX Thoughts

Who’s Afraid of Little Ole AI: Some Post Adobe MAX Thoughts

“Writing should be respected and held to be nobler than all goods, unless she has suffered degradation in the brothel of the printing presses. She is a maiden with a pen, a harlot in print. Governed only by avaricious gain, will not that most base woman deserve the name of prostitute?”

In 1440 when the Gutenberg printing press was introduced, not everyone was a fan. Take Filippo de Strata (quoted above) who wrote an entire polemic tome to urge Italian nobility to banish the printing press to the fire heap. I mean, the guy outright called the machine a prostitute!

It is not unheard of that new technologies are met with a blend of excitement and fear.

Radio: “Radio is a highly complicated machine in the hands of people who know nothing about it.” Thomas Edison

The Internet: “The truth is no online database will replace your daily newspaper, no CD-ROM can take the place of a competent teacher and no computer network will change the way government works” Clifford Stoll, Newsweek Magazine

Now, let’s do Artificial Intelligence (AI): “It will mean that 95% of what marketers use agencies, strategists, and creative professionals for today will easily, nearly instantly and at almost no cost be handled by the AI.” Sam Altman

There is a rightful discussion and welcome debate over where and how AI, and perhaps more specifically Generative AI (GenAI) can or should be unleashed…and where it should or must be constrained and restricted. In fairness, even Sam Altman, CEO of OpenAI, clarified his above quote by noting that GenAI and AI as a larger entity would reframe human creativity, not replace it. Since GenAI tools exploded onto the scene, there has been a blend of curious enthusiasm and cautious skepticism with a side of fear mongering as pundits wonder aloud just how many hard-working humans will lose their livelihoods in this rise of the machines.

After spending a week in Miami surrounded by artists, creatives and creators, I am happy to report that AI adoption and use has evolved beyond those early days of fear and misunderstanding. I would argue that artists and creators have embraced the debate and the tools, choosing to be active participants by contributing to the guardrails that protect intellectual and creative property while also unleashing their own wild human creativity in new and extraordinary ways. The electricity that ran through the Miami Beach Convention Center at Adobe MAX 2024 was more about what artists could do next in this age of AI as art and art with AI. If the machines rise, the consensus in Miami was that the artists and creators of the world were going to rise right along with them.

Some Standout Announcements

  • Adobe Firefly Video Model is here and its gonna be a whole big thing. In beta, this newest member of the Firefly model family generates video from text and image prompts. It can smooth out transitions and even extend video clips. It also doesn’t hurt to have deep integrations with Premiere Pro so that video generation to editing and use is a smooth process. Generative Extend is a prime example, now available in beta in Premiere Pro. It extends video clips to cover gaps in footage and can even hold on a shot longer to enable perfect timing on pesky edits.

    Keeping pace with video creation requests feels impossible for most marketing and creative teams. Video can be expensive, time consuming and operationally impossible to move along efficiently. But this is interestingly where Adobe seems to be focusing…at that key content supply chain bottle neck that can fester and disrupt the flow between creative ideation and content generation.

    The introduction of the Firefly Video model is on its own an impressive announcement, but couple it with a brand new Frame.io and new device partnerships between Frame.io and the likes of Canon, Nikon and Leica to the Camera to Cloud ecosystem, video production as we know it is about to have a whole massive shakeup that makes video far more accessible, affordable and usable for marketing but easily extends to informal engagement hubs like HR, Sales and Service.
     
  • The Adobe Firefly Image Models also keep improving with the introduction of Firefly Image Model 3 that doesn’t just look at generating more content aware and realistic images…it does it four times faster. That’s right…now you can generate in FAST MODE. And yes, every time I see the button to activate these faster generations, I can’t help but shout “FAST MOOOOOODE!!!!” with my hands cupped like a bullhorn.

    A snappier model joins enhancements and improvements to Adobe’s Firefly Services and Custom Models for enterprise customers, making it is easy to see why enterprises are leaning into generating with Firefly for speed and for brand safety. With the focus on commercial readiness, these continuously improving models aren’t just focused on how good a generation can look…it also ensures that when you ask for an image of a woman drinking a soda, that the soda label isn’t a CocaPepsi or some other brand-infringing gaffe. Plus, with Custom Models, organizations can amplify safeguards by training the model on brand approved style guides and asset portfolios brining a new level of specificity to the generated assets.
     
  • Adobe brought an impressive upgrade to the GenStudio line with GenStudio for Performance Marketing. GenStudio is the end-to-end set of Creative Cloud and Experience Cloud applications together. GenStudio for Performance Marketing is a self-service, GenAI forward solution designed to optimize content for specific performance driven initiatives. This connects the dots between creation and campaign deployment across paid campaigns or even marketing driven emails. Soon every resource involved in this content supply chain can activate campaigns and make real time, in-flight adjustments on everything from creative assets to deployment parameters in channels like paid social and even mobile. Imagine saying goodbye to that social ad campaign postmortem where the image or the video clip was to blame for poor performance…instead imagine a GenAI empowered process that can meet market and consumer demand for fresh content while also satisfying the business’ demand for optimized spend and performance.
     
  • Project Concept just speaks to my marketing and agency exec soul. If tools like GenStudio are focused on the gaps in the launch and optimization stages of the content supply chain, tools like Project Concept rewind the tape BEFORE the very beginning and gives a collaborative home to the very initial stages of creativity, concepting and testing. Mood boards aren’t just for teenagers manifesting their perfect prom-posal. I often relied on crude mood boards cobbled together on PowerPoint slides to bring a visual center point to campaign and project concepts.

    A good mood board can encapsulate the look AND actual feeling intended to be shared with a campaign’s audience. A GREAT mood board sticks in your memory not just for the campaign it spawned, but for the creativity NOT used yet. Exceptional mood boards are durable…home to a collection of images, attempted glyphs for logos and even early-stage illustrations that should be revisited. Mood boards are home to everything from colors and textures to styles and fonts. Creativity is not easy. But having tools that collect and bring order to artistic chaos can make the creative process a little bit easier. Project Concept is in its own earliest stages of iteration, just entering private beta, but expect to see this highly collaborative space for creativity to be ready for ideation soon.

Even with ALL that, it was a single tool…a single new feature…that earned the MAX live audience’s biggest, boldest, most unbridled cheer: Distraction Removal. Described as a “smart technology to help remove people, wires, poles and other distractions from images” it was the star of the show. It once again proves that for users, AI’s most potent magic is in the simple, usable and immediately valuable details.

Some Parting Thoughts

It is hard to walk away from Adobe MAX without a sense of awe at what creatives, artists and every day creators can dream up and express. While the tools and the announcements were impressive and signaled a significant commitment to an AI-powered roadmap that will continue to push Adobe and the experience market forward, the tools always pale in comparison to the people and the community on display.

AI is neither the prostitute printing press nor the creative job killer. It, like every innovative tool and instrument before it, is as powerful as the minds and the hearts of those who wield it. How you use it and how you fill it still requires that you make the first thought, the first idea…the first prompt. How the rest unfolds is up to you. Throughout the week, I had the chance to connect with creators who were all more than willing to share their creations, showing off art tucked into sketch books or stored on laptops and phones. This community is doing what it has done since the very first time artists got together in a town square: they share, they celebrate and then...they roll up their sleeves. What they will create next will only be limited by their imagination and not dictated by any technology or tool. And thanks to new AI tools that extend creative capabilities into more informal creative and engagement hubs, the community will get larger and welcome even more more creators. 

 

 

 

 

 

 

 

 

 

 

 

For a more comprehensive list of announcements, read here.

There is also a MAX blog that highlights some of the announcements I’ve listed above, read here.

New C-Suite Marketing Transformation Next-Generation Customer Experience Chief Customer Officer Chief Marketing Officer Chief Digital Officer

Palantir Q3 strong amid strong AI demand; Karp says 'we intend to take the entire market'

Palantir Q3 strong amid strong AI demand; Karp says 'we intend to take the entire market'

Palantir delivered strong third quarter results and upped its outlook for the fourth quarter. CEO Alex Karp said the quarter "was driven by unrelenting AI demand that won't slow down."

The company reported third quarter earnings of $144 million, or 6 cents a share, on revenue of $726 million, up 30% from a year ago. Non-GAAP earnings were 10 cents a share in the quarter.

Wall Street was expecting Palantir to report non-GAAP third quarter earnings of 9 cents a share on revenue of $703.7 million.

Palantir is delivering strong growth as its US commercial revenue accelerates along with its US government sales. Palantir has landed enterprise customers with its AI Platform Boot Camps

As for the outlook, Palantir projected revenue of $767 million to $771 million. For 2024, Palantir projected $2.805 billion to $2.809 billion. The company expects a US commercial revenue of $687 million, up 50% from a year ago, and GAAP operating and net income in each quarter of the year.

Palantir closed 104 deals above $1 million in the third quarter as customer accounts surged 39% from a year ago. Lowe's bets on AI, technology to navigate slowing demand

The company's growth rate has accelerated in the last six quarters.

In a shareholder letter, Karp said the following:

  • "The growth of our business is accelerating, and our financial performance is exceeding expectations as we meet an unwavering demand for the most advanced artificial intelligence technologies from our U.S. government and commercial customers."
  • "A juggernaut is emerging. This is the software century, and we intend to take the entire market."
  • "The unrelenting march of our business has been driven by an early and decades-long investment in the technical infrastructure that is now making the large language models that have reshaped our world useful and valuable to large enterprises."
  • "It is the speed with which institutions in the United States, in particular, have adopted our platforms and artificial intelligence capabilities more broadly that has been, and we believe will continue to be, the driver of our growth. As America once again forges ahead, our allies and partners in Europe are being left behind. Their private and state institutions stand on the sidelines during this pivotal moment in economic history, while the relentless innovation of U.S. companies disrupts and reshapes global industries. Europe must adapt to the opportunities and challenges of AI, or risk ruin."

On a conference call, Palantir executives made the following points:

  • "We're witnessing the commoditization of cognition with the rapid advancement of AI models," said Ryan Taylor, Chief Revenue Officer.  "Almost all investment in the AI space has been focused on supplying and improving these models. What would differentiate the AI haves from the have needs is the ability to maximally leverage these models by capitalizing upon the rich context within the enterprise."
  • Taylor said Department of Defense drove seqentual revenue growth.  
  • Shyam Sankar, CTO, said: "Models continue to improve, but more importantly, the models across both open and closed source are becoming more similar. They are converging, all while pricing for inference is dropping like a rock. This only strengthens our conviction the value is in the application and workflow layer, which is where we excel."
  • The big LLM companies will have to build applications around their models to extract value, said Sankar. The differentiation for Palantir is ontology across AIP.  
Data to Decisions Innovation & Product-led Growth Future of Work Tech Optimization Next-Generation Customer Experience Digital Safety, Privacy & Cybersecurity AI GenerativeAI ML Machine Learning LLMs Agentic AI Analytics Automation Disruptive Technology Chief Executive Officer Chief Information Officer Chief Data Officer Chief Technology Officer Chief AI Officer Chief Analytics Officer Chief Information Security Officer Chief Product Officer

Creatio’s “Energy” Release Fuels its Continued Disruption of the CRM Space

Creatio’s “Energy” Release Fuels its Continued Disruption of the CRM Space

Creatio has been taking a “no code” approach to building a midmarket and enterprise focused CRM platform and set of applications for about a decade now. The company has offered a competitive suite of CRM tools spanning marketing automation, sales automation and customer service automation that rests upon a solid workflow engine (the company was previously named “BPMonline”).

So, with an existing solid foundation in workflow, the innovations we are seeing in AI provide a unique opportunity for Creatio to offer its customers the ability to supercharge existing workflow oriented CRM with generative and agentic AI tools to drive user productivity, reduce costs, and provide an enhanced customer experience. And that is just what its latest release, dubbed “Energy,” aims to do.

Embedded AI to Drive CRM Adoption and ROI

The highlights of the Energy release include a new “AI Command center.”  The goal of AI Command Center is to combine prescriptive, generative, and agentic AI into one single destination. It allows admins to design, deploy, and refine AI skills in a single place, to both optimize the actual performance of AI implementations but also better audit and moderate AI usage across the organization.

The AI builder tools in Energy are impressive, and bring Creatio’s AI vision closer to parity with most CRM providers. However, given its small and midsize business base of customers, Creatio is releasing a slew of pre-built AI tools for multiple use cases. These initial 20 pre-built tools cover marketing, sales and support use cases. For example, users can more quickly segment target lists, leverage generative AI to create personalized digital engagements, and take advantage of integrated predictive analytics to refine offers and promotions to improve conversion rates.

The AI advancements build upon existing strong copilot and other generative AI tools inside Creatio’s offerings. These tools have provided inline, contextual insights around leads, accounts, and even predictive and prescriptive insights around the reporting and analytics tools. With agentic AI advancements, Creatio users can now better use AI to automate common tasks in the system, driving productivity and enabling growing but resources constrained teams to “do more with less” and to manage growth efficiently without needing to constantly add human headcount. And, by providing a more streamlined and effective employee experience, users can potentially retain more employees as they can be more productive and less likely to experience employee burnout.

Out of the box AI tools include support for the following use cases:

  • Sales: Meeting Scheduling, Conversion Score Insights, Lead and Opportunity Summaries
  • Marketing: Bounce Responses Analysis, Enhanced Email Subject Lines, Text Rewriting, Text Translation
  • Service and Support: Case Resolution Recommendations, Case Performance Analysis, Case Summaries, Knowledge Base Articles
  • General CRM: a brand new drag-and-drop Email Designer, revamped Product Catalog, redesigned pages for Order and Contract Management, improved navigation panels, Ada AI chatbot integration, embedded Google Analytics integration, and many others.

Flexible Pricing for Growing Businesses

In a recent launch event for the Energy release, Creatio showcased some customers who are taking advantage of the platform, as well as how they plan to leverage the new AI capabilities to drive productivity and foster growth without having to make significant people hires in the process, further driving efficiency. But what was notable was the size of Creatio’s reference customers. These were manufacturers and others firms with more than a thousand CRM users across marketing, sales and support. Creatio has also landed marquee enterprise reference customers including AMD, Howdens, Colgate Palmolive, and Metlife to name a few. In short, Creatio is proving itself a legitimate platform that can scale to meet enterprise customers’ needs as their businesses grow.

But as businesses grow and their needs change, traditional CRM pricing can actually stymy an organization’s ability to be successful in their CRM initiatives. High per-user pricing in legacy CRM offerings, as well as arbitrary silos between application functions (example: you cannot use any aspect of marketing automation as a sales automation user without significant increase in spend) have forced line of business and IT leaders to make hard decisions as to who has access to the system, and what functionality they can utilize.

Creatio is trying to solve this by offering a far more flexible pricing model that better meets the needs of growing businesses. The company offers Growth, Enterprise, and Unlimited platform access plans that enable users to build CRM deployments that fir their unique business needs, and low cost ($15 per user/month) feature set access for its core sales, marketing and support tools. Platform plans start at $25 per user/per month, making the platform compelling to businesses of all sizes. In addition, Creatio includes its AI capabilities including the new features in Energy as part of the base price. This gives users the ability to both experiment and deploy AI without a lot of risk in terms of cost, complexity or security concerns.

For businesses looking to deploy their first packaged CRM system, Creatio should be on any short-list. The competitive platform fees,  the ability to enable every employee to access data and functionality as needed without premium SaaS prices, and the fact that the AI capabilities require no fees, makes Creatio a compelling alternative to more premium priced offerings.

Add to that, the free AI tools can enable smaller business to expand their business without headcount additions, and the return on investment could far outweigh any cost of ownership when we think of the ability to grow without hiring more workers. But beyond pricing, the workflow oriented platform, the no-code approach and the well-integrated marketing, sales and support applications offers growing and midsized enterprises a tool they can really “own” and create a differentiated employee and customer experience without a lot of IT assistance, or needing to engage with VARs or SIs for any change in the system, driving both a more effective and efficient CRM deployment.

Next-Generation Customer Experience Data to Decisions Future of Work Innovation & Product-led Growth New C-Suite Marketing Transformation I am Team Leader at the Nominee Organization (no vendor self nominations) Distillation Aftershots Tech Optimization Digital Safety, Privacy & Cybersecurity ML Machine Learning LLMs Agentic AI Generative AI AI Analytics Automation business Marketing SaaS PaaS IaaS Digital Transformation Disruptive Technology Enterprise IT Enterprise Acceleration Enterprise Software Next Gen Apps IoT Blockchain CRM ERP finance Healthcare Customer Service Content Management Collaboration Chief Revenue Officer Chief Executive Officer Chief Information Officer Chief Technology Officer Chief AI Officer Chief Data Officer Chief Analytics Officer Chief Information Security Officer Chief Product Officer

ExxonMobil to outline process, automation, AI efforts

ExxonMobil to outline process, automation, AI efforts

ExxonMobil is looking to save $15 billion in operating costs by 2027 and it will leverage artificial intelligence in combination with process intelligence to get there.

During ExxonMobil's third quarter earnings call, CEO Darren Woods said the company would outline how it will leverage AI across the enterprise via its global business services (GBS) group. That unit is responsible for end-to-end processes across the company.

"The organization is getting more efficient and effective at the core task of driving value in the company," said Woods. "The technology side of the equation will drive a double effect of higher revenue and lower costs to improve profitability."

On December 11, ExxonMobil will outline its AI and process transformation plans for investors. Woods said, "AI is part of the equation" and there's a "concerted effort to apply that new technology."

CFO Kathy Mikelis said AI is just one part of the mix. The company has been historically siloed and lacked standardized process. Those silos "made it more difficult to apply any single type of technology across the company."

She said:

"We'll be continuing to automate much of what we do today manually and that's going to drive improved efficiency and a way better experience for our people, our customers and our vendors. We're not always the easiest company to do business with when it comes to information technology and self-service. We have a pretty complicated IT environment we're in the process of simplifying to drive a much higher degree of automation into the business."

Speaking at Celonis' Celosphere 2024 event in Munich last month, John DiTullio, Process Transformation Executive in ExxonMobil's Global Business Solutions unit, highlighted how the company is putting in the technology that'll lead to more automation and process efficiency.

"In ExxonMobil we talk in the B's not M's but to get to the billions you have to do it million by million," said DiTullio, who was an early adopter of Celonis' Process Intelligence Graph, which analyzes processes across an enterprise as well as the interdependencies.

DiTullio said ExxonMobil is using Celonis to better migrate from various SAP ECC6 instances to SAP S/4HANA. That IT transformation is one example where ExxonMobil is becoming more efficient, and there are many more said DiTullio.

Celonis is being used for multiple use cases including procurement, supply chain, logistics, maintenance, inventory and accounts payable and receivable to name a few by riding on top of various systems like SAP and Salesforce to optimize processes.

ExxonMobil is also a large Amazon Web Services customer and the stack includes Snowflake and a bevy of other vendors. Like any enterprise with the scale of ExxonMobil the company is trying to optimize a complex IT stack that includes one of everything.

"Value comes in many shapes and sizes and collaboration is enabled by leveraging scale and a common language to make decisions," said DiTullio. "Data speaks louder."

Although ExxonMobil won't outline its AI plans until next month, it appears that the data infrastructure and stage is set for AI adoption and more automation.

Data to Decisions Tech Optimization Innovation & Product-led Growth Future of Work Next-Generation Customer Experience Revenue & Growth Effectiveness New C-Suite Digital Safety, Privacy & Cybersecurity AI GenerativeAI ML Machine Learning LLMs Agentic AI Analytics Automation Disruptive Technology Chief Information Officer Chief Executive Officer Chief Technology Officer Chief AI Officer Chief Data Officer Chief Analytics Officer Chief Information Security Officer Chief Product Officer

AI data center building boom: Four themes to know

AI data center building boom: Four themes to know

The tide has turned as Wall Street is starting to ask questions about the capital expenditures being laid out for data centers designed for generative AI. Some answers from CEOs have been better than others, but common themes around logistics, land and power, business models and efficiencies have emerged.

Here are the big themes to note amid this AI-fueled data center binge.

Logistics matter

During Amazon's third quarter earnings call, CEO Andy Jassy made a few critical points about the data center buildout. First, he noted that data center assets last 20 to 30 years and have a long runway for monetization. But when asked about margins, Jassy said the following:

"I think one of the least understood parts about AWS, over time, is that it is a massive logistics challenge. If you think about it, we have 35 or so regions around the world, which is an area of the world where we have multiple data centers, and then probably about 130 availability zone through data centers, and then we have thousands of SKUs we have to land in all those facilities.

If you land too little of them, you end up with shortages, which end up in outages for customers. Most don't end up with too little, they end up with too much. And if you end up with too much, the economics are woefully inefficient."

Jassy added that AWS has sophisticated models to anticipate capacity and what services are offered. Given that it's early in the AI boom, demand is volatile and less predictable. "We have significant demand signals giving us an idea about how much we need," said Jassy, who acknowledged that there are lower margins because the AI market is immature.

Following the logic of Jassy's comments you'd expect companies that are used to building out data centers--Meta and Alphabet--will have advantages over a company like Microsoft--historically a software vendor.

Indeed, Microsoft CEO Satya Nadella said:

"We have run into lots of external constraints because this demand all showed up pretty fast," he said. "DCs don't get built overnight. There is the DC, there is power. And so that's sort of been the short-term constraint. Even in Q2, for example, some of the demand issues we have or our ability to fulfill demand is because of external third-party stuff that we leased moving up. In the long run, we do need effective power and we need DCs. And some of these things are more long lead."

Lead times, land and power

In the end, AI data centers require a lot more than the gear that goes in them.

Comments from data center players like Equinix highlight the lead times with genAI facilities go well beyond GPU supplies. "Customer requirements and data center designs are evolving rapidly. Energy constraints and long-term development cycles pose challenges to our industry's ability to serve customers effectively," said Equinix CEO Adaire Fox-Martin, who noted that his company has the land and power commitments to continue to scale.

Digital Realty Trust CEO Andrew Power noted that hyperscalers that are running to nuclear energy for future power needs, but these purchase agreements in many cases (small nuclear reactors for instance) will take years to deliver.

"Sourcing available power is just one piece of the data center infrastructure puzzle. Supply chain management, construction management and operating expertise are all challenges that customers rely on Digital Realty to solve," said Power.

Some business models lead to multiple AI wins

Alphabet and Meta are both spending massive amounts on data centers and have already told Wall Street 2025 capital expenditures are going higher.

Neither company talked about logistics or capacity issues with data center buildouts. These firms do depend on Nvidia GPUs, but also have their own processors. Amazon, Alphabet and Meta have been building data centers at scale since inception.

The big difference for Alphabet and Meta is that they have the models and business models to better justify the data center buildout. Both Alphabet's Google and Meta properties are using AI to better monetize their core properties.

Meta CEO Mark Zuckerberg said the company is leveraging generative AI across the properties to bolster efficiency and drive revenue.

Alphabet CEO Sundar Pichai had a similar refrain. Yes, AI is a big investment, but services like AI Overview, Circle to Search, and Lens can drive revenue and engagement.

Massive efficiencies ahead

Feel free to question the theory that you need to build out a data center footprint based on today's relatively inefficient AI workloads.

AI workload efficiency is improving for a variety of reasons, but the primary one is money. Sure, Zuckerberg loves open-source AI and infrastructure, but he's also following the money.

Zuckerberg noted that infrastructure will become more efficient and that's why Meta has backed the Open Compute Project. He said:

"This stuff is obviously very expensive. When someone figures out a way to run this better, if they can run it 20% more effectively, then that will save us a huge amount of money. And that was sort of the experience that we had with open compute and part of why we are leaning so much into open source here."

Pichai made a similar point. He said:

"We are also doing important work inside our data centers to drive efficiencies while making significant hardware and model improvements. For example, we shared that since we first began testing AI Overviews, we have lowered machine cost per query significantly. In 18 months, we reduced cost by more than 90% for these queries through hardware, engineering and technical breakthroughs while doubling the size of our custom Gemini model."

Speaking on a panel at Constellation Research's Connected Enterprise conference, Brian Behlendorf, CTO at the Open Wallet Foundation and Chief AI Strategist at The Linux Foundation said "there's a lot of irrational exuberance about the amount of investment that's going to be required both to train models and do inference on them."

"The cost of training AI is going to come down dramatically. There is a raft of 10x improvements in training and inference costs, purely in software. We're also finding better structured data ends lead to higher quality models at smaller token sizes," he said.

Data to Decisions Tech Optimization Innovation & Product-led Growth Future of Work Next-Generation Customer Experience Digital Safety, Privacy & Cybersecurity Big Data AI GenerativeAI ML Machine Learning LLMs Agentic AI Analytics Automation Disruptive Technology Chief Executive Officer Chief Financial Officer Chief Information Officer Chief Technology Officer Chief Information Security Officer Chief Data Officer Chief AI Officer Chief Analytics Officer Chief Product Officer

Constellation Research's Connected Enterprise 2024: All the takeaways

Constellation Research's Connected Enterprise 2024: All the takeaways

Constellation Research's Connected Enterprise 2024 spurred big ideas, a community of tech leaders and dozens of takeaways. It's a fire house of information designed to get you thinking about what's around the corner.

With that in mind, here's a look at the takeaways that I’ve flagged for follow up. Much of this reporter's notebook includes themes that could emerge over time. We'll be posting our interviews from CCE 2024 and interviews in the weeks to come.

Put active inference on your radar. "There are several technologies that are coming and one of them is our Internet is evolving into spatial domains that are programmable," said Denise Holt, Founder and CEO AIX Global Media. "It'll create digital twins of everything, and this is going to provide a grounding layer of reality for these next evolution of agents."

Active inference will have an understanding of the real world. Holt said active inference will be able to take in sensor information, ground it to reality and then leverage edge computing for inference. "Active inference enables the distribution of these agents to where they're not tethered to a giant database that is consuming all of this energy," she said. "The processing gets distributed to edge computing and edge devices. And then the other aspect of it is that it uses the right data in the moment for the task at hand, so it's not having to process through all of this irrelevant data to come up with an output that's close to your expectations. It actually deals with real world data in the moment over time."

Key themes of active inference. In the talk, Holt did a deep dive of active inference. Here are a few takeaways to know:

  • Active inference mimics biological intelligence and can overcome the limits of AI and machine learning.
  • Active inference is explainable and capable of governance.
  • Real-time decision making is a core feature of active inference and agents are building blocks that continually adapt to their environment.
  • Active inference is decentralized.
  • There isn't a big data requirement because active inference uses real world context.
  • Agents that power active inference leverage sensor data from IoT, cameras and robotics and measure it against a real-world model.
  • The standards of the spatial web, which enables active inference, have been in development for the last four years.
  • Active inference will be powered by digital twins of everything and nested ecosystems with them.

Holt said the impact goes like this: "We will have smart cities, autonomous systems, improving the efficiency of everything, global supply chains, personal and critical systems. Homeostasis of all complex systems can be achieved--healthcare, education, environmental management. This is adaptive. It's efficient edge computing, improved human AI, collaboration, cooperation and safety."

Focus on the application of AI, not the technology itself. "AI is all about the application of technology. AI is a universal technology instead of a small pocket of innovation," said Hari Shetty, Chief Strategist and Technology Officer at Wipro. "It's about the outcomes of technology for our clients."

EQ will save us. John Nosta, President of NostaLab, argued that large language models (LLMs) are expanding the cognitive dynamic with humans. He said:

"The cognitive experience itself is supported by large language models, and it makes it better. It makes it enjoyable. LLMs are tuned to your brain's creative frequency. It taps the genius within you to facilitate this dialog. LLM is your favorite teacher that you had in first grade or second grade. It gets you and that cognitive dynamic, that iterative dynamic, facilitates faster, better, and it lets you enjoy the ride."

Nostra said there is a risk that AI will cut human knowledge into smaller pieces, but doesn't see it happening. Why? Emotional intelligence. "I think that AI s going to be smarter. But maybe there is light at the end of the tunnel if humans have an EQ based process. This where it gets sticky," said Nostra. "There's a fundamental human component here that will ultimately be the domain of humanity."

Agentic AI has runway, but there are multiple challenges ahead. A panel focused on making agents more human and surfaced the following questions:

  • Can agents become more human with synthetic emotion?
  • Agent sprawl will mean a nearly infinite number of types.
  • It's unclear what role regulation will play. Will agents comply with EU's GDPR?
  • Can orchestration make managing agents worse?
  • Agents are focused on autonomous tasks today, but are likely to morph into avatars and creations that carry more meaning to humans.

"The Internet was decentralized. AI is centralized, closed and only a few win. We need to break that model. We have designed centralized scarcity. We need decentralized abundance. Otherwise, the AI overlords will take over," said Constellation Research CEO & Founder R “Ray” Wang.

One of those overlords is Nvidia, but there are questions emerging that perhaps this data center buildout for brute forces approaches to AI is misguided. Brian Behlendorf, CTO at the Open Wallet Foundation and Chief AI Strategist at The Linux Foundation said, "there's a lot of irrational exuberance about the amount of investment that's going to be required both to train models and do inference on them."

Change management is never out of fashion--even in new projects including AI. One common theme from the successful AI projects cited at CCE was change management--cultural, technology and emotional intelligence.

"Hold on to your ideas a little lightly. Experts of the past are not the experts of tomorrow," said Vala Afshar, Chief Digital Evangelist, Salesforce and Co-Founder and Co-Host of DisrupTVShow. "Be humble and kind and know you can be wrong."

Innovation sometimes means burning legacy technology to the ground. David Giambruno, VP Tivity Health, walked through the steps of cutting IT budgets, eliminating tech debt and enabling innovation. Exponential efficiency isn’t easy.

Get ready to hear a lot about knowledge as a theme. Enterprise buyers will hear a lot about "knowledge" in 2025, but CxOs shouldn't treat the topic as just another buzzword, said Constellation Research analyst Liz Miller. Knowledge is about all the accumulated data across the enterprise that drives experiences.

The enterprise software buying process is broken and it's swallowing up the CIO role. I held a panel on marketplaces and removing friction from the enterprise software buying process. Ashwin Rangan, who has held CIO roles across multiple enterprises, said: "I think the CIO role is becoming the chief cat herder role," said Rangan. "The CIO is turning into a chief procurement officer for technology vs. the joy of innovation. The innovation track is being disrupted by trying to figure out how to buy all of this stuff."

Automating repetitive work can hollow out your bench. "Here's the thing that I think too many people forget. When you hire somebody with no experience at all the work you give them very early on repetitive and easy to check the answer. The perfect task for AI is also the perfect work for your intern or new graduate," said Cassie Kozyrkov, Founder Kozyr LLC, who delivered the keynote at Constellation Research's Connected Enterprise. "A lot more of the junior person's work is going to get cannibalized by more senior folks."

Alan Boehme, Future Tech Advisor to CEO H&M, argued that personalization doesn't exist. "Personalization doesn't exist because people don't know what they want. You're just leading them down paths--that's not personalizing," he said.

Privacy doesn't exist either. "Our job as designers, as brands, is to make the fact that you have no privacy worth your while," said Benjamin Wiener, SVP and Strategic Business Unit Head, Cognizant Moment.

Industries are made up and a business construct that's outdated. Rita McGrath, Founder, Valize Strategy and Professor, Columbia Business School, said industries are false constructs that hamper leadership. "We made up what an industry is and what its boundaries are and who participates in it. If you think about most of your companies, what industry are you really in? Who are you really competing with? It's not always an obvious question," said McGrath.

Governance as an AI enabler. Governance was a recurring theme on day one as an enabler for responsible AI. Although governance isn't a fun topic, it's needed in data and AI for transparency and fairness. Without those two things you don't have trust and your AI projects are likely to fail.

Cybersecurity is also a key theme for boards. The odd thing is that cybersecurity budgets have taken a hit to fund AI. Focus on the response to a cyberattacks, which by the way will be more AI-driven.

Capture the data that matters. Numerous execs pushed back on the urge to collect data on everything. The argument was more for quality than quantity. "The biggest opportunity is to actually capture more data not to change models, but improve the day-to-day job. If you think of the typical day of a broker, there is so much data we are not capturing," said Ibrahim Gokcen, Chief Data & Analytics Officer at AON. "There are all these PDF files of codes and proposals and policies we connect and feed into models, dashboards and insights."

Active metadata will be critical. Mark Potter, CEO of Actian, said: “Active metadata is all about understanding how to map the lineage of data and knowledge. Graphs that allow you to understand how data is connected to other sources or people will be key.”

GenAI and agents are your enterprise software UI. Boomi CEO Steve Lucas said ERP vendors should all be concerned because AI is the new UI. Chatbots and AI are going to replace the UI that requires you to "to log in and find some random pain in the ass thing and spend 7 hours figuring it out. You're going to see AI as the new UI and ERP vendors know it."

The future of health will be AI, tech enabled. A panel of healthcare professionals said they expect the industry to move toward robotic care by 2050, sensor and scanning technologies at scale, and preventative care that is incentivized through an award system. "At the end of the day, it's about human nature and that's a beast of its own," said David Giambruno, VP Tivity Health.

Employee experience can be assisted by software and AI, but you need humans. Systems, tools and processes are foundational to employee experience especially with AI. Monica Kumar, EVP & CMO at Extreme Networks, said software can enable a good employee experience, but requires the worker to provide input. Others agreed. "Excellent employee experiences are technology combined with people and good data to improve the software," said Anne Kao, Board Advisor, Product, AppFaktors.

2025 themes. With budget season well underway, 2025 brings a few big questions to ponder? How will AI be funded and what projects will lose out? In other words, when will AI get its own budget line. How do enterprises approach growth in the age of AI? See: The art, ROI and FOMO of 2025 AI budget planning

CCE 2024, SuperNova Award interviews

Data to Decisions Innovation & Product-led Growth New C-Suite Next-Generation Customer Experience Future of Work Tech Optimization Digital Safety, Privacy & Cybersecurity AI GenerativeAI ML Machine Learning LLMs Agentic AI Analytics Automation Disruptive Technology Chief Executive Officer Chief Financial Officer Chief Information Officer Chief Technology Officer Chief AI Officer Chief Data Officer Chief Analytics Officer Chief Information Security Officer Chief Product Officer

Intel defends Gaudi 3 as it misses 2024 sales targets

Intel defends Gaudi 3 as it misses 2024 sales targets

Intel CEO Pat Gelsinger argued that its Gaudi 3 AI accelerator will be able to deliver strong total cost of ownership even as it falls short of the $500 million revenue target for 2024.

Gelsinger said on Intel's third quarter earnings call that the company is encouraged by Gaudi 3 interest despite the sales setback. Gaudi 3 AI accelerators are Intel's play to be in the mix for AI workloads. Nvidia is the clear leader in AI infrastructure with AMD playing No. 2 competitor.

Here's what Gelsinger had to say:

"While the Gaudi 3 benchmarks have been impressive and we are pleased by our recent collaboration with IBM to deploy Gaudi 3 as a service on IBM Cloud. The overall uptake of Gaudi has been slower than we anticipated as adoption rates were impacted by the product transition from Gaudi 2 to Gaudi 3 and software ease of use.

As a result, we will not achieve our target of $500 million in revenue for Gaudi in 2024. That said, taking a longer-term view, we remain encouraged by the market available to us. There is clear need for solutions with superior TCO based on open standards and we are continuing to enhance the Gaudi value proposition."

When pressed by analysts, Gelsinger said Gaudi 3 should be viewed as part of a CPU combination.

Gelsinger made the following points:

  • CPU is playing an increasing role in data center AI compute due to inference. "As you go into enterprise AI, we expect to place a more prominent role, databases, embedding, refinement or much more attuned to CPU workloads. And our strategy there is CPU plus accelerator or CPU plus Gaudi," he said.
  • Enterprise use cases will be more about inference and CPUs and Gaudi 3.
  • Intel is seeing a good pipeline for Gaudi 3 and early interest.
  • "Our strategy there is CPU plus accelerator or CPU plus Gaudi," said Gelsinger.

Intel's third quarter results and fourth quarter outlook left room for optimism, but the chipmaker still has a lot of work to do.

By the numbers:

  • Intel said it expects fourth quarter revenue to be between $13.3 billion and $14.3 billion and the midpoint of $13.8 billion was above the $13.66 billion estimate. Adjusted earnings for the fourth quarter are expected to be 12 cents a share, above the 8 cents a share estimate.
  • Intel reported a third quarter net loss of $16.6 billion, which includes restructuring charges on revenue of $13.3 billion, down 6% from a year ago. On a non-GAAP basis, Intel lost $2 billion, or 46 cents a share.
  • The company took a $2.8 billion restructuring charge in the third quarter.
  • Intel said its client computing unit revenue was down 7% in the third quarter and the data center division was up 9%.

 

Data to Decisions Tech Optimization Big Data Chief Information Officer Chief Technology Officer Chief Information Security Officer Chief Data Officer

Apple Q4 ahead of estimates along with iPhone sales

Apple Q4 ahead of estimates along with iPhone sales

Apple reported a solid fourth quarter as earnings, revenue and iPhone sales were above expectations.
 
The company reported fourth quarter earnings of $1.64 a share on revenue of $94.93 billion. Wall Street was looking for earnings of $1.60 a share on revenue of $94.58 billion.
 
With the results, Apple allayed some fears about iPhone sales. iPhone revenue was $46.22 billion in the fourth quarter ahead of expectations. However, Mac, iPad and services revenue fell short of what many analysts were expecting.
 
CEO Tim Cook said revenue in the fourth quarter was at a record level and up 6% from a year ago. He touted new product cycles for iPhone, Apple Watch and AirPods.
Innovation & Product-led Growth apple Chief Information Officer