Zoho focuses LLM efforts on Nvidia architecture

Larry Dignan

Editor in Chief of Constellation Insights
Constellation Research

Larry Dignan is Editor in Chief of Constellation Insights at Constellation Research, where he leads editorial coverage focused on enterprise technology, digital transformation, and emerging trends shaping the future of business. He oversees research-driven news, analysis, interviews, and event coverage designed to help technology buyers and vendors navigate complex markets with clarity and context. ...

Read more

Zoho said it will build narrow use case focused language models for its platform on Nvidia after seeing a 60% increase in throughput and 35% reduction in latency compared to the open-source frameworks used previously.

The company, which offers a broad suite of business applications, has been building its AI stack and features in its portfolio.

Zoho said that it will use Nvidia's NeMo, a part of Nvidia AI Enterprise, and GPUs for its models. Zoho said it has spent more than $10 million on Nvidia technology and plans to invest another $10 million in the next year.

• Lessons learned from four Zoho customers
• Zoho Analytics revamp aims to connect, BI, data scientists, business users
• Zoho Advances Its Value-Leading Analytics and Business Intelligence Platform (research)
• Zoho CEO Sridhar Vembu: Long-term thought leadership on innovation, technology, people
• Zoholics 2024: Zoho aims to democratize CRM, infuse AI across platform, court developers, create cybersecurity stack

In a statement, Ramprakash Ramamoorthy, Director of AI at Zoho, said the company is focused on developing large language models (LLMs) designed for business use cases and integrated into its stack.

Zoho's focus has been on using smaller models that are more use case focused and cost efficient. Zoho, which uses multiple models, doesn't train its models on customer data.

According to Zoho, its LLM efforts will revolve around multimodal, vision and speech capabilities. The company said it is testing NVIDIA TensorRT-LLM.

Constellation Research analyst Holger Mueller said:

"This is a good move by Zoho and it's not surprising. There is no alternative to NVidia when it comes to on-premises AI. It’s a great validation of the Nvidia stack as Zoho tried alternate solutions, and does not shy away from stating that Nvidia is more efficient. The question is whether can a Nvidia stack deliver at an attractive SMB price point."

IBM Q3 mixed, AI bookings surge, infrastructure sales take hit

Larry Dignan

Editor in Chief of Constellation Insights
Constellation Research

Larry Dignan is Editor in Chief of Constellation Insights at Constellation Research, where he leads editorial coverage focused on enterprise technology, digital transformation, and emerging trends shaping the future of business. He oversees research-driven news, analysis, interviews, and event coverage designed to help technology buyers and vendors navigate complex markets with clarity and context. ...

Read more

IBM's third quarter was mixed as sales fell short of estimates, earnings were better-than-expected and the company said that its generative AI bookings were $3 billion.

The company reported third quarter earnings of $2.30 a share on revenue of $15 billion, up 1% from a year ago. Wall Street was expecting IBM to report third quarter non-GAAP earnings of $2.23 a share on revenue of $15.08 billion.

• IBM rolls out Granite 3 models, makes default for Consulting Advantage

• IBM open sources Granite models, integrates watsonx.governance with AWS SageMaker

CEO Arvind Krishna said the company was set up well in software with revenue growth consistent with the third quarter. Krishna said the company saw "a reacceleration in Red Hat" and good traction with its models, which deliver good price for performance.

Constellation Research analyst Holger Mueller said IBM's results were hampered by pension costs, but is showing traction in software. Mueller said:

"IBM is becoming more of a software company with 45% of revenue coming from applications. If the trend continues, we will see IBM passing the 50% milestone next year. Good things happen when a former product developer is made CEO, and knows how to leverage IBM Research."

By the numbers:

• IBM's software revenue was $6.5 billion, up 9.7% from a year ago. Data and AI revenue was up 5%, Red Hat growth was 14% and automation was up 13%.
• Consulting revenue in the quarter was $5.2 billion, down 0.5%.
• Infrastructure revenue in the third quarter fell 7% from a year ago to $3 billion. IBM Z revenue was down 19%.

ServiceNow posts strong Q3, launches Workflow Data Fabric, expands partnerships, hires Zavery as product chief

Larry Dignan

Editor in Chief of Constellation Insights
Constellation Research

Larry Dignan is Editor in Chief of Constellation Insights at Constellation Research, where he leads editorial coverage focused on enterprise technology, digital transformation, and emerging trends shaping the future of business. He oversees research-driven news, analysis, interviews, and event coverage designed to help technology buyers and vendors navigate complex markets with clarity and context. ...

Read more

ServiceNow reported better-than-expected third quarter results, launched Workflow Data Fabric, outlined partnerships with Rimini Street and Cognizant and said it will step up agentic AI efforts with Nvidia. For good measure, ServiceNow also said Google Cloud executive Amit Zavery will be the company’s new president, chief product officer and chief operating officer.

The moves come as ServiceNow delivered strong subscription growth of 22.5% in the third quarter compared to a year ago. The company inked 15 deals worth more than $5 million in annual contract value and more than 2,020 customers with more than $1 million in ACV.

For the third quarter, ServiceNow reported net income of $432 million, or $2.07 a share, on revenue of $2.8 billion. Non-GAAP earnings for the quarter were $3.72 a share. Wall Street was expecting ServiceNow to report earnings of $3.45 a share on revenue of $2.75 billion.

As for the outlook, ServiceNow projected subscription revenue of $2.875 billion to $2.88 billion.

With Now Assist AI as its fastest growing product, ServiceNow is looking to press an advantage as a platform that enables agentic AI by connecting multiple systems and the data, workflows and processes in enterprises. ServiceNow CFO Gina Mastantuono said demand for the Now Platform was “robust” and Now Assist was “already delivering fantastic results.”

ServiceNow's Xanadu release adds AI Agents, RaptorDB Pro, genAI enhancements

The hire of Zavery is also a big move. CEO Bill McDermott said the addition of Zavery gives ServiceNow a “visionary product and engineering leader with a proven history of building market defining products and scaling world class platforms.”

Zavery's most recent gig was VP, GM and Head of Platform from Google Cloud. Zavery previously was an executive at Oracle. 

In an SEC filing, ServiceNow detailed Zavery's pay package. A few nuggets worth noting:

• The base salary is $900,000. 
• Zavery's signing bonus was $3 million. 
• To replace Zavery's outstanding equity grant from Alphabet (Google Cloud's parent), ServiceNow said Zavery was eligble to receive an equity grant of $29 million. 

Zavery will take on his role as ServiceNow is already furiously building on its agentic AI plans:

• ServiceNow launched Workflow Data Fabric, a data layer that operates across enterprise systems, and a partnership with Cognizant.
• ServiceNow and Nvidia expanded a partnership to co-develop AI agents based on Nvidia NIM Blueprints.
• ServiceNow and Rimini Street outlined a partnership to put the Now Platform on top of legacy ERP systems, support them and take the savings to invest in AI innovation.

Speaking on ServiceNow's third quarter earnings call, McDermott said the company is more strategic with generative AI and agentic AI. "The C-suite is looking to us to prevent a mess with AI," said McDermott. "Leaders see the risk that every vendor's bots and agents will scatter like hornets fleeing the nest. Enterprises trust us to be the governance control tower."

McDermott said the company is now using its platform to deploy autonomous agents at scale. "We intend to be the control point that governs the deployment of agentic AI across the enterprise," he said. 

Here's a look at what was announced:

Workflow Data Fabric, Cognizant pact

ServiceNow launched Workflow Data Fabric, which is based on the Now Platform and RaptorDB Pro database. Workflow Data Fabric is available now.

The data layer features Zero Copy connections to integrate data from multiple sources to be used by AI agents. Cognizant will be the first partner for Workflow Data Fabric.

With the move, ServiceNow is adding a data integration layer to connect systems and workflows. Enterprise software vendors are increasingly adding these data layers.

Workflow Data Fabric is designed to connect, understand and process structured and unstructured streaming data across ServiceNow and third-party platforms. ServiceNow's plan is to use Workflow Data Fabric to read data and act.

Key points include:

• Workflow Data Fabric is powered by ServiceNow's Automation Engine, which includes data streaming, robotics process automation and process mining.
• The recent acquisition of Raytion is integrated with more than 500 connectors.
• ServiceNow said the launch of Workflow Data Fabric includes Zero Copy partnerships with Databricks and Snowflake and other data platforms.
• Workflow Data Fabric streamlines notifications and assigns incidents and includes ServiceNow's Knowledge Graph. The idea is that this graph can add context so AI agents can carry out tasks.

Nvidia NIM Agent Blueprints

ServiceNow and Nvidia said the companies will co-develop native AI agents based on Nvidia's NIM Agent Blueprints.

The two companies said they will develop multiple AI agent use cases for the Now Platform. These AI agents would leverage Nvidia AI Enterprise, NeMo and NIM microservices.

• Nvidia launches NIM Agent Blueprint for cybersecurity
• Accenture to use Nvidia stack for agentic AI
• Nvidia launches NIM Agent Blueprints aims for more turnkey genAI use cases

ServiceNow and Nvidia have been partners for years. Nvidia is looking to broaden its AI agent frameworks to speed up generative AI deployments.

According to the companies, the plan is to expand out-of-the-box AI agents starting with cybersecurity. ServiceNow and Nvidia said they will develop Vulnerability Analysis for Container Security AI Agent.

These turnkey AI agents will be activated through ServiceNow AI Agent Studio, which is expected to be available in 2025.

Rimini Street pact

ServiceNow said it will partner with Rimini Street to offer enterprise resource planning (ERP) support to milk legacy systems without migrations and re-platforming so enterprises can invest elsewhere.

• DSAG: SAP's innovation focus on cloud, discriminates against on-premise users
• SAP ups 2024 outlook as Q3 better than expected

Constellation Research CEO Ray Wang said the ServiceNow-Rimini Street partnership can give enterprises some breathing room since many are being prodded to upgrade to cloud-based foundations. "It is imperative that enterprises accelerate AI innovation, digital transformation and workflow automation without being slowed by the complexity and cost burden of upgrading or migrating existing enterprise software," said Wang.

The companies said they will offer a new enterprise software model that includes:

• ServiceNow's AI platform to provide a layer on top of existing ERP systems. Rimini Street will design, deploy and manage the Now Platform on top of ERP systems with a certified ServiceNow team. Savings will fund AI investments.
• Rimini Support will replace software vendor maintenance with no required upgrades or migrations for a minimum of 15 years.
• Rimini Manage that will run the day-to-day software operating and support tasks of legacy ERP systems.

For Rimini Street, the ServiceNow pact will help with the company's own transformation as it winds down Oracle Peoplesoft support to focus on VMware maintenance and other initiatives.

Anthropic's Claude 3.5 Sonnet model can use your computer

Larry Dignan

Editor in Chief of Constellation Insights
Constellation Research

Larry Dignan is Editor in Chief of Constellation Insights at Constellation Research, where he leads editorial coverage focused on enterprise technology, digital transformation, and emerging trends shaping the future of business. He oversees research-driven news, analysis, interviews, and event coverage designed to help technology buyers and vendors navigate complex markets with clarity and context. ...

Read more

Anthropic upgraded Claude 3.5 Sonnet with the ability to use your computer, looking at your screen, moving cursors, clicking and typing. The company also launched Claude 3.5 Haiku.

As large language model (LLM) vendors keep upping the training ante, Anthropic continues to think through features for collaboration and now computer use.

• Anthropic launches Claude Enterprise with 500K context window, GitHub integration, enterprise security
• Anthropic adds more collaboration features to Claude for Pro, Team customers
• Anthropic launches Claude 3.5 Sonnet, Artifacts as a way to collaborate
• Anthropic launches Claude Team plan, iOS app
• Anthropic CEO Amodei on where LLMs are headed, enterprise use cases, scaling

The company said computer use on Claude 3.5 Sonnet is available in public beta via API. Developers will be able to direct Claude to use computers and take on some of the tedious work of filling out forms and combing through files. Claude 3.5 Sonnet will be able to use any application on your computer.

Anthropic noted that computer use is still experimental and error prone, but expects rapid improvements. Asana, Canva, Cognition, DoorDash, Replit, and The Browser Company are among the companies using Claude 3.5 Sonnet and computer use. The new model is available via Anthropic, Amazon Bedrock and Google Cloud Vertex AI.

In a blog post, Anthropic outlined some of the research that went into Claude 3.5 Sonnet's computer use features. Among the takeaways:

• Claude looks at screenshots of what's visible to the user, then counts how many pixels vertically or horizontally it needs to move a cursor to click correctly.
• Anthropic spent a lot of time training Claude to count pixels. Without this skill, the model struggles to give mouse commands.
• Claude was able to turn a user's written prompt into a sequence of steps and then take action.
• The company said Claude isn't anywhere near human-level skill on the computer, but expects the gap to close.

Anthropic also outlined safety concerns. The company said:

“As with any AI capability, there’s also the potential for users to intentionally misuse Claude’s computer skills. Our teams have developed classifiers and other methods to flag and mitigate these kinds of abuses.

While computer use is not sufficiently advanced or capable of operating at a scale that would present heightened risks relative to existing capabilities, we've put in place measures to monitor when Claude is asked to engage in election-related activity, as well as systems for nudging Claude away from activities like generating and posting content on social media, registering web domains, or interacting with government websites. We will continuously evaluate and iterate these safety measures to balance Claude's capabilities with responsible use during the public beta."

SAP ups 2024 outlook as Q3 better than expected

Larry Dignan

Editor in Chief of Constellation Insights
Constellation Research

Larry Dignan is Editor in Chief of Constellation Insights at Constellation Research, where he leads editorial coverage focused on enterprise technology, digital transformation, and emerging trends shaping the future of business. He oversees research-driven news, analysis, interviews, and event coverage designed to help technology buyers and vendors navigate complex markets with clarity and context. ...

Read more

SAP raised its cloud and software outlook for fiscal 2024 as the company's backlog continued to surge.

The company projected 2024 cloud and software revenue of €29.5 billion to €29.8 billion, up from the €29 billion to €29.5 billion previously projected. The company also said its free cash flow will be €3.5 billion to €4 billion.

SAP held its cloud 2024 revenue projection steady at €17.0 billion to €17.3 billion.

In the third quarter, SAP reported earnings of €1.44 billion, or €1.25 a share, on revenue of €8.47 billion, up 9% from a year ago. Cloud revenue was €4.35 billion, up 25% from a year ago. Cloud ERP revenue in the third quarter was €3.64 billion, up 34% from a year ago.

Wall Street was expecting SAP to report third quarter earnings of €1.21 a share on revenue of €8.45 billion.

• DSAG: SAP's innovation focus on cloud, discriminates against on-premise users
• SAP gives ABAP code a genAI boost, adds data lake capabilities to Datasphere
• SAP’s Joule everywhere plan: ‘We are not developing AI just for the sake of AI”

Christian Klein, CEO of SAP, said the third quarter showed strength for cloud ERP and "a significant part of our cloud deals in Q3 included AI use cases."

Speaking on SAP's earnings conference call, Klein talked up Joule and said it has the best chance to be a premier AI agent. 

"While many in the software industry talk about AI agents these days, I can assure you, Joule will be the champion of them all. So far, we have added over 500 skills to Joule and we are well on track to cover 80% of the most frequent business and analytical transactions by the end of this year. And in Q3 alone, several hundred customers licensed Joule."

Klein said that Joule's power will be the ability to perform tasks across finance, HR, sales, supply chain and other functions. "Joule will soon be able to orchestrate several AI agents to carry out complex processes end-to-end," he said. 

SAP CFO Dominik Asam said the company is seeing efficiency gains from its restructuring in 2024.

By the numbers:

• SAP's cloud backlog was up 25% in the third quarter compared to a year ago and the acquisition of WalkMe contributed 1% to that growth rate.
• Software licenses revenue in the third quarter fell 15% from a year ago.
• Restructuring expenses for the first nine months of 2024 were €2.8 billion.
• By region, SAP said it saw cloud revenue strength in Asia Pacific and Japan and EMEA. Americas growth was "robust."

Key points from SAP's earnings conference call include:

• Klein said about 30% of SAP's cloud orders included AI use cases. 
• SAP cited numerous RISE with SAP wins including grocers Schwarz Group and Sainsbury as well as Nvidia, which implemented RISE with SAP in 6 months, and Mercado Libre. 
• "Our investment in Business AI are also starting to show positive results, creating new opportunities and deepening customer engagement. Now with the added capabilities of WalkMe, we are able to further improve work flow execution and user experience," said Asam.
• Klein said that SAP's move to centralize its cloud operations is paying dividends. "We are rolling out the cloud version of HANA, much more scale, better TCO, better resiliency. And of course, we're also working with the hyperscalers. I mean, we have with RISE and on the cloud infrastructure, we have really some really strong measures we are driving to further optimize not only performance, but again, also the scalability of HANA Cloud running on the hyperscaler infrastructure," he said. 

Constellation Research's take

Constellation Research analyst Holger Mueller said:

"SAP had a good quarter, as expected. AI is the break Christian Klein and team as AI needs to live in the cloud, and that forces before skeptical CxOs to bite the bullet and move to S/4 HANA. SAP keeps struggling with the value for SAP Grow and Rise – as only 1/3 of cloud revenue comes from these initiatives, but this does not matter anymore as AI is the pull. With favorable announcements from the recent SAP TechED conferencebto help customers with the ABAP code assets as well as the announcement of an SAP DataLake, SAP is helping its existing customers more and better than before. All of this leads to a key milestone for the vendor: Cloud revenue for the first time is over 50% of SAP revenue. What is remarkable is that SAP is more profitable. Traditionally, the (now shrinking) perpetual license revenue is more profitable than cloud revenue (where SaaS vendors pay IaaS vendors). But with SAP charging more customers directly for their IaaS costs (and then paying the AWS, Google and Microsoft etc.), it is making margin from the pass through."

• SAP Q2 cloud ERP revenue up 33%, sees restructuring hitting 9,000 to 10,000 jobs
• Amazon Bedrock integrated into SAP AI Core, SAP to use AWS chips
• SAP acquires WalkMe for $1.5 billion
• Boomi aims to ease SAP Datasphere migrations

Honeywell, Google Cloud team up on industrial IoT, genAI use cases

Larry Dignan

Editor in Chief of Constellation Insights
Constellation Research

Larry Dignan is Editor in Chief of Constellation Insights at Constellation Research, where he leads editorial coverage focused on enterprise technology, digital transformation, and emerging trends shaping the future of business. He oversees research-driven news, analysis, interviews, and event coverage designed to help technology buyers and vendors navigate complex markets with clarity and context. ...

Read more

Honeywell said it will integrate Google Cloud's AI into Honeywell Forge, an Internet of things platform designed for industrial use cases.

The two companies said they will create joint applications for industrial use cases in 2025 that combine Google Cloud's Gemini on Vertex AI with Honeywell's applications.

For Google Cloud, the Honeywell partnership highlights how it is leveraging AI, use cases and a focus on verticals to enter accounts often via generative AI. Thomas Kurian, CEO of Google Cloud, has focused Vertex AI on industry use cases, automation and process optimization. Kurian has also touted AI agents.

• How Google Cloud is monetizing AI
• Google Cloud Vertex AI updates focus on the practical with Context Caching, grounding services
• Google Cloud Next 2024: Google Cloud aims to be data, AI platform of choice
• Google Cloud Next: The role of genAI agents, enterprise use cases
• Google Public Sector Summit: 9 takeaways you need to know
• Google I/O 2024: Multimodal Gemini, Project Astra, AI agents and 'teammates'

Specifically, Google Cloud and Honeywell will build industrial AI agents using Google Cloud Vertex AI Search and Gemini multimodal large language models. Use cases include:

• Industrial AI agents focused on automating project design cycles and preventative maintenance.
• Cybersecurity applications that couple Google Threat Intelligence with Honeywell's Global Analysis, Research and Defense Threat Intelligence and Secure Media Exchange.
• Edge device AI that will put Google's Gemini Nano model on Honeywell edge devices across multiple industries. The two companies said they plan to offer a series of edge devices.

Honeywell has aligned its business around three big trends--automation, future of aviation and energy transfer. All those industries are ripe for AI optimization.