Results

Event Report: Teradata Possible LA | With Constellation Analyst Doug Henschen

Event Report: Teradata Possible LA | With Constellation Analyst Doug Henschen

 

During its October event - Teradata Possible LA - Teradata announced BYO-LLM and GPU acceleration options, giving customers flexibility for #generativeAI #innovation.

Hear from Doug Henschen, VP & Principal Analyst at Constellation Research, as he gives an in-depth report LIVE from the event and unpacks the implications of Teradata's big announcements.

On <iframe width="560" height="315" src="https://www.youtube.com/embed/APtQbN9FZfw?si=Or6lEz3bh2_vEJOQ" title="YouTube video player" frameborder="0" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share" referrerpolicy="strict-origin-when-cross-origin" allowfullscreen></iframe>

Dell lays out AMD genAI systems, services

Dell lays out AMD genAI systems, services

Dell Technologies launched new systems powered by AMD's next-generation EPYC server processors and PowerEdge XC9680 system powered by AMD Instinct MI300 and 300x AI accelerators. Dell is also surrounding those AMD powered AI systems with services and the chipmaker's software stack.

With the moves, Dell is basically providing AMD AI factory building blocks along with its Nvidia systems. Dell, HPE and SuperMicro are all benefiting from AI system demand and looking to differentiate on energy consumption, cooling and overall efficiency. AMD launched its next-generation EPYC and Instinct processors at its AI event. 

"We're trying to make sure that customers are able to take advantage of the most common AI toolsets and software that they'll use for their AI workloads," said Varun Chhabra, senior vice president of Dell's ISG and Telecom unit. He added that Dell and AMD have already tested and validated the new genAI systems to cut the time to value.

Chhabra said Dell is also surrounding those AMD systems with services to implement them. Dell is also expanding its Hugging Face partnership, which gives enterprises model choices for on-premises deployments, to AMD systems.

Here's a breakdown of Dell's AMD AI announcements.

  • Dell PowerEdge R6715 and R7715 servers with AMD 5th gen EPYC processors. A new chassis design provides enhanced air cooling for 50% more cores (192 cores/CPU) with dual 500W CPUs. Dell also added larger storage configurations and enhanced heat sinks. The company said the new systems provide a 7:1 consolidation ratio from the previous generation systems and up to 65% lower CPU energy cost.

  • Dell PowerEdge XE7745. These enterprise AI systems provide more GPU density in an air-cooled 4U chassis. The system adds twice the PCIe GPU capacity with options for a diverse set of AI accelerators and optimized cooling for up to 600W GPUs.
  • Dell Generative AI AMD systems. Dell said it will package AMD's AI accelerators with its ROCm and Omnia software as well as standards-based AI and machine learning frameworks. This stack will include the PowerEdge XE9680 with AMD MI300x GPUs and services.

Data to Decisions Tech Optimization Digital Safety, Privacy & Cybersecurity Innovation & Product-led Growth Future of Work Next-Generation Customer Experience dell SaaS PaaS IaaS Cloud Digital Transformation Disruptive Technology Enterprise IT Enterprise Acceleration Enterprise Software Next Gen Apps IoT Blockchain CRM ERP CCaaS UCaaS Collaboration Enterprise Service Big Data AI GenerativeAI ML Machine Learning LLMs Agentic AI Analytics Automation Chief Information Officer Chief Technology Officer Chief Information Security Officer Chief Data Officer Chief Executive Officer Chief AI Officer Chief Analytics Officer Chief Product Officer

AMD launches next-gen Instinct AI accelerators, 5th gen EPYC as it fortifies position as Nvidia counterweight

AMD launches next-gen Instinct AI accelerators, 5th gen EPYC as it fortifies position as Nvidia counterweight

AMD launched its 5th Gen EPYC processor as well as its latest Instinct MI325X accelerators as it aims to gain AI workloads from inference to model training. The big takeaway is that AMD is well equipped to give Nvidia competition for AI workloads. 

The chipmaker said its MI325X platform will begin production in the fourth quarter with favorable performance vs. Nvidia's H200 GPUs. AMD also outlined its annual cadence as well as the roadmap head into 2025.

Lisa Su, CEO of AMD, gave a closely watched keynote at its Advancing AI 2024 event. The launch of AMD's new enterprise CPUs and GPUs are critical given the chipmaker is the best positioned to compete with Nvidia, which has dominated AI infrastructure. Su said that the data center AI accelerator market can hit $500 billion by 2028. "The data center and AI represent significant growth opportunities for AMD, and we are building strong momentum for our EPYC and AMD Instinct processors across a growing set of customers," she said. 

AMD Instinct MI325X and what's ahead

Su said the next-gen Instinct GPU will have 256GB HBM3I, 6TB/s and better performance overall compared to the previous MI300.

AMD added that the MI325X platform outperforms Nvidia H200 HGX for Meta Llama inference workloads and matches it for 8GPU training.

Su also said that its AMD Instinct MI355X Accelerator is in preview for launch in the first half of 2025.

For AMD, the game is getting its GPUs in the hyperscale clouds--Google Cloud, Microsoft Azure and Oracle were on stage with Su live or by video--as well as with key infrastructure providers such as Dell Technologies, HPE and SuperMicro. These infrastructure providers are creating data center designs that can accommodate AMD and Nvidia with future proofed infrastructure. AMD also highlighted partners such as Databricks.

Making the EPYC case for the enterprise

Su's keynote focused on a key theme for the 5th Gen EPYC processor in the data center: Enterprise returns due to lower total cost of ownership as well as taking on inference workloads.

The latest EPYC server processor is billed as the best CPU for cloud, enterprise and AI workloads. The processor, formerly code-named Turin, has 150 billion transistors, up to 192 cores and up to 5GHz built on 3nm and 4nm technology.

For the enterprise, Su said the latest EPYC has up to 1.6x performance per core in virtualized infrastructure and up to 4x throughput performance for open-source databases and video transcoding.

As for inference workloads, Su said the latest EPYC processor has up to 3.8x the AI performance for machine learning and end-to-end AI.

The broader portfolio

  • Although Instinct and EPYC were the headliners, AMD had a bevy of other offerings to round out its AI portfolio. Here's a look:
  • AMD's CDNA Next architecture will be available in 2026. AMD also touted its AMD ROCm software stack. 
  • AMD also expanded its DPU processor lineup with AMD  Pensando Salina DPU and AMD Pensando Pollara 400, the first Ultra Ethernet Consortium ready NIC.
  • AMD launched AMD Ryzen AI PRO 300 Series processors, powering Microsoft Copilot+ laptops.
     

Data to Decisions Tech Optimization Innovation & Product-led Growth Future of Work Next-Generation Customer Experience Digital Safety, Privacy & Cybersecurity AMD Big Data AI GenerativeAI ML Machine Learning LLMs Agentic AI Analytics Automation Disruptive Technology Chief Information Officer Chief Technology Officer Chief Information Security Officer Chief Data Officer Chief Executive Officer Chief AI Officer Chief Analytics Officer Chief Product Officer

How Climate Tech and AI can Address Environmental Challenges | CR Sustainability Convos

How Climate Tech and AI can Address Environmental Challenges | CR Sustainability Convos

During #ClimateWeekNYC, Constellation Research, founder R "Ray" Wang had an engaging conversation with Sol Salinas, EVP, and Sustainability Lead for Capgemini Americas on the role of #sustainability, climate #tech, and #AI in addressing environmental challenges.

The discussion explored:

📌 Capgemini's significant partner ecosystem that supports clients in their sustainability efforts.
📌 The increasing commitment and investment in sustainability by organizations globally.
📌 The focus on circularity, waste reduction, and #technologies like small modular nuclear reactors and AI to drive sustainability.
📌 The importance of regulation, transparency, and overcoming greenwashing concerns around sustainability claims.

Watch the full interview to learn more about leveraging strategy, technology, and partnerships to advance sustainability goals.

On CR Conversations <iframe width="560" height="315" src="https://www.youtube.com/embed/BxvdD5WUcfo?si=aHhtj97JB84P5iiD" title="YouTube video player" frameborder="0" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share" referrerpolicy="strict-origin-when-cross-origin" allowfullscreen></iframe>

How Seattle Seahawks are approaching genAI, model choices with AWS

How Seattle Seahawks are approaching genAI, model choices with AWS


The Seattle Seahawks are using Amazon Bedrock, generative AI and other AWS services to distribute video and content faster with a focus on quick returns as well as long-tail opportunities. Here's a look at the project and lessons learned so far.

The generative AI project, which started with this season, is part of a multi-year extension between the Seahawks and AWS, the team's official cloud, machine, AI and generative AI provider. Under the deal, the Seahawks are automating content distribution as well as transcribing, summarizing and distributing press conferences across multiple channels and languages.

AWS and the Seahawks will also integrate generative AI throughout business operations. The Seahawks and AWS first partnered in 2019 on NFL Next Gen Stats, insights on player health, performance and scouting. Lumen Field, home of the Seahawks, is also a showcase for Amazon's Just Walk Out technology.

I caught up with Kenton Olson, Seattle Seahawks Vice President of Digital & Emerging Media, to walk through the generative AI content project and what's next.

The project. Olson said the Seahawks will publish more than 1,000 videos throughout the year. The goal was to speed up the time it takes to get videos from the creation team and editors to production. After the 2023 season, the Seahawks looked to accelerate the process with Olson's content team of 11, which focuses on digital content and platforms.

"We use multiple AWS products for everything from encoding and transcribing video to hosting," said Olson. "We were excited to use Amazon Bedrock to provide some automation to the videos we're shooting to save time and get stuff out faster."

For now, the Seahawks are focused on media availability of videos and press conferences. The Seahawks will do about 300 press conferences throughout the year with plays and coaches.

In the future, Olson said generative AI will provide an assist for podcasting and entire video workflow. "As we move forward, we'll train the AI and make sure we tune it because every video is a little bit different," said Olson. "We started with press conferences and are learning."

    The process before and after. Olson said the previous process took about 45 minutes to an hour to create a video to publishing and streaming to various channels. The video processing and publishing process had 60 steps. "We're now in a situation where once the video is submitted it's published in about 10 minutes in a worst-case scenario," said Olson. "That includes things like translating and providing a summary that would have taken us hours before."

    Returns on investment. Olson said the initial return is time saved that frees his team up to think of new types of content to create. "We'd like our people thinking of new types of content not necessarily pushing buttons to publish something," said Olson.

    By the end of the season, Olson expects save hours "so that our content creators can focus on creating other things for our fans and exposing that content."

    Another early return is that the Seahawks can provide more in-depth information with generative AI summaries that can give fans more opportunities to discover content in unique ways. "We're also excited to see how our search engine referrals and various components are improved by providing more rich metadata," said Olson.

    Longer term, Olson said generative AI can boost the returns of the Seahawks video archive, which will be critical since the franchise will soon enter its 50th season. Olson said:

    "We have done a good amount of work over the past couple of years to take old Betamax tapes off the shelf and digitize those. We don't have a lot of real good data on all those, and so we're working with AWS right now to figure out how to process them and get a lot more data about who's in the video and what did they talked about. In the future, we could say here's a Jim Zorn video of him talking about something and do it within seconds. Today that would be a lot of manual scrubbing. As we move forward, there will be opportunities to talk about our history."

    More from the genAI field:

    Model choices. Olson said the plan from the beginning was to test multiple models and analyze them based on quality of output without human intervention. The Seahawks have already swapped a few models based on use cases. Olson noted that his team has swapped models out as the company moved from pilot to production. "It definitely took us some tinkering to understand what model makes sense and which doesn't. The tremendous thing about Bedrock is that we can use many different models," he said. "When we built this process, we knew these models are all changing. The model we're using now is really great, but for all we know there's some model in six or seven months that we'll want to move to."

    Humans in the loop. Olson said the primary goal of the genAI project was to focus his team on more content and new ideas. The process for the video team is to bookend video production with human oversight. At the end of the process, humans make the quality checks and decide to publish, but the models have gotten to the point where "we're hitting publish more than having to make edits," said Olson.

    Olson's team also had to give models unique spellings of names as well as new players as roster changes are daily and weekly. "We really work on ingesting our roster before every video to make sure the latest players are there," he said. Today, the models get an update every time there's a roster change.

    What's more intriguing to Olson is the human input at the front end of the process. He said that generative AI speeds up ideation and allows creators to try new things in seconds and iterate from there.

    The project timeline. Olson said the Seahawks started on the genAI project in the late spring with building components. By time, the season started the Seahawks were ready to go. "It took us about two months of adding pieces and iterating to make sure we could move forward," said Olson. "It was more about adjusting the model to fit our needs and making sure we use it in the correct way."

    Data to Decisions Future of Work Marketing Transformation Next-Generation Customer Experience New C-Suite Innovation & Product-led Growth Tech Optimization Digital Safety, Privacy & Cybersecurity AI GenerativeAI ML Machine Learning LLMs Agentic AI Analytics Automation Disruptive Technology Chief Information Officer Chief Executive Officer Chief Technology Officer Chief AI Officer Chief Data Officer Chief Analytics Officer Chief Information Security Officer Chief Product Officer

    OpenAI, AI Sustainability, CX Optimization | ConstellationTV Episode 90

    OpenAI, AI Sustainability, CX Optimization | ConstellationTV Episode 90

    We made it to ConstellationTV episode 90! 📺 Hear co-hosts Holger Mueller and Liz Miller discuss enterprise technology news, including AI Forum highlights, AI integration in workforce management, and the impact of OpenAI's recent funding and future innovation.

    Then R "Ray" Wang has an engaging conversation with Sol Salinas, EVP, and Sustainability Lead for Capgemini Americas on the role of sustainability, climate tech, and AI in addressing environmental challenges.

    The episode concludes with a CR CX Convo with leaders from The Scotts Miracle-Gro Company on the importance of empathy in customer experience.

    00:00 - Meet the hosts
    01:24 - Enterprise tech news updates (AIF 2024, workforce management AI, OpenAI)
    17:11 - Sustainability and AI with Capgemini's Sol Salinas
    29:40 - CR CX Convo: Tests CX to Optimize for Extraordinary Growth
    42:13 - Bloopers!

    ConstellationTV is a bi-weekly Web series hosted by Constellation analysts, tune in live at 9:00 a.m. PT/ 12:00 p.m. ET every other Wednesday!

    On ConstellationTV <iframe width="560" height="315" src="https://www.youtube.com/embed/1qA-GqW07bw?si=MPt_C27lsaw_Tigp" title="YouTube video player" frameborder="0" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share" referrerpolicy="strict-origin-when-cross-origin" allowfullscreen></iframe>

    How Seattle Seahawks are approaching genAI, model choices with AWS | Constellation Insights Interview

    How Seattle Seahawks are approaching genAI, model choices with AWS | Constellation Insights Interview

    The Seattle Seahawks are revolutionizing their video content distribution with the help of #AWS and #generativeAI. In a recent interview, Kenton Olson, VP of Digital and Emerging Media for the Seahawks, shared insights into their innovative project with Larry Dignan, Editor in Chief of Constellation Insights

    A few highlights include...

    📌 The team produces over 1,000 videos per year, creating a time-consuming distribution challenge. By integrating AWS services like Media Convert, Transcribe, and Bedrock, they've reduced publishing time from 30-45 minutes to just 10 minutes.
    📌 Generative AI allows the Seahawks to automatically generate video summaries, translations, and metadata - saving their content team valuable time to focus on creating new, engaging content.
    📌 The AI-powered system has improved the searchability and fan discoverability of Seahawks videos by providing richer metadata. This enhances the team's ability to reach and connect with their passionate fanbase.
    📌 The flexibility of AWS Bedrock enables the Seahawks to easily test and swap AI models, ensuring they can adapt to the latest advancements in generative AI technology.

    This example showcases how sports organizations can leverage the power of #cloud and #AI to streamline operations, enhance fan engagement, and unlock new content opportunities. The Seahawks are leading the way in transforming the digital fan experience. #AWS #AI #SportsTech #SeattleSeahawks #DigitalTransformation

    On Insights <iframe width="560" height="315" src="https://www.youtube.com/embed/z4b_JPK-K_k?si=LoRcqsXxNPKmBKXm" title="YouTube video player" frameborder="0" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share" referrerpolicy="strict-origin-when-cross-origin" allowfullscreen></iframe>

    Zoom launches AI Companion 2.0, eyes enterprise, industry expansion

    Zoom launches AI Companion 2.0, eyes enterprise, industry expansion

    Zoom outlined its roadmap and upcoming products that include AI Companion 2.0 across its platform, a focus on work management for frontline workers and a deeper dive into contact center, education and healthcare markets.

    In a briefing, Smita Hashim, Chief Product Officer at Zoom, said the company's AI Companion effort initially revolved around the theme of meet happy by adding tools for engagement, becoming more productive and collaboration. With AI Companion 2.0, Zoom is expanding its view more toward work happy.

    "We have expanded our vision to work happy. And what work happy really means for us from our perspective is helping our customers and users have the time to really be what is uniquely human to them," said Hashim, who noted that AI Companion is now activated on more than 4 million accounts and 57% of the Fortune 500. "AI Companion is going to be your personal assistant that can work across Zoom Workplace."

    This vision will be outlined at the company's Zoomtopia conference, which will feature CEO Eric Yuan's keynote as well as customer sessions. The upshot with Zoom's product launches and roadmap, which lands in the fourth quarter of 2024 and extends into 2025, is that the company is gunning for Microsoft Teams. The challenge for Zoom will be overcoming AI assistant fatigue--every enterprise application has one--and breaking through the Microsoft Bundle.

    Hashim noted that AI agent, companion, copilot fatigue directly.

    "Sprawl is a challenge for our users and frankly some of the implementations are confusing. Why do I need an agent just for SharePoint? I don't want hundreds and thousands of agents running around in my user interface. With AI Companion 2.0 we see it as a super-agent that will have skills to connect to Workday, Jira and various workflows to help you get more done."

    Constellation Research analyst Holger Mueller said:

    "Zoom has made massive progress in the last year to position itself beyond just synchronous communication, making it more and more an alternative to the omnipresent Teams. The question will be – can Zoom overcome the power of the Microsoft enterprise agreement with innovation? It certainly has some key capabilities here, especially on the AI side – where it makes AI insights and automation easier accessible than other products, as well as offering a single AI assistant with Zoom AI Companion. On the new offering side, the Frontline Worker offering has a lot of potential, Zoom got the capability mix right, now it has to get the price point right. Overall Zoom has the ability to change the future of work – again."

    Zoom's announcements at Zoomtopia include:

    Zoom AI Companion 2.0, available October 2025. Zoom AI Companion 2.0 works across the Zoom Workplace platform adds context, synthesizes data from meetings, chats and docs as well as Microsoft Outlook, Office, Gmail and other applications, and can take action.

    • Takeaway: AI Companion 2.0 is Zoom's horizontal AI and agent play. By connecting to other enterprise data repositories Zoom is betting that it can be the lead AI collaboration tool. The fact that Zoom doesn't charge extra for AI Companion is a big selling point for adoption.

    Custom AI Companion add-on for Zoom Workplace, which enables enterprises to customize AI Companion and connect it to business apps and data sets. This customization ability is expected in the first half of 2025 at $12 per user per month. AI Companion is typically included in Zoom Workspace without an add-on fee.

    • Takeaway: Hashim said the ability to customize was one of the big customer requests. The move to personalize AI Companion is a natural progression. "Our customers and their organizations are unique. They work across different applications, different data sources. Their employees are unique. They have different goals, they have different ambitions and customers have been asking us how AI companion could expand to address all of those needs," she said.

    Zoom AI Studio, which will customize AI Companion with connectors to knowledge bases, fine tuning and AI skills.

    • Takeaway: Custom AI Companion add-on and AI Studio will enable AI Companion to move across workflow applications and take actions. This ability will also enable Zoom to provide personal employee coaching and avatars.

    Zoom Tasks, which will use AI Companion to detect tasks across Workplace and sync updates.

    AI Companion for Workvivo for employee engagement as well as a listening suite to gauge employee sentiment. Will Meta's Workplace shutdown be a boon for Zoom's Workvivo?

    Contact center enhancements such as dynamic agent guides, suggested answer and supervisor tools.

    Industry enhancements with AI Companion for Educators including lesson plans, Zoom for Healthcare including Zoom Workplace for Clinicians, and Zoom Workplace for Frontline, which is aimed at workers in the field. Frontline workers were a big focus for Facebook Workspace, which is winding down and moving customers to Zoom Workvivo.

    • Takeaway: Zoom's education efforts are notable since they alleviate hybrid learning pain points and connectors to Canvas and other common education applications are a win. In addition, Zoom Workspace Clinicians is a nice way to leverage the platform overall. Zoom's focus on healthcare looks to build its 36% telemedicine market share. Zoom said more than 140,000 healthcare institutions use Zoom. Zoom Workplace for Frontline is also an area with a lot of white space for the company.

    Data to Decisions Future of Work Innovation & Product-led Growth Next-Generation Customer Experience New C-Suite Marketing Transformation I am Team Leader at the Nominee Organization (no vendor self nominations) Distillation Aftershots Tech Optimization Digital Safety, Privacy & Cybersecurity zoom AI GenerativeAI ML Machine Learning LLMs Agentic AI Analytics Automation Disruptive Technology Chief Information Officer Chief Executive Officer Chief Technology Officer Chief AI Officer Chief Data Officer Chief Analytics Officer Chief Information Security Officer Chief Product Officer

    Atlassian Rovo AI additions go GA with consumption pricing on deck

    Atlassian Rovo AI additions go GA with consumption pricing on deck

    Atlassian said its latest AI features and Rovo, a generative AI assistant that operates across the company's platform, are generally available across the company's products. Atlassian also introduced Rovo Agents.

    The company said it will offer Rovo for annual subscriptions at $20 per user per month, monthly at $24 per user a month and consumption pricing in mid-2025. Licensing plans will be based on Rovo use per site where any users with access to the site is a billable user. Enterprises would only pay once per billable user.

    Enterprise software vendors have been tweaking monetization models as some vendors focus on consumption or even conversations with an AI agent.

    In May, Atlassian launched Rovo with the following core components:

    • Rovo Search, which will comb through content wherever it is stored (Google Drive, Microsoft SharePoint, GitHub, Slack etc.), and query across applications. Rovo Search will identify team players, projects and information needed to make decisions. Rovo Search will connect niche and custom apps via API and have enterprise-grade governance to data governance.
    • Insights, which are delivered via knowledge cards that offer context about projects, goals and teammates.
    • Rovo Chat, a conversational bot that is built on company data and learns as it goes.

    In a briefing, Jamil Valliani, Head of Product AI at Atlassian, cited early customers who have boosted efficiency by about 25% using Rovo with their development teams. Rovo beta testers said they've saved 1 hour to 2 hours of time saved per week.

    Atlassian is connecting Rovo Search via connectors and connecting that data to Rovo Chat and throughout the platform.

    The company also outlined Rovo Agents, which operate out-of-the-ox from Atlassian's marketplace partners. Atlassian is providing more than 20 out-of-the-box agents and tools to build your own Rovo Agents with low and no code tools.

    According to Atlassian, Rovo Agents can speed up the development process by automatically generating code plans, code recommendations and pull requests based on task descriptions, requirements and context.

    Other updates for Atlassian Intelligence include:

    • Jira Service Management will use AI to group related alerts and surface critical incidents, suggest right resources and subject matter experts. The AIOps capabilities also capture incident timelines, generate post-incident reviews and summarize details.
    • Jira Service Management virtual service agent will automate support across multiple platforms and add new onboarding and automation enhancements.
    • Loom will get AI-powered automated workflows via integrations with Jira and Confluence.

    Atlassian's AI additions will be critical to the company's future growth. In August, Atlassian projected first quarter revenue of $1.149 billion to $1.157 billion, below the consensus estimate of $1.16 billion. For fiscal 2025, Atlassian projected revenue growth of about 16%, below the 18% expected by Wall Street.

    The company at the time cited uncertain macroeconomic conditions and an evolving go-to-market strategy.

    Speaking at an investment conference, Atlassian Chief Operating Officer Anu Bharadwaj said early adoption of Atlassian Intelligence and Rovo has been strong.

    "Thousands of customers have adopted Atlassian intelligence already so far, and I'm very pleased with the repeated usage that it gets because one of the interesting things about AI is where are the use cases where you can unlock tangible productivity benefits. I think it is still early innings, so I’m very much looking forward to seeing how that plays out."

    Regarding pricing, Bharadwaj said Atlassian has raised prices for its cloud products over time as it has added AI, automation and new features. "The price increases are very much in tune with the amount of customer value that we are able to deliver," he said. "In terms of seat-based versus not, I do think that there is an interesting exploration there around consumption-based pricing, which we will really think through, especially in an AI world, where we talk about virtual agents, which will be different than a seat-based model."

    Data to Decisions Future of Work Innovation & Product-led Growth Tech Optimization Next-Generation Customer Experience Digital Safety, Privacy & Cybersecurity AI GenerativeAI ML Machine Learning LLMs Agentic AI Analytics Automation Disruptive Technology Chief Information Officer Chief Executive Officer Chief Technology Officer Chief AI Officer Chief Data Officer Chief Analytics Officer Chief Information Security Officer Chief Product Officer

    How GE Healthcare is approaching generative AI, LLMs, and transformation

    How GE Healthcare is approaching generative AI, LLMs, and transformation

    GE Healthcare has been working on machine learning, deep learning and artificial intelligence for years, but now the company sees an inflection point where generative AI can transform healthcare from products to workflow to efficiencies that improve the customer experience.

    Parminder Bhatia, Chief AI Officer of GE Healthcare, said the emergence of multimodal large language models (LLMs) can uniquely improve healthcare, which is built on everything from different modalities, imaging data, clinical notes, voice interaction, electronic health records and other data.

    Before GE Healthcare, Bhatia oversaw generative AI and large language models at Amazon Web Services. His group worked on Amazon Q and Amazon Bedrock. GE Healthcare and AWS recently announced a partnership to transform healthcare with a focus on purpose-built generative AI models using services such as Bedrock.

    We caught up with Bhatia, an AI 150 inductee, at Constellation Research's AI Forum in New York to talk shop. Here's a look at the takeaways.

    GE Healthcare's approach to AI. Bhatia has been in his current role for about 18 months overseeing the strategy and vision for AI at GE Healthcare. For GE Healthcare, the AI strategy revolves around the AI going into the MRI, CT and X-ray machines as well as digital platforms that focus on clinical and operational efficiencies across a hospital.

    "There's a lot of focus on how we build these technologies that can really streamline workflow," said Bhatia. For instance, AI in an MRI machine that can reduce scan time by 50% with the same quality doubles the efficiency and productivity of the workforce.

    Other examples of AI's role at GE Healthcare include AI in ultrasound equipment that can act as a copilot, remote scans and imaging and technologies that "improve the efficiencies and accelerate getting better diagnosis, solving problems in treatment and cancer areas as well," said Bhatia.

    GE Healthcare has been a pioneer within machine learning and deep learning for more than a decade and has the highest number of FDA approved app authorizations three years in a row.

    Why generative AI and healthcare go together. Bhatia said LLMs have been all the talk, but the excitement around them is that they are multimodal. That ability to be multimodal means they apply well to healthcare.

    He said:

    "These technologies are truly multimodal in nature and that means they're more tailored for healthcare, which consists of data coming from different modalities, imaging data, clinical notes, voice interaction, your EHRs and other data. As these technologies were being built out it made sense for me to get back into healthcare. It's the perfect opportunity to apply these applications."

    Patient experience and AI. Bhatia said AI will ultimately have an impact on the patient experience as workflows and staffing levels are improved for diagnosis to screening to treatment and therapy. GE Healthcare Command Center is using AI to streamline hospital operations, manage staffing and send triggers for actions. While many of those technologies don't affect the patient directly, the patient experience is improved with capacity planning.

    "These technologies streamline operations and that becomes relevant across a spectrum of things," said Bhatia. "Patient guidance will also be key as we take care from inside the hospital to outside with patient monitoring and virtual care at home."

    These hospital workflows will give a longitudinal patient view across care that improves experiences, he said.

    Indeed, GE Healthcare recently acquired MIM Software, a company that manages workflows from diagnosis to treatment and therapy. A few recent developments with MIM include:

    Personalization of care. Bhatia said AI will also play a big role in personalized treatment for cancer that deliver targeted radiation to kill cells.

    "In the next three to five years, you're going to have thousands of variations in which these different radiopharmaceutical drugs can be given to the individual patients," he said. "MIM Software is designed to address the complexities that happen across the system, where it provides solutions to navigate the expanding landscape of personalized treatment."

    Bhatia added:

    "A lot of these things are starting with operational efficiency, but also combining multimodal data. I think that's where AI is becoming a key enabler, not just at the diagnosis level, but health clinicians can streamline the longitudinal view of the patient's data, which is truly multimodal. That technology and data can really streamline the operations, which has impact on better therapy and more personalized therapy for patients as well."

    GE Healthcare's approach to AI. Bhatia said the company is taking a hybrid approach to AI and investing in talent focused on cloud and AI. "We are bringing a lot of that muscle for cloud and AI across the spectrum," he said. "That becomes the key component as we're looking into a lot of problems and challenges as well."

    The hybrid strategy will mean "a lot of things happen on prem and a lot of things will happen in the cloud to accelerate and transform," said Bhatia. With AWS, GE Healthcare will look to building its own foundational models as well as using multiple LLMs for everything from workflows to equipment to treatments and imaging. Bhatia said:

    "The partnership we announced with AWS is about strategy and foundational model building for building our own proprietary genAI, streamlining workflows and developing use cases. The partnership is really 1+1 is greater than 2 because you get a lot of benefits from security and scale with AWS and GE Healthcare being in more than 160 countries."

    This approach to hybrid AI will also mean multiple partnerships for clinical research. Ultimately, GE Healthcare wants to be able to predict if a patient is going to skip or arrive late to appointments adapt workflows, and build in flexibility, said Bhatia.'

    Model choice. Bhatia said flexibility with foundational models is critical. "One model is not going to solve all problems and you'll have to look to the clinical side and the operational side of things," he said. "The first place AI can have an impact is to alleviate cognitive and data overload to highlight what's relevant."

    Bhatia added that models will also need to be adapted and used for specific use cases. Open-source models also have potential to be adapted for a specific use cases.

    AI as a horizontal and vertical tool. Bhatia said it's important for AI leaders to think about generative AI as a horizontal enabler and a technology that can be used to drill down in specific areas. He said:

    "You can build these AI algorithms for breast cancer, but they can easily be adapted to prostate cancer or lung cancer. And I think that's where these technologies are becoming really game changer. How do you adapt them, not just looking into the vertical side of things, going from diagnosis to treatment therapy and the entire patient journey, but also how they can be adapted across the spectrum?"

    Data to Decisions Next-Generation Customer Experience Future of Work Innovation & Product-led Growth Tech Optimization Digital Safety, Privacy & Cybersecurity AR AI GenerativeAI ML Machine Learning LLMs Agentic AI Analytics Automation Disruptive Technology Chief Information Officer Chief Executive Officer Chief Technology Officer Chief AI Officer Chief Data Officer Chief Analytics Officer Chief Information Security Officer Chief Product Officer