Google Cloud Introduces Multimodal AI for Healthcare at HIMSS 2025

by BiopharmaTrend    •     

Disclaimer: All opinions expressed by Contributors are their own and do not represent those of their employers, or BiopharmaTrend.com.
Contributors are fully responsible for assuring they own any required copyright for any content they submit to BiopharmaTrend.com. This website and its owners shall not be liable for neither information and content submitted for publication by Contributors, nor its accuracy.

   News    # AI & Digital   
Share:   Share in LinkedIn  Share in Reddit  Share in X  Share in Hacker News  Share in Facebook  Send by email   |  

Google Cloud has introduced multimodal AI capabilities in Vertex AI Search for healthcare, designed to help clinicians retrieve and analyze complex medical data. The new features, announced at the HIMSS 25 healthcare conference this week, include Visual Q&A, which can interpret medical images, tables, and structured data directly, and the integration of Gemini 2.0, Google’s latest AI model, for faster and more accurate search performance.

Healthcare data is largely image-based, with nearly 90% consisting of x-rays, scans, photos, and other non-textual information. Visual Q&A enables direct analysis of diagrams, x-rays, and pathology reports, allowing clinicians to search for information without requiring manual text conversion. The inclusion of Gemini 2.0 Flash, which outperforms 1.5 Pro on key benchmarks at twice the speed, further enhances the efficiency of retrieving and analyzing multimodal patient data.

Several organizations are integrating these AI-powered tools:

  • Counterpart Health is using Vertex AI Search in Counterpart Assistant to synthesize data from 100+ medical sources, supporting early identification and proactive management of chronic diseases.
  • MEDITECH has integrated AI-powered search and summarization into its Expanse EHR, streamlining how clinicians retrieve patient data.
  • Suki has incorporated Vertex AI Search to strengthen clinical Q&A and patient summarization, speeding up decision-making.
  • Freenome is leveraging Google Cloud AI tools to identify high-risk colorectal cancer patients by analyzing de-identified patient data.

Beyond search, Google Cloud is advancing AI-driven workflow automation via AI agents. Basalt Health is deploying agents to automate medical chart preparation and risk assessments, while Google Agentspace enables organizations to build custom AI agents with Gemini’s advanced reasoning and search capabilities.

Google Cloud is showcasing these new healthcare AI advancements at HIMSS 2025 (booth #673), with live demonstrations of multimodal clinical search, AI-powered patient data analysis, and workflow automation tools. More details are available in the Google Cloud Press Corner.

Topics: AI & Digital   

Share:   Share in LinkedIn  Share in Reddit  Share in X  Share in Hacker News  Share in Facebook  Send by email