Multimodal AI Research Advances in Medical and Healthcare Fields

멀티모달 | Wed Aug 12 2026 00:00:00 GMT+0000 (Coordinated Universal Time) | 3 sources

Google unveiled AMIE for real-time video consultations, Microsoft released CARE-X for chest X-ray interpretation, and researchers used AI to map schizophrenia gene networks.

Analysis

[Google DeepMind] unveiled AMIE real-time video consultation AI system ^[1]

• Leverages multi-agent architecture based on Gemini and Project Astra
• Interprets visual and auditory signals and guides virtual physical examinations
• Received positive evaluations from clinical raters across core clinical competencies
• Patient actors preferred video consultations over text chat

[Microsoft Research] released CARE-X VLM for chest X-ray interpretation ^[2]

• Unified model combining generative reports with structured diagnostic predictions
• Rewards clinical accuracy through DAPO reinforcement learning
• Parallel experiments combining Qwen3-VL-4B-Instruct with deterministic measurement tools
• Validated on real clinical data from Narayana Health in India

[Lieber Institute and collaborators] mapped schizophrenia gene networks using AI ^[3]

• Large-scale genetic analysis study published in Nature Genetics
• Identified 766 schizophrenia-related genes
• 641 of which are newly discovered
• Analyzed genetic data from over 102
• 000 people and tissue from 6 brain regions
• Genes operate as an interconnected network rather than isolated elements

Sources

• [1] AMIE, our research medical AI system, demonstrates real-time clinical video consultation capabilities in a first-of-its-kind study. - Google AI Blog
• [2] Introducing CARE-X: Towards Clinically Useful Radiology VLMs with Auxiliary Supervision, Reward-Aligned Learning, and Tool-Augmented Measurement - Microsoft Research Blog
• [3] AI Is Helping Solve the Intricate Genetic Puzzle of Schizophrenia - Wired AI