Ads_970x250

Google Tests Video Medical AI Against Doctors

AMIE was rated on par with physicians in simulated video consultations but has yet to be tested with real patients.

Topics

  • Google researchers have expanded their experimental medical AI system AMIE into real-time video consultations, allowing it to listen, observe patients, speak with them and guide basic physical examinations.

    In a randomized study, AMIE Video was tested across 100 clinical scenarios and 300 simulated consultations. The study involved 15 trained patient actors, 10 board-certified primary-care physicians and 20 independent doctors who evaluated performance.

    Google said AMIE Video performed at a level comparable with physicians on history taking, diagnostic accuracy, treatment and management recommendations and communication. 

    The AI scored significantly higher on average in eliciting physical signs and guiding patients through examination maneuvers over video.

    AMIE Video is built on Gemini and Project Astra and uses three AI agents working in parallel. A “talker” handles the patient conversation, a “planner” updates diagnoses and treatment options in the background, and a “perception” agent monitors visual and audio cues including signs of distress and physical findings.

    Patient actors also rated the video format more favorably than text chat and gave AMIE positive scores for rapport, empathy and confidence.

    Google, however, cautioned against treating the results as evidence that the system can perform the same way in hospitals or routine telehealth. 

    The study used trained actors rather than real patients, and some conditions could not be realistically reproduced. Separate evaluations also found occasional perception and reasoning errors.

    “Assessing these findings in studies with real patients and real clinical conditions is an essential next step before any conclusions about real-world utility can be drawn,” the researchers said.

    Google is already testing earlier versions of AMIE with Beth Israel Deaconess Medical Center and Included Health.

    Topics

    More Like This

    You must to post a comment.

    First time here? : Comment on articles and get access to many more articles.