Google AI health chatbot passes US medical exam: Study | The Business Standard
Skip to main content
  • Latest
  • Economy
    • Banking
    • Stocks
    • Industry
    • Analysis
    • Bazaar
    • RMG
    • Corporates
    • Aviation
  • Videos
    • TBS Today
    • TBS Stories
    • TBS World
    • News of the day
    • TBS Programs
    • Podcast
    • Editor's Pick
  • World+Biz
  • Features
    • Panorama
    • The Big Picture
    • Pursuit
    • Habitat
    • Thoughts
    • Splash
    • Mode
    • Tech
    • Explorer
    • Brands
    • In Focus
    • Book Review
    • Earth
    • Food
    • Luxury
    • Wheels
  • More
    • Sports
    • TBS Graduates
    • Bangladesh
    • Supplement
    • Infograph
    • Archive
    • Gallery
    • Long Read
    • Interviews
    • Offbeat
    • Magazine
    • Climate Change
    • Health
    • Cartoons
  • বাংলা
The Business Standard

Tuesday
June 10, 2025

Sign In
Subscribe
  • Latest
  • Economy
    • Banking
    • Stocks
    • Industry
    • Analysis
    • Bazaar
    • RMG
    • Corporates
    • Aviation
  • Videos
    • TBS Today
    • TBS Stories
    • TBS World
    • News of the day
    • TBS Programs
    • Podcast
    • Editor's Pick
  • World+Biz
  • Features
    • Panorama
    • The Big Picture
    • Pursuit
    • Habitat
    • Thoughts
    • Splash
    • Mode
    • Tech
    • Explorer
    • Brands
    • In Focus
    • Book Review
    • Earth
    • Food
    • Luxury
    • Wheels
  • More
    • Sports
    • TBS Graduates
    • Bangladesh
    • Supplement
    • Infograph
    • Archive
    • Gallery
    • Long Read
    • Interviews
    • Offbeat
    • Magazine
    • Climate Change
    • Health
    • Cartoons
  • বাংলা
TUESDAY, JUNE 10, 2025
Google AI health chatbot passes US medical exam: Study

Tech

AFP/BSS
14 July, 2023, 12:35 pm
Last modified: 14 July, 2023, 12:42 pm

Related News

  • How to not write like an AI
  • Google judge mulls softer remedies in US search antitrust case
  • Anthropic’s latest AI model will blackmail you if you threaten to shut it down
  • Google Pay likely coming to Bangladesh soon
  • How NotebookLM became my favourite study buddy

Google AI health chatbot passes US medical exam: Study

AFP/BSS
14 July, 2023, 12:35 pm
Last modified: 14 July, 2023, 12:42 pm
Photo: Collected
Photo: Collected

Google's artificial intelligence-powered medical chatbot has achieved a passing grade on a tough US medical licensing exam, but it's answers still fall short of those from human doctors, a peer-reviewed study said on Wednesday. 

Last year the release of ChatGPT -- whose developer OpenAI is backed by Google's rival Microsoft -- kicked off a race between tech giants in the burgeoning field of AI. 

While much has been made about the future possibilities -- and dangers -- of AI, health is one area where the technology had already shown tangible progress, with algorithms able to read certain medical scans as well as humans.

The Business Standard Google News Keep updated, follow The Business Standard's Google news channel

Google first unveiled its AI tool for answering medical questions, called Med-PaLM, in a preprint study in December. Unlike ChatGPT, it has not been released to the public. 

The US tech giant says Med-PaLM is the first large language model, an AI technique trained on vast amounts of human-produced text, to pass the US Medical Licensing Examination (USMLE). 

A passing grade for the exam, which is taken by medical students and physicians-in-training in the United States, is around 60%. 

In February, a study said that ChatGPT had achieved passing or near passing results.

In a peer-reviewed study published in the journal Nature on Wednesday, Google researchers said that Med-PaLM had achieved 67.6 percent on USMLE-style multiple choice questions. 

"Med-PaLM performs encouragingly, but remains inferior to clinicians," the study said. 

To identify and cut down on "hallucinations" -- the name for when AI models offer up false information -- Google said it had developed a new evaluation benchmark.

Karan Singhal, a Google researcher and lead author of the new study, told AFP that the team has used the benchmark to test a newer version of their model with "super exciting" results.

Med-PaLM 2 has reached 86.5 percent on the USMLE exam, topping the previous version by nearly 20 percent, according to a preprint study released in May that has not been peer-reviewed.

'Elephant in the room' 

James Davenport, a computer scientist at the UK's University of Bath not involved in the research, said "there is an elephant in the room" for these AI-powered medical chatbots.

There is a big difference between answering "medical questions and actual medicine," which includes diagnosing and treating genuine health problems," he said.

Anthony Cohn, an AI expert at the UK's Leeds University, said that hallucinations would likely always be a problem for such large language models, because of their statistical nature.

Therefore these models "should always be regarded as assistants rather than the final decision makers," Cohn said.

Singhal said that in the future Med-PaLM could be used to support doctors to offer up alternatives that may not have been considered otherwise.

The Wall Street Journal reported earlier this week that Med-PaLM 2 has been in testing at the prestigious US Mayo Clinic research hospital since April. 

Singhal said he could not speak about specific partnerships.

But he emphasised that any testing would not be "clinical, or patient facing, or are able to cause patients harm". 

It would instead be for "more administrative tasks that can be relatively easily automated, with low stakes," he added.

Top News

AI / chatbot / google

Comments

While most comments will be posted if they are on-topic and not abusive, moderation decisions are subjective. Published comments are readers’ own views and The Business Standard does not endorse any of the readers’ comments.

Top Stories

  • Swedish activist Greta Thunberg, who departed Israel by plane on Tuesday after being detained aboard the Gaza-bound British-flagged yacht "Madleen" after Israeli forces boarded the charity vessel as it attempted to reach the Gaza Strip in defiance of an Israeli naval blockade, talks to journalists surrounded by French police as she arrives at a terminal at the Paris-Charles de Gaulle Airport, in Roissy-en-France near Paris, France, June 10, 2025. REUTERS/Gonzalo Fuentes
    Greta Thunberg says she was kidnapped by Israel in international waters
  • Right-wing Knesset members Itamar Ben-Gvir (Left) and Bezalel Smotrich, Jerusalem, September 2022. File Photo: REUTERS/Amir Cohen/Pool
    UK sanctions Israeli far-right ministers over Gaza comments
  • A file photo of Bangladesh Bank Governor Dr Ahsan H Mansur. Photo: Collected
    'I have no relation with this': Ahsan Mansur debunks Joy’s allegations over daughter’s Dubai flat

MOST VIEWED

  • On left, Abdullah Hil Rakib, former senior vice president (SVP) of BGMEA and additional managing director of Team Group; on right, Captain Md Saifuzzaman (Guddu), a Boeing 787 Dreamliner pilot for Biman Bangladesh Airlines. Photos: Collected
    Ex-BGMEA SVP Abdullah Hil Rakib, Biman 787 pilot Saifuzzaman drown in boating accident in Canada
  • File photo of Eid holidaymakers returning to the capital from their country homes/Rajib Dhar
    Dhaka: The city we never want to return to, but always do
  • Chief Adviser Muhammad Yunus leaves for a four-day visit to the United Kingdom from the Dhaka airport on 9 June 2025. Photo: CA Press Wing
    CA Yunus leaves for UK; discussion expected on renewable energy investment, laundered money
  • File Photo: Collected
    Enhanced surveillance at Ctg airport amid rising global Covid-19 cases
  • Inside the aid ship stormed by Israeli forces on 9 June 2025. Photo: BBC
    Israeli forces stormed aid boat carrying Greta Thunberg bound for Gaza: Freedom Flotilla Coalition
  • Photos: Collected
    Abdul Hamid wasn't arrested because he's not wanted right now: Home adviser

Related News

  • How to not write like an AI
  • Google judge mulls softer remedies in US search antitrust case
  • Anthropic’s latest AI model will blackmail you if you threaten to shut it down
  • Google Pay likely coming to Bangladesh soon
  • How NotebookLM became my favourite study buddy

Features

Illustration: Duniya Jahan/ TBS

Forget Katy Perry, here’s Bangladesh’s Ruthba Yasmin shooting for the moon

1h | Features
File photo of Eid holidaymakers returning to the capital from their country homes/Rajib Dhar

Dhaka: The city we never want to return to, but always do

1d | Features
Photo collage shows political posters in Bagerhat. Photos: Jannatul Naym Pieal

From Sheikh Dynasty to sibling rivalry: Bagerhat signals a turning tide in local politics

3d | Bangladesh
Illustration: TBS

Unbearable weight of the white coat: The mental health crisis in our medical colleges

6d | Panorama

More Videos from TBS

Greta Thunberg deported from Israel

Greta Thunberg deported from Israel

3h | TBS World
BNP is not a revolutionary party: Mirza Fakhrul

BNP is not a revolutionary party: Mirza Fakhrul

4h | TBS Today
News of The Day, 10 JUNE 2025

News of The Day, 10 JUNE 2025

2h | TBS News of the day
Trump sends 2,000 more National Guard and 700 Marines to Los Angeles

Trump sends 2,000 more National Guard and 700 Marines to Los Angeles

5h | TBS World
EMAIL US
contact@tbsnews.net
FOLLOW US
WHATSAPP
+880 1847416158
The Business Standard
  • About Us
  • Contact us
  • Sitemap
  • Advertisement
  • Privacy Policy
  • Comment Policy
Copyright © 2025
The Business Standard All rights reserved
Technical Partner: RSI Lab

Contact Us

The Business Standard

Main Office -4/A, Eskaton Garden, Dhaka- 1000

Phone: +8801847 416158 - 59

Send Opinion articles to - oped.tbs@gmail.com

For advertisement- sales@tbsnews.net