ChatGPT, a text-based artificial intelligence platform, has taken the internet by surprise. According to a new study, the AI chatbot and one other AI tool have passed the US Medical Licensing Examination (USMLE).
The USMLE evaluates a physician’s ability to apply knowledge, concepts, and principles, as well as display core patient-centered abilities, which are vital in health and disease and form the foundation of safe and successful patient care. There are three exams: Step 1, Step 2CK, and Step 3.
According to the study published on the medical repository medRxiv, “ChatGPT performed at or near the passing threshold for all three exams without any specialized training or reinforcement. Additionally, ChatGPT’s explanations demonstrated a high level of concordance and insight.”
“These results suggest that large language models may have the potential to assist with medical education and clinical decision-making,” the research revealed.
It was assured that “none of the answers, explanations, or related information were indexed on Google” before ChatGPT took the exam.
Another AI tool emerged from a second research published on arXivo that assessed the performance of another language model, Flan-PaLM, on the USMLE. The main difference between the two models, according to AI researcher Vivek Natarajan, is that this model was significantly upgraded to prep for the exams using a collection of medical question-answering databases known as the MultiMedQA.
With a USMLE accuracy rate of 67.6 percent, Flan-PaLM outperformed the previous top score achieved by PubMed GPT.
Large language models “offer a tremendous opportunity to rethink the development of medical AI and make it easier, safer, and more egalitarian to employ,” according to Natarajan and team members.
ChatGPT, an AI tool developed by OpenAI, is quickly gaining traction in India and worldwide. Recently, millionaire Gautam Adani, the world’s fourth richest person, admitted to becoming addicted to ChatGPT.
He said on LinkedIn that he has developed “some addiction” to ChatGPT after using the AI chatbot.