ChatGPT can produce medical record notes ten times faster than doctors

The AI model ChatGPT can write administrative medical notes up to ten times faster than doctors without compromising quality. This is according to a new study conducted by researchers at Uppsala University Hospital and Uppsala University in collaboration with Danderyd Hospital and the University Hospital of Basel, Switzerland. They conducted a pilot study of just six virtual patient cases, which will now be followed up with an in-depth study of 1,000 authentic patient medical records.

“For years, the debate has centred on how to improve the efficiency of healthcare. Thanks to advances in generative AI and language modelling, there are now opportunities to reduce the administrative burden on healthcare professionals. This will allow doctors to spend more time with their patients,” explains Cyrus Brodén, an orthopaedic physician and researcher at Uppsala University Hospital and Uppsala University.

Administrative tasks take up a large share of a doctor’s working hours, reducing the time for patient contact and contributing to a stressful work situation. Researchers at Uppsala University Hospital and Uppsala University, in collaboration with Danderyd Hospital and the University Hospital of Basel, Switzerland, have shown in a new study that the AI model ChatGPT can write administrative medical notes up to ten times faster than doctors without compromising quality.

The aim of the study was to assess the quality and effectiveness of the ChatGPT tool when producing medical record notes. The researchers used six virtual patient cases that mimicked real cases in both structure and content. Discharge documents for each case were generated by orthopaedic physicians. ChatGPT-4 was then asked to generate the same notes. The quality assessment was carried out by an expert panel of 15 people who were unaware of the source of the documents. As a secondary metric, the time required to create the documents was compared.

“The results show that ChatGPT-4 and human-generated notes are comparable in quality overall, but ChatGPT-4 produced discharge documents ten times faster than the doctors,” notes Brodén.

“Our interpretation is that advanced large language models like ChatGPT-4 have the potential to change the way we work with administrative tasks in healthcare. I believe that generative AI will have a major impact on healthcare and that this could be the beginning of a very exciting development,” he maintains.

The plan is to launch an in-depth study shortly, with researchers collecting 1,000 medical patient records. Again, the aim is to use ChatGPT to produce similar administrative notes in the patient records.

“This will be an interesting and resource-intensive project involving many partners. We are already working actively to fulfil all data management and confidentiality requirements to get the study under way,” concludes Brodén.

Rosenberg, G. S., Magnéli, M., Barle, N., Kontakis, M. G., Müller, A. M., Wittauer, M., Gordon, M., & Brodén, C.. 2024: ChatGPT-4 generates orthopedic discharge documents faster than humans maintaining comparable quality: a pilot study of 6 cases. Acta Orthopaedica, 95, 152-156. https://doi.org/10.2340/17453674.2024.40182