(ANN/CHINA DAILY) – Zhejiang University has become a trailblazer in healthcare innovation by introducing OmniPT, the first AI-powered universal pathology assistant used in clinical practice in China.
This groundbreaking tool is now operational at the First Affiliated Hospital of Zhejiang University School of Medicine in Hangzhou, marking a significant milestone in the integration of artificial intelligence into cancer diagnostics.
OmniPT leverages advanced vision and language models to facilitate seamless human-computer interaction, assisting pathologists in diagnosing high-incidence cancers such as gastric, colorectal, and cervical cancers.
By enhancing diagnostic precision and reducing errors, this AI-driven system promises to improve treatment outcomes and efficiency in cancer care.
OmniPT has achieved a number of breakthroughs in laboratory tests, including in cancer classification, grading, vascular and neural invasion identification and the discovery of markers that indicate the future course of the disease, the hospital said.
Analyses and predictions by OmniPT have been 80 to 90 per cent accurate across cancer types.
Most patients and their families are unfamiliar with the details of pathology examinations — work performed on tissue samples or cells in a lab, and pathologists generally do not interact directly with patients.
When biological samples from a patient are sent to a lab, experts go through an intense process to understand the pathological changes and the nature of the disease in the specimen at hand.
The role of the pathologist is to help reach an accurate diagnosis through the application of rigorous empirical standards. China, however, faces a severe shortage of pathology professionals.
“Many people may know that paediatricians are in short supply, but pathologists are even more rare. Currently, our country needs 150,000 to 200,000 pathologists, but there are only about 30,000 officially registered,” said Zhang Jing, chair of the pathology department and vice-president of the Yuhang branch of the hospital.
Apart from this massive gap, there are also regional imbalances. While cities like Beijing, Shanghai and Hangzhou may be facing less severe shortages, the situation is dire in remote areas, he added.
Additionally, the long training period only complicates the situation as young pathologists often lack the required depth of experience.
Against this backdrop, OmniPT, developed by Professor Song Mingli’s team from Zhejiang University’s College of Computer Science and Technology in collaboration with the First Affiliated Hospital, is facilitating fast, accurate clinical diagnosis.
By leveraging human-computer interaction and centering on the needs of pathologists, OmniPT significantly improves diagnostic efficiency and quality, and helps alleviate the shortage of professionals.
“It serves as an assistant to pathologists by handling repetitive tasks so that they can focus on final judgment,” Zhang said.
He provided an example of counting mitosis, which is a critical task when diagnosing gliomas, a kind of tumor that can be found in the brain or spinal cord.
“It can take at least 30 minutes to an hour to count a single pathology slide under a high-power microscope,” he said.
“OmniPT, however, can complete this task in less than 10 seconds. Its computational capabilities allow it to analyse the findings in far greater detail than manual work. When it encounters 10 uncertain mitotic figures, it reports to a pathologist like me to make the final judgment,” Zhang added.
In collaboration with the hospital, Song’s team has focused on clinical needs. OmniPT accelerates the evaluation of samples on slides, particularly details that might be overlooked by fatigued doctors. OmniPT handles more than 90 percent of repetitive tasks, leaving only a small fraction for pathologists to assess.
“It assists us, but it doesn’t drive us. We drive it. By leveraging AI in our interactions, we can solve challenging problems in pathology — particularly for people in remote regions or those with less experienced doctors. It greatly improves efficiency, reduces costs and helps us avoid errors,” Zhang said.
