BERT-based Transfer Learning in Sentence-level Anatomic Classification of Free-Text Radiology Reports
-
- Daiki Nishigaki
- From the Departments of Artificial Intelligence Diagnostic Radiology (D.N., Y.S., T.W., K.K., K.Y., J.S., S.K.) and Radiology (N.T.), Osaka University Graduate School of Medicine, 2-2 Yamadaoka, Suita, Osaka 565-0871, Japan.
-
- Yuki Suzuki
- From the Departments of Artificial Intelligence Diagnostic Radiology (D.N., Y.S., T.W., K.K., K.Y., J.S., S.K.) and Radiology (N.T.), Osaka University Graduate School of Medicine, 2-2 Yamadaoka, Suita, Osaka 565-0871, Japan.
-
- Tomohiro Wataya
- From the Departments of Artificial Intelligence Diagnostic Radiology (D.N., Y.S., T.W., K.K., K.Y., J.S., S.K.) and Radiology (N.T.), Osaka University Graduate School of Medicine, 2-2 Yamadaoka, Suita, Osaka 565-0871, Japan.
-
- Kosuke Kita
- From the Departments of Artificial Intelligence Diagnostic Radiology (D.N., Y.S., T.W., K.K., K.Y., J.S., S.K.) and Radiology (N.T.), Osaka University Graduate School of Medicine, 2-2 Yamadaoka, Suita, Osaka 565-0871, Japan.
-
- Kazuki Yamagata
- From the Departments of Artificial Intelligence Diagnostic Radiology (D.N., Y.S., T.W., K.K., K.Y., J.S., S.K.) and Radiology (N.T.), Osaka University Graduate School of Medicine, 2-2 Yamadaoka, Suita, Osaka 565-0871, Japan.
-
- Junya Sato
- From the Departments of Artificial Intelligence Diagnostic Radiology (D.N., Y.S., T.W., K.K., K.Y., J.S., S.K.) and Radiology (N.T.), Osaka University Graduate School of Medicine, 2-2 Yamadaoka, Suita, Osaka 565-0871, Japan.
-
- Shoji Kido
- From the Departments of Artificial Intelligence Diagnostic Radiology (D.N., Y.S., T.W., K.K., K.Y., J.S., S.K.) and Radiology (N.T.), Osaka University Graduate School of Medicine, 2-2 Yamadaoka, Suita, Osaka 565-0871, Japan.
-
- Noriyuki Tomiyama
- From the Departments of Artificial Intelligence Diagnostic Radiology (D.N., Y.S., T.W., K.K., K.Y., J.S., S.K.) and Radiology (N.T.), Osaka University Graduate School of Medicine, 2-2 Yamadaoka, Suita, Osaka 565-0871, Japan.
Description
To assess whether transfer learning with a bidirectional encoder representations from transformers (BERT) model, pretrained on a clinical corpus, can perform sentence-level anatomic classification of free-text radiology reports, even for anatomic classes with few positive examples.This retrospective study included radiology reports of patients who underwent whole-body PET/CT imaging from December 2005 to December 2020. Each sentence in these reports (6272 sentences) was labeled by two annotators according to body part ("brain," "headneck," "chest," "abdomen," "limbs," "spine," or "others"). The BERT-based transfer learning approach was compared with two baseline machine learning approaches: bidirectional long short-term memory (BiLSTM) and the count-based method. Area under the precision-recall curve (AUPRC) and area under the receiver operating characteristic curve (AUC) were computed for each approach, and AUCs were compared using the DeLong test.The BERT-based approach achieved a macro-averaged AUPRC of 0.88 for classification, outperforming the baselines. AUC results for BERT were significantly higher than those of BiLSTM for all classes and those of the count-based method for the "brain," "chest," "abdomen," and "others" classes (The BERT-based transfer learning approach outperformed the BiLSTM and count-based approaches in sentence-level anatomic classification of free-text radiology reports, even for anatomic classes with few labeled training data.
Journal
-
- Radiology: Artificial Intelligence
-
Radiology: Artificial Intelligence 5 (2), 2023-03-01
Radiological Society of North America (RSNA)