Automated approach for estimation of grade groups for prostate cancer based on histological image feature analysis

<jats:title>Abstract</jats:title><jats:sec><jats:title>Background</jats:title><jats:p>There is a low reproducibility of the Gleason scores that determine the grade group of prostate cancer given the intra‐ and interobserver variability among pathologists. This study aimed to develop an automated approach for estimating prostate cancer grade groups based on features obtained from histological image analysis.</jats:p></jats:sec><jats:sec><jats:title>Methods</jats:title><jats:p>Fifty‐nine patients who underwent radical prostatectomy were selected under the approval of the institutional review board of our university hospital. For estimation, we followed the grade group criteria provided by the International Society of Urological Pathology in 2014. One hundred eight specimen slides obtained from the patients were digitized to extract 110 regions of interest (ROI) from hematoxylin and eosin‐stained histological images using a digital whole slide scanner at ×20 magnification with a pixel size of 0.4 μm. Each color pixel value in the ROI was decomposed into six intensities corresponding to the RGB (red, green, and blue) and HSV (hue, saturation, and value) color models. Image features were extracted by histological image analysis, obtaining 54 features from the ROI based on histogram and texture analyses in the six types of decomposed histological images. Then, 40 representative features were selected from the 324 histological image features based on statistically significant differences (<jats:italic>P</jats:italic> < .05) between the mean image feature values for high (≥3, Gleason score ≥4 + 3) and low (≤2, Gleason score ≤3 + 4) grade groups. The relationship between grade groups and the most representative image feature (ie, complexity) was approximated using regression to estimate real‐number grade groups defined by continuous numerical grading. Finally, the grade groups were expressed as the conventional grade groups (ie, integers from 1 to 5) using a piecewise step function.</jats:p></jats:sec><jats:sec><jats:title>Results</jats:title><jats:p>The grade groups were correctly estimated by the proposed approach without errors on training (70 ROIs) and validation (40 ROIs) data.</jats:p></jats:sec><jats:sec><jats:title>Conclusions</jats:title><jats:p>Our results suggest that the proposed approach may support pathologists during the evaluation of grade groups for prostate cancer, thus mitigating intra‐ and interobserver variability.</jats:p></jats:sec>