In contrast to the progress in the research on physiological disorders relating to shelf life in fruit crops, it has been difficult to non-destructively predict their occurrence. Recent high-tech instruments have gradually enabled non-destructive predictions for various disorders in some crops, while there are still issues in terms of efficiency and costs. Here, we propose application of a deep neural network (or simply deep learning) to simple RGB images to predict a severe fruit disorder in persimmon, rapid over-softening. With 1,080 RGB images of ‘Soshu’ persimmon fruits, three convolutional neural networks (CNN) were examined to predict rapid over-softened fruits with a binary classification and the date to fruit softening. All of the examined CNN models worked successfully for binary classification of the rapid over-softened fruits and the controls with > 80% accuracy using multiple criteria. Furthermore, the prediction values (or confidence) in the binary classification were correlated to the date to fruit softening. Although the features for classification by deep learning have been thought to be in a black box by conventional standards, recent feature visualization methods (or “explainable” deep learning) has allowed identification of the relevant regions in the original images. We applied Grad-CAM, Guided backpropagation, and layer-wise relevance propagation (LRP), to find early symptoms for CNNs classification of rapid over-softened fruits. The focus on the relevant regions tended to be on color unevenness on the surface of the fruit, especially in the peripheral regions. These results suggest that deep learning frameworks could potentially provide new insights into early physiological symptoms of which researchers are unaware.
"}],"abstractLicenseFlag":"disallow"}],"creator":[{"@id":"https://cir.nii.ac.jp/crid/1410855754106054661","@type":"Researcher","foaf:name":[{"@language":"en","@value":"Suzuki Maria"}],"jpcoar:affiliationName":[{"@language":"en","@value":"Graduate School of Environmental and Life Science, Okayama University"}]},{"@id":"https://cir.nii.ac.jp/crid/1410855754106054657","@type":"Researcher","foaf:name":[{"@language":"en","@value":"Masuda Kanae"}],"jpcoar:affiliationName":[{"@language":"en","@value":"Graduate School of Environmental and Life Science, Okayama University"}]},{"@id":"https://cir.nii.ac.jp/crid/1410855754106054662","@type":"Researcher","foaf:name":[{"@language":"en","@value":"Asakuma Hideaki"}],"jpcoar:affiliationName":[{"@language":"en","@value":"Fukuoka Agriculture and Forestry Research Center"}]},{"@id":"https://cir.nii.ac.jp/crid/1410855754106054660","@type":"Researcher","foaf:name":[{"@language":"en","@value":"Takeshita Kouki"}],"jpcoar:affiliationName":[{"@language":"en","@value":"Department of Advanced Information Technology, Kyushu University"}]},{"@id":"https://cir.nii.ac.jp/crid/1410855754106054663","@type":"Researcher","foaf:name":[{"@language":"en","@value":"Baba Kohei"}],"jpcoar:affiliationName":[{"@language":"en","@value":"Department of Advanced Information Technology, Kyushu University"}]},{"@id":"https://cir.nii.ac.jp/crid/1410855754106054658","@type":"Researcher","foaf:name":[{"@language":"en","@value":"Kubo Yasutaka"}],"jpcoar:affiliationName":[{"@language":"en","@value":"Graduate School of Environmental and Life Science, Okayama University"}]},{"@id":"https://cir.nii.ac.jp/crid/1410855754106054659","@type":"Researcher","foaf:name":[{"@language":"en","@value":"Ushijima Koichiro"}],"jpcoar:affiliationName":[{"@language":"en","@value":"Graduate School of Environmental and Life Science, Okayama University"}]},{"@id":"https://cir.nii.ac.jp/crid/1410855754106054656","@type":"Researcher","foaf:name":[{"@language":"en","@value":"Uchida Seiichi"}],"jpcoar:affiliationName":[{"@language":"en","@value":"Department of Advanced Information Technology, Kyushu University"}]},{"@id":"https://cir.nii.ac.jp/crid/1410855754106054664","@type":"Researcher","foaf:name":[{"@language":"en","@value":"Akagi Takashi"}],"jpcoar:affiliationName":[{"@language":"en","@value":"Graduate School of Environmental and Life Science, Okayama University"},{"@language":"en","@value":"JST, PRESTO"}]}],"publication":{"publicationIdentifier":[{"@type":"PISSN","@value":"21890102"},{"@type":"EISSN","@value":"21890110"},{"@type":"ISSN","@value":"21890102"},{"@type":"NDL_BIB_ID","@value":"025794703"},{"@type":"LISSN","@value":"21890102"},{"@type":"NCID","@value":"AA12708073"}],"prism:publicationName":[{"@language":"en","@value":"The Horticulture Journal"},{"@language":"ja","@value":"The Horticulture Journal"},{"@language":"en","@value":"Hort. J."},{"@language":"en","@value":"The Hort J"},{"@language":"en","@value":"Horticulture J"},{"@language":"en","@value":"The Horticulture J"},{"@language":"en","@value":"Hortic J"},{"@language":"en","@value":"The Hortic J"}],"dc:publisher":[{"@language":"en","@value":"The Japanese Society for Horticultural Science"},{"@language":"ja","@value":"一般社団法人 園芸学会"}],"prism:publicationDate":"2022","prism:volume":"91","prism:number":"3","prism:startingPage":"408","prism:endingPage":"415"},"reviewed":"false","dcterms:accessRights":"http://purl.org/coar/access_right/c_abf2","url":[{"@id":"https://ousar.lib.okayama-u.ac.jp/63811"},{"@id":"http://id.ndl.go.jp/bib/032269816"},{"@id":"https://ndlsearch.ndl.go.jp/books/R000000004-I032269816"},{"@id":"https://www.jstage.jst.go.jp/article/hortj/91/3/91_UTD-323/_pdf"}],"availableAt":"2022","foaf:topic":[{"@id":"https://cir.nii.ac.jp/all?q=AI","dc:title":"AI"},{"@id":"https://cir.nii.ac.jp/all?q=classification","dc:title":"classification"},{"@id":"https://cir.nii.ac.jp/all?q=explainable%20deep%20learning","dc:title":"explainable deep learning"},{"@id":"https://cir.nii.ac.jp/all?q=internal%20disorder","dc:title":"internal disorder"},{"@id":"https://cir.nii.ac.jp/all?q=ripening","dc:title":"ripening"}],"project":[{"@id":"https://cir.nii.ac.jp/crid/1040010457606483584","@type":"Project","projectIdentifier":[{"@type":"KAKEN","@value":"22H04926"},{"@type":"JGN","@value":"JP22H04926"},{"@type":"URI","@value":"https://kaken.nii.ac.jp/grant/KAKENHI-PROJECT-22H04926/"}],"notation":[{"@language":"ja","@value":"先端バイオイメージング支援プラットフォーム"},{"@language":"en","@value":"Advanced Bioimaging Support"}]}],"relatedProduct":[{"@id":"https://cir.nii.ac.jp/crid/1050848249893650688","@type":"Article","resourceType":"学術雑誌論文(journal article)","relationType":["references"],"jpcoar:relatedTitle":[{"@language":"en","@value":"Cultivar discrimination of litchi fruit images using deep learning"}]},{"@id":"https://cir.nii.ac.jp/crid/1360285707431376000","@type":"Article","resourceType":"学術雑誌論文(journal article)","relationType":["references"],"jpcoar:relatedTitle":[{"@value":"Expression of genes encoding xyloglucan endotransglycosylase/hydrolase in ‘Saijo’ persimmon fruit during softening after deastringency treatment"}]},{"@id":"https://cir.nii.ac.jp/crid/1360298340840760448","@type":"Article","relationType":["references"],"jpcoar:relatedTitle":[{"@value":"Hypoxia‐responsive