Hirling, Dominik and Tasnádi, Ervin Áron and Caicedo, Juan and Caroprese, Maria V. and Sjögren, Rickard and Aubreville, Marc and Koós, Krisztián and Horváth, Péter (2023) Segmentation metric misinterpretations in bioimage analysis. NATURE METHODS. ISSN 1548-7091 (In Press)
|
Text
s41592-023-01942-8.pdf - Published Version Available under License Creative Commons Attribution. Download (3MB) | Preview |
Abstract
Quantitative evaluation of image segmentation algorithms is crucial in the field of bioimage analysis. The most common assessment scores, however, are often misinterpreted and multiple definitions coexist with the same name. Here we present the ambiguities of evaluation metrics for segmentation algorithms and show how these misinterpretations can alter leaderboards of influential competitions. We also propose guidelines for how the currently existing problems could be tackled.
| Item Type: | Article |
|---|---|
| Additional Information: | Funding Agency and Grant Number: Lenduelet BIOMAG grant [2018342, TKP2021-EGA09]; H2020-COMPASS-ERAPerMed; CZI Deep Visual Proteomics; H2020-DiscovAIR; H2020-Fair-CHARM; HAS-NAP3; Horizon Europe BIALYMP; ELKH-Excellence grant from OTKA-SNN [139455/ARRS]; FIMM High Content Imaging and Analysis Unit (FIMM-HCA; HiLIFE-HELMI); Finnish Cancer Society; Doctoral Student Scholarship Program of the Co-operative Doctoral Program of the Ministry of Innovation and Technology - National Research, Development and Innovation Fund Funding text: D.H., K.K., E.T. and P.H. acknowledge support from the Lenduelet BIOMAG grant (no. 2018-342), TKP2021-EGA09, H2020-COMPASS-ERAPerMed, CZI Deep Visual Proteomics, H2020-DiscovAIR, H2020-Fair-CHARM, HAS-NAP3, Horizon Europe BIALYMP, the ELKH-Excellence grant from OTKA-SNN no. 139455/ARRS, the FIMM High Content Imaging and Analysis Unit (FIMM-HCA; HiLIFE-HELMI), and Finnish Cancer Society. D.H. and P.H. acknowledge the professional support of the Doctoral Student Scholarship Program of the Co-operative Doctoral Program of the Ministry of Innovation and Technology financed from the National Research, Development and Innovation Fund. We acknowledge support from A. Carpenter for the help in sharing the DSB2018 dataset. |
| Subjects: | Q Science / természettudomány > QH Natural history / természetrajz > QH301 Biology / biológia > QH3011 Biochemistry / biokémia |
| SWORD Depositor: | MTMT SWORD |
| Depositing User: | MTMT SWORD |
| Date Deposited: | 25 Sep 2023 12:40 |
| Last Modified: | 25 Sep 2023 12:40 |
| URI: | http://real.mtak.hu/id/eprint/174829 |
Actions (login required)
 |
Edit Item |
