Skip to main content
PLOS One logoLink to PLOS One
. 2024 Mar 11;19(3):e0299202. doi: 10.1371/journal.pone.0299202

Qualitative classification of thrombus images as a way to improve quantitative analysis of thrombus formation in flow chamber assays

Piotr Kamola 1, Tomasz Przygodzki 1,*
Editor: Giuseppe Remuzzi2
PMCID: PMC10927075  PMID: 38466712

Abstract

Background

Thrombus formation in vitro under flow conditions is one of the most widely used methods to study haemostasis and to evaluate the activity of potential antithrombotic compounds. Assessment of the results of these experiments is often based on a quantification of microscopic images of thrombi. In a majority of reported analysis all thrombi visualised in an image are quantified as one homogenous class. In some protocols, qualitative assessment of thrombi morphology based on a visual comparison of evaluated images with representative images of predefined classes of thrombi are performed by experienced analysts. In presented paper we show how the quantitative analysis can be improved by classification of thrombi on the basis of defined morphological features prior to quantification and we suggest that machine learning-based approach can improve this way of analysis.

Methods

We tested the applicability of machine learning-based segmentation and classification of thrombi images to improve the outcome of quantification of the results of flow chamber assays. For this, we used the public domain machine learning software Ilastik for bioimage analysis developed at the European Molecular Biology Laboratory. A model was trained to distinguish two classes of thrombi based on certain morphological features which apparently correspond to the stage of thrombus development. Thrombi formed in the presence of a model antiplatelet compound—abciximab or in control conditions were quantified with the use of this model and the results were compared to quantification where all thrombi were quantified as a homogenous class.

Results

Machine learning-based analysis was capable of effective distinguishing of two classes of morphologically distinct platelet aggregates. The use of the model which segmented and quantified only the objects recognized as compacted structures provided results which better mirrored the actual effect of an antiplatelet treatment than quantification based on all structures.

Conclusions

Classification of thrombi enabled by machine learning increases the relevance of quantitative information and allows better evaluation of the results of in vitro thrombosis assays.

Introduction

Thrombus formation in vitro under flow conditions is one of the most widely used methods to study haemostasis and to evaluate the activity of potential antithrombotic compounds [1, 2]. In this method, blood is perfused through channels coated with protein components which stimulate the activation of blood platelets and the formation of thrombi. There are several ways of quantification of the effectiveness of thrombi formation in these systems. One of them is based on the assessment of the resistance of blood flow, which increases with the growth of occlusive thrombi [3]. A relatively novel approach uses quartz crystal microbalance system [4]. However, the most often used method of quantification is based on the evaluation of microscopic images of thrombi [57].

In a majority of reported analysis all visualised thrombi are quantified as a homogenous class. At the same time however, different classes of thrombi can be distinguished in a single image with respect to such features as their morphology or intensity of staining. This non-homogenous morphology of thrombi across the image results from different stage of their growth. In selected studies researchers used a score assessment of thrombi morphology to express the differences in their appearance in a quantitative way [6, 8, 9]. This approach was based on a visual comparison of evaluated images with representative images of predefined classes of thrombi which was performed by experienced analysts.

Presented work is aimed at providing a solution which would allow thrombi qualitative classification prior to quantification based on machine learning-based classifier rather than on the classification by the eye of an analyst. We focused on distinguishing thrombi which, in the moment of imaging, presented apparently different stage of development. The aim of the study was to train a classifier capable of semantic segmentation of only highly grown, compacted thrombi and to test if quantification of thrombi of solely this class would have advantage over quantification of all thrombi. Creating such a solution would be beneficial in the case of analysis of the effects of treatments which result in a decrease of height and volume of thrombi but which leave the total area covered by platelets unaffected. In these cases the effect of treatment can hardly be quantified on the basis of wide-field or single focal plane confocal images, which are the most often used imaging techniques. The evaluation of the effects of certain treatment on the formation of high, compacted thrombi is crucial as inhibition of this process is the actual aim of antiplatelet and antithrombotic therapies.

To validate the proposed approach, images of thrombi formed in the control conditions and in the presence of a model inhibitor of platelet aggregation–abciximab were quantified by our trained model and by a classical approach where all structures were taken into calculus.

In the field of bioimaging, there are currently several software solutions that allow performing machine learning–based analyses. One such solution is a public domain machine learning software for bioimage analysis Ilastik created at the European Molecular Biology Laboratory distributed under GNU General Public License which we decided to train as a classifier in our studies [10].

Methods

Generation and imaging of thrombi

The experiments were performed with the use of the VenaFlux platform (Cellix, Dublin, Ireland). The channels of the Vena8 Endo+ biochip were coated with type I collagen (Chrono-log Corp., Havertown, PA, USA) in concentration of 20 μg/ml or fibrinogen (Calbiochem, Darmstadt, Germany) in concentration of 100μg/ml overnight at 4°C and blocked with 0.1% BSA for 1 hour at room temperature. Blood samples were collected from healthy volunteers (n = 15, age between 20–55 years, 10 female and 5 male, platelet count = 266±45 plt/μm3 [mean±S.D.]) into a vacuum tube containing 0.105 M buffered sodium citrate. Blood was recalcified and perfused with shear force of 20 dynes/cm2 (approx. 445s-1) for 4 minutes. In some experiments, abciximab (Janssen Biologics B.V., Leiden, Netherlands) was added prior to perfusion at a final concentration of 10 μg/ml. Measurements were performed in a paired manner i.e. blood sample was split in two and one sample was added with abciximab and the other with equal volume of saline. Adherent platelets were stained with platelet-specific anti-CD41 PE-conjugated antibodies (Becton-Dickinson, San Diego, CA, USA). Imaging was performed using a wide-field epifluorescence AxioExaminer microscope (Carl Zeiss, Oberkochen, Germany). At least eight images were acquired in each channel. The study was approved by the Medical University of Lodz committee on the Ethics of Research in Human Experimentation (number of the consent RNN/323/20/KE). Volunteers presented informed consent. Volunteers were recruited between January 2022 and May 2023.

Training of models in Ilastik

Two classes of thrombi were distinguished: one class comprised of objects relatively homogenously stained across their area and the second consisted of objects with strong border staining and relatively dark centre Fig 1A. These two classes of thrombi apparently represent structures on different stages of development as can be deduced by comparison with three-dimensional reconstruction of confocal images of thrombi generated in the same conditions Fig 1B.

Fig 1. Morphological heterogeneity of platelet aggregates formed on collagen under flow conditions.

Fig 1

a) an image of thrombi formed on a collagen-coated surface acquired by wide-field microscopy, inlet graphs represent examples of structures with strong border staining and relatively dark centre (white frames) and of homogenously stained structures (yellow frames). b) confocal image of thrombi formed on a collagen-coated surface, an example of thrombus spanning the height of a channel (white frame), an example of low thrombus (yellow frame).

The difference in staining presumably results from various permeability of the structures to fluoro-labelled antibodies. It could be assumed that the structures which are less grown in z-axis and plausibly less densely packed are relatively homogenously stained as a majority of platelets is accessible for antibodies. The second group consists of packed, built up thrombi with lower accessibility of antibodies to their inner region. For the sake of convenience the latter class of thrombi will be denominated in the text as compacted structures. We hypothesised that quantifying only the structures included in this group would provide more discriminatory results than the classical approach in which all CD41-positive structures are quantified.

In order to compare these two approaches, two models were trained in Ilastik. One segmented all of CD41 positive objects and the second capable of differentiating between two morphologically different classes of platelet aggregates.

The segmentation in both models was a two-step process. A first step, pixel classification, is aimed at selection of pixels which form objects of interest. In the second stage, object classification, the pixels selected at the first step are grouped into objects and these objects are further assigned to different classes. Training of both models was performed according to the following schemes:

i) Model for quantification of all objects irrespective of their morphology:

two classes of pixels were created: background and the area covered by platelets. In an object classification step all objects identified as platelet aggregates were classified as thrombi.

ii) Model for quantification of only compacted aggregates:

In the pixel classification step two classes of pixels were defined: 1) background, 2) CD41 positive structures.

In the objects classification step the objects formed of the second class of pixels were taken into account. These objects were separated into two classes. It is relatively difficult to provide clear criteria to differentiate objects of such morphological complexity as platelet aggregates and thrombi. Proposed criteria of differentiation of these objects must therefore be to a large extent arbitrary. The criteria used to train our proposed model were the following: objects with strong edge staining on most of the perimeter and with relatively darker centre were classified as compacted thrombi, whereas objects where staining was more uniform, and the structures presumably less compacted, were classified to the second group. The schematic representation of this training procedure is presented on Fig 2.

Fig 2. Schematic representation of pixel and object classification steps in Ilastik followed by particle analyses by FIJI in the workflow where only selected class of thrombi was quantified.

Fig 2

a) an exemplary raw image of CD41-labeled blood platelets aggregated on collagen-coated surface; b) pixel classification map: red spots represent groups of pixels which with high probability belong to the class of platelets; c) Object prediction map where two classes of objects were defined: compacted thrombi and non-compacted aggregates. Colours represent probability that object belongs to the compacted thrombi class: green colour for high probability and red for low probability. d) object probability map thresholded to contain only the objects which belong to the compacted thrombi class with certain probability.

Detailed description of both training procedures is provided in S1 File.

To train both models, images acquired in flow chamber assays on blood samples from 9 different donors were used. The model was trained on total 18 images. Total number of objects used to train the model which quantified only the compacted structures was 3750.

The analysis were performed with the use of 1.4.0b21 Ilastik version.

The workflow was run on Intel Core i7-10700K CPU equipped with 32GB DDR4 RAM under 64-bit Windows 10 Pro.

Image analysis

The first step consisted of image preprocessing with the use of FIJI software [11]. At this step the file format was changed from the one generated by the microscope software, i.e. Zeiss .czi format, to tagged image file format (tiff). At this step the background substraction was also performed with the use of Substract Background function in FIJI. The entire preprocessing step was automated with the use of macro written in IJ1 Macro language.

In the next step, Ilastik models trained as described above were used to perform pixel classification followed by object classification to generate maps of objects for each analysed image. The model aimed at segmentation of all objects generated the maps of all structures consisting of blood platelets. The second model in turn generated maps of probability that a certain structure belongs to the class of compacted thrombi.

The objects on the maps were then quantified by Analyze Particles module of FIJI. In the maps generated by the first model all objects were quantified. The maps generated by the second model were thresholded at first place, so that only the structures which belonged to the class of compacted thrombi with a probability higher than the threshold were further processed. The choice of this value was determined during model evaluation described in Results section.

Parameters calculated by the Analyze Particles tool in FIJI included area of individual thrombi and Feret diameter of each thrombus. “Include holes” option was checked so that even if a segmentation was empty inside, the values were calculated for the entire segmented area. The operation was performed with the use of macro written in IJ1 Macro language.

Finally python script was run to calculate mean and median values of the parameters and summarized area of the structures segmented in each image.

Schematic presentation of the workflow is shown in Fig 3. All the steps of the workflow were automated by a single python script which was launching in a sequential manner all of the workflow components: FIJI macro for preprocessing, python script for Ilastik pixel prediction followed by object prediction in headless mode, FIJI macro for particle analyses, and finally python script to generate excel files.

Fig 3. Schematic representation of the workflow used for image quantification.

Fig 3

The raw images are first pre-processed with the use of Fiji software. In a next step Ilastik model is used to segment the structures and probability maps are generated for each image. The maps are analysed with the use of Fiji to provide quantification of the structures. Finally Python script is used to generate spread sheets which contain measurement results.

Statistical analysis

Normality of data distribution or of differences between paired values was tested with The Shapiro–Wilk test and Levene’s test. The statistical significance of differences between two groups was estimated using the paired or the unpaired Student’s t-test. To compare differences between more than two groups ANOVA for repeated measurements and the Tukey’s post-hoc test for multiple comparisons were used. Analyses were performed and charts were generated with use of GraphPad Prism v.9 (San Diego, CA, USA).

Ethics approval and consent to participate

The study was approved by the Medical University of Lodz committee on the Ethics of Research in Human Experimentation (number of the consent RNN/323/20/KE). Written informed consent, including detailed information regarding the study objectives, study design, risks and benefits, was obtained from each individual before blood withdrawal.

Results

Evaluation of the model

The evaluation of the model used to segment all aggregates was based on comparison of consistency of model-driven segmentation with that performed by an analyst. For this purpose, 10 cropped fragments of images were used. Ground truth segmentation was obtained by manual outlining of the objects by an analyst. The same cropped fragments were segmented by the trained model. Both segmentations were overlapped using Python script which calculated ratio of intersection of the objects (area which is shared by overlapping objects) and union (summarized area of overlapping objects) for each image and intersection over union metric (Jaccard index) was calculated. Jaccard index calculated for the model which segmented all thrombi equalled to 0.89 (0.86; 0.92) (median; IQR). The index values higher than 0.7 are generally considered indicative of high coverage.

In the second model, its ability to differentiate between compacted and non-compacted thrombi was assessed. In a set of images, outlines of all structures segmented by the model were visualised and assigned by an analyst to either of the classes to generate ground truth classification. In the next step, the assignments were compared with classification of structures as predicted by the model. As described above, Ilastik generated probability maps where each structure was assigned with a probability of being a solid thrombus. These probability values were than used to threshold the structures in the last step of the workflow: the structures assigned with the probability value higher than the threshold value were considered as thrombi and further processed. The selection of this threshold value was performed in a procedure described below. The process of comparing ground truth with model predictions was performed for 22 different threshold values of probability ranging from 0.16 to 0.98. To facilitate the visual inspection of the images the probability values were recalculated from 0–1 range to 0–255 (8-bit image). In the following sections of the manuscript these renormalised values will be used to express thresholds.

The outcome of this comparison was summarized for each image and for each threshold value in a form of a confusion matrix. When a structure labelled by an analyst as compacted thrombus was predicted accordingly by the model it was considered a true positive (TP), and if the model recognised it as non-compacted, it was considered a false negative (FN). In turn, when a structure labelled by an analyst as non-compacted was predicted accordingly by the model it was considered a true negative (TN), and if predicted by the model as compacted it was considered as false positive (FP). The values were then used to calculate true positive rate (TPR)–a fraction of all compacted thrombi correctly identified as such and false positive rate (FPR)–a fraction of non-compacted structures mistakenly predicted by the model as compacted. These metrics calculated for each threshold value were plotted against each other to generate ROC curves for each image separately and from them an averaged ROC curve was generated (Fig 4). Such presentation of metrics is widely used to evaluate the quality of tests. It shows a balance between positive samples that are detected at a given threshold value and negative samples which are falsely detected as positive in the same conditions. The procedure was performed with use of ImageJ macros and python scripts. The detailed description is provided in S1 File.

Fig 4. ROC curve for the model used to segment only compacted thrombi.

Fig 4

a) an exemplary raw image of CD41-labeled blood platelets aggregated on collagen-coated surface; b) schematic representation of ground truth labelling: blue selections–non-compacted structures, red selections–compacted structures; c) the exemplary image thresholded at 22 different values of probability d) ROC curve—true positive rate (TPR) and false positive rate (FPR) values were calculated on the basis of confusion matrices generated by comparison of binary images thresholded at various values of probability with ground truth. Inlet graph shows individual ROC curves for each of nine images used to calculated confusion matrices.

Two threshold values were chosen for further analysis: 120 and 150. At the threshold of 120 a TPR value equalled to 0.98, and FPR equalled to 0.27 meaning that only approx. 2% of compacted structures were missed in the analysis, but this high recall was at the expense of approx. 27% of non-compacted structures being falsely identified as compacted. In the case of threshold equal to 150 TPR equalled to 0.78, and FPR equalled to 0.15 meaning that up to approx. 22% of compacted structures were missed in the analysis, but the rate of non-compacted structures falsely identified as compacted dropped to approx. 15%. A further increase of the threshold to minimise FPR would result in a substantial decrease in thrombi detection as can be read out from the ROC curve.

Quantification of thrombi with the use of the trained Ilastik models

At the first place the model was tested to assess its ability to distinguish thrombi from layers of adhered platelets which do not form structures substantially developed in z-axis. To this end we used images of platelets adhered on fibrinogen. In these conditions blood platelets tend to coat the surface with relatively thin layer and do not form thrombi as it occurs on collagen coated surface. The images used at this step were not included in the training set.

In the case of nearly confluent coverage of the surface with platelets, the model segmented and quantified only a fraction of objects where platelets were specifically densely packed. This resulted in a significantly lower values of coverage area at both thresholds when compared to analysis with the classical approach where all CD41-positive structures were segmented (Fig 5). This confirmed the specificity of the model towards such structures.

Fig 5. Quantification of platelets adhered to fibrinogen.

Fig 5

a) an exemplary raw image of CD41-labeled blood platelets adhered to fibrinogen-coated surface; b) the exemplary image segmented with the model where all CD41-positive objects are segmented (upper image), with the model trained to segment only the compacted thrombi thresholded at 120 (middle image) and 150 (bottom image); c) coverage area calculated for three ways of segmentation depicted in b); ANOVA for repeated measurements and the post-hoc test for multiple comparisons, n = 5, p-values two-tailed.

As the next step we used the model to quantify the effects of a model antiplatelet drug and to compare the outcome of the quantification with the most often used approach based on quantification of all platelets adhered to the surface. Abciximab caused an apparent decrease in the number of aggregates and many of them did not present a morphology which fulfilled the criteria of compacted structures (Fig 6).

Fig 6. Segmentation of thrombi formed in control conditions and in the presence of abciximab with the use of the models described in the study.

Fig 6

Exemplary images of platelet aggregates generated on collagen-coated surface in control conditions (upper panel) and in the presence of abciximab (lower panel). Raw images are shown along with the binary maps of segmentations of all structures and with the use of the model which detects only the compacted thrombi thresholded at the values of 120 and 150.

When the objects were segmented without respect to their morphology, the area covered by platelets did not significantly differ between control and abciximab samples (Fig 7A). However, when instead of the classic approach, a model was used for segmentation and only the high aggregates were quantified, the area covered by platelets was significantly smaller in abciximab treated samples at both thresholds applied (Fig 7B and 7C).

Fig 7. Quantification of the effects of abciximab on thrombi formation with the use of the models described in the study.

Fig 7

Area covered by platelets based on segmentation of all platelet aggregates (n.s.) (a) and based on segmentation of only compacted aggregates thresholded at 120 (p = 0,0436) (b) or at 150 (p = 0,0108) (c). Median area of individual aggregates based on segmentation of all platelet aggregates (p = 0,0348) (d); and based on segmentation of only compacted aggregates thresholded at 120 (p = 0,0002)(e) or at 150 (p = 0,0023)(f); Feret diameter of individual aggregates based on segmentation of all platelet aggregates (n.s.) (g) and based on segmentation of only compacted aggregates thresholded at 120 (p = 0,0003) (h) or at 150 (p = 0,0082) (i); n = 6, all analyses performed with paired t-test, all p-values two-tailed, each point represents a mean of value calculated for at least eight images.

Inhibition of platelet aggregation may lead to formation of a number of smaller thrombi instead of lower number of larger structures. In such case a total coverage area is not a relevant measure of the effect and a size of individual thrombi is used as a parameter of choice. In presented results abciximab treatment resulted in a significant decrease of a median size of individual thrombi even when they were quantified as a homogenous class (Fig 7D). The difference however was much more pronounced when only solid structures were segmented with the use of the model (Fig 7E and 7F).

Another parameter which describes the morphology of individual objects is Feret diameter. As it is calculated by FIJI, the value represents the longest distance between any two points along the selection boundary. In the case of thrombi, this parameter would therefore be a measure of the ability of the haemostatic system to form continuous structures under the shear stress. When all objects were quantified Feret diameter did not differ between control and abciximab-treated samples (Fig 7G). It was however significantly decreased in abciximab samples when only compacted thrombi were quantified (Fig 7H and 7I).

Segmentation of the selected class of structures resulted not only in an increase of the difference between control and abciximab-treated samples, but also in a change in the absolute values of each parameter. The coverage area in both control and abciximab samples decreased with the application of the model selective towards the compacted structures, which reflected the fact that less structures were segmented and quantified. On the other hand median area and median Feret diameters increased when the model was applied. This was an effect of exclusion of the smaller fraction of objects from the analysis.

Discussion

In many of the experiments conducted with the use of flow chambers quantification is based on images acquired by means of wide field microscopy or confocal imaging of a single focal plane. In such analysis all thrombi are considered as a homogenous class and quantitative representation of images includes total area covered by these structures or a central measure tendency of certain parameters of individual thrombi. In presented work we suggest another approach where quantification is based on selected structures which fulfil a certain morphological criterion. In our particular example this morphological type corresponded to the stage of thrombi growth.

Quantification with the use of a model trained to segment only the structures fulfilling these criteria assured better discrimination of the inhibitory effect of the model antiplatelet drug than quantification of all structures. In the latter case evaluation of parameters of individual objects provided a certain discrimination which might suggest that this solution is sufficient to achieve the aim and that qualitative selection of structures prior to quantification does not provide additional benefits. In fact, when a strong inhibitory effect is considered such a solution may provide satisfactory results. In the case of more subtle effects however, qualitative selection may be useful. Also, if an inhibitory effect on thrombus formation was accompanied by a substantial increase of adhesion of platelets leading to coating of the surface, quantification of individual structures treated as one class would become more difficult. In such case, as shown by the example of platelets adhered to fibrinogen, the trained model capable of distinguishing layers of platelets from more compacted aggregates may prove useful.

In the life sciences there exist no analytical methods that provide indisputable results. Quantification of images based on machine learning model is no exception. The main source of variability in this case is uncertainty about the classification of the objects. To verify how different classification can affect the results we compared the outcome of analyses at two different values of threshold. The comparison showed that even when approximately 20% of structures not fulfilling our criteria were taken into calculus at low threshold or when approximately 20% of the structures of interest dropped out from analyses at high threshold, still the model more efficiently discriminated the effect of antiplatelet treatment than analyses based on all objects.

Presented method of analyses is by no means intended to serve as a replacement for confocal microscopy with three-dimensional reconstruction of images. The latter will always provide the most relevant quantitative details such as volume or height of thrombi. At the same time however, wide-field imaging or confocal imaging of a single focal plane remain the most often ways to record thrombi images. It is due to several reasons. Acquiring of z-stack images with the use of confocal microscopy is relatively time-consuming and laborious task. This is of particular significance in the case of flow chamber assays where several images along the channel should be acquired to provide a relevant representation of thrombi heterogeneity. Additional factor which limits the usage of confocal microscopy is relatively lower accessibility to such setups when compared to wide field microscopes. Therefore we believe that solution which improves a relevance of quantitation based on single focal planes images may prove beneficial.

The idea of quantification combined with qualitative distinction between morphological classes of thrombi has been already applied in several studies [6, 8, 9]. It has been based on comparing by an analyst of images acquired in the experiments with reference images representative to the classes of interest. The images were then assigned a score value depending on the outcome of the comparison. Machine learning approach proposed in the paper could support this way of analysis. The model can be trained to distinguish thrombi not only on the basis of their morphology, like in the presented paper, but also on the basis of staining of specific markers of platelet activation. Such an approach has been recently used to distinguish platelet aggregates varying in terms of the density of GPVI clusters [12]. The same solution has proved useful for classifying of adhered platelets with respect to different degree of spreading [13], or to detect platelets characterized by compromised spreading in a cohort of patients with bleeding disorders [14].

All the steps of the presented workflows were automated by scripts written in Python programming language. An automated workflow which combines segmentation with quantitative analysis allows fast calculation of experimental data from a set of images. This is of special importance when re-evaluation of a large number of images is required. The latter scenario may occur when novel experimental data or literature survey inclines an analyst to look at the already analysed data from a different perspective. For instance, if such a novel protocol of analysis demanded an alternative object classification, this could be easily achieved by training of a new model and replacing the respective files in the workflow. Similarly, a calculation of a novel quantitative parameter describing the objects requires only a modification of a selected script file. The workload of re-analysis is therefore minimized and its time is limited only by a computational power of a computer setup. Alternatively such workflows can be created with the use of graphical environments such as KNIME [13].

Conclusions

In presented work we propose a machine learning based solution to segment thrombi in fluorescently labelled images in the process of quantification of experiments performed in flow chambers. We suggest that the use of classification of thrombi enabled by machine learning may increase the relevance of quantitative information and allow better evaluation of the results of these experiments.

Supporting information

S1 File

(DOCX)

pone.0299202.s001.docx (23.3KB, docx)

Data Availability

A detailed description of both workflows is provided in Supplementary materials. All the steps of the presented workflows were automated by scripts written in python programming language. The python scripts, Fiji macros, Ilastik trained models and raw data were deposited in Zenodo repository (https://doi.org/10.5281/zenodo.10495557) and are accessible for potential users.

Funding Statement

This work was supported by the National Science Centre grant OPUS (UMO-2020/37/B/NZ3/00301).

References

  • 1.Mangin PH, Neeves KB, Lam WA, Cosemans J, Korin N, Kerrigan SW, et al.: In vitro flow-based assay: From simple toward more sophisticated models for mimicking hemostasis and thrombosis. J Thromb Haemost 2021, 19(2):582–587. doi: 10.1111/jth.15143 [DOI] [PubMed] [Google Scholar]
  • 2.Westein E, de Witt S, Lamers M, Cosemans JM, Heemskerk JW: Monitoring in vitro thrombus formation with novel microfluidic devices. Platelets 2012, 23(7):501–509. doi: 10.3109/09537104.2012.709653 [DOI] [PubMed] [Google Scholar]
  • 3.Kaikita K, Hosokawa K, Dahlen JR, Tsujita K: Total Thrombus-Formation Analysis System (T-TAS): Clinical Application of Quantitative Analysis of Thrombus Formation in Cardiovascular Disease. Thromb Haemost 2019, 119(10):1554–1562. doi: 10.1055/s-0039-1693411 [DOI] [PubMed] [Google Scholar]
  • 4.Sinn S, Muller L, Drechsel H, Wandel M, Northoff H, Ziemer G, et al.: Platelet aggregation monitoring with a newly developed quartz crystal microbalance system as an alternative to optical platelet aggregometry. Analyst 2010, 135(11):2930–2938. doi: 10.1039/c0an00474j [DOI] [PubMed] [Google Scholar]
  • 5.Roest M, Reininger A, Zwaginga JJ, King MR, Heemskerk JW, Biorheology Subcommittee of the SSCotI: Flow chamber-based assays to measure thrombus formation in vitro: requirements for standardization. J Thromb Haemost 2011, 9(11):2322–2324. [DOI] [PubMed] [Google Scholar]
  • 6.van Geffen JP, Brouns SLN, Batista J, McKinney H, Kempster C, Nagy M, et al.: High-throughput elucidation of thrombus formation reveals sources of platelet function variability. Haematologica 2019, 104(6):1256–1267. doi: 10.3324/haematol.2018.198853 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Przygodzki T, Wolska N, Talar M, Polak D, Gapinska M, Watala C: Comparison of different microscopy approaches to quantification of inhibitory effect on thrombus formation under flow conditions by the example of adenosine receptor agonist HE-NECA. J Pharmacol Toxicol Methods 2018, 94(Pt 1):94–104. doi: 10.1016/j.vascn.2018.07.003 [DOI] [PubMed] [Google Scholar]
  • 8.Herfs L, Swieringa F, Jooss N, Kozlowski M, Heubel-Moenen FCJ, van Oerle R, et al.: Multiparameter microfluidics assay of thrombus formation reveals increased sensitivity to contraction and antiplatelet agents at physiological temperature. Thromb Res 2021, 203:46–56. doi: 10.1016/j.thromres.2021.04.014 [DOI] [PubMed] [Google Scholar]
  • 9.Perrella G, Montague SJ, Brown HC, Garcia Quintanilla L, Slater A, Stegner D, et al.: Role of Tyrosine Kinase Syk in Thrombus Stabilisation at High Shear. Int J Mol Sci 2022, 23(1). doi: 10.3390/ijms23010493 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Berg S, Kutra D, Kroeger T, Straehle CN, Kausler BX, Haubold C, et al.: ilastik: interactive machine learning for (bio)image analysis. Nat Methods 2019, 16(12):1226–1232. doi: 10.1038/s41592-019-0582-9 [DOI] [PubMed] [Google Scholar]
  • 11.Schindelin J, Arganda-Carreras I, Frise E, Kaynig V, Longair M, Pietzsch T, et al.: Fiji: an open-source platform for biological-image analysis. Nat Methods 2012, 9(7):676–682. doi: 10.1038/nmeth.2019 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Jooss NJ, Smith CW, Pike JA, Farndale RW, Henskens YMC, Watson SP, et al.: Platelet GPVI cluster size is related to thrombus formation and phosphatidylserine exposure in collagen-adherent platelets under arterial shear. J Thromb Haemost 2023. [DOI] [PubMed] [Google Scholar]
  • 13.Pike JA, Simms VA, Smith CW, Morgan NV, Khan AO, Poulter NS, et al.: An adaptable analysis workflow for characterization of platelet spreading and morphology. Platelets 2021, 32(1):54–58. doi: 10.1080/09537104.2020.1748588 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Khan AO, Maclachlan A, Lowe GC, Nicolson PLR, Ghaithi RA, Thomas SG, et al.: High-throughput platelet spreading analysis: a tool for the diagnosis of platelet-based bleeding disorders. Haematologica 2020, 105(3):e124–e128. doi: 10.3324/haematol.2019.225912 [DOI] [PMC free article] [PubMed] [Google Scholar]

Decision Letter 0

Giuseppe Remuzzi

28 Nov 2023

PONE-D-23-31983Qualitative classification of images of thrombi as a way to improve quantitative analysis of thrombus formation in flow chamber assaysPLOS ONE

Dear Dr. Przygodzki,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

The manuscript focuses on a topic of potential interest. The study, however, presents major pitfalls that should be addressed to support sound conclusions. To mention some of them, ii) lack of information on donor variables, including platelet count and sex; ii) lack of comparison to a manual analysis and verification for validation of the machine learning approach; iii) lack of clarity on the choice of ‘only high aggregates’; iv) analyse images across a series of timepoints to allow the identification of individual thrombi once the platelet coverages becomes confluent; v) provide more details on the experimental setting, such as figure legends, number of the experiments performed, how many images were analysed for each perfusion, statistical analysis, set up of the experiments with and without abciximab.

Please submit your revised manuscript by Jan 12 2024 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Giuseppe Remuzzi

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at 

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and 

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Please note that PLOS ONE has specific guidelines on code sharing for submissions in which author-generated code underpins the findings in the manuscript. In these cases, all author-generated code must be made available without restrictions upon publication of the work. Please review our guidelines at https://journals.plos.org/plosone/s/materials-and-software-sharing#loc-sharing-code and ensure that your code is shared in a way that follows best practice and facilitates reproducibility and reuse.

3. Thank you for stating the following financial disclosure: 

"This work was supported by the National Science Centre grant OPUS (UMO-2020/37/B/NZ3/00301)."

  

Please state what role the funders took in the study.  If the funders had no role, please state: "The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript." 

If this statement is not correct you must amend it as needed. 

Please include this amended Role of Funder statement in your cover letter; we will change the online submission form on your behalf.

4. Your ethics statement should only appear in the Methods section of your manuscript. If your ethics statement is written in any section besides the Methods, please delete it from any other section. 

5. Please include captions for your Supporting Information files at the end of your manuscript, and update any in-text citations to match accordingly. Please see our Supporting Information guidelines for more information: http://journals.plos.org/plosone/s/supporting-information.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Partly

Reviewer #2: No

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: No

Reviewer #2: No

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: No

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: No

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: The work of Kamola and Przygodzki is original and interesting. They used machine learning-based analysis to improve classification of platelet thrombi that results from flow chamber assays. The methodology described could turn useful for fast re-analyses of thrombus formation. However, the work is too preliminary, and some points should be added or improved as follows:

- As correctly stated by the Authors the methodology described should not be intended to serve as a replacement of confocal microscopy with three-dimensional reconstruction of images. The new method can help implement image re-analysis as it enables fast calculation. However, to validate the new methodology, data obtained on the same images with “traditional” methods of analysis should be added for comparison.

- No legends of the figures are provided. It is difficult to understand what the Authors intend to show.

- Method section page 2 “generation and imaging of thrombi”. It is not clear whether the effect of abciximab was tested in parallel with the blood of the same donor used as control. Please add this information. The number of the experiments with and without abciximab should be provided.

- The Author stated that two classes of thrombi were distinguished (page 3, lines 1-6) and are presented in Figure 1. Please describe the figure adding a detailed legend.

- How many images were analysed for each perfusion? Mean ± SD should be added.

- Statistical analysis should be reported.

- The description of the results is difficult to follow. Result section should be rewritten, and more details added.

Reviewer #2: This study presents a machine learning-based method for classification of images of thrombi formed in in vitro flow chambers. Two classes of thrombi are deciphered as the result; a proof-of-concept data set is then presented using known antiplatelet agents.

The machine learning code applied in this platform is used on 18 images from 9 donors as a training set; this is an extremely limited set of images and likely fails to capture the heterogeneity between donors and reproducibility between experiments or within experiments. A complete analysis of the heterogeneity in images within an individual experiments, for the same donor between experiments, and importantly, between donors.

Donor variables including platelet count and sex as a variable should be reported.

Images should be analyzed across a series of timepoints, as this analysis would be unable to distinguish individual thrombi once the platelet coverages becomes confluent. The choice of ‘only high aggregates’ is arbitrary; why when all segments are segmented compared to only high segments, do the y-axis scales change and the larger aggregates appear in the analysis of the high aggregates but are missing in the analysis of all the aggregates.

Comparison to a manual analysis and verification compared to a ground truth is required for validation.

The machine learning code was not developed by this group for this analysis; rather, this study is the demonstration of the use of this code for analyzing platelet thrombus and aggregates. The novelty of this application of analysis tool is not novel and is more suitable for report as a methods paper or used as a method as part of a mechanistic study with a novel finding.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2024 Mar 11;19(3):e0299202. doi: 10.1371/journal.pone.0299202.r002

Author response to Decision Letter 0


25 Jan 2024

REVIEWER #1

We have re-evaluated the Ilastik model prior to submission of the revised version of the manuscript and we have decided to train it de novo using better defined criteria for object and pixel classification. These criteria are described in the revised version of the manuscript. We have also modified the method of the model evaluation by introducing confusion matrix and ROC curves. In addition, we have found out that the values presented in the original version were expressed in pixels erroneously described as um. In the present version the values were recalculated.

REVIEWER

- As correctly stated by the Authors the methodology described should not be intended to serve as a replacement of confocal microscopy with three-dimensional reconstruction of images. The new method can help implement image re-analysis as it enables fast calculation. However, to validate the new methodology, data obtained on the same images with “traditional” methods of analysis should be added for comparison.

RESPONSE:

We agree with the suggestion of the reviewer that quantification based on selected class of thrombi should be compared with the traditional approach. The traditional approach is based on quantification of all objects i.e. both separated platelets and thrombi. In our work this approach was performed with the use of a model which segmented all CD41-positive structures. As this idea was not clearly expressed in the original version of our paper, we have amended it in the present version: lines 19-24 page 3

REVIEWER

- No legends of the figures are provided. It is difficult to understand what the Authors intend to show.

RESPONSE:

The figure legends were submitted along with the manuscript as a separate file and were not included in the main manuscript file. In the amended version the legends have been included in the end of the file.

REVIEWER

- Method section page 2 “generation and imaging of thrombi”. It is not clear whether the effect of abciximab was tested in parallel with the blood of the same donor used as control. Please add this information. The number of the experiments with and without abciximab should be provided.

RESPONSE:

The experiments were performed in a pairwise manner. The information has been added in

Lines 45-46 page 2. The number of repetitions was provided in figure legend.

REVIEWER

- The Author stated that two classes of thrombi were distinguished (page 3, lines 1-6) and are presented in Figure 1. Please describe the figure adding a detailed legend.

RESPONSE

The descritpion of the classes has been provided in the figure legend

REVIEWER

- How many images were analysed for each perfusion? Mean ± SD should be added.

RESPONSE

There were at least 8 images per perfusion as stated in the method section line 1 page 3 and on the figure 7 legend. Therefore, each dot on the Figure 7 represents an average of at least 8 images (technical repetitions). Showing of mean ± SD for each perfusion would hence represent a variability between technical repetitions. Also, these values would be hardly visible when aligned. Thus we decided to omit their presentation. To provide an opportunity for the reviewer and the readers we have published raw data of the experiments in the repository as stated in the Availability of data and materials section.

REVIEWER

- Statistical analysis should be reported.

RESPONSE

Statistical analyses have been added in lines 32-38 page 4

REVIEWER

- The description of the results is difficult to follow. Result section should be rewritten, and more details added.

RESPONSE

We have rewritten the results section

REVIEWER #2:

We have re-evaluated the Ilastik model prior to submission of the revised version of the manuscript and we have decided to train it de novo using better defined criteria for object and pixel classification. These criteria are described in the revised version of the manuscript. We have also modified the method of the model evaluation by introducing confusion matrix and ROC curves. In addition, we have found out that the values presented in the original version were expressed in pixels erroneously described as um. In the present version the values were recalculated.

REVIEWER

The machine learning code applied in this platform is used on 18 images from 9 donors as a training set; this is an extremely limited set of images and likely fails to capture the heterogeneity between donors and reproducibility between experiments or within experiments. A complete analysis of the heterogeneity in images within an individual experiments, for the same donor between experiments, and importantly, between donors.

RESPONSE:

The approach used in the presented studies is instance segmentation and not image classification. It means that a single element which is being classified here is not an entire image, but a segmented object in the image. Therefore the training set is not actually comprised of 18 images but it consists of 3750 objects of thrombi being segmented in these 18 images. This information has been added to the amended version of the manuscript lines 46-47 page 3 . To ensure a good generalisation of the model the training was performed on samples from different donors. This approach is similar to that used in other publications. In a paper where Ilastik was used for platelet classification, the model was trained on 8 images (Platelets. 2021; 32(1): 54–58.). Authors provided a number of objects in these 8 images: 1732. In another paper (PLoS Comput Biol. 2023 Nov; 19(11): e1010845) authors used five images to train their model.

A measure of how effective was the training is based on comparision of model outcome with ground truth. This is actually a question of the model fitness, of its ability of generalisation. And this has been evaluated by specific metrics. They have been described in the manuscript.

Heterogeneity of images within an individual images is an intrinsic feature of the microfluidic methods: thrombi can form differently along the channel with more thrombi generated in the inlet than closer to the outlet. This effect is more pronounced in some types of chambers while others are less susceptible. Because of this some researchers prefer to take images only from the defined lengths of the channels to minimize this heterogeneity. But all this considerations are not in the scope of presented paper. The paper is not aimed at refining of the microfluidic chamber assay, but at establishing the methods of analysis of images no matter what kind of microfluidic device was used to generate them. Similarly, variation between donors is a biological effect and not the effect of the image analysis.

Finally the work presented here was not intended to present a trained model for a production purposes. It is rather a proof of concept work to show, as a title says, that qualitative classification of thrombi prior their quantification could provide better evaluation of the antiplatelet drugs than analysis based on a robust quantification. It is to encourage researchers in the field of thrombosis to employ such a classification-supported in their analysis in place of robust quantification. As it is discussed, the exact method used may differ on several levels: starting from imaging (still or real-time), through staining strategy (other antigens than CD41 can be used for this purpose), and finally the machine learning approach (convolutional neural networks could be employed instead of random forest classifier).

REVIEWER

Donor variables including platelet count and sex as a variable should be reported.

RESPONSE

The data has been added in lines 40-41 page 2.

REVIEWER

Images should be analyzed across a series of timepoints, as this analysis would be unable to distinguish individual thrombi once the platelet coverages becomes confluent. The choice of ‘only high aggregates’ is arbitrary;

RESPONSE:

The timeframe of analysis is usually a choice of researcher. Due to the risk of reaching confluency or, as it is more possible in the case of growing thrombi, due to the risk of occluding the channel, the experiments are usually performed in a period that allows to form separate thrombi. Our study was not aimed at finding a proper way of how long to perfuse the channel, but rather how to analyse the visual data. The choice of high aggregates is in fact arbitrary as we stated it. The reason for this choice has been explained in the paper: the height of aggregates is a crucial parameter as it decides on their occlusive abilities which are clinically relevant. It has been explained in lines 23-24 page 2.

REVIEWER

why when all segments are segmented compared to only high segments, do the y-axis scales change and the larger aggregates appear in the analysis of the high aggregates but are missing in the analysis of all the aggregates.

RESPONSE:

The y-axes present median values. When only high aggregates are segmented, the smallest aggregates are not taken to the analysis which results in a decrease of median. This has been explained in lines 30-36 page 6.

REVIEWER

Comparison to a manual analysis and verification compared to a ground truth is required for validation.

RESPONSE:

We agree with the reviewer’s suggestion that evaluation of the model is substantial. The calculation of Jaccard index (IOU) for both models was performed in the primary version of the manuscript. During revision we have decided to evaluate the model selective towards compacted thrombi with another approach. We have calculated confusion matrices and ROC curves as has been described in the amended version of the manuscript in lines 5-40 page 5.

REVIEWER

The machine learning code was not developed by this group for this analysis; rather, this study is the demonstration of the use of this code for analyzing platelet thrombus and aggregates. The novelty of this application of analysis tool is not novel and is more suitable for report as a methods paper or used as a method as part of a mechanistic study with a novel finding.

RESPONSE:

We fully agree with the reviewer that the paper reports „ the demonstration of the use of this code for analyzing platelet thrombus and aggregates” This was our intention: to encourage researchers who work in the thrombosis field to apply machine learning tools to the analysis by showing that this kind of analysis provides more appropriate results. Therefore we must unfortunately disagree with the statement that “novelty of this application of analysis tool is not novel”. Qualitative evaluation of thrombus images prior to quantitative analysis is rarely performed, and if it is, it has so far been done by "by eye" comparison, as described in the papers we refer to in our manuscript.

Decision Letter 1

Giuseppe Remuzzi

7 Feb 2024

Qualitative classification of thrombus images as a way to improve quantitative analysis of thrombus formation in flow chamber assays

PONE-D-23-31983R1

Dear Dr. Przygodzki,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Giuseppe Remuzzi

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

Reviewer #2: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: The revised version of the manuscript Kamola and Przygodzki is improved.

I have no further comments.

Reviewer #2: No further concerns on this study; the authors sufficiently argued their case.

No concerns about dual publication, research ethics, or publication ethics.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

**********

Acceptance letter

Giuseppe Remuzzi

1 Mar 2024

PONE-D-23-31983R1

PLOS ONE

Dear Dr. Przygodzki,

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now being handed over to our production team.

At this stage, our production department will prepare your paper for publication. This includes ensuring the following:

* All references, tables, and figures are properly cited

* All relevant supporting information is included in the manuscript submission,

* There are no issues that prevent the paper from being properly typeset

If revisions are needed, the production department will contact you directly to resolve them. If no revisions are needed, you will receive an email when the publication date has been set. At this time, we do not offer pre-publication proofs to authors during production of the accepted work. Please keep in mind that we are working through a large volume of accepted articles, so please give us a few weeks to review your paper and let you know the next and final steps.

Lastly, if your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

If we can help with anything else, please email us at customercare@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Prof. Giuseppe Remuzzi

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 File

    (DOCX)

    pone.0299202.s001.docx (23.3KB, docx)

    Data Availability Statement

    A detailed description of both workflows is provided in Supplementary materials. All the steps of the presented workflows were automated by scripts written in python programming language. The python scripts, Fiji macros, Ilastik trained models and raw data were deposited in Zenodo repository (https://doi.org/10.5281/zenodo.10495557) and are accessible for potential users.


    Articles from PLOS ONE are provided here courtesy of PLOS

    RESOURCES