Table 4.
Results of the Patternnet algorithm trained with the 10-fold cross-validation.
| 10-Fold Cross-Validation and 3*N Patternnet ANN | Train | Test | More Discriminating Variables | Explicit Variables | ||||
|---|---|---|---|---|---|---|---|---|
| Variable Number (Number of Tested Combinations) | Mean Sensitivity | Mean Specificity | Mean AUC | Mean Sensitivity | Mean Specificity | Mean AUC | ||
| 2 (120) | 52.9 | 65.3 | 0.636 (CI 95%: 0.626–0.646) | 50.3 | 63.8 | 0.629 (CI 95%: 0.56–0.698) | 1, 8 | Age, BMI |
| 49.6 | 66.1 | 0.616 (CI 95%: 0.609–0.623) | 50.3 | 65.9 | 0.613 (CI 95%: 0.544–0.682) | 1, 14 | Age, HB | |
| 50.1 | 66.5 | 0.618 (CI 95%: 0.61–0.626) | 49.4 | 66.1 | 0.61 (CI 95%: 0.546–0.674) | 1, 9 | Age, Lynch | |
| 53.8 | 61.9 | 0.613 (CI 95%: 0.608–0.618) | 52.1 | 61.9 | 0.61 (CI 95%: 0.562–0.657) | 8, 13 | BMI, BC | |
| 63.5 | 53.2 | 0.618 (CI 95%: 0.61–0.626) | 61.9 | 52.2 | 0.606 (CI 95%: 0.56–0.652) | 8, 15 | BMI, RB | |
| 3 (560) | 66.4 | 53.7 | 0.64 (CI 95%: 0.616–0.664) | 67.6 | 55.4 | 0.658 (CI 95%: 0.598–0.718) | 2, 8, 14 | Mp, BMI, HB |
| 60.7 | 61.4 | 0.647 (CI 95%: 0.636–0.659) | 65.2 | 59.1 | 0.657 (CI 95%: 0.598–0.717) | 1, 8, 9 | Age, BMI, Lynch | |
| 60.3 | 62 | 0.651 (CI 95%: 0.634–0.667) | 62.9 | 62 | 0.648 (CI 95%: 0.571–0.726) | 1, 8, 13 | Age, BMI, BC | |
| 50.8 | 67.5 | 0.641 (CI 95%: 0.631–0.65) | 53 | 67 | 0.646 (CI 95%: 0.576–0.716) | 1, 3, 8 | Age, Preg, BMI | |
| 60.2 | 62.5 | 0.641 (CI 95%: 0.627–0.656) | 59.3 | 61.5 | 0.644 (CI 95%: 0.566–0.722) | 1, 8, 15 | Age, BMI, RB | |
| 4 (1820) | 63.3 | 66 | 0.683 (CI 95%: 0.67–0.697) | 65.8 | 66.5 | 0.691 (CI 95%: 0.657–0.725) | 1, 8, 9, 14 | Age, BMI, Lynch, HB |
| 68.1 | 61.6 | 0.689 (CI 95%: 0.683–0.694) | 67.4 | 60 | 0.688 (CI 95%: 0.653–0.722) | 1, 5, 8, 14 | Age, Bleed, BMI, HB | |
| 62.7 | 62.4 | 0.671 (CI 95%: 0.666–0.677) | 63.1 | 62.2 | 0.671 (CI 95%: 0.646–0.697) | 1, 8, 9, 15 | Age, BMI, Lynch, RB | |
| 67.8 | 59.2 | 0.674 (CI 95%: 0.659–0.69) | 66.3 | 62.8 | 0.668 (CI 95%: 0.617–0.72) | 1, 2, 8, 14 | Age, Mp, BMI, HB | |
| 63.6 | 59.4 | 0.658 (CI 95%: 0.654–0.663) | 64.5 | 59.6 | 0.666 (CI 95%: 0.626–0.706) | 1, 3, 8, 9 | Age, Preg, BMI, Lynch | |
| 5 (4368) | 65.8 | 65 | 0.695 (CI 95%: 0.689–0.702) | 67.8 | 63.4 | 0.702 (CI 95%: 0.656–0.749) | 1, 2, 8, 13, 14 | Age, Mp, BMI, BC, HB |
| 63.6 | 63.5 | 0.692 (CI 95%: 0.688–0.697) | 66 | 63.6 | 0.701 (CI 95%: 0.665–0.737) | 1, 8, 9, 13, 15 | Age, BMI, Lynch, BC, RB | |
| 63.9 | 63.6 | 0.682 (CI 95%: 0.675–0.689) | 61.4 | 63.9 | 0.688 (CI 95%: 0.648–0.729) | 1, 2, 8, 9, 14 | Age, Mp, BMI, Lynch, HB | |
| 63.2 | 62.5 | 0.668 (CI 95%: 0.659–0.678) | 65.7 | 60.6 | 0.688 (CI 95%: 0.619–0.756) | 1, 2, 6, 8, 14 | Age, Mp, Hyp, BMI, HB | |
| 65.4 | 61.7 | 0.683 (CI 95%: 0.675–0.69) | 67.4 | 61.3 | 0.687 (CI 95%: 0.636–0.737) | 1, 8, 9, 12, 14 | Age, BMI, Lynch, TOS, HB | |
| 6 (8008) | 68.4 | 60.8 | 0.705 (CI 95%: 0.7–0.711) | 67.8 | 60.3 | 0.702 (CI 95%: 0.653–0.751) | 1, 6, 7, 8, 14, 16 | Age, Hyp, Dia, BMI, HB, D&C |
| 66.2 | 66.7 | 0.708 (CI 95%: 0.702–0.714) | 64.8 | 66.4 | 0.696 (CI 95%: 0.64–0.752) | 1, 7, 8, 9, 11, 14 | Age, Dia, BMI, Lynch, OC, HB | |
| 68.6 | 63.9 | 0.708 (CI 95%: 0.698–0.718) | 67.4 | 63.5 | 0.694 (CI 95%: 0.609–0.779) | 1, 2, 7, 8, 9, 14 | Age, Mp, Dia, BMI, Lynch, HB | |
| 67.1 | 61.5 | 0.699 (CI 95%: 0.693–0.704) | 65.8 | 61.1 | 0.693 (CI 95%: 0.643–0.744) | 1, 5, 8, 9, 11, 15 | Age, Bleed, BMI, Lynch, OC, RB | |
| 72.6 | 62.6 | 0.716 (CI 95%: 0.701–0.731) | 67.2 | 62.6 | 0.693 (CI 95%: 0.633–0.753) | 1, 2, 8, 9, 13, 14 | Age, Mp, BMI, Lynch, BC, HB | |
| 7 (11,440) | 69.9 | 62.5 | 0.707 (CI 95%: 0.687–0.728) | 70.3 | 62 | 0.71 (CI 95%: 0.667–0.753) | 1, 8, 9, 11, 13, 15, 16 | Age, BMI, Lynch, OC, BC, RB, D&C |
| 66.4 | 67.1 | 0.717 (CI 95%: 0.712–0.722) | 66 | 67.5 | 0.709 (CI 95%: 0.655–0.764) | 1, 2, 3, 4, 6, 8, 14 | Age, Mp, Preg, Smoke, Hyp, BMI, HB | |
| 66 | 63.5 | 0.7 (CI 95%: 0.692–0.708) | 68 | 64.7 | 0.705 (CI 95%: 0.667–0.744) | 1, 3, 7, 8, 9, 13, 14 | Age, Preg, Dia, BMI, Lynch, BC, HB | |
| 60.3 | 68.5 | 0.699 (CI 95%: 0.696–0.702) | 59.7 | 68.8 | 0.703 (CI 95%: 0.677–0.728) | 1, 3, 5, 6, 8, 9, 13 | Age, Preg, Bleed, Hyp, BMI, Lynch, BC | |
| 67.1 | 61.2 | 0.707 (CI 95%: 0.694–0.721) | 65.1 | 62.2 | 0.701 (CI 95%: 0.648–0.755) | 1, 6, 8, 9, 10, 13, 15 | Age, Hyp, BMI, Lynch, Tam, BC, RB | |
| 8 (12,870) | 67.1 | 67.2 | 0.738 (CI 95%: 0.696–0.781) | 66.5 | 65.3 | 0.736 (CI 95%: 0.643–0.828) | 1, 2, 6, 7, 8, 9, 10, 14 | Age, Mp, Hyp, Dia, BMI, Lynch, Tam, HB |
| 67 | 65.5 | 0.733 (CI 95%: 0.728–0.739) | 67.5 | 66.3 | 0.731 (CI 95%: 0.677–0.786) | 1, 2, 4, 6, 8, 13, 14, 16 | Age, Mp, Smoke, Hyp, BMI, BC, HB, D&C | |
| 70.9 | 63.6 | 0.733 (CI 95%: 0.726–0.74) | 70.1 | 63.5 | 0.729 (CI 95%: 0.662–0.797) | 1, 2, 5, 6, 8, 9, 10, 14 | Age, Mp, Bleed, Hyp, BMI, Lynch, Tam, HB | |
| 68.2 | 63.8 | 0.721 (CI 95%: 0.716–0.726) | 67.5 | 64.8 | 0.72 (CI 95%: 0.67–0.771) | 1, 4, 6, 7, 8, 9, 13, 15 | Age, Smoke, Hyp, Dia, BMI, Lynch, BC, RB | |
| 72.8 | 60.6 | 0.717 (CI 95%: 0.713–0.721) | 71.3 | 60.1 | 0.719 (CI 95%: 0.675–0.763) | 1, 5, 8, 9, 10, 12, 15, 16 | Age, Bleed, BMI, Lynch, Tam, TOS, RB, D&C | |
| 9 (11,440) | 69.1 | 66.2 | 0.731 (CI 95%: 0.727–0.735) | 67.5 | 67.5 | 0.722 (CI 95%: 0.672–0.773) | 1, 5, 6, 7, 8, 9, 12, 13, 15 | Age, Bleed, Hyp, Dia, BMI, Lynch, TOS, BC, RB |
| 66.8 | 67.1 | 0.741 (CI 95%: 0.735–0.746) | 63.9 | 68.2 | 0.721 (CI 95%: 0.65–0.793) | 1, 3, 6, 8, 9, 10, 13, 15, 16 | Age, Preg, Hyp, BMI, Lynch, Tam, BC, RB, D&C | |
| 68.7 | 66.1 | 0.732 (CI 95%: 0.727–0.737) | 67.4 | 66.8 | 0.72 (CI 95%: 0.663–0.778) | 1, 3, 4, 5, 6, 7, 8, 9, 14 | Age, Preg, Smoke, Bleed, Hyp, Dia, BMI, Lynch, HB | |
| 66.2 | 62.4 | 0.721 (CI 95%: 0.718–0.725) | 66.1 | 62.7 | 0.72 (CI 95%: 0.677–0.763) | 1, 3, 6, 7, 8, 10, 11, 14, 16 | Age, Preg, Hyp, Dia, BMI, Tam, OC, HB, D&C | |
| 71.8 | 62.1 | 0.729 (CI 95%: 0.711–0.747) | 73.6 | 61 | 0.717 (CI 95%: 0.651–0.783) | 2, 4, 5, 6, 7, 8, 10, 14, 15 | Mp, Smoke, Bleed, Hyp, Dia, BMI, Tam, HB, RB | |
| 10 (8008) | 69.2 | 67 | 0.754 (CI 95%: 0.747–0.761) | 68.4 | 67.1 | 0.752 (CI 95%: 0.681–0.824) | 1, 4, 6, 7, 8, 9, 12, 13, 14, 15 | Age, Smoke, Hyp, Dia, BMI, Lynch, TOS, BC, HB, RB |
| 68.5 | 66.3 | 0.743 (CI 95%: 0.739–0.748) | 69.6 | 65.1 | 0.749 (CI 95%: 0.709–0.789) | 1, 4, 6, 7, 8, 10, 11, 13, 14, 16 | Age, Smoke, Hyp, Dia, BMI, Tam, OC, BC, HB, D&C | |
| 70.9 | 66.3 | 0.753 (CI 95%: 0.74–0.765) | 72.6 | 65.2 | 0.745 (CI 95%: 0.686–0.804) | 1, 3, 5, 6, 8, 9, 10, 11, 12, 14 | Age, Preg, Bleed, Hyp, BMI, Lynch, Tam, OC, TOS, HB | |
| 75.5 | 58.5 | 0.736 (CI 95%: 0.732–0.741) | 76 | 58.8 | 0.738 (CI 95%: 0.685–0.791) | 1, 3, 5, 7, 8, 9, 11, 13, 14, 15 | Age, Preg, Bleed, Dia, BMI, Lynch, OC, BC, HB, RB | |
| 67.2 | 65.8 | 0.74 (CI 95%: 0.734–0.745) | 66 | 66.7 | 0.735 (CI 95%: 0.671–0.798) | 1, 6, 7, 8, 9, 11, 12, 13, 14, 15 | Age, Hyp, Dia, BMI, Lynch, OC, TOS, BC, HB, RB | |
| 11 (4368) | 68.9 | 64.9 | 0.749 (CI 95%: 0.744–0.754) | 68.3 | 65.7 | 0.752 (CI 95%: 0.7–0.805) | 1, 3, 4, 5, 6, 8, 9, 11, 13, 15, 16 | Age, Preg, Smoke, Bleed, Hyp, BMI, Lynch, OC, BC, RB, D&C |
| 72.5 | 64.6 | 0.756 (CI 95%: 0.752–0.76) | 71.6 | 65.7 | 0.75 (CI 95%: 0.703–0.797) | 1, 3, 4, 5, 6, 7, 8, 10, 11, 12, 14 | Age, Preg, Smoke, Bleed, Hyp, Dia, BMI, Tam, OC, TOS, HB | |
| 71.5 | 64.6 | 0.74 (CI 95%: 0.73–0.75) | 69.6 | 64.1 | 0.744 (CI 95%: 0.667–0.82) | 1, 4, 5, 6, 7, 8, 9, 11, 13, 14, 16 | Age, Smoke, Bleed, Hyp, Dia, BMI, Lynch, OC, BC, HB, D&C | |
| 67.2 | 67.5 | 0.746 (CI 95%: 0.738–0.753) | 65.3 | 67.9 | 0.742 (CI 95%: 0.678–0.807) | 1, 3, 6, 7, 8, 9, 10, 12, 13, 14, 15 | Age, Preg, Hyp, Dia, BMI, Lynch, Tam, TOS, BC, HB, RB | |
| 75.1 | 59.7 | 0.748 (CI 95%: 0.744–0.753) | 73.8 | 58.5 | 0.74 (CI 95%: 0.684–0.796) | 1, 2, 4, 6, 7, 8, 11, 12, 14, 15, 16 | Age, Mp, Smoke, Hyp, Dia, BMI, OC, TOS, HB, RB, D&C | |
| 12 (1820) | 67.1 | 68.6 | 0.753 (CI 95%: 0.747–0.758) | 68.1 | 68.9 | 0.76 (CI 95%: 0.706–0.814) | 1, 3, 4, 5, 6, 7, 8, 9, 12, 13, 15, 16 | Age, Preg, Smoke, Bleed, Hyp, Dia, BMI, Lynch, TOS, BC, RB, D&C |
| 73.3 | 66.2 | 0.755 (CI 95%: 0.747–0.764) | 72.6 | 65.8 | 0.754 (CI 95%: 0.681–0.826) | 1, 2, 3, 4, 5, 6, 7, 8, 10, 13, 14, 16 | Age, Mp, Preg, Smoke, Bleed, Hyp, Dia, BMI, Tam, BC, HB, D&C | |
| 68.4 | 67.5 | 0.751 (CI 95%: 0.744–0.758) | 68.4 | 66.9 | 0.753 (CI 95%: 0.695–0.812) | 1, 2, 3, 4, 6, 7, 8, 9, 11, 12, 15, 16 | Age, Mp, Preg, Smoke, Hyp, Dia, BMI, Lynch, OC, TOS, RB, D&C | |
| 64.4 | 69.4 | 0.747 (CI 95%: 0.74–0.754) | 67.4 | 69.8 | 0.753 (CI 95%: 0.701–0.805) | 1, 2, 3, 4, 5, 6, 8, 9, 10, 13, 14, 15 | Age, Mp, Preg, Smoke, Bleed, Hyp, BMI, Lynch, Tam, BC, HB, RB | |
| 73.4 | 61.6 | 0.741 (CI 95%: 0.735–0.747) | 73.2 | 60.8 | 0.748 (CI 95%: 0.689–0.808) | 1, 2, 3, 4, 6, 7, 8, 9, 11, 14, 15, 16 | Age, Mp, Preg, Smoke, Hyp, Dia, BMI, Lynch, OC, HB, RB, D&C | |
| 13 (560) | 73.2 | 66.2 | 0.765 (CI 95%: 0.76–0.771) | 71.7 | 65.5 | 0.756 (CI 95%: 0.707–0.805) | 1, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16 | Age, Bleed, Hyp, Dia, BMI, Lynch, Tam, OC, TOS, BC, HB, RB, D&C |
| 73.3 | 60.2 | 0.739 (CI 95%: 0.729–0.748) | 75.4 | 60.8 | 0.742 (CI 95%: 0.669–0.816) | 1, 2, 3, 4, 6, 7, 8, 9, 10, 11, 13, 14, 15 | Age, Mp, Preg, Smoke, Hyp, Dia, BMI, Lynch, Tam, OC, BC, HB, RB | |
| 72.2 | 65.9 | 0.749 (CI 95%: 0.743–0.755) | 72.2 | 64.2 | 0.741 (CI 95%: 0.68–0.802) | 1, 2, 3, 4, 5, 6, 7, 8, 9, 13, 14, 15, 16 | Age, Mp, Preg, Smoke, Bleed, Hyp, Dia, BMI, Lynch, BC, HB, RB, D&C | |
| 71.2 | 65 | 0.746 (CI 95%: 0.732–0.761) | 69.5 | 63.8 | 0.738 (CI 95%: 0.639–0.837) | 1, 2, 3, 4, 5, 6, 7, 8, 10, 13, 14, 15, 16 | Age, Mp, Preg, Smoke, Bleed, Hyp, Dia, BMI, Tam, BC, HB, RB, D&C | |
| 70.7 | 66 | 0.74 (CI 95%: 0.73–0.749) | 72.3 | 66.2 | 0.737 (CI 95%: 0.657–0.817) | 1, 2, 3, 4, 6, 7, 8, 9, 11, 12, 13, 14, 15 | Age, Mp, Preg, Smoke, Hyp, Dia, BMI, Lynch, OC, TOS, BC, HB, RB | |
| 14 (120) | 67.8 | 66.1 | 0.73 (CI 95%: 0.727–0.733) | 68.5 | 65.1 | 0.739 (CI 95%: 0.71–0.767) | 1, 2, 3, 4, 6, 7, 8, 9, 11, 12, 13, 14, 15, 16 | Age, Mp, Preg, Smoke, Hyp, Dia, BMI, Lynch, OC, TOS, BC, HB, RB, D&C |
| 75.4 | 62.1 | 0.737 (CI 95%: 0.703–0.77) | 72 | 62.6 | 0.727 (CI 95%: 0.649–0.804) | 1, 2, 3, 4, 5, 6, 8, 9, 10, 11, 12, 14, 15, 16 | Age, Mp, Preg, Smoke, Bleed, Hyp, BMI, Lynch, Tam, OC, TOS, HB, RB, D&C | |
| 72.3 | 62.3 | 0.738 (CI 95%: 0.734–0.742) | 71.5 | 63.6 | 0.726 (CI 95%: 0.681–0.77) | 1, 3, 4, 5, 6, 7, 8, 9, 10, 12, 13, 14, 15, 16 | Age, Preg, Smoke, Bleed, Hyp, Dia, BMI, Lynch, Tam, TOS, BC, HB, RB, D&C | |
| 65.9 | 67.2 | 0.724 (CI 95%: 0.718–0.73) | 65.9 | 66.7 | 0.723 (CI 95%: 0.661–0.786) | 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 14, 16 | Age, Mp, Preg, Smoke, Bleed, Hyp, Dia, BMI, Lynch, Tam, OC, TOS, HB, D&C | |
| 67.3 | 66.7 | 0.72 (CI 95%: 0.715–0.724) | 65.2 | 67.3 | 0.722 (CI 95%: 0.684–0.76) | 1, 2, 3, 4, 5, 6, 7, 8, 10, 11, 13, 14, 15, 16 | Age, Mp, Preg, Smoke, Bleed, Hyp, Dia, BMI, Tam, OC, BC, HB, RB, D&C | |
| 15 (16) | 70.3 | 68 | 0.753 (CI 95%: 0.741–0.766) | 70.4 | 67.7 | 0.743 (CI 95%: 0.642–0.844) | 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15 | Age, Mp, Preg, Smoke, Bleed, Hyp, Dia, BMI, Lynch, Tam, OC, TOS, BC, HB, RB |
| 68.5 | 66.1 | 0.728 (CI 95%: 0.714–0.742) | 66.4 | 64.9 | 0.713 (CI 95%: 0.629–0.796) | 1, 2, 3, 4, 5, 6, 7, 8, 9, 11, 12, 13, 14, 15, 16 | Age, Mp, Preg, Smoke, Bleed, Hyp, Dia, BMI, Lynch, OC, TOS, BC, HB, RB, D&C | |
| 64.2 | 66 | 0.711 (CI 95%: 0.696–0.725) | 65.9 | 65.9 | 0.708 (CI 95%: 0.629–0.786) | 1, 2, 3, 4, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16 | Age, Mp, Preg, Smoke, Hyp, Dia, BMI, Lynch, Tam, OC, TOS, BC, HB, RB, D&C | |
| 69.1 | 62.4 | 0.699 (CI 95%: 0.694–0.704) | 70.1 | 62 | 0.705 (CI 95%: 0.63–0.779) | 1, 2, 3, 4, 5, 6, 8, 9, 10, 11, 12, 13, 14, 15, 16 | Age, Mp, Preg, Smoke, Bleed, Hyp, BMI, Lynch, Tam, OC, TOS, BC, HB, RB, D&C | |
| 66 | 64.8 | 0.729 (CI 95%: 0.719–0.739) | 62.6 | 63.1 | 0.703 (CI 95%: 0.61–0.795) | 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 13, 14, 15, 16 | Age, Mp, Preg, Smoke, Bleed, Hyp, Dia, BMI, Lynch, Tam, OC, BC, HB, RB, D&C | |
1 Age; 2 Menopause (Mp); 3 previous pregnancies (Preg); 4 Smoking habit (Smoke); 5 abnormal uterine bleeding (bleed); 6 hypertension (Hyp); 7 diabet (Dia); 8 BMI; 9 hereditary Lynch syndrome (Lynch); 10 Previous Tamoxifen therapy (Tam); 11 hormonal therapy with OC (OC); 12 hormonal therapy use TOS (TOS); 13 previous breast cancer (BC); 14 hysteroscopically guided biopsy (HB); 15 hysteroscopic endometrial resection (RB); 16 D&C dilation and curettage. For each reduced model having N variables, an artificial neural network having 3*N nodes was used. Thus, for the two-variable model, a network of six nodes was used. For three variables, nine nodes, and so on. The number of nodes n is variable and is shown in the first column of the table. Many configurations were tested with different nodes, but this was the one with the best performance and the least number of nodes.