Table 3: Experimental results on 16 cases of applying Self-Attention to ResNet50.
Num of Self-Attention | Position of Self-Attention(conv_2, conv_3, conv_4, conv_5) | MRE (mm) | SD (mm) | (2mm) | SDR (%) (4mm) | (6mm) |
1 | T, F, F, F | 3.4038 | 6.2086 | 39.6441 | 83.2726 | 94.5052 |
F, T, F, F | 3.4564 | 4.3089 | 32.4653 | 74.3142 | 91.7188 |
F, F, T, F | 3.3054 | 4.8174 | 43.3507 | 77.9948 | 89.2014 |
F, F, F, T | 3.6580 | 5.1508 | 41.1719 | 72.4045 | 84.0885 |
2 | T, T, F, F | 3.0957 | 3.6377 | 42.0486 | 78.8281 | 92.1267 |
T, F, T, F | 3.3378 | 6.3228 | 45.5816 | 81.3802 | 93.9063 |
T, F, F, T | 3.1830 | 5.6842 | 44.2969 | 80.8594 | 93.5851 |
F, T, T, F | 3.5257 | 5.1822 | 39.9653 | 74.1667 | 89.3576 |
F, T, F, T | 3.9982 | 7.1549 | 39.9826 | 72.5955 | 86.6146 |
F, F, T, T | 3.6239 | 6.6797 | 38.4288 | 75.1042 | 91.7448 |
3 | T, T, T, F | 2.9997 | 3.8673 | 40.7986 | 81.4063 | 94.6788 |
T, T, F, T | 3.5314 | 6.3551 | 42.9688 | 77.9774 | 91.8142 |
T, F, T, T | 3.5173 | 6.3888 | 37.2917 | 80.0174 | 92.2830 |
F, T, T, T | 4.0847 | 5.7149 | 30.1736 | 68.2639 | 86.3715 |
4 | T, T, T, T | 3.2849 | 4.5663 | 31.7101 | 81.4497 | 94.0625 |
Self-Attention average | - | 3.4671 | 5.4693 | 39.3252 | 77.3356 | 91.0706 |
* MRE: Mean Radial Error, SD: Standard Deviation, SDR: Successful Detection Rate