Table 3: Experimental results on 16 cases of applying Self-Attention to ResNet50.

Num of Self-Attention Position of Self-Attention(conv_2, conv_3, conv_4, conv_5) MRE (mm) SD (mm) (2mm) SDR (%) (4mm) (6mm)
1 T, F, F, F 3.4038 6.2086 39.6441 83.2726 94.5052
F, T, F, F 3.4564 4.3089 32.4653 74.3142 91.7188
F, F, T, F 3.3054 4.8174 43.3507 77.9948 89.2014
F, F, F, T 3.6580 5.1508 41.1719 72.4045 84.0885
2 T, T, F, F 3.0957 3.6377 42.0486 78.8281 92.1267
T, F, T, F 3.3378 6.3228 45.5816 81.3802 93.9063
T, F, F, T 3.1830 5.6842 44.2969 80.8594 93.5851
F, T, T, F 3.5257 5.1822 39.9653 74.1667 89.3576
F, T, F, T 3.9982 7.1549 39.9826 72.5955 86.6146
F, F, T, T 3.6239 6.6797 38.4288 75.1042 91.7448
3 T, T, T, F 2.9997 3.8673 40.7986 81.4063 94.6788
T, T, F, T 3.5314 6.3551 42.9688 77.9774 91.8142
T, F, T, T 3.5173 6.3888 37.2917 80.0174 92.2830
F, T, T, T 4.0847 5.7149 30.1736 68.2639 86.3715
4 T, T, T, T 3.2849 4.5663 31.7101 81.4497 94.0625
Self-Attention average - 3.4671 5.4693 39.3252 77.3356 91.0706
* MRE: Mean Radial Error, SD: Standard Deviation, SDR: Successful Detection Rate