Statistics: Experiment 3

Results

Agreements Disagreements Kappa
Detector Projects Misuses Potential Hits Open Reviews Open '?' Yes No Total Yes/No No/Yes Total p0 pe Score Hits Recall
DMMC 21 37 12 0 0 0 12 12 0 0 0 1 0 1 0 0%
Findbugs 10 16 3 0 0 2 1 3 0 0 0 1 0.222 1 2 12.5%
GrouMiner 21 36 0 0 0 0 0 0 0 0 0 0 0 0 0 0%
Jadet 22 36 0 0 0 0 0 0 0 0 0 0 0 0 0 0%
Tikanga 22 36 1 0 0 0 1 1 0 0 0 1 0 1 0 0%
Total 25 43 16 0 0 2 14 16 0 0 0 1 0.109 1 2 0.9%

Misuses

Project Version Misuse DMMC Findbugs GrouMiner Jadet Tikanga
axis1 1.2 SV_CVE_12_5784
axis1 1.2 SV_CVE_12_5784_1
axis1 1.2 SV_CVE_12_5784_2
commons-httpclient 4.2.1 SV_CVE_12_6153
bctls 1.58 SV_CVE_17_13098
cloudstack 4.2.0 SV_CVE_13_6398_1
cloudstack 4.2.0 SV_CVE_13_6398_2
wss4j1 2.0.1 SV_CVE_15_0226
wss4j2 2.0.0 SV_CVE_15_0227_1
wss4j2 2.0.0 SV_CVE_15_0227_2
wss4j2 2.0.0 SV_CVE_15_0227_3
wss4j2 2.0.0 SV_CVE_15_0227_4
wss4j3 2.0.1 CVE_14_3623_1
wss4j3 2.0.1 SV_CVE_14_3623_1
santuario-xml-security 1.5.4 SV_CVE_13_2172_1
santuario-xml-security 1.5.4 SV_CVE_13_2172_2
sling 2.1.0 SV_CVE_12_2138_1
wicket 6.0.0 SV_CVE_16_6793
cloudstack2 4.3.0 SV_CVE_14_9593_2
odata4j 0.6 SV_CVE_14_0171
undertow 1.2 SV_CVE_14_7816
uberfire 0.3.1 SV_CVE_14_8114_1
uberfire 0.3.1 SV_CVE_14_8114_2
uberfire 0.3.1 SV_CVE_14_8114_3
commons-jelly 1.0.1 SV_CVE_17_12621
hawtio2 1.2.3 SV_CVE_14_0121_1
hawtio2 1.2.3 SV_CVE_14_0121_2
hawtio 1.2.1 SV_CVE_14_0120_1
xalan 2.7.1 CVE_14_0107_1
xalan 2.7.1 CVE_14_0107_2
xalan 2.7.1 CVE_14_0107_3
xalan 2.7.1 CVE_14_0107_4
solr 4.5.1 SV_CVE_13_6397_1
solr 4.5.1 SV_CVE_13_6397_2
solr 4.5.1 SV_CVE_13_6397_3
javamelody 1.45.0 SV_CVE_14_4378
derby 10.10.2 SV_CVE_15_1832
derby 10.10.2.0 SV_CVE_15_1832
qpid1 6.0.5 SV_CVE_11_1111
qpid1 6.0.5 SV_CVE_16_8741
qpid2 6.0.1 SV_CVE_16_4432_1
qpid2 6.0.1 SV_CVE_16_4432_2
qpid2 6.0.1 SV_CVE_16_4432_3
qpid3 6.0.2 SV_CVE_16_3094