Statistics: Results

Experiment 1

Agreements Disagreements Kappa
Detector Projects Synthetics Misuses Potential Hits Open Reviews Open '?' Yes No Total Yes/No No/Yes Total p0 pe Score Hits Recall
MuDetect 26 3 122 104 134 0 0 0 0 0 0 0 0 0 0 0 0%
MuDetectXP_180301_1_LabelVisitor 2 0 4 0 0 0 0 0 0 0 0 0 0 0 0 0 0%
MuDetect_180210_DataFlowThroughActionNodes 26 3 122 80 157 0 0 0 0 0 0 0 0 0 0 0 0%
MuDetect_180212_FixSeqOrder 25 3 121 103 200 0 0 0 0 0 0 0 0 0 0 0 0%
MuDetect_180213_IgnoreOrderOnlyConnections 54 4 170 141 273 0 0 0 0 0 0 0 0 0 0 0 0%
MuDetect_180214_ExcludeVeryPrevalent 55 4 171 17 34 0 0 0 0 0 0 0 0 0 0 0 0%
MuDetect_180214_NonDataDepCond_Catch 55 4 171 141 282 0 0 0 0 0 0 0 0 0 0 0 0%
MuDetect_180214_XMethodSupport 55 4 171 141 282 0 0 0 0 0 0 0 0 0 0 0 0%
MuDetect_180221_BestRanking 54 4 170 151 302 0 0 0 0 0 0 0 0 0 0 0 0%
MuDetect_180223_1_ExcludeInstancesAndQualifiers 54 4 170 151 302 0 0 0 0 0 0 0 0 0 0 0 0%
MuDetect_180223_2_SelIsRep 54 4 170 151 302 0 0 0 0 0 0 0 0 0 0 0 0%
MuDetect_180223_4_KeepInstanceFragments 55 4 171 152 304 0 0 0 0 0 0 0 0 0 0 0 0%
MuDetect_180223_5_FilterOnlyDefAndString 55 4 171 149 298 0 0 0 0 0 0 0 0 0 0 0 0%
MuDetect_180225_2_FixCleanup 54 4 170 148 296 0 0 0 0 0 0 0 0 0 0 0 0%
MuDetect_180227_1_ExtendOnlyDataFlow 55 4 171 149 298 0 0 0 0 0 0 0 0 0 0 0 0%
MuDetect_180301_1_LabelVisitor 9 0 14 9 18 0 0 0 0 0 0 0 0 0 0 0 0%
Total 55 4 171 1787 3482 0 0 0 0 0 0 0 0 0 0 0 0%

Experiment 2

:
Agreements Disagreements Kappa
Detector Projects Potential Hits Open Reviews Open '?' Yes No Total Yes/No No/Yes Total p0 pe Score Hits Precision
MuDetect 4 60 81 0 0 0 0 0 0 0 0 0 0 0 0%
MuDetectXP_180223_KeepInstanceFragments 3 28 28 0 0 0 0 0 0 0 0 0 0 0 0%
MuDetect_180210_DataFlowThroughActionNodes 5 100 199 0 0 0 0 0 0 0 0 0 0 0 0%
MuDetect_180212_FixSeqOrder 5 80 130 0 0 0 0 0 0 0 0 0 0 0 0%
MuDetect_180213_IgnoreOrderOnlyConnections 10 180 327 0 0 0 0 0 0 0 0 0 0 0 0%
MuDetect_180214_ExcludeVeryPrevalent 10 160 320 0 0 0 0 0 0 0 0 0 0 0 0%
MuDetect_180214_NonDataDepCond_Catch 10 180 331 0 0 0 0 0 0 0 0 0 0 0 0%
MuDetect_180214_XMethodSupport 10 180 360 0 0 0 0 0 0 0 0 0 0 0 0%
MuDetect_180216_10_FixSeveralHeuristics 10 153 306 0 0 0 0 0 0 0 0 0 0 0 0%
MuDetect_180216_11_IgnoreDataNodesForOverlap 10 171 171 0 0 0 0 0 0 0 0 0 0 0 0%
MuDetect_180216_12_AlwaysExtendDataNodes 10 147 294 0 0 0 0 0 0 0 0 0 0 0 0%
MuDetect_180219_1_FixOrder 10 100 200 0 0 0 0 0 0 0 0 0 0 0 0%
MuDetect_180219_2_FixCycle 10 140 280 0 0 0 0 0 0 0 0 0 0 0 0%
MuDetect_180219_3_FixCycle2 10 160 235 0 0 0 0 0 0 0 0 0 0 0 0%
MuDetect_180219_4_WithinMethodSupport 10 160 320 0 0 0 0 0 0 0 0 0 0 0 0%
MuDetect_180220_1_WithinMethodSupport4Real 10 180 360 0 0 0 0 0 0 0 0 0 0 0 0%
MuDetect_180221_BestRanking 10 161 161 0 0 0 0 0 0 0 0 0 0 0 0%
MuDetect_180223_1_ExcludeInstancesAndQualifiers 9 142 284 0 0 0 0 0 0 0 0 0 0 0 0%
MuDetect_180223_2_SelIsRep 9 142 227 0 0 0 0 0 0 0 0 0 0 0 0%
MuDetect_180223_4_KeepInstanceFragments 10 162 162 0 0 0 0 0 0 0 0 0 0 0 0%
MuDetect_180223_5_FilterOnlyDefAndString 10 137 158 0 0 0 0 0 0 0 0 0 0 0 0%
MuDetect_180225_2_FixCleanup 10 155 161 0 0 0 0 0 0 0 0 0 0 0 0%
MuDetect_180227_1_ExtendOnlyDataFlow 10 144 144 0 0 0 0 0 0 0 0 0 0 0 0%
MuDetect_180301_3_Assert 2 40 40 0 0 0 0 0 0 0 0 0 0 0 0%
Total 10 3262 5279 0 0 0 0 0 0 0 0 0 0 0 0%

Experiment 3

Agreements Disagreements Kappa
Detector Projects Misuses Potential Hits Open Reviews Open '?' Yes No Total Yes/No No/Yes Total p0 pe Score Hits Recall
MuDetect 26 142 15 15 0 0 0 0 0 0 0 0 0 0 0 0%
MuDetectRankComp_180220_1_AllInOne 10 67 39 76 0 0 0 0 0 0 0 0 0 0 0 0%
MuDetectRankComp_180220_2_TotalOrder 10 67 43 44 0 0 0 0 0 0 0 0 0 0 0 0%
MuDetectRankComp_180222_ExcludeInstances 10 67 53 53 0 0 0 0 0 0 0 0 0 0 0 0%
MuDetectXP 24 100 28 28 0 0 0 0 0 0 0 0 0 0 0 0%
MuDetectXP_180220_1_up2date 1 40 1 1 0 0 0 0 0 0 0 0 0 0 0 0%
MuDetectXP_180227_1_ExtendOnlyDataFlow 12 92 68 68 0 0 0 0 0 0 0 0 0 0 0 0%
MuDetectXP_180301_1_LabelVisitor 51 214 109 217 0 0 0 0 0 0 0 0 0 0 0 0%
MuDetect_180210_DataFlowThroughActionNodes 20 128 3 3 0 0 0 0 0 0 0 0 0 0 0 0%
MuDetect_180212_FixSeqOrder 26 142 15 30 0 0 0 0 0 0 0 0 0 0 0 0%
MuDetect_180213_IgnoreOrderOnlyConnections 56 213 106 109 0 0 0 0 0 0 0 0 0 0 0 0%
MuDetect_180214_ExcludeVeryPrevalent 49 202 34 50 0 0 0 0 0 0 0 0 0 0 0 0%
MuDetect_180214_NonDataDepCond_Catch 49 202 95 149 0 0 0 0 0 0 0 0 0 0 0 0%
MuDetect_180214_XMethodSupport 49 202 92 144 0 0 0 0 0 0 0 0 0 0 0 0%
MuDetect_180215_ExcludeVeryPrevalentFixed 10 67 41 41 0 0 0 0 0 0 0 0 0 0 0 0%
MuDetect_180216_10_FixSeveralHeuristics 10 67 35 35 0 0 0 0 0 0 0 0 0 0 0 0%
MuDetect_180216_11_IgnoreDataNodesForOverlap 10 67 37 37 0 0 0 0 0 0 0 0 0 0 0 0%
MuDetect_180216_12_AlwaysExtendDataNodes 10 67 37 37 0 0 0 0 0 0 0 0 0 0 0 0%
MuDetect_180219_1_FixOrder 10 67 22 44 0 0 0 0 0 0 0 0 0 0 0 0%
MuDetect_180219_2_FixCycle 10 67 34 34 0 0 0 0 0 0 0 0 0 0 0 0%
MuDetect_180219_3_FixCycle2 10 67 41 75 0 0 0 0 0 0 0 0 0 0 0 0%
MuDetect_180219_4_WithinMethodSupport 10 67 41 41 0 0 0 0 0 0 0 0 0 0 0 0%
MuDetect_180220_1_WithinMethodSupport4Real 10 67 43 43 0 0 0 0 0 0 0 0 0 0 0 0%
MuDetect_180221_BestRanking 49 202 71 142 0 0 0 0 0 0 0 0 0 0 0 0%
MuDetect_180223_1_ExcludeInstancesAndQualifiers 49 202 66 111 0 0 0 0 0 0 0 0 0 0 0 0%
MuDetect_180223_2_SelIsRep 49 202 66 66 0 0 0 0 0 0 0 0 0 0 0 0%
MuDetect_180223_3_Backtracking 2 17 4 4 0 0 0 0 0 0 0 0 0 0 0 0%
MuDetect_180223_4_KeepInstanceFragments 49 202 80 80 0 0 0 0 0 0 0 0 0 0 0 0%
MuDetect_180223_5_FilterOnlyDefAndString 49 202 69 69 0 0 0 0 0 0 0 0 0 0 0 0%
MuDetect_180225_2_FixCleanup 49 202 62 62 0 0 0 0 0 0 0 0 0 0 0 0%
MuDetect_180227_1_ExtendOnlyDataFlow 49 202 60 81 0 0 0 0 0 0 0 0 0 0 0 0%
MuDetect_180301_1_LabelVisitor 10 63 49 49 0 0 0 0 0 0 0 0 0 0 0 0%
MuDetect_180301_2_TrueSelIsRep 7 58 47 47 0 0 0 0 0 0 0 0 0 0 0 0%
MuDetect_180301_3_Assert 10 63 47 47 0 0 0 0 0 0 0 0 0 0 0 0%
MuDetect_180301_4_FilterOnlyMissingAssignment 10 63 47 81 0 0 0 0 0 0 0 0 0 0 0 0%
MuDetect_180301_5_OnlyDataFlow 10 63 49 49 0 0 0 0 0 0 0 0 0 0 0 0%
MuDetect_180301_6_HoansFixes 10 63 47 47 0 0 0 0 0 0 0 0 0 0 0 0%
Total 56 223 1796 2309 0 0 0 0 0 0 0 0 0 0 0 0%