Experiment 3: Benchmark

Detector: Findbugs

Project Version Result # of Findings Runtime Misuse Violation Types Decision Reviews Your Review Your Comment Tags

aclang

587

success

27

14.4

s

1

  • missing/condition/null_check
view

2

  • missing/condition/null_check
view

acmath

998

success

13

55.1

s

1

  • missing/condition/null_check
view

2

  • missing/condition/null_check
view

adempiere

1312

success

72

19.9

s

1

  • missing/call
  • superfluous/call
view

2

  • missing/call
  • superfluous/call
view

alibaba-druid

e10f28

success

145

57.6

s

1

  • missing/call
view

2

  • missing/exception handling
view

closure

114

success

36

40.6

s

1

  • superfluous/condition/null_check
view

319

success

52

73.8

s

2

  • missing/exception handling
view

dmmc-1023

  • missing/condition/value_or_state
view

dmmc-13

  • missing/condition/value_or_state
view

findbugs-0

  • missing/condition/null_check
view

findbugs-10

  • missing/call
  • superfluous/call
view

findbugs-13

  • missing/condition/value_or_state
view

findbugs-16

  • superfluous/value_or_state
view

findbugs-17

  • superfluous/value_or_state
view

findbugs-18

  • superfluous/call
view

findbugs-19

  • missing/call
  • superfluous/call
view

findbugs-3

  • missing/condition/null_check
view

findbugs-4

  • missing/condition/null_check
view

findbugs-5

  • missing/condition/null_check
view

findbugs-6

  • missing/condition/null_check
view

findbugs-7

  • missing/call
  • superfluous/call
view

findbugs-9

  • missing/condition/null_check
view

mudetect-12

view

mudetect-13

view

mudetect-17

view

mudetect-18

view

tikanga-2

  • missing/condition/value_or_state
view

tikanga-6

  • missing/condition/value_or_state
view

884

success

103

54.1

s

3

  • missing/condition/null_check
view

itext

5091

success

352

45.9

s

1

  • missing/exception handling
view

dmmc-15

  • missing/condition/value_or_state
view

dmmc-16

  • missing/condition/value_or_state
view

dmmc-18

  • missing/condition/value_or_state
view

dmmc-357

  • missing/condition/value_or_state
view

dmmc-61

  • missing/condition/value_or_state
view

dmmc-937

  • missing/condition/value_or_state
view

findbugs-4

  • missing/condition/null_check
view

findbugs-5

  • missing/condition/null_check
view

findbugs-6

  • missing/condition/null_check
view

findbugs-7

  • missing/call
view

jadet-5

  • missing/condition/value_or_state
view

jadet-9

  • missing/condition/value_or_state
view

mudetect-15

view

jmrtd

51

success

47

15.5

s

1

  • missing/call
view

findbugs-0

  • missing/condition/null_check
view

findbugs-1

  • missing/condition/null_check
view

findbugs-10

  • superfluous/call
view

findbugs-11

  • missing/exception handling
  • superfluous/exception handling
view

findbugs-12

  • missing/exception handling
  • superfluous/exception handling
view

findbugs-13

  • missing/call
  • superfluous/call
view

findbugs-14

  • missing/call
  • superfluous/call
view

findbugs-15

  • missing/call
  • superfluous/call
view

findbugs-16

  • missing/call
  • superfluous/call
view

findbugs-17

  • missing/call
  • superfluous/call
view

findbugs-18

  • missing/call
  • superfluous/call
view

findbugs-19

  • missing/call
  • superfluous/call
view

findbugs-2

  • missing/condition/value_or_state
view

findbugs-3

  • missing/condition/value_or_state
view

findbugs-4

  • missing/condition/value_or_state
view

findbugs-5

  • missing/condition/value_or_state
view

findbugs-6

  • missing/condition/value_or_state
view

findbugs-7

  • missing/condition/value_or_state
view

findbugs-8

  • missing/condition/value_or_state
view

findbugs-9

  • missing/condition/value_or_state
view

67

success

51

9.7

s

2

  • missing/condition/value_or_state
view

jodatime

1231

success

2

5.2

s

1

  • missing/condition/null_check
view

findbugs-1

  • missing/call
  • superfluous/call
view

lucene

1251

success

80

28.2

s

1

  • missing/exception handling
view

1918

success

91

41.1

s

2

  • missing/exception handling
view

findbugs-0

  • superfluous/call
view

findbugs-16

  • missing/call
  • superfluous/call
view

findbugs-17

  • missing/call
  • superfluous/call
view

findbugs-18

  • missing/condition/synchronization
view

findbugs-19

  • missing/call
view

mudetect-5

view

mudetect-9

view

tikanga-0

  • missing/condition/value_or_state
view

tikanga-1

  • missing/condition/value_or_state
view

207

success

50

15.2

s

3

  • missing/condition/value_or_state
view

754

success

63

19.9

s

5

  • missing/condition/value_or_state
view

rhino

286251

success

96

17.1

s

1

  • superfluous/call/duplicate
view