Experiment 3: Benchmark

Detector: MuDetectXProject_170626_XSupport

Project Version Result # of Findings Runtime Misuse Violation Types Decision Reviews Your Review Your Comment Tags

aclang

587

success

564

517.5

s

1

  • missing/condition/null_check
view

2

  • missing/condition/null_check
view

587.1

view

587.2

view

acmath

998

success

0

33.6

s

1

  • missing/condition/null_check
view

2

  • missing/condition/null_check
view

alibaba-druid

e10f28

success

156

422.2

s

1

  • missing/call
view

2

  • missing/exception handling
view

closure

114

success

0

18.2

s

1

  • superfluous/condition/null_check
view

319

success

227

494.3

s

2

  • missing/exception handling
view

dmmc-1023

  • missing/condition/value_or_state
view

dmmc-13

  • missing/condition/value_or_state
view

mudetect-12

  • missing/condition/value_or_state
view

mudetect-13

  • missing/condition/value_or_state
view

mudetect-18

  • missing/condition/value_or_state
view

tikanga-2

  • missing/condition/value_or_state
view

tikanga-6

  • missing/condition/value_or_state
view

httpclient

302

success

195

889.6

s

1

  • missing/call
view

444

success

27

220.5

s

2

  • missing/call
view

3

  • missing/call
view

452

success

0

219.6

s

4

  • missing/call
  • superfluous/call
view

itext

5091

success

1636

430.0

s

1

  • missing/exception handling
view

dmmc-15

  • missing/condition/value_or_state
view

dmmc-16

  • missing/condition/value_or_state
view

dmmc-18

  • missing/condition/value_or_state
view

dmmc-357

  • missing/condition/value_or_state
view

dmmc-61

  • missing/condition/value_or_state
view

dmmc-937

  • missing/condition/value_or_state
view

jadet-5

  • missing/condition/value_or_state
view

jadet-9

  • missing/condition/value_or_state
view

mudetect-15

  • missing/condition/value_or_state
view

jackrabbit

1601

success

0

18.7

s

1

  • missing/condition/null_check
view

1678

success

278

205.0

s

2

  • missing/condition/null_check
view

1694

success

0

18.5

s

3a

  • missing/call
view

3b

  • missing/call
view

1750

success

11

517.4

s

5

  • missing/call
view

jfreechart

1025

success

0

23.0

s

1

  • missing/call
view

2183

success

1450

715.2

s

5

  • missing/condition/null_check
view

881

success

763

305.1

s

7a

  • missing/condition/null_check
view

7b

  • missing/condition/null_check
view

jmrtd

51

success

3

514.8

s

1

  • missing/call
view

67

success

35

373.4

s

2

  • missing/condition/value_or_state
view

jodatime

1231

success

0

22.6

s

1

  • missing/condition/null_check
view

lucene

1251

success

18

511.9

s

1

  • missing/exception handling
view

1918

success

634

304.1

s

2

  • missing/exception handling
view

mudetect-5

  • missing/condition/value_or_state
view

mudetect-9

  • missing/condition/value_or_state
view

tikanga-0

  • missing/condition/value_or_state
view

tikanga-1

  • missing/condition/value_or_state
view

207

success

219

199.2

s

3

  • missing/condition/value_or_state
view

754

success

355

210.9

s

5

  • missing/condition/value_or_state
view

rhino

286251

success

496

737.6

s

1

  • superfluous/call/duplicate
view

synthetic

close-1

success

0

508.5

s

close-1

  • missing/call
view

close-2

success

1

498.9

s

close-2

  • missing/exception handling
view

cme

success

0

1,330.7

s

cme

  • superfluous/call
view

fisexists

success

1

196.0

s

fisexists

  • missing/condition/value_or_state
view

flush

success

0

2,085.6

s

flush

  • missing/call
view

hasnext

success

1

247.0

s

hasnext

  • missing/condition/value_or_state
view

listget

success

0

164.1

s

listget

  • missing/condition/value_or_state
view

mapkeynull

success

1

198.3

s

mapkeynull

  • missing/condition/null_check
view

mapnull

success

1

197.6

s

mapnull

  • missing/condition/value_or_state
view

nofile

success

0

1.9

s

nofile

  • missing/condition/value_or_state
view

setfirst

success

1

254.0

s

setfirst

  • missing/condition/value_or_state
view

unsynchronized

success

0

201.9

s

unsynchronized

  • missing/condition/threading
view