MoDisco Java Discover Benchmark

Execution time by project size

System Information

OS name	Windows Server 2008 R2
OS version	6.1
OS architecture	amd64
Number of processor cores	1
Processor name	Intel(R) Xeon(R) CPU E5450 @ 3.00GHz
Processor description	Intel64 Family 6 Model 23 Stepping 8
Processor cache size	0
System memory	4,0 GiB

Results Overview

Project	Average discovery time	Average save time	Number of model elements	Total size	Average file size	Total lines	Average lines per file	XMI size
org.eclipse.gmt.modisco.infra.browser	55,97s (σ = 0.544s)	1,09s (σ = 0.079s)	88651	514,4 KiB	6,9 KiB	14431	192	13,1 MiB
org.eclipse.jdt.debug	22m 21s (σ = 3.931s)	5,20s (σ = 0.433s)	339847	2,4 MiB	5,1 KiB	74704	159	46,5 MiB
org.eclipse.jdt.debug.ui	14m 0s (σ = 3.947s)	4,62s (σ = 0.886s)	323361	2,2 MiB	5,4 KiB	63383	154	46,1 MiB
org.eclipse.jface	18m 24s (σ = 2.001s)	5,99s (σ = 2.026s)	353767	3,1 MiB	8,3 KiB	103378	271	45,5 MiB
org.eclipse.jface.text	15m 32s (σ = 3.627s)	4,19s (σ = 0.09s)	309902	2,3 MiB	7,4 KiB	76791	237	41,1 MiB
org.eclipse.modisco.java.discoverer	38,54s (σ = 0.389s)	0,98s (σ = 0.202s)	70854	403,3 KiB	9,0 KiB	11471	254	10,5 MiB
org.eclipse.modisco.omg.smm	1m 32s (σ = 0.197s)	1,03s (σ = 0.0070s)	97806	1,3 MiB	10,8 KiB	40415	336	13,7 MiB
org.eclipse.pde.core	39m 25s (σ = 17.155s)	8,51s (σ = 2.193s)	460415	2,6 MiB	5,3 KiB	79881	157	62,9 MiB
org.eclipse.pde.ui	158m 9s (σ = 37.243s)	24,93s (σ = 10.956s)	1010177	5,5 MiB	6,0 KiB	161628	174	143,7 MiB
org.eclipse.ui.ide	49m 53s (σ = 21.32s)	0,00s (σ = 0.0s)	0	4,2 MiB	7,7 KiB	137196	243	0 bytes

Execution times per iteration

org.eclipse.gmt.modisco.infra.browser

iteration	relative execution time	time
1/3		56,56s
2/3		55,25s
3/3		56,11s

org.eclipse.jdt.debug

iteration	relative execution time	time
1/3		22m 27s
2/3		22m 19s
3/3		22m 18s

org.eclipse.jdt.debug.ui

iteration	relative execution time	time
1/3		14m 5s
2/3		13m 59s
3/3		13m 55s

org.eclipse.jface

iteration	relative execution time	time
1/3		18m 24s
2/3		18m 26s
3/3		18m 21s

org.eclipse.jface.text

iteration	relative execution time	time
1/3		15m 29s
2/3		15m 37s
3/3		15m 31s

org.eclipse.modisco.java.discoverer

iteration	relative execution time	time
1/3		39,02s
2/3		38,06s
3/3		38,53s

org.eclipse.modisco.omg.smm

iteration	relative execution time	time
1/3		1m 33s
2/3		1m 33s
3/3		1m 32s

org.eclipse.pde.core

iteration	relative execution time	time
1/3		39m 1s
2/3		39m 37s
3/3		39m 38s

org.eclipse.pde.ui

iteration	relative execution time	time
1/3		158m 50s
2/3		158m 18s
3/3		157m 20s

org.eclipse.ui.ide

iteration	relative execution time	time
1/3		50m 17s
2/3		49m 25s
3/3		49m 56s

Save times per iteration

org.eclipse.gmt.modisco.infra.browser

iteration	relative save time	time(s)
1/3		1,13s
2/3		0,99s
3/3		1,17s

org.eclipse.jdt.debug

iteration	relative save time	time(s)
1/3		5,59s
2/3		5,41s
3/3		4,59s

org.eclipse.jdt.debug.ui

iteration	relative save time	time(s)
1/3		3,69s
2/3		4,36s
3/3		5,81s

org.eclipse.jface

iteration	relative save time	time(s)
1/3		3,61s
2/3		5,81s
3/3		8,56s

org.eclipse.jface.text

iteration	relative save time	time(s)
1/3		4,17s
2/3		4,31s
3/3		4,09s

org.eclipse.modisco.java.discoverer

iteration	relative save time	time(s)
1/3		0,83s
2/3		1,27s
3/3		0,84s

org.eclipse.modisco.omg.smm

iteration	relative save time	time(s)
1/3		1,03s
2/3		1,03s
3/3		1,02s

org.eclipse.pde.core

iteration	relative save time	time(s)
1/3		9,92s
2/3		10,19s
3/3		5,41s

org.eclipse.pde.ui

iteration	relative save time	time(s)
1/3		40,19s
2/3		19,63s
3/3		14,97s

org.eclipse.ui.ide

iteration	relative save time	time(s)
1/3		0,00s
2/3		0,00s
3/3		0,00s

Detailed Results

org.eclipse.gmt.modisco.infra.browser

iteration 1

name: org.eclipse.gmt.modisco.infra.browser
date: Thu Jul 21 17:42:48 CEST 2011
algorithm:
discoverer: org.eclipse.modisco.java.discoverer.javaProjectToKDM v0.9.1.201107121436 (org.eclipse.modisco.java.discoverer.benchmark.kdm.KDMBenchmarkDiscoverer)
save time: 1,13s
execution time: 56,56s
metamodel variant:
max used memory: 383,0 MiB
number of model elements: 88651
XMI file size: 13,1 MiB

iteration 2

name: org.eclipse.gmt.modisco.infra.browser
date: Thu Jul 21 17:43:46 CEST 2011
algorithm:
discoverer: org.eclipse.modisco.java.discoverer.javaProjectToKDM v0.9.1.201107121436 (org.eclipse.modisco.java.discoverer.benchmark.kdm.KDMBenchmarkDiscoverer)
save time: 0,99s
execution time: 55,25s
metamodel variant:
max used memory: 445,0 MiB
number of model elements: 88651
XMI file size: 13,1 MiB

iteration 3

name: org.eclipse.gmt.modisco.infra.browser
date: Thu Jul 21 17:44:44 CEST 2011
algorithm:
discoverer: org.eclipse.modisco.java.discoverer.javaProjectToKDM v0.9.1.201107121436 (org.eclipse.modisco.java.discoverer.benchmark.kdm.KDMBenchmarkDiscoverer)
save time: 1,17s
execution time: 56,11s
metamodel variant:
max used memory: 445,1 MiB
number of model elements: 88651
XMI file size: 13,1 MiB

org.eclipse.jdt.debug

iteration 1

name: org.eclipse.jdt.debug
date: Thu Jul 21 18:07:14 CEST 2011
algorithm:
discoverer: org.eclipse.modisco.java.discoverer.javaProjectToKDM v0.9.1.201107121436 (org.eclipse.modisco.java.discoverer.benchmark.kdm.KDMBenchmarkDiscoverer)
save time: 5,59s
execution time: 22m 27s
metamodel variant:
max used memory: 1014,6 MiB
number of model elements: 339847
XMI file size: 46,5 MiB

iteration 2

name: org.eclipse.jdt.debug
date: Thu Jul 21 18:29:43 CEST 2011
algorithm:
discoverer: org.eclipse.modisco.java.discoverer.javaProjectToKDM v0.9.1.201107121436 (org.eclipse.modisco.java.discoverer.benchmark.kdm.KDMBenchmarkDiscoverer)
save time: 5,41s
execution time: 22m 19s
metamodel variant:
max used memory: 1014,5 MiB
number of model elements: 339847
XMI file size: 46,5 MiB

iteration 3

name: org.eclipse.jdt.debug
date: Thu Jul 21 18:52:13 CEST 2011
algorithm:
discoverer: org.eclipse.modisco.java.discoverer.javaProjectToKDM v0.9.1.201107121436 (org.eclipse.modisco.java.discoverer.benchmark.kdm.KDMBenchmarkDiscoverer)
save time: 4,59s
execution time: 22m 18s
metamodel variant:
max used memory: 1014,6 MiB
number of model elements: 339847
XMI file size: 46,5 MiB

org.eclipse.jdt.debug.ui

iteration 1

name: org.eclipse.jdt.debug.ui
date: Thu Jul 21 19:06:27 CEST 2011
algorithm:
discoverer: org.eclipse.modisco.java.discoverer.javaProjectToKDM v0.9.1.201107121436 (org.eclipse.modisco.java.discoverer.benchmark.kdm.KDMBenchmarkDiscoverer)
save time: 3,69s
execution time: 14m 5s
metamodel variant:
max used memory: 1014,6 MiB
number of model elements: 323361
XMI file size: 46,1 MiB

iteration 2

name: org.eclipse.jdt.debug.ui
date: Thu Jul 21 19:20:34 CEST 2011
algorithm:
discoverer: org.eclipse.modisco.java.discoverer.javaProjectToKDM v0.9.1.201107121436 (org.eclipse.modisco.java.discoverer.benchmark.kdm.KDMBenchmarkDiscoverer)
save time: 4,36s
execution time: 13m 59s
metamodel variant:
max used memory: 1014,6 MiB
number of model elements: 323361
XMI file size: 46,1 MiB

iteration 3

name: org.eclipse.jdt.debug.ui
date: Thu Jul 21 19:34:40 CEST 2011
algorithm:
discoverer: org.eclipse.modisco.java.discoverer.javaProjectToKDM v0.9.1.201107121436 (org.eclipse.modisco.java.discoverer.benchmark.kdm.KDMBenchmarkDiscoverer)
save time: 5,81s
execution time: 13m 55s
metamodel variant:
max used memory: 1014,6 MiB
number of model elements: 323361
XMI file size: 46,1 MiB

org.eclipse.jface

iteration 1

name: org.eclipse.jface
date: Thu Jul 21 19:53:13 CEST 2011
algorithm:
discoverer: org.eclipse.modisco.java.discoverer.javaProjectToKDM v0.9.1.201107121436 (org.eclipse.modisco.java.discoverer.benchmark.kdm.KDMBenchmarkDiscoverer)
save time: 3,61s
execution time: 18m 24s
metamodel variant:
max used memory: 1014,5 MiB
number of model elements: 353767
XMI file size: 45,5 MiB

iteration 2

name: org.eclipse.jface
date: Thu Jul 21 20:11:47 CEST 2011
algorithm:
discoverer: org.eclipse.modisco.java.discoverer.javaProjectToKDM v0.9.1.201107121436 (org.eclipse.modisco.java.discoverer.benchmark.kdm.KDMBenchmarkDiscoverer)
save time: 5,81s
execution time: 18m 26s
metamodel variant:
max used memory: 1014,6 MiB
number of model elements: 353767
XMI file size: 45,5 MiB

iteration 3

name: org.eclipse.jface
date: Thu Jul 21 20:30:22 CEST 2011
algorithm:
discoverer: org.eclipse.modisco.java.discoverer.javaProjectToKDM v0.9.1.201107121436 (org.eclipse.modisco.java.discoverer.benchmark.kdm.KDMBenchmarkDiscoverer)
save time: 8,56s
execution time: 18m 21s
metamodel variant:
max used memory: 1014,8 MiB
number of model elements: 353767
XMI file size: 45,5 MiB

org.eclipse.jface.text

iteration 1

name: org.eclipse.jface.text
date: Thu Jul 21 20:46:03 CEST 2011
algorithm:
discoverer: org.eclipse.modisco.java.discoverer.javaProjectToKDM v0.9.1.201107121436 (org.eclipse.modisco.java.discoverer.benchmark.kdm.KDMBenchmarkDiscoverer)
save time: 4,17s
execution time: 15m 29s
metamodel variant:
max used memory: 1014,5 MiB
number of model elements: 309902
XMI file size: 41,1 MiB

iteration 2

name: org.eclipse.jface.text
date: Thu Jul 21 21:01:48 CEST 2011
algorithm:
discoverer: org.eclipse.modisco.java.discoverer.javaProjectToKDM v0.9.1.201107121436 (org.eclipse.modisco.java.discoverer.benchmark.kdm.KDMBenchmarkDiscoverer)
save time: 4,31s
execution time: 15m 37s
metamodel variant:
max used memory: 1014,6 MiB
number of model elements: 309903
XMI file size: 41,1 MiB

iteration 3

name: org.eclipse.jface.text
date: Thu Jul 21 21:17:30 CEST 2011
algorithm:
discoverer: org.eclipse.modisco.java.discoverer.javaProjectToKDM v0.9.1.201107121436 (org.eclipse.modisco.java.discoverer.benchmark.kdm.KDMBenchmarkDiscoverer)
save time: 4,09s
execution time: 15m 31s
metamodel variant:
max used memory: 1014,5 MiB
number of model elements: 309903
XMI file size: 41,1 MiB

org.eclipse.modisco.java.discoverer

iteration 1

name: org.eclipse.modisco.java.discoverer
date: Thu Jul 21 21:18:16 CEST 2011
algorithm:
discoverer: org.eclipse.modisco.java.discoverer.javaProjectToKDM v0.9.1.201107121436 (org.eclipse.modisco.java.discoverer.benchmark.kdm.KDMBenchmarkDiscoverer)
save time: 0,83s
execution time: 39,02s
metamodel variant:
max used memory: 1014,6 MiB
number of model elements: 70854
XMI file size: 10,5 MiB

iteration 2

name: org.eclipse.modisco.java.discoverer
date: Thu Jul 21 21:18:57 CEST 2011
algorithm:
discoverer: org.eclipse.modisco.java.discoverer.javaProjectToKDM v0.9.1.201107121436 (org.eclipse.modisco.java.discoverer.benchmark.kdm.KDMBenchmarkDiscoverer)
save time: 1,27s
execution time: 38,06s
metamodel variant:
max used memory: 1014,6 MiB
number of model elements: 70854
XMI file size: 10,5 MiB

iteration 3

name: org.eclipse.modisco.java.discoverer
date: Thu Jul 21 21:19:38 CEST 2011
algorithm:
discoverer: org.eclipse.modisco.java.discoverer.javaProjectToKDM v0.9.1.201107121436 (org.eclipse.modisco.java.discoverer.benchmark.kdm.KDMBenchmarkDiscoverer)
save time: 0,84s
execution time: 38,53s
metamodel variant:
max used memory: 987,3 MiB
number of model elements: 70854
XMI file size: 10,5 MiB

org.eclipse.modisco.omg.smm

iteration 1

name: org.eclipse.modisco.omg.smm
date: Thu Jul 21 21:21:14 CEST 2011
algorithm:
discoverer: org.eclipse.modisco.java.discoverer.javaProjectToKDM v0.9.1.201107121436 (org.eclipse.modisco.java.discoverer.benchmark.kdm.KDMBenchmarkDiscoverer)
save time: 1,03s
execution time: 1m 33s
metamodel variant:
max used memory: 881,2 MiB
number of model elements: 97806
XMI file size: 13,7 MiB

iteration 2

name: org.eclipse.modisco.omg.smm
date: Thu Jul 21 21:22:49 CEST 2011
algorithm:
discoverer: org.eclipse.modisco.java.discoverer.javaProjectToKDM v0.9.1.201107121436 (org.eclipse.modisco.java.discoverer.benchmark.kdm.KDMBenchmarkDiscoverer)
save time: 1,03s
execution time: 1m 33s
metamodel variant:
max used memory: 881,0 MiB
number of model elements: 97806
XMI file size: 13,7 MiB

iteration 3

name: org.eclipse.modisco.omg.smm
date: Thu Jul 21 21:24:25 CEST 2011
algorithm:
discoverer: org.eclipse.modisco.java.discoverer.javaProjectToKDM v0.9.1.201107121436 (org.eclipse.modisco.java.discoverer.benchmark.kdm.KDMBenchmarkDiscoverer)
save time: 1,02s
execution time: 1m 32s
metamodel variant:
max used memory: 881,0 MiB
number of model elements: 97806
XMI file size: 13,7 MiB

org.eclipse.pde.core

iteration 1

name: org.eclipse.pde.core
date: Thu Jul 21 22:03:29 CEST 2011
algorithm:
discoverer: org.eclipse.modisco.java.discoverer.javaProjectToKDM v0.9.1.201107121436 (org.eclipse.modisco.java.discoverer.benchmark.kdm.KDMBenchmarkDiscoverer)
save time: 9,92s
execution time: 39m 1s
metamodel variant:
max used memory: 1,1 GiB
number of model elements: 460415
XMI file size: 62,9 MiB

iteration 2

name: org.eclipse.pde.core
date: Thu Jul 21 22:43:22 CEST 2011
algorithm:
discoverer: org.eclipse.modisco.java.discoverer.javaProjectToKDM v0.9.1.201107121436 (org.eclipse.modisco.java.discoverer.benchmark.kdm.KDMBenchmarkDiscoverer)
save time: 10,19s
execution time: 39m 37s
metamodel variant:
max used memory: 1,4 GiB
number of model elements: 460415
XMI file size: 62,9 MiB

iteration 3

name: org.eclipse.pde.core
date: Thu Jul 21 23:23:14 CEST 2011
algorithm:
discoverer: org.eclipse.modisco.java.discoverer.javaProjectToKDM v0.9.1.201107121436 (org.eclipse.modisco.java.discoverer.benchmark.kdm.KDMBenchmarkDiscoverer)
save time: 5,41s
execution time: 39m 38s
metamodel variant:
max used memory: 1,4 GiB
number of model elements: 460415
XMI file size: 62,9 MiB

org.eclipse.pde.ui

iteration 1

name: org.eclipse.pde.ui
date: Fri Jul 22 02:02:15 CEST 2011
algorithm:
discoverer: org.eclipse.modisco.java.discoverer.javaProjectToKDM v0.9.1.201107121436 (org.eclipse.modisco.java.discoverer.benchmark.kdm.KDMBenchmarkDiscoverer)
save time: 40,19s
execution time: 158m 50s
metamodel variant:
max used memory: 2,4 GiB
number of model elements: 1010177
XMI file size: 143,7 MiB

iteration 2

name: org.eclipse.pde.ui
date: Fri Jul 22 04:41:23 CEST 2011
algorithm:
discoverer: org.eclipse.modisco.java.discoverer.javaProjectToKDM v0.9.1.201107121436 (org.eclipse.modisco.java.discoverer.benchmark.kdm.KDMBenchmarkDiscoverer)
save time: 19,63s
execution time: 158m 18s
metamodel variant:
max used memory: 2,4 GiB
number of model elements: 1010177
XMI file size: 143,7 MiB

iteration 3

name: org.eclipse.pde.ui
date: Fri Jul 22 07:19:20 CEST 2011
algorithm:
discoverer: org.eclipse.modisco.java.discoverer.javaProjectToKDM v0.9.1.201107121436 (org.eclipse.modisco.java.discoverer.benchmark.kdm.KDMBenchmarkDiscoverer)
save time: 14,97s
execution time: 157m 20s
metamodel variant:
max used memory: 2,4 GiB
number of model elements: 1010177
XMI file size: 143,7 MiB

org.eclipse.ui.ide

iteration 1

name: org.eclipse.ui.ide
date: Fri Jul 22 08:10:04 CEST 2011
algorithm:
discoverer: org.eclipse.modisco.java.discoverer.javaProjectToKDM v0.9.1.201107121436 (org.eclipse.modisco.java.discoverer.benchmark.kdm.KDMBenchmarkDiscoverer)
save time: 0,00s
execution time: 50m 17s
metamodel variant:
max used memory: 2,4 GiB
number of model elements: 0
XMI file size: 0 bytes
Discovery error:
org.eclipse.m2m.atl.engine.vm.VMException: Feature type does not exist on java!SingleVariableAccess
at A.CreateUsesType(1 : Mjava!TypeAccess;) : ??#32(javaToKdm.atl[1887:10-1887:18])
local variables = {tgt=OUT!, src=IN!, self=javaToKdm : ASMModule}
local stack = [OUT!, OUT!, javaToKdm : ASMModule]

iteration 2

name: org.eclipse.ui.ide
date: Fri Jul 22 08:59:35 CEST 2011
algorithm:
discoverer: org.eclipse.modisco.java.discoverer.javaProjectToKDM v0.9.1.201107121436 (org.eclipse.modisco.java.discoverer.benchmark.kdm.KDMBenchmarkDiscoverer)
save time: 0,00s
execution time: 49m 25s
metamodel variant:
max used memory: 2,4 GiB
number of model elements: 0
XMI file size: 0 bytes
Discovery error:
org.eclipse.m2m.atl.engine.vm.VMException: Feature type does not exist on java!SingleVariableAccess
at A.CreateUsesType(1 : Mjava!TypeAccess;) : ??#32(javaToKdm.atl[1887:10-1887:18])
local variables = {tgt=OUT!, src=IN!, self=javaToKdm : ASMModule}
local stack = [OUT!, OUT!, javaToKdm : ASMModule]

iteration 3

name: org.eclipse.ui.ide
date: Fri Jul 22 09:49:37 CEST 2011
algorithm:
discoverer: org.eclipse.modisco.java.discoverer.javaProjectToKDM v0.9.1.201107121436 (org.eclipse.modisco.java.discoverer.benchmark.kdm.KDMBenchmarkDiscoverer)
save time: 0,00s
execution time: 49m 56s
metamodel variant:
max used memory: 2,4 GiB
number of model elements: 0
XMI file size: 0 bytes
Discovery error:
org.eclipse.m2m.atl.engine.vm.VMException: Feature type does not exist on java!SingleVariableAccess
at A.CreateUsesType(1 : Mjava!TypeAccess;) : ??#32(javaToKdm.atl[1887:10-1887:18])
local variables = {tgt=OUT!, src=IN!, self=javaToKdm : ASMModule}
local stack = [OUT!, OUT!, javaToKdm : ASMModule]

This report has been generated with MoDisco Java Discoverer Benchmark.