References
See [http://wiki.osgeo.org/wiki/Benchmarking_2009]
Observations
Between GS 1.7.0 and GS 2.0 there were some significant improvements:
- SDE got significantly faster
- Oracle one improved as well
- Labelling got faster, despite 1.7.0 not supporting the more expensive curved labels
However, GS 2.0 was benchmarked by mistake with a high PNG compression ratio compared to GS 1.7.0 and MapServer, resulting in generally weaker results in many tests.
FOSS4G 2009 - edges merge
Big simple line shapefile with cased line rendering and multiple road classes. 1:10k to 1:100k scales, random screen sized requests.
|
Shapefiles
| |
1 |
10 |
20 |
40 |
| MS 5.6b3 fcgi |
8.2 |
17.1 |
16.8 |
17.6 |
| GS 1.7.0 |
7.9 |
15.1 |
12.6 |
14.6 |
| GS 2.0.0 |
7.6 |
15 |
13.1 |
15.1 |
| GS 2.0.1 |
8.4 |
16.4 |
14.2 |
16.2 |
|
 |
|
PostGIS
| |
1 |
10 |
20 |
40 |
| MS 5.6b3 fcgi |
6.6 |
15.8 |
15.1 |
16.4 |
| GS 1.7.0 |
9.0 |
19.1 |
16.6 |
18.1 |
| GS 2.0.0 |
7.2 |
16.3 |
14.8 |
16.6 |
| GS 2.0.1 |
7.9 |
18.3 |
16.3 |
18.5 |
|
 |
|
Oracle
| |
1 |
10 |
20 |
40 |
| MS 5.6b3 fcgi |
5.6 |
12.6 |
11.6 |
12.8 |
| GS 1.7.0 |
5.3 |
16.1 |
13.9 |
15.7 |
| GS 2.0.0 |
5.9 |
12.5 |
11.5 |
12.7 |
| GS 2.0.1 |
6.7 |
13.7 |
11.3 |
13.5 |
|
 |
|
SDE
(GeoServer 2.0.x results not available since the SDE license expired)
| |
1 |
10 |
20 |
40 |
| MS 5.6b3 fcgi |
4.7 |
11.1 |
9.7 |
11 |
| GS 1.7.0 |
4.3 |
5.9 |
4.8 |
5.6 |
| GS 2.0.0 |
6.1 |
13.3 |
11.6 |
13 |
|
 |
FOSS4G 2009 - edges merge labelled
Big simple line shapefile with cased line rendering and multiple road classes and labels following lines where supported (the only one not supporting them is GS 1.7.0). 1:3k to 1:10k scales, random screen sized requests.
|
Shapefile
| |
1 |
10 |
20 |
40 |
| MS 5.6b3 fcgi |
8.2 |
17.1 |
16.8 |
17.6 |
| GS 1.7.0 |
4.9 |
10.6 |
11.1 |
10.9 |
| GS 2.0.0 |
6.3 |
13.4 |
13.9 |
13.2 |
| GS 2.0.1 |
9 |
14.7 |
15.2 |
15 |
|
 |
|
PostGIS
| |
1 |
10 |
20 |
40 |
| MS 5.6b3 fcgi |
8 |
18.6 |
19.4 |
19.1 |
| GS 1.7.0 |
5.6 |
10.7 |
11.1 |
11.0 |
| GS 2.0.0 |
6.6 |
14.3 |
14.9 |
14.7 |
| GS 2.0.1 |
7.1 |
16.2 |
15.6 |
16.5 |
|
 |
|
Oracle
| |
1 |
10 |
20 |
40 |
| MS 5.6b3 fcgi |
6.8 |
16.8 |
17.5 |
17.3 |
| GS 1.7.0 |
4.0 |
10.2 |
10.8 |
10.7 |
| GS 2.0.0 |
6 |
13.2 |
13.9 |
13.5 |
| GS 2.0.1 |
6.5 |
14.6 |
15.1 |
14.9 |
|
 |
|
SDE
(GeoServer 2.0.x results not available since the SDE license expired)
| |
1 |
10 |
20 |
40 |
| MS 5.6b3 fcgi |
6.4 |
16.4 |
17.4 |
17.2 |
| GS 1.7.0 |
3.9 |
7.4 |
7.7 |
7.7 |
| GS 2.0.0 |
5.6 |
12.8 |
13.3 |
13.1 |
|
 |
FOSS4G 2009 - areawater
Relatively big polygon layer, simple solid fill rendering. 10k to 100k scales, random screen sized requests.
|
Shapefile
| |
1 |
10 |
20 |
40 |
| MS 5.6b3 fcgi |
12 |
25.8 |
26.2 |
26.8 |
| GS 1.7.0 |
13.3 |
31.2 |
32.2 |
30.9 |
| GS 2.0.0 |
11 |
25 |
25.2 |
25.1 |
| GS 2.0.1 |
12.8 |
30 |
31.2 |
30.4 |
|
 |
|
PostGIS
| |
1 |
10 |
20 |
40 |
| MS 5.6b3 fcgi |
10.1 |
23.7 |
24.2 |
24.5 |
| GS 1.7.0 |
12.9 |
30.8 |
31.0 |
31.6 |
| GS 2.0.0 |
10.7 |
24.4 |
25.2 |
25.7 |
| GS 2.0.1 |
12.4 |
30.6 |
31.3 |
32.7 |
|
 |
|
Oracle
| |
1 |
10 |
20 |
40 |
| MS 5.6b3 fcgi |
9.2 |
21.1 |
21.7 |
22 |
| GS 1.7.0 |
6.8 |
22.7 |
22.4 |
22.7 |
| GS 2.0.0 |
10.2 |
23.1 |
23.8 |
23 |
| GS 2.0.1 |
12 |
29.5 |
29.7 |
29.4 |
|
 |
|
SDE
(GeoServer 2.0.x results not available since the SDE license expired)
| |
1 |
10 |
20 |
40 |
| MS 5.6b3 fcgi |
8.9 |
22.3 |
23.2 |
23.6 |
| GS 1.7.0 |
8.4 |
15.5 |
15.2 |
15.9 |
| GS 2.0.0 |
9.5 |
23.3 |
23.6 |
23.3 |
|
 |
FOSS4G 2009 - GNIS 2009
Relatively small point layer, a dozen different icons used to depict different point classes. 10k to 100k scales, random screen sized requests.
|
Shapefile
| |
1 |
10 |
20 |
40 |
| MS 5.6b3 fcgi |
12.2 |
26.5 |
26.6 |
27.1 |
| GS 1.7.0 |
13.1 |
32.8 |
32.9 |
33.7 |
| GS 2.0.0 |
9.3 |
24.3 |
25 |
25.2 |
| GS 2.0.1 |
12.9 |
30.6 |
31 |
30.2 |
|
 |
|
PostGIS
| |
1 |
10 |
20 |
40 |
| MS 5.6b3 fcgi |
10.8 |
24.3 |
24.6 |
25 |
| GS 1.7.0 |
12.9 |
30.5 |
30.8 |
30.9 |
| GS 2.0.0 |
11 |
25.1 |
25.3 |
25.8 |
| GS 2.0.1 |
12.8 |
30.8 |
32.3 |
32.7 |
|
 |
|
Oracle
| |
1 |
10 |
20 |
40 |
| MS 5.6b3 fcgi |
9.8 |
23.3 |
23.4 |
23.9 |
| GS 1.7.0 |
7.0 |
22.7 |
23.2 |
23.2 |
| GS 2.0.0 |
10.5 |
25 |
25.2 |
24.6 |
| GS 2.0.1 |
12.4 |
30.6 |
29.1 |
32.5 |
|
 |
|
SDE
(GeoServer 2.0.x results not available since the SDE license expired)
| |
1 |
10 |
20 |
40 |
| MS 5.6b3 fcgi |
9.6 |
23.6 |
23.9 |
24.5 |
| GS 1.7.0 |
9.7 |
22.3 |
21.5 |
22.8 |
| GS 2.0.0 |
10.1 |
24.5 |
24.6 |
23.9 |
|
 |
FOSS4G 2009 - Bluemarble TNG
Relatively big raster layer, 21600x21600, in ECW, Mosaic of 512 GeoTiff files, Mosaic of 8 GeoTiff files (GS only) and single BigTiff (MapServer only). Mosaics are 16GB each.
|
ECW
| |
1 |
10 |
20 |
40 |
| MS 5.6b3 fcgi |
7.4 |
20 |
19.8 |
19.1 |
| GS 1.7 |
n.a. |
n.a. |
n.a. |
n.a. |
| GS 2.0.0 |
5 |
11.1 |
11.2 |
10.5 |
| GS 2.0.1 |
5.7 |
12.3 |
12.5 |
11.7 |
|
 |
|
512 tiles mosaic (16GB)
| |
1 |
10 |
20 |
40 |
| MS 5.6b3 fcgi |
6.5 |
14.9 |
16.4 |
16.9 |
| GS 1.7 |
n.a. |
n.a. |
n.a. |
n.a. |
| GS 2.0.0 |
4.8 |
9.7 |
9.6 |
9.9 |
| GS 2.0.1 |
5.2 |
10.2 |
10.6 |
11.1 |
|
 |
|
8 files mosaic (16GB) for GeoServer, single BigTIFF (16GB) for MapServer
| |
1 |
10 |
20 |
40 |
| MS 5.6b3 fcgi |
11.1 |
26.9 |
28.1 |
27.3 |
| GS 1.7 |
n.a. |
n.a. |
n.a. |
n.a. |
| GS 2.0.0 |
6.4 |
13.7 |
13.3 |
13.6 |
| GS 2.0.1 |
7.4 |
15.3 |
14.8 |
15.2 |
|
 |