Programming Rants: rhino

Showing posts with label rhino. Show all posts

2015-02-26

Numeric CombSort Benchmark update!

As I've written before, CombSort are quite good sort algorithm. Let's compare this algorithm when implemented in various programming language. The benchmark should not use any other built-in function other than array generation and printing. The benchmark uses AMD A8-6600K, 16GB RAM with Non-SSD disk.

$ alias | grep 'alias time'
alias time='/usr/bin/time -f "\nCPU: %Us\tReal: %es\tRAM: %MKB"'
$ time --version
GNU time 1.7

$ g++ --version
g++ (GCC) 4.9.2 20141224 (prerelease)
$ time g++ comb.cpp
CPU: 0.05s Real: 0.12s RAM: 19428KB
$ time ./a.out
CPU: 1.94s Real: 1.97s RAM: 79804KB
$ time g++ -O2 comb.cpp
CPU: 0.07s Real: 0.11s RAM: 21260KB
$ time ./a.out
CPU: 0.88s Real: 0.90s RAM: 79804KB

$ clang --version
clang version 3.5.1 (tags/RELEASE_351/final)
$ time clang++ comb.cpp
CPU: 0.05s Real: 0.08s RAM: 33564KB
$ time ./a.out
CPU: 1.83s Real: 1.86s RAM: 79764KB
$ time clang++ -O2 comb.cpp
CPU: 0.08s Real: 0.14s RAM: 37860KB
$ time ./a.out
CPU: 0.89s Real: 0.91s RAM: 79804KB

$ java -version

java version "1.7.0_71"

$ time javac comb.java
CPU: 1.05s Real: 0.73s RAM: 65952KB

$ time java comb

CPU: 1.32s Real: 1.32s RAM: 110488KB

$ php --version
PHP 5.6.4 (cli) (built: Dec 17 2014 21:45:04)
$ time php comb.php
CPU: 102.69s Real: 104.20s RAM: 2497508KB

$ hhvm --version
HipHop VM 3.5.0 (rel)

$ time hhvm -v Eval.Jit=true comb.php

CPU: 12.56s Real: 14.83s RAM: 362488KB

$ ruby --version

ruby 2.2.0p0 (2014-12-25 revision 49005) [x86_64-linux]

$ time ruby comb.rb

CPU: 52.87s Real: 53.02s RAM: 87892KB

$ rbx --version
rubinius 2.5.2 (2.1.0 7a5b05b1 2015-01-30 3.5.1 JI) [x86_64-linux-gnu]
$ time rbx comb.rb
CPU: 74.89s Real: 74.30s RAM: 135320KB

$ node --version

v0.10.35

$ time node comb1.js

CPU: 2.64s Real: 2.64s RAM: 92240KB

$ time node comb2.js
CPU: 2.68s Real: 2.72s RAM: 140612KB

$ rhino < /dev/null
Rhino 1.7 release 4 2014 07 01
$ rhino comb2.js
CPU: 87.39s Real: 61.16s RAM: 1993848KB

$ pacman -Qo `which jsc-3`
/usr/bin/jsc-3 is owned by webkitgtk 2.4.8-1
$ time jsc-3 comb1.js
CPU: 23.74s Real: 23.93s RAM: 93740KB
$ time jsc-3 comb2.js
CPU: 18.99s Real: 19.16s RAM: 181644KB

$ js24 --help | grep Version
Version: JavaScript-C24.2.0
$ time js24 --ion-eager comb1.js
CPU: 2.13s Real: 2.15s RAM: 89688KB
$ time js24 --ion-eager comb2.js
CPU: 1.53s Real: 1.58s RAM: 92384KB

$ go version

go version go1.4.1 linux/amd64

$ time go build comb.go

CPU: 0.14s Real: 0.17s RAM: 31568KB

$ time ./comb

CPU: 1.10s Real: 1.14s RAM: 79824KB

$ rustc --version
rustc 1.0.0-dev
$ time rustc comb.rs
CPU: 0.39s Real: 0.49s RAM: 106844KB
$ time ./comb
CPU: 10.62s Real: 10.71s RAM: 86020KB
$ time rustc -O comb.rs
CPU: 0.41s Real: 0.49s RAM: 110204KB
$ time ./comb
CPU: 0.97s Real: 0.99s RAM: 86108KB

$ scala -version
Scala code runner version 2.11.5 -- Copyright 2002-2013, LAMP/EPFL
$ time scala comb.scala
CPU: 5.43s Real: 6.30s RAM: 206088KB
$ time scalac comb.scala
CPU: 10.62s Real: 7.00s RAM: 143460KB
$ time scala Comb
CPU: 5.49s Real: 5.05s RAM: 206300KB

$ python --version
Python 3.4.2
$ time python comb1.py
CPU: 90.47s Real: 90.83s RAM: 403192KB
$ time python comb2.py
CPU: 106.82s Real: 107.26s RAM: 87248KB

$ pypy --version
Python 2.7.8 (c6ad44ecf5d8, Nov 18 2014, 18:04:31) [PyPy 2.4.0 with GCC 4.9.2]
$ time pypy comb1.py
CPU: 5.34s Real: 5.40s RAM: 136764KB
$ time pypy comb2.py
CPU: 5.85s Real: 6.04s RAM: 204588KB

$ mcs --version
Mono C# compiler version 3.12.0.0
$ time mcs -o+ comb.cs
CPU: 0.44s Real: 0.47s RAM: 45908KB
$ time ./comb.exe
CPU: 1.38s Real: 1.41s RAM: 90472KB

$ lua -v
Lua 5.2.3 Copyright (C) 1994-2013 Lua.org, PUC-Rio
$ time lua comb.lua
CPU: 65.64s Real: 65.81s RAM: 264096KB

$ luajit -v
LuaJIT 2.0.3 -- Copyright (C) 2005-2014 Mike Pall.
$ time luajit comb.lua
CPU: 6.30s Real: 6.34s RAM: 132964KB

$ dart --version
Dart VM version: 1.8.5 (Tue Jan 13 12:44:14 2015) on "linux_x64"
$ time dart scomb.dart
CPU: 2.12s Real: 2.24s RAM: 93392KB

The code can be found on my dropbox (folder: num-comb), and here's the summary:

Compiler / Interpreter	Language	Compile Duration	Compile RAM	Runtime Duration	Runtime RAM	Total Duration
g++ (debug)	C++	50	19428	1940	79804	1990
g++ (-O2)	C++	70	21260	880	79804	950
clang++ (debug)	C++	50	33564	1830	79764	1880
clang++ (-O2)	C++	80	37860	890	79804	970
javac, java	Java	1050	65952	1320	110488	2370
php	PHP			102690	2497508	102690
hhvm	PHP			12560	362488	12560
ruby	Ruby			52870	87892	52870
rbx	Ruby			74890	135320	74890
node (typed array)	Javascript			2640	92240	2640
node (untyped array)	Javascript			2680	140612	2680
rhino (untyped array)	Javascript			87039	1993848	87039
jsc-3 (typed array)	Javascript			23740	93740	23740
jsc-3 (untyped array)	Javascript			18990	181644	18990
js24 (typed array)	Javascript			2130	89688	2130
js24 (untyped array)	Javascript			1530	92384	1530
go	Go	140	31568	1100	79824	1240
rustc (debug)	Rust	390	106844	10620	86020	11010
rustc (-O2)	Rust	410	110204	970	86108	1380
scala	Scala			5430	206088	5430
python3	Python 3			90470	403192	90470
python3 (array)	Python 3			106820	87248	106820
pypy	Python 2			5340	136764	5340
pypy (array)	Python 2			5850	204588	5850
mcs	C#	440	45908	1380	90472	1820
lua	Lua			65640	264096	65640
luajit	Lua			6300	132964	6300
dart	Dart			2120	93392	2120

Write down your opinion (or pastie if you found a bug on these source, or if you want to add more language implementation) on the comment section ^^)b

Note #1: Opal (0.6.8) and JRuby (both 1.7.18 and 9.0.0pre1) failed to run this benchmark (they exceed 300s runtime limit even when using -J-Xmx3000M -J-Djruby.compile.mode=FORCE flag).

Note #2: Yes, it's unfair to compare array of integer and array of double, life is unfair by design, get over it...

2015-02-20

Lesser String Associative Benchmark

Today we will benchmark about associative array (again) but with lower number of items, since most scripting language failed the previous benchmark. This time we will use lower number of input (only 1% of previous benchmark). The testing done in 64-bit Linux, Intel i3-4150 CPU @ 3.50GHz, 8GB RAM and Non-SSD hard disk. The code can be found on my dropbox (folder: assoc-small).

$ alias | grep 'alias time'alias time='/usr/bin/time -f "\nCPU: %Us\tReal: %es\tRAM: %MKB"'
$ time --version
GNU time 1.7

$ hhvm --version
HipHop VM 3.5.0 (rel) Compiler: 1422366928_06713107
$ time hhvm assoc.php
62810 62928 12261
356028 1118896 222001
CPU: 0.44s Real: 0.59s RAM: 96040KB

$ pacman -Q | grep ph7
ph7 2001004-1
$ time ph7 assoc.php
62810 62928 12261
356028 1118896 222001
CPU: 8.88s Real: 8.93s RAM: 112596KB

$ ruby --version
ruby 2.1.5p273 (2014-11-13 revision 48405) [x86_64-linux]
$ time ruby hash.rb
62810 62928 12261
356028 1118896 222001
CPU: 0.51s Real: 0.53s RAM: 36424KB

$ rbx --version
rubinius 2.5.2.c85 (2.1.0 e8a24276 2015-02-23 3.5.1 JI) [x86_64-linux-gnu]
$ time rbx hash.rb
62810 62928 12261
356028 1118896 222001
CPU: 3.29s Real: 1.74s RAM: 119228KB

$ jruby --version
jruby 9.0.0.0-SNAPSHOT (2.2.0p0) 2015-02-24 2a3dc1f OpenJDK 64-Bit Server VM 24.75-b04 on 1.7.0_75-b13 +jit [linux-amd64]
$ time jruby hash.rb
62810 62928 12261
356028 1118896 222001
CPU: 8.77s Real: 3.83s RAM: 288472KB

$ iojs --version
v1.0.4
$ time iojs object.js
62810 62928 12261
356028 1118896 222001
CPU: 33.85s Real: 33.88s RAM: 55676KB

$ /opt/nodejs4/bin/node --version
v0.4.12
$ time /opt/nodejs4/bin/node object.js
62810 62928 12261
356028 1118896 222001
CPU: 16.77s Real: 16.80s RAM: 47124KB

$ node --version
v0.6.21-pre
$ time node object.js
62810 62928 12261
356028 1118896 222001
CPU: 16.96s Real: 16.92s RAM: 47128KB

$ node --version
v0.8.23
$ time node object.js
62810 62928 12261
356028 1118896 222001
CPU: 28.98s Real: 28.93s RAM: 50876KB

$ node --version
0.10.36-3
$ time node object.js
62810 62928 12261
356028 1118896 222001
CPU: 29.02s Real: 28.96s RAM: 51788KB

$ js24 --help | grep Version
Version: JavaScript-C24.2.0
$ time js24 object.js
62810 62928 12261
356028 1118896 222001
CPU: 0.34s Real: 0.35s RAM: 98480KB

$ pacman -Qo `which jsc-3`
/usr/bin/jsc-3 is owned by webkitgtk 2.4.8-1
$ time jsc-3 object.js
62810 62928 12261
356028 1118896 222001
CPU: 0.37s Real: 0.40s RAM: 87032KB

$ rhino < /dev/null
Rhino 1.7 release 4 2014 07 01
$ time rhino object.js
62810 62928 12261
356028 1118896 222001
CPU: 1.45s Real: 0.93s RAM: 179840KB

$ python3 --version
Python 3.4.2
$ time python3 dictionary.py
62810 62928 12261
356028 1118896 222001
CPU: 1.01s Real: 1.03s RAM: 40992KB

$ pypy --version
Python 2.7.8 (10f1b29a2bd2, Feb 05 2015, 16:50:17) [PyPy 2.5.0 with GCC 4.9.2 20141224 (prerelease)]
$ time pypy dictionary.py
(62810, 62928, 12261)
(356028, 1118896, 222001)
CPU: 0.31s Real: 0.32s RAM: 102660KB

$ go version
go version go1.4.1 linux/amd64
$ rm -f map; time go run map.go
62810 62928 12261
356028 1118896 222001
CPU: 0.27s Real: 0.29s RAM: 39340KB

$ lua -v
Lua 5.2.3 Copyright (C) 1994-2013 Lua.org, PUC-Rio
$ time lua table.lua
62810 62928 12261
356028 1118896 222001
CPU: 0.60s Real: 0.62s RAM: 26692KB

$ luajit -v
LuaJIT 2.0.3 -- Copyright (C) 2005-2014 Mike Pall.
$ time luajit table.lua
62810 62928 12261
356028 1118896 222001
CPU: 0.40s Real: 0.42s RAM: 19436KB

$ dart --version
Dart VM version: 1.8.5 (Tue Jan 13 12:44:14 2015) on "linux_x64"
$ time dart map.dart
62810 62928 12261
356028 1118896 222001
CPU: 0.31s Real: 0.34s RAM: 95780KB

And the summary

Compiler / Interpreter	Language	Type Name	Data Structure	Runtime Duration	Runtime RAM
hhvm	PHP 5.4	array	Hash Table	440	96040
ph7	PHP 5.3	array	Hash Table	8880	112596
ruby	Ruby	Hash	Hash Table	510	36424
rbx	Ruby	Hash	Hash Table	3290	119228
jruby	Ruby	Hash	Hash Table	3830	288472
iojs	JavaScript ES6	Object	Unknown	33850	55676
node (0.4)	JavaScript	Object	Unknown	16770	47124
node (0.6)	JavaScript	Object	Unknown	16960	47128
node (0.8)	JavaScript	Object	Unknown	28980	50876
node (0.10)	JavaScript	Object	Unknown	29020	51788
js24	JavaScript	Object	Unknown	340	98480
jsc-3	JavaScript	Object	Unknown	370	87032
rhino	JavaScript	Object	Unknown	1450	179840
python3	Python 3	dict	Hash Table	1010	40992
pypy	Python 2	dict	Hash Table	310	102660
go	Go	map	Hash Table	270	39340
lua	Lua	table	Hash Table	600	26692
luajit	Lua	table	Hash Table	400	19436
dart	Dart	Map	Hash Table	310	95780

Note #1: Apparently my previous code for Python, JavaScript and PHP were wrong because I forgot to round the floating point division, I have updated the previous benchmark result.

Note #2: PHP 5.6.5 failed to build the associative array within 2200s

Note #3: I/O JS and NodeJS seems fast to build the associative array, but awfully slow when iterating array

2015-02-03

Old String CombSort Benchmark

this is old benchmark, you can find updated result here.

2015-01-31

Old Numeric Combsort Benchmark

this is old benchmark, you can find updated result here.

Subscribe to: Posts ( Atom )