- 06 Mar, 2018 4 commits
-
-
Kirill Smelkov authoredCompared to yesterday shows relatively no significant change, though some benchmarks, usually related to sql are itself noisy. $ benchstat -split node,cluster,dataset 20180305-neo1-ffixed-c.txt 20180306-neo1-ffixed-c.txt name old pystone/s new pystone/s delta node:neo1 pystone 106k ± 1% 106k ± 1% ~ (p=0.690 n=5+5) name old time/op new time/op delta node:neo1 crc32/py/4K 5.13µs ± 1% 5.13µs ± 1% ~ (p=0.548 n=5+5) crc32/go/4K 2.79µs ± 0% 2.79µs ± 0% ~ (p=0.238 n=5+5) sha1/py/4K 13.5µs ± 1% 13.4µs ± 1% ~ (p=0.548 n=5+5) sha1/go/4K 9.83µs ± 0% 9.83µs ± 0% ~ (p=0.746 n=5+5) unzlib/py/wczdata 36.2µs ± 1% 36.1µs ± 0% ~ (p=0.421 n=5+5) unzlib/go/wczdata 31.2µs ± 1% 31.1µs ± 1% ~ (p=0.548 n=5+5) unzlib/py/prod1-avg 16.4µs ± 2% 16.3µs ± 2% ~ (p=0.690 n=5+5) unzlib/go/prod1-avg 9.42µs ± 0% 9.42µs ± 0% ~ (p=0.786 n=5+5) disk/randread/direct/4K-min 161µs ± 0% 162µs ± 0% +0.37% (p=0.008 n=5+5) disk/randread/direct/4K-avg 187µs ± 1% 187µs ± 2% ~ (p=0.381 n=5+5) disk/randread/pagecache/4K-min 390ns ± 1% 389ns ± 1% ~ (p=0.317 n=5+5) disk/randread/pagecache/4K-avg 801ns ± 0% 804ns ± 0% +0.34% (p=0.048 n=5+4) name old time/object new time/object delta cluster:neo1 dataset:wczblk1-8 fs1-zhash.py 34.9µs ± 1% 34.7µs ± 2% ~ (p=0.651 n=5+5) fs1-zhash.go 5.96µs ± 1% 6.00µs ± 2% ~ (p=0.683 n=5+5) fs1-zhash.go+prefetch128 6.64µs ± 2% 6.52µs ± 4% ~ (p=0.317 n=5+5) zeo/py/fs1-zhash.py 517µs ± 2% 523µs ± 1% ~ (p=0.222 n=5+5) zeo/py/fs1-zhash.go 200µs ± 3% 194µs ± 4% ~ (p=0.310 n=5+5) zeo/py/fs1-zhash.go+prefetch128 99.3µs ± 4% 98.6µs ± 3% ~ (p=1.000 n=5+5) neo/py(!log)/sqlite-zhash.py 668µs ±18% 684µs ± 3% ~ (p=0.841 n=5+5) neo/py(!log)/sqlite-zhash.go 242µs ± 1% 236µs ± 2% -2.46% (p=0.008 n=5+5) neo/py(!log)/sqlite-zhash.go+prefetch128 166µs ± 1% 162µs ± 2% -2.30% (p=0.008 n=5+5) neo/py(!log)/sql-zhash.py 933µs ±54% 942µs ±47% ~ (p=1.000 n=5+5) neo/py(!log)/sql-zhash.go 317µs ± 8% 300µs ±17% ~ (p=0.690 n=5+5) neo/py(!log)/sql-zhash.go+prefetch128 245µs ± 7% 240µs ± 6% ~ (p=0.548 n=5+5) neo/go/fs1-zhash.py 382µs ±22% 383µs ±20% ~ (p=1.000 n=5+5) neo/go/fs1-zhash.go 81.3µs ± 3% 81.3µs ± 1% ~ (p=0.532 n=5+5) neo/go/fs1-zhash.go+prefetch128 33.9µs ± 4% 33.8µs ± 5% ~ (p=0.952 n=5+5) neo/go/fs1(!sha1)-zhash.go(!sha1) 57.4µs ± 3% 57.6µs ± 3% ~ (p=0.746 n=5+5) neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 23.2µs ± 4% 22.9µs ± 6% ~ (p=0.500 n=5+5) neo/go/sqlite-zhash.py 410µs ± 3% 402µs ± 6% ~ (p=1.000 n=5+5) neo/go/sqlite-zhash.go 125µs ± 1% 125µs ± 1% ~ (p=0.333 n=5+5) neo/go/sqlite-zhash.go+prefetch128 47.4µs ± 3% 48.4µs ± 8% ~ (p=0.690 n=5+5) neo/go/sqlite-zhash.go(!sha1) 114µs ± 2% 116µs ± 2% ~ (p=0.151 n=5+5) neo/go/sqlite-zhash.go+prefetch128(!sha1) 47.0µs ±13% 45.9µs ± 5% ~ (p=1.000 n=5+5) cluster:neo1 dataset:prod1-1024 fs1-zhash.py 29.0µs ± 1% 28.9µs ± 1% ~ (p=0.341 n=5+5) fs1-zhash.go 3.76µs ± 2% 3.76µs ± 4% ~ (p=1.000 n=5+5) fs1-zhash.go+prefetch128 3.80µs ± 0% 3.86µs ± 2% ~ (p=0.238 n=4+5) zeo/py/fs1-zhash.py 481µs ± 3% 474µs ± 2% ~ (p=0.310 n=5+5) zeo/py/fs1-zhash.go 170µs ± 5% 170µs ± 3% ~ (p=1.000 n=5+5) zeo/py/fs1-zhash.go+prefetch128 87.7µs ± 2% 87.8µs ± 1% ~ (p=0.881 n=5+5) neo/py(!log)/sqlite-zhash.py 657µs ±11% 665µs ± 2% ~ (p=0.841 n=5+5) neo/py(!log)/sqlite-zhash.go 213µs ± 5% 219µs ± 2% ~ (p=0.222 n=5+5) neo/py(!log)/sqlite-zhash.go+prefetch128 151µs ± 2% 151µs ± 1% ~ (p=0.881 n=5+5) neo/py(!log)/sql-zhash.py 897µs ±54% 886µs ±56% ~ (p=0.690 n=5+5) neo/py(!log)/sql-zhash.go 320µs ± 9% 298µs ± 9% ~ (p=0.151 n=5+5) neo/py(!log)/sql-zhash.go+prefetch128 230µs ± 2% 230µs ± 3% ~ (p=1.000 n=5+5) neo/go/fs1-zhash.py 346µs ±35% 319µs ±11% ~ (p=0.794 n=5+5) neo/go/fs1-zhash.go 61.2µs ± 1% 61.3µs ± 3% ~ (p=0.794 n=5+5) neo/go/fs1-zhash.go+prefetch128 22.6µs ± 2% 22.5µs ± 3% ~ (p=0.738 n=5+5) neo/go/fs1(!sha1)-zhash.go(!sha1) 51.2µs ± 2% 52.0µs ± 3% ~ (p=0.135 n=5+5) neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 18.5µs ± 5% 18.3µs ± 2% ~ (p=0.460 n=5+5) neo/go/sqlite-zhash.py 391µs ± 7% 382µs ± 6% ~ (p=0.421 n=5+5) neo/go/sqlite-zhash.go 113µs ± 1% 113µs ± 1% ~ (p=0.841 n=5+5) neo/go/sqlite-zhash.go+prefetch128 41.5µs ± 6% 40.9µs ± 4% ~ (p=0.730 n=5+5) neo/go/sqlite-zhash.go(!sha1) 109µs ± 1% 108µs ± 1% ~ (p=0.222 n=5+5) neo/go/sqlite-zhash.go+prefetch128(!sha1) 41.1µs ± 3% 41.1µs ± 5% ~ (p=1.000 n=5+5) name old req/s new req/s delta cluster:neo1 dataset:wczblk1-8 fs1-zwrk.go·1 230k ± 0% 229k ± 0% ~ (p=0.095 n=5+5) fs1-zwrk.go·2 446k ± 1% 443k ± 1% ~ (p=0.151 n=5+5) fs1-zwrk.go·3 663k ± 0% 662k ± 1% ~ (p=0.730 n=4+5) fs1-zwrk.go·4 868k ± 0% 867k ± 1% ~ (p=0.548 n=5+5) fs1-zwrk.go·8 989k ± 1% 988k ± 0% ~ (p=1.000 n=5+5) fs1-zwrk.go·12 1.02M ± 0% 1.02M ± 0% ~ (p=1.000 n=5+5) fs1-zwrk.go·16 1.01M ± 0% 0.98M ±12% ~ (p=0.841 n=5+5) zeo/py/fs1-zwrk.go·1 5.09k ± 2% 5.15k ± 1% ~ (p=0.421 n=5+5) zeo/py/fs1-zwrk.go·2 7.08k ± 2% 7.08k ± 1% ~ (p=0.690 n=5+5) zeo/py/fs1-zwrk.go·3 7.75k ± 1% 7.73k ± 1% ~ (p=0.548 n=5+5) zeo/py/fs1-zwrk.go·4 7.93k ± 2% 7.97k ± 4% ~ (p=0.690 n=5+5) zeo/py/fs1-zwrk.go·8 8.30k ± 2% 8.30k ± 2% ~ (p=1.000 n=5+5) zeo/py/fs1-zwrk.go·12 8.43k ± 1% 8.15k ± 1% -3.31% (p=0.008 n=5+5) zeo/py/fs1-zwrk.go·16 8.41k ± 2% 8.25k ± 1% ~ (p=0.056 n=5+5) neo/py(!log)/sqlite-zwrk.go·1 4.36k ± 4% 4.31k ± 4% ~ (p=0.841 n=5+5) neo/py(!log)/sqlite-zwrk.go·2 6.27k ± 3% 6.28k ± 5% ~ (p=0.548 n=5+5) neo/py(!log)/sqlite-zwrk.go·3 6.21k ± 2% 6.38k ± 0% +2.64% (p=0.016 n=5+4) neo/py(!log)/sqlite-zwrk.go·4 6.07k ± 6% 6.15k ± 5% ~ (p=0.548 n=5+5) neo/py(!log)/sqlite-zwrk.go·8 6.22k ± 3% 6.27k ± 4% ~ (p=0.421 n=5+5) neo/py(!log)/sqlite-zwrk.go·12 6.19k ± 4% 6.33k ± 2% ~ (p=0.056 n=5+5) neo/py(!log)/sqlite-zwrk.go·16 6.09k ± 6% 6.25k ± 4% ~ (p=0.310 n=5+5) neo/py(!log)/sql-zwrk.go·1 3.12k ± 7% 3.10k ± 6% ~ (p=0.690 n=5+5) neo/py(!log)/sql-zwrk.go·2 4.02k ± 7% 3.98k ± 1% ~ (p=0.690 n=5+5) neo/py(!log)/sql-zwrk.go·3 4.08k ± 8% 4.04k ± 3% ~ (p=0.841 n=5+5) neo/py(!log)/sql-zwrk.go·4 4.03k ± 4% 4.06k ± 4% ~ (p=1.000 n=5+5) neo/py(!log)/sql-zwrk.go·8 3.95k ± 3% 3.79k ± 7% ~ (p=0.151 n=5+5) neo/py(!log)/sql-zwrk.go·12 4.04k ± 5% 3.98k ± 3% ~ (p=0.421 n=5+5) neo/py(!log)/sql-zwrk.go·16 3.97k ± 5% 3.94k ± 1% ~ (p=0.841 n=5+5) neo/go/fs1-zwrk.go·1 12.9k ± 2% 12.8k ± 0% ~ (p=0.841 n=5+5) neo/go/fs1-zwrk.go·2 24.9k ± 1% 24.8k ± 0% ~ (p=0.286 n=5+4) neo/go/fs1-zwrk.go·3 32.4k ± 0% 32.3k ± 0% -0.29% (p=0.032 n=5+5) neo/go/fs1-zwrk.go·4 40.8k ± 1% 40.7k ± 0% ~ (p=0.151 n=5+5) neo/go/fs1-zwrk.go·8 54.8k ± 1% 54.5k ± 1% ~ (p=0.056 n=5+5) neo/go/fs1-zwrk.go·12 56.5k ± 1% 56.5k ± 1% ~ (p=0.841 n=5+5) neo/go/fs1-zwrk.go·16 54.4k ± 2% 53.2k ±10% ~ (p=0.841 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 18.9k ± 2% 19.0k ± 2% ~ (p=0.690 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 37.8k ± 0% 37.8k ± 0% ~ (p=0.841 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 48.1k ± 0% 48.0k ± 1% ~ (p=0.222 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 59.2k ± 0% 59.0k ± 0% -0.45% (p=0.016 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 78.4k ± 0% 78.0k ± 1% ~ (p=0.056 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 82.9k ± 1% 82.2k ± 2% ~ (p=0.421 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 80.4k ± 2% 80.4k ± 1% ~ (p=0.690 n=5+5) neo/go/sqlite-zwrk.go·1 8.13k ± 0% 8.06k ± 4% ~ (p=1.000 n=5+5) neo/go/sqlite-zwrk.go·2 14.9k ± 0% 14.9k ± 0% ~ (p=0.151 n=5+5) neo/go/sqlite-zwrk.go·3 20.8k ± 1% 20.7k ± 0% ~ (p=0.310 n=5+5) neo/go/sqlite-zwrk.go·4 24.9k ± 0% 24.8k ± 0% -0.37% (p=0.032 n=5+5) neo/go/sqlite-zwrk.go·8 31.7k ± 1% 31.7k ± 1% ~ (p=1.000 n=5+5) neo/go/sqlite-zwrk.go·12 31.4k ± 1% 30.8k ± 5% ~ (p=0.151 n=5+5) neo/go/sqlite-zwrk.go·16 30.5k ± 2% 30.4k ± 2% ~ (p=0.841 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·1 8.96k ± 0% 8.95k ± 1% ~ (p=0.690 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·2 16.4k ± 0% 16.2k ± 1% -1.04% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·3 22.7k ± 0% 22.6k ± 0% -0.59% (p=0.016 n=5+4) neo/go/sqlite-zwrk.go(!sha1)·4 27.7k ± 0% 27.9k ± 0% +0.58% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·8 34.4k ± 0% 35.0k ± 1% +1.92% (p=0.016 n=4+5) neo/go/sqlite-zwrk.go(!sha1)·12 33.5k ± 2% 34.7k ± 1% +3.56% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·16 33.0k ± 2% 33.0k ±11% ~ (p=0.222 n=5+5) cluster:neo1 dataset:prod1-1024 fs1-zwrk.go·1 452k ± 1% 451k ± 0% ~ (p=0.690 n=5+5) fs1-zwrk.go·2 895k ± 0% 893k ± 0% -0.30% (p=0.032 n=5+5) fs1-zwrk.go·3 1.33M ± 1% 1.34M ± 1% ~ (p=0.151 n=5+5) fs1-zwrk.go·4 1.76M ± 1% 1.77M ± 0% ~ (p=0.690 n=5+5) fs1-zwrk.go·8 1.94M ±12% 1.99M ± 1% ~ (p=0.841 n=5+5) fs1-zwrk.go·12 2.03M ± 0% 2.03M ± 1% ~ (p=0.286 n=5+4) fs1-zwrk.go·16 2.03M ± 0% 2.03M ± 0% ~ (p=0.095 n=5+5) zeo/py/fs1-zwrk.go·1 6.00k ± 2% 5.79k ± 3% -3.52% (p=0.032 n=5+5) zeo/py/fs1-zwrk.go·2 8.45k ± 7% 8.55k ± 1% ~ (p=0.690 n=5+5) zeo/py/fs1-zwrk.go·3 9.33k ± 2% 9.28k ± 7% ~ (p=0.841 n=5+5) zeo/py/fs1-zwrk.go·4 9.80k ± 0% 9.72k ± 1% -0.89% (p=0.032 n=5+5) zeo/py/fs1-zwrk.go·8 10.4k ± 1% 10.4k ± 1% ~ (p=0.841 n=5+5) zeo/py/fs1-zwrk.go·12 10.5k ± 2% 10.5k ± 1% ~ (p=0.421 n=5+5) zeo/py/fs1-zwrk.go·16 10.4k ± 4% 10.4k ± 4% ~ (p=1.000 n=5+5) neo/py(!log)/sqlite-zwrk.go·1 4.87k ±11% 4.90k ± 7% ~ (p=0.690 n=5+5) neo/py(!log)/sqlite-zwrk.go·2 6.44k ± 1% 6.28k ± 4% ~ (p=0.421 n=5+5) neo/py(!log)/sqlite-zwrk.go·3 6.31k ± 6% 6.32k ± 5% ~ (p=1.000 n=5+5) neo/py(!log)/sqlite-zwrk.go·4 6.36k ± 7% 6.45k ± 2% ~ (p=1.000 n=5+5) neo/py(!log)/sqlite-zwrk.go·8 6.47k ± 1% 6.45k ± 2% ~ (p=1.000 n=5+5) neo/py(!log)/sqlite-zwrk.go·12 6.48k ± 1% 6.31k ± 3% ~ (p=0.056 n=5+5) neo/py(!log)/sqlite-zwrk.go·16 6.35k ± 2% 6.36k ± 5% ~ (p=0.548 n=5+5) neo/py(!log)/sql-zwrk.go·1 3.07k ± 9% 3.50k ± 9% +14.08% (p=0.032 n=5+5) neo/py(!log)/sql-zwrk.go·2 4.09k ± 3% 4.05k ± 6% ~ (p=1.000 n=5+5) neo/py(!log)/sql-zwrk.go·3 3.99k ±11% 4.06k ± 7% ~ (p=0.548 n=5+5) neo/py(!log)/sql-zwrk.go·4 3.99k ± 2% 3.98k ± 4% ~ (p=1.000 n=5+5) neo/py(!log)/sql-zwrk.go·8 4.15k ± 4% 4.15k ± 3% ~ (p=0.548 n=5+5) neo/py(!log)/sql-zwrk.go·12 4.13k ± 5% 4.00k ± 5% ~ (p=0.222 n=5+5) neo/py(!log)/sql-zwrk.go·16 4.22k ± 7% 3.96k ±11% ~ (p=0.151 n=5+5) neo/go/fs1-zwrk.go·1 17.3k ± 1% 17.1k ± 1% ~ (p=0.063 n=5+5) neo/go/fs1-zwrk.go·2 32.5k ± 1% 32.6k ± 0% ~ (p=0.222 n=5+5) neo/go/fs1-zwrk.go·3 43.3k ± 0% 43.3k ± 0% ~ (p=0.841 n=5+5) neo/go/fs1-zwrk.go·4 52.9k ± 0% 52.9k ± 0% ~ (p=0.730 n=4+5) neo/go/fs1-zwrk.go·8 65.3k ± 2% 66.3k ± 1% +1.57% (p=0.032 n=5+4) neo/go/fs1-zwrk.go·12 61.0k ± 6% 61.6k ± 1% ~ (p=1.000 n=5+5) neo/go/fs1-zwrk.go·16 55.9k ± 2% 55.6k ± 4% ~ (p=0.421 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 20.0k ± 3% 19.6k ± 5% ~ (p=0.421 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 40.5k ± 1% 40.3k ± 0% ~ (p=0.095 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 51.6k ± 0% 51.6k ± 0% ~ (p=0.841 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 62.6k ± 0% 62.0k ± 0% -0.83% (p=0.008 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 74.6k ± 1% 74.2k ± 4% ~ (p=1.000 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 66.3k ± 4% 64.8k ± 7% ~ (p=0.548 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 58.9k ± 2% 59.5k ± 4% ~ (p=0.841 n=5+5) neo/go/sqlite-zwrk.go·1 9.01k ± 1% 9.02k ± 1% ~ (p=1.000 n=5+5) neo/go/sqlite-zwrk.go·2 15.9k ± 1% 16.0k ± 0% ~ (p=0.310 n=5+5) neo/go/sqlite-zwrk.go·3 21.8k ± 0% 21.8k ± 1% ~ (p=1.000 n=4+4) neo/go/sqlite-zwrk.go·4 26.3k ± 0% 26.2k ± 0% ~ (p=0.095 n=5+5) neo/go/sqlite-zwrk.go·8 29.8k ± 1% 30.0k ± 2% ~ (p=0.421 n=5+5) neo/go/sqlite-zwrk.go·12 28.5k ± 1% 28.6k ± 2% ~ (p=0.690 n=5+5) neo/go/sqlite-zwrk.go·16 28.5k ± 8% 28.7k ± 1% ~ (p=0.730 n=5+4) neo/go/sqlite-zwrk.go(!sha1)·1 9.38k ± 1% 9.45k ± 1% ~ (p=0.222 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·2 16.5k ± 0% 16.6k ± 1% ~ (p=0.095 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·3 22.7k ± 0% 23.0k ± 0% +1.59% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·4 27.5k ± 1% 28.0k ± 1% +1.81% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·8 32.3k ± 5% 32.3k ± 0% ~ (p=0.222 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·12 30.7k ± 2% 30.6k ± 2% ~ (p=0.690 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·16 30.3k ± 2% 30.3k ± 2% ~ (p=0.841 n=5+5) name old latency-time/object new latency-time/object delta cluster:neo1 dataset:wczblk1-8 fs1-zwrk.go·1 4.35µs ± 0% 4.36µs ± 0% ~ (p=0.095 n=5+5) fs1-zwrk.go·2 4.49µs ± 1% 4.52µs ± 1% ~ (p=0.151 n=5+5) fs1-zwrk.go·3 4.53µs ± 0% 4.53µs ± 1% ~ (p=0.730 n=4+5) fs1-zwrk.go·4 4.61µs ± 0% 4.61µs ± 1% ~ (p=0.548 n=5+5) fs1-zwrk.go·8 8.09µs ± 1% 8.10µs ± 0% ~ (p=1.000 n=5+5) fs1-zwrk.go·12 11.8µs ± 0% 11.8µs ± 0% ~ (p=1.000 n=5+5) fs1-zwrk.go·16 15.8µs ± 0% 16.5µs ±13% ~ (p=0.841 n=5+5) zeo/py/fs1-zwrk.go·1 197µs ± 2% 194µs ± 1% ~ (p=0.421 n=5+5) zeo/py/fs1-zwrk.go·2 283µs ± 2% 282µs ± 1% ~ (p=0.690 n=5+5) zeo/py/fs1-zwrk.go·3 387µs ± 1% 388µs ± 1% ~ (p=0.548 n=5+5) zeo/py/fs1-zwrk.go·4 504µs ± 2% 502µs ± 5% ~ (p=0.690 n=5+5) zeo/py/fs1-zwrk.go·8 964µs ± 2% 964µs ± 2% ~ (p=1.000 n=5+5) zeo/py/fs1-zwrk.go·12 1.42ms ± 1% 1.47ms ± 1% +3.43% (p=0.008 n=5+5) zeo/py/fs1-zwrk.go·16 1.90ms ± 2% 1.94ms ± 1% ~ (p=0.056 n=5+5) neo/py(!log)/sqlite-zwrk.go·1 230µs ± 4% 232µs ± 4% ~ (p=0.841 n=5+5) neo/py(!log)/sqlite-zwrk.go·2 319µs ± 3% 319µs ± 5% ~ (p=0.548 n=5+5) neo/py(!log)/sqlite-zwrk.go·3 483µs ± 2% 470µs ± 0% -2.59% (p=0.016 n=5+4) neo/py(!log)/sqlite-zwrk.go·4 661µs ± 6% 651µs ± 5% ~ (p=0.548 n=5+5) neo/py(!log)/sqlite-zwrk.go·8 1.29ms ± 3% 1.28ms ± 4% ~ (p=0.421 n=5+5) neo/py(!log)/sqlite-zwrk.go·12 1.94ms ± 4% 1.90ms ± 2% ~ (p=0.056 n=5+5) neo/py(!log)/sqlite-zwrk.go·16 2.63ms ± 6% 2.56ms ± 4% ~ (p=0.310 n=5+5) neo/py(!log)/sql-zwrk.go·1 321µs ± 7% 323µs ± 6% ~ (p=0.690 n=5+5) neo/py(!log)/sql-zwrk.go·2 499µs ± 7% 503µs ± 2% ~ (p=0.690 n=5+5) neo/py(!log)/sql-zwrk.go·3 737µs ± 8% 742µs ± 3% ~ (p=0.841 n=5+5) neo/py(!log)/sql-zwrk.go·4 993µs ± 4% 986µs ± 4% ~ (p=1.000 n=5+5) neo/py(!log)/sql-zwrk.go·8 2.03ms ± 3% 2.11ms ± 8% ~ (p=0.151 n=5+5) neo/py(!log)/sql-zwrk.go·12 2.97ms ± 4% 3.02ms ± 3% ~ (p=0.421 n=5+5) neo/py(!log)/sql-zwrk.go·16 4.03ms ± 4% 4.06ms ± 1% ~ (p=0.841 n=5+5) neo/go/fs1-zwrk.go·1 77.7µs ± 2% 77.8µs ± 0% ~ (p=0.841 n=5+5) neo/go/fs1-zwrk.go·2 80.2µs ± 1% 80.6µs ± 0% ~ (p=0.286 n=5+4) neo/go/fs1-zwrk.go·3 92.5µs ± 0% 92.8µs ± 0% +0.30% (p=0.032 n=5+5) neo/go/fs1-zwrk.go·4 98.1µs ± 1% 98.2µs ± 0% ~ (p=0.151 n=5+5) neo/go/fs1-zwrk.go·8 146µs ± 1% 147µs ± 1% ~ (p=0.056 n=5+5) neo/go/fs1-zwrk.go·12 212µs ± 1% 212µs ± 1% ~ (p=0.841 n=5+5) neo/go/fs1-zwrk.go·16 294µs ± 2% 293µs ± 1% ~ (p=0.905 n=5+4) neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 52.8µs ± 2% 52.7µs ± 2% ~ (p=0.690 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 53.0µs ± 0% 53.0µs ± 0% ~ (p=0.889 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 62.3µs ± 0% 62.5µs ± 1% ~ (p=0.222 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 67.5µs ± 0% 67.8µs ± 0% +0.46% (p=0.016 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 102µs ± 0% 103µs ± 1% +0.54% (p=0.040 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 145µs ± 1% 146µs ± 2% ~ (p=0.421 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 199µs ± 2% 199µs ± 1% ~ (p=0.651 n=5+5) neo/go/sqlite-zwrk.go·1 123µs ± 0% 124µs ± 4% ~ (p=1.000 n=5+5) neo/go/sqlite-zwrk.go·2 134µs ± 0% 134µs ± 0% ~ (p=0.151 n=5+5) neo/go/sqlite-zwrk.go·3 144µs ± 1% 145µs ± 0% ~ (p=0.310 n=5+5) neo/go/sqlite-zwrk.go·4 161µs ± 0% 161µs ± 0% +0.38% (p=0.032 n=5+5) neo/go/sqlite-zwrk.go·8 253µs ± 1% 252µs ± 1% ~ (p=1.000 n=5+5) neo/go/sqlite-zwrk.go·12 383µs ± 1% 390µs ± 5% ~ (p=0.151 n=5+5) neo/go/sqlite-zwrk.go·16 524µs ± 2% 526µs ± 2% ~ (p=0.841 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·1 112µs ± 0% 112µs ± 1% ~ (p=0.690 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·2 122µs ± 0% 124µs ± 1% +1.05% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·3 132µs ± 0% 133µs ± 0% +0.60% (p=0.016 n=5+4) neo/go/sqlite-zwrk.go(!sha1)·4 144µs ± 0% 143µs ± 0% -0.57% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·8 233µs ± 0% 228µs ± 1% -1.88% (p=0.016 n=4+5) neo/go/sqlite-zwrk.go(!sha1)·12 359µs ± 2% 346µs ± 1% -3.44% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·16 485µs ± 2% 486µs ±11% ~ (p=0.222 n=5+5) cluster:neo1 dataset:prod1-1024 fs1-zwrk.go·1 2.21µs ± 1% 2.22µs ± 1% ~ (p=0.667 n=5+5) fs1-zwrk.go·2 2.23µs ± 0% 2.24µs ± 0% +0.30% (p=0.040 n=5+5) fs1-zwrk.go·3 2.25µs ± 1% 2.25µs ± 1% ~ (p=0.135 n=5+5) fs1-zwrk.go·4 2.27µs ± 1% 2.26µs ± 0% ~ (p=0.611 n=5+5) fs1-zwrk.go·8 4.15µs ±13% 4.02µs ± 1% ~ (p=0.841 n=5+5) fs1-zwrk.go·12 5.90µs ± 0% 5.92µs ± 1% ~ (p=0.317 n=5+4) fs1-zwrk.go·16 7.89µs ± 0% 7.87µs ± 0% ~ (p=0.087 n=5+5) zeo/py/fs1-zwrk.go·1 167µs ± 2% 173µs ± 3% +3.68% (p=0.032 n=5+5) zeo/py/fs1-zwrk.go·2 237µs ± 7% 234µs ± 1% ~ (p=0.690 n=5+5) zeo/py/fs1-zwrk.go·3 322µs ± 2% 324µs ± 7% ~ (p=0.841 n=5+5) zeo/py/fs1-zwrk.go·4 408µs ± 0% 412µs ± 1% +0.91% (p=0.032 n=5+5) zeo/py/fs1-zwrk.go·8 770µs ± 1% 768µs ± 1% ~ (p=0.841 n=5+5) zeo/py/fs1-zwrk.go·12 1.14ms ± 2% 1.14ms ± 1% ~ (p=0.421 n=5+5) zeo/py/fs1-zwrk.go·16 1.54ms ± 4% 1.54ms ± 4% ~ (p=1.000 n=5+5) neo/py(!log)/sqlite-zwrk.go·1 206µs ±11% 204µs ± 8% ~ (p=0.690 n=5+5) neo/py(!log)/sqlite-zwrk.go·2 311µs ± 1% 319µs ± 4% ~ (p=0.421 n=5+5) neo/py(!log)/sqlite-zwrk.go·3 476µs ± 7% 475µs ± 5% ~ (p=1.000 n=5+5) neo/py(!log)/sqlite-zwrk.go·4 629µs ± 7% 620µs ± 2% ~ (p=1.000 n=5+5) neo/py(!log)/sqlite-zwrk.go·8 1.24ms ± 1% 1.24ms ± 2% ~ (p=1.000 n=5+5) neo/py(!log)/sqlite-zwrk.go·12 1.85ms ± 1% 1.90ms ± 3% ~ (p=0.056 n=5+5) neo/py(!log)/sqlite-zwrk.go·16 2.52ms ± 2% 2.52ms ± 5% ~ (p=0.548 n=5+5) neo/py(!log)/sql-zwrk.go·1 327µs ± 8% 287µs ± 8% -12.18% (p=0.032 n=5+5) neo/py(!log)/sql-zwrk.go·2 489µs ± 3% 495µs ± 6% ~ (p=1.000 n=5+5) neo/py(!log)/sql-zwrk.go·3 755µs ±10% 740µs ± 8% ~ (p=0.548 n=5+5) neo/py(!log)/sql-zwrk.go·4 1.00ms ± 2% 1.01ms ± 4% ~ (p=1.000 n=5+5) neo/py(!log)/sql-zwrk.go·8 1.93ms ± 3% 1.93ms ± 3% ~ (p=0.548 n=5+5) neo/py(!log)/sql-zwrk.go·12 2.91ms ± 5% 3.01ms ± 4% ~ (p=0.222 n=5+5) neo/py(!log)/sql-zwrk.go·16 3.80ms ± 7% 4.05ms ±10% ~ (p=0.151 n=5+5) neo/go/fs1-zwrk.go·1 57.8µs ± 1% 58.5µs ± 1% ~ (p=0.063 n=5+5) neo/go/fs1-zwrk.go·2 61.5µs ± 1% 61.4µs ± 0% ~ (p=0.254 n=5+5) neo/go/fs1-zwrk.go·3 69.3µs ± 0% 69.3µs ± 0% ~ (p=0.841 n=5+5) neo/go/fs1-zwrk.go·4 75.6µs ± 0% 75.6µs ± 0% ~ (p=0.730 n=4+5) neo/go/fs1-zwrk.go·8 123µs ± 2% 121µs ± 1% -1.56% (p=0.032 n=5+4) neo/go/fs1-zwrk.go·12 197µs ± 6% 195µs ± 1% ~ (p=1.000 n=5+5) neo/go/fs1-zwrk.go·16 286µs ± 2% 288µs ± 4% ~ (p=0.421 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 50.0µs ± 3% 50.9µs ± 5% ~ (p=0.421 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 49.4µs ± 1% 49.7µs ± 0% ~ (p=0.095 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 58.1µs ± 0% 58.2µs ± 0% ~ (p=0.841 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 63.9µs ± 0% 64.5µs ± 0% +0.84% (p=0.008 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 107µs ± 1% 108µs ± 4% ~ (p=1.000 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 181µs ± 4% 185µs ± 8% ~ (p=0.548 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 272µs ± 2% 269µs ± 4% ~ (p=0.841 n=5+5) neo/go/sqlite-zwrk.go·1 111µs ± 1% 111µs ± 1% ~ (p=1.000 n=5+5) neo/go/sqlite-zwrk.go·2 126µs ± 1% 125µs ± 0% ~ (p=0.310 n=5+5) neo/go/sqlite-zwrk.go·3 137µs ± 0% 137µs ± 1% ~ (p=1.000 n=4+4) neo/go/sqlite-zwrk.go·4 152µs ± 0% 153µs ± 0% ~ (p=0.095 n=5+5) neo/go/sqlite-zwrk.go·8 268µs ± 1% 267µs ± 1% ~ (p=0.421 n=5+5) neo/go/sqlite-zwrk.go·12 421µs ± 1% 420µs ± 2% ~ (p=0.690 n=5+5) neo/go/sqlite-zwrk.go·16 562µs ± 8% 558µs ± 1% ~ (p=0.730 n=5+4) neo/go/sqlite-zwrk.go(!sha1)·1 107µs ± 1% 106µs ± 1% ~ (p=0.222 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·2 121µs ± 0% 121µs ± 1% ~ (p=0.095 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·3 132µs ± 0% 130µs ± 0% -1.57% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·4 146µs ± 1% 143µs ± 1% -1.78% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·8 247µs ± 5% 248µs ± 0% ~ (p=0.222 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·12 391µs ± 2% 393µs ± 2% ~ (p=0.690 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·16 528µs ± 2% 528µs ± 2% ~ (p=0.841 n=5+5)
-
Kirill Smelkov authored
Compared to yesterday shows not significant change, thus meaning benchmarking is more or less stable (+/- 5% at ·12 and ·16 is probably due to scheduling): $ benchstat -split node,cluster,dataset 20180305-deco-ffixed-c.txt 20180306-deco-ffixed-c.txt name old pystone/s new pystone/s delta node:deco pystone 219k ± 3% 217k ± 4% ~ (p=0.548 n=5+5) name old time/op new time/op delta node:deco crc32/py/4K 5.72µs ± 0% 5.73µs ± 0% ~ (p=0.460 n=5+5) crc32/go/4K 279ns ± 0% 279ns ± 0% ~ (all equal) sha1/py/4K 6.69µs ± 0% 6.74µs ± 1% +0.66% (p=0.024 n=5+5) sha1/go/4K 5.59µs ± 0% 5.60µs ± 0% +0.19% (p=0.008 n=5+5) unzlib/py/wczdata 27.2µs ± 0% 27.2µs ± 1% ~ (p=0.905 n=4+5) unzlib/go/wczdata 26.9µs ± 1% 27.0µs ± 0% ~ (p=0.222 n=5+5) unzlib/py/prod1-avg 5.06µs ± 0% 5.14µs ± 3% ~ (p=0.603 n=4+5) unzlib/go/prod1-avg 5.33µs ± 1% 5.30µs ± 1% ~ (p=0.087 n=5+5) disk/randread/direct/4K-min 105µs ± 0% 104µs ± 2% ~ (p=0.270 n=5+5) disk/randread/direct/4K-avg 142µs ± 0% 141µs ± 0% -0.31% (p=0.032 n=5+5) disk/randread/pagecache/4K-min 583ns ± 1% 579ns ± 2% ~ (p=0.246 n=5+5) disk/randread/pagecache/4K-avg 1.00µs ± 1% 0.99µs ± 0% -0.98% (p=0.024 n=5+5) name old time/object new time/object delta cluster:deco dataset:wczblk1-8 fs1-zhash.py 20.2µs ± 1% 20.3µs ± 1% ~ (p=0.571 n=4+4) fs1-zhash.go 3.20µs ± 0% 3.26µs ± 4% ~ (p=0.444 n=5+5) fs1-zhash.go+prefetch128 4.14µs ± 6% 4.04µs ± 1% ~ (p=0.444 n=5+5) zeo/py/fs1-zhash.py 379µs ± 3% 383µs ± 5% ~ (p=0.730 n=5+5) zeo/py/fs1-zhash.go 127µs ± 1% 126µs ± 1% ~ (p=0.317 n=4+5) zeo/py/fs1-zhash.go+prefetch128 64.1µs ± 2% 63.1µs ± 1% ~ (p=0.222 n=5+5) neo/py(!log)/sqlite-zhash.py 335µs ± 4% 344µs ± 6% ~ (p=0.421 n=5+5) neo/py(!log)/sqlite-zhash.go 145µs ± 2% 140µs ± 1% -3.07% (p=0.008 n=5+5) neo/py(!log)/sqlite-zhash.go+prefetch128 118µs ± 1% 119µs ± 2% ~ (p=0.548 n=5+5) neo/py(!log)/sql-zhash.py 454µs ±61% 386µs ± 1% ~ (p=1.000 n=5+4) neo/py(!log)/sql-zhash.go 183µs ± 1% 183µs ± 3% ~ (p=1.000 n=5+5) neo/py(!log)/sql-zhash.go+prefetch128 164µs ± 2% 164µs ± 3% ~ (p=0.690 n=5+5) neo/go/fs1-zhash.py 227µs ± 2% 226µs ± 3% ~ (p=0.690 n=5+5) neo/go/fs1-zhash.go 56.9µs ± 1% 57.1µs ± 0% ~ (p=0.119 n=5+5) neo/go/fs1-zhash.go+prefetch128 24.7µs ± 2% 24.7µs ± 5% ~ (p=0.571 n=5+5) neo/go/fs1(!sha1)-zhash.go(!sha1) 40.5µs ± 1% 40.2µs ± 1% ~ (p=0.254 n=5+5) neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 16.8µs ± 5% 17.1µs ± 6% ~ (p=0.579 n=5+5) neo/go/sqlite-zhash.py 269µs ± 1% 272µs ± 3% ~ (p=0.690 n=5+5) neo/go/sqlite-zhash.go 92.7µs ± 0% 92.8µs ± 0% ~ (p=0.397 n=5+4) neo/go/sqlite-zhash.go+prefetch128 39.8µs ± 8% 40.5µs ± 5% ~ (p=0.548 n=5+5) neo/go/sqlite-zhash.go(!sha1) 86.4µs ± 2% 86.5µs ± 2% ~ (p=0.571 n=5+5) neo/go/sqlite-zhash.go+prefetch128(!sha1) 40.1µs ±11% 38.8µs ± 9% ~ (p=0.579 n=5+5) cluster:deco dataset:prod1-1024 fs1-zhash.py 15.8µs ± 2% 15.8µs ± 3% ~ (p=0.629 n=4+4) fs1-zhash.go 2.80µs ± 0% 2.80µs ± 0% ~ (all equal) fs1-zhash.go+prefetch128 3.54µs ± 7% 3.42µs ± 8% ~ (p=0.381 n=5+5) zeo/py/fs1-zhash.py 362µs ± 6% 361µs ± 5% ~ (p=1.000 n=5+5) zeo/py/fs1-zhash.go 106µs ± 1% 105µs ± 0% ~ (p=0.214 n=5+5) zeo/py/fs1-zhash.go+prefetch128 58.9µs ± 1% 58.9µs ± 1% ~ (p=0.881 n=5+5) neo/py(!log)/sqlite-zhash.py 331µs ± 1% 344µs ± 7% ~ (p=0.063 n=5+5) neo/py(!log)/sqlite-zhash.go 136µs ± 1% 137µs ± 2% ~ (p=0.222 n=5+5) neo/py(!log)/sqlite-zhash.go+prefetch128 112µs ± 1% 114µs ± 1% +1.73% (p=0.008 n=5+5) neo/py(!log)/sql-zhash.py 389µs ± 6% 380µs ± 4% ~ (p=0.486 n=4+4) neo/py(!log)/sql-zhash.go 180µs ± 2% 180µs ± 1% ~ (p=0.548 n=5+5) neo/py(!log)/sql-zhash.go+prefetch128 157µs ± 1% 159µs ± 1% ~ (p=0.095 n=5+5) neo/go/fs1-zhash.py 223µs ± 0% 221µs ± 1% -0.79% (p=0.016 n=5+5) neo/go/fs1-zhash.go 44.9µs ± 1% 45.2µs ± 2% ~ (p=0.357 n=5+5) neo/go/fs1-zhash.go+prefetch128 17.6µs ± 5% 17.6µs ± 2% ~ (p=1.000 n=5+5) neo/go/fs1(!sha1)-zhash.go(!sha1) 39.1µs ± 1% 39.1µs ± 2% ~ (p=0.714 n=5+5) neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 14.8µs ± 3% 14.6µs ± 4% ~ (p=0.302 n=5+5) neo/go/sqlite-zhash.py 269µs ± 3% 271µs ± 2% ~ (p=0.548 n=5+5) neo/go/sqlite-zhash.go 86.0µs ± 1% 86.4µs ± 0% ~ (p=0.206 n=5+5) neo/go/sqlite-zhash.go+prefetch128 36.4µs ± 6% 35.8µs ± 2% ~ (p=0.532 n=5+5) neo/go/sqlite-zhash.go(!sha1) 83.6µs ± 1% 84.0µs ± 1% ~ (p=0.516 n=5+5) neo/go/sqlite-zhash.go+prefetch128(!sha1) 35.9µs ± 5% 36.5µs ± 5% ~ (p=0.444 n=5+5) name old req/s new req/s delta cluster:deco dataset:wczblk1-8 fs1-zwrk.go·1 438k ± 1% 436k ± 0% ~ (p=0.222 n=5+5) fs1-zwrk.go·2 745k ± 1% 744k ± 1% ~ (p=0.548 n=5+5) fs1-zwrk.go·3 1.09M ± 0% 1.09M ± 0% ~ (p=0.095 n=5+5) fs1-zwrk.go·4 1.15M ± 1% 1.16M ± 1% ~ (p=0.095 n=5+5) fs1-zwrk.go·8 1.27M ± 1% 1.27M ± 1% ~ (p=0.841 n=5+5) fs1-zwrk.go·12 1.27M ± 1% 1.27M ± 1% ~ (p=0.690 n=5+5) fs1-zwrk.go·16 1.28M ± 1% 1.27M ± 1% ~ (p=0.841 n=5+5) zeo/py/fs1-zwrk.go·1 9.04k ± 1% 9.12k ± 0% +0.89% (p=0.008 n=5+5) zeo/py/fs1-zwrk.go·2 11.4k ± 1% 11.6k ± 1% +1.58% (p=0.008 n=5+5) zeo/py/fs1-zwrk.go·3 13.4k ± 1% 13.4k ± 1% ~ (p=0.310 n=5+5) zeo/py/fs1-zwrk.go·4 14.0k ± 1% 14.0k ± 1% ~ (p=0.595 n=5+5) zeo/py/fs1-zwrk.go·8 14.6k ± 4% 14.7k ± 1% ~ (p=0.690 n=5+5) zeo/py/fs1-zwrk.go·12 14.9k ± 1% 15.0k ± 1% ~ (p=0.421 n=5+5) zeo/py/fs1-zwrk.go·16 15.3k ± 1% 15.1k ± 0% -0.79% (p=0.016 n=5+5) neo/py(!log)/sqlite-zwrk.go·1 7.03k ± 3% 7.09k ± 1% ~ (p=0.310 n=5+5) neo/py(!log)/sqlite-zwrk.go·2 8.52k ± 1% 8.48k ± 1% ~ (p=0.151 n=5+5) neo/py(!log)/sqlite-zwrk.go·3 8.48k ± 1% 8.48k ± 1% ~ (p=0.690 n=5+5) neo/py(!log)/sqlite-zwrk.go·4 8.45k ± 1% 8.47k ± 1% ~ (p=0.841 n=5+5) neo/py(!log)/sqlite-zwrk.go·8 8.44k ± 1% 8.43k ± 1% ~ (p=0.690 n=5+5) neo/py(!log)/sqlite-zwrk.go·12 8.48k ± 1% 8.46k ± 1% ~ (p=0.841 n=5+5) neo/py(!log)/sqlite-zwrk.go·16 8.49k ± 1% 8.46k ± 1% ~ (p=0.310 n=5+5) neo/py(!log)/sql-zwrk.go·1 5.51k ± 1% 5.51k ± 1% ~ (p=1.000 n=5+5) neo/py(!log)/sql-zwrk.go·2 6.31k ± 1% 6.32k ± 1% ~ (p=0.841 n=5+5) neo/py(!log)/sql-zwrk.go·3 6.20k ± 1% 6.29k ± 1% +1.37% (p=0.008 n=5+5) neo/py(!log)/sql-zwrk.go·4 6.22k ± 1% 6.27k ± 1% +0.83% (p=0.008 n=5+5) neo/py(!log)/sql-zwrk.go·8 6.25k ± 1% 6.27k ± 1% ~ (p=0.548 n=5+5) neo/py(!log)/sql-zwrk.go·12 6.26k ± 1% 6.29k ± 0% ~ (p=0.841 n=5+5) neo/py(!log)/sql-zwrk.go·16 6.26k ± 1% 6.22k ± 1% ~ (p=0.421 n=5+5) neo/go/fs1-zwrk.go·1 18.4k ± 0% 18.4k ± 1% ~ (p=0.167 n=5+5) neo/go/fs1-zwrk.go·2 38.2k ± 1% 38.1k ± 1% ~ (p=0.841 n=5+5) neo/go/fs1-zwrk.go·3 45.8k ± 1% 46.0k ± 1% ~ (p=0.421 n=5+5) neo/go/fs1-zwrk.go·4 49.8k ± 0% 50.2k ± 1% +0.94% (p=0.008 n=5+5) neo/go/fs1-zwrk.go·8 60.3k ± 1% 61.0k ± 0% +1.16% (p=0.016 n=5+5) neo/go/fs1-zwrk.go·12 61.6k ± 1% 62.1k ± 1% ~ (p=0.222 n=5+5) neo/go/fs1-zwrk.go·16 61.4k ± 1% 62.5k ± 1% ~ (p=0.095 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 26.1k ± 1% 26.3k ± 1% ~ (p=0.222 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 55.3k ± 1% 55.3k ± 1% ~ (p=1.000 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 62.7k ± 1% 62.7k ± 1% ~ (p=0.841 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 69.1k ± 0% 69.3k ± 1% ~ (p=0.421 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 87.9k ± 0% 88.2k ± 0% ~ (p=0.310 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 92.2k ± 1% 93.4k ± 0% +1.32% (p=0.008 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 93.4k ± 1% 93.5k ± 2% ~ (p=0.690 n=5+5) neo/go/sqlite-zwrk.go·1 11.1k ± 0% 11.0k ± 1% ~ (p=0.421 n=5+5) neo/go/sqlite-zwrk.go·2 18.5k ± 0% 18.4k ± 1% -0.68% (p=0.016 n=5+5) neo/go/sqlite-zwrk.go·3 24.5k ± 0% 24.4k ± 1% ~ (p=0.151 n=5+5) neo/go/sqlite-zwrk.go·4 26.9k ± 1% 26.8k ± 0% ~ (p=0.151 n=5+5) neo/go/sqlite-zwrk.go·8 29.9k ± 2% 30.4k ± 2% ~ (p=0.310 n=5+5) neo/go/sqlite-zwrk.go·12 29.2k ± 2% 30.5k ± 1% +4.49% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go·16 28.4k ± 2% 29.9k ± 2% +5.53% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·1 11.8k ± 0% 11.9k ± 1% ~ (p=0.063 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·2 19.5k ± 0% 19.7k ± 0% +0.60% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·3 26.8k ± 1% 26.5k ± 1% -1.14% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·4 30.3k ± 1% 30.0k ± 0% -1.12% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·8 32.0k ± 2% 31.2k ± 2% -2.46% (p=0.032 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·12 30.2k ± 3% 28.9k ± 1% -4.20% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·16 29.7k ± 1% 28.4k ± 2% -4.27% (p=0.008 n=5+5) cluster:deco dataset:prod1-1024 fs1-zwrk.go·1 555k ± 0% 555k ± 0% ~ (p=1.000 n=5+5) fs1-zwrk.go·2 982k ± 2% 1008k ± 3% +2.66% (p=0.032 n=5+5) fs1-zwrk.go·3 1.32M ± 1% 1.32M ± 1% ~ (p=0.421 n=5+5) fs1-zwrk.go·4 1.51M ± 1% 1.55M ± 2% +2.80% (p=0.032 n=5+5) fs1-zwrk.go·8 1.58M ± 1% 1.59M ± 0% ~ (p=0.548 n=5+5) fs1-zwrk.go·12 1.59M ± 0% 1.59M ± 0% ~ (p=0.548 n=5+5) fs1-zwrk.go·16 1.59M ± 0% 1.59M ± 0% ~ (p=0.095 n=5+5) zeo/py/fs1-zwrk.go·1 9.70k ± 1% 9.70k ± 0% ~ (p=1.000 n=5+5) zeo/py/fs1-zwrk.go·2 12.2k ± 1% 12.4k ± 1% +1.67% (p=0.008 n=5+5) zeo/py/fs1-zwrk.go·3 14.2k ± 1% 14.2k ± 1% ~ (p=0.095 n=5+5) zeo/py/fs1-zwrk.go·4 14.9k ± 0% 14.9k ± 0% ~ (p=0.841 n=5+5) zeo/py/fs1-zwrk.go·8 15.6k ± 0% 15.6k ± 0% ~ (p=0.548 n=5+5) zeo/py/fs1-zwrk.go·12 15.9k ± 1% 15.2k ±11% ~ (p=0.310 n=5+5) zeo/py/fs1-zwrk.go·16 16.1k ± 0% 16.1k ± 1% ~ (p=0.421 n=5+5) neo/py(!log)/sqlite-zwrk.go·1 7.51k ± 1% 7.44k ± 1% -0.91% (p=0.016 n=5+5) neo/py(!log)/sqlite-zwrk.go·2 8.72k ± 1% 8.59k ± 1% -1.45% (p=0.008 n=5+5) neo/py(!log)/sqlite-zwrk.go·3 8.69k ± 1% 8.61k ± 1% ~ (p=0.095 n=5+5) neo/py(!log)/sqlite-zwrk.go·4 8.67k ± 1% 8.57k ± 1% ~ (p=0.095 n=5+5) neo/py(!log)/sqlite-zwrk.go·8 8.72k ± 0% 8.56k ± 1% -1.83% (p=0.008 n=5+5) neo/py(!log)/sqlite-zwrk.go·12 8.63k ± 1% 8.51k ± 1% ~ (p=0.056 n=5+5) neo/py(!log)/sqlite-zwrk.go·16 8.64k ± 1% 8.54k ± 1% ~ (p=0.095 n=5+5) neo/py(!log)/sql-zwrk.go·1 5.56k ± 2% 5.55k ± 2% ~ (p=1.000 n=5+5) neo/py(!log)/sql-zwrk.go·2 6.42k ± 0% 6.36k ± 1% -0.97% (p=0.032 n=5+5) neo/py(!log)/sql-zwrk.go·3 6.40k ± 0% 6.31k ± 0% -1.44% (p=0.008 n=5+5) neo/py(!log)/sql-zwrk.go·4 6.38k ± 1% 6.28k ± 0% -1.57% (p=0.008 n=5+5) neo/py(!log)/sql-zwrk.go·8 6.39k ± 1% 6.34k ± 1% ~ (p=0.056 n=5+5) neo/py(!log)/sql-zwrk.go·12 6.42k ± 1% 6.35k ± 1% -1.11% (p=0.016 n=5+5) neo/py(!log)/sql-zwrk.go·16 6.41k ± 2% 6.36k ± 0% ~ (p=0.151 n=5+5) neo/go/fs1-zwrk.go·1 23.8k ± 0% 23.7k ± 0% -0.33% (p=0.032 n=5+5) neo/go/fs1-zwrk.go·2 45.0k ± 1% 45.4k ± 0% +0.93% (p=0.032 n=5+5) neo/go/fs1-zwrk.go·3 55.1k ± 1% 55.2k ± 1% ~ (p=1.000 n=5+5) neo/go/fs1-zwrk.go·4 60.1k ± 0% 60.7k ± 2% ~ (p=0.151 n=5+5) neo/go/fs1-zwrk.go·8 68.3k ± 2% 70.9k ± 2% +3.72% (p=0.016 n=5+5) neo/go/fs1-zwrk.go·12 69.3k ± 5% 71.1k ± 3% ~ (p=0.310 n=5+5) neo/go/fs1-zwrk.go·16 68.8k ± 6% 71.0k ± 3% ~ (p=0.690 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 27.3k ± 0% 27.3k ± 0% ~ (p=0.095 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 54.9k ± 1% 55.4k ± 1% ~ (p=0.095 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 64.0k ± 0% 64.0k ± 1% ~ (p=0.841 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 68.7k ± 1% 69.0k ± 1% ~ (p=0.222 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 79.4k ± 2% 80.9k ± 2% ~ (p=0.222 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 77.9k ± 2% 78.3k ± 5% ~ (p=1.000 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 75.3k ± 6% 75.4k ± 3% ~ (p=1.000 n=5+5) neo/go/sqlite-zwrk.go·1 11.8k ± 0% 11.7k ± 1% ~ (p=0.095 n=5+5) neo/go/sqlite-zwrk.go·2 19.2k ± 0% 19.0k ± 0% -0.85% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go·3 24.5k ± 1% 24.5k ± 1% ~ (p=1.000 n=5+5) neo/go/sqlite-zwrk.go·4 26.6k ± 1% 26.3k ± 1% -1.38% (p=0.016 n=5+5) neo/go/sqlite-zwrk.go·8 25.1k ± 3% 24.9k ± 3% ~ (p=0.421 n=5+5) neo/go/sqlite-zwrk.go·12 23.8k ± 2% 24.0k ± 5% ~ (p=1.000 n=5+5) neo/go/sqlite-zwrk.go·16 24.3k ± 2% 25.4k ± 1% +4.53% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·1 12.1k ± 1% 12.2k ± 0% ~ (p=0.151 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·2 19.6k ± 0% 19.8k ± 0% +0.98% (p=0.016 n=4+5) neo/go/sqlite-zwrk.go(!sha1)·3 25.3k ± 1% 26.2k ± 1% +3.40% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·4 27.3k ± 1% 28.7k ± 1% +5.03% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·8 25.4k ± 3% 27.2k ± 3% +6.78% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·12 23.8k ± 2% 25.3k ± 2% +6.21% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·16 23.9k ± 2% 25.3k ± 1% +6.14% (p=0.008 n=5+5) name old latency-time/object new latency-time/object delta cluster:deco dataset:wczblk1-8 fs1-zwrk.go·1 2.29µs ± 1% 2.29µs ± 0% ~ (p=0.222 n=5+5) fs1-zwrk.go·2 2.68µs ± 1% 2.69µs ± 1% ~ (p=0.524 n=5+5) fs1-zwrk.go·3 2.76µs ± 0% 2.76µs ± 0% ~ (p=0.111 n=5+5) fs1-zwrk.go·4 3.46µs ± 1% 3.44µs ± 1% ~ (p=0.095 n=5+5) fs1-zwrk.go·8 6.28µs ± 1% 6.28µs ± 1% ~ (p=0.889 n=5+5) fs1-zwrk.go·12 9.42µs ± 1% 9.46µs ± 1% ~ (p=0.690 n=5+5) fs1-zwrk.go·16 12.5µs ± 1% 12.6µs ± 1% ~ (p=0.841 n=5+5) zeo/py/fs1-zwrk.go·1 111µs ± 1% 110µs ± 0% -0.88% (p=0.008 n=5+5) zeo/py/fs1-zwrk.go·2 176µs ± 1% 173µs ± 1% -1.56% (p=0.008 n=5+5) zeo/py/fs1-zwrk.go·3 224µs ± 1% 224µs ± 1% ~ (p=0.310 n=5+5) zeo/py/fs1-zwrk.go·4 285µs ± 1% 286µs ± 1% ~ (p=0.690 n=5+5) zeo/py/fs1-zwrk.go·8 549µs ± 4% 545µs ± 1% ~ (p=0.690 n=5+5) zeo/py/fs1-zwrk.go·12 805µs ± 1% 802µs ± 1% ~ (p=0.421 n=5+5) zeo/py/fs1-zwrk.go·16 1.05ms ± 1% 1.06ms ± 0% +0.80% (p=0.016 n=5+5) neo/py(!log)/sqlite-zwrk.go·1 142µs ± 3% 141µs ± 1% ~ (p=0.310 n=5+5) neo/py(!log)/sqlite-zwrk.go·2 235µs ± 1% 236µs ± 1% ~ (p=0.151 n=5+5) neo/py(!log)/sqlite-zwrk.go·3 354µs ± 1% 354µs ± 1% ~ (p=0.690 n=5+5) neo/py(!log)/sqlite-zwrk.go·4 473µs ± 1% 472µs ± 1% ~ (p=0.841 n=5+5) neo/py(!log)/sqlite-zwrk.go·8 948µs ± 1% 949µs ± 1% ~ (p=0.690 n=5+5) neo/py(!log)/sqlite-zwrk.go·12 1.42ms ± 1% 1.42ms ± 1% ~ (p=0.841 n=5+5) neo/py(!log)/sqlite-zwrk.go·16 1.88ms ± 1% 1.89ms ± 1% ~ (p=0.310 n=5+5) neo/py(!log)/sql-zwrk.go·1 181µs ± 1% 181µs ± 1% ~ (p=1.000 n=5+5) neo/py(!log)/sql-zwrk.go·2 317µs ± 1% 317µs ± 1% ~ (p=0.841 n=5+5) neo/py(!log)/sql-zwrk.go·3 484µs ± 1% 477µs ± 1% -1.36% (p=0.008 n=5+5) neo/py(!log)/sql-zwrk.go·4 643µs ± 1% 638µs ± 1% -0.82% (p=0.008 n=5+5) neo/py(!log)/sql-zwrk.go·8 1.28ms ± 1% 1.28ms ± 1% ~ (p=0.548 n=5+5) neo/py(!log)/sql-zwrk.go·12 1.92ms ± 1% 1.91ms ± 0% ~ (p=0.841 n=5+5) neo/py(!log)/sql-zwrk.go·16 2.56ms ± 1% 2.57ms ± 1% ~ (p=0.421 n=5+5) neo/go/fs1-zwrk.go·1 54.5µs ± 0% 54.2µs ± 1% ~ (p=0.167 n=5+5) neo/go/fs1-zwrk.go·2 52.4µs ± 1% 52.5µs ± 1% ~ (p=0.841 n=5+5) neo/go/fs1-zwrk.go·3 65.4µs ± 1% 65.3µs ± 1% ~ (p=0.421 n=5+5) neo/go/fs1-zwrk.go·4 80.4µs ± 0% 79.6µs ± 1% -0.93% (p=0.008 n=5+5) neo/go/fs1-zwrk.go·8 133µs ± 1% 131µs ± 0% -1.15% (p=0.016 n=5+5) neo/go/fs1-zwrk.go·12 195µs ± 1% 193µs ± 1% ~ (p=0.222 n=5+5) neo/go/fs1-zwrk.go·16 261µs ± 1% 256µs ± 1% ~ (p=0.095 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 38.3µs ± 1% 38.0µs ± 1% ~ (p=0.222 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 36.2µs ± 1% 36.1µs ± 1% ~ (p=1.000 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 47.8µs ± 1% 47.8µs ± 1% ~ (p=0.841 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 57.9µs ± 0% 57.7µs ± 1% ~ (p=0.421 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 91.0µs ± 0% 90.7µs ± 0% ~ (p=0.310 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 130µs ± 1% 129µs ± 0% -1.31% (p=0.008 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 171µs ± 1% 171µs ± 2% ~ (p=0.690 n=5+5) neo/go/sqlite-zwrk.go·1 90.4µs ± 0% 90.7µs ± 1% ~ (p=0.421 n=5+5) neo/go/sqlite-zwrk.go·2 108µs ± 0% 109µs ± 1% +0.69% (p=0.016 n=5+5) neo/go/sqlite-zwrk.go·3 123µs ± 0% 123µs ± 1% ~ (p=0.151 n=5+5) neo/go/sqlite-zwrk.go·4 148µs ± 1% 149µs ± 0% ~ (p=0.151 n=5+5) neo/go/sqlite-zwrk.go·8 267µs ± 2% 263µs ± 2% ~ (p=0.310 n=5+5) neo/go/sqlite-zwrk.go·12 411µs ± 2% 393µs ± 1% -4.31% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go·16 564µs ± 2% 534µs ± 2% -5.24% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·1 84.5µs ± 0% 84.0µs ± 1% ~ (p=0.063 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·2 102µs ± 0% 102µs ± 0% -0.60% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·3 112µs ± 1% 113µs ± 1% +1.16% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·4 132µs ± 1% 133µs ± 0% +1.13% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·8 250µs ± 2% 257µs ± 2% +2.52% (p=0.032 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·12 397µs ± 3% 415µs ± 1% +4.38% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·16 539µs ± 1% 563µs ± 2% +4.47% (p=0.008 n=5+5) cluster:deco dataset:prod1-1024 fs1-zwrk.go·1 1.80µs ± 0% 1.80µs ± 0% ~ (p=0.968 n=5+5) fs1-zwrk.go·2 2.04µs ± 2% 1.98µs ± 3% -2.55% (p=0.032 n=5+5) fs1-zwrk.go·3 2.28µs ± 1% 2.27µs ± 1% ~ (p=0.389 n=5+5) fs1-zwrk.go·4 2.65µs ± 1% 2.58µs ± 2% -2.71% (p=0.032 n=5+5) fs1-zwrk.go·8 5.05µs ± 1% 5.04µs ± 0% ~ (p=0.548 n=5+5) fs1-zwrk.go·12 7.54µs ± 0% 7.55µs ± 0% ~ (p=0.571 n=5+5) fs1-zwrk.go·16 10.1µs ± 0% 10.0µs ± 0% ~ (p=0.095 n=5+5) zeo/py/fs1-zwrk.go·1 103µs ± 1% 103µs ± 0% ~ (p=1.000 n=5+5) zeo/py/fs1-zwrk.go·2 164µs ± 1% 162µs ± 1% -1.64% (p=0.008 n=5+5) zeo/py/fs1-zwrk.go·3 211µs ± 1% 212µs ± 1% ~ (p=0.095 n=5+5) zeo/py/fs1-zwrk.go·4 269µs ± 0% 269µs ± 0% ~ (p=0.841 n=5+5) zeo/py/fs1-zwrk.go·8 512µs ± 0% 512µs ± 0% ~ (p=0.548 n=5+5) zeo/py/fs1-zwrk.go·12 755µs ± 1% 793µs ±12% ~ (p=0.310 n=5+5) zeo/py/fs1-zwrk.go·16 993µs ± 0% 991µs ± 1% ~ (p=0.421 n=5+5) neo/py(!log)/sqlite-zwrk.go·1 133µs ± 1% 134µs ± 1% +0.92% (p=0.016 n=5+5) neo/py(!log)/sqlite-zwrk.go·2 229µs ± 1% 233µs ± 1% +1.47% (p=0.008 n=5+5) neo/py(!log)/sqlite-zwrk.go·3 345µs ± 1% 348µs ± 1% ~ (p=0.095 n=5+5) neo/py(!log)/sqlite-zwrk.go·4 461µs ± 1% 467µs ± 1% ~ (p=0.095 n=5+5) neo/py(!log)/sqlite-zwrk.go·8 917µs ± 0% 935µs ± 1% +1.87% (p=0.008 n=5+5) neo/py(!log)/sqlite-zwrk.go·12 1.39ms ± 1% 1.41ms ± 1% ~ (p=0.056 n=5+5) neo/py(!log)/sqlite-zwrk.go·16 1.85ms ± 1% 1.87ms ± 1% ~ (p=0.095 n=5+5) neo/py(!log)/sql-zwrk.go·1 180µs ± 2% 180µs ± 2% ~ (p=1.000 n=5+5) neo/py(!log)/sql-zwrk.go·2 311µs ± 0% 315µs ± 1% +0.99% (p=0.032 n=5+5) neo/py(!log)/sql-zwrk.go·3 468µs ± 0% 475µs ± 0% +1.47% (p=0.008 n=5+5) neo/py(!log)/sql-zwrk.go·4 627µs ± 1% 637µs ± 0% +1.59% (p=0.008 n=5+5) neo/py(!log)/sql-zwrk.go·8 1.25ms ± 1% 1.26ms ± 1% ~ (p=0.056 n=5+5) neo/py(!log)/sql-zwrk.go·12 1.87ms ± 1% 1.89ms ± 1% +1.13% (p=0.016 n=5+5) neo/py(!log)/sql-zwrk.go·16 2.50ms ± 2% 2.52ms ± 0% ~ (p=0.151 n=5+5) neo/go/fs1-zwrk.go·1 42.0µs ± 0% 42.2µs ± 0% +0.33% (p=0.032 n=5+5) neo/go/fs1-zwrk.go·2 44.5µs ± 1% 44.1µs ± 0% -0.92% (p=0.032 n=5+5) neo/go/fs1-zwrk.go·3 54.5µs ± 1% 54.4µs ± 1% ~ (p=1.000 n=5+5) neo/go/fs1-zwrk.go·4 66.5µs ± 0% 65.9µs ± 2% ~ (p=0.151 n=5+5) neo/go/fs1-zwrk.go·8 117µs ± 2% 113µs ± 2% -3.59% (p=0.016 n=5+5) neo/go/fs1-zwrk.go·12 173µs ± 4% 169µs ± 4% ~ (p=0.310 n=5+5) neo/go/fs1-zwrk.go·16 233µs ± 6% 225µs ± 3% ~ (p=0.690 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 36.7µs ± 0% 36.6µs ± 0% ~ (p=0.095 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 36.4µs ± 1% 36.1µs ± 1% ~ (p=0.095 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 46.9µs ± 0% 46.9µs ± 1% ~ (p=0.841 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 58.2µs ± 1% 57.9µs ± 1% ~ (p=0.222 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 101µs ± 2% 99µs ± 2% ~ (p=0.222 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 154µs ± 2% 153µs ± 5% ~ (p=1.000 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 213µs ± 6% 212µs ± 3% ~ (p=1.000 n=5+5) neo/go/sqlite-zwrk.go·1 84.7µs ± 0% 85.1µs ± 1% ~ (p=0.095 n=5+5) neo/go/sqlite-zwrk.go·2 104µs ± 0% 105µs ± 0% +0.86% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go·3 123µs ± 1% 123µs ± 1% ~ (p=1.000 n=5+5) neo/go/sqlite-zwrk.go·4 150µs ± 1% 152µs ± 1% +1.40% (p=0.016 n=5+5) neo/go/sqlite-zwrk.go·8 319µs ± 3% 321µs ± 3% ~ (p=0.421 n=5+5) neo/go/sqlite-zwrk.go·12 504µs ± 2% 500µs ± 5% ~ (p=1.000 n=5+5) neo/go/sqlite-zwrk.go·16 659µs ± 2% 630µs ± 1% -4.34% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·1 82.5µs ± 1% 82.0µs ± 0% ~ (p=0.151 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·2 102µs ± 0% 101µs ± 0% -0.97% (p=0.016 n=4+5) neo/go/sqlite-zwrk.go(!sha1)·3 119µs ± 1% 115µs ± 1% -3.29% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·4 146µs ± 1% 139µs ± 1% -4.78% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·8 315µs ± 3% 295µs ± 3% -6.37% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·12 503µs ± 2% 474µs ± 2% -5.86% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·16 671µs ± 2% 632µs ± 1% -5.79% (p=0.008 n=5+5)
-
Kirill Smelkov authored
-
Kirill Smelkov authored
-
- 05 Mar, 2018 6 commits
-
-
Kirill Smelkov authored
-
Kirill Smelkov authored
Latency is awful (> 500µs) because RX coalescing is not disabled on rio.
-
Kirill Smelkov authored
Like in previous commit should not be changing compared to 39a77e3b, but it was not checked.
-
Kirill Smelkov authored
Compared to 0ed7b1fc there should not be a difference (checked only on serial cases with manually ediging 20180221-deco-noturbo-noz.txt-fix to use updated output format for wczblk1-8 dataset): $ benchstat -split node,cluster,dataset 20180221-deco-noturbo-noz.txt-fix 20180305-deco-noturbo-c.txt name old pystone/s new pystone/s delta node:deco pystone 221k ± 0% 219k ± 3% ~ (p=0.690 n=5+5) name old time/op new time/op delta node:deco sha1/py/1K 1.85µs ± 2% 1.84µs ± 1% ~ (p=0.508 n=5+5) sha1/go/1K 1.53µs ± 0% 1.53µs ± 0% ~ (p=0.103 n=5+5) sha1/py/4K 6.68µs ± 1% 6.69µs ± 0% ~ (p=0.151 n=5+5) sha1/go/4K 5.59µs ± 0% 5.59µs ± 0% ~ (p=0.333 n=5+5) sha1/py/2M 3.18ms ± 0% 3.18ms ± 0% ~ (p=0.421 n=5+5) sha1/go/2M 2.78ms ± 0% 2.78ms ± 0% ~ (p=1.000 n=5+5) unzlib/py/null-1K 2.81µs ± 0% 2.91µs ± 3% +3.49% (p=0.008 n=5+5) unzlib/go/null-1K 2.86µs ± 0% 2.88µs ± 1% +0.93% (p=0.008 n=5+5) unzlib/py/null-4K 11.3µs ± 1% 11.4µs ± 2% +0.89% (p=0.040 n=5+5) unzlib/go/null-4K 11.3µs ± 0% 11.4µs ± 0% +0.89% (p=0.008 n=5+5) unzlib/py/null-2M 5.71ms ± 5% 5.66ms ± 3% ~ (p=1.000 n=5+5) unzlib/go/null-2M 4.79ms ± 0% 4.79ms ± 0% ~ (p=0.095 n=5+5) unzlib/py/prod1-avg 5.02µs ± 1% 5.06µs ± 0% ~ (p=0.057 n=4+4) unzlib/go/prod1-avg 5.27µs ± 1% 5.33µs ± 1% ~ (p=0.087 n=5+5) unzlib/py/prod1-max 512µs ± 2% 438µs ± 5% -14.45% (p=0.008 n=5+5) unzlib/go/prod1-max 336µs ± 0% 352µs ± 4% +4.67% (p=0.008 n=5+5) disk/randread/direct/4K-min 105µs ± 1% 105µs ± 0% ~ (p=1.000 n=5+5) disk/randread/direct/4K-avg 144µs ± 0% 142µs ± 0% -1.54% (p=0.008 n=5+5) disk/randread/direct/2M-min 5.48ms ± 3% 5.34ms ± 3% ~ (p=0.135 n=5+5) disk/randread/direct/2M-avg 6.13ms ± 1% 6.04ms ± 2% ~ (p=0.056 n=5+5) disk/randread/pagecache/4K-min 570ns ± 1% 583ns ± 1% +2.28% (p=0.008 n=5+5) disk/randread/pagecache/4K-avg 975ns ± 0% 1003ns ± 1% +2.91% (p=0.008 n=5+5) disk/randread/pagecache/2M-min 195µs ± 4% 197µs ± 4% ~ (p=0.690 n=5+5) disk/randread/pagecache/2M-avg 214µs ± 0% 220µs ± 1% +2.80% (p=0.008 n=5+5) name old time/object new time/object delta cluster:deco dataset:wczblk1-8 fs1-zhash.py 20.3µs ± 1% 20.2µs ± 1% ~ (p=0.444 n=5+4) fs1-zhash.go 3.20µs ± 0% 3.20µs ± 0% ~ (all equal) fs1-zhash.go+prefetch128 4.16µs ± 4% 4.14µs ± 6% ~ (p=0.952 n=5+5) zeo/py/fs1-zhash.py 375µs ± 4% 379µs ± 3% ~ (p=0.690 n=5+5) neo/py/sqlite-zhash.py 355µs ± 6% 362µs ± 6% ~ (p=0.421 n=5+5) neo/py/sqlite-zhash.go 156µs ± 2% 158µs ± 1% ~ (p=0.151 n=5+5) neo/py/sqlite-zhash.go+prefetch128 134µs ± 2% 135µs ± 1% ~ (p=0.421 n=5+5) neo/py(!log)/sqlite-zhash.py 326µs ± 3% 335µs ± 4% ~ (p=0.381 n=5+5) neo/py(!log)/sqlite-zhash.go 143µs ± 3% 145µs ± 2% ~ (p=0.508 n=5+5) neo/py(!log)/sqlite-zhash.go+prefetch128 119µs ± 2% 118µs ± 1% ~ (p=0.421 n=5+5) neo/py/sql-zhash.py 466µs ±45% 392µs ± 5% ~ (p=0.111 n=5+4) neo/py/sql-zhash.go 201µs ± 2% 197µs ± 1% -1.63% (p=0.008 n=5+5) neo/py/sql-zhash.go+prefetch128 184µs ± 2% 180µs ± 2% -1.96% (p=0.032 n=5+5) neo/py(!log)/sql-zhash.py 375µs ± 2% 454µs ±61% ~ (p=0.286 n=4+5) neo/py(!log)/sql-zhash.go 182µs ± 2% 183µs ± 1% ~ (p=0.802 n=5+5) neo/py(!log)/sql-zhash.go+prefetch128 164µs ± 1% 164µs ± 2% ~ (p=0.881 n=5+5) neo/go/fs1-zhash.py 226µs ± 1% 227µs ± 2% ~ (p=0.397 n=5+5) neo/go/fs1-zhash.go 56.8µs ± 1% 56.9µs ± 1% ~ (p=0.889 n=5+5) neo/go/fs1-zhash.go+prefetch128 24.8µs ± 3% 24.7µs ± 2% ~ (p=0.651 n=5+5) neo/go/sqlite-zhash.py 264µs ± 4% 269µs ± 1% ~ (p=0.548 n=5+5) neo/go/sqlite-zhash.go 93.5µs ± 0% 92.7µs ± 0% -0.83% (p=0.008 n=5+5) neo/go/sqlite-zhash.go+prefetch128 39.3µs ± 4% 39.8µs ± 8% ~ (p=0.952 n=5+5) ( not sure what it was for unzlib/py/prod1-max - probaby some background process was also running last time at that test )
-
Kirill Smelkov authored
-
Kirill Smelkov authored
-
- 04 Mar, 2018 9 commits
-
-
Kirill Smelkov authored
-
Kirill Smelkov authored
-
Kirill Smelkov authored
-
Kirill Smelkov authored
-
Kirill Smelkov authored
-
Kirill Smelkov authored
-
Kirill Smelkov authored
-
Kirill Smelkov authored
-
Kirill Smelkov authored
-
- 02 Mar, 2018 6 commits
-
-
Kirill Smelkov authored
-
Kirill Smelkov authored
-
Kirill Smelkov authored
-
Kirill Smelkov authored
-
Kirill Smelkov authored
-
Kirill Smelkov authored
-
- 01 Mar, 2018 2 commits
-
-
Kirill Smelkov authored
-
Kirill Smelkov authored
-
- 28 Feb, 2018 9 commits
-
-
Kirill Smelkov authored
-
Kirill Smelkov authored
-
Kirill Smelkov authored
-
Kirill Smelkov authored
This should make inter-host or inter-cluster comparisions of benchmark more straightforward.
-
Kirill Smelkov authored
Cstates are not disabled. First dataset graphed here: https://lab.nexedi.com/kirr/misc/raw/526e5ca/t/zwrk-z600-htoff.png
-
Kirill Smelkov authored
Cstates are not disabled. First dataset grpahed here: https://lab.nexedi.com/kirr/misc/raw/4a8fedc/t/zwrk-z6001.png
-
Kirill Smelkov authored
Handy for misconfigured systems like fqdn=z6001.ivan.nexedi.com, hostname=z6001-COMP-2784.
-
Kirill Smelkov authored
-
Kirill Smelkov authored
-
- 27 Feb, 2018 2 commits
-
-
Kirill Smelkov authored
very draft; work in progress.
-
Kirill Smelkov authored
-
- 26 Feb, 2018 2 commits
-
-
Kirill Smelkov authored
-
Kirill Smelkov authored
Similarly to wrk on HTTP. Rationale: simulating multiple clients is: 1. noisy - the timings from run to run are changing sometimes up to 50% 2. with significant additional overhead - there are constant OS-level process switches in between client processes and this prevents to actually create the load. 3. the above load from "2" actually takes resources from the server in localhost case. So let's switch to simlating many requests in lightweight way similarly to how it is done in wrk - in one process and not so many threads (it can be just 1) with many connections opened to server and epolly way to load it with Go providing epoll-goroutine matching.
-
