Commits · 3695ff12e05e29bdf5e7fbe89d88600b5bf9e554 · Kirill Smelkov / neo

06 Mar, 2018 10 commits

X rio: localhost timings, C > C1 disabled · 3695ff12

Kirill Smelkov authored Mar 06, 2018

Disabling C-states on rio tendto help serial cases, like it was on neo1
and z6001, but it is closer to noise.

---- 8< ----
cluster:rio dataset:wczblk1-8
zeo/py/fs1-zhash.py 400µs ± 0% 370µs ± 1% -7.32% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zhash.py 318µs ± 7% 295µs ± 0% -7.16% (p=0.008 n=5+5)
neo/py(!log)/sql-zhash.go+prefetch128 158µs ± 3% 158µs ± 2% ~ (p=1.000 n=5+5)
neo/go/fs1-zhash.py 222µs ± 4% 214µs ± 2% -3.73% (p=0.040 n=5+5)
neo/go/sqlite-zhash.py 273µs ± 3% 256µs ± 4% -6.45% (p=0.008 n=5+5)

cluster:rio dataset:prod1-1024
zeo/py/fs1-zhash.py 372µs ±10% 347µs ± 5% -6.84% (p=0.032 n=5+5)
neo/py(!log)/sqlite-zhash.py 321µs ±11% 298µs ± 5% -7.13% (p=0.048 n=5+5)
---- 8< ----

the pystone/s change is nose as pystone/s for C-enabled case was 146k on
prev-prev run (see 31dc070d).

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

$ benchstat -split node,cluster,dataset 20180306-rio-ffixed-c.txt 20180306-rio-ffixed-noc_C1$1µs$.txt

name old pystone/s new pystone/s delta
node:rio
pystone 115k ±12% 144k ± 1% +25.53% (p=0.008 n=5+5)

name old time/op new time/op delta
node:rio
crc32/py/4K 4.77µs ± 0% 4.78µs ± 1% ~ (p=0.825 n=4+5)
crc32/go/4K 1.49µs ± 0% 1.49µs ± 0% ~ (p=0.484 n=5+5)
sha1/py/4K 8.04µs ± 1% 8.00µs ± 1% ~ (p=0.206 n=5+5)
sha1/go/4K 8.93µs ± 0% 8.93µs ± 0% ~ (p=0.389 n=5+5)
unzlib/py/wczdata 25.1µs ± 1% 25.1µs ± 1% ~ (p=1.000 n=5+5)
unzlib/go/wczdata 23.0µs ± 0% 22.9µs ± 0% -0.45% (p=0.016 n=5+5)
unzlib/py/prod1-avg 7.16µs ± 1% 7.08µs ± 1% ~ (p=0.056 n=5+5)
unzlib/go/prod1-avg 5.08µs ± 1% 5.04µs ± 0% -0.82% (p=0.008 n=5+5)
disk/randread/direct/4K-min 92.4µs ± 0% 92.7µs ± 0% ~ (p=0.198 n=5+5)
disk/randread/direct/4K-avg 115µs ± 0% 115µs ± 0% +0.37% (p=0.008 n=5+5)
disk/randread/pagecache/4K-min 565ns ± 2% 562ns ± 1% ~ (p=0.444 n=5+5)
disk/randread/pagecache/4K-avg 992ns ± 0% 992ns ± 0% ~ (p=1.032 n=4+5)

name old time/object new time/object delta
cluster:rio dataset:wczblk1-8
fs1-zhash.py 29.2µs ± 1% 28.8µs ± 2% ~ (p=0.111 n=4+5)
fs1-zhash.go 4.68µs ± 5% 4.60µs ± 0% ~ (p=0.444 n=5+5)
fs1-zhash.go+prefetch128 4.78µs ± 5% 4.62µs ±15% ~ (p=0.159 n=5+5)
zeo/py/fs1-zhash.py 400µs ± 0% 370µs ± 1% -7.32% (p=0.008 n=5+5)
zeo/py/fs1-zhash.go 138µs ± 1% 136µs ± 2% ~ (p=0.087 n=5+5)
zeo/py/fs1-zhash.go+prefetch128 74.7µs ± 2% 74.9µs ± 2% ~ (p=0.730 n=5+5)
neo/py(!log)/sqlite-zhash.py 318µs ± 7% 295µs ± 0% -7.16% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zhash.go 154µs ± 4% 151µs ± 6% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zhash.go+prefetch128 125µs ± 3% 126µs ± 2% ~ (p=0.746 n=5+5)
neo/py(!log)/sql-zhash.py 400µs ±57% 325µs ± 2% ~ (p=0.063 n=5+4)
neo/py(!log)/sql-zhash.go 183µs ±11% 178µs ± 2% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zhash.go+prefetch128 158µs ± 3% 158µs ± 2% ~ (p=1.000 n=5+5)
neo/go/fs1-zhash.py 222µs ± 4% 214µs ± 2% -3.73% (p=0.040 n=5+5)
neo/go/fs1-zhash.go 68.6µs ± 2% 68.9µs ± 3% ~ (p=0.722 n=5+5)
neo/go/fs1-zhash.go+prefetch128 29.0µs ± 6% 28.3µs ± 4% ~ (p=0.135 n=5+5)
neo/go/fs1(!sha1)-zhash.go(!sha1) 43.9µs ± 3% 43.7µs ± 2% ~ (p=0.881 n=5+5)
neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 18.8µs ± 5% 18.6µs ± 4% ~ (p=0.516 n=5+5)
neo/go/sqlite-zhash.py 273µs ± 3% 256µs ± 4% -6.45% (p=0.008 n=5+5)
neo/go/sqlite-zhash.go 104µs ± 1% 104µs ± 2% ~ (p=0.651 n=5+5)
neo/go/sqlite-zhash.go+prefetch128 36.3µs ± 3% 37.0µs ± 8% ~ (p=0.595 n=5+5)
neo/go/sqlite-zhash.go(!sha1) 94.2µs ± 3% 93.1µs ± 3% ~ (p=0.151 n=5+5)
neo/go/sqlite-zhash.go+prefetch128(!sha1) 35.1µs ± 6% 35.7µs ±13% ~ (p=1.000 n=5+5)
cluster:rio dataset:prod1-1024
fs1-zhash.py 23.9µs ± 1% 24.0µs ± 2% ~ (p=0.937 n=4+5)
fs1-zhash.go 3.40µs ± 0% 3.40µs ± 0% ~ (all equal)
fs1-zhash.go+prefetch128 3.02µs ± 9% 3.04µs ± 2% ~ (p=0.397 n=5+5)
zeo/py/fs1-zhash.py 372µs ±10% 347µs ± 5% -6.84% (p=0.032 n=5+5)
zeo/py/fs1-zhash.go 114µs ± 1% 114µs ± 2% ~ (p=0.548 n=5+5)
zeo/py/fs1-zhash.go+prefetch128 64.6µs ± 1% 66.6µs ± 1% +3.07% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zhash.py 321µs ±11% 298µs ± 5% -7.13% (p=0.048 n=5+5)
neo/py(!log)/sqlite-zhash.go 142µs ± 3% 142µs ± 3% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zhash.go+prefetch128 117µs ± 1% 115µs ± 1% ~ (p=0.087 n=5+5)
neo/py(!log)/sql-zhash.py 330µs ± 1% 380µs ±34% +15.42% (p=0.016 n=4+5)
neo/py(!log)/sql-zhash.go 172µs ± 1% 170µs ± 2% ~ (p=0.310 n=5+5)
neo/py(!log)/sql-zhash.go+prefetch128 149µs ± 2% 148µs ± 1% ~ (p=0.222 n=5+5)
neo/go/fs1-zhash.py 217µs ± 1% 214µs ± 5% ~ (p=0.643 n=5+5)
neo/go/fs1-zhash.go 49.8µs ± 2% 49.5µs ± 1% ~ (p=0.246 n=5+5)
neo/go/fs1-zhash.go+prefetch128 18.8µs ± 1% 19.1µs ± 2% +2.03% (p=0.048 n=5+5)
neo/go/fs1(!sha1)-zhash.go(!sha1) 40.4µs ± 3% 40.5µs ± 2% ~ (p=0.587 n=5+5)
neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 16.1µs ± 2% 15.8µs ± 3% ~ (p=0.238 n=5+5)
neo/go/sqlite-zhash.py 263µs ± 4% 253µs ± 3% -3.90% (p=0.024 n=5+5)
neo/go/sqlite-zhash.go 93.1µs ± 1% 92.7µs ± 1% ~ (p=0.595 n=5+5)
neo/go/sqlite-zhash.go+prefetch128 32.7µs ± 2% 32.6µs ± 4% ~ (p=0.659 n=5+5)
neo/go/sqlite-zhash.go(!sha1) 89.6µs ± 1% 91.2µs ± 1% +1.79% (p=0.024 n=5+5)
neo/go/sqlite-zhash.go+prefetch128(!sha1) 34.0µs ± 2% 32.7µs ± 2% -3.82% (p=0.008 n=5+5)

name old req/s new req/s delta
cluster:rio dataset:wczblk1-8
fs1-zwrk.go·1 300k ± 0% 299k ± 1% ~ (p=0.310 n=5+5)
fs1-zwrk.go·2 546k ± 0% 547k ± 1% ~ (p=0.690 n=5+5)
fs1-zwrk.go·3 810k ± 0% 812k ± 0% ~ (p=0.310 n=5+5)
fs1-zwrk.go·4 1.08M ± 0% 1.08M ± 0% ~ (p=0.841 n=5+5)
fs1-zwrk.go·8 1.42M ± 0% 1.42M ± 0% ~ (p=1.000 n=5+5)
fs1-zwrk.go·12 1.55M ± 0% 1.55M ± 0% ~ (p=1.000 n=5+5)
fs1-zwrk.go·16 1.55M ± 0% 1.54M ± 0% -0.34% (p=0.016 n=5+5)
zeo/py/fs1-zwrk.go·1 7.41k ± 1% 7.42k ± 1% ~ (p=0.690 n=5+5)
zeo/py/fs1-zwrk.go·2 9.03k ± 1% 8.95k ± 1% ~ (p=0.310 n=5+5)
zeo/py/fs1-zwrk.go·3 9.77k ± 1% 9.86k ± 1% ~ (p=0.151 n=5+5)
zeo/py/fs1-zwrk.go·4 10.1k ± 3% 10.1k ± 2% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·8 10.5k ± 0% 10.4k ± 2% -1.37% (p=0.032 n=5+5)
zeo/py/fs1-zwrk.go·12 10.6k ± 1% 10.6k ± 2% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·16 10.6k ± 1% 10.6k ± 1% ~ (p=0.222 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 6.80k ± 2% 6.78k ± 1% ~ (p=0.841 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 8.31k ± 7% 8.25k ± 8% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 8.60k ± 1% 8.48k ± 1% ~ (p=0.056 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 8.60k ± 1% 8.52k ± 0% ~ (p=0.114 n=4+4)
neo/py(!log)/sqlite-zwrk.go·8 8.61k ± 1% 8.51k ± 1% ~ (p=0.095 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 8.56k ± 1% 8.46k ± 2% ~ (p=0.151 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 8.49k ± 3% 8.51k ± 1% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·1 5.62k ± 6% 5.59k ± 2% ~ (p=0.310 n=5+5)
neo/py(!log)/sql-zwrk.go·2 6.75k ± 4% 6.83k ± 1% ~ (p=0.190 n=5+4)
neo/py(!log)/sql-zwrk.go·3 6.77k ± 2% 6.71k ± 2% ~ (p=0.548 n=5+5)
neo/py(!log)/sql-zwrk.go·4 6.51k ± 7% 6.56k ± 4% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·8 6.56k ± 4% 6.68k ± 4% ~ (p=0.310 n=5+5)
neo/py(!log)/sql-zwrk.go·12 6.84k ± 1% 6.73k ± 6% ~ (p=0.730 n=4+5)
neo/py(!log)/sql-zwrk.go·16 6.73k ± 3% 6.71k ± 3% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·1 15.5k ± 0% 15.6k ± 0% ~ (p=0.095 n=5+5)
neo/go/fs1-zwrk.go·2 29.9k ± 1% 30.2k ± 1% +0.84% (p=0.032 n=5+5)
neo/go/fs1-zwrk.go·3 39.4k ± 0% 39.7k ± 0% +0.70% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·4 49.4k ± 0% 49.6k ± 0% +0.54% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·8 68.4k ± 0% 68.8k ± 0% +0.62% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·12 72.5k ± 0% 73.0k ± 0% +0.66% (p=0.016 n=5+5)
neo/go/fs1-zwrk.go·16 73.2k ± 0% 73.7k ± 1% +0.79% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 26.2k ± 1% 25.3k ± 2% -3.17% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 47.6k ± 0% 47.8k ± 0% +0.46% (p=0.032 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 59.4k ± 0% 59.6k ± 0% ~ (p=0.095 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 72.2k ± 0% 72.4k ± 0% ~ (p=0.056 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 96.7k ± 0% 96.8k ± 0% ~ (p=0.841 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 109k ± 0% 110k ± 0% ~ (p=0.841 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 113k ± 1% 113k ± 1% ~ (p=0.548 n=5+5)
neo/go/sqlite-zwrk.go·1 9.82k ± 0% 9.91k ± 0% +0.88% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·2 18.3k ± 0% 18.4k ± 0% +0.56% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·3 25.3k ± 0% 25.5k ± 0% +0.91% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·4 30.3k ± 0% 30.6k ± 0% +0.80% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·8 39.5k ± 0% 40.1k ± 0% +1.54% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·12 40.8k ± 2% 41.8k ± 1% +2.31% (p=0.016 n=5+5)
neo/go/sqlite-zwrk.go·16 40.5k ± 2% 41.8k ± 2% +3.20% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 11.0k ± 1% 11.1k ± 1% ~ (p=0.222 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 20.0k ± 0% 20.1k ± 0% +0.35% (p=0.016 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 27.9k ± 0% 28.0k ± 0% +0.27% (p=0.016 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 34.1k ± 0% 34.3k ± 0% +0.62% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 44.1k ± 1% 44.7k ± 1% +1.53% (p=0.016 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 43.1k ± 1% 44.5k ± 1% +3.33% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 41.2k ± 2% 43.0k ± 2% +4.21% (p=0.008 n=5+5)
cluster:rio dataset:prod1-1024
fs1-zwrk.go·1 465k ± 1% 461k ± 1% ~ (p=0.056 n=5+5)
fs1-zwrk.go·2 920k ± 0% 918k ± 0% ~ (p=0.730 n=4+5)
fs1-zwrk.go·3 1.36M ± 1% 1.37M ± 1% ~ (p=0.548 n=5+5)
fs1-zwrk.go·4 1.81M ± 0% 1.80M ± 3% ~ (p=0.310 n=5+5)
fs1-zwrk.go·8 2.37M ± 1% 2.38M ± 2% ~ (p=0.690 n=5+5)
fs1-zwrk.go·12 2.41M ± 0% 2.42M ± 0% ~ (p=0.690 n=5+5)
fs1-zwrk.go·16 2.42M ± 0% 2.41M ± 0% ~ (p=0.056 n=5+5)
zeo/py/fs1-zwrk.go·1 8.98k ± 1% 8.88k ± 1% -1.08% (p=0.032 n=5+5)
zeo/py/fs1-zwrk.go·2 11.7k ± 1% 11.6k ± 2% ~ (p=0.310 n=5+5)
zeo/py/fs1-zwrk.go·3 12.9k ± 2% 12.5k ± 2% -2.84% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·4 13.4k ± 4% 13.1k ± 2% ~ (p=0.095 n=5+5)
zeo/py/fs1-zwrk.go·8 14.0k ± 2% 13.6k ± 1% -2.77% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·12 14.2k ± 2% 13.9k ± 1% -2.05% (p=0.032 n=5+5)
zeo/py/fs1-zwrk.go·16 14.2k ± 3% 13.8k ± 1% -2.84% (p=0.032 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 7.16k ± 4% 7.12k ± 3% ~ (p=0.548 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 8.75k ± 1% 8.64k ± 7% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 8.65k ± 4% 8.79k ± 1% ~ (p=0.548 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 8.53k ± 6% 8.73k ± 2% ~ (p=0.310 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 8.61k ± 3% 8.60k ± 2% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 8.64k ± 0% 8.78k ± 1% +1.63% (p=0.016 n=4+5)
neo/py(!log)/sqlite-zwrk.go·16 8.64k ± 1% 8.58k ± 3% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·1 5.88k ± 1% 5.91k ± 1% ~ (p=0.548 n=5+5)
neo/py(!log)/sql-zwrk.go·2 6.79k ± 2% 6.71k ± 9% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zwrk.go·3 6.58k ± 4% 6.85k ± 2% ~ (p=0.056 n=5+5)
neo/py(!log)/sql-zwrk.go·4 6.68k ± 4% 6.82k ± 1% ~ (p=0.730 n=5+4)
neo/py(!log)/sql-zwrk.go·8 6.83k ± 1% 6.80k ± 6% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·12 6.66k ± 4% 6.87k ± 2% +3.10% (p=0.016 n=5+5)
neo/py(!log)/sql-zwrk.go·16 6.65k ± 5% 6.90k ± 2% ~ (p=0.151 n=5+5)
neo/go/fs1-zwrk.go·1 21.8k ± 1% 21.9k ± 2% ~ (p=0.222 n=5+5)
neo/go/fs1-zwrk.go·2 39.2k ± 1% 39.6k ± 1% +0.94% (p=0.016 n=5+5)
neo/go/fs1-zwrk.go·3 51.4k ± 0% 51.5k ± 0% ~ (p=0.421 n=5+5)
neo/go/fs1-zwrk.go·4 62.8k ± 0% 62.8k ± 0% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·8 80.7k ± 1% 80.2k ± 1% ~ (p=0.421 n=5+5)
neo/go/fs1-zwrk.go·12 80.0k ± 2% 79.6k ± 3% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·16 78.3k ± 2% 77.1k ± 5% ~ (p=0.421 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 26.5k ± 1% 26.9k ± 1% +1.52% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 48.8k ± 0% 49.2k ± 0% +0.89% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 61.8k ± 0% 62.1k ± 0% ~ (p=0.056 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 74.0k ± 0% 74.2k ± 0% ~ (p=0.151 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 91.3k ± 0% 91.9k ± 2% ~ (p=0.190 n=4+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 93.1k ± 2% 92.9k ± 2% ~ (p=0.841 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 89.7k ± 2% 90.1k ± 2% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go·1 11.0k ± 1% 11.1k ± 0% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go·2 19.4k ± 1% 19.4k ± 0% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go·3 26.6k ± 0% 26.5k ± 0% ~ (p=0.095 n=5+5)
neo/go/sqlite-zwrk.go·4 31.9k ± 0% 31.7k ± 0% -0.47% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·8 37.4k ± 2% 37.3k ± 2% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go·12 35.2k ± 3% 35.4k ± 2% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go·16 34.6k ± 2% 34.8k ± 2% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 11.5k ± 1% 11.4k ± 1% -1.34% (p=0.032 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 20.1k ± 0% 19.8k ± 0% -1.52% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 27.6k ± 0% 27.3k ± 1% -0.93% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 33.4k ± 0% 33.1k ± 1% -0.81% (p=0.016 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 38.8k ± 2% 38.8k ± 1% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 36.4k ± 1% 36.0k ± 2% ~ (p=0.222 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 35.2k ± 2% 35.1k ± 2% ~ (p=0.690 n=5+5)

name old latency-time/object new latency-time/object delta
cluster:rio dataset:wczblk1-8
fs1-zwrk.go·1 3.33µs ± 0% 3.34µs ± 1% ~ (p=0.286 n=5+5)
fs1-zwrk.go·2 3.67µs ± 0% 3.65µs ± 1% ~ (p=0.667 n=5+5)
fs1-zwrk.go·3 3.70µs ± 0% 3.69µs ± 0% ~ (p=0.310 n=5+5)
fs1-zwrk.go·4 3.72µs ± 0% 3.72µs ± 0% ~ (p=0.984 n=5+5)
fs1-zwrk.go·8 5.62µs ± 0% 5.62µs ± 0% ~ (p=0.889 n=5+5)
fs1-zwrk.go·12 7.76µs ± 0% 7.76µs ± 0% ~ (p=1.000 n=5+5)
fs1-zwrk.go·16 10.3µs ± 0% 10.4µs ± 0% +0.34% (p=0.016 n=5+5)
zeo/py/fs1-zwrk.go·1 135µs ± 1% 135µs ± 1% ~ (p=0.690 n=5+5)
zeo/py/fs1-zwrk.go·2 222µs ± 1% 223µs ± 1% ~ (p=0.310 n=5+5)
zeo/py/fs1-zwrk.go·3 307µs ± 1% 304µs ± 1% ~ (p=0.151 n=5+5)
zeo/py/fs1-zwrk.go·4 398µs ± 3% 397µs ± 2% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·8 759µs ± 0% 770µs ± 2% +1.41% (p=0.032 n=5+5)
zeo/py/fs1-zwrk.go·12 1.13ms ± 1% 1.14ms ± 2% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·16 1.50ms ± 1% 1.51ms ± 1% ~ (p=0.222 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 147µs ± 2% 147µs ± 1% ~ (p=0.841 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 241µs ± 8% 243µs ± 8% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 349µs ± 1% 354µs ± 1% ~ (p=0.056 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 465µs ± 1% 470µs ± 0% ~ (p=0.114 n=4+4)
neo/py(!log)/sqlite-zwrk.go·8 930µs ± 1% 940µs ± 1% ~ (p=0.095 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 1.40ms ± 1% 1.42ms ± 2% ~ (p=0.151 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 1.88ms ± 3% 1.88ms ± 1% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·1 178µs ± 6% 179µs ± 2% ~ (p=0.310 n=5+5)
neo/py(!log)/sql-zwrk.go·2 297µs ± 4% 293µs ± 1% ~ (p=0.190 n=5+4)
neo/py(!log)/sql-zwrk.go·3 443µs ± 2% 447µs ± 2% ~ (p=0.548 n=5+5)
neo/py(!log)/sql-zwrk.go·4 616µs ± 8% 610µs ± 4% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·8 1.22ms ± 5% 1.20ms ± 4% ~ (p=0.310 n=5+5)
neo/py(!log)/sql-zwrk.go·12 1.75ms ± 1% 1.79ms ± 6% ~ (p=0.730 n=4+5)
neo/py(!log)/sql-zwrk.go·16 2.38ms ± 3% 2.38ms ± 3% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·1 64.4µs ± 0% 64.1µs ± 0% ~ (p=0.095 n=5+5)
neo/go/fs1-zwrk.go·2 66.8µs ± 1% 66.3µs ± 1% -0.83% (p=0.032 n=5+5)
neo/go/fs1-zwrk.go·3 76.1µs ± 0% 75.5µs ± 0% -0.69% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·4 81.0µs ± 0% 80.6µs ± 0% -0.53% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·8 117µs ± 0% 116µs ± 0% -0.62% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·12 165µs ± 0% 164µs ± 0% -0.65% (p=0.016 n=5+5)
neo/go/fs1-zwrk.go·16 219µs ± 0% 217µs ± 1% -0.78% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 38.2µs ± 1% 39.5µs ± 2% +3.29% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 42.0µs ± 0% 41.8µs ± 0% -0.45% (p=0.032 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 50.5µs ± 0% 50.4µs ± 0% ~ (p=0.095 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 55.4µs ± 0% 55.3µs ± 0% ~ (p=0.063 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 82.8µs ± 0% 82.7µs ± 0% ~ (p=0.841 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 110µs ± 0% 110µs ± 0% ~ (p=0.841 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 142µs ± 1% 142µs ± 1% ~ (p=0.548 n=5+5)
neo/go/sqlite-zwrk.go·1 102µs ± 0% 101µs ± 0% -0.87% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·2 110µs ± 0% 109µs ± 0% -0.55% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·3 119µs ± 0% 117µs ± 0% -0.90% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·4 132µs ± 0% 131µs ± 0% -0.79% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·8 203µs ± 0% 200µs ± 0% -1.52% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·12 294µs ± 2% 287µs ± 1% -2.26% (p=0.016 n=5+5)
neo/go/sqlite-zwrk.go·16 395µs ± 2% 383µs ± 2% -3.11% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 91.1µs ± 1% 90.4µs ± 1% ~ (p=0.222 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 100µs ± 0% 100µs ± 0% -0.35% (p=0.016 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 108µs ± 0% 107µs ± 0% -0.27% (p=0.016 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 117µs ± 0% 117µs ± 0% -0.62% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 182µs ± 1% 179µs ± 1% -1.51% (p=0.016 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 279µs ± 1% 270µs ± 1% -3.22% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 388µs ± 2% 372µs ± 2% -4.03% (p=0.008 n=5+5)
cluster:rio dataset:prod1-1024
fs1-zwrk.go·1 2.15µs ± 1% 2.17µs ± 1% ~ (p=0.056 n=5+5)
fs1-zwrk.go·2 2.17µs ± 0% 2.18µs ± 0% ~ (p=0.603 n=4+5)
fs1-zwrk.go·3 2.20µs ± 1% 2.20µs ± 1% ~ (p=0.460 n=5+5)
fs1-zwrk.go·4 2.21µs ± 0% 2.23µs ± 3% ~ (p=0.278 n=5+5)
fs1-zwrk.go·8 3.37µs ± 1% 3.36µs ± 2% ~ (p=0.690 n=5+5)
fs1-zwrk.go·12 4.97µs ± 0% 4.97µs ± 0% ~ (p=0.675 n=5+5)
fs1-zwrk.go·16 6.61µs ± 0% 6.63µs ± 0% ~ (p=0.063 n=5+5)
zeo/py/fs1-zwrk.go·1 111µs ± 1% 113µs ± 1% +1.09% (p=0.032 n=5+5)
zeo/py/fs1-zwrk.go·2 171µs ± 1% 173µs ± 2% ~ (p=0.310 n=5+5)
zeo/py/fs1-zwrk.go·3 233µs ± 2% 240µs ± 2% +2.94% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·4 298µs ± 4% 306µs ± 2% ~ (p=0.095 n=5+5)
zeo/py/fs1-zwrk.go·8 572µs ± 2% 588µs ± 1% +2.84% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·12 844µs ± 2% 861µs ± 1% +2.07% (p=0.032 n=5+5)
zeo/py/fs1-zwrk.go·16 1.12ms ± 3% 1.16ms ± 1% +2.90% (p=0.032 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 140µs ± 4% 140µs ± 3% ~ (p=0.548 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 229µs ± 1% 232µs ± 7% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 347µs ± 5% 341µs ± 1% ~ (p=0.548 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 470µs ± 7% 458µs ± 2% ~ (p=0.310 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 929µs ± 3% 930µs ± 2% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 1.39ms ± 0% 1.37ms ± 1% -1.60% (p=0.016 n=4+5)
neo/py(!log)/sqlite-zwrk.go·16 1.85ms ± 1% 1.86ms ± 3% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·1 170µs ± 1% 169µs ± 1% ~ (p=0.548 n=5+5)
neo/py(!log)/sql-zwrk.go·2 294µs ± 2% 299µs ±10% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zwrk.go·3 456µs ± 4% 438µs ± 1% ~ (p=0.056 n=5+5)
neo/py(!log)/sql-zwrk.go·4 599µs ± 4% 587µs ± 1% ~ (p=0.730 n=5+4)
neo/py(!log)/sql-zwrk.go·8 1.17ms ± 1% 1.18ms ± 6% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·12 1.80ms ± 4% 1.75ms ± 2% -3.05% (p=0.016 n=5+5)
neo/py(!log)/sql-zwrk.go·16 2.41ms ± 5% 2.32ms ± 2% ~ (p=0.151 n=5+5)
neo/go/fs1-zwrk.go·1 45.9µs ± 1% 45.6µs ± 2% ~ (p=0.167 n=5+5)
neo/go/fs1-zwrk.go·2 51.0µs ± 1% 50.6µs ± 1% -0.94% (p=0.016 n=5+5)
neo/go/fs1-zwrk.go·3 58.3µs ± 0% 58.3µs ± 0% ~ (p=0.421 n=5+5)
neo/go/fs1-zwrk.go·4 63.7µs ± 0% 63.7µs ± 0% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·8 99.2µs ± 1% 99.8µs ± 1% ~ (p=0.421 n=5+5)
neo/go/fs1-zwrk.go·12 150µs ± 2% 151µs ± 3% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·16 204µs ± 3% 208µs ± 5% ~ (p=0.421 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 37.7µs ± 1% 37.2µs ± 1% -1.50% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 41.0µs ± 0% 40.6µs ± 0% -0.88% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 48.5µs ± 0% 48.3µs ± 0% ~ (p=0.056 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 54.0µs ± 0% 53.9µs ± 0% ~ (p=0.151 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 87.6µs ± 0% 87.1µs ± 2% ~ (p=0.190 n=4+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 129µs ± 2% 129µs ± 2% ~ (p=0.841 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 178µs ± 2% 178µs ± 2% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go·1 90.7µs ± 1% 90.4µs ± 0% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go·2 103µs ± 1% 103µs ± 0% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go·3 113µs ± 0% 113µs ± 0% ~ (p=0.095 n=5+5)
neo/go/sqlite-zwrk.go·4 125µs ± 0% 126µs ± 0% +0.47% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·8 214µs ± 2% 215µs ± 2% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go·12 341µs ± 3% 339µs ± 2% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go·16 462µs ± 2% 460µs ± 2% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 86.7µs ± 1% 87.9µs ± 1% +1.36% (p=0.032 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 100µs ± 0% 101µs ± 0% +1.54% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 109µs ± 0% 110µs ± 1% +0.94% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 120µs ± 0% 121µs ± 1% +0.82% (p=0.016 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 206µs ± 2% 206µs ± 1% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 330µs ± 1% 333µs ± 2% ~ (p=0.222 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 455µs ± 2% 456µs ± 2% ~ (p=0.690 n=5+5)

3695ff12

X z6001: localhost timings, C > C1 disabled · 65de70b8

Kirill Smelkov authored Mar 06, 2018

Like for neo1 disabling C-states helps serial cases for zeo/py and
neo/py/sqlite and serial and parallel cases for neo/py/sql. For
neo/py/sql it also tends to make timings less noisy:

---- 8< ----
cluster:z6001 dataset:wczblk1-8
zeo/py/fs1-zhash.py 650µs ± 7% 583µs ± 9% -10.33% (p=0.032 n=5+5)
zeo/py/fs1-zhash.go 274µs ±13% 202µs ± 1% -26.34% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zhash.py 696µs ± 1% 476µs ± 4% -31.64% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zhash.go 338µs ± 7% 225µs ± 6% -33.47% (p=0.008 n=5+5)
neo/py(!log)/sql-zhash.py 1.00ms ±38% 0.59ms ±36% -41.17% (p=0.016 n=5+5)
neo/py(!log)/sql-zhash.go 434µs ± 6% 282µs ± 3% -35.10% (p=0.008 n=5+5)
neo/py(!log)/sql-zhash.go+prefetch128 277µs ± 9% 237µs ± 2% -14.37% (p=0.008 n=5+5)

zeo/py/fs1-zwrk.go·1 233µs ± 8% 195µs ± 2% -16.41% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 288µs ±14% 220µs ± 2% -23.74% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·1 400µs ±16% 278µs ± 1% -30.47% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·2 562µs ± 8% 470µs ± 0% -16.47% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·3 827µs ±13% 699µs ± 1% -15.44% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·4 1.13ms ±14% 0.96ms ±10% -15.10% (p=0.016 n=5+5)
neo/py(!log)/sql-zwrk.go·8 2.13ms ±13% 1.90ms ± 1% -10.78% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·12 3.24ms ±12% 2.82ms ± 2% -12.82% (p=0.032 n=5+5)
neo/py(!log)/sql-zwrk.go·16 4.62ms ± 8% 3.76ms ± 1% -18.69% (p=0.016 n=5+4)

cluster:z6001 dataset:prod1-1024
zeo/py/fs1-zhash.go 235µs ± 7% 167µs ± 1% -28.85% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zhash.py 664µs ± 2% 452µs ±10% -31.89% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zhash.go 269µs ± 7% 208µs ± 1% -22.79% (p=0.008 n=5+5)
neo/py(!log)/sql-zhash.py 1.03ms ±29% 0.57ms ±38% -44.81% (p=0.008 n=5+5)
neo/py(!log)/sql-zhash.go 406µs ± 2% 267µs ± 3% -34.15% (p=0.008 n=5+5)

zeo/py/fs1-zwrk.go·1 208µs ± 5% 163µs ± 1% -21.69% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 271µs ± 7% 210µs ± 6% -22.43% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·1 400µs ±11% 261µs ± 1% -34.78% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·2 554µs ± 7% 463µs ± 1% -16.42% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·3 783µs ±11% 692µs ± 0% -11.57% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·4 1.06ms ±11% 0.92ms ± 1% -12.52% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·8 2.07ms ± 9% 1.83ms ± 2% -11.28% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·12 3.02ms ± 7% 2.80ms ± 3% -7.52% (p=0.032 n=5+5)
neo/py(!log)/sql-zwrk.go·16 4.32ms ±12% 3.67ms ± 2% -15.10% (p=0.008 n=5+5)
---- 8< ----

Like on neo1 it also seems to be helping neo/go/* with slower python
client, but for neo/go/sqlite with go client too:

---- 8< ----
cluster:z6001 dataset:wczblk1-8
neo/go/fs1-zhash.py 526µs ± 8% 333µs ±10% -36.81% (p=0.008 n=5+5)
neo/go/sqlite-zhash.py 528µs ±15% 385µs ± 6% -27.15% (p=0.008 n=5+5)
neo/go/sqlite-zhash.go 204µs ±22% 142µs ± 1% -30.26% (p=0.008 n=5+5)
neo/go/sqlite-zhash.go(!sha1) 194µs ± 9% 132µs ± 3% -31.76% (p=0.008 n=5+5)

neo/go/sqlite-zwrk.go·1 208µs ±14% 139µs ± 1% -32.89% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·2 166µs ± 2% 147µs ± 1% -11.70% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·3 158µs ± 1% 150µs ± 0% -4.60% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·4 162µs ± 0% 157µs ± 0% -3.12% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 185µs ± 4% 130µs ± 1% -29.53% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 156µs ± 1% 136µs ± 1% -12.98% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 149µs ± 1% 139µs ± 0% -6.76% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 149µs ± 1% 142µs ± 0% -4.81% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 166µs ± 1% 163µs ± 0% -2.04% (p=0.008 n=5+5)

cluster:z6001 dataset:prod1-1024
neo/go/fs1-zhash.py 520µs ± 9% 321µs ±11% -38.25% (p=0.008 n=5+5)
neo/go/fs1-zhash.go 83.2µs ± 7% 74.8µs ± 3% -10.14% (p=0.008 n=5+5)
neo/go/sqlite-zhash.py 539µs ±11% 361µs ± 6% -32.97% (p=0.008 n=5+5)
neo/go/sqlite-zhash.go 196µs ± 9% 128µs ± 2% -34.66% (p=0.008 n=5+5)
neo/go/sqlite-zhash.go(!sha1) 168µs ± 8% 125µs ± 4% -25.63% (p=0.008 n=5+5)

neo/go/sqlite-zwrk.go·1 177µs ± 8% 126µs ± 1% -29.04% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·2 151µs ± 2% 136µs ± 1% -9.65% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·3 148µs ± 1% 140µs ± 0% -5.57% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·4 151µs ± 0% 145µs ± 0% -3.78% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·8 180µs ± 1% 177µs ± 1% -1.31% (p=0.016 n=5+5)

neo/go/sqlite-zwrk.go(!sha1)·1 176µs ± 4% 120µs ± 2% -31.54% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 152µs ± 3% 131µs ± 1% -13.38% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 147µs ± 1% 135µs ± 0% -7.68% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 148µs ± 2% 140µs ± 1% -5.20% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 176µs ± 1% 173µs ± 1% -1.65% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 225µs ± 1% 224µs ± 0% ~ (p=0.222 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 321µs ± 1% 321µs ± 1% ~ (p=1.000 n=5+5)
---- 8< ----

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

$ benchstat -split node,cluster,dataset 20180306-z6001-ffixed-c.txt 20180306-z6001-ffixed-noc_C1$3µs$.txt

name old pystone/s new pystone/s delta
node:z6001
pystone 109k ± 9% 114k ± 1% ~ (p=0.421 n=5+5)

name old time/op new time/op delta
node:z6001
crc32/py/4K 5.11µs ± 1% 5.15µs ± 4% ~ (p=0.738 n=5+5)
crc32/go/4K 1.72µs ± 0% 1.72µs ± 0% ~ (p=1.000 n=4+4)
sha1/py/4K 14.7µs ± 1% 14.7µs ± 1% ~ (p=0.841 n=5+5)
sha1/go/4K 10.3µs ± 0% 10.3µs ± 0% ~ (p=0.103 n=5+5)
unzlib/py/wczdata 37.1µs ± 8% 36.3µs ± 1% ~ (p=0.310 n=5+5)
unzlib/go/wczdata 31.5µs ± 0% 31.2µs ± 0% -1.12% (p=0.008 n=5+5)
unzlib/py/prod1-avg 18.5µs ± 3% 18.6µs ± 3% ~ (p=0.841 n=5+5)
unzlib/go/prod1-avg 10.0µs ± 1% 9.9µs ± 1% ~ (p=0.095 n=5+5)
disk/randread/direct/4K-min 126µs ± 1% 127µs ± 1% ~ (p=1.000 n=4+5)
disk/randread/direct/4K-avg 199µs ± 9% 168µs ± 0% -15.84% (p=0.008 n=5+5)
disk/randread/pagecache/4K-min 806ns ± 3% 799ns ± 1% ~ (p=0.746 n=5+5)
disk/randread/pagecache/4K-avg 1.44µs ± 7% 1.52µs ± 3% ~ (p=0.079 n=5+5)

name old time/object new time/object delta
cluster:z6001 dataset:wczblk1-8
fs1-zhash.py 37.6µs ± 2% 37.4µs ± 2% ~ (p=0.571 n=5+5)
fs1-zhash.go 6.00µs ± 2% 5.96µs ± 1% ~ (p=0.643 n=5+5)
fs1-zhash.go+prefetch128 8.00µs ± 5% 7.24µs ± 6% -9.50% (p=0.016 n=5+5)
zeo/py/fs1-zhash.py 650µs ± 7% 583µs ± 9% -10.33% (p=0.032 n=5+5)
zeo/py/fs1-zhash.go 274µs ±13% 202µs ± 1% -26.34% (p=0.008 n=5+5)
zeo/py/fs1-zhash.go+prefetch128 101µs ± 2% 102µs ± 2% ~ (p=0.310 n=5+5)
neo/py(!log)/sqlite-zhash.py 696µs ± 1% 476µs ± 4% -31.64% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zhash.go 338µs ± 7% 225µs ± 6% -33.47% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zhash.go+prefetch128 177µs ± 1% 179µs ± 1% ~ (p=0.143 n=5+5)
neo/py(!log)/sql-zhash.py 1.00ms ±38% 0.59ms ±36% -41.17% (p=0.016 n=5+5)
neo/py(!log)/sql-zhash.go 434µs ± 6% 282µs ± 3% -35.10% (p=0.008 n=5+5)
neo/py(!log)/sql-zhash.go+prefetch128 277µs ± 9% 237µs ± 2% -14.37% (p=0.008 n=5+5)
neo/go/fs1-zhash.py 526µs ± 8% 333µs ±10% -36.81% (p=0.008 n=5+5)
neo/go/fs1-zhash.go 102µs ± 8% 94µs ± 6% -8.17% (p=0.032 n=5+5)
neo/go/fs1-zhash.go+prefetch128 36.6µs ± 4% 36.6µs ± 3% ~ (p=0.841 n=5+5)
neo/go/fs1(!sha1)-zhash.go(!sha1) 76.4µs ± 5% 69.7µs ± 8% -8.75% (p=0.032 n=5+5)
neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 26.5µs ± 2% 26.4µs ± 5% ~ (p=0.730 n=5+5)
neo/go/sqlite-zhash.py 528µs ±15% 385µs ± 6% -27.15% (p=0.008 n=5+5)
neo/go/sqlite-zhash.go 204µs ±22% 142µs ± 1% -30.26% (p=0.008 n=5+5)
neo/go/sqlite-zhash.go+prefetch128 39.9µs ± 4% 41.4µs ± 5% ~ (p=0.111 n=5+5)
neo/go/sqlite-zhash.go(!sha1) 194µs ± 9% 132µs ± 3% -31.76% (p=0.008 n=5+5)
neo/go/sqlite-zhash.go+prefetch128(!sha1) 38.2µs ± 7% 36.7µs ± 5% ~ (p=0.151 n=5+5)
cluster:z6001 dataset:prod1-1024
fs1-zhash.py 30.3µs ± 1% 30.0µs ± 1% ~ (p=0.373 n=5+5)
fs1-zhash.go 4.62µs ± 3% 4.60µs ± 0% ~ (p=0.968 n=5+4)
fs1-zhash.go+prefetch128 5.76µs ± 8% 5.48µs ± 4% ~ (p=0.056 n=5+5)
zeo/py/fs1-zhash.py 632µs ±15% 560µs ± 3% ~ (p=0.151 n=5+5)
zeo/py/fs1-zhash.go 235µs ± 7% 167µs ± 1% -28.85% (p=0.008 n=5+5)
zeo/py/fs1-zhash.go+prefetch128 87.2µs ± 1% 88.5µs ± 1% +1.49% (p=0.048 n=5+5)
neo/py(!log)/sqlite-zhash.py 664µs ± 2% 452µs ±10% -31.89% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zhash.go 269µs ± 7% 208µs ± 1% -22.79% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zhash.go+prefetch128 162µs ± 0% 163µs ± 0% ~ (p=0.397 n=4+5)
neo/py(!log)/sql-zhash.py 1.03ms ±29% 0.57ms ±38% -44.81% (p=0.008 n=5+5)
neo/py(!log)/sql-zhash.go 406µs ± 2% 267µs ± 3% -34.15% (p=0.008 n=5+5)
neo/py(!log)/sql-zhash.go+prefetch128 268µs ± 5% 228µs ±10% -14.87% (p=0.008 n=5+5)
neo/go/fs1-zhash.py 520µs ± 9% 321µs ±11% -38.25% (p=0.008 n=5+5)
neo/go/fs1-zhash.go 83.2µs ± 7% 74.8µs ± 3% -10.14% (p=0.008 n=5+5)
neo/go/fs1-zhash.go+prefetch128 24.0µs ± 5% 24.1µs ± 1% ~ (p=0.548 n=5+5)
neo/go/fs1(!sha1)-zhash.go(!sha1) 67.0µs ± 3% 65.2µs ± 5% ~ (p=0.095 n=5+5)
neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 21.2µs ± 4% 21.1µs ± 2% ~ (p=0.952 n=5+5)
neo/go/sqlite-zhash.py 539µs ±11% 361µs ± 6% -32.97% (p=0.008 n=5+5)
neo/go/sqlite-zhash.go 196µs ± 9% 128µs ± 2% -34.66% (p=0.008 n=5+5)
neo/go/sqlite-zhash.go+prefetch128 35.0µs ± 3% 34.6µs ± 2% ~ (p=0.302 n=5+5)
neo/go/sqlite-zhash.go(!sha1) 168µs ± 8% 125µs ± 4% -25.63% (p=0.008 n=5+5)
neo/go/sqlite-zhash.go+prefetch128(!sha1) 35.1µs ± 4% 34.9µs ± 2% ~ (p=1.000 n=5+5)

name old req/s new req/s delta
cluster:z6001 dataset:wczblk1-8
fs1-zwrk.go·1 230k ± 1% 231k ± 1% ~ (p=0.548 n=5+5)
fs1-zwrk.go·2 437k ± 5% 444k ± 1% ~ (p=0.421 n=5+5)
fs1-zwrk.go·3 663k ± 4% 661k ± 4% ~ (p=1.000 n=5+5)
fs1-zwrk.go·4 880k ± 1% 878k ± 3% ~ (p=0.841 n=5+5)
fs1-zwrk.go·8 1.75M ± 2% 1.76M ± 2% ~ (p=0.548 n=5+5)
fs1-zwrk.go·12 2.56M ± 0% 2.51M ± 3% ~ (p=0.063 n=4+5)
fs1-zwrk.go·16 2.89M ± 1% 2.90M ± 1% ~ (p=0.310 n=5+5)
zeo/py/fs1-zwrk.go·1 4.30k ± 8% 5.14k ± 2% +19.34% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·2 6.33k ± 0% 6.38k ± 2% +0.85% (p=0.016 n=4+5)
zeo/py/fs1-zwrk.go·3 6.90k ± 0% 7.05k ± 1% +2.13% (p=0.016 n=4+5)
zeo/py/fs1-zwrk.go·4 7.14k ± 1% 7.22k ± 2% ~ (p=0.111 n=4+5)
zeo/py/fs1-zwrk.go·8 7.53k ± 2% 7.50k ± 1% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·12 7.65k ± 0% 7.53k ± 0% -1.59% (p=0.016 n=4+5)
zeo/py/fs1-zwrk.go·16 7.57k ± 0% 7.66k ± 1% +1.17% (p=0.032 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 3.50k ±15% 4.55k ± 2% +30.01% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 5.58k ± 0% 5.59k ± 1% ~ (p=0.730 n=4+5)
neo/py(!log)/sqlite-zwrk.go·3 5.63k ± 2% 5.56k ± 0% ~ (p=0.190 n=5+4)
neo/py(!log)/sqlite-zwrk.go·4 5.56k ± 1% 5.54k ± 0% ~ (p=0.095 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 5.61k ± 2% 5.59k ± 2% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 5.62k ± 1% 5.57k ± 0% -0.82% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 5.62k ± 1% 5.58k ± 0% ~ (p=0.413 n=4+5)
neo/py(!log)/sql-zwrk.go·1 2.53k ±17% 3.59k ± 1% +41.99% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·2 3.57k ± 9% 4.26k ± 0% +19.25% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·3 3.65k ±14% 4.29k ± 1% +17.53% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·4 3.56k ±16% 4.17k ± 9% +17.25% (p=0.016 n=5+5)
neo/py(!log)/sql-zwrk.go·8 3.78k ±12% 4.20k ± 1% +11.12% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·12 3.73k ±13% 4.25k ± 2% +13.97% (p=0.032 n=5+5)
neo/py(!log)/sql-zwrk.go·16 3.47k ± 9% 4.26k ± 1% +22.71% (p=0.016 n=5+4)
neo/go/fs1-zwrk.go·1 10.7k ± 5% 11.1k ± 7% ~ (p=0.310 n=5+5)
neo/go/fs1-zwrk.go·2 22.3k ± 1% 23.1k ± 2% +3.68% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·3 31.7k ± 1% 32.1k ± 1% +1.34% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·4 43.2k ± 1% 43.5k ± 0% +0.72% (p=0.032 n=5+5)
neo/go/fs1-zwrk.go·8 78.3k ± 0% 78.1k ± 0% ~ (p=0.222 n=5+5)
neo/go/fs1-zwrk.go·12 92.5k ± 0% 92.4k ± 0% ~ (p=0.690 n=5+5)
neo/go/fs1-zwrk.go·16 103k ± 1% 102k ± 0% ~ (p=0.310 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 15.0k ± 5% 15.1k ± 3% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 31.5k ± 1% 31.8k ± 1% +0.91% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 43.8k ± 0% 44.1k ± 0% +0.82% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 57.4k ± 0% 57.9k ± 0% +0.92% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 100k ± 0% 100k ± 0% ~ (p=0.222 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 116k ± 0% 116k ± 0% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 126k ± 1% 126k ± 0% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go·1 4.85k ±15% 7.17k ± 1% +47.73% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·2 12.0k ± 2% 13.6k ± 1% +13.23% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·3 19.0k ± 1% 19.9k ± 0% +4.82% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·4 24.7k ± 0% 25.5k ± 0% +3.22% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·8 44.8k ± 0% 44.9k ± 0% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go·12 56.3k ± 0% 55.7k ± 0% -0.92% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·16 58.0k ± 0% 57.4k ± 1% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 5.41k ± 4% 7.67k ± 1% +41.83% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 12.8k ± 1% 14.7k ± 1% +14.92% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 20.2k ± 1% 21.6k ± 0% +7.25% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 26.8k ± 1% 28.2k ± 0% +5.05% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 48.1k ± 1% 49.1k ± 0% +2.08% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 60.3k ± 0% 60.4k ± 0% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 61.7k ± 1% 61.9k ± 1% ~ (p=0.690 n=5+5)
cluster:z6001 dataset:prod1-1024
fs1-zwrk.go·1 347k ± 2% 347k ± 2% ~ (p=1.000 n=5+5)
fs1-zwrk.go·2 660k ± 3% 659k ± 2% ~ (p=0.841 n=5+5)
fs1-zwrk.go·3 985k ± 4% 978k ± 4% ~ (p=0.421 n=5+5)
fs1-zwrk.go·4 1.31M ± 2% 1.30M ± 4% ~ (p=0.421 n=5+5)
fs1-zwrk.go·8 2.55M ± 4% 2.52M ± 6% ~ (p=0.690 n=5+5)
fs1-zwrk.go·12 2.81M ± 1% 3.02M ± 1% +7.78% (p=0.008 n=5+5)
fs1-zwrk.go·16 2.85M ± 2% 3.06M ± 1% +7.51% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·1 4.80k ± 5% 6.13k ± 1% +27.58% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·2 8.18k ± 1% 8.16k ± 2% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·3 8.96k ± 1% 8.99k ± 2% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·4 8.88k ± 9% 9.37k ± 1% ~ (p=0.548 n=5+5)
zeo/py/fs1-zwrk.go·8 10.0k ± 2% 9.8k ± 5% ~ (p=0.905 n=4+5)
zeo/py/fs1-zwrk.go·12 9.80k ± 6% 9.19k ± 8% ~ (p=0.056 n=5+5)
zeo/py/fs1-zwrk.go·16 10.1k ± 6% 8.9k ±15% ~ (p=0.095 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 3.70k ± 6% 4.77k ± 6% +29.01% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 5.77k ± 0% 5.92k ± 0% +2.58% (p=0.029 n=4+4)
neo/py(!log)/sqlite-zwrk.go·3 5.77k ± 0% 5.76k ± 0% -0.25% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 5.77k ± 0% 5.82k ± 2% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 5.84k ± 1% 5.75k ± 0% -1.67% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 5.78k ± 2% 5.71k ± 0% -1.27% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 5.80k ± 1% 5.71k ± 0% -1.63% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·1 2.51k ±12% 3.83k ± 1% +52.68% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·2 3.62k ± 8% 4.32k ± 1% +19.32% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·3 3.86k ±11% 4.33k ± 0% +12.15% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·4 3.82k ±11% 4.33k ± 1% +13.35% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·8 3.89k ±10% 4.36k ± 2% +12.29% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·12 3.98k ± 7% 4.29k ± 3% +7.85% (p=0.032 n=5+5)
neo/py(!log)/sql-zwrk.go·16 3.72k ±13% 4.36k ± 2% +17.09% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·1 13.8k ± 3% 14.0k ± 3% ~ (p=0.310 n=5+5)
neo/go/fs1-zwrk.go·2 28.1k ± 0% 28.4k ± 1% +1.29% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·3 40.2k ± 0% 40.5k ± 0% +0.60% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·4 52.8k ± 1% 53.1k ± 0% +0.54% (p=0.032 n=5+5)
neo/go/fs1-zwrk.go·8 90.6k ± 0% 90.2k ± 0% -0.48% (p=0.032 n=5+5)
neo/go/fs1-zwrk.go·12 95.8k ± 1% 95.0k ± 2% ~ (p=0.151 n=5+5)
neo/go/fs1-zwrk.go·16 90.9k ± 1% 90.4k ± 2% ~ (p=0.841 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 16.2k ± 2% 16.3k ± 2% ~ (p=0.690 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 32.9k ± 1% 33.4k ± 0% +1.52% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 46.2k ± 0% 46.5k ± 0% +0.68% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 59.8k ± 1% 60.4k ± 0% +0.91% (p=0.016 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 98.1k ± 0% 98.7k ± 1% ~ (p=0.056 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 102k ± 1% 103k ± 1% ~ (p=0.095 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 97.0k ± 2% 98.4k ± 2% ~ (p=0.095 n=5+5)
neo/go/sqlite-zwrk.go·1 5.67k ± 8% 7.97k ± 1% +40.55% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·2 13.3k ± 2% 14.7k ± 1% +10.67% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·3 20.3k ± 1% 21.5k ± 0% +5.90% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·4 26.5k ± 0% 27.6k ± 0% +3.93% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·8 44.5k ± 1% 45.1k ± 1% +1.33% (p=0.016 n=5+5)
neo/go/sqlite-zwrk.go·12 52.3k ± 1% 52.6k ± 0% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go·16 48.9k ± 1% 48.8k ± 1% ~ (p=0.548 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 5.69k ± 4% 8.31k ± 2% +45.99% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 13.2k ± 3% 15.2k ± 1% +15.42% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 20.5k ± 1% 22.2k ± 0% +8.31% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 27.1k ± 2% 28.6k ± 1% +5.47% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 45.4k ± 1% 46.2k ± 1% +1.67% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 53.3k ± 1% 53.5k ± 0% ~ (p=0.222 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 49.8k ± 1% 49.8k ± 1% ~ (p=1.000 n=5+5)

name old latency-time/object new latency-time/object delta
cluster:z6001 dataset:wczblk1-8
fs1-zwrk.go·1 4.34µs ± 1% 4.33µs ± 1% ~ (p=0.540 n=5+5)
fs1-zwrk.go·2 4.58µs ± 5% 4.51µs ± 1% ~ (p=0.381 n=5+5)
fs1-zwrk.go·3 4.52µs ± 4% 4.54µs ± 4% ~ (p=0.952 n=5+5)
fs1-zwrk.go·4 4.55µs ± 1% 4.56µs ± 3% ~ (p=0.841 n=5+5)
fs1-zwrk.go·8 4.58µs ± 2% 4.56µs ± 2% ~ (p=0.548 n=5+5)
fs1-zwrk.go·12 4.69µs ± 0% 4.77µs ± 3% ~ (p=0.063 n=4+5)
fs1-zwrk.go·16 5.53µs ± 1% 5.51µs ± 1% ~ (p=0.310 n=5+5)
zeo/py/fs1-zwrk.go·1 233µs ± 8% 195µs ± 2% -16.41% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·2 315µs ± 2% 314µs ± 2% ~ (p=0.095 n=5+5)
zeo/py/fs1-zwrk.go·3 435µs ± 0% 426µs ± 1% -2.08% (p=0.016 n=4+5)
zeo/py/fs1-zwrk.go·4 560µs ± 1% 554µs ± 2% ~ (p=0.111 n=4+5)
zeo/py/fs1-zwrk.go·8 1.06ms ± 2% 1.07ms ± 1% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·12 1.57ms ± 0% 1.59ms ± 0% +1.62% (p=0.016 n=4+5)
zeo/py/fs1-zwrk.go·16 2.11ms ± 0% 2.09ms ± 1% -1.15% (p=0.032 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 288µs ±14% 220µs ± 2% -23.74% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 358µs ± 0% 358µs ± 1% ~ (p=0.730 n=4+5)
neo/py(!log)/sqlite-zwrk.go·3 533µs ± 2% 539µs ± 0% ~ (p=0.190 n=5+4)
neo/py(!log)/sqlite-zwrk.go·4 720µs ± 1% 723µs ± 0% ~ (p=0.095 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 1.43ms ± 2% 1.43ms ± 2% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 2.14ms ± 1% 2.15ms ± 0% +0.82% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 2.85ms ± 1% 2.87ms ± 0% ~ (p=0.413 n=4+5)
neo/py(!log)/sql-zwrk.go·1 400µs ±16% 278µs ± 1% -30.47% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·2 562µs ± 8% 470µs ± 0% -16.47% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·3 827µs ±13% 699µs ± 1% -15.44% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·4 1.13ms ±14% 0.96ms ±10% -15.10% (p=0.016 n=5+5)
neo/py(!log)/sql-zwrk.go·8 2.13ms ±13% 1.90ms ± 1% -10.78% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·12 3.24ms ±12% 2.82ms ± 2% -12.82% (p=0.032 n=5+5)
neo/py(!log)/sql-zwrk.go·16 4.62ms ± 8% 3.76ms ± 1% -18.69% (p=0.016 n=5+4)
neo/go/fs1-zwrk.go·1 93.9µs ± 4% 90.4µs ± 7% ~ (p=0.310 n=5+5)
neo/go/fs1-zwrk.go·2 89.6µs ± 1% 86.5µs ± 2% -3.55% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·3 94.6µs ± 1% 93.3µs ± 1% -1.33% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·4 92.6µs ± 1% 91.9µs ± 0% -0.71% (p=0.032 n=5+5)
neo/go/fs1-zwrk.go·8 102µs ± 0% 102µs ± 0% ~ (p=0.222 n=5+5)
neo/go/fs1-zwrk.go·12 130µs ± 0% 130µs ± 0% ~ (p=0.690 n=5+5)
neo/go/fs1-zwrk.go·16 156µs ± 1% 157µs ± 0% ~ (p=0.310 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 66.8µs ± 5% 66.1µs ± 3% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 63.5µs ± 1% 62.9µs ± 1% -0.90% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 68.5µs ± 0% 68.0µs ± 0% -0.81% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 69.7µs ± 0% 69.0µs ± 0% -0.91% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 79.7µs ± 0% 79.9µs ± 0% ~ (p=0.222 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 103µs ± 0% 103µs ± 0% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 127µs ± 1% 127µs ± 0% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go·1 208µs ±14% 139µs ± 1% -32.89% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·2 166µs ± 2% 147µs ± 1% -11.70% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·3 158µs ± 1% 150µs ± 0% -4.60% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·4 162µs ± 0% 157µs ± 0% -3.12% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·8 178µs ± 0% 178µs ± 0% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go·12 213µs ± 0% 215µs ± 0% +0.93% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·16 276µs ± 0% 279µs ± 1% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 185µs ± 4% 130µs ± 1% -29.53% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 156µs ± 1% 136µs ± 1% -12.98% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 149µs ± 1% 139µs ± 0% -6.76% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 149µs ± 1% 142µs ± 0% -4.81% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 166µs ± 1% 163µs ± 0% -2.04% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 199µs ± 0% 199µs ± 0% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 259µs ± 1% 259µs ± 1% ~ (p=0.690 n=5+5)
cluster:z6001 dataset:prod1-1024
fs1-zwrk.go·1 2.88µs ± 2% 2.88µs ± 2% ~ (p=1.000 n=5+5)
fs1-zwrk.go·2 3.03µs ± 3% 3.03µs ± 3% ~ (p=0.841 n=5+5)
fs1-zwrk.go·3 3.05µs ± 4% 3.07µs ± 4% ~ (p=0.421 n=5+5)
fs1-zwrk.go·4 3.05µs ± 2% 3.09µs ± 4% ~ (p=0.421 n=5+5)
fs1-zwrk.go·8 3.14µs ± 4% 3.18µs ± 6% ~ (p=0.690 n=5+5)
fs1-zwrk.go·12 4.28µs ± 1% 3.97µs ± 1% -7.22% (p=0.008 n=5+5)
fs1-zwrk.go·16 5.63µs ± 2% 5.23µs ± 1% -7.01% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·1 208µs ± 5% 163µs ± 1% -21.69% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·2 245µs ± 1% 245µs ± 2% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·3 335µs ± 1% 334µs ± 2% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·4 453µs ±10% 427µs ± 1% ~ (p=0.548 n=5+5)
zeo/py/fs1-zwrk.go·8 803µs ± 2% 815µs ± 5% ~ (p=0.905 n=4+5)
zeo/py/fs1-zwrk.go·12 1.23ms ± 6% 1.31ms ± 8% ~ (p=0.056 n=5+5)
zeo/py/fs1-zwrk.go·16 1.59ms ± 6% 1.82ms ±14% ~ (p=0.095 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 271µs ± 7% 210µs ± 6% -22.43% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 346µs ± 0% 338µs ± 0% -2.52% (p=0.029 n=4+4)
neo/py(!log)/sqlite-zwrk.go·3 520µs ± 0% 521µs ± 0% +0.25% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 694µs ± 0% 688µs ± 2% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 1.37ms ± 1% 1.39ms ± 0% +1.68% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 2.07ms ± 2% 2.10ms ± 0% +1.28% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 2.76ms ± 1% 2.80ms ± 0% +1.65% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·1 400µs ±11% 261µs ± 1% -34.78% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·2 554µs ± 7% 463µs ± 1% -16.42% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·3 783µs ±11% 692µs ± 0% -11.57% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·4 1.06ms ±11% 0.92ms ± 1% -12.52% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·8 2.07ms ± 9% 1.83ms ± 2% -11.28% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·12 3.02ms ± 7% 2.80ms ± 3% -7.52% (p=0.032 n=5+5)
neo/py(!log)/sql-zwrk.go·16 4.32ms ±12% 3.67ms ± 2% -15.10% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·1 72.6µs ± 3% 71.5µs ± 3% ~ (p=0.310 n=5+5)
neo/go/fs1-zwrk.go·2 71.2µs ± 0% 70.3µs ± 1% -1.27% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·3 74.6µs ± 0% 74.1µs ± 0% -0.59% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·4 75.7µs ± 1% 75.3µs ± 0% -0.54% (p=0.032 n=5+5)
neo/go/fs1-zwrk.go·8 88.3µs ± 0% 88.7µs ± 0% +0.48% (p=0.032 n=5+5)
neo/go/fs1-zwrk.go·12 125µs ± 1% 126µs ± 2% ~ (p=0.151 n=5+5)
neo/go/fs1-zwrk.go·16 176µs ± 1% 177µs ± 2% ~ (p=0.841 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 61.7µs ± 2% 61.3µs ± 2% ~ (p=0.651 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 60.7µs ± 1% 59.8µs ± 0% -1.50% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 64.9µs ± 0% 64.5µs ± 0% -0.68% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 66.9µs ± 1% 66.3µs ± 0% -0.90% (p=0.016 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 81.5µs ± 0% 81.0µs ± 1% ~ (p=0.056 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 118µs ± 1% 116µs ± 1% ~ (p=0.095 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 165µs ± 2% 163µs ± 2% ~ (p=0.095 n=5+5)
neo/go/sqlite-zwrk.go·1 177µs ± 8% 126µs ± 1% -29.04% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·2 151µs ± 2% 136µs ± 1% -9.65% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·3 148µs ± 1% 140µs ± 0% -5.57% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·4 151µs ± 0% 145µs ± 0% -3.78% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·8 180µs ± 1% 177µs ± 1% -1.31% (p=0.016 n=5+5)
neo/go/sqlite-zwrk.go·12 229µs ± 1% 228µs ± 0% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go·16 327µs ± 1% 328µs ± 1% ~ (p=0.548 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 176µs ± 4% 120µs ± 2% -31.54% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 152µs ± 3% 131µs ± 1% -13.38% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 147µs ± 1% 135µs ± 0% -7.68% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 148µs ± 2% 140µs ± 1% -5.20% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 176µs ± 1% 173µs ± 1% -1.65% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 225µs ± 1% 224µs ± 0% ~ (p=0.222 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 321µs ± 1% 321µs ± 1% ~ (p=1.000 n=5+5)

65de70b8

X neo1: localhost timings, C > C1 disabled · f40c8b4b

Kirill Smelkov authored Mar 06, 2018

$ benchstat -split node,cluster,dataset 20180306-neo1-ffixed-c.txt 20180306-neo1-ffixed-noc_C1$3µs$.txt

Disabling C states helps serial cases for zeo/py and neo/py/sqlite and
both serial and parallel cases for neo/py/sql. For neo/py/sql it also
denoises the timing.

---- 8< ----
cluster:neo1 dataset:wczblk1-8
zeo/py/fs1-zhash.py 523µs ± 1% 465µs ± 4% -11.04% (p=0.008 n=5+5)
zeo/py/fs1-zhash.go 194µs ± 4% 173µs ± 2% -10.70% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zhash.py 684µs ± 3% 389µs ± 1% -43.08% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zhash.go 236µs ± 2% 198µs ± 5% -16.19% (p=0.008 n=5+5)
neo/py(!log)/sql-zhash.py 942µs ±47% 448µs ± 3% -52.47% (p=0.016 n=5+4)
neo/py(!log)/sql-zhash.go 300µs ±17% 251µs ± 2% -16.37% (p=0.008 n=5+5)

zeo/py/fs1-zwrk.go·1 194µs ± 1% 171µs ± 1% -11.93% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 232µs ± 4% 198µs ± 3% -14.97% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·1 323µs ± 6% 242µs ± 1% -24.90% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·2 503µs ± 2% 421µs ± 5% -16.28% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·3 742µs ± 3% 639µs ± 4% -13.97% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·4 986µs ± 4% 838µs ± 2% -15.02% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·8 2.11ms ± 8% 1.71ms ± 4% -18.91% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·12 3.02ms ± 3% 2.57ms ± 3% -14.83% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·16 4.06ms ± 1% 3.39ms ± 3% -16.33% (p=0.008 n=5+5)

cluster:neo1 dataset:prod1-1024
zeo/py/fs1-zhash.go 170µs ± 3% 148µs ± 3% -13.05% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zhash.py 665µs ± 2% 382µs ± 3% -42.60% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zhash.go 219µs ± 2% 181µs ± 1% -17.27% (p=0.008 n=5+5)
neo/py(!log)/sql-zhash.py 886µs ±56% 426µs ± 1% -51.90% (p=0.016 n=5+4)
neo/py(!log)/sql-zhash.go 298µs ± 9% 234µs ± 2% -21.22% (p=0.008 n=5+5)

zeo/py/fs1-zwrk.go·1 173µs ± 3% 146µs ± 2% -15.31% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 204µs ± 8% 182µs ± 3% -11.14% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·1 287µs ± 8% 236µs ± 8% -17.73% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·2 495µs ± 6% 406µs ± 1% -17.95% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·3 740µs ± 8% 618µs ± 3% -16.50% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·4 1.01ms ± 4% 0.82ms ± 2% -18.75% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·8 1.93ms ± 3% 1.64ms ± 1% -15.14% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·12 3.01ms ± 4% 2.45ms ± 3% -18.53% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·16 4.05ms ±10% 3.33ms ± 8% -17.74% (p=0.008 n=5+5)
---- 8< ----

It looks to be also helping to neo/go/* with python (thus slower)
client:

---- 8< ----
cluster:neo1 dataset:wczblk1-8
neo/go/fs1-zhash.py 383µs ±20% 270µs ± 2% -29.62% (p=0.008 n=5+5)
neo/go/sqlite-zhash.py 402µs ± 6% 323µs ± 1% -19.66% (p=0.008 n=5+5)

cluster:neo1 dataset:prod1-1024
neo/go/fs1-zhash.py 319µs ±11% 260µs ± 2% -18.46% (p=0.008 n=5+5)
neo/go/sqlite-zhash.py 382µs ± 6% 310µs ± 2% -19.04% (p=0.008 n=5+5)
---- 8< ----

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

$ benchstat -split node,cluster,dataset 20180306-neo1-ffixed-c.txt 20180306-neo1-ffixed-noc_C1$3µs$.txt

name old pystone/s new pystone/s delta
node:neo1
pystone 106k ± 1% 106k ± 1% ~ (p=0.548 n=5+5)

name old time/op new time/op delta
node:neo1
crc32/py/4K 5.13µs ± 1% 5.13µs ± 1% ~ (p=1.000 n=5+5)
crc32/go/4K 2.79µs ± 0% 2.79µs ± 0% -0.06% (p=0.032 n=5+5)
sha1/py/4K 13.4µs ± 1% 13.5µs ± 1% ~ (p=0.548 n=5+5)
sha1/go/4K 9.83µs ± 0% 9.85µs ± 1% ~ (p=0.905 n=5+4)
unzlib/py/wczdata 36.1µs ± 0% 36.1µs ± 1% ~ (p=0.841 n=5+5)
unzlib/go/wczdata 31.1µs ± 1% 30.9µs ± 1% ~ (p=0.111 n=5+5)
unzlib/py/prod1-avg 16.3µs ± 2% 16.8µs ±10% ~ (p=0.548 n=5+5)
unzlib/go/prod1-avg 9.42µs ± 0% 9.27µs ± 1% -1.58% (p=0.008 n=5+5)
disk/randread/direct/4K-min 162µs ± 0% 162µs ± 0% ~ (p=0.270 n=5+4)
disk/randread/direct/4K-avg 187µs ± 2% 172µs ± 0% -8.20% (p=0.008 n=5+5)
disk/randread/pagecache/4K-min 389ns ± 1% 390ns ± 1% ~ (p=0.548 n=5+5)
disk/randread/pagecache/4K-avg 804ns ± 0% 894ns ± 0% +11.28% (p=0.016 n=4+5)

name old time/object new time/object delta
cluster:neo1 dataset:wczblk1-8
fs1-zhash.py 34.7µs ± 2% 34.4µs ± 2% ~ (p=0.119 n=5+5)
fs1-zhash.go 6.00µs ± 2% 5.90µs ± 0% ~ (p=0.095 n=5+4)
fs1-zhash.go+prefetch128 6.52µs ± 4% 6.26µs ± 3% ~ (p=0.079 n=5+5)
zeo/py/fs1-zhash.py 523µs ± 1% 465µs ± 4% -11.04% (p=0.008 n=5+5)
zeo/py/fs1-zhash.go 194µs ± 4% 173µs ± 2% -10.70% (p=0.008 n=5+5)
zeo/py/fs1-zhash.go+prefetch128 98.6µs ± 3% 98.8µs ± 1% ~ (p=0.810 n=5+5)
neo/py(!log)/sqlite-zhash.py 684µs ± 3% 389µs ± 1% -43.08% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zhash.go 236µs ± 2% 198µs ± 5% -16.19% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zhash.go+prefetch128 162µs ± 2% 165µs ± 4% ~ (p=0.310 n=5+5)
neo/py(!log)/sql-zhash.py 942µs ±47% 448µs ± 3% -52.47% (p=0.016 n=5+4)
neo/py(!log)/sql-zhash.go 300µs ±17% 251µs ± 2% -16.37% (p=0.008 n=5+5)
neo/py(!log)/sql-zhash.go+prefetch128 240µs ± 6% 220µs ± 1% -8.51% (p=0.008 n=5+5)
neo/go/fs1-zhash.py 383µs ±20% 270µs ± 2% -29.62% (p=0.008 n=5+5)
neo/go/fs1-zhash.go 81.3µs ± 1% 81.0µs ± 4% ~ (p=0.690 n=5+5)
neo/go/fs1-zhash.go+prefetch128 33.8µs ± 5% 34.9µs ± 6% ~ (p=0.381 n=5+5)
neo/go/fs1(!sha1)-zhash.go(!sha1) 57.6µs ± 3% 56.0µs ± 3% -2.71% (p=0.024 n=5+5)
neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 22.9µs ± 6% 22.7µs ± 7% ~ (p=1.000 n=5+5)
neo/go/sqlite-zhash.py 402µs ± 6% 323µs ± 1% -19.66% (p=0.008 n=5+5)
neo/go/sqlite-zhash.go 125µs ± 1% 124µs ± 1% ~ (p=0.056 n=5+5)
neo/go/sqlite-zhash.go+prefetch128 48.4µs ± 8% 46.9µs ± 2% ~ (p=0.690 n=5+5)
neo/go/sqlite-zhash.go(!sha1) 116µs ± 2% 113µs ± 2% -1.96% (p=0.032 n=5+5)
neo/go/sqlite-zhash.go+prefetch128(!sha1) 45.9µs ± 5% 46.6µs ± 4% ~ (p=0.341 n=5+5)
cluster:neo1 dataset:prod1-1024
fs1-zhash.py 28.9µs ± 1% 28.9µs ± 1% ~ (p=0.746 n=5+5)
fs1-zhash.go 3.76µs ± 4% 3.76µs ± 2% ~ (p=1.000 n=5+5)
fs1-zhash.go+prefetch128 3.86µs ± 2% 3.74µs ± 2% -3.11% (p=0.048 n=5+5)
zeo/py/fs1-zhash.py 474µs ± 2% 442µs ± 9% ~ (p=0.095 n=5+5)
zeo/py/fs1-zhash.go 170µs ± 3% 148µs ± 3% -13.05% (p=0.008 n=5+5)
zeo/py/fs1-zhash.go+prefetch128 87.8µs ± 1% 87.9µs ± 2% ~ (p=0.881 n=5+5)
neo/py(!log)/sqlite-zhash.py 665µs ± 2% 382µs ± 3% -42.60% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zhash.go 219µs ± 2% 181µs ± 1% -17.27% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zhash.go+prefetch128 151µs ± 1% 150µs ± 1% ~ (p=0.206 n=5+4)
neo/py(!log)/sql-zhash.py 886µs ±56% 426µs ± 1% -51.90% (p=0.016 n=5+4)
neo/py(!log)/sql-zhash.go 298µs ± 9% 234µs ± 2% -21.22% (p=0.008 n=5+5)
neo/py(!log)/sql-zhash.go+prefetch128 230µs ± 3% 210µs ± 6% -8.71% (p=0.008 n=5+5)
neo/go/fs1-zhash.py 319µs ±11% 260µs ± 2% -18.46% (p=0.008 n=5+5)
neo/go/fs1-zhash.go 61.3µs ± 3% 61.4µs ± 2% ~ (p=0.802 n=5+5)
neo/go/fs1-zhash.go+prefetch128 22.5µs ± 3% 22.2µs ± 5% ~ (p=0.595 n=5+5)
neo/go/fs1(!sha1)-zhash.go(!sha1) 52.0µs ± 3% 51.9µs ± 4% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 18.3µs ± 2% 18.3µs ± 3% ~ (p=0.667 n=5+5)
neo/go/sqlite-zhash.py 382µs ± 6% 310µs ± 2% -19.04% (p=0.008 n=5+5)
neo/go/sqlite-zhash.go 113µs ± 1% 112µs ± 1% ~ (p=0.063 n=5+5)
neo/go/sqlite-zhash.go+prefetch128 40.9µs ± 4% 41.9µs ± 4% ~ (p=0.190 n=5+5)
neo/go/sqlite-zhash.go(!sha1) 108µs ± 1% 107µs ± 1% ~ (p=0.056 n=5+5)
neo/go/sqlite-zhash.go+prefetch128(!sha1) 41.1µs ± 5% 41.1µs ± 2% ~ (p=0.881 n=5+5)

name old req/s new req/s delta
cluster:neo1 dataset:wczblk1-8
fs1-zwrk.go·1 229k ± 0% 229k ± 0% ~ (p=1.000 n=5+5)
fs1-zwrk.go·2 443k ± 1% 439k ± 0% ~ (p=0.111 n=5+4)
fs1-zwrk.go·3 662k ± 1% 660k ± 1% ~ (p=1.000 n=5+5)
fs1-zwrk.go·4 867k ± 1% 865k ± 0% ~ (p=1.000 n=5+5)
fs1-zwrk.go·8 988k ± 0% 959k ±11% ~ (p=0.548 n=5+5)
fs1-zwrk.go·12 1.02M ± 0% 1.02M ± 0% ~ (p=0.841 n=5+5)
fs1-zwrk.go·16 976k ±12% 1015k ± 0% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·1 5.15k ± 1% 5.84k ± 1% +13.54% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·2 7.08k ± 1% 7.05k ± 5% ~ (p=0.841 n=5+5)
zeo/py/fs1-zwrk.go·3 7.73k ± 1% 7.82k ± 1% +1.29% (p=0.032 n=5+5)
zeo/py/fs1-zwrk.go·4 7.97k ± 4% 8.07k ± 1% ~ (p=0.421 n=5+5)
zeo/py/fs1-zwrk.go·8 8.30k ± 2% 8.40k ± 2% ~ (p=0.095 n=5+5)
zeo/py/fs1-zwrk.go·12 8.15k ± 1% 8.40k ± 2% +3.08% (p=0.016 n=5+5)
zeo/py/fs1-zwrk.go·16 8.25k ± 1% 8.48k ± 1% +2.85% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 4.31k ± 4% 5.06k ± 3% +17.59% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 6.28k ± 5% 6.39k ± 0% ~ (p=0.730 n=5+4)
neo/py(!log)/sqlite-zwrk.go·3 6.38k ± 0% 6.28k ± 8% ~ (p=0.730 n=4+5)
neo/py(!log)/sqlite-zwrk.go·4 6.15k ± 5% 6.10k ± 5% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 6.27k ± 4% 6.22k ± 9% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 6.33k ± 2% 6.28k ± 6% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 6.25k ± 4% 6.17k ± 6% ~ (p=0.690 n=5+5)
neo/py(!log)/sql-zwrk.go·1 3.10k ± 6% 4.12k ± 1% +33.05% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·2 3.98k ± 1% 4.76k ± 5% +19.62% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·3 4.04k ± 3% 4.70k ± 4% +16.27% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·4 4.06k ± 4% 4.78k ± 2% +17.62% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·8 3.79k ± 7% 4.67k ± 5% +23.22% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·12 3.98k ± 3% 4.67k ± 3% +17.40% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·16 3.94k ± 1% 4.72k ± 3% +19.55% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·1 12.8k ± 0% 12.8k ± 1% ~ (p=0.421 n=5+5)
neo/go/fs1-zwrk.go·2 24.8k ± 0% 25.0k ± 1% ~ (p=0.063 n=4+5)
neo/go/fs1-zwrk.go·3 32.3k ± 0% 32.2k ± 2% ~ (p=0.222 n=5+5)
neo/go/fs1-zwrk.go·4 40.7k ± 0% 40.9k ± 0% +0.47% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·8 54.5k ± 1% 54.9k ± 0% +0.66% (p=0.016 n=5+5)
neo/go/fs1-zwrk.go·12 56.5k ± 1% 56.7k ± 1% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·16 53.2k ±10% 54.4k ± 2% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 19.0k ± 2% 19.3k ± 2% ~ (p=0.056 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 37.8k ± 0% 37.8k ± 1% ~ (p=0.841 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 48.0k ± 1% 48.2k ± 0% +0.50% (p=0.032 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 59.0k ± 0% 59.2k ± 0% +0.39% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 78.0k ± 1% 78.3k ± 0% ~ (p=0.095 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 82.2k ± 2% 82.5k ± 1% ~ (p=0.690 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 80.4k ± 1% 80.3k ± 2% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go·1 8.06k ± 4% 8.24k ± 1% +2.17% (p=0.016 n=5+5)
neo/go/sqlite-zwrk.go·2 14.9k ± 0% 15.0k ± 0% ~ (p=0.095 n=5+5)
neo/go/sqlite-zwrk.go·3 20.7k ± 0% 20.8k ± 0% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go·4 24.8k ± 0% 24.9k ± 0% +0.39% (p=0.016 n=5+5)
neo/go/sqlite-zwrk.go·8 31.7k ± 1% 31.6k ± 1% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go·12 30.8k ± 5% 31.4k ± 1% ~ (p=0.310 n=5+5)
neo/go/sqlite-zwrk.go·16 30.4k ± 2% 30.6k ± 3% ~ (p=0.548 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 8.95k ± 1% 9.05k ± 1% ~ (p=0.056 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 16.2k ± 1% 16.3k ± 1% +0.88% (p=0.016 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 22.6k ± 0% 22.6k ± 0% ~ (p=0.905 n=4+5)
neo/go/sqlite-zwrk.go(!sha1)·4 27.9k ± 0% 27.7k ± 0% -0.83% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 35.0k ± 1% 34.4k ± 1% -1.78% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 34.7k ± 1% 33.4k ± 2% -3.68% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 33.0k ±11% 32.9k ± 2% ~ (p=0.151 n=5+5)
cluster:neo1 dataset:prod1-1024
fs1-zwrk.go·1 451k ± 0% 451k ± 1% ~ (p=1.000 n=5+5)
fs1-zwrk.go·2 893k ± 0% 871k ± 9% ~ (p=0.690 n=5+5)
fs1-zwrk.go·3 1.34M ± 1% 1.33M ± 0% ~ (p=0.690 n=5+5)
fs1-zwrk.go·4 1.77M ± 0% 1.76M ± 0% ~ (p=0.310 n=5+5)
fs1-zwrk.go·8 1.99M ± 1% 2.00M ± 2% ~ (p=0.421 n=5+5)
fs1-zwrk.go·12 2.03M ± 1% 2.03M ± 0% ~ (p=0.556 n=4+5)
fs1-zwrk.go·16 2.03M ± 0% 2.03M ± 0% ~ (p=0.111 n=5+4)
zeo/py/fs1-zwrk.go·1 5.79k ± 3% 6.83k ± 2% +18.03% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·2 8.55k ± 1% 8.70k ± 1% +1.74% (p=0.016 n=5+5)
zeo/py/fs1-zwrk.go·3 9.28k ± 7% 9.54k ± 2% ~ (p=0.151 n=5+5)
zeo/py/fs1-zwrk.go·4 9.72k ± 1% 9.77k ± 1% ~ (p=0.151 n=5+5)
zeo/py/fs1-zwrk.go·8 10.4k ± 1% 10.5k ± 1% ~ (p=0.421 n=5+5)
zeo/py/fs1-zwrk.go·12 10.5k ± 1% 10.6k ± 1% ~ (p=0.310 n=5+5)
zeo/py/fs1-zwrk.go·16 10.4k ± 4% 10.7k ± 1% +2.75% (p=0.016 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 4.90k ± 7% 5.51k ± 3% +12.34% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 6.28k ± 4% 6.38k ± 3% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 6.32k ± 5% 6.27k ± 5% ~ (p=0.841 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 6.45k ± 2% 6.54k ± 0% +1.35% (p=0.032 n=5+4)
neo/py(!log)/sqlite-zwrk.go·8 6.45k ± 2% 6.48k ± 2% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 6.31k ± 3% 6.43k ± 2% ~ (p=0.151 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 6.36k ± 5% 6.41k ± 3% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·1 3.50k ± 9% 4.25k ± 7% +21.25% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·2 4.05k ± 6% 4.92k ± 1% +21.64% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·3 4.06k ± 7% 4.85k ± 3% +19.49% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·4 3.98k ± 4% 4.90k ± 2% +22.98% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·8 4.15k ± 3% 4.89k ± 1% +17.81% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·12 4.00k ± 5% 4.90k ± 3% +22.72% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·16 3.96k ±11% 4.81k ± 7% +21.32% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·1 17.1k ± 1% 17.4k ± 2% +2.02% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·2 32.6k ± 0% 32.8k ± 1% ~ (p=0.310 n=5+5)
neo/go/fs1-zwrk.go·3 43.3k ± 0% 43.2k ± 0% ~ (p=1.000 n=5+5)
neo/go/fs1-zwrk.go·4 52.9k ± 0% 52.9k ± 0% ~ (p=0.905 n=5+4)
neo/go/fs1-zwrk.go·8 66.3k ± 1% 65.4k ± 1% ~ (p=0.063 n=4+5)
neo/go/fs1-zwrk.go·12 61.6k ± 1% 59.6k ± 4% -3.20% (p=0.016 n=5+5)
neo/go/fs1-zwrk.go·16 55.6k ± 4% 53.9k ± 2% ~ (p=0.056 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 19.6k ± 5% 20.1k ± 2% ~ (p=0.310 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 40.3k ± 0% 39.9k ± 5% ~ (p=0.690 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 51.6k ± 0% 51.7k ± 0% ~ (p=0.421 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 62.0k ± 0% 62.5k ± 0% +0.78% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 74.2k ± 4% 74.0k ± 3% ~ (p=0.841 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 64.8k ± 7% 66.8k ± 3% ~ (p=0.222 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 59.5k ± 4% 58.6k ± 2% ~ (p=0.222 n=5+5)
neo/go/sqlite-zwrk.go·1 9.02k ± 1% 9.16k ± 1% +1.58% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·2 16.0k ± 0% 16.0k ± 1% ~ (p=0.548 n=5+5)
neo/go/sqlite-zwrk.go·3 21.8k ± 1% 21.8k ± 0% ~ (p=0.730 n=4+5)
neo/go/sqlite-zwrk.go·4 26.2k ± 0% 26.2k ± 1% ~ (p=0.905 n=5+4)
neo/go/sqlite-zwrk.go·8 30.0k ± 2% 29.9k ± 1% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go·12 28.6k ± 2% 28.5k ± 2% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go·16 28.7k ± 1% 28.9k ± 2% ~ (p=0.730 n=4+5)
neo/go/sqlite-zwrk.go(!sha1)·1 9.45k ± 1% 9.51k ± 1% ~ (p=0.222 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 16.6k ± 1% 16.5k ± 1% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 23.0k ± 0% 22.7k ± 0% -1.37% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 28.0k ± 1% 27.4k ± 0% -2.02% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 32.3k ± 0% 30.4k ±12% -5.86% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 30.6k ± 2% 29.6k ± 2% -3.24% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 30.3k ± 2% 29.5k ± 2% -2.73% (p=0.008 n=5+5)

name old latency-time/object new latency-time/object delta
cluster:neo1 dataset:wczblk1-8
fs1-zwrk.go·1 4.36µs ± 0% 4.37µs ± 0% ~ (p=1.000 n=5+5)
fs1-zwrk.go·2 4.52µs ± 1% 4.56µs ± 0% ~ (p=0.111 n=5+4)
fs1-zwrk.go·3 4.53µs ± 1% 4.54µs ± 1% ~ (p=0.881 n=5+5)
fs1-zwrk.go·4 4.61µs ± 1% 4.62µs ± 0% ~ (p=0.889 n=5+5)
fs1-zwrk.go·8 8.10µs ± 0% 8.37µs ±12% ~ (p=0.548 n=5+5)
fs1-zwrk.go·12 11.8µs ± 0% 11.8µs ± 0% ~ (p=0.841 n=5+5)
fs1-zwrk.go·16 16.5µs ±13% 15.8µs ± 0% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·1 194µs ± 1% 171µs ± 1% -11.93% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·2 282µs ± 1% 284µs ± 5% ~ (p=0.841 n=5+5)
zeo/py/fs1-zwrk.go·3 388µs ± 1% 383µs ± 1% -1.27% (p=0.032 n=5+5)
zeo/py/fs1-zwrk.go·4 502µs ± 5% 496µs ± 1% ~ (p=0.421 n=5+5)
zeo/py/fs1-zwrk.go·8 964µs ± 2% 952µs ± 2% ~ (p=0.095 n=5+5)
zeo/py/fs1-zwrk.go·12 1.47ms ± 1% 1.43ms ± 2% -2.98% (p=0.016 n=5+5)
zeo/py/fs1-zwrk.go·16 1.94ms ± 1% 1.89ms ± 1% -2.77% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 232µs ± 4% 198µs ± 3% -14.97% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 319µs ± 5% 313µs ± 0% ~ (p=0.730 n=5+4)
neo/py(!log)/sqlite-zwrk.go·3 470µs ± 0% 469µs ± 1% ~ (p=0.343 n=4+4)
neo/py(!log)/sqlite-zwrk.go·4 651µs ± 5% 656µs ± 5% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 1.28ms ± 4% 1.29ms ±10% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 1.90ms ± 2% 1.91ms ± 6% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 2.56ms ± 4% 2.60ms ± 6% ~ (p=0.690 n=5+5)
neo/py(!log)/sql-zwrk.go·1 323µs ± 6% 242µs ± 1% -24.90% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·2 503µs ± 2% 421µs ± 5% -16.28% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·3 742µs ± 3% 639µs ± 4% -13.97% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·4 986µs ± 4% 838µs ± 2% -15.02% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·8 2.11ms ± 8% 1.71ms ± 4% -18.91% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·12 3.02ms ± 3% 2.57ms ± 3% -14.83% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·16 4.06ms ± 1% 3.39ms ± 3% -16.33% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·1 77.8µs ± 0% 78.2µs ± 1% ~ (p=0.421 n=5+5)
neo/go/fs1-zwrk.go·2 80.6µs ± 0% 80.0µs ± 1% ~ (p=0.063 n=4+5)
neo/go/fs1-zwrk.go·3 92.8µs ± 0% 93.1µs ± 2% ~ (p=0.222 n=5+5)
neo/go/fs1-zwrk.go·4 98.2µs ± 0% 97.7µs ± 0% -0.47% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·8 147µs ± 1% 146µs ± 0% -0.66% (p=0.016 n=5+5)
neo/go/fs1-zwrk.go·12 212µs ± 1% 212µs ± 1% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·16 293µs ± 1% 294µs ± 2% ~ (p=0.556 n=4+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 52.7µs ± 2% 51.8µs ± 2% ~ (p=0.056 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 53.0µs ± 0% 52.9µs ± 1% ~ (p=0.841 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 62.5µs ± 1% 62.2µs ± 0% -0.50% (p=0.032 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 67.8µs ± 0% 67.6µs ± 0% -0.39% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 103µs ± 1% 102µs ± 0% ~ (p=0.095 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 146µs ± 2% 145µs ± 1% ~ (p=0.690 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 199µs ± 1% 199µs ± 2% ~ (p=0.794 n=5+5)
neo/go/sqlite-zwrk.go·1 124µs ± 4% 121µs ± 1% -2.17% (p=0.016 n=5+5)
neo/go/sqlite-zwrk.go·2 134µs ± 0% 134µs ± 0% ~ (p=0.095 n=5+5)
neo/go/sqlite-zwrk.go·3 145µs ± 0% 144µs ± 0% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go·4 161µs ± 0% 161µs ± 0% -0.38% (p=0.016 n=5+5)
neo/go/sqlite-zwrk.go·8 252µs ± 1% 253µs ± 1% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go·12 390µs ± 5% 382µs ± 1% ~ (p=0.310 n=5+5)
neo/go/sqlite-zwrk.go·16 526µs ± 2% 524µs ± 3% ~ (p=0.548 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 112µs ± 1% 110µs ± 1% ~ (p=0.056 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 124µs ± 1% 123µs ± 1% -0.87% (p=0.016 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 133µs ± 0% 133µs ± 0% ~ (p=0.905 n=4+5)
neo/go/sqlite-zwrk.go(!sha1)·4 143µs ± 0% 145µs ± 0% +0.83% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 228µs ± 1% 232µs ± 1% +1.81% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 346µs ± 1% 359µs ± 2% +3.82% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 486µs ±11% 486µs ± 2% ~ (p=0.151 n=5+5)
cluster:neo1 dataset:prod1-1024
fs1-zwrk.go·1 2.22µs ± 1% 2.22µs ± 1% ~ (p=0.889 n=5+5)
fs1-zwrk.go·2 2.24µs ± 0% 2.30µs ± 9% ~ (p=0.690 n=5+5)
fs1-zwrk.go·3 2.25µs ± 1% 2.25µs ± 0% ~ (p=0.738 n=5+5)
fs1-zwrk.go·4 2.26µs ± 0% 2.27µs ± 0% ~ (p=0.286 n=5+5)
fs1-zwrk.go·8 4.02µs ± 1% 4.00µs ± 2% ~ (p=0.460 n=5+5)
fs1-zwrk.go·12 5.92µs ± 1% 5.91µs ± 0% ~ (p=0.619 n=4+5)
fs1-zwrk.go·16 7.87µs ± 0% 7.88µs ± 0% ~ (p=0.127 n=5+4)
zeo/py/fs1-zwrk.go·1 173µs ± 3% 146µs ± 2% -15.31% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·2 234µs ± 1% 230µs ± 1% -1.71% (p=0.016 n=5+5)
zeo/py/fs1-zwrk.go·3 324µs ± 7% 315µs ± 2% ~ (p=0.151 n=5+5)
zeo/py/fs1-zwrk.go·4 412µs ± 1% 409µs ± 1% ~ (p=0.151 n=5+5)
zeo/py/fs1-zwrk.go·8 768µs ± 1% 765µs ± 1% ~ (p=0.421 n=5+5)
zeo/py/fs1-zwrk.go·12 1.14ms ± 1% 1.13ms ± 1% ~ (p=0.310 n=5+5)
zeo/py/fs1-zwrk.go·16 1.54ms ± 4% 1.49ms ± 1% -2.71% (p=0.016 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 204µs ± 8% 182µs ± 3% -11.14% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 319µs ± 4% 314µs ± 3% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 475µs ± 5% 479µs ± 5% ~ (p=0.841 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 620µs ± 2% 612µs ± 0% -1.34% (p=0.032 n=5+4)
neo/py(!log)/sqlite-zwrk.go·8 1.24ms ± 2% 1.23ms ± 2% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 1.90ms ± 3% 1.87ms ± 2% ~ (p=0.151 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 2.52ms ± 5% 2.49ms ± 3% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·1 287µs ± 8% 236µs ± 8% -17.73% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·2 495µs ± 6% 406µs ± 1% -17.95% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·3 740µs ± 8% 618µs ± 3% -16.50% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·4 1.01ms ± 4% 0.82ms ± 2% -18.75% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·8 1.93ms ± 3% 1.64ms ± 1% -15.14% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·12 3.01ms ± 4% 2.45ms ± 3% -18.53% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·16 4.05ms ±10% 3.33ms ± 8% -17.74% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·1 58.5µs ± 1% 57.4µs ± 2% -1.98% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·2 61.4µs ± 0% 61.1µs ± 1% ~ (p=0.238 n=5+5)
neo/go/fs1-zwrk.go·3 69.3µs ± 0% 69.4µs ± 0% ~ (p=0.881 n=5+5)
neo/go/fs1-zwrk.go·4 75.6µs ± 0% 75.6µs ± 0% ~ (p=0.952 n=5+4)
neo/go/fs1-zwrk.go·8 121µs ± 1% 122µs ± 1% ~ (p=0.063 n=4+5)
neo/go/fs1-zwrk.go·12 195µs ± 1% 201µs ± 4% +3.35% (p=0.016 n=5+5)
neo/go/fs1-zwrk.go·16 288µs ± 4% 297µs ± 2% ~ (p=0.056 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 50.9µs ± 5% 49.8µs ± 2% ~ (p=0.310 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 49.7µs ± 0% 50.1µs ± 5% ~ (p=0.690 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 58.2µs ± 0% 58.0µs ± 0% ~ (p=0.421 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 64.5µs ± 0% 64.0µs ± 0% -0.77% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 108µs ± 4% 108µs ± 3% ~ (p=0.841 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 185µs ± 8% 180µs ± 3% ~ (p=0.222 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 269µs ± 4% 273µs ± 2% ~ (p=0.222 n=5+5)
neo/go/sqlite-zwrk.go·1 111µs ± 1% 109µs ± 1% -1.55% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·2 125µs ± 0% 125µs ± 1% ~ (p=0.548 n=5+5)
neo/go/sqlite-zwrk.go·3 137µs ± 1% 137µs ± 0% ~ (p=0.730 n=4+5)
neo/go/sqlite-zwrk.go·4 153µs ± 0% 153µs ± 1% ~ (p=0.905 n=5+4)
neo/go/sqlite-zwrk.go·8 267µs ± 1% 267µs ± 1% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go·12 420µs ± 2% 421µs ± 2% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go·16 558µs ± 1% 554µs ± 2% ~ (p=0.730 n=4+5)
neo/go/sqlite-zwrk.go(!sha1)·1 106µs ± 1% 105µs ± 1% ~ (p=0.222 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 121µs ± 1% 121µs ± 1% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 130µs ± 0% 132µs ± 0% +1.39% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 143µs ± 1% 146µs ± 0% +2.06% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 248µs ± 0% 264µs ±13% +6.65% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 393µs ± 2% 406µs ± 2% +3.34% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 528µs ± 2% 543µs ± 2% +2.81% (p=0.008 n=5+5)

f40c8b4b

X deco: localhost timings, C > C1 disabled · 0867c981

Kirill Smelkov authored Mar 06, 2018

Probably what is above noise is:

---- 8< ----
cluster:deco dataset:wczblk1-8
zeo/py/fs1-zhash.go 126µs ± 1% 112µs ± 1% -10.86% (p=0.008 n=5+5)

zeo/py/fs1-zwrk.go·1 9.12k ± 0% 8.04k ± 4% -11.87% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·2 11.6k ± 1% 9.5k ± 1% -17.54% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·3 13.4k ± 1% 10.5k ± 0% -21.56% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·4 14.0k ± 1% 11.0k ± 1% -21.81% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·8 14.7k ± 1% 11.4k ± 1% -22.03% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·12 15.0k ± 1% 11.7k ± 0% -22.09% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·16 15.1k ± 0% 11.8k ± 2% -22.32% (p=0.008 n=5+5)

zeo/py/fs1-zwrk.go·1 110µs ± 0% 125µs ± 4% +13.55% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·2 173µs ± 1% 210µs ± 1% +21.27% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·3 224µs ± 1% 286µs ± 0% +27.49% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·4 286µs ± 1% 365µs ± 1% +27.90% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·8 545µs ± 1% 699µs ± 1% +28.25% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·12 802µs ± 1% 1029µs ± 0% +28.35% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·16 1.06ms ± 0% 1.36ms ± 2% +28.74% (p=0.008 n=5+5)
---- 8< ----

however it strangely shows that serial zeo-zhash.go latency improved
126µs -> 112µs and serial zeo-zwrk.go latency got worse 110µs -> 125µs,
so probably it is all noise and I will remeasure.

Otherwise no significant change.

$ benchstat -split node,cluster,dataset 20180306-deco-ffixed-c.txt 20180306-deco-ffixed-noc_C1$2µs$.txt

name old pystone/s new pystone/s delta
node:deco
pystone 217k ± 4% 218k ± 2% ~ (p=0.841 n=5+5)

name old time/op new time/op delta
node:deco
crc32/py/4K 5.73µs ± 0% 5.72µs ± 0% ~ (p=0.151 n=5+5)
crc32/go/4K 279ns ± 0% 280ns ± 1% ~ (p=0.444 n=5+5)
sha1/py/4K 6.74µs ± 1% 6.72µs ± 1% ~ (p=0.310 n=5+5)
sha1/go/4K 5.60µs ± 0% 5.59µs ± 0% -0.16% (p=0.016 n=5+4)
unzlib/py/wczdata 27.2µs ± 1% 27.2µs ± 1% ~ (p=0.690 n=5+5)
unzlib/go/wczdata 27.0µs ± 0% 26.8µs ± 0% -0.49% (p=0.032 n=5+5)
unzlib/py/prod1-avg 5.14µs ± 3% 5.08µs ± 1% ~ (p=0.690 n=5+5)
unzlib/go/prod1-avg 5.30µs ± 1% 5.29µs ± 1% ~ (p=0.151 n=5+5)
disk/randread/direct/4K-min 104µs ± 2% 105µs ± 0% +1.23% (p=0.016 n=5+5)
disk/randread/direct/4K-avg 141µs ± 0% 142µs ± 0% +0.60% (p=0.008 n=5+5)
disk/randread/pagecache/4K-min 579ns ± 2% 582ns ± 0% ~ (p=0.548 n=5+5)
disk/randread/pagecache/4K-avg 993ns ± 0% 987ns ± 0% -0.60% (p=0.008 n=5+5)

name old time/object new time/object delta
cluster:deco dataset:wczblk1-8
fs1-zhash.py 20.3µs ± 1% 20.2µs ± 1% ~ (p=0.444 n=4+5)
fs1-zhash.go 3.26µs ± 4% 3.20µs ± 0% ~ (p=0.444 n=5+5)
fs1-zhash.go+prefetch128 4.04µs ± 1% 4.14µs ± 1% ~ (p=0.079 n=5+5)
zeo/py/fs1-zhash.py 383µs ± 5% 361µs ± 3% ~ (p=0.056 n=5+5)
zeo/py/fs1-zhash.go 126µs ± 1% 112µs ± 1% -10.86% (p=0.008 n=5+5)
zeo/py/fs1-zhash.go+prefetch128 63.1µs ± 1% 63.9µs ± 1% +1.14% (p=0.040 n=5+5)
neo/py(!log)/sqlite-zhash.py 344µs ± 6% 321µs ± 8% ~ (p=0.151 n=5+5)
neo/py(!log)/sqlite-zhash.go 140µs ± 1% 141µs ± 3% ~ (p=0.286 n=5+5)
neo/py(!log)/sqlite-zhash.go+prefetch128 119µs ± 2% 119µs ± 1% ~ (p=0.897 n=5+5)
neo/py(!log)/sql-zhash.py 386µs ± 1% 376µs ± 2% ~ (p=0.114 n=4+4)
neo/py(!log)/sql-zhash.go 183µs ± 3% 187µs ± 5% ~ (p=0.341 n=5+5)
neo/py(!log)/sql-zhash.go+prefetch128 164µs ± 3% 164µs ± 2% ~ (p=1.000 n=5+5)
neo/go/fs1-zhash.py 226µs ± 3% 226µs ± 2% ~ (p=0.841 n=5+5)
neo/go/fs1-zhash.go 57.1µs ± 0% 57.1µs ± 1% ~ (p=1.000 n=5+5)
neo/go/fs1-zhash.go+prefetch128 24.7µs ± 5% 24.0µs ± 4% -2.91% (p=0.048 n=5+5)
neo/go/fs1(!sha1)-zhash.go(!sha1) 40.2µs ± 1% 40.3µs ± 1% ~ (p=0.952 n=5+5)
neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 17.1µs ± 6% 17.2µs ± 4% ~ (p=0.786 n=5+5)
neo/go/sqlite-zhash.py 272µs ± 3% 253µs ± 1% -6.99% (p=0.008 n=5+5)
neo/go/sqlite-zhash.go 92.8µs ± 0% 93.7µs ± 1% +0.99% (p=0.016 n=4+5)
neo/go/sqlite-zhash.go+prefetch128 40.5µs ± 5% 39.5µs ± 6% ~ (p=0.222 n=5+5)
neo/go/sqlite-zhash.go(!sha1) 86.5µs ± 2% 86.4µs ± 3% ~ (p=0.571 n=5+5)
neo/go/sqlite-zhash.go+prefetch128(!sha1) 38.8µs ± 9% 39.4µs ± 7% ~ (p=0.730 n=5+5)
cluster:deco dataset:prod1-1024
fs1-zhash.py 15.8µs ± 3% 15.9µs ± 2% ~ (p=0.413 n=4+5)
fs1-zhash.go 2.80µs ± 0% 2.80µs ± 0% ~ (all equal)
fs1-zhash.go+prefetch128 3.42µs ± 8% 3.34µs ± 2% ~ (p=0.683 n=5+5)
zeo/py/fs1-zhash.py 361µs ± 5% 347µs ± 3% ~ (p=0.095 n=5+5)
zeo/py/fs1-zhash.go 105µs ± 0% 105µs ± 0% -0.42% (p=0.016 n=5+5)
zeo/py/fs1-zhash.go+prefetch128 58.9µs ± 1% 58.9µs ± 1% ~ (p=0.508 n=5+5)
neo/py(!log)/sqlite-zhash.py 344µs ± 7% 317µs ± 5% -7.93% (p=0.016 n=5+5)
neo/py(!log)/sqlite-zhash.go 137µs ± 2% 138µs ± 1% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zhash.go+prefetch128 114µs ± 1% 112µs ± 1% -1.48% (p=0.024 n=5+5)
neo/py(!log)/sql-zhash.py 380µs ± 4% 377µs ± 2% ~ (p=1.000 n=4+4)
neo/py(!log)/sql-zhash.go 180µs ± 1% 184µs ± 2% +2.44% (p=0.032 n=5+5)
neo/py(!log)/sql-zhash.go+prefetch128 159µs ± 1% 160µs ± 2% ~ (p=0.889 n=5+5)
neo/go/fs1-zhash.py 221µs ± 1% 225µs ± 1% +1.59% (p=0.016 n=5+5)
neo/go/fs1-zhash.go 45.2µs ± 2% 44.6µs ± 0% -1.37% (p=0.016 n=5+5)
neo/go/fs1-zhash.go+prefetch128 17.6µs ± 2% 17.2µs ± 3% ~ (p=0.087 n=5+5)
neo/go/fs1(!sha1)-zhash.go(!sha1) 39.1µs ± 2% 39.1µs ± 3% ~ (p=0.659 n=5+5)
neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 14.6µs ± 4% 15.2µs ± 3% +4.25% (p=0.024 n=5+5)
neo/go/sqlite-zhash.py 271µs ± 2% 254µs ± 1% -6.14% (p=0.008 n=5+5)
neo/go/sqlite-zhash.go 86.4µs ± 0% 86.3µs ± 0% ~ (p=0.325 n=5+5)
neo/go/sqlite-zhash.go+prefetch128 35.8µs ± 2% 36.6µs ± 5% ~ (p=0.690 n=5+5)
neo/go/sqlite-zhash.go(!sha1) 84.0µs ± 1% 83.8µs ± 2% ~ (p=0.952 n=5+5)
neo/go/sqlite-zhash.go+prefetch128(!sha1) 36.5µs ± 5% 36.9µs ± 8% ~ (p=1.000 n=5+5)

name old req/s new req/s delta
cluster:deco dataset:wczblk1-8
fs1-zwrk.go·1 436k ± 0% 431k ± 1% -1.23% (p=0.008 n=5+5)
fs1-zwrk.go·2 744k ± 1% 760k ± 3% ~ (p=0.056 n=5+5)
fs1-zwrk.go·3 1.09M ± 0% 1.08M ± 2% ~ (p=0.095 n=5+5)
fs1-zwrk.go·4 1.16M ± 1% 1.16M ± 1% ~ (p=1.000 n=5+5)
fs1-zwrk.go·8 1.27M ± 1% 1.27M ± 1% ~ (p=1.000 n=5+5)
fs1-zwrk.go·12 1.27M ± 1% 1.28M ± 1% ~ (p=0.310 n=5+5)
fs1-zwrk.go·16 1.27M ± 1% 1.28M ± 1% ~ (p=0.222 n=5+5)
zeo/py/fs1-zwrk.go·1 9.12k ± 0% 8.04k ± 4% -11.87% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·2 11.6k ± 1% 9.5k ± 1% -17.54% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·3 13.4k ± 1% 10.5k ± 0% -21.56% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·4 14.0k ± 1% 11.0k ± 1% -21.81% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·8 14.7k ± 1% 11.4k ± 1% -22.03% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·12 15.0k ± 1% 11.7k ± 0% -22.09% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·16 15.1k ± 0% 11.8k ± 2% -22.32% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 7.09k ± 1% 7.04k ± 1% ~ (p=0.151 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 8.48k ± 1% 8.52k ± 1% ~ (p=0.548 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 8.48k ± 1% 8.51k ± 1% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 8.47k ± 1% 8.50k ± 1% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 8.43k ± 1% 8.53k ± 1% +1.16% (p=0.032 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 8.46k ± 1% 8.48k ± 2% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 8.46k ± 1% 8.48k ± 1% ~ (p=0.690 n=5+5)
neo/py(!log)/sql-zwrk.go·1 5.51k ± 1% 5.37k ± 3% ~ (p=0.151 n=5+5)
neo/py(!log)/sql-zwrk.go·2 6.32k ± 1% 6.34k ± 0% ~ (p=0.690 n=5+5)
neo/py(!log)/sql-zwrk.go·3 6.29k ± 1% 6.28k ± 1% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·4 6.27k ± 1% 6.29k ± 1% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·8 6.27k ± 1% 6.29k ± 1% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·12 6.29k ± 0% 6.25k ± 1% ~ (p=0.056 n=5+5)
neo/py(!log)/sql-zwrk.go·16 6.22k ± 1% 6.23k ± 2% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·1 18.4k ± 1% 18.4k ± 0% ~ (p=0.151 n=5+5)
neo/go/fs1-zwrk.go·2 38.1k ± 1% 38.3k ± 1% ~ (p=0.310 n=5+5)
neo/go/fs1-zwrk.go·3 46.0k ± 1% 45.9k ± 0% ~ (p=1.000 n=5+5)
neo/go/fs1-zwrk.go·4 50.2k ± 1% 50.0k ± 0% ~ (p=0.056 n=5+5)
neo/go/fs1-zwrk.go·8 61.0k ± 0% 60.3k ± 1% -1.09% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·12 62.1k ± 1% 62.1k ± 1% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·16 62.5k ± 1% 61.6k ± 1% -1.37% (p=0.032 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 26.3k ± 1% 26.3k ± 0% ~ (p=0.841 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 55.3k ± 1% 55.7k ± 1% ~ (p=0.056 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 62.7k ± 1% 62.8k ± 1% ~ (p=0.690 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 69.3k ± 1% 69.4k ± 1% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 88.2k ± 0% 88.3k ± 1% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 93.4k ± 0% 93.5k ± 1% ~ (p=0.421 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 93.5k ± 2% 93.8k ± 0% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go·1 11.0k ± 1% 11.0k ± 0% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go·2 18.4k ± 1% 18.3k ± 1% ~ (p=0.556 n=5+4)
neo/go/sqlite-zwrk.go·3 24.4k ± 1% 24.2k ± 0% -0.73% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·4 26.8k ± 0% 26.8k ± 1% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go·8 30.4k ± 2% 29.6k ± 2% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go·12 30.5k ± 1% 29.3k ± 2% -4.15% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·16 29.9k ± 2% 28.6k ± 1% -4.50% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 11.9k ± 1% 11.9k ± 1% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 19.7k ± 0% 19.6k ± 1% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 26.5k ± 1% 26.4k ± 0% ~ (p=0.310 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 30.0k ± 0% 30.0k ± 0% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 31.2k ± 2% 31.2k ± 2% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 28.9k ± 1% 28.8k ± 3% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 28.4k ± 2% 28.4k ± 1% ~ (p=0.841 n=5+5)
cluster:deco dataset:prod1-1024
fs1-zwrk.go·1 555k ± 0% 556k ± 0% ~ (p=0.421 n=5+5)
fs1-zwrk.go·2 1.01M ± 3% 0.99M ± 6% ~ (p=0.310 n=5+5)
fs1-zwrk.go·3 1.32M ± 1% 1.33M ± 2% ~ (p=1.000 n=5+5)
fs1-zwrk.go·4 1.55M ± 2% 1.53M ± 0% ~ (p=0.421 n=5+5)
fs1-zwrk.go·8 1.59M ± 0% 1.59M ± 1% ~ (p=0.690 n=5+5)
fs1-zwrk.go·12 1.59M ± 0% 1.60M ± 1% ~ (p=0.095 n=5+5)
fs1-zwrk.go·16 1.59M ± 0% 1.59M ± 0% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·1 9.70k ± 0% 9.75k ± 1% ~ (p=0.095 n=5+5)
zeo/py/fs1-zwrk.go·2 12.4k ± 1% 12.4k ± 1% ~ (p=0.421 n=5+5)
zeo/py/fs1-zwrk.go·3 14.2k ± 1% 14.2k ± 1% ~ (p=0.841 n=5+5)
zeo/py/fs1-zwrk.go·4 14.9k ± 0% 14.9k ± 1% ~ (p=0.421 n=5+5)
zeo/py/fs1-zwrk.go·8 15.6k ± 0% 15.6k ± 1% ~ (p=0.548 n=5+5)
zeo/py/fs1-zwrk.go·12 15.2k ±11% 16.0k ± 1% ~ (p=0.056 n=5+5)
zeo/py/fs1-zwrk.go·16 16.1k ± 1% 16.0k ± 6% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 7.44k ± 1% 7.45k ± 2% ~ (p=0.841 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 8.59k ± 1% 8.71k ± 1% +1.33% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 8.61k ± 1% 8.69k ± 1% ~ (p=0.095 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 8.57k ± 1% 8.61k ± 1% ~ (p=0.310 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 8.56k ± 1% 8.61k ± 1% ~ (p=0.222 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 8.51k ± 1% 8.59k ± 1% ~ (p=0.222 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 8.54k ± 1% 8.60k ± 1% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·1 5.55k ± 2% 5.45k ± 2% ~ (p=0.056 n=5+5)
neo/py(!log)/sql-zwrk.go·2 6.36k ± 1% 6.25k ± 1% -1.67% (p=0.016 n=5+5)
neo/py(!log)/sql-zwrk.go·3 6.31k ± 0% 6.24k ± 1% -1.09% (p=0.016 n=5+5)
neo/py(!log)/sql-zwrk.go·4 6.28k ± 0% 6.27k ± 1% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·8 6.34k ± 1% 6.28k ± 1% ~ (p=0.095 n=5+5)
neo/py(!log)/sql-zwrk.go·12 6.35k ± 1% 6.33k ± 0% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zwrk.go·16 6.36k ± 0% 6.30k ± 1% -0.95% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·1 23.7k ± 0% 23.9k ± 0% +0.71% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·2 45.4k ± 0% 45.5k ± 1% ~ (p=0.421 n=5+5)
neo/go/fs1-zwrk.go·3 55.2k ± 1% 55.1k ± 0% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·4 60.7k ± 2% 60.4k ± 0% ~ (p=0.548 n=5+5)
neo/go/fs1-zwrk.go·8 70.9k ± 2% 69.2k ± 2% -2.41% (p=0.032 n=5+5)
neo/go/fs1-zwrk.go·12 71.1k ± 3% 68.0k ± 5% ~ (p=0.056 n=5+5)
neo/go/fs1-zwrk.go·16 71.0k ± 3% 68.1k ± 3% -4.07% (p=0.016 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 27.3k ± 0% 27.2k ± 1% ~ (p=0.548 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 55.4k ± 1% 55.5k ± 1% ~ (p=0.548 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 64.0k ± 1% 64.0k ± 1% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 69.0k ± 1% 69.1k ± 1% ~ (p=0.421 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 80.9k ± 2% 81.1k ± 4% ~ (p=0.690 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 78.3k ± 5% 77.8k ± 8% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 75.4k ± 3% 76.8k ± 5% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go·1 11.7k ± 1% 11.7k ± 1% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go·2 19.0k ± 0% 18.9k ± 1% ~ (p=0.548 n=5+5)
neo/go/sqlite-zwrk.go·3 24.5k ± 1% 24.4k ± 2% ~ (p=0.222 n=5+5)
neo/go/sqlite-zwrk.go·4 26.3k ± 1% 26.0k ± 3% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go·8 24.9k ± 3% 24.6k ± 5% ~ (p=0.548 n=5+5)
neo/go/sqlite-zwrk.go·12 24.0k ± 5% 23.7k ± 3% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go·16 25.4k ± 1% 24.1k ± 3% -5.14% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 12.2k ± 0% 12.2k ± 1% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 19.8k ± 0% 19.6k ± 1% -0.81% (p=0.032 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 26.2k ± 1% 25.5k ± 1% -2.65% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 28.7k ± 1% 27.5k ± 2% -4.20% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 27.2k ± 3% 25.6k ± 2% -5.54% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 25.3k ± 2% 24.0k ± 2% -5.13% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 25.3k ± 1% 24.2k ± 1% -4.63% (p=0.008 n=5+5)

name old latency-time/object new latency-time/object delta
cluster:deco dataset:wczblk1-8
fs1-zwrk.go·1 2.29µs ± 0% 2.32µs ± 1% +1.24% (p=0.008 n=5+5)
fs1-zwrk.go·2 2.69µs ± 1% 2.63µs ± 3% ~ (p=0.056 n=5+5)
fs1-zwrk.go·3 2.76µs ± 0% 2.78µs ± 2% ~ (p=0.079 n=5+5)
fs1-zwrk.go·4 3.44µs ± 1% 3.44µs ± 1% ~ (p=1.000 n=5+5)
fs1-zwrk.go·8 6.28µs ± 1% 6.28µs ± 1% ~ (p=0.984 n=5+5)
fs1-zwrk.go·12 9.46µs ± 1% 9.40µs ± 1% ~ (p=0.310 n=5+5)
fs1-zwrk.go·16 12.6µs ± 1% 12.5µs ± 1% ~ (p=0.222 n=5+5)
zeo/py/fs1-zwrk.go·1 110µs ± 0% 125µs ± 4% +13.55% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·2 173µs ± 1% 210µs ± 1% +21.27% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·3 224µs ± 1% 286µs ± 0% +27.49% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·4 286µs ± 1% 365µs ± 1% +27.90% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·8 545µs ± 1% 699µs ± 1% +28.25% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·12 802µs ± 1% 1029µs ± 0% +28.35% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·16 1.06ms ± 0% 1.36ms ± 2% +28.74% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 141µs ± 1% 142µs ± 1% ~ (p=0.151 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 236µs ± 1% 235µs ± 1% ~ (p=0.548 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 354µs ± 1% 353µs ± 1% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 472µs ± 1% 470µs ± 1% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 949µs ± 1% 938µs ± 1% -1.15% (p=0.032 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 1.42ms ± 1% 1.41ms ± 2% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 1.89ms ± 1% 1.89ms ± 1% ~ (p=0.690 n=5+5)
neo/py(!log)/sql-zwrk.go·1 181µs ± 1% 186µs ± 3% ~ (p=0.151 n=5+5)
neo/py(!log)/sql-zwrk.go·2 317µs ± 1% 315µs ± 0% ~ (p=0.690 n=5+5)
neo/py(!log)/sql-zwrk.go·3 477µs ± 1% 478µs ± 1% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·4 638µs ± 1% 636µs ± 1% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·8 1.28ms ± 1% 1.27ms ± 1% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·12 1.91ms ± 0% 1.92ms ± 1% ~ (p=0.056 n=5+5)
neo/py(!log)/sql-zwrk.go·16 2.57ms ± 1% 2.57ms ± 2% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·1 54.2µs ± 1% 54.4µs ± 0% ~ (p=0.151 n=5+5)
neo/go/fs1-zwrk.go·2 52.5µs ± 1% 52.2µs ± 1% ~ (p=0.333 n=5+5)
neo/go/fs1-zwrk.go·3 65.3µs ± 1% 65.3µs ± 0% ~ (p=1.000 n=5+5)
neo/go/fs1-zwrk.go·4 79.6µs ± 1% 80.0µs ± 0% ~ (p=0.056 n=5+5)
neo/go/fs1-zwrk.go·8 131µs ± 0% 133µs ± 1% +1.10% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·12 193µs ± 1% 193µs ± 1% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·16 256µs ± 1% 260µs ± 1% +1.38% (p=0.032 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 38.0µs ± 1% 38.0µs ± 0% ~ (p=0.889 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 36.1µs ± 1% 35.9µs ± 1% ~ (p=0.056 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 47.8µs ± 1% 47.7µs ± 1% ~ (p=0.690 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 57.7µs ± 1% 57.7µs ± 1% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 90.7µs ± 0% 90.6µs ± 1% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 129µs ± 0% 128µs ± 1% ~ (p=0.421 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 171µs ± 2% 171µs ± 0% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go·1 90.7µs ± 1% 91.2µs ± 0% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go·2 109µs ± 1% 109µs ± 1% ~ (p=0.556 n=5+4)
neo/go/sqlite-zwrk.go·3 123µs ± 1% 124µs ± 0% +0.74% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·4 149µs ± 0% 149µs ± 1% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go·8 263µs ± 2% 270µs ± 2% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go·12 393µs ± 1% 410µs ± 2% +4.33% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·16 534µs ± 2% 560µs ± 1% +4.70% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 84.0µs ± 1% 84.0µs ± 1% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 102µs ± 0% 102µs ± 1% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 113µs ± 1% 113µs ± 0% ~ (p=0.310 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 133µs ± 0% 133µs ± 0% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 257µs ± 2% 257µs ± 2% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 415µs ± 1% 417µs ± 3% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 563µs ± 2% 563µs ± 1% ~ (p=0.841 n=5+5)
cluster:deco dataset:prod1-1024
fs1-zwrk.go·1 1.80µs ± 0% 1.80µs ± 0% ~ (p=0.413 n=5+5)
fs1-zwrk.go·2 1.98µs ± 3% 2.01µs ± 6% ~ (p=0.310 n=5+5)
fs1-zwrk.go·3 2.27µs ± 1% 2.26µs ± 2% ~ (p=0.889 n=5+5)
fs1-zwrk.go·4 2.58µs ± 2% 2.61µs ± 0% ~ (p=0.492 n=5+5)
fs1-zwrk.go·8 5.04µs ± 0% 5.04µs ± 1% ~ (p=0.730 n=5+5)
fs1-zwrk.go·12 7.55µs ± 0% 7.52µs ± 1% ~ (p=0.095 n=5+5)
fs1-zwrk.go·16 10.0µs ± 0% 10.0µs ± 0% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·1 103µs ± 0% 103µs ± 1% ~ (p=0.095 n=5+5)
zeo/py/fs1-zwrk.go·2 162µs ± 1% 161µs ± 1% ~ (p=0.421 n=5+5)
zeo/py/fs1-zwrk.go·3 212µs ± 1% 212µs ± 1% ~ (p=0.841 n=5+5)
zeo/py/fs1-zwrk.go·4 269µs ± 0% 268µs ± 1% ~ (p=0.421 n=5+5)
zeo/py/fs1-zwrk.go·8 512µs ± 0% 512µs ± 1% ~ (p=0.548 n=5+5)
zeo/py/fs1-zwrk.go·12 793µs ±12% 752µs ± 1% ~ (p=0.056 n=5+5)
zeo/py/fs1-zwrk.go·16 991µs ± 1% 1001µs ± 6% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 134µs ± 1% 134µs ± 1% ~ (p=0.841 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 233µs ± 1% 230µs ± 1% -1.31% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 348µs ± 1% 345µs ± 1% ~ (p=0.095 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 467µs ± 1% 465µs ± 1% ~ (p=0.310 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 935µs ± 1% 929µs ± 1% ~ (p=0.222 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 1.41ms ± 1% 1.40ms ± 1% ~ (p=0.222 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 1.87ms ± 1% 1.86ms ± 1% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·1 180µs ± 2% 184µs ± 2% ~ (p=0.056 n=5+5)
neo/py(!log)/sql-zwrk.go·2 315µs ± 1% 320µs ± 1% +1.69% (p=0.016 n=5+5)
neo/py(!log)/sql-zwrk.go·3 475µs ± 0% 481µs ± 1% +1.11% (p=0.016 n=5+5)
neo/py(!log)/sql-zwrk.go·4 637µs ± 0% 638µs ± 1% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·8 1.26ms ± 1% 1.27ms ± 1% ~ (p=0.095 n=5+5)
neo/py(!log)/sql-zwrk.go·12 1.89ms ± 1% 1.89ms ± 0% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zwrk.go·16 2.52ms ± 0% 2.54ms ± 1% +0.96% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·1 42.2µs ± 0% 41.9µs ± 0% -0.70% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·2 44.1µs ± 0% 44.0µs ± 1% ~ (p=0.421 n=5+5)
neo/go/fs1-zwrk.go·3 54.4µs ± 1% 54.5µs ± 0% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·4 65.9µs ± 2% 66.2µs ± 0% ~ (p=0.548 n=5+5)
neo/go/fs1-zwrk.go·8 113µs ± 2% 116µs ± 2% +2.48% (p=0.032 n=5+5)
neo/go/fs1-zwrk.go·12 169µs ± 4% 177µs ± 5% ~ (p=0.056 n=5+5)
neo/go/fs1-zwrk.go·16 225µs ± 3% 235µs ± 3% +4.24% (p=0.016 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 36.6µs ± 0% 36.8µs ± 1% ~ (p=0.548 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 36.1µs ± 1% 36.0µs ± 1% ~ (p=0.548 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 46.9µs ± 1% 46.9µs ± 1% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 57.9µs ± 1% 57.9µs ± 1% ~ (p=0.421 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 98.9µs ± 2% 98.6µs ± 4% ~ (p=0.690 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 153µs ± 5% 155µs ± 8% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 212µs ± 3% 208µs ± 5% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go·1 85.1µs ± 1% 85.5µs ± 1% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go·2 105µs ± 0% 106µs ± 1% ~ (p=0.548 n=5+5)
neo/go/sqlite-zwrk.go·3 123µs ± 1% 123µs ± 2% ~ (p=0.222 n=5+5)
neo/go/sqlite-zwrk.go·4 152µs ± 1% 154µs ± 3% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go·8 321µs ± 3% 325µs ± 5% ~ (p=0.548 n=5+5)
neo/go/sqlite-zwrk.go·12 500µs ± 5% 507µs ± 3% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go·16 630µs ± 1% 665µs ± 3% +5.46% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 82.0µs ± 0% 82.3µs ± 1% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 101µs ± 0% 102µs ± 1% +0.82% (p=0.032 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 115µs ± 1% 118µs ± 1% +2.73% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 139µs ± 1% 145µs ± 2% +4.40% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 295µs ± 3% 312µs ± 2% +5.87% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 474µs ± 2% 500µs ± 2% +5.41% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 632µs ± 1% 662µs ± 1% +4.85% (p=0.008 n=5+5)

0867c981

X rio: localhost timings, Cenabled · 31dc070d

Kirill Smelkov authored Mar 06, 2018

Compared to yesterday shows relatively no significant change, though
some benchmarks, like on neo1 & z6001, are itself noisy.

Disk, like on neo1 is not stable from run to run (though it still shows
a magnitude).

$ benchstat -split node,cluster,dataset 20180305-rio-ffixed-c.txt 20180306-rio-ffixed-c.txt

name old pystone/s new pystone/s delta
node:rio
pystone 146k ± 1% 115k ±12% -21.20% (p=0.008 n=5+5)

name old time/op new time/op delta
node:rio
crc32/py/4K 4.76µs ± 0% 4.77µs ± 0% ~ (p=0.730 n=5+4)
crc32/go/4K 1.49µs ± 0% 1.49µs ± 0% +0.22% (p=0.016 n=4+5)
sha1/py/4K 8.02µs ± 2% 8.04µs ± 1% ~ (p=0.500 n=5+5)
sha1/go/4K 8.95µs ± 0% 8.93µs ± 0% ~ (p=0.397 n=4+5)
unzlib/py/wczdata 25.0µs ± 0% 25.1µs ± 1% ~ (p=0.778 n=4+5)
unzlib/go/wczdata 23.0µs ± 0% 23.0µs ± 0% ~ (p=0.548 n=5+5)
unzlib/py/prod1-avg 7.25µs ± 3% 7.16µs ± 1% ~ (p=0.151 n=5+5)
unzlib/go/prod1-avg 5.07µs ± 0% 5.08µs ± 1% ~ (p=0.841 n=5+5)
disk/randread/direct/4K-min 38.4µs ± 1% 92.4µs ± 0% +140.70% (p=0.008 n=5+5)
disk/randread/direct/4K-avg 96.9µs ± 0% 115.0µs ± 0% +18.72% (p=0.008 n=5+5)
disk/randread/pagecache/4K-min 571ns ± 1% 565ns ± 2% ~ (p=0.167 n=5+5)
disk/randread/pagecache/4K-avg 1.01µs ± 0% 0.99µs ± 0% -1.78% (p=0.029 n=4+4)

name old time/object new time/object delta
cluster:rio dataset:wczblk1-8
fs1-zhash.py 28.7µs ± 2% 29.2µs ± 1% ~ (p=0.063 n=5+4)
fs1-zhash.go 4.60µs ± 0% 4.68µs ± 5% ~ (p=0.444 n=5+5)
fs1-zhash.go+prefetch128 4.72µs ± 6% 4.78µs ± 5% ~ (p=0.460 n=5+5)
zeo/py/fs1-zhash.py 395µs ± 3% 400µs ± 0% ~ (p=0.690 n=5+5)
zeo/py/fs1-zhash.go 138µs ± 1% 138µs ± 1% ~ (p=0.897 n=5+5)
zeo/py/fs1-zhash.go+prefetch128 73.5µs ± 1% 74.7µs ± 2% +1.66% (p=0.048 n=5+5)
neo/py(!log)/sqlite-zhash.py 330µs ± 6% 318µs ± 7% ~ (p=0.310 n=5+5)
neo/py(!log)/sqlite-zhash.go 157µs ± 4% 154µs ± 4% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zhash.go+prefetch128 126µs ± 3% 125µs ± 3% ~ (p=0.548 n=5+5)
neo/py(!log)/sql-zhash.py 392µs ±45% 400µs ±57% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zhash.go 181µs ± 2% 183µs ±11% ~ (p=0.690 n=5+5)
neo/py(!log)/sql-zhash.go+prefetch128 159µs ± 4% 158µs ± 3% ~ (p=0.841 n=5+5)
neo/go/fs1-zhash.py 228µs ± 2% 222µs ± 4% ~ (p=0.079 n=5+5)
neo/go/fs1-zhash.go 68.5µs ± 1% 68.6µs ± 2% ~ (p=0.714 n=5+5)
neo/go/fs1-zhash.go+prefetch128 29.4µs ± 5% 29.0µs ± 6% ~ (p=0.381 n=5+5)
neo/go/fs1(!sha1)-zhash.go(!sha1) 44.2µs ± 2% 43.9µs ± 3% ~ (p=0.770 n=5+5)
neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 19.1µs ± 3% 18.8µs ± 5% ~ (p=0.643 n=5+5)
neo/go/sqlite-zhash.py 265µs ± 5% 273µs ± 3% ~ (p=0.095 n=5+5)
neo/go/sqlite-zhash.go 104µs ± 1% 104µs ± 1% ~ (p=0.690 n=5+5)
neo/go/sqlite-zhash.go+prefetch128 38.6µs ± 6% 36.3µs ± 3% -6.16% (p=0.048 n=5+5)
neo/go/sqlite-zhash.go(!sha1) 92.9µs ± 2% 94.2µs ± 3% ~ (p=0.095 n=5+5)
neo/go/sqlite-zhash.go+prefetch128(!sha1) 35.7µs ± 6% 35.1µs ± 6% ~ (p=0.413 n=5+5)
cluster:rio dataset:prod1-1024
fs1-zhash.py 23.9µs ± 1% 23.9µs ± 1% ~ (p=1.000 n=5+4)
fs1-zhash.go 3.40µs ± 0% 3.40µs ± 0% ~ (all equal)
fs1-zhash.go+prefetch128 3.00µs ± 0% 3.02µs ± 9% ~ (p=0.444 n=5+5)
zeo/py/fs1-zhash.py 367µs ± 5% 372µs ±10% ~ (p=1.000 n=5+5)
zeo/py/fs1-zhash.go 114µs ± 3% 114µs ± 1% ~ (p=0.421 n=5+5)
zeo/py/fs1-zhash.go+prefetch128 64.6µs ± 0% 64.6µs ± 1% ~ (p=0.913 n=5+5)
neo/py(!log)/sqlite-zhash.py 314µs ± 8% 321µs ±11% ~ (p=0.952 n=5+5)
neo/py(!log)/sqlite-zhash.go 144µs ± 2% 142µs ± 3% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zhash.go+prefetch128 115µs ± 1% 117µs ± 1% ~ (p=0.056 n=5+5)
neo/py(!log)/sql-zhash.py 378µs ±44% 330µs ± 1% ~ (p=0.286 n=5+4)
neo/py(!log)/sql-zhash.go 174µs ± 5% 172µs ± 1% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zhash.go+prefetch128 149µs ± 1% 149µs ± 2% ~ (p=0.952 n=5+5)
neo/go/fs1-zhash.py 218µs ± 1% 217µs ± 1% ~ (p=0.857 n=4+5)
neo/go/fs1-zhash.go 49.9µs ± 1% 49.8µs ± 2% ~ (p=0.984 n=5+5)
neo/go/fs1-zhash.go+prefetch128 19.0µs ± 1% 18.8µs ± 1% ~ (p=0.143 n=5+5)
neo/go/fs1(!sha1)-zhash.go(!sha1) 40.4µs ± 3% 40.4µs ± 3% ~ (p=0.794 n=5+5)
neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 16.2µs ± 5% 16.1µs ± 2% ~ (p=1.000 n=5+5)
neo/go/sqlite-zhash.py 266µs ± 3% 263µs ± 4% ~ (p=0.690 n=5+5)
neo/go/sqlite-zhash.go 94.0µs ± 1% 93.1µs ± 1% -1.00% (p=0.040 n=5+5)
neo/go/sqlite-zhash.go+prefetch128 33.0µs ± 4% 32.7µs ± 2% ~ (p=0.651 n=5+5)
neo/go/sqlite-zhash.go(!sha1) 90.1µs ± 2% 89.6µs ± 1% ~ (p=0.381 n=5+5)
neo/go/sqlite-zhash.go+prefetch128(!sha1) 32.9µs ± 4% 34.0µs ± 2% ~ (p=0.063 n=5+5)

name old req/s new req/s delta
cluster:rio dataset:wczblk1-8
fs1-zwrk.go·1 300k ± 0% 300k ± 0% ~ (p=0.151 n=5+5)
fs1-zwrk.go·2 549k ± 0% 546k ± 0% -0.53% (p=0.016 n=4+5)
fs1-zwrk.go·3 811k ± 0% 810k ± 0% ~ (p=0.421 n=5+5)
fs1-zwrk.go·4 1.07M ± 0% 1.08M ± 0% ~ (p=0.310 n=5+5)
fs1-zwrk.go·8 1.42M ± 0% 1.42M ± 0% ~ (p=0.841 n=5+5)
fs1-zwrk.go·12 1.54M ± 0% 1.55M ± 0% ~ (p=0.310 n=5+5)
fs1-zwrk.go·16 1.55M ± 0% 1.55M ± 0% ~ (p=0.151 n=5+5)
zeo/py/fs1-zwrk.go·1 7.55k ± 0% 7.41k ± 1% -1.87% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·2 9.17k ± 1% 9.03k ± 1% -1.60% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·3 9.74k ± 1% 9.77k ± 1% ~ (p=0.548 n=5+5)
zeo/py/fs1-zwrk.go·4 10.2k ± 2% 10.1k ± 3% ~ (p=0.095 n=5+5)
zeo/py/fs1-zwrk.go·8 10.6k ± 2% 10.5k ± 0% ~ (p=0.310 n=5+5)
zeo/py/fs1-zwrk.go·12 10.5k ± 1% 10.6k ± 1% ~ (p=0.222 n=5+5)
zeo/py/fs1-zwrk.go·16 10.6k ± 1% 10.6k ± 1% ~ (p=0.151 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 6.69k ± 4% 6.80k ± 2% ~ (p=0.310 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 8.31k ± 9% 8.31k ± 7% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 7.96k ± 6% 8.60k ± 1% +8.12% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 8.27k ± 9% 8.60k ± 1% +4.05% (p=0.016 n=5+4)
neo/py(!log)/sqlite-zwrk.go·8 8.42k ± 2% 8.61k ± 1% +2.20% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 8.46k ± 1% 8.56k ± 1% +1.19% (p=0.032 n=4+5)
neo/py(!log)/sqlite-zwrk.go·16 8.34k ± 4% 8.49k ± 3% ~ (p=0.310 n=5+5)
neo/py(!log)/sql-zwrk.go·1 5.63k ± 1% 5.62k ± 6% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·2 6.80k ± 2% 6.75k ± 4% ~ (p=0.548 n=5+5)
neo/py(!log)/sql-zwrk.go·3 6.68k ± 2% 6.77k ± 2% ~ (p=0.310 n=5+5)
neo/py(!log)/sql-zwrk.go·4 6.63k ± 3% 6.51k ± 7% ~ (p=0.690 n=5+5)
neo/py(!log)/sql-zwrk.go·8 6.73k ± 2% 6.56k ± 4% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·12 6.71k ± 1% 6.84k ± 1% +2.00% (p=0.016 n=5+4)
neo/py(!log)/sql-zwrk.go·16 6.77k ± 2% 6.73k ± 3% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·1 15.7k ± 1% 15.5k ± 0% -1.10% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·2 30.2k ± 0% 29.9k ± 1% -1.04% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·3 39.8k ± 0% 39.4k ± 0% -0.82% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·4 49.8k ± 0% 49.4k ± 0% -0.85% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·8 69.1k ± 1% 68.4k ± 0% -0.93% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·12 73.1k ± 1% 72.5k ± 0% -0.74% (p=0.016 n=5+5)
neo/go/fs1-zwrk.go·16 73.8k ± 0% 73.2k ± 0% -0.81% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 25.5k ± 2% 26.2k ± 1% +2.41% (p=0.016 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 47.9k ± 0% 47.6k ± 0% -0.60% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 59.8k ± 0% 59.4k ± 0% -0.63% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 72.7k ± 0% 72.2k ± 0% -0.75% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 97.0k ± 0% 96.7k ± 0% ~ (p=0.151 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 110k ± 0% 109k ± 0% -0.64% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 114k ± 0% 113k ± 1% ~ (p=0.056 n=5+5)
neo/go/sqlite-zwrk.go·1 9.84k ± 1% 9.82k ± 0% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go·2 18.2k ± 0% 18.3k ± 0% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go·3 25.4k ± 0% 25.3k ± 0% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go·4 30.3k ± 0% 30.3k ± 0% ~ (p=0.095 n=5+5)
neo/go/sqlite-zwrk.go·8 39.3k ± 1% 39.5k ± 0% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go·12 40.6k ± 2% 40.8k ± 2% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go·16 40.5k ± 1% 40.5k ± 2% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 11.1k ± 1% 11.0k ± 1% ~ (p=0.095 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 20.1k ± 0% 20.0k ± 0% -0.49% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 27.9k ± 0% 27.9k ± 0% ~ (p=0.056 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 34.1k ± 1% 34.1k ± 0% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 44.2k ± 1% 44.1k ± 1% ~ (p=0.310 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 43.2k ± 1% 43.1k ± 1% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 41.3k ± 2% 41.2k ± 2% ~ (p=1.000 n=5+5)
cluster:rio dataset:prod1-1024
fs1-zwrk.go·1 463k ± 1% 465k ± 1% ~ (p=0.095 n=5+5)
fs1-zwrk.go·2 882k ± 7% 920k ± 0% +4.29% (p=0.016 n=5+4)
fs1-zwrk.go·3 1.36M ± 1% 1.36M ± 1% ~ (p=0.056 n=5+5)
fs1-zwrk.go·4 1.79M ± 1% 1.81M ± 0% ~ (p=0.095 n=5+5)
fs1-zwrk.go·8 2.34M ± 2% 2.37M ± 1% ~ (p=0.151 n=5+5)
fs1-zwrk.go·12 2.40M ± 0% 2.41M ± 0% ~ (p=0.056 n=5+5)
fs1-zwrk.go·16 2.41M ± 0% 2.42M ± 0% +0.61% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·1 8.99k ± 1% 8.98k ± 1% ~ (p=0.841 n=5+5)
zeo/py/fs1-zwrk.go·2 11.8k ± 1% 11.7k ± 1% -1.10% (p=0.032 n=5+5)
zeo/py/fs1-zwrk.go·3 12.9k ± 1% 12.9k ± 2% ~ (p=0.690 n=5+5)
zeo/py/fs1-zwrk.go·4 13.4k ± 3% 13.4k ± 4% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·8 14.1k ± 1% 14.0k ± 2% ~ (p=0.421 n=5+5)
zeo/py/fs1-zwrk.go·12 14.4k ± 2% 14.2k ± 2% ~ (p=0.421 n=5+5)
zeo/py/fs1-zwrk.go·16 14.4k ± 1% 14.2k ± 3% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 7.18k ± 2% 7.16k ± 4% ~ (p=0.841 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 8.65k ± 3% 8.75k ± 1% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 8.63k ± 1% 8.65k ± 4% ~ (p=0.222 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 8.67k ± 1% 8.53k ± 6% ~ (p=0.841 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 8.47k ± 6% 8.61k ± 3% ~ (p=0.310 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 8.45k ± 5% 8.64k ± 0% ~ (p=0.286 n=5+4)
neo/py(!log)/sqlite-zwrk.go·16 8.37k ± 3% 8.64k ± 1% +3.14% (p=0.032 n=5+5)
neo/py(!log)/sql-zwrk.go·1 5.91k ± 3% 5.88k ± 1% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·2 6.86k ± 3% 6.79k ± 2% ~ (p=0.690 n=5+5)
neo/py(!log)/sql-zwrk.go·3 6.91k ± 4% 6.58k ± 4% -4.75% (p=0.016 n=5+5)
neo/py(!log)/sql-zwrk.go·4 6.84k ± 2% 6.68k ± 4% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·8 6.98k ± 1% 6.83k ± 1% -2.17% (p=0.016 n=5+5)
neo/py(!log)/sql-zwrk.go·12 6.84k ± 6% 6.66k ± 4% ~ (p=0.095 n=5+5)
neo/py(!log)/sql-zwrk.go·16 6.92k ± 4% 6.65k ± 5% ~ (p=0.056 n=5+5)
neo/go/fs1-zwrk.go·1 21.8k ± 0% 21.8k ± 1% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·2 39.4k ± 1% 39.2k ± 1% ~ (p=0.056 n=5+5)
neo/go/fs1-zwrk.go·3 51.6k ± 0% 51.4k ± 0% -0.37% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·4 62.9k ± 0% 62.8k ± 0% ~ (p=0.222 n=5+5)
neo/go/fs1-zwrk.go·8 80.3k ± 2% 80.7k ± 1% ~ (p=0.548 n=5+5)
neo/go/fs1-zwrk.go·12 79.7k ± 2% 80.0k ± 2% ~ (p=0.690 n=5+5)
neo/go/fs1-zwrk.go·16 78.1k ± 4% 78.3k ± 2% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 26.5k ± 2% 26.5k ± 1% ~ (p=0.841 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 49.2k ± 0% 48.8k ± 0% -0.90% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 62.4k ± 0% 61.8k ± 0% -0.97% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 74.5k ± 0% 74.0k ± 0% -0.63% (p=0.016 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 92.3k ± 2% 91.3k ± 0% ~ (p=0.190 n=5+4)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 93.6k ± 4% 93.1k ± 2% ~ (p=0.548 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 90.7k ± 5% 89.7k ± 2% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go·1 11.0k ± 0% 11.0k ± 1% +0.63% (p=0.016 n=5+5)
neo/go/sqlite-zwrk.go·2 19.4k ± 0% 19.4k ± 1% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go·3 26.5k ± 0% 26.6k ± 0% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go·4 31.8k ± 1% 31.9k ± 0% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go·8 37.5k ± 1% 37.4k ± 2% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go·12 36.4k ± 5% 35.2k ± 3% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go·16 36.5k ± 3% 34.6k ± 2% -5.21% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 11.5k ± 1% 11.5k ± 1% ~ (p=0.310 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 20.1k ± 1% 20.1k ± 0% ~ (p=0.548 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 28.0k ± 0% 27.6k ± 0% -1.43% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 34.0k ± 0% 33.4k ± 0% -1.74% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 40.2k ± 1% 38.8k ± 2% -3.35% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 38.1k ± 1% 36.4k ± 1% -4.51% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 36.8k ± 1% 35.2k ± 2% -4.47% (p=0.008 n=5+5)

name old latency-time/object new latency-time/object delta
cluster:rio dataset:wczblk1-8
fs1-zwrk.go·1 3.34µs ± 0% 3.33µs ± 0% ~ (p=0.222 n=5+5)
fs1-zwrk.go·2 3.65µs ± 0% 3.67µs ± 0% +0.53% (p=0.016 n=4+5)
fs1-zwrk.go·3 3.70µs ± 0% 3.70µs ± 0% ~ (p=0.421 n=5+5)
fs1-zwrk.go·4 3.72µs ± 0% 3.72µs ± 0% ~ (p=0.341 n=5+5)
fs1-zwrk.go·8 5.62µs ± 0% 5.62µs ± 0% ~ (p=0.889 n=5+5)
fs1-zwrk.go·12 7.77µs ± 0% 7.76µs ± 0% ~ (p=0.333 n=5+5)
fs1-zwrk.go·16 10.4µs ± 0% 10.3µs ± 0% ~ (p=0.151 n=5+5)
zeo/py/fs1-zwrk.go·1 132µs ± 0% 135µs ± 1% +1.91% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·2 218µs ± 1% 222µs ± 1% +1.62% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·3 308µs ± 1% 307µs ± 1% ~ (p=0.548 n=5+5)
zeo/py/fs1-zwrk.go·4 392µs ± 2% 398µs ± 3% ~ (p=0.095 n=5+5)
zeo/py/fs1-zwrk.go·8 754µs ± 2% 759µs ± 0% ~ (p=0.310 n=5+5)
zeo/py/fs1-zwrk.go·12 1.15ms ± 1% 1.13ms ± 1% ~ (p=0.222 n=5+5)
zeo/py/fs1-zwrk.go·16 1.51ms ± 1% 1.50ms ± 1% ~ (p=0.151 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 150µs ± 4% 147µs ± 2% ~ (p=0.310 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 235µs ± 1% 241µs ± 8% ~ (p=0.556 n=4+5)
neo/py(!log)/sqlite-zwrk.go·3 378µs ± 6% 349µs ± 1% -7.74% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 485µs ± 9% 465µs ± 1% -4.08% (p=0.016 n=5+4)
neo/py(!log)/sqlite-zwrk.go·8 950µs ± 2% 930µs ± 1% -2.15% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 1.42ms ± 1% 1.40ms ± 1% -1.18% (p=0.032 n=4+5)
neo/py(!log)/sqlite-zwrk.go·16 1.92ms ± 4% 1.88ms ± 3% ~ (p=0.310 n=5+5)
neo/py(!log)/sql-zwrk.go·1 178µs ± 1% 178µs ± 6% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·2 294µs ± 2% 297µs ± 4% ~ (p=0.548 n=5+5)
neo/py(!log)/sql-zwrk.go·3 449µs ± 2% 443µs ± 2% ~ (p=0.310 n=5+5)
neo/py(!log)/sql-zwrk.go·4 603µs ± 3% 616µs ± 8% ~ (p=0.690 n=5+5)
neo/py(!log)/sql-zwrk.go·8 1.19ms ± 2% 1.22ms ± 5% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·12 1.79ms ± 1% 1.75ms ± 1% -1.96% (p=0.016 n=5+4)
neo/py(!log)/sql-zwrk.go·16 2.36ms ± 2% 2.38ms ± 3% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·1 63.7µs ± 1% 64.4µs ± 0% +1.11% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·2 66.2µs ± 0% 66.8µs ± 1% +1.05% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·3 75.4µs ± 0% 76.1µs ± 0% +0.82% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·4 80.4µs ± 0% 81.0µs ± 0% +0.85% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·8 116µs ± 1% 117µs ± 0% +0.94% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·12 164µs ± 1% 165µs ± 0% +0.74% (p=0.016 n=5+5)
neo/go/fs1-zwrk.go·16 217µs ± 0% 219µs ± 0% +0.82% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 39.2µs ± 2% 38.2µs ± 1% -2.37% (p=0.016 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 41.8µs ± 0% 42.0µs ± 0% +0.60% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 50.2µs ± 0% 50.5µs ± 0% +0.64% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 55.0µs ± 0% 55.4µs ± 0% +0.76% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 82.5µs ± 0% 82.8µs ± 0% ~ (p=0.151 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 109µs ± 0% 110µs ± 0% +0.65% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 141µs ± 0% 142µs ± 1% ~ (p=0.056 n=5+5)
neo/go/sqlite-zwrk.go·1 102µs ± 1% 102µs ± 0% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go·2 110µs ± 0% 110µs ± 0% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go·3 118µs ± 0% 119µs ± 0% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go·4 132µs ± 0% 132µs ± 0% ~ (p=0.095 n=5+5)
neo/go/sqlite-zwrk.go·8 204µs ± 1% 203µs ± 0% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go·12 296µs ± 2% 294µs ± 2% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go·16 395µs ± 1% 395µs ± 2% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 90.2µs ± 1% 91.1µs ± 1% ~ (p=0.095 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 100µs ± 0% 100µs ± 0% +0.49% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 107µs ± 0% 108µs ± 0% ~ (p=0.056 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 117µs ± 1% 117µs ± 0% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 181µs ± 1% 182µs ± 1% ~ (p=0.310 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 278µs ± 1% 279µs ± 1% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 388µs ± 2% 388µs ± 2% ~ (p=1.000 n=5+5)
cluster:rio dataset:prod1-1024
fs1-zwrk.go·1 2.16µs ± 1% 2.15µs ± 1% ~ (p=0.079 n=5+5)
fs1-zwrk.go·2 2.27µs ± 7% 2.17µs ± 0% -4.29% (p=0.016 n=5+4)
fs1-zwrk.go·3 2.21µs ± 1% 2.20µs ± 1% ~ (p=0.056 n=5+5)
fs1-zwrk.go·4 2.23µs ± 1% 2.21µs ± 0% ~ (p=0.087 n=5+5)
fs1-zwrk.go·8 3.42µs ± 2% 3.37µs ± 1% ~ (p=0.151 n=5+5)
fs1-zwrk.go·12 4.99µs ± 0% 4.97µs ± 0% ~ (p=0.056 n=5+5)
fs1-zwrk.go·16 6.65µs ± 0% 6.61µs ± 0% -0.60% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·1 111µs ± 1% 111µs ± 1% ~ (p=0.841 n=5+5)
zeo/py/fs1-zwrk.go·2 169µs ± 1% 171µs ± 1% +1.12% (p=0.032 n=5+5)
zeo/py/fs1-zwrk.go·3 233µs ± 1% 233µs ± 2% ~ (p=0.690 n=5+5)
zeo/py/fs1-zwrk.go·4 298µs ± 3% 298µs ± 4% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·8 567µs ± 1% 572µs ± 2% ~ (p=0.421 n=5+5)
zeo/py/fs1-zwrk.go·12 835µs ± 2% 844µs ± 2% ~ (p=0.421 n=5+5)
zeo/py/fs1-zwrk.go·16 1.11ms ± 1% 1.12ms ± 3% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 139µs ± 2% 140µs ± 4% ~ (p=0.841 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 231µs ± 3% 229µs ± 1% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 348µs ± 1% 347µs ± 5% ~ (p=0.222 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 462µs ± 1% 470µs ± 7% ~ (p=0.841 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 945µs ± 6% 929µs ± 3% ~ (p=0.310 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 1.42ms ± 5% 1.39ms ± 0% ~ (p=0.286 n=5+4)
neo/py(!log)/sqlite-zwrk.go·16 1.91ms ± 3% 1.85ms ± 1% -3.07% (p=0.032 n=5+5)
neo/py(!log)/sql-zwrk.go·1 169µs ± 3% 170µs ± 1% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·2 292µs ± 3% 294µs ± 2% ~ (p=0.690 n=5+5)
neo/py(!log)/sql-zwrk.go·3 434µs ± 4% 456µs ± 4% +4.99% (p=0.016 n=5+5)
neo/py(!log)/sql-zwrk.go·4 585µs ± 2% 599µs ± 4% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·8 1.15ms ± 1% 1.17ms ± 1% +2.21% (p=0.016 n=5+5)
neo/py(!log)/sql-zwrk.go·12 1.76ms ± 7% 1.80ms ± 4% ~ (p=0.095 n=5+5)
neo/py(!log)/sql-zwrk.go·16 2.31ms ± 4% 2.41ms ± 5% ~ (p=0.056 n=5+5)
neo/go/fs1-zwrk.go·1 45.8µs ± 0% 45.9µs ± 1% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·2 50.7µs ± 1% 51.0µs ± 1% ~ (p=0.056 n=5+5)
neo/go/fs1-zwrk.go·3 58.1µs ± 0% 58.3µs ± 0% +0.37% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·4 63.6µs ± 0% 63.7µs ± 0% ~ (p=0.222 n=5+5)
neo/go/fs1-zwrk.go·8 100µs ± 1% 99µs ± 1% ~ (p=0.548 n=5+5)
neo/go/fs1-zwrk.go·12 151µs ± 2% 150µs ± 2% ~ (p=0.690 n=5+5)
neo/go/fs1-zwrk.go·16 205µs ± 4% 204µs ± 3% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 37.7µs ± 2% 37.7µs ± 1% ~ (p=0.841 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 40.6µs ± 0% 41.0µs ± 0% +0.91% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 48.1µs ± 0% 48.5µs ± 0% +0.98% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 53.7µs ± 0% 54.0µs ± 0% +0.63% (p=0.016 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 86.7µs ± 2% 87.6µs ± 0% ~ (p=0.190 n=5+4)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 128µs ± 4% 129µs ± 2% ~ (p=0.548 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 177µs ± 5% 178µs ± 2% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go·1 91.3µs ± 0% 90.7µs ± 1% -0.63% (p=0.016 n=5+5)
neo/go/sqlite-zwrk.go·2 103µs ± 0% 103µs ± 1% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go·3 113µs ± 0% 113µs ± 0% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go·4 126µs ± 1% 125µs ± 0% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go·8 214µs ± 1% 214µs ± 2% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go·12 330µs ± 5% 341µs ± 3% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go·16 438µs ± 3% 462µs ± 2% +5.47% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 87.2µs ± 1% 86.7µs ± 1% ~ (p=0.310 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 99.3µs ± 1% 99.7µs ± 0% ~ (p=0.548 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 107µs ± 0% 109µs ± 0% +1.45% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 118µs ± 0% 120µs ± 0% +1.77% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 199µs ± 1% 206µs ± 2% +3.47% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 315µs ± 1% 330µs ± 1% +4.73% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 434µs ± 1% 455µs ± 2% +4.69% (p=0.008 n=5+5)

31dc070d

X z6001: localhost timings, Cenabled · 850bfb9d

Kirill Smelkov authored Mar 06, 2018

Compared to yesterday shows relatively no significant change, though
some benchmarks, like on neo1, are itself noisy.

disk/randread/direct/4K-avg changes by 55%, probably showing we should
be taking into account mdev(=std) ioping gives us, not only averaging
the average it prints.

$ benchstat -split node,cluster,dataset 20180305-z6001-ffixed-c.txt 20180306-z6001-ffixed-c.txt

name old pystone/s new pystone/s delta
node:z6001
pystone 112k ± 8% 109k ± 9% ~ (p=0.548 n=5+5)

name old time/op new time/op delta
node:z6001
crc32/py/4K 5.11µs ± 2% 5.11µs ± 1% ~ (p=0.452 n=5+5)
crc32/go/4K 1.72µs ± 0% 1.72µs ± 0% ~ (p=1.000 n=4+4)
sha1/py/4K 17.1µs ±31% 14.7µs ± 1% ~ (p=0.056 n=5+5)
sha1/go/4K 10.6µs ± 5% 10.3µs ± 0% ~ (p=1.000 n=5+5)
unzlib/py/wczdata 36.4µs ± 1% 37.1µs ± 8% ~ (p=1.000 n=5+5)
unzlib/go/wczdata 31.5µs ± 0% 31.5µs ± 0% ~ (p=0.151 n=5+5)
unzlib/py/prod1-avg 18.5µs ± 2% 18.5µs ± 3% ~ (p=0.841 n=5+5)
unzlib/go/prod1-avg 10.0µs ± 0% 10.0µs ± 1% ~ (p=0.151 n=5+5)
disk/randread/direct/4K-min 125µs ± 1% 126µs ± 1% +0.92% (p=0.048 n=5+4)
disk/randread/direct/4K-avg 128µs ± 0% 199µs ± 9% +55.41% (p=0.016 n=4+5)
disk/randread/pagecache/4K-min 801ns ± 4% 806ns ± 3% ~ (p=0.452 n=5+5)
disk/randread/pagecache/4K-avg 1.39µs ±12% 1.44µs ± 7% ~ (p=0.643 n=5+5)

name old time/object new time/object delta
cluster:z6001 dataset:wczblk1-8
fs1-zhash.py 37.4µs ± 2% 37.6µs ± 2% ~ (p=0.579 n=5+5)
fs1-zhash.go 5.94µs ± 1% 6.00µs ± 2% ~ (p=0.365 n=5+5)
fs1-zhash.go+prefetch128 8.06µs ± 7% 8.00µs ± 5% ~ (p=1.000 n=5+5)
zeo/py/fs1-zhash.py 657µs ±14% 650µs ± 7% ~ (p=0.548 n=5+5)
zeo/py/fs1-zhash.go 273µs ± 4% 274µs ±13% ~ (p=0.889 n=5+5)
zeo/py/fs1-zhash.go+prefetch128 101µs ± 2% 101µs ± 2% ~ (p=0.968 n=5+5)
neo/py(!log)/sqlite-zhash.py 694µs ± 1% 696µs ± 1% ~ (p=0.841 n=5+5)
neo/py(!log)/sqlite-zhash.go 326µs ±20% 338µs ± 7% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zhash.go+prefetch128 174µs ± 2% 177µs ± 1% ~ (p=0.063 n=5+5)
neo/py(!log)/sql-zhash.py 934µs ± 3% 1000µs ±38% ~ (p=0.730 n=4+5)
neo/py(!log)/sql-zhash.go 422µs ±11% 434µs ± 6% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zhash.go+prefetch128 274µs ±10% 277µs ± 9% ~ (p=1.000 n=5+5)
neo/go/fs1-zhash.py 527µs ±13% 526µs ± 8% ~ (p=0.841 n=5+5)
neo/go/fs1-zhash.go 103µs ± 6% 102µs ± 8% ~ (p=1.000 n=5+5)
neo/go/fs1-zhash.go+prefetch128 35.7µs ± 3% 36.6µs ± 4% ~ (p=0.175 n=5+5)
neo/go/fs1(!sha1)-zhash.go(!sha1) 73.8µs ± 5% 76.4µs ± 5% ~ (p=0.151 n=5+5)
neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 27.2µs ± 6% 26.5µs ± 2% ~ (p=0.310 n=5+5)
neo/go/sqlite-zhash.py 553µs ±14% 528µs ±15% ~ (p=0.421 n=5+5)
neo/go/sqlite-zhash.go 222µs ±17% 204µs ±22% ~ (p=0.421 n=5+5)
neo/go/sqlite-zhash.go+prefetch128 39.6µs ± 4% 39.9µs ± 4% ~ (p=0.841 n=5+5)
neo/go/sqlite-zhash.go(!sha1) 188µs ±14% 194µs ± 9% ~ (p=0.690 n=5+5)
neo/go/sqlite-zhash.go+prefetch128(!sha1) 37.4µs ± 4% 38.2µs ± 7% ~ (p=0.278 n=5+5)
cluster:z6001 dataset:prod1-1024
fs1-zhash.py 30.3µs ± 3% 30.3µs ± 1% ~ (p=0.444 n=5+5)
fs1-zhash.go 4.60µs ± 0% 4.62µs ± 3% ~ (p=0.556 n=4+5)
fs1-zhash.go+prefetch128 5.90µs ± 5% 5.76µs ± 8% ~ (p=0.476 n=5+5)
zeo/py/fs1-zhash.py 617µs ± 9% 632µs ±15% ~ (p=0.841 n=5+5)
zeo/py/fs1-zhash.go 228µs ± 4% 235µs ± 7% ~ (p=0.389 n=5+5)
zeo/py/fs1-zhash.go+prefetch128 87.9µs ± 1% 87.2µs ± 1% ~ (p=0.206 n=5+5)
neo/py(!log)/sqlite-zhash.py 665µs ± 3% 664µs ± 2% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zhash.go 285µs ± 4% 269µs ± 7% ~ (p=0.095 n=5+5)
neo/py(!log)/sqlite-zhash.go+prefetch128 163µs ± 0% 162µs ± 0% -0.52% (p=0.029 n=4+4)
neo/py(!log)/sql-zhash.py 970µs ±41% 1029µs ±29% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zhash.go 386µs ±11% 406µs ± 2% ~ (p=0.548 n=5+5)
neo/py(!log)/sql-zhash.go+prefetch128 261µs ± 3% 268µs ± 5% ~ (p=0.310 n=5+5)
neo/go/fs1-zhash.py 515µs ±16% 520µs ± 9% ~ (p=1.000 n=5+5)
neo/go/fs1-zhash.go 82.5µs ± 7% 83.2µs ± 7% ~ (p=0.690 n=5+5)
neo/go/fs1-zhash.go+prefetch128 24.2µs ± 3% 24.0µs ± 5% ~ (p=0.452 n=5+5)
neo/go/fs1(!sha1)-zhash.go(!sha1) 70.4µs ± 2% 67.0µs ± 3% -4.80% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 20.9µs ± 2% 21.2µs ± 4% ~ (p=0.579 n=5+5)
neo/go/sqlite-zhash.py 527µs ± 9% 539µs ±11% ~ (p=0.587 n=5+5)
neo/go/sqlite-zhash.go 190µs ±23% 196µs ± 9% ~ (p=0.310 n=5+5)
neo/go/sqlite-zhash.go+prefetch128 34.7µs ± 2% 35.0µs ± 3% ~ (p=0.421 n=5+5)
neo/go/sqlite-zhash.go(!sha1) 159µs ±21% 168µs ± 8% ~ (p=0.310 n=5+5)
neo/go/sqlite-zhash.go+prefetch128(!sha1) 35.4µs ± 1% 35.1µs ± 4% ~ (p=0.556 n=5+5)

name old req/s new req/s delta
cluster:z6001 dataset:wczblk1-8
fs1-zwrk.go·1 231k ± 0% 230k ± 1% ~ (p=0.056 n=5+5)
fs1-zwrk.go·2 444k ± 2% 437k ± 5% ~ (p=0.548 n=5+5)
fs1-zwrk.go·3 667k ± 2% 663k ± 4% ~ (p=0.690 n=5+5)
fs1-zwrk.go·4 877k ± 0% 880k ± 1% ~ (p=0.286 n=4+5)
fs1-zwrk.go·8 1.74M ± 2% 1.75M ± 2% ~ (p=0.421 n=5+5)
fs1-zwrk.go·12 2.52M ± 3% 2.56M ± 0% ~ (p=0.190 n=5+4)
fs1-zwrk.go·16 2.88M ± 0% 2.89M ± 1% ~ (p=0.151 n=5+5)
zeo/py/fs1-zwrk.go·1 4.42k ± 5% 4.30k ± 8% ~ (p=0.548 n=5+5)
zeo/py/fs1-zwrk.go·2 6.33k ± 0% 6.33k ± 0% ~ (p=0.905 n=5+4)
zeo/py/fs1-zwrk.go·3 6.91k ± 0% 6.90k ± 0% ~ (p=0.730 n=5+4)
zeo/py/fs1-zwrk.go·4 7.12k ± 0% 7.14k ± 1% ~ (p=0.343 n=4+4)
zeo/py/fs1-zwrk.go·8 7.52k ± 1% 7.53k ± 2% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·12 7.55k ± 2% 7.65k ± 0% ~ (p=0.111 n=5+4)
zeo/py/fs1-zwrk.go·16 7.67k ± 2% 7.57k ± 0% ~ (p=0.151 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 3.41k ±12% 3.50k ±15% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 5.63k ± 0% 5.58k ± 0% -0.85% (p=0.016 n=5+4)
neo/py(!log)/sqlite-zwrk.go·3 5.54k ± 5% 5.63k ± 2% ~ (p=0.548 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 5.54k ± 1% 5.56k ± 1% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 5.74k ± 1% 5.61k ± 2% -2.19% (p=0.032 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 5.67k ± 1% 5.62k ± 1% ~ (p=0.151 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 5.64k ± 2% 5.62k ± 1% ~ (p=0.556 n=5+4)
neo/py(!log)/sql-zwrk.go·1 2.64k ± 8% 2.53k ±17% ~ (p=0.690 n=5+5)
neo/py(!log)/sql-zwrk.go·2 3.63k ± 9% 3.57k ± 9% ~ (p=0.690 n=5+5)
neo/py(!log)/sql-zwrk.go·3 3.91k ± 7% 3.65k ±14% ~ (p=0.151 n=5+5)
neo/py(!log)/sql-zwrk.go·4 3.73k ± 9% 3.56k ±16% ~ (p=0.310 n=5+5)
neo/py(!log)/sql-zwrk.go·8 3.79k ± 5% 3.78k ±12% ~ (p=0.690 n=5+5)
neo/py(!log)/sql-zwrk.go·12 3.65k ±11% 3.73k ±13% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zwrk.go·16 3.69k ±14% 3.47k ± 9% ~ (p=0.421 n=5+5)
neo/go/fs1-zwrk.go·1 10.8k ± 6% 10.7k ± 5% ~ (p=0.690 n=5+5)
neo/go/fs1-zwrk.go·2 22.5k ± 2% 22.3k ± 1% ~ (p=0.421 n=5+5)
neo/go/fs1-zwrk.go·3 31.8k ± 1% 31.7k ± 1% ~ (p=0.548 n=5+5)
neo/go/fs1-zwrk.go·4 43.3k ± 0% 43.2k ± 1% ~ (p=0.548 n=5+5)
neo/go/fs1-zwrk.go·8 78.1k ± 0% 78.3k ± 0% ~ (p=0.151 n=5+5)
neo/go/fs1-zwrk.go·12 92.5k ± 0% 92.5k ± 0% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·16 102k ± 1% 103k ± 1% ~ (p=0.548 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 15.3k ± 5% 15.0k ± 5% ~ (p=0.548 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 31.5k ± 1% 31.5k ± 1% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 43.8k ± 0% 43.8k ± 0% ~ (p=0.841 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 57.6k ± 0% 57.4k ± 0% ~ (p=0.310 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 100k ± 0% 100k ± 0% ~ (p=0.310 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 116k ± 0% 116k ± 0% ~ (p=0.222 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 126k ± 0% 126k ± 1% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go·1 5.05k ±10% 4.85k ±15% ~ (p=0.548 n=5+5)
neo/go/sqlite-zwrk.go·2 11.8k ± 2% 12.0k ± 2% +2.47% (p=0.032 n=5+5)
neo/go/sqlite-zwrk.go·3 19.0k ± 0% 19.0k ± 1% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go·4 24.6k ± 1% 24.7k ± 0% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go·8 44.5k ± 1% 44.8k ± 0% ~ (p=0.056 n=5+5)
neo/go/sqlite-zwrk.go·12 56.3k ± 1% 56.3k ± 0% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go·16 58.4k ± 0% 58.0k ± 0% -0.72% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 5.62k ± 7% 5.41k ± 4% ~ (p=0.222 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 13.1k ± 3% 12.8k ± 1% ~ (p=0.056 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 20.4k ± 1% 20.2k ± 1% -1.15% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 27.1k ± 1% 26.8k ± 1% ~ (p=0.095 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 48.4k ± 1% 48.1k ± 1% ~ (p=0.222 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 60.2k ± 0% 60.3k ± 0% ~ (p=0.095 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 61.6k ± 1% 61.7k ± 1% ~ (p=0.548 n=5+5)
cluster:z6001 dataset:prod1-1024
fs1-zwrk.go·1 342k ± 4% 347k ± 2% ~ (p=0.310 n=5+5)
fs1-zwrk.go·2 657k ± 6% 660k ± 3% ~ (p=0.841 n=5+5)
fs1-zwrk.go·3 985k ± 4% 985k ± 4% ~ (p=0.841 n=5+5)
fs1-zwrk.go·4 1.29M ± 2% 1.31M ± 2% ~ (p=0.222 n=5+5)
fs1-zwrk.go·8 2.57M ± 1% 2.55M ± 4% ~ (p=0.690 n=5+5)
fs1-zwrk.go·12 2.81M ± 2% 2.81M ± 1% ~ (p=1.000 n=5+5)
fs1-zwrk.go·16 2.85M ± 1% 2.85M ± 2% ~ (p=0.841 n=5+5)
zeo/py/fs1-zwrk.go·1 5.07k ± 5% 4.80k ± 5% ~ (p=0.056 n=5+5)
zeo/py/fs1-zwrk.go·2 8.17k ± 2% 8.18k ± 1% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·3 8.84k ± 5% 8.96k ± 1% ~ (p=0.421 n=5+5)
zeo/py/fs1-zwrk.go·4 9.19k ± 1% 8.88k ± 9% ~ (p=0.690 n=5+5)
zeo/py/fs1-zwrk.go·8 9.82k ± 1% 9.96k ± 2% ~ (p=0.111 n=5+4)
zeo/py/fs1-zwrk.go·12 9.67k ± 6% 9.80k ± 6% ~ (p=0.222 n=5+5)
zeo/py/fs1-zwrk.go·16 10.0k ± 9% 10.1k ± 6% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 3.69k ± 9% 3.70k ± 6% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 5.76k ± 0% 5.77k ± 0% ~ (p=0.343 n=4+4)
neo/py(!log)/sqlite-zwrk.go·3 5.44k ±11% 5.77k ± 0% +6.20% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 5.81k ± 1% 5.77k ± 0% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 5.85k ± 0% 5.84k ± 1% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 5.67k ± 3% 5.78k ± 2% +1.96% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 5.84k ± 0% 5.80k ± 1% ~ (p=0.730 n=4+5)
neo/py(!log)/sql-zwrk.go·1 2.63k ± 6% 2.51k ±12% ~ (p=0.310 n=5+5)
neo/py(!log)/sql-zwrk.go·2 3.83k ±11% 3.62k ± 8% ~ (p=0.222 n=5+5)
neo/py(!log)/sql-zwrk.go·3 3.64k ±13% 3.86k ±11% ~ (p=0.310 n=5+5)
neo/py(!log)/sql-zwrk.go·4 3.73k ±14% 3.82k ±11% ~ (p=0.548 n=5+5)
neo/py(!log)/sql-zwrk.go·8 4.12k ± 6% 3.89k ±10% ~ (p=0.222 n=5+5)
neo/py(!log)/sql-zwrk.go·12 3.89k ± 9% 3.98k ± 7% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zwrk.go·16 3.60k ± 9% 3.72k ±13% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·1 13.4k ± 3% 13.8k ± 3% ~ (p=0.222 n=5+5)
neo/go/fs1-zwrk.go·2 28.0k ± 1% 28.1k ± 0% ~ (p=0.548 n=5+5)
neo/go/fs1-zwrk.go·3 40.0k ± 0% 40.2k ± 0% +0.61% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·4 52.8k ± 0% 52.8k ± 1% ~ (p=1.000 n=5+5)
neo/go/fs1-zwrk.go·8 90.7k ± 0% 90.6k ± 0% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·12 96.4k ± 1% 95.8k ± 1% ~ (p=0.151 n=5+5)
neo/go/fs1-zwrk.go·16 91.2k ± 2% 90.9k ± 1% ~ (p=0.690 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 15.9k ± 2% 16.2k ± 2% +2.23% (p=0.032 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 33.0k ± 0% 32.9k ± 1% ~ (p=0.421 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 46.3k ± 0% 46.2k ± 0% ~ (p=0.548 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 59.9k ± 0% 59.8k ± 1% ~ (p=0.690 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 98.7k ± 1% 98.1k ± 0% ~ (p=0.151 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 103k ± 1% 102k ± 1% ~ (p=0.310 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 96.5k ± 3% 97.0k ± 2% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go·1 5.66k ±15% 5.67k ± 8% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go·2 13.3k ± 2% 13.3k ± 2% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go·3 20.4k ± 0% 20.3k ± 1% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go·4 26.6k ± 1% 26.5k ± 0% ~ (p=0.222 n=5+5)
neo/go/sqlite-zwrk.go·8 44.5k ± 0% 44.5k ± 1% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go·12 52.2k ± 1% 52.3k ± 1% ~ (p=0.548 n=5+5)
neo/go/sqlite-zwrk.go·16 48.8k ± 1% 48.9k ± 1% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 5.74k ± 8% 5.69k ± 4% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 13.3k ± 2% 13.2k ± 3% ~ (p=0.548 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 20.5k ± 1% 20.5k ± 1% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 27.0k ± 1% 27.1k ± 2% ~ (p=0.310 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 44.8k ± 2% 45.4k ± 1% ~ (p=0.095 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 53.1k ± 1% 53.3k ± 1% ~ (p=0.222 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 49.8k ± 2% 49.8k ± 1% ~ (p=1.000 n=5+5)

name old latency-time/object new latency-time/object delta
cluster:z6001 dataset:wczblk1-8
fs1-zwrk.go·1 4.32µs ± 0% 4.34µs ± 1% +0.47% (p=0.040 n=5+5)
fs1-zwrk.go·2 4.51µs ± 2% 4.58µs ± 5% ~ (p=0.548 n=5+5)
fs1-zwrk.go·3 4.50µs ± 2% 4.52µs ± 4% ~ (p=0.635 n=5+5)
fs1-zwrk.go·4 4.56µs ± 0% 4.55µs ± 1% ~ (p=0.381 n=4+5)
fs1-zwrk.go·8 4.60µs ± 2% 4.58µs ± 2% ~ (p=0.421 n=5+5)
fs1-zwrk.go·12 4.77µs ± 3% 4.69µs ± 0% ~ (p=0.190 n=5+4)
fs1-zwrk.go·16 5.56µs ± 0% 5.53µs ± 1% ~ (p=0.151 n=5+5)
zeo/py/fs1-zwrk.go·1 227µs ± 5% 233µs ± 8% ~ (p=0.548 n=5+5)
zeo/py/fs1-zwrk.go·2 316µs ± 0% 315µs ± 2% ~ (p=0.841 n=5+5)
zeo/py/fs1-zwrk.go·3 434µs ± 0% 435µs ± 0% ~ (p=0.730 n=5+4)
zeo/py/fs1-zwrk.go·4 562µs ± 0% 560µs ± 1% ~ (p=0.343 n=4+4)
zeo/py/fs1-zwrk.go·8 1.06ms ± 1% 1.06ms ± 2% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·12 1.59ms ± 2% 1.57ms ± 0% ~ (p=0.111 n=5+4)
zeo/py/fs1-zwrk.go·16 2.09ms ± 2% 2.11ms ± 0% ~ (p=0.151 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 295µs ±11% 288µs ±14% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 355µs ± 0% 358µs ± 0% +0.86% (p=0.016 n=5+4)
neo/py(!log)/sqlite-zwrk.go·3 542µs ± 5% 533µs ± 2% ~ (p=0.548 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 722µs ± 1% 720µs ± 1% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 1.39ms ± 1% 1.43ms ± 2% +2.25% (p=0.032 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 2.11ms ± 1% 2.14ms ± 1% ~ (p=0.151 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 2.84ms ± 2% 2.85ms ± 1% ~ (p=0.556 n=5+4)
neo/py(!log)/sql-zwrk.go·1 380µs ± 8% 400µs ±16% ~ (p=0.690 n=5+5)
neo/py(!log)/sql-zwrk.go·2 553µs ± 9% 562µs ± 8% ~ (p=0.690 n=5+5)
neo/py(!log)/sql-zwrk.go·3 769µs ± 7% 827µs ±13% ~ (p=0.151 n=5+5)
neo/py(!log)/sql-zwrk.go·4 1.08ms ± 9% 1.13ms ±14% ~ (p=0.310 n=5+5)
neo/py(!log)/sql-zwrk.go·8 2.11ms ± 5% 2.13ms ±13% ~ (p=0.690 n=5+5)
neo/py(!log)/sql-zwrk.go·12 3.31ms ±12% 3.24ms ±12% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zwrk.go·16 4.37ms ±15% 4.62ms ± 8% ~ (p=0.421 n=5+5)
neo/go/fs1-zwrk.go·1 92.9µs ± 6% 93.9µs ± 4% ~ (p=0.690 n=5+5)
neo/go/fs1-zwrk.go·2 88.7µs ± 2% 89.6µs ± 1% ~ (p=0.421 n=5+5)
neo/go/fs1-zwrk.go·3 94.4µs ± 1% 94.6µs ± 1% ~ (p=0.548 n=5+5)
neo/go/fs1-zwrk.go·4 92.5µs ± 0% 92.6µs ± 1% ~ (p=0.548 n=5+5)
neo/go/fs1-zwrk.go·8 102µs ± 0% 102µs ± 0% ~ (p=0.151 n=5+5)
neo/go/fs1-zwrk.go·12 130µs ± 0% 130µs ± 0% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·16 157µs ± 1% 156µs ± 1% ~ (p=0.548 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 65.6µs ± 5% 66.8µs ± 5% ~ (p=0.548 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 63.4µs ± 1% 63.5µs ± 1% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 68.4µs ± 0% 68.5µs ± 0% ~ (p=0.841 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 69.5µs ± 0% 69.7µs ± 0% ~ (p=0.310 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 79.9µs ± 0% 79.7µs ± 0% ~ (p=0.310 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 103µs ± 0% 103µs ± 0% ~ (p=0.222 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 127µs ± 0% 127µs ± 1% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go·1 198µs ± 9% 208µs ±14% ~ (p=0.548 n=5+5)
neo/go/sqlite-zwrk.go·2 170µs ± 2% 166µs ± 2% -2.41% (p=0.032 n=5+5)
neo/go/sqlite-zwrk.go·3 157µs ± 0% 158µs ± 1% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go·4 162µs ± 1% 162µs ± 0% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go·8 180µs ± 1% 178µs ± 0% ~ (p=0.056 n=5+5)
neo/go/sqlite-zwrk.go·12 213µs ± 1% 213µs ± 0% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go·16 274µs ± 0% 276µs ± 0% +0.72% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 178µs ± 7% 185µs ± 4% ~ (p=0.222 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 152µs ± 3% 156µs ± 1% ~ (p=0.056 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 147µs ± 1% 149µs ± 1% +1.17% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 148µs ± 1% 149µs ± 1% ~ (p=0.095 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 165µs ± 1% 166µs ± 1% ~ (p=0.222 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 199µs ± 0% 199µs ± 0% ~ (p=0.095 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 260µs ± 1% 259µs ± 1% ~ (p=0.548 n=5+5)
cluster:z6001 dataset:prod1-1024
fs1-zwrk.go·1 2.93µs ± 4% 2.88µs ± 2% ~ (p=0.310 n=5+5)
fs1-zwrk.go·2 3.05µs ± 6% 3.03µs ± 3% ~ (p=0.841 n=5+5)
fs1-zwrk.go·3 3.05µs ± 5% 3.05µs ± 4% ~ (p=0.841 n=5+5)
fs1-zwrk.go·4 3.10µs ± 2% 3.05µs ± 2% ~ (p=0.222 n=5+5)
fs1-zwrk.go·8 3.11µs ± 1% 3.14µs ± 4% ~ (p=0.690 n=5+5)
fs1-zwrk.go·12 4.27µs ± 2% 4.28µs ± 1% ~ (p=1.000 n=5+5)
fs1-zwrk.go·16 5.62µs ± 1% 5.63µs ± 2% ~ (p=0.841 n=5+5)
zeo/py/fs1-zwrk.go·1 198µs ± 6% 208µs ± 5% ~ (p=0.056 n=5+5)
zeo/py/fs1-zwrk.go·2 245µs ± 2% 245µs ± 1% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·3 340µs ± 5% 335µs ± 1% ~ (p=0.421 n=5+5)
zeo/py/fs1-zwrk.go·4 435µs ± 1% 453µs ±10% ~ (p=0.690 n=5+5)
zeo/py/fs1-zwrk.go·8 814µs ± 1% 803µs ± 2% ~ (p=0.111 n=5+4)
zeo/py/fs1-zwrk.go·12 1.24ms ± 7% 1.23ms ± 6% ~ (p=0.222 n=5+5)
zeo/py/fs1-zwrk.go·16 1.61ms ±10% 1.59ms ± 6% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 272µs ± 8% 271µs ± 7% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 347µs ± 0% 346µs ± 0% ~ (p=0.343 n=4+4)
neo/py(!log)/sqlite-zwrk.go·3 555µs ±12% 520µs ± 0% -6.28% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 688µs ± 1% 694µs ± 0% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 1.37ms ± 0% 1.37ms ± 1% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 2.12ms ± 3% 2.07ms ± 2% -1.93% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 2.74ms ± 0% 2.76ms ± 1% ~ (p=0.730 n=4+5)
neo/py(!log)/sql-zwrk.go·1 380µs ± 6% 400µs ±11% ~ (p=0.310 n=5+5)
neo/py(!log)/sql-zwrk.go·2 524µs ±10% 554µs ± 7% ~ (p=0.222 n=5+5)
neo/py(!log)/sql-zwrk.go·3 832µs ±12% 783µs ±11% ~ (p=0.310 n=5+5)
neo/py(!log)/sql-zwrk.go·4 1.08ms ±13% 1.06ms ±11% ~ (p=0.548 n=5+5)
neo/py(!log)/sql-zwrk.go·8 1.95ms ± 7% 2.07ms ± 9% ~ (p=0.222 n=5+5)
neo/py(!log)/sql-zwrk.go·12 3.09ms ±10% 3.02ms ± 7% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zwrk.go·16 4.45ms ± 8% 4.32ms ±12% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·1 74.5µs ± 3% 72.6µs ± 3% ~ (p=0.222 n=5+5)
neo/go/fs1-zwrk.go·2 71.4µs ± 1% 71.2µs ± 0% ~ (p=0.548 n=5+5)
neo/go/fs1-zwrk.go·3 75.0µs ± 0% 74.6µs ± 0% -0.61% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·4 75.8µs ± 0% 75.7µs ± 1% ~ (p=1.000 n=5+5)
neo/go/fs1-zwrk.go·8 88.2µs ± 0% 88.3µs ± 0% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·12 124µs ± 1% 125µs ± 1% ~ (p=0.151 n=5+5)
neo/go/fs1-zwrk.go·16 175µs ± 2% 176µs ± 1% ~ (p=0.690 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 63.1µs ± 2% 61.7µs ± 2% -2.19% (p=0.032 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 60.6µs ± 0% 60.7µs ± 1% ~ (p=0.421 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 64.8µs ± 0% 64.9µs ± 0% ~ (p=0.548 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 66.7µs ± 0% 66.9µs ± 1% ~ (p=0.690 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 81.1µs ± 1% 81.5µs ± 0% ~ (p=0.151 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 117µs ± 1% 118µs ± 1% ~ (p=0.310 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 166µs ± 3% 165µs ± 2% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go·1 178µs ±14% 177µs ± 8% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go·2 150µs ± 2% 151µs ± 2% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go·3 147µs ± 0% 148µs ± 1% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go·4 151µs ± 1% 151µs ± 0% ~ (p=0.222 n=5+5)
neo/go/sqlite-zwrk.go·8 180µs ± 0% 180µs ± 1% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go·12 230µs ± 1% 229µs ± 1% ~ (p=0.548 n=5+5)
neo/go/sqlite-zwrk.go·16 328µs ± 1% 327µs ± 1% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 175µs ± 8% 176µs ± 4% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 150µs ± 2% 152µs ± 3% ~ (p=0.548 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 147µs ± 1% 147µs ± 1% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 148µs ± 1% 148µs ± 2% ~ (p=0.310 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 179µs ± 2% 176µs ± 1% ~ (p=0.095 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 226µs ± 1% 225µs ± 1% ~ (p=0.222 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 322µs ± 2% 321µs ± 1% ~ (p=1.000 n=5+5)

850bfb9d

X neo1: localhost timings, Cenabled · 9644774a

Kirill Smelkov authored Mar 06, 2018

Compared to yesterday shows relatively no significant change, though
some benchmarks, usually related to sql are itself noisy.

$ benchstat -split node,cluster,dataset 20180305-neo1-ffixed-c.txt 20180306-neo1-ffixed-c.txt

name old pystone/s new pystone/s delta
node:neo1
pystone 106k ± 1% 106k ± 1% ~ (p=0.690 n=5+5)

name old time/op new time/op delta
node:neo1
crc32/py/4K 5.13µs ± 1% 5.13µs ± 1% ~ (p=0.548 n=5+5)
crc32/go/4K 2.79µs ± 0% 2.79µs ± 0% ~ (p=0.238 n=5+5)
sha1/py/4K 13.5µs ± 1% 13.4µs ± 1% ~ (p=0.548 n=5+5)
sha1/go/4K 9.83µs ± 0% 9.83µs ± 0% ~ (p=0.746 n=5+5)
unzlib/py/wczdata 36.2µs ± 1% 36.1µs ± 0% ~ (p=0.421 n=5+5)
unzlib/go/wczdata 31.2µs ± 1% 31.1µs ± 1% ~ (p=0.548 n=5+5)
unzlib/py/prod1-avg 16.4µs ± 2% 16.3µs ± 2% ~ (p=0.690 n=5+5)
unzlib/go/prod1-avg 9.42µs ± 0% 9.42µs ± 0% ~ (p=0.786 n=5+5)
disk/randread/direct/4K-min 161µs ± 0% 162µs ± 0% +0.37% (p=0.008 n=5+5)
disk/randread/direct/4K-avg 187µs ± 1% 187µs ± 2% ~ (p=0.381 n=5+5)
disk/randread/pagecache/4K-min 390ns ± 1% 389ns ± 1% ~ (p=0.317 n=5+5)
disk/randread/pagecache/4K-avg 801ns ± 0% 804ns ± 0% +0.34% (p=0.048 n=5+4)

name old time/object new time/object delta
cluster:neo1 dataset:wczblk1-8
fs1-zhash.py 34.9µs ± 1% 34.7µs ± 2% ~ (p=0.651 n=5+5)
fs1-zhash.go 5.96µs ± 1% 6.00µs ± 2% ~ (p=0.683 n=5+5)
fs1-zhash.go+prefetch128 6.64µs ± 2% 6.52µs ± 4% ~ (p=0.317 n=5+5)
zeo/py/fs1-zhash.py 517µs ± 2% 523µs ± 1% ~ (p=0.222 n=5+5)
zeo/py/fs1-zhash.go 200µs ± 3% 194µs ± 4% ~ (p=0.310 n=5+5)
zeo/py/fs1-zhash.go+prefetch128 99.3µs ± 4% 98.6µs ± 3% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zhash.py 668µs ±18% 684µs ± 3% ~ (p=0.841 n=5+5)
neo/py(!log)/sqlite-zhash.go 242µs ± 1% 236µs ± 2% -2.46% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zhash.go+prefetch128 166µs ± 1% 162µs ± 2% -2.30% (p=0.008 n=5+5)
neo/py(!log)/sql-zhash.py 933µs ±54% 942µs ±47% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zhash.go 317µs ± 8% 300µs ±17% ~ (p=0.690 n=5+5)
neo/py(!log)/sql-zhash.go+prefetch128 245µs ± 7% 240µs ± 6% ~ (p=0.548 n=5+5)
neo/go/fs1-zhash.py 382µs ±22% 383µs ±20% ~ (p=1.000 n=5+5)
neo/go/fs1-zhash.go 81.3µs ± 3% 81.3µs ± 1% ~ (p=0.532 n=5+5)
neo/go/fs1-zhash.go+prefetch128 33.9µs ± 4% 33.8µs ± 5% ~ (p=0.952 n=5+5)
neo/go/fs1(!sha1)-zhash.go(!sha1) 57.4µs ± 3% 57.6µs ± 3% ~ (p=0.746 n=5+5)
neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 23.2µs ± 4% 22.9µs ± 6% ~ (p=0.500 n=5+5)
neo/go/sqlite-zhash.py 410µs ± 3% 402µs ± 6% ~ (p=1.000 n=5+5)
neo/go/sqlite-zhash.go 125µs ± 1% 125µs ± 1% ~ (p=0.333 n=5+5)
neo/go/sqlite-zhash.go+prefetch128 47.4µs ± 3% 48.4µs ± 8% ~ (p=0.690 n=5+5)
neo/go/sqlite-zhash.go(!sha1) 114µs ± 2% 116µs ± 2% ~ (p=0.151 n=5+5)
neo/go/sqlite-zhash.go+prefetch128(!sha1) 47.0µs ±13% 45.9µs ± 5% ~ (p=1.000 n=5+5)
cluster:neo1 dataset:prod1-1024
fs1-zhash.py 29.0µs ± 1% 28.9µs ± 1% ~ (p=0.341 n=5+5)
fs1-zhash.go 3.76µs ± 2% 3.76µs ± 4% ~ (p=1.000 n=5+5)
fs1-zhash.go+prefetch128 3.80µs ± 0% 3.86µs ± 2% ~ (p=0.238 n=4+5)
zeo/py/fs1-zhash.py 481µs ± 3% 474µs ± 2% ~ (p=0.310 n=5+5)
zeo/py/fs1-zhash.go 170µs ± 5% 170µs ± 3% ~ (p=1.000 n=5+5)
zeo/py/fs1-zhash.go+prefetch128 87.7µs ± 2% 87.8µs ± 1% ~ (p=0.881 n=5+5)
neo/py(!log)/sqlite-zhash.py 657µs ±11% 665µs ± 2% ~ (p=0.841 n=5+5)
neo/py(!log)/sqlite-zhash.go 213µs ± 5% 219µs ± 2% ~ (p=0.222 n=5+5)
neo/py(!log)/sqlite-zhash.go+prefetch128 151µs ± 2% 151µs ± 1% ~ (p=0.881 n=5+5)
neo/py(!log)/sql-zhash.py 897µs ±54% 886µs ±56% ~ (p=0.690 n=5+5)
neo/py(!log)/sql-zhash.go 320µs ± 9% 298µs ± 9% ~ (p=0.151 n=5+5)
neo/py(!log)/sql-zhash.go+prefetch128 230µs ± 2% 230µs ± 3% ~ (p=1.000 n=5+5)
neo/go/fs1-zhash.py 346µs ±35% 319µs ±11% ~ (p=0.794 n=5+5)
neo/go/fs1-zhash.go 61.2µs ± 1% 61.3µs ± 3% ~ (p=0.794 n=5+5)
neo/go/fs1-zhash.go+prefetch128 22.6µs ± 2% 22.5µs ± 3% ~ (p=0.738 n=5+5)
neo/go/fs1(!sha1)-zhash.go(!sha1) 51.2µs ± 2% 52.0µs ± 3% ~ (p=0.135 n=5+5)
neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 18.5µs ± 5% 18.3µs ± 2% ~ (p=0.460 n=5+5)
neo/go/sqlite-zhash.py 391µs ± 7% 382µs ± 6% ~ (p=0.421 n=5+5)
neo/go/sqlite-zhash.go 113µs ± 1% 113µs ± 1% ~ (p=0.841 n=5+5)
neo/go/sqlite-zhash.go+prefetch128 41.5µs ± 6% 40.9µs ± 4% ~ (p=0.730 n=5+5)
neo/go/sqlite-zhash.go(!sha1) 109µs ± 1% 108µs ± 1% ~ (p=0.222 n=5+5)
neo/go/sqlite-zhash.go+prefetch128(!sha1) 41.1µs ± 3% 41.1µs ± 5% ~ (p=1.000 n=5+5)

name old req/s new req/s delta
cluster:neo1 dataset:wczblk1-8
fs1-zwrk.go·1 230k ± 0% 229k ± 0% ~ (p=0.095 n=5+5)
fs1-zwrk.go·2 446k ± 1% 443k ± 1% ~ (p=0.151 n=5+5)
fs1-zwrk.go·3 663k ± 0% 662k ± 1% ~ (p=0.730 n=4+5)
fs1-zwrk.go·4 868k ± 0% 867k ± 1% ~ (p=0.548 n=5+5)
fs1-zwrk.go·8 989k ± 1% 988k ± 0% ~ (p=1.000 n=5+5)
fs1-zwrk.go·12 1.02M ± 0% 1.02M ± 0% ~ (p=1.000 n=5+5)
fs1-zwrk.go·16 1.01M ± 0% 0.98M ±12% ~ (p=0.841 n=5+5)
zeo/py/fs1-zwrk.go·1 5.09k ± 2% 5.15k ± 1% ~ (p=0.421 n=5+5)
zeo/py/fs1-zwrk.go·2 7.08k ± 2% 7.08k ± 1% ~ (p=0.690 n=5+5)
zeo/py/fs1-zwrk.go·3 7.75k ± 1% 7.73k ± 1% ~ (p=0.548 n=5+5)
zeo/py/fs1-zwrk.go·4 7.93k ± 2% 7.97k ± 4% ~ (p=0.690 n=5+5)
zeo/py/fs1-zwrk.go·8 8.30k ± 2% 8.30k ± 2% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·12 8.43k ± 1% 8.15k ± 1% -3.31% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·16 8.41k ± 2% 8.25k ± 1% ~ (p=0.056 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 4.36k ± 4% 4.31k ± 4% ~ (p=0.841 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 6.27k ± 3% 6.28k ± 5% ~ (p=0.548 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 6.21k ± 2% 6.38k ± 0% +2.64% (p=0.016 n=5+4)
neo/py(!log)/sqlite-zwrk.go·4 6.07k ± 6% 6.15k ± 5% ~ (p=0.548 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 6.22k ± 3% 6.27k ± 4% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 6.19k ± 4% 6.33k ± 2% ~ (p=0.056 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 6.09k ± 6% 6.25k ± 4% ~ (p=0.310 n=5+5)
neo/py(!log)/sql-zwrk.go·1 3.12k ± 7% 3.10k ± 6% ~ (p=0.690 n=5+5)
neo/py(!log)/sql-zwrk.go·2 4.02k ± 7% 3.98k ± 1% ~ (p=0.690 n=5+5)
neo/py(!log)/sql-zwrk.go·3 4.08k ± 8% 4.04k ± 3% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zwrk.go·4 4.03k ± 4% 4.06k ± 4% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·8 3.95k ± 3% 3.79k ± 7% ~ (p=0.151 n=5+5)
neo/py(!log)/sql-zwrk.go·12 4.04k ± 5% 3.98k ± 3% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·16 3.97k ± 5% 3.94k ± 1% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·1 12.9k ± 2% 12.8k ± 0% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·2 24.9k ± 1% 24.8k ± 0% ~ (p=0.286 n=5+4)
neo/go/fs1-zwrk.go·3 32.4k ± 0% 32.3k ± 0% -0.29% (p=0.032 n=5+5)
neo/go/fs1-zwrk.go·4 40.8k ± 1% 40.7k ± 0% ~ (p=0.151 n=5+5)
neo/go/fs1-zwrk.go·8 54.8k ± 1% 54.5k ± 1% ~ (p=0.056 n=5+5)
neo/go/fs1-zwrk.go·12 56.5k ± 1% 56.5k ± 1% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·16 54.4k ± 2% 53.2k ±10% ~ (p=0.841 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 18.9k ± 2% 19.0k ± 2% ~ (p=0.690 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 37.8k ± 0% 37.8k ± 0% ~ (p=0.841 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 48.1k ± 0% 48.0k ± 1% ~ (p=0.222 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 59.2k ± 0% 59.0k ± 0% -0.45% (p=0.016 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 78.4k ± 0% 78.0k ± 1% ~ (p=0.056 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 82.9k ± 1% 82.2k ± 2% ~ (p=0.421 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 80.4k ± 2% 80.4k ± 1% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go·1 8.13k ± 0% 8.06k ± 4% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go·2 14.9k ± 0% 14.9k ± 0% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go·3 20.8k ± 1% 20.7k ± 0% ~ (p=0.310 n=5+5)
neo/go/sqlite-zwrk.go·4 24.9k ± 0% 24.8k ± 0% -0.37% (p=0.032 n=5+5)
neo/go/sqlite-zwrk.go·8 31.7k ± 1% 31.7k ± 1% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go·12 31.4k ± 1% 30.8k ± 5% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go·16 30.5k ± 2% 30.4k ± 2% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 8.96k ± 0% 8.95k ± 1% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 16.4k ± 0% 16.2k ± 1% -1.04% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 22.7k ± 0% 22.6k ± 0% -0.59% (p=0.016 n=5+4)
neo/go/sqlite-zwrk.go(!sha1)·4 27.7k ± 0% 27.9k ± 0% +0.58% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 34.4k ± 0% 35.0k ± 1% +1.92% (p=0.016 n=4+5)
neo/go/sqlite-zwrk.go(!sha1)·12 33.5k ± 2% 34.7k ± 1% +3.56% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 33.0k ± 2% 33.0k ±11% ~ (p=0.222 n=5+5)
cluster:neo1 dataset:prod1-1024
fs1-zwrk.go·1 452k ± 1% 451k ± 0% ~ (p=0.690 n=5+5)
fs1-zwrk.go·2 895k ± 0% 893k ± 0% -0.30% (p=0.032 n=5+5)
fs1-zwrk.go·3 1.33M ± 1% 1.34M ± 1% ~ (p=0.151 n=5+5)
fs1-zwrk.go·4 1.76M ± 1% 1.77M ± 0% ~ (p=0.690 n=5+5)
fs1-zwrk.go·8 1.94M ±12% 1.99M ± 1% ~ (p=0.841 n=5+5)
fs1-zwrk.go·12 2.03M ± 0% 2.03M ± 1% ~ (p=0.286 n=5+4)
fs1-zwrk.go·16 2.03M ± 0% 2.03M ± 0% ~ (p=0.095 n=5+5)
zeo/py/fs1-zwrk.go·1 6.00k ± 2% 5.79k ± 3% -3.52% (p=0.032 n=5+5)
zeo/py/fs1-zwrk.go·2 8.45k ± 7% 8.55k ± 1% ~ (p=0.690 n=5+5)
zeo/py/fs1-zwrk.go·3 9.33k ± 2% 9.28k ± 7% ~ (p=0.841 n=5+5)
zeo/py/fs1-zwrk.go·4 9.80k ± 0% 9.72k ± 1% -0.89% (p=0.032 n=5+5)
zeo/py/fs1-zwrk.go·8 10.4k ± 1% 10.4k ± 1% ~ (p=0.841 n=5+5)
zeo/py/fs1-zwrk.go·12 10.5k ± 2% 10.5k ± 1% ~ (p=0.421 n=5+5)
zeo/py/fs1-zwrk.go·16 10.4k ± 4% 10.4k ± 4% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 4.87k ±11% 4.90k ± 7% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 6.44k ± 1% 6.28k ± 4% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 6.31k ± 6% 6.32k ± 5% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 6.36k ± 7% 6.45k ± 2% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 6.47k ± 1% 6.45k ± 2% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 6.48k ± 1% 6.31k ± 3% ~ (p=0.056 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 6.35k ± 2% 6.36k ± 5% ~ (p=0.548 n=5+5)
neo/py(!log)/sql-zwrk.go·1 3.07k ± 9% 3.50k ± 9% +14.08% (p=0.032 n=5+5)
neo/py(!log)/sql-zwrk.go·2 4.09k ± 3% 4.05k ± 6% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·3 3.99k ±11% 4.06k ± 7% ~ (p=0.548 n=5+5)
neo/py(!log)/sql-zwrk.go·4 3.99k ± 2% 3.98k ± 4% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·8 4.15k ± 4% 4.15k ± 3% ~ (p=0.548 n=5+5)
neo/py(!log)/sql-zwrk.go·12 4.13k ± 5% 4.00k ± 5% ~ (p=0.222 n=5+5)
neo/py(!log)/sql-zwrk.go·16 4.22k ± 7% 3.96k ±11% ~ (p=0.151 n=5+5)
neo/go/fs1-zwrk.go·1 17.3k ± 1% 17.1k ± 1% ~ (p=0.063 n=5+5)
neo/go/fs1-zwrk.go·2 32.5k ± 1% 32.6k ± 0% ~ (p=0.222 n=5+5)
neo/go/fs1-zwrk.go·3 43.3k ± 0% 43.3k ± 0% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·4 52.9k ± 0% 52.9k ± 0% ~ (p=0.730 n=4+5)
neo/go/fs1-zwrk.go·8 65.3k ± 2% 66.3k ± 1% +1.57% (p=0.032 n=5+4)
neo/go/fs1-zwrk.go·12 61.0k ± 6% 61.6k ± 1% ~ (p=1.000 n=5+5)
neo/go/fs1-zwrk.go·16 55.9k ± 2% 55.6k ± 4% ~ (p=0.421 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 20.0k ± 3% 19.6k ± 5% ~ (p=0.421 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 40.5k ± 1% 40.3k ± 0% ~ (p=0.095 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 51.6k ± 0% 51.6k ± 0% ~ (p=0.841 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 62.6k ± 0% 62.0k ± 0% -0.83% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 74.6k ± 1% 74.2k ± 4% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 66.3k ± 4% 64.8k ± 7% ~ (p=0.548 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 58.9k ± 2% 59.5k ± 4% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go·1 9.01k ± 1% 9.02k ± 1% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go·2 15.9k ± 1% 16.0k ± 0% ~ (p=0.310 n=5+5)
neo/go/sqlite-zwrk.go·3 21.8k ± 0% 21.8k ± 1% ~ (p=1.000 n=4+4)
neo/go/sqlite-zwrk.go·4 26.3k ± 0% 26.2k ± 0% ~ (p=0.095 n=5+5)
neo/go/sqlite-zwrk.go·8 29.8k ± 1% 30.0k ± 2% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go·12 28.5k ± 1% 28.6k ± 2% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go·16 28.5k ± 8% 28.7k ± 1% ~ (p=0.730 n=5+4)
neo/go/sqlite-zwrk.go(!sha1)·1 9.38k ± 1% 9.45k ± 1% ~ (p=0.222 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 16.5k ± 0% 16.6k ± 1% ~ (p=0.095 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 22.7k ± 0% 23.0k ± 0% +1.59% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 27.5k ± 1% 28.0k ± 1% +1.81% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 32.3k ± 5% 32.3k ± 0% ~ (p=0.222 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 30.7k ± 2% 30.6k ± 2% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 30.3k ± 2% 30.3k ± 2% ~ (p=0.841 n=5+5)

name old latency-time/object new latency-time/object delta
cluster:neo1 dataset:wczblk1-8
fs1-zwrk.go·1 4.35µs ± 0% 4.36µs ± 0% ~ (p=0.095 n=5+5)
fs1-zwrk.go·2 4.49µs ± 1% 4.52µs ± 1% ~ (p=0.151 n=5+5)
fs1-zwrk.go·3 4.53µs ± 0% 4.53µs ± 1% ~ (p=0.730 n=4+5)
fs1-zwrk.go·4 4.61µs ± 0% 4.61µs ± 1% ~ (p=0.548 n=5+5)
fs1-zwrk.go·8 8.09µs ± 1% 8.10µs ± 0% ~ (p=1.000 n=5+5)
fs1-zwrk.go·12 11.8µs ± 0% 11.8µs ± 0% ~ (p=1.000 n=5+5)
fs1-zwrk.go·16 15.8µs ± 0% 16.5µs ±13% ~ (p=0.841 n=5+5)
zeo/py/fs1-zwrk.go·1 197µs ± 2% 194µs ± 1% ~ (p=0.421 n=5+5)
zeo/py/fs1-zwrk.go·2 283µs ± 2% 282µs ± 1% ~ (p=0.690 n=5+5)
zeo/py/fs1-zwrk.go·3 387µs ± 1% 388µs ± 1% ~ (p=0.548 n=5+5)
zeo/py/fs1-zwrk.go·4 504µs ± 2% 502µs ± 5% ~ (p=0.690 n=5+5)
zeo/py/fs1-zwrk.go·8 964µs ± 2% 964µs ± 2% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·12 1.42ms ± 1% 1.47ms ± 1% +3.43% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·16 1.90ms ± 2% 1.94ms ± 1% ~ (p=0.056 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 230µs ± 4% 232µs ± 4% ~ (p=0.841 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 319µs ± 3% 319µs ± 5% ~ (p=0.548 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 483µs ± 2% 470µs ± 0% -2.59% (p=0.016 n=5+4)
neo/py(!log)/sqlite-zwrk.go·4 661µs ± 6% 651µs ± 5% ~ (p=0.548 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 1.29ms ± 3% 1.28ms ± 4% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 1.94ms ± 4% 1.90ms ± 2% ~ (p=0.056 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 2.63ms ± 6% 2.56ms ± 4% ~ (p=0.310 n=5+5)
neo/py(!log)/sql-zwrk.go·1 321µs ± 7% 323µs ± 6% ~ (p=0.690 n=5+5)
neo/py(!log)/sql-zwrk.go·2 499µs ± 7% 503µs ± 2% ~ (p=0.690 n=5+5)
neo/py(!log)/sql-zwrk.go·3 737µs ± 8% 742µs ± 3% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zwrk.go·4 993µs ± 4% 986µs ± 4% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·8 2.03ms ± 3% 2.11ms ± 8% ~ (p=0.151 n=5+5)
neo/py(!log)/sql-zwrk.go·12 2.97ms ± 4% 3.02ms ± 3% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·16 4.03ms ± 4% 4.06ms ± 1% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·1 77.7µs ± 2% 77.8µs ± 0% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·2 80.2µs ± 1% 80.6µs ± 0% ~ (p=0.286 n=5+4)
neo/go/fs1-zwrk.go·3 92.5µs ± 0% 92.8µs ± 0% +0.30% (p=0.032 n=5+5)
neo/go/fs1-zwrk.go·4 98.1µs ± 1% 98.2µs ± 0% ~ (p=0.151 n=5+5)
neo/go/fs1-zwrk.go·8 146µs ± 1% 147µs ± 1% ~ (p=0.056 n=5+5)
neo/go/fs1-zwrk.go·12 212µs ± 1% 212µs ± 1% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·16 294µs ± 2% 293µs ± 1% ~ (p=0.905 n=5+4)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 52.8µs ± 2% 52.7µs ± 2% ~ (p=0.690 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 53.0µs ± 0% 53.0µs ± 0% ~ (p=0.889 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 62.3µs ± 0% 62.5µs ± 1% ~ (p=0.222 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 67.5µs ± 0% 67.8µs ± 0% +0.46% (p=0.016 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 102µs ± 0% 103µs ± 1% +0.54% (p=0.040 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 145µs ± 1% 146µs ± 2% ~ (p=0.421 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 199µs ± 2% 199µs ± 1% ~ (p=0.651 n=5+5)
neo/go/sqlite-zwrk.go·1 123µs ± 0% 124µs ± 4% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go·2 134µs ± 0% 134µs ± 0% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go·3 144µs ± 1% 145µs ± 0% ~ (p=0.310 n=5+5)
neo/go/sqlite-zwrk.go·4 161µs ± 0% 161µs ± 0% +0.38% (p=0.032 n=5+5)
neo/go/sqlite-zwrk.go·8 253µs ± 1% 252µs ± 1% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go·12 383µs ± 1% 390µs ± 5% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go·16 524µs ± 2% 526µs ± 2% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 112µs ± 0% 112µs ± 1% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 122µs ± 0% 124µs ± 1% +1.05% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 132µs ± 0% 133µs ± 0% +0.60% (p=0.016 n=5+4)
neo/go/sqlite-zwrk.go(!sha1)·4 144µs ± 0% 143µs ± 0% -0.57% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 233µs ± 0% 228µs ± 1% -1.88% (p=0.016 n=4+5)
neo/go/sqlite-zwrk.go(!sha1)·12 359µs ± 2% 346µs ± 1% -3.44% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 485µs ± 2% 486µs ±11% ~ (p=0.222 n=5+5)
cluster:neo1 dataset:prod1-1024
fs1-zwrk.go·1 2.21µs ± 1% 2.22µs ± 1% ~ (p=0.667 n=5+5)
fs1-zwrk.go·2 2.23µs ± 0% 2.24µs ± 0% +0.30% (p=0.040 n=5+5)
fs1-zwrk.go·3 2.25µs ± 1% 2.25µs ± 1% ~ (p=0.135 n=5+5)
fs1-zwrk.go·4 2.27µs ± 1% 2.26µs ± 0% ~ (p=0.611 n=5+5)
fs1-zwrk.go·8 4.15µs ±13% 4.02µs ± 1% ~ (p=0.841 n=5+5)
fs1-zwrk.go·12 5.90µs ± 0% 5.92µs ± 1% ~ (p=0.317 n=5+4)
fs1-zwrk.go·16 7.89µs ± 0% 7.87µs ± 0% ~ (p=0.087 n=5+5)
zeo/py/fs1-zwrk.go·1 167µs ± 2% 173µs ± 3% +3.68% (p=0.032 n=5+5)
zeo/py/fs1-zwrk.go·2 237µs ± 7% 234µs ± 1% ~ (p=0.690 n=5+5)
zeo/py/fs1-zwrk.go·3 322µs ± 2% 324µs ± 7% ~ (p=0.841 n=5+5)
zeo/py/fs1-zwrk.go·4 408µs ± 0% 412µs ± 1% +0.91% (p=0.032 n=5+5)
zeo/py/fs1-zwrk.go·8 770µs ± 1% 768µs ± 1% ~ (p=0.841 n=5+5)
zeo/py/fs1-zwrk.go·12 1.14ms ± 2% 1.14ms ± 1% ~ (p=0.421 n=5+5)
zeo/py/fs1-zwrk.go·16 1.54ms ± 4% 1.54ms ± 4% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 206µs ±11% 204µs ± 8% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 311µs ± 1% 319µs ± 4% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 476µs ± 7% 475µs ± 5% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 629µs ± 7% 620µs ± 2% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 1.24ms ± 1% 1.24ms ± 2% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 1.85ms ± 1% 1.90ms ± 3% ~ (p=0.056 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 2.52ms ± 2% 2.52ms ± 5% ~ (p=0.548 n=5+5)
neo/py(!log)/sql-zwrk.go·1 327µs ± 8% 287µs ± 8% -12.18% (p=0.032 n=5+5)
neo/py(!log)/sql-zwrk.go·2 489µs ± 3% 495µs ± 6% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·3 755µs ±10% 740µs ± 8% ~ (p=0.548 n=5+5)
neo/py(!log)/sql-zwrk.go·4 1.00ms ± 2% 1.01ms ± 4% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·8 1.93ms ± 3% 1.93ms ± 3% ~ (p=0.548 n=5+5)
neo/py(!log)/sql-zwrk.go·12 2.91ms ± 5% 3.01ms ± 4% ~ (p=0.222 n=5+5)
neo/py(!log)/sql-zwrk.go·16 3.80ms ± 7% 4.05ms ±10% ~ (p=0.151 n=5+5)
neo/go/fs1-zwrk.go·1 57.8µs ± 1% 58.5µs ± 1% ~ (p=0.063 n=5+5)
neo/go/fs1-zwrk.go·2 61.5µs ± 1% 61.4µs ± 0% ~ (p=0.254 n=5+5)
neo/go/fs1-zwrk.go·3 69.3µs ± 0% 69.3µs ± 0% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·4 75.6µs ± 0% 75.6µs ± 0% ~ (p=0.730 n=4+5)
neo/go/fs1-zwrk.go·8 123µs ± 2% 121µs ± 1% -1.56% (p=0.032 n=5+4)
neo/go/fs1-zwrk.go·12 197µs ± 6% 195µs ± 1% ~ (p=1.000 n=5+5)
neo/go/fs1-zwrk.go·16 286µs ± 2% 288µs ± 4% ~ (p=0.421 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 50.0µs ± 3% 50.9µs ± 5% ~ (p=0.421 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 49.4µs ± 1% 49.7µs ± 0% ~ (p=0.095 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 58.1µs ± 0% 58.2µs ± 0% ~ (p=0.841 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 63.9µs ± 0% 64.5µs ± 0% +0.84% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 107µs ± 1% 108µs ± 4% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 181µs ± 4% 185µs ± 8% ~ (p=0.548 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 272µs ± 2% 269µs ± 4% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go·1 111µs ± 1% 111µs ± 1% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go·2 126µs ± 1% 125µs ± 0% ~ (p=0.310 n=5+5)
neo/go/sqlite-zwrk.go·3 137µs ± 0% 137µs ± 1% ~ (p=1.000 n=4+4)
neo/go/sqlite-zwrk.go·4 152µs ± 0% 153µs ± 0% ~ (p=0.095 n=5+5)
neo/go/sqlite-zwrk.go·8 268µs ± 1% 267µs ± 1% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go·12 421µs ± 1% 420µs ± 2% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go·16 562µs ± 8% 558µs ± 1% ~ (p=0.730 n=5+4)
neo/go/sqlite-zwrk.go(!sha1)·1 107µs ± 1% 106µs ± 1% ~ (p=0.222 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 121µs ± 0% 121µs ± 1% ~ (p=0.095 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 132µs ± 0% 130µs ± 0% -1.57% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 146µs ± 1% 143µs ± 1% -1.78% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 247µs ± 5% 248µs ± 0% ~ (p=0.222 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 391µs ± 2% 393µs ± 2% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 528µs ± 2% 528µs ± 2% ~ (p=0.841 n=5+5)

9644774a

X deco: localhost timings, Cenabled · dabeb4b8

Kirill Smelkov authored Mar 06, 2018

Compared to yesterday shows not significant change, thus meaning
benchmarking is more or less stable (+/- 5% at ·12 and ·16 is probably
due to scheduling):

$ benchstat -split node,cluster,dataset 20180305-deco-ffixed-c.txt 20180306-deco-ffixed-c.txt

name old pystone/s new pystone/s delta
node:deco
pystone 219k ± 3% 217k ± 4% ~ (p=0.548 n=5+5)

name old time/op new time/op delta
node:deco
crc32/py/4K 5.72µs ± 0% 5.73µs ± 0% ~ (p=0.460 n=5+5)
crc32/go/4K 279ns ± 0% 279ns ± 0% ~ (all equal)
sha1/py/4K 6.69µs ± 0% 6.74µs ± 1% +0.66% (p=0.024 n=5+5)
sha1/go/4K 5.59µs ± 0% 5.60µs ± 0% +0.19% (p=0.008 n=5+5)
unzlib/py/wczdata 27.2µs ± 0% 27.2µs ± 1% ~ (p=0.905 n=4+5)
unzlib/go/wczdata 26.9µs ± 1% 27.0µs ± 0% ~ (p=0.222 n=5+5)
unzlib/py/prod1-avg 5.06µs ± 0% 5.14µs ± 3% ~ (p=0.603 n=4+5)
unzlib/go/prod1-avg 5.33µs ± 1% 5.30µs ± 1% ~ (p=0.087 n=5+5)
disk/randread/direct/4K-min 105µs ± 0% 104µs ± 2% ~ (p=0.270 n=5+5)
disk/randread/direct/4K-avg 142µs ± 0% 141µs ± 0% -0.31% (p=0.032 n=5+5)
disk/randread/pagecache/4K-min 583ns ± 1% 579ns ± 2% ~ (p=0.246 n=5+5)
disk/randread/pagecache/4K-avg 1.00µs ± 1% 0.99µs ± 0% -0.98% (p=0.024 n=5+5)

name old time/object new time/object delta
cluster:deco dataset:wczblk1-8
fs1-zhash.py 20.2µs ± 1% 20.3µs ± 1% ~ (p=0.571 n=4+4)
fs1-zhash.go 3.20µs ± 0% 3.26µs ± 4% ~ (p=0.444 n=5+5)
fs1-zhash.go+prefetch128 4.14µs ± 6% 4.04µs ± 1% ~ (p=0.444 n=5+5)
zeo/py/fs1-zhash.py 379µs ± 3% 383µs ± 5% ~ (p=0.730 n=5+5)
zeo/py/fs1-zhash.go 127µs ± 1% 126µs ± 1% ~ (p=0.317 n=4+5)
zeo/py/fs1-zhash.go+prefetch128 64.1µs ± 2% 63.1µs ± 1% ~ (p=0.222 n=5+5)
neo/py(!log)/sqlite-zhash.py 335µs ± 4% 344µs ± 6% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zhash.go 145µs ± 2% 140µs ± 1% -3.07% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zhash.go+prefetch128 118µs ± 1% 119µs ± 2% ~ (p=0.548 n=5+5)
neo/py(!log)/sql-zhash.py 454µs ±61% 386µs ± 1% ~ (p=1.000 n=5+4)
neo/py(!log)/sql-zhash.go 183µs ± 1% 183µs ± 3% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zhash.go+prefetch128 164µs ± 2% 164µs ± 3% ~ (p=0.690 n=5+5)
neo/go/fs1-zhash.py 227µs ± 2% 226µs ± 3% ~ (p=0.690 n=5+5)
neo/go/fs1-zhash.go 56.9µs ± 1% 57.1µs ± 0% ~ (p=0.119 n=5+5)
neo/go/fs1-zhash.go+prefetch128 24.7µs ± 2% 24.7µs ± 5% ~ (p=0.571 n=5+5)
neo/go/fs1(!sha1)-zhash.go(!sha1) 40.5µs ± 1% 40.2µs ± 1% ~ (p=0.254 n=5+5)
neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 16.8µs ± 5% 17.1µs ± 6% ~ (p=0.579 n=5+5)
neo/go/sqlite-zhash.py 269µs ± 1% 272µs ± 3% ~ (p=0.690 n=5+5)
neo/go/sqlite-zhash.go 92.7µs ± 0% 92.8µs ± 0% ~ (p=0.397 n=5+4)
neo/go/sqlite-zhash.go+prefetch128 39.8µs ± 8% 40.5µs ± 5% ~ (p=0.548 n=5+5)
neo/go/sqlite-zhash.go(!sha1) 86.4µs ± 2% 86.5µs ± 2% ~ (p=0.571 n=5+5)
neo/go/sqlite-zhash.go+prefetch128(!sha1) 40.1µs ±11% 38.8µs ± 9% ~ (p=0.579 n=5+5)
cluster:deco dataset:prod1-1024
fs1-zhash.py 15.8µs ± 2% 15.8µs ± 3% ~ (p=0.629 n=4+4)
fs1-zhash.go 2.80µs ± 0% 2.80µs ± 0% ~ (all equal)
fs1-zhash.go+prefetch128 3.54µs ± 7% 3.42µs ± 8% ~ (p=0.381 n=5+5)
zeo/py/fs1-zhash.py 362µs ± 6% 361µs ± 5% ~ (p=1.000 n=5+5)
zeo/py/fs1-zhash.go 106µs ± 1% 105µs ± 0% ~ (p=0.214 n=5+5)
zeo/py/fs1-zhash.go+prefetch128 58.9µs ± 1% 58.9µs ± 1% ~ (p=0.881 n=5+5)
neo/py(!log)/sqlite-zhash.py 331µs ± 1% 344µs ± 7% ~ (p=0.063 n=5+5)
neo/py(!log)/sqlite-zhash.go 136µs ± 1% 137µs ± 2% ~ (p=0.222 n=5+5)
neo/py(!log)/sqlite-zhash.go+prefetch128 112µs ± 1% 114µs ± 1% +1.73% (p=0.008 n=5+5)
neo/py(!log)/sql-zhash.py 389µs ± 6% 380µs ± 4% ~ (p=0.486 n=4+4)
neo/py(!log)/sql-zhash.go 180µs ± 2% 180µs ± 1% ~ (p=0.548 n=5+5)
neo/py(!log)/sql-zhash.go+prefetch128 157µs ± 1% 159µs ± 1% ~ (p=0.095 n=5+5)
neo/go/fs1-zhash.py 223µs ± 0% 221µs ± 1% -0.79% (p=0.016 n=5+5)
neo/go/fs1-zhash.go 44.9µs ± 1% 45.2µs ± 2% ~ (p=0.357 n=5+5)
neo/go/fs1-zhash.go+prefetch128 17.6µs ± 5% 17.6µs ± 2% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zhash.go(!sha1) 39.1µs ± 1% 39.1µs ± 2% ~ (p=0.714 n=5+5)
neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 14.8µs ± 3% 14.6µs ± 4% ~ (p=0.302 n=5+5)
neo/go/sqlite-zhash.py 269µs ± 3% 271µs ± 2% ~ (p=0.548 n=5+5)
neo/go/sqlite-zhash.go 86.0µs ± 1% 86.4µs ± 0% ~ (p=0.206 n=5+5)
neo/go/sqlite-zhash.go+prefetch128 36.4µs ± 6% 35.8µs ± 2% ~ (p=0.532 n=5+5)
neo/go/sqlite-zhash.go(!sha1) 83.6µs ± 1% 84.0µs ± 1% ~ (p=0.516 n=5+5)
neo/go/sqlite-zhash.go+prefetch128(!sha1) 35.9µs ± 5% 36.5µs ± 5% ~ (p=0.444 n=5+5)

name old req/s new req/s delta
cluster:deco dataset:wczblk1-8
fs1-zwrk.go·1 438k ± 1% 436k ± 0% ~ (p=0.222 n=5+5)
fs1-zwrk.go·2 745k ± 1% 744k ± 1% ~ (p=0.548 n=5+5)
fs1-zwrk.go·3 1.09M ± 0% 1.09M ± 0% ~ (p=0.095 n=5+5)
fs1-zwrk.go·4 1.15M ± 1% 1.16M ± 1% ~ (p=0.095 n=5+5)
fs1-zwrk.go·8 1.27M ± 1% 1.27M ± 1% ~ (p=0.841 n=5+5)
fs1-zwrk.go·12 1.27M ± 1% 1.27M ± 1% ~ (p=0.690 n=5+5)
fs1-zwrk.go·16 1.28M ± 1% 1.27M ± 1% ~ (p=0.841 n=5+5)
zeo/py/fs1-zwrk.go·1 9.04k ± 1% 9.12k ± 0% +0.89% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·2 11.4k ± 1% 11.6k ± 1% +1.58% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·3 13.4k ± 1% 13.4k ± 1% ~ (p=0.310 n=5+5)
zeo/py/fs1-zwrk.go·4 14.0k ± 1% 14.0k ± 1% ~ (p=0.595 n=5+5)
zeo/py/fs1-zwrk.go·8 14.6k ± 4% 14.7k ± 1% ~ (p=0.690 n=5+5)
zeo/py/fs1-zwrk.go·12 14.9k ± 1% 15.0k ± 1% ~ (p=0.421 n=5+5)
zeo/py/fs1-zwrk.go·16 15.3k ± 1% 15.1k ± 0% -0.79% (p=0.016 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 7.03k ± 3% 7.09k ± 1% ~ (p=0.310 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 8.52k ± 1% 8.48k ± 1% ~ (p=0.151 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 8.48k ± 1% 8.48k ± 1% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 8.45k ± 1% 8.47k ± 1% ~ (p=0.841 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 8.44k ± 1% 8.43k ± 1% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 8.48k ± 1% 8.46k ± 1% ~ (p=0.841 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 8.49k ± 1% 8.46k ± 1% ~ (p=0.310 n=5+5)
neo/py(!log)/sql-zwrk.go·1 5.51k ± 1% 5.51k ± 1% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·2 6.31k ± 1% 6.32k ± 1% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zwrk.go·3 6.20k ± 1% 6.29k ± 1% +1.37% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·4 6.22k ± 1% 6.27k ± 1% +0.83% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·8 6.25k ± 1% 6.27k ± 1% ~ (p=0.548 n=5+5)
neo/py(!log)/sql-zwrk.go·12 6.26k ± 1% 6.29k ± 0% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zwrk.go·16 6.26k ± 1% 6.22k ± 1% ~ (p=0.421 n=5+5)
neo/go/fs1-zwrk.go·1 18.4k ± 0% 18.4k ± 1% ~ (p=0.167 n=5+5)
neo/go/fs1-zwrk.go·2 38.2k ± 1% 38.1k ± 1% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·3 45.8k ± 1% 46.0k ± 1% ~ (p=0.421 n=5+5)
neo/go/fs1-zwrk.go·4 49.8k ± 0% 50.2k ± 1% +0.94% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·8 60.3k ± 1% 61.0k ± 0% +1.16% (p=0.016 n=5+5)
neo/go/fs1-zwrk.go·12 61.6k ± 1% 62.1k ± 1% ~ (p=0.222 n=5+5)
neo/go/fs1-zwrk.go·16 61.4k ± 1% 62.5k ± 1% ~ (p=0.095 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 26.1k ± 1% 26.3k ± 1% ~ (p=0.222 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 55.3k ± 1% 55.3k ± 1% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 62.7k ± 1% 62.7k ± 1% ~ (p=0.841 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 69.1k ± 0% 69.3k ± 1% ~ (p=0.421 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 87.9k ± 0% 88.2k ± 0% ~ (p=0.310 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 92.2k ± 1% 93.4k ± 0% +1.32% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 93.4k ± 1% 93.5k ± 2% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go·1 11.1k ± 0% 11.0k ± 1% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go·2 18.5k ± 0% 18.4k ± 1% -0.68% (p=0.016 n=5+5)
neo/go/sqlite-zwrk.go·3 24.5k ± 0% 24.4k ± 1% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go·4 26.9k ± 1% 26.8k ± 0% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go·8 29.9k ± 2% 30.4k ± 2% ~ (p=0.310 n=5+5)
neo/go/sqlite-zwrk.go·12 29.2k ± 2% 30.5k ± 1% +4.49% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·16 28.4k ± 2% 29.9k ± 2% +5.53% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 11.8k ± 0% 11.9k ± 1% ~ (p=0.063 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 19.5k ± 0% 19.7k ± 0% +0.60% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 26.8k ± 1% 26.5k ± 1% -1.14% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 30.3k ± 1% 30.0k ± 0% -1.12% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 32.0k ± 2% 31.2k ± 2% -2.46% (p=0.032 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 30.2k ± 3% 28.9k ± 1% -4.20% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 29.7k ± 1% 28.4k ± 2% -4.27% (p=0.008 n=5+5)
cluster:deco dataset:prod1-1024
fs1-zwrk.go·1 555k ± 0% 555k ± 0% ~ (p=1.000 n=5+5)
fs1-zwrk.go·2 982k ± 2% 1008k ± 3% +2.66% (p=0.032 n=5+5)
fs1-zwrk.go·3 1.32M ± 1% 1.32M ± 1% ~ (p=0.421 n=5+5)
fs1-zwrk.go·4 1.51M ± 1% 1.55M ± 2% +2.80% (p=0.032 n=5+5)
fs1-zwrk.go·8 1.58M ± 1% 1.59M ± 0% ~ (p=0.548 n=5+5)
fs1-zwrk.go·12 1.59M ± 0% 1.59M ± 0% ~ (p=0.548 n=5+5)
fs1-zwrk.go·16 1.59M ± 0% 1.59M ± 0% ~ (p=0.095 n=5+5)
zeo/py/fs1-zwrk.go·1 9.70k ± 1% 9.70k ± 0% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·2 12.2k ± 1% 12.4k ± 1% +1.67% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·3 14.2k ± 1% 14.2k ± 1% ~ (p=0.095 n=5+5)
zeo/py/fs1-zwrk.go·4 14.9k ± 0% 14.9k ± 0% ~ (p=0.841 n=5+5)
zeo/py/fs1-zwrk.go·8 15.6k ± 0% 15.6k ± 0% ~ (p=0.548 n=5+5)
zeo/py/fs1-zwrk.go·12 15.9k ± 1% 15.2k ±11% ~ (p=0.310 n=5+5)
zeo/py/fs1-zwrk.go·16 16.1k ± 0% 16.1k ± 1% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 7.51k ± 1% 7.44k ± 1% -0.91% (p=0.016 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 8.72k ± 1% 8.59k ± 1% -1.45% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 8.69k ± 1% 8.61k ± 1% ~ (p=0.095 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 8.67k ± 1% 8.57k ± 1% ~ (p=0.095 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 8.72k ± 0% 8.56k ± 1% -1.83% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 8.63k ± 1% 8.51k ± 1% ~ (p=0.056 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 8.64k ± 1% 8.54k ± 1% ~ (p=0.095 n=5+5)
neo/py(!log)/sql-zwrk.go·1 5.56k ± 2% 5.55k ± 2% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·2 6.42k ± 0% 6.36k ± 1% -0.97% (p=0.032 n=5+5)
neo/py(!log)/sql-zwrk.go·3 6.40k ± 0% 6.31k ± 0% -1.44% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·4 6.38k ± 1% 6.28k ± 0% -1.57% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·8 6.39k ± 1% 6.34k ± 1% ~ (p=0.056 n=5+5)
neo/py(!log)/sql-zwrk.go·12 6.42k ± 1% 6.35k ± 1% -1.11% (p=0.016 n=5+5)
neo/py(!log)/sql-zwrk.go·16 6.41k ± 2% 6.36k ± 0% ~ (p=0.151 n=5+5)
neo/go/fs1-zwrk.go·1 23.8k ± 0% 23.7k ± 0% -0.33% (p=0.032 n=5+5)
neo/go/fs1-zwrk.go·2 45.0k ± 1% 45.4k ± 0% +0.93% (p=0.032 n=5+5)
neo/go/fs1-zwrk.go·3 55.1k ± 1% 55.2k ± 1% ~ (p=1.000 n=5+5)
neo/go/fs1-zwrk.go·4 60.1k ± 0% 60.7k ± 2% ~ (p=0.151 n=5+5)
neo/go/fs1-zwrk.go·8 68.3k ± 2% 70.9k ± 2% +3.72% (p=0.016 n=5+5)
neo/go/fs1-zwrk.go·12 69.3k ± 5% 71.1k ± 3% ~ (p=0.310 n=5+5)
neo/go/fs1-zwrk.go·16 68.8k ± 6% 71.0k ± 3% ~ (p=0.690 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 27.3k ± 0% 27.3k ± 0% ~ (p=0.095 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 54.9k ± 1% 55.4k ± 1% ~ (p=0.095 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 64.0k ± 0% 64.0k ± 1% ~ (p=0.841 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 68.7k ± 1% 69.0k ± 1% ~ (p=0.222 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 79.4k ± 2% 80.9k ± 2% ~ (p=0.222 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 77.9k ± 2% 78.3k ± 5% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 75.3k ± 6% 75.4k ± 3% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go·1 11.8k ± 0% 11.7k ± 1% ~ (p=0.095 n=5+5)
neo/go/sqlite-zwrk.go·2 19.2k ± 0% 19.0k ± 0% -0.85% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·3 24.5k ± 1% 24.5k ± 1% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go·4 26.6k ± 1% 26.3k ± 1% -1.38% (p=0.016 n=5+5)
neo/go/sqlite-zwrk.go·8 25.1k ± 3% 24.9k ± 3% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go·12 23.8k ± 2% 24.0k ± 5% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go·16 24.3k ± 2% 25.4k ± 1% +4.53% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 12.1k ± 1% 12.2k ± 0% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 19.6k ± 0% 19.8k ± 0% +0.98% (p=0.016 n=4+5)
neo/go/sqlite-zwrk.go(!sha1)·3 25.3k ± 1% 26.2k ± 1% +3.40% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 27.3k ± 1% 28.7k ± 1% +5.03% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 25.4k ± 3% 27.2k ± 3% +6.78% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 23.8k ± 2% 25.3k ± 2% +6.21% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 23.9k ± 2% 25.3k ± 1% +6.14% (p=0.008 n=5+5)

name old latency-time/object new latency-time/object delta
cluster:deco dataset:wczblk1-8
fs1-zwrk.go·1 2.29µs ± 1% 2.29µs ± 0% ~ (p=0.222 n=5+5)
fs1-zwrk.go·2 2.68µs ± 1% 2.69µs ± 1% ~ (p=0.524 n=5+5)
fs1-zwrk.go·3 2.76µs ± 0% 2.76µs ± 0% ~ (p=0.111 n=5+5)
fs1-zwrk.go·4 3.46µs ± 1% 3.44µs ± 1% ~ (p=0.095 n=5+5)
fs1-zwrk.go·8 6.28µs ± 1% 6.28µs ± 1% ~ (p=0.889 n=5+5)
fs1-zwrk.go·12 9.42µs ± 1% 9.46µs ± 1% ~ (p=0.690 n=5+5)
fs1-zwrk.go·16 12.5µs ± 1% 12.6µs ± 1% ~ (p=0.841 n=5+5)
zeo/py/fs1-zwrk.go·1 111µs ± 1% 110µs ± 0% -0.88% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·2 176µs ± 1% 173µs ± 1% -1.56% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·3 224µs ± 1% 224µs ± 1% ~ (p=0.310 n=5+5)
zeo/py/fs1-zwrk.go·4 285µs ± 1% 286µs ± 1% ~ (p=0.690 n=5+5)
zeo/py/fs1-zwrk.go·8 549µs ± 4% 545µs ± 1% ~ (p=0.690 n=5+5)
zeo/py/fs1-zwrk.go·12 805µs ± 1% 802µs ± 1% ~ (p=0.421 n=5+5)
zeo/py/fs1-zwrk.go·16 1.05ms ± 1% 1.06ms ± 0% +0.80% (p=0.016 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 142µs ± 3% 141µs ± 1% ~ (p=0.310 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 235µs ± 1% 236µs ± 1% ~ (p=0.151 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 354µs ± 1% 354µs ± 1% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 473µs ± 1% 472µs ± 1% ~ (p=0.841 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 948µs ± 1% 949µs ± 1% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 1.42ms ± 1% 1.42ms ± 1% ~ (p=0.841 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 1.88ms ± 1% 1.89ms ± 1% ~ (p=0.310 n=5+5)
neo/py(!log)/sql-zwrk.go·1 181µs ± 1% 181µs ± 1% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·2 317µs ± 1% 317µs ± 1% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zwrk.go·3 484µs ± 1% 477µs ± 1% -1.36% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·4 643µs ± 1% 638µs ± 1% -0.82% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·8 1.28ms ± 1% 1.28ms ± 1% ~ (p=0.548 n=5+5)
neo/py(!log)/sql-zwrk.go·12 1.92ms ± 1% 1.91ms ± 0% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zwrk.go·16 2.56ms ± 1% 2.57ms ± 1% ~ (p=0.421 n=5+5)
neo/go/fs1-zwrk.go·1 54.5µs ± 0% 54.2µs ± 1% ~ (p=0.167 n=5+5)
neo/go/fs1-zwrk.go·2 52.4µs ± 1% 52.5µs ± 1% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·3 65.4µs ± 1% 65.3µs ± 1% ~ (p=0.421 n=5+5)
neo/go/fs1-zwrk.go·4 80.4µs ± 0% 79.6µs ± 1% -0.93% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·8 133µs ± 1% 131µs ± 0% -1.15% (p=0.016 n=5+5)
neo/go/fs1-zwrk.go·12 195µs ± 1% 193µs ± 1% ~ (p=0.222 n=5+5)
neo/go/fs1-zwrk.go·16 261µs ± 1% 256µs ± 1% ~ (p=0.095 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 38.3µs ± 1% 38.0µs ± 1% ~ (p=0.222 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 36.2µs ± 1% 36.1µs ± 1% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 47.8µs ± 1% 47.8µs ± 1% ~ (p=0.841 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 57.9µs ± 0% 57.7µs ± 1% ~ (p=0.421 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 91.0µs ± 0% 90.7µs ± 0% ~ (p=0.310 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 130µs ± 1% 129µs ± 0% -1.31% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 171µs ± 1% 171µs ± 2% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go·1 90.4µs ± 0% 90.7µs ± 1% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go·2 108µs ± 0% 109µs ± 1% +0.69% (p=0.016 n=5+5)
neo/go/sqlite-zwrk.go·3 123µs ± 0% 123µs ± 1% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go·4 148µs ± 1% 149µs ± 0% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go·8 267µs ± 2% 263µs ± 2% ~ (p=0.310 n=5+5)
neo/go/sqlite-zwrk.go·12 411µs ± 2% 393µs ± 1% -4.31% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·16 564µs ± 2% 534µs ± 2% -5.24% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 84.5µs ± 0% 84.0µs ± 1% ~ (p=0.063 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 102µs ± 0% 102µs ± 0% -0.60% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 112µs ± 1% 113µs ± 1% +1.16% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 132µs ± 1% 133µs ± 0% +1.13% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 250µs ± 2% 257µs ± 2% +2.52% (p=0.032 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 397µs ± 3% 415µs ± 1% +4.38% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 539µs ± 1% 563µs ± 2% +4.47% (p=0.008 n=5+5)
cluster:deco dataset:prod1-1024
fs1-zwrk.go·1 1.80µs ± 0% 1.80µs ± 0% ~ (p=0.968 n=5+5)
fs1-zwrk.go·2 2.04µs ± 2% 1.98µs ± 3% -2.55% (p=0.032 n=5+5)
fs1-zwrk.go·3 2.28µs ± 1% 2.27µs ± 1% ~ (p=0.389 n=5+5)
fs1-zwrk.go·4 2.65µs ± 1% 2.58µs ± 2% -2.71% (p=0.032 n=5+5)
fs1-zwrk.go·8 5.05µs ± 1% 5.04µs ± 0% ~ (p=0.548 n=5+5)
fs1-zwrk.go·12 7.54µs ± 0% 7.55µs ± 0% ~ (p=0.571 n=5+5)
fs1-zwrk.go·16 10.1µs ± 0% 10.0µs ± 0% ~ (p=0.095 n=5+5)
zeo/py/fs1-zwrk.go·1 103µs ± 1% 103µs ± 0% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·2 164µs ± 1% 162µs ± 1% -1.64% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·3 211µs ± 1% 212µs ± 1% ~ (p=0.095 n=5+5)
zeo/py/fs1-zwrk.go·4 269µs ± 0% 269µs ± 0% ~ (p=0.841 n=5+5)
zeo/py/fs1-zwrk.go·8 512µs ± 0% 512µs ± 0% ~ (p=0.548 n=5+5)
zeo/py/fs1-zwrk.go·12 755µs ± 1% 793µs ±12% ~ (p=0.310 n=5+5)
zeo/py/fs1-zwrk.go·16 993µs ± 0% 991µs ± 1% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 133µs ± 1% 134µs ± 1% +0.92% (p=0.016 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 229µs ± 1% 233µs ± 1% +1.47% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 345µs ± 1% 348µs ± 1% ~ (p=0.095 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 461µs ± 1% 467µs ± 1% ~ (p=0.095 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 917µs ± 0% 935µs ± 1% +1.87% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 1.39ms ± 1% 1.41ms ± 1% ~ (p=0.056 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 1.85ms ± 1% 1.87ms ± 1% ~ (p=0.095 n=5+5)
neo/py(!log)/sql-zwrk.go·1 180µs ± 2% 180µs ± 2% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·2 311µs ± 0% 315µs ± 1% +0.99% (p=0.032 n=5+5)
neo/py(!log)/sql-zwrk.go·3 468µs ± 0% 475µs ± 0% +1.47% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·4 627µs ± 1% 637µs ± 0% +1.59% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·8 1.25ms ± 1% 1.26ms ± 1% ~ (p=0.056 n=5+5)
neo/py(!log)/sql-zwrk.go·12 1.87ms ± 1% 1.89ms ± 1% +1.13% (p=0.016 n=5+5)
neo/py(!log)/sql-zwrk.go·16 2.50ms ± 2% 2.52ms ± 0% ~ (p=0.151 n=5+5)
neo/go/fs1-zwrk.go·1 42.0µs ± 0% 42.2µs ± 0% +0.33% (p=0.032 n=5+5)
neo/go/fs1-zwrk.go·2 44.5µs ± 1% 44.1µs ± 0% -0.92% (p=0.032 n=5+5)
neo/go/fs1-zwrk.go·3 54.5µs ± 1% 54.4µs ± 1% ~ (p=1.000 n=5+5)
neo/go/fs1-zwrk.go·4 66.5µs ± 0% 65.9µs ± 2% ~ (p=0.151 n=5+5)
neo/go/fs1-zwrk.go·8 117µs ± 2% 113µs ± 2% -3.59% (p=0.016 n=5+5)
neo/go/fs1-zwrk.go·12 173µs ± 4% 169µs ± 4% ~ (p=0.310 n=5+5)
neo/go/fs1-zwrk.go·16 233µs ± 6% 225µs ± 3% ~ (p=0.690 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 36.7µs ± 0% 36.6µs ± 0% ~ (p=0.095 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 36.4µs ± 1% 36.1µs ± 1% ~ (p=0.095 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 46.9µs ± 0% 46.9µs ± 1% ~ (p=0.841 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 58.2µs ± 1% 57.9µs ± 1% ~ (p=0.222 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 101µs ± 2% 99µs ± 2% ~ (p=0.222 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 154µs ± 2% 153µs ± 5% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 213µs ± 6% 212µs ± 3% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go·1 84.7µs ± 0% 85.1µs ± 1% ~ (p=0.095 n=5+5)
neo/go/sqlite-zwrk.go·2 104µs ± 0% 105µs ± 0% +0.86% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·3 123µs ± 1% 123µs ± 1% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go·4 150µs ± 1% 152µs ± 1% +1.40% (p=0.016 n=5+5)
neo/go/sqlite-zwrk.go·8 319µs ± 3% 321µs ± 3% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go·12 504µs ± 2% 500µs ± 5% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go·16 659µs ± 2% 630µs ± 1% -4.34% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 82.5µs ± 1% 82.0µs ± 0% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 102µs ± 0% 101µs ± 0% -0.97% (p=0.016 n=4+5)
neo/go/sqlite-zwrk.go(!sha1)·3 119µs ± 1% 115µs ± 1% -3.29% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 146µs ± 1% 139µs ± 1% -4.78% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 315µs ± 3% 295µs ± 3% -6.37% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 503µs ± 2% 474µs ± 2% -5.86% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 671µs ± 2% 632µs ± 1% -5.79% (p=0.008 n=5+5)

dabeb4b8

X z6001 localhost timings after switch to zwrk + stabilizing benchmark format. · 6a5c1f93
Kirill Smelkov authored Mar 06, 2018

6a5c1f93
X neo1 timings (ffixed, C not disabled) · 8748ba93
Kirill Smelkov authored Mar 06, 2018

8748ba93

05 Mar, 2018 6 commits

X save time not benchmarking things we do not show · b655da26
Kirill Smelkov authored Mar 05, 2018

b655da26

X deco-rio timings · a1dde3c9

Kirill Smelkov authored Mar 05, 2018

Latency is awful (> 500µs) because RX coalescing is not disabled on rio.

a1dde3c9

X rio localhost timings after switch to zwrk & stabilizing output format · 2d0b54ad
Kirill Smelkov authored Mar 05, 2018
```
Like in previous commit should not be changing compared to 39a77e3b, but
it was not checked.
```
2d0b54ad

X noturbo deco timings after switch to zwrk + stabilizing neotest output format · ea5f9d26

Kirill Smelkov authored Mar 05, 2018

Compared to 0ed7b1fc there should not be a difference (checked only on
serial cases with manually ediging 20180221-deco-noturbo-noz.txt-fix to
use updated output format for wczblk1-8 dataset):

$ benchstat -split node,cluster,dataset 20180221-deco-noturbo-noz.txt-fix 20180305-deco-noturbo-c.txt
name old pystone/s new pystone/s delta
node:deco
pystone 221k ± 0% 219k ± 3% ~ (p=0.690 n=5+5)

name old time/op new time/op delta
node:deco
sha1/py/1K 1.85µs ± 2% 1.84µs ± 1% ~ (p=0.508 n=5+5)
sha1/go/1K 1.53µs ± 0% 1.53µs ± 0% ~ (p=0.103 n=5+5)
sha1/py/4K 6.68µs ± 1% 6.69µs ± 0% ~ (p=0.151 n=5+5)
sha1/go/4K 5.59µs ± 0% 5.59µs ± 0% ~ (p=0.333 n=5+5)
sha1/py/2M 3.18ms ± 0% 3.18ms ± 0% ~ (p=0.421 n=5+5)
sha1/go/2M 2.78ms ± 0% 2.78ms ± 0% ~ (p=1.000 n=5+5)
unzlib/py/null-1K 2.81µs ± 0% 2.91µs ± 3% +3.49% (p=0.008 n=5+5)
unzlib/go/null-1K 2.86µs ± 0% 2.88µs ± 1% +0.93% (p=0.008 n=5+5)
unzlib/py/null-4K 11.3µs ± 1% 11.4µs ± 2% +0.89% (p=0.040 n=5+5)
unzlib/go/null-4K 11.3µs ± 0% 11.4µs ± 0% +0.89% (p=0.008 n=5+5)
unzlib/py/null-2M 5.71ms ± 5% 5.66ms ± 3% ~ (p=1.000 n=5+5)
unzlib/go/null-2M 4.79ms ± 0% 4.79ms ± 0% ~ (p=0.095 n=5+5)
unzlib/py/prod1-avg 5.02µs ± 1% 5.06µs ± 0% ~ (p=0.057 n=4+4)
unzlib/go/prod1-avg 5.27µs ± 1% 5.33µs ± 1% ~ (p=0.087 n=5+5)
unzlib/py/prod1-max 512µs ± 2% 438µs ± 5% -14.45% (p=0.008 n=5+5)
unzlib/go/prod1-max 336µs ± 0% 352µs ± 4% +4.67% (p=0.008 n=5+5)
disk/randread/direct/4K-min 105µs ± 1% 105µs ± 0% ~ (p=1.000 n=5+5)
disk/randread/direct/4K-avg 144µs ± 0% 142µs ± 0% -1.54% (p=0.008 n=5+5)
disk/randread/direct/2M-min 5.48ms ± 3% 5.34ms ± 3% ~ (p=0.135 n=5+5)
disk/randread/direct/2M-avg 6.13ms ± 1% 6.04ms ± 2% ~ (p=0.056 n=5+5)
disk/randread/pagecache/4K-min 570ns ± 1% 583ns ± 1% +2.28% (p=0.008 n=5+5)
disk/randread/pagecache/4K-avg 975ns ± 0% 1003ns ± 1% +2.91% (p=0.008 n=5+5)
disk/randread/pagecache/2M-min 195µs ± 4% 197µs ± 4% ~ (p=0.690 n=5+5)
disk/randread/pagecache/2M-avg 214µs ± 0% 220µs ± 1% +2.80% (p=0.008 n=5+5)

name old time/object new time/object delta
cluster:deco dataset:wczblk1-8
fs1-zhash.py 20.3µs ± 1% 20.2µs ± 1% ~ (p=0.444 n=5+4)
fs1-zhash.go 3.20µs ± 0% 3.20µs ± 0% ~ (all equal)
fs1-zhash.go+prefetch128 4.16µs ± 4% 4.14µs ± 6% ~ (p=0.952 n=5+5)
zeo/py/fs1-zhash.py 375µs ± 4% 379µs ± 3% ~ (p=0.690 n=5+5)
neo/py/sqlite-zhash.py 355µs ± 6% 362µs ± 6% ~ (p=0.421 n=5+5)
neo/py/sqlite-zhash.go 156µs ± 2% 158µs ± 1% ~ (p=0.151 n=5+5)
neo/py/sqlite-zhash.go+prefetch128 134µs ± 2% 135µs ± 1% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zhash.py 326µs ± 3% 335µs ± 4% ~ (p=0.381 n=5+5)
neo/py(!log)/sqlite-zhash.go 143µs ± 3% 145µs ± 2% ~ (p=0.508 n=5+5)
neo/py(!log)/sqlite-zhash.go+prefetch128 119µs ± 2% 118µs ± 1% ~ (p=0.421 n=5+5)
neo/py/sql-zhash.py 466µs ±45% 392µs ± 5% ~ (p=0.111 n=5+4)
neo/py/sql-zhash.go 201µs ± 2% 197µs ± 1% -1.63% (p=0.008 n=5+5)
neo/py/sql-zhash.go+prefetch128 184µs ± 2% 180µs ± 2% -1.96% (p=0.032 n=5+5)
neo/py(!log)/sql-zhash.py 375µs ± 2% 454µs ±61% ~ (p=0.286 n=4+5)
neo/py(!log)/sql-zhash.go 182µs ± 2% 183µs ± 1% ~ (p=0.802 n=5+5)
neo/py(!log)/sql-zhash.go+prefetch128 164µs ± 1% 164µs ± 2% ~ (p=0.881 n=5+5)
neo/go/fs1-zhash.py 226µs ± 1% 227µs ± 2% ~ (p=0.397 n=5+5)
neo/go/fs1-zhash.go 56.8µs ± 1% 56.9µs ± 1% ~ (p=0.889 n=5+5)
neo/go/fs1-zhash.go+prefetch128 24.8µs ± 3% 24.7µs ± 2% ~ (p=0.651 n=5+5)
neo/go/sqlite-zhash.py 264µs ± 4% 269µs ± 1% ~ (p=0.548 n=5+5)
neo/go/sqlite-zhash.go 93.5µs ± 0% 92.7µs ± 0% -0.83% (p=0.008 n=5+5)
neo/go/sqlite-zhash.go+prefetch128 39.3µs ± 4% 39.8µs ± 8% ~ (p=0.952 n=5+5)

( not sure what it was for unzlib/py/prod1-max - probaby some background process
was also running last time at that test )

ea5f9d26

. · 7c21fb98
Kirill Smelkov authored Mar 05, 2018

7c21fb98
X normalize/convert units, so that disk and ping/tcp latencies could be plotted too · 916782b6
Kirill Smelkov authored Mar 05, 2018

916782b6

04 Mar, 2018 9 commits
- . · 89682f01
  Kirill Smelkov authored Mar 04, 2018
  
  89682f01
- . · 2fd51bd0
  Kirill Smelkov authored Mar 04, 2018
  
  2fd51bd0
- . · 5369d45c
  Kirill Smelkov authored Mar 04, 2018
  
  5369d45c
- . · 12722462
  Kirill Smelkov authored Mar 04, 2018
  
  12722462
- . · fc4a7c11
  Kirill Smelkov authored Mar 04, 2018
  
  fc4a7c11
- . · 37d24e29
  Kirill Smelkov authored Mar 04, 2018
  
  37d24e29
- . · 5e042262
  Kirill Smelkov authored Mar 04, 2018
  
  5e042262
- . · 0c4e10dd
  Kirill Smelkov authored Mar 04, 2018
  
  0c4e10dd
- . · 9eae441c
  Kirill Smelkov authored Mar 04, 2018
  
  9eae441c
02 Mar, 2018 6 commits
- . · 16ac482c
  Kirill Smelkov authored Mar 02, 2018
  
  16ac482c
- X switch node info to labels; start adding that to plot · f5fec740
  Kirill Smelkov authored Mar 02, 2018
  
  f5fec740
- . · 28d00786
  Kirill Smelkov authored Mar 02, 2018
  
  28d00786
- . · 1d1e8ba6
  Kirill Smelkov authored Mar 02, 2018
  
  1d1e8ba6
- . · 12d6f138
  Kirill Smelkov authored Mar 02, 2018
  
  12d6f138
- X benchlib/benchstat: Emit label:value info for several labels on one line, similary to go version · a9b10a45
  Kirill Smelkov authored Mar 02, 2018
  
  a9b10a45
01 Mar, 2018 2 commits
- . · 32fc8327
  Kirill Smelkov authored Mar 02, 2018
  
  32fc8327
- . · c1300da3
  Kirill Smelkov authored Mar 01, 2018
  
  c1300da3
28 Feb, 2018 7 commits
- . · 6ade4c8c
  Kirill Smelkov authored Mar 01, 2018
  
  6ade4c8c
- . · f4b40c52
  Kirill Smelkov authored Feb 28, 2018
  
  f4b40c52
- . · 1b2bc5a8
  Kirill Smelkov authored Feb 28, 2018
  
  1b2bc5a8
- X neotest: Move cluster / node out fro benchmark name to label in environment · 906462a3
  Kirill Smelkov authored Feb 28, 2018
```
This should make inter-host or inter-cluster comparisions of benchmark more straightforward.
```
  906462a3
- X z600: localhost timings with upgraded everything and disabled HT · 321dfcc7
  Kirill Smelkov authored Feb 28, 2018
```
Cstates are not disabled.
First dataset graphed here:

https://lab.nexedi.com/kirr/misc/raw/526e5ca/t/zwrk-z600-htoff.png
```
  321dfcc7
- X z6001: localhost timings with upgraded everything · 97f35994
  Kirill Smelkov authored Feb 28, 2018
```
Cstates are not disabled.
First dataset grpahed here:

https://lab.nexedi.com/kirr/misc/raw/4a8fedc/t/zwrk-z6001.png
```
  97f35994
- X neotest: Prefer first part of FQDN for hostname · 2910cf56
  Kirill Smelkov authored Feb 28, 2018
```
Handy for misconfigured systems like fqdn=z6001.ivan.nexedi.com,
hostname=z6001-COMP-2784.
```
  2910cf56