t/time/20180308-rio-ffixed-c-zwrk10s.txt · 9282fca1a79b949d6420b0b2781172ab0bfa53c9 · Kirill Smelkov / neo

X rio: localhost timings, Cenabled, zwrk@10s · 9282fca1

Kirill Smelkov authored Mar 09, 2018

Compared to zwrk@1s it helps but only a very tiny tiny bit: Besides
everything else that might be noise the improvements are:

---- 8< ----
cluster:rio dataset:prod1-1024
neo/go/fs1-zwrk.go·16 200µs ± 3% 179µs ± 3% -10.62% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 128µs ± 2% 116µs ± 5% -9.16% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 178µs ± 3% 149µs ± 2% -16.06% (p=0.008 n=5+5)
---- 8< ----

and noise on neo/py/sql is back:

---- 8< ----
cluster:rio dataset:wczblk1-8
neo/py(!log)/sql-zhash.py 342µs ± 2% 406µs ±39% ~ (p=0.063 n=4+5)
---- 8< ----

The next commit will add measurements with C-states disabled.

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

$ benchstat -split node,cluster,dataset 20180308-rio-ffixed-c-zwrk1s.txt 20180308-rio-ffixed-c-zwrk10s.txt

name old pystone/s new pystone/s delta
node:rio
pystone 144k ± 3% 140k ±12% ~ (p=0.690 n=5+5)

name old time/op new time/op delta
node:rio
crc32/py/4K 4.79µs ± 1% 4.79µs ± 1% ~ (p=0.889 n=5+5)
crc32/go/4K 1.49µs ± 0% 1.49µs ± 0% ~ (p=0.873 n=5+4)
sha1/py/4K 7.98µs ± 1% 8.02µs ± 2% ~ (p=0.548 n=5+5)
sha1/go/4K 9.29µs ±12% 8.93µs ± 0% ~ (p=0.111 n=5+4)
unzlib/py/wczdata 25.2µs ± 1% 25.2µs ± 1% ~ (p=0.690 n=5+5)
unzlib/go/wczdata 23.0µs ± 0% 23.0µs ± 0% +0.17% (p=0.016 n=5+5)
unzlib/py/prod1-avg 7.26µs ± 3% 7.27µs ± 1% ~ (p=1.000 n=5+5)
unzlib/go/prod1-avg 5.06µs ± 1% 5.07µs ± 2% ~ (p=0.690 n=5+5)
disk/randread/direct/4K-min 93.0µs ± 0% 93.1µs ± 1% ~ (p=0.690 n=5+5)
disk/randread/direct/4K-avg 116µs ± 1% 116µs ± 0% ~ (p=0.373 n=5+5)
disk/randread/pagecache/4K-min 570ns ± 1% 570ns ± 1% ~ (p=1.000 n=5+5)
disk/randread/pagecache/4K-avg 995ns ± 0% 999ns ± 1% ~ (p=0.135 n=5+5)

name old time/object new time/object delta
cluster:rio dataset:wczblk1-8
fs1-zhash.py 28.9µs ± 1% 29.0µs ± 5% ~ (p=0.730 n=4+5)
fs1-zhash.go 4.60µs ± 0% 4.60µs ± 0% ~ (all equal)
fs1-zhash.go+prefetch128 4.62µs ± 3% 4.74µs ± 3% ~ (p=0.119 n=5+5)
zeo/py/fs1-zhash.py 412µs ± 4% 398µs ± 1% ~ (p=0.095 n=5+5)
zeo/py/fs1-zhash.go 139µs ± 3% 138µs ± 1% ~ (p=0.889 n=5+5)
zeo/py/fs1-zhash.go+prefetch128 75.2µs ± 5% 74.5µs ± 2% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zhash.py 315µs ± 3% 321µs ± 4% ~ (p=0.246 n=5+5)
neo/py(!log)/sqlite-zhash.go 156µs ± 6% 155µs ± 2% ~ (p=0.548 n=5+5)
neo/py(!log)/sqlite-zhash.go+prefetch128 125µs ± 2% 122µs ± 1% -2.28% (p=0.032 n=5+5)
neo/py(!log)/sql-zhash.py 342µs ± 2% 406µs ±39% ~ (p=0.063 n=4+5)
neo/py(!log)/sql-zhash.go 178µs ± 2% 181µs ± 6% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zhash.go+prefetch128 159µs ± 2% 160µs ± 2% ~ (p=1.000 n=5+5)
neo/go/fs1-zhash.py 224µs ± 4% 223µs ± 6% ~ (p=0.548 n=5+5)
neo/go/fs1-zhash.go 67.0µs ± 1% 67.2µs ± 1% ~ (p=0.810 n=5+5)
neo/go/fs1-zhash.go+prefetch128 28.3µs ± 1% 28.8µs ± 3% ~ (p=0.175 n=5+5)
neo/go/fs1(!sha1)-zhash.go(!sha1) 45.0µs ± 6% 43.9µs ± 2% ~ (p=0.516 n=5+5)
neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 19.0µs ± 3% 18.7µs ± 4% ~ (p=0.365 n=5+5)
neo/go/sqlite-zhash.py 266µs ± 2% 264µs ± 1% ~ (p=1.000 n=5+5)
neo/go/sqlite-zhash.go 103µs ± 2% 105µs ± 1% ~ (p=0.143 n=5+5)
neo/go/sqlite-zhash.go+prefetch128 37.6µs ± 2% 37.9µs ± 9% ~ (p=0.690 n=5+5)
neo/go/sqlite-zhash.go(!sha1) 94.7µs ± 1% 94.4µs ± 3% ~ (p=0.500 n=5+5)
neo/go/sqlite-zhash.go+prefetch128(!sha1) 35.1µs ± 6% 36.9µs ± 6% ~ (p=0.230 n=5+5)
cluster:rio dataset:prod1-1024
fs1-zhash.py 24.2µs ± 1% 24.1µs ± 1% ~ (p=0.540 n=4+5)
fs1-zhash.go 3.40µs ± 0% 3.40µs ± 0% ~ (all equal)
fs1-zhash.go+prefetch128 3.06µs ± 2% 3.00µs ± 0% ~ (p=0.095 n=5+4)
zeo/py/fs1-zhash.py 368µs ± 1% 352µs ± 1% -4.55% (p=0.008 n=5+5)
zeo/py/fs1-zhash.go 115µs ± 2% 116µs ± 2% ~ (p=0.730 n=5+5)
zeo/py/fs1-zhash.go+prefetch128 65.6µs ± 1% 65.9µs ± 1% ~ (p=0.508 n=5+5)
neo/py(!log)/sqlite-zhash.py 316µs ± 6% 326µs ± 8% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zhash.go 142µs ± 5% 142µs ± 2% ~ (p=0.841 n=5+5)
neo/py(!log)/sqlite-zhash.go+prefetch128 116µs ± 1% 116µs ± 1% ~ (p=0.690 n=5+5)
neo/py(!log)/sql-zhash.py 339µs ± 5% 342µs ± 4% ~ (p=1.000 n=4+4)
neo/py(!log)/sql-zhash.go 172µs ± 1% 173µs ± 3% ~ (p=0.579 n=5+5)
neo/py(!log)/sql-zhash.go+prefetch128 150µs ± 1% 148µs ± 2% ~ (p=0.151 n=5+5)
neo/go/fs1-zhash.py 219µs ± 2% 220µs ± 4% ~ (p=1.000 n=5+5)
neo/go/fs1-zhash.go 49.9µs ± 1% 49.7µs ± 1% ~ (p=0.421 n=5+5)
neo/go/fs1-zhash.go+prefetch128 19.1µs ± 3% 18.9µs ± 3% ~ (p=0.540 n=5+5)
neo/go/fs1(!sha1)-zhash.go(!sha1) 41.1µs ± 2% 40.7µs ± 1% ~ (p=0.333 n=5+5)
neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 16.2µs ± 5% 16.2µs ± 2% ~ (p=0.873 n=5+5)
neo/go/sqlite-zhash.py 261µs ± 5% 261µs ± 2% ~ (p=1.000 n=5+5)
neo/go/sqlite-zhash.go 94.3µs ± 1% 93.3µs ± 1% ~ (p=0.087 n=5+5)
neo/go/sqlite-zhash.go+prefetch128 33.6µs ± 5% 33.3µs ± 3% ~ (p=0.810 n=5+5)
neo/go/sqlite-zhash.go(!sha1) 90.3µs ± 2% 89.9µs ± 1% ~ (p=0.738 n=5+5)
neo/go/sqlite-zhash.go+prefetch128(!sha1) 33.0µs ± 4% 33.0µs ± 1% ~ (p=0.952 n=5+5)

name old req/s new req/s delta
cluster:rio dataset:wczblk1-8
fs1-zwrk.go·1 301k ± 0% 300k ± 0% ~ (p=0.056 n=5+5)
fs1-zwrk.go·2 550k ± 3% 550k ± 0% ~ (p=0.548 n=5+5)
fs1-zwrk.go·3 817k ± 1% 816k ± 0% ~ (p=1.000 n=5+5)
fs1-zwrk.go·4 1.08M ± 0% 1.08M ± 0% ~ (p=0.310 n=5+5)
fs1-zwrk.go·8 1.42M ± 0% 1.43M ± 0% ~ (p=0.056 n=5+5)
fs1-zwrk.go·12 1.55M ± 0% 1.55M ± 0% ~ (p=0.548 n=5+5)
fs1-zwrk.go·16 1.55M ± 0% 1.55M ± 1% ~ (p=0.841 n=5+5)
zeo/py/fs1-zwrk.go·1 7.38k ± 1% 7.40k ± 0% ~ (p=0.222 n=5+5)
zeo/py/fs1-zwrk.go·2 8.96k ± 2% 8.89k ± 0% ~ (p=0.690 n=5+5)
zeo/py/fs1-zwrk.go·3 9.66k ± 3% 9.62k ± 1% ~ (p=0.690 n=5+5)
zeo/py/fs1-zwrk.go·4 9.87k ± 1% 9.91k ± 0% ~ (p=0.222 n=5+5)
zeo/py/fs1-zwrk.go·8 10.3k ± 1% 10.3k ± 0% ~ (p=0.222 n=5+5)
zeo/py/fs1-zwrk.go·12 10.4k ± 1% 10.4k ± 1% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·16 10.5k ± 1% 10.5k ± 1% ~ (p=0.548 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 6.88k ± 2% 6.82k ± 1% ~ (p=0.151 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 8.63k ± 3% 8.63k ± 1% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 8.66k ± 0% 8.56k ± 2% ~ (p=0.111 n=4+5)
neo/py(!log)/sqlite-zwrk.go·4 8.71k ± 1% 8.54k ± 1% -1.95% (p=0.016 n=4+5)
neo/py(!log)/sqlite-zwrk.go·8 8.60k ± 2% 8.53k ± 1% ~ (p=0.310 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 8.63k ± 2% 8.56k ± 0% ~ (p=0.190 n=5+4)
neo/py(!log)/sqlite-zwrk.go·16 8.54k ± 3% 8.53k ± 1% ~ (p=0.548 n=5+5)
neo/py(!log)/sql-zwrk.go·1 5.69k ± 1% 5.57k ± 2% -2.20% (p=0.032 n=5+5)
neo/py(!log)/sql-zwrk.go·2 6.73k ± 5% 6.64k ± 2% ~ (p=0.222 n=5+5)
neo/py(!log)/sql-zwrk.go·3 6.69k ± 2% 6.60k ± 1% ~ (p=0.222 n=5+5)
neo/py(!log)/sql-zwrk.go·4 6.60k ±11% 6.54k ± 2% ~ (p=0.151 n=5+5)
neo/py(!log)/sql-zwrk.go·8 6.65k ± 2% 6.64k ± 1% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·12 6.58k ±11% 6.64k ± 2% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·16 6.70k ± 1% 6.62k ± 2% ~ (p=0.413 n=4+5)
neo/go/fs1-zwrk.go·1 15.7k ± 0% 15.6k ± 0% ~ (p=0.095 n=5+5)
neo/go/fs1-zwrk.go·2 30.3k ± 0% 30.0k ± 0% -1.12% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·3 39.8k ± 0% 39.6k ± 0% -0.49% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·4 49.7k ± 0% 49.5k ± 0% -0.41% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·8 68.7k ± 1% 69.0k ± 0% ~ (p=0.222 n=5+5)
neo/go/fs1-zwrk.go·12 73.0k ± 0% 73.3k ± 0% ~ (p=0.095 n=5+5)
neo/go/fs1-zwrk.go·16 73.9k ± 0% 74.2k ± 0% +0.38% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 25.6k ± 3% 25.6k ± 1% ~ (p=0.690 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 47.8k ± 0% 47.3k ± 0% -1.02% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 59.6k ± 0% 59.5k ± 0% ~ (p=0.056 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 72.7k ± 0% 72.2k ± 0% -0.66% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 97.0k ± 0% 96.6k ± 0% ~ (p=0.056 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 109k ± 1% 110k ± 0% ~ (p=0.222 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 113k ± 1% 114k ± 0% ~ (p=0.056 n=5+5)
neo/go/sqlite-zwrk.go·1 9.88k ± 1% 9.89k ± 0% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go·2 18.4k ± 0% 18.1k ± 0% -1.38% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·3 25.5k ± 0% 25.0k ± 0% -2.00% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·4 30.4k ± 0% 29.7k ± 0% -2.24% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·8 39.5k ± 0% 38.1k ± 0% -3.72% (p=0.016 n=5+4)
neo/go/sqlite-zwrk.go·12 40.9k ± 1% 40.5k ± 2% ~ (p=0.095 n=5+5)
neo/go/sqlite-zwrk.go·16 40.4k ± 2% 41.3k ± 1% +2.15% (p=0.032 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 11.0k ± 1% 11.0k ± 0% ~ (p=0.310 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 19.9k ± 0% 19.6k ± 0% -1.25% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 27.7k ± 0% 27.2k ± 0% -1.89% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 34.0k ± 1% 33.1k ± 0% -2.60% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 43.8k ± 1% 42.4k ± 2% -3.00% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 42.8k ± 2% 42.8k ± 1% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 40.9k ± 2% 42.8k ± 3% +4.65% (p=0.008 n=5+5)
cluster:rio dataset:prod1-1024
fs1-zwrk.go·1 462k ± 1% 460k ± 1% ~ (p=0.690 n=5+5)
fs1-zwrk.go·2 910k ± 1% 901k ± 2% ~ (p=0.095 n=5+5)
fs1-zwrk.go·3 1.35M ± 0% 1.34M ± 1% -1.12% (p=0.032 n=5+5)
fs1-zwrk.go·4 1.79M ± 1% 1.78M ± 0% -0.73% (p=0.016 n=5+5)
fs1-zwrk.go·8 2.38M ± 1% 2.37M ± 1% ~ (p=0.548 n=5+5)
fs1-zwrk.go·12 2.40M ± 1% 2.40M ± 0% ~ (p=0.421 n=5+5)
fs1-zwrk.go·16 2.40M ± 0% 2.40M ± 0% ~ (p=0.841 n=5+5)
zeo/py/fs1-zwrk.go·1 8.91k ± 2% 8.87k ± 0% ~ (p=0.310 n=5+5)
zeo/py/fs1-zwrk.go·2 11.7k ± 1% 11.4k ± 1% -2.04% (p=0.016 n=5+5)
zeo/py/fs1-zwrk.go·3 13.0k ± 1% 12.6k ± 1% -3.20% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·4 13.4k ± 2% 13.1k ± 1% ~ (p=0.056 n=5+5)
zeo/py/fs1-zwrk.go·8 14.2k ± 2% 13.7k ± 0% -3.44% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·12 14.1k ± 2% 13.8k ± 1% -1.88% (p=0.032 n=5+5)
zeo/py/fs1-zwrk.go·16 14.4k ± 2% 13.9k ± 1% -3.29% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 7.12k ± 2% 7.23k ± 0% ~ (p=0.095 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 8.37k ± 6% 8.71k ± 1% +4.06% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 8.60k ± 1% 8.71k ± 1% +1.25% (p=0.032 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 8.40k ± 8% 8.69k ± 1% ~ (p=0.310 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 8.61k ± 3% 8.75k ± 1% ~ (p=0.310 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 8.56k ± 2% 8.66k ± 2% ~ (p=0.151 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 8.46k ± 5% 8.67k ± 2% ~ (p=0.222 n=5+5)
neo/py(!log)/sql-zwrk.go·1 5.78k ± 5% 5.83k ± 1% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·2 6.77k ± 4% 6.83k ± 1% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zwrk.go·3 6.85k ± 1% 6.80k ± 1% ~ (p=0.095 n=5+5)
neo/py(!log)/sql-zwrk.go·4 6.79k ± 2% 6.76k ± 2% ~ (p=0.794 n=5+5)
neo/py(!log)/sql-zwrk.go·8 6.80k ± 5% 6.68k ± 2% ~ (p=0.222 n=5+5)
neo/py(!log)/sql-zwrk.go·12 6.50k ± 5% 6.84k ± 2% ~ (p=0.095 n=5+5)
neo/py(!log)/sql-zwrk.go·16 6.81k ± 1% 6.81k ± 1% ~ (p=1.000 n=5+5)
neo/go/fs1-zwrk.go·1 21.6k ± 1% 21.8k ± 0% ~ (p=0.095 n=5+5)
neo/go/fs1-zwrk.go·2 39.2k ± 1% 39.2k ± 0% ~ (p=0.690 n=5+5)
neo/go/fs1-zwrk.go·3 51.3k ± 0% 51.4k ± 0% ~ (p=0.310 n=5+5)
neo/go/fs1-zwrk.go·4 62.7k ± 0% 62.9k ± 0% +0.30% (p=0.016 n=5+5)
neo/go/fs1-zwrk.go·8 81.7k ± 1% 82.9k ± 2% +1.50% (p=0.032 n=5+5)
neo/go/fs1-zwrk.go·12 82.1k ± 3% 88.0k ± 2% +7.14% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·16 80.1k ± 3% 89.6k ± 3% +11.90% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 26.5k ± 1% 26.6k ± 0% ~ (p=0.690 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 49.1k ± 0% 48.7k ± 0% -0.65% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 62.2k ± 0% 62.0k ± 0% ~ (p=0.151 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 74.2k ± 0% 74.4k ± 0% ~ (p=0.421 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 92.4k ± 1% 94.2k ± 0% +2.01% (p=0.016 n=5+4)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 94.1k ± 2% 103.6k ± 5% +10.13% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 90.0k ± 3% 107.2k ± 2% +19.10% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·1 10.9k ± 1% 11.1k ± 1% +1.37% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·2 19.3k ± 0% 19.4k ± 0% +0.80% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·3 26.4k ± 1% 26.7k ± 0% +0.86% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·4 31.8k ± 0% 32.1k ± 0% +1.02% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·8 38.1k ± 3% 37.4k ± 2% ~ (p=0.310 n=5+5)
neo/go/sqlite-zwrk.go·12 37.1k ± 2% 35.8k ± 3% -3.52% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·16 36.3k ± 2% 35.0k ± 3% -3.60% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 11.5k ± 1% 11.5k ± 0% ~ (p=0.056 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 20.1k ± 0% 19.9k ± 1% -0.77% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 27.6k ± 0% 27.3k ± 1% -1.08% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 33.5k ± 2% 33.1k ± 0% -1.32% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 40.0k ± 1% 37.6k ± 2% -5.99% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 37.9k ± 0% 36.3k ± 4% -4.29% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 36.7k ± 1% 35.2k ± 3% -3.99% (p=0.008 n=5+5)

name old latency-time/object new latency-time/object delta
cluster:rio dataset:wczblk1-8
fs1-zwrk.go·1 3.32µs ± 0% 3.33µs ± 0% +0.42% (p=0.048 n=5+5)
fs1-zwrk.go·2 3.64µs ± 3% 3.63µs ± 0% ~ (p=0.500 n=5+5)
fs1-zwrk.go·3 3.67µs ± 1% 3.68µs ± 0% ~ (p=0.937 n=5+5)
fs1-zwrk.go·4 3.70µs ± 0% 3.70µs ± 0% ~ (p=0.381 n=5+5)
fs1-zwrk.go·8 5.62µs ± 0% 5.60µs ± 0% ~ (p=0.056 n=5+5)
fs1-zwrk.go·12 7.76µs ± 0% 7.75µs ± 0% ~ (p=0.516 n=5+5)
fs1-zwrk.go·16 10.3µs ± 0% 10.3µs ± 1% ~ (p=0.746 n=5+5)
zeo/py/fs1-zwrk.go·1 136µs ± 1% 135µs ± 0% ~ (p=0.222 n=5+5)
zeo/py/fs1-zwrk.go·2 223µs ± 2% 225µs ± 0% ~ (p=0.690 n=5+5)
zeo/py/fs1-zwrk.go·3 311µs ± 3% 312µs ± 1% ~ (p=0.690 n=5+5)
zeo/py/fs1-zwrk.go·4 405µs ± 1% 403µs ± 0% ~ (p=0.222 n=5+5)
zeo/py/fs1-zwrk.go·8 774µs ± 1% 778µs ± 0% ~ (p=0.222 n=5+5)
zeo/py/fs1-zwrk.go·12 1.15ms ± 1% 1.15ms ± 1% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·16 1.52ms ± 1% 1.53ms ± 1% ~ (p=0.548 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 145µs ± 2% 147µs ± 1% ~ (p=0.151 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 232µs ± 3% 232µs ± 1% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 347µs ± 0% 350µs ± 2% ~ (p=0.111 n=4+5)
neo/py(!log)/sqlite-zwrk.go·4 459µs ± 1% 469µs ± 1% +1.99% (p=0.016 n=4+5)
neo/py(!log)/sqlite-zwrk.go·8 930µs ± 2% 938µs ± 1% ~ (p=0.310 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 1.39ms ± 2% 1.40ms ± 0% ~ (p=0.190 n=5+4)
neo/py(!log)/sqlite-zwrk.go·16 1.87ms ± 3% 1.88ms ± 1% ~ (p=0.548 n=5+5)
neo/py(!log)/sql-zwrk.go·1 176µs ± 1% 180µs ± 2% +2.26% (p=0.032 n=5+5)
neo/py(!log)/sql-zwrk.go·2 298µs ± 5% 301µs ± 2% ~ (p=0.222 n=5+5)
neo/py(!log)/sql-zwrk.go·3 449µs ± 2% 454µs ± 1% ~ (p=0.222 n=5+5)
neo/py(!log)/sql-zwrk.go·4 589µs ± 1% 612µs ± 2% +3.90% (p=0.016 n=4+5)
neo/py(!log)/sql-zwrk.go·8 1.20ms ± 2% 1.20ms ± 1% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·12 1.83ms ±12% 1.81ms ± 2% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·16 2.39ms ± 1% 2.42ms ± 2% ~ (p=0.413 n=4+5)
neo/go/fs1-zwrk.go·1 63.9µs ± 0% 64.1µs ± 0% ~ (p=0.095 n=5+5)
neo/go/fs1-zwrk.go·2 66.0µs ± 0% 66.7µs ± 0% +1.14% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·3 75.4µs ± 0% 75.8µs ± 0% +0.50% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·4 80.5µs ± 0% 80.8µs ± 0% +0.41% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·8 116µs ± 1% 116µs ± 0% ~ (p=0.222 n=5+5)
neo/go/fs1-zwrk.go·12 164µs ± 0% 164µs ± 0% ~ (p=0.095 n=5+5)
neo/go/fs1-zwrk.go·16 217µs ± 0% 216µs ± 0% -0.37% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 39.0µs ± 3% 39.1µs ± 1% ~ (p=0.690 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 41.8µs ± 0% 42.2µs ± 0% +1.03% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 50.3µs ± 0% 50.4µs ± 0% ~ (p=0.056 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 55.0µs ± 0% 55.4µs ± 0% +0.66% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 82.5µs ± 0% 82.8µs ± 0% ~ (p=0.056 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 110µs ± 1% 109µs ± 0% ~ (p=0.222 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 142µs ± 1% 141µs ± 0% ~ (p=0.056 n=5+5)
neo/go/sqlite-zwrk.go·1 101µs ± 1% 101µs ± 0% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go·2 109µs ± 0% 110µs ± 0% +1.40% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·3 118µs ± 0% 120µs ± 0% +2.04% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·4 132µs ± 0% 135µs ± 0% +2.29% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·8 202µs ± 0% 210µs ± 0% +3.86% (p=0.016 n=5+4)
neo/go/sqlite-zwrk.go·12 294µs ± 1% 297µs ± 2% ~ (p=0.095 n=5+5)
neo/go/sqlite-zwrk.go·16 396µs ± 3% 388µs ± 1% -2.11% (p=0.032 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 91.1µs ± 1% 90.9µs ± 0% ~ (p=0.310 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 101µs ± 0% 102µs ± 0% +1.26% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 108µs ± 0% 110µs ± 0% +1.92% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 118µs ± 1% 121µs ± 0% +2.67% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 183µs ± 1% 188µs ± 2% +3.10% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 280µs ± 2% 280µs ± 2% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 391µs ± 2% 374µs ± 3% -4.44% (p=0.008 n=5+5)
cluster:rio dataset:prod1-1024
fs1-zwrk.go·1 2.17µs ± 1% 2.17µs ± 1% ~ (p=0.738 n=5+5)
fs1-zwrk.go·2 2.20µs ± 0% 2.22µs ± 1% ~ (p=0.103 n=5+5)
fs1-zwrk.go·3 2.21µs ± 0% 2.24µs ± 1% +1.15% (p=0.024 n=5+5)
fs1-zwrk.go·4 2.23µs ± 1% 2.25µs ± 0% +0.73% (p=0.024 n=5+5)
fs1-zwrk.go·8 3.37µs ± 1% 3.38µs ± 1% ~ (p=0.548 n=5+5)
fs1-zwrk.go·12 5.00µs ± 1% 5.00µs ± 0% ~ (p=0.310 n=5+5)
fs1-zwrk.go·16 6.67µs ± 0% 6.67µs ± 0% ~ (p=0.841 n=5+5)
zeo/py/fs1-zwrk.go·1 112µs ± 2% 113µs ± 0% ~ (p=0.310 n=5+5)
zeo/py/fs1-zwrk.go·2 171µs ± 1% 175µs ± 1% +2.08% (p=0.016 n=5+5)
zeo/py/fs1-zwrk.go·3 230µs ± 1% 238µs ± 1% +3.31% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·4 298µs ± 2% 306µs ± 1% ~ (p=0.056 n=5+5)
zeo/py/fs1-zwrk.go·8 562µs ± 2% 582µs ± 0% +3.55% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·12 852µs ± 2% 868µs ± 1% +1.91% (p=0.032 n=5+5)
zeo/py/fs1-zwrk.go·16 1.11ms ± 2% 1.15ms ± 1% +3.39% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 141µs ± 2% 138µs ± 0% ~ (p=0.095 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 239µs ± 6% 230µs ± 1% -3.99% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 349µs ± 1% 344µs ± 1% -1.24% (p=0.032 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 477µs ± 9% 461µs ± 1% ~ (p=0.310 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 929µs ± 3% 914µs ± 1% ~ (p=0.310 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 1.40ms ± 2% 1.39ms ± 2% ~ (p=0.151 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 1.89ms ± 5% 1.85ms ± 2% ~ (p=0.222 n=5+5)
neo/py(!log)/sql-zwrk.go·1 173µs ± 6% 172µs ± 1% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·2 295µs ± 4% 293µs ± 1% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zwrk.go·3 438µs ± 1% 441µs ± 1% ~ (p=0.095 n=5+5)
neo/py(!log)/sql-zwrk.go·4 589µs ± 2% 592µs ± 2% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zwrk.go·8 1.18ms ± 6% 1.20ms ± 3% ~ (p=0.222 n=5+5)
neo/py(!log)/sql-zwrk.go·12 1.85ms ± 5% 1.75ms ± 2% ~ (p=0.095 n=5+5)
neo/py(!log)/sql-zwrk.go·16 2.35ms ± 1% 2.35ms ± 1% ~ (p=1.000 n=5+5)
neo/go/fs1-zwrk.go·1 46.3µs ± 1% 45.9µs ± 0% ~ (p=0.095 n=5+5)
neo/go/fs1-zwrk.go·2 51.0µs ± 1% 51.0µs ± 0% ~ (p=0.690 n=5+5)
neo/go/fs1-zwrk.go·3 58.4µs ± 0% 58.4µs ± 0% ~ (p=0.310 n=5+5)
neo/go/fs1-zwrk.go·4 63.8µs ± 0% 63.6µs ± 0% -0.30% (p=0.016 n=5+5)
neo/go/fs1-zwrk.go·8 97.9µs ± 1% 96.5µs ± 2% -1.48% (p=0.032 n=5+5)
neo/go/fs1-zwrk.go·12 146µs ± 3% 136µs ± 2% -6.67% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·16 200µs ± 3% 179µs ± 3% -10.62% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 37.7µs ± 1% 37.6µs ± 0% ~ (p=0.690 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 40.8µs ± 0% 41.0µs ± 0% +0.66% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 48.3µs ± 0% 48.4µs ± 0% ~ (p=0.151 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 53.9µs ± 0% 53.8µs ± 0% ~ (p=0.421 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 86.6µs ± 1% 84.9µs ± 0% -1.98% (p=0.016 n=5+4)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 128µs ± 2% 116µs ± 5% -9.16% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 178µs ± 3% 149µs ± 2% -16.06% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·1 91.7µs ± 1% 90.5µs ± 1% -1.35% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·2 104µs ± 0% 103µs ± 0% -0.80% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·3 113µs ± 1% 112µs ± 0% -0.86% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·4 126µs ± 0% 124µs ± 0% -1.01% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·8 210µs ± 3% 214µs ± 3% ~ (p=0.310 n=5+5)
neo/go/sqlite-zwrk.go·12 324µs ± 2% 336µs ± 3% +3.66% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·16 441µs ± 2% 458µs ± 3% +3.75% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 87.2µs ± 1% 86.6µs ± 0% ~ (p=0.056 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 100µs ± 0% 100µs ± 1% +0.77% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 109µs ± 0% 110µs ± 1% +1.09% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 119µs ± 2% 121µs ± 0% +1.33% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 200µs ± 1% 213µs ± 2% +6.39% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 316µs ± 0% 331µs ± 4% +4.54% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 436µs ± 1% 454µs ± 3% +4.17% (p=0.008 n=5+5)

9282fca1

20180308-rio-ffixed-c-zwrk10s.txt 138 KB

Replace 20180308-rio-ffixed-c-zwrk10s.txt