Commits · e0d875bc499ca5d973cfee526d8f7c54ec882323 · Stefane Fermigier / neo

21 Mar, 2018 1 commit
- X neotest: Teach it to benchmark NEO with storage partitioned to several nodes · e0d875bc
  Kirill Smelkov authored Mar 21, 2018
```
With default still being 1 partition. To be tested on field. Benchplot
to be updated for new benchmark namings.
```
  e0d875bc
19 Mar, 2018 1 commit

Kirill Smelkov authored Mar 19, 2018

Similarly to deco, neo1 and rio, neo/go/sqlite is speed-up a bit. And
everything else close to noise.

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

$ benchstat -split node,cluster,dataset 20180308-z6001-ffixed-noc_C1$3µs$-zwrk1s.txt 20180319-z6001.txt

name old pystone/s new pystone/s delta
node:z6001
pystone 115k ± 1% 113k ± 1% -1.35% (p=0.016 n=5+5)

name old time/op new time/op delta
node:z6001
crc32/py/4K 5.12µs ± 2% 5.13µs ± 3% ~ (p=1.000 n=5+5)
crc32/go/4K 1.72µs ± 0% 1.76µs ± 5% ~ (p=0.794 n=4+5)
sha1/py/4K 14.7µs ± 1% 14.7µs ± 1% ~ (p=0.841 n=5+5)
sha1/go/4K 10.3µs ± 0% 12.7µs ±30% ~ (p=0.079 n=4+5)
unzlib/py/wczdata 36.5µs ± 1% 39.3µs ± 9% ~ (p=0.548 n=5+5)
unzlib/go/wczdata 31.2µs ± 0% 31.2µs ± 0% ~ (p=0.222 n=5+5)
unzlib/py/prod1-avg 18.6µs ± 1% 19.6µs ±11% ~ (p=0.730 n=4+5)
unzlib/go/prod1-avg 9.87µs ± 1% 9.88µs ± 1% ~ (p=1.000 n=5+5)
disk/randread/direct/4K-min 127µs ± 1% 126µs ± 1% ~ (p=0.270 n=5+5)
disk/randread/direct/4K-avg 168µs ± 0% 168µs ± 1% ~ (p=0.151 n=5+5)
disk/randread/pagecache/4K-min 788ns ± 1% 784ns ± 1% ~ (p=0.270 n=5+5)
disk/randread/pagecache/4K-avg 1.50µs ± 3% 1.47µs ±10% ~ (p=0.635 n=5+5)

name old time/object new time/object delta
cluster:z6001 dataset:wczblk1-8
fs1-zhash.py 37.6µs ± 1% 38.1µs ± 2% ~ (p=0.111 n=5+4)
fs1-zhash.go 5.98µs ± 2% 6.28µs ±19% ~ (p=0.794 n=5+5)
fs1-zhash.go+prefetch128 7.34µs ± 5% 7.20µs ± 4% ~ (p=0.603 n=5+5)
zeo/py/fs1-zhash.py 590µs ± 4% 591µs ± 8% ~ (p=0.421 n=5+5)
zeo/py/fs1-zhash.go 201µs ± 3% 201µs ± 2% ~ (p=0.841 n=5+5)
zeo/py/fs1-zhash.go+prefetch128 102µs ± 2% 102µs ± 1% ~ (p=0.310 n=5+5)
neo/py(!log)/sqlite-zhash.py 482µs ± 4% 475µs ± 2% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zhash.go 222µs ± 1% 228µs ± 1% +2.67% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zhash.go+prefetch128 179µs ± 2% 180µs ± 2% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zhash.py 529µs ± 4% 526µs ± 4% ~ (p=0.886 n=4+4)
neo/py(!log)/sql-zhash.go 275µs ± 1% 281µs ± 3% ~ (p=0.087 n=5+5)
neo/py(!log)/sql-zhash.go+prefetch128 237µs ± 5% 241µs ± 4% ~ (p=0.222 n=5+5)
neo/go/fs1-zhash.py 342µs ± 2% 337µs ±12% ~ (p=0.595 n=5+5)
neo/go/fs1-zhash.go 91.2µs ± 2% 96.1µs ± 9% ~ (p=0.151 n=5+5)
neo/go/fs1-zhash.go+prefetch128 36.6µs ± 2% 35.9µs ± 6% ~ (p=0.127 n=5+5)
neo/go/fs1(!sha1)-zhash.go(!sha1) 68.8µs ± 3% 68.6µs ± 5% ~ (p=0.841 n=5+5)
neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 26.5µs ± 3% 26.6µs ± 5% ~ (p=0.897 n=5+5)
neo/go/sqlite-zhash.py 373µs ± 7% 350µs ± 7% ~ (p=0.151 n=5+5)
neo/go/sqlite-zhash.go 143µs ± 3% 117µs ± 2% -18.18% (p=0.008 n=5+5)
neo/go/sqlite-zhash.go+prefetch128 39.0µs ± 5% 39.4µs ± 4% ~ (p=0.635 n=5+5)
neo/go/sqlite-zhash.go(!sha1) 133µs ± 5% 107µs ± 1% -19.65% (p=0.008 n=5+5)
neo/go/sqlite-zhash.go+prefetch128(!sha1) 36.6µs ± 5% 37.2µs ± 5% ~ (p=0.452 n=5+5)
cluster:z6001 dataset:prod1-1024
fs1-zhash.py 30.5µs ± 2% 30.6µs ± 2% ~ (p=0.794 n=5+4)
fs1-zhash.go 4.60µs ± 0% 4.56µs ± 1% ~ (p=0.333 n=4+5)
fs1-zhash.go+prefetch128 5.44µs ± 3% 5.24µs ± 5% ~ (p=0.143 n=5+5)
zeo/py/fs1-zhash.py 555µs ± 2% 545µs ±10% ~ (p=0.841 n=5+5)
zeo/py/fs1-zhash.go 169µs ± 1% 173µs ± 1% +2.54% (p=0.008 n=5+5)
zeo/py/fs1-zhash.go+prefetch128 88.4µs ± 2% 88.5µs ± 1% ~ (p=0.952 n=5+5)
neo/py(!log)/sqlite-zhash.py 467µs ± 4% 472µs ± 7% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zhash.go 205µs ± 0% 209µs ± 0% +2.27% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zhash.go+prefetch128 161µs ± 1% 163µs ± 0% +1.09% (p=0.008 n=5+5)
neo/py(!log)/sql-zhash.py 518µs ± 2% 581µs ±40% ~ (p=0.556 n=4+5)
neo/py(!log)/sql-zhash.go 267µs ± 1% 266µs ± 1% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zhash.go+prefetch128 226µs ± 9% 226µs ± 9% ~ (p=0.690 n=5+5)
neo/go/fs1-zhash.py 320µs ±11% 311µs ±10% ~ (p=0.841 n=5+5)
neo/go/fs1-zhash.go 76.3µs ± 3% 75.5µs ± 4% ~ (p=0.738 n=5+5)
neo/go/fs1-zhash.go+prefetch128 23.6µs ± 2% 24.0µs ± 2% ~ (p=0.151 n=5+5)
neo/go/fs1(!sha1)-zhash.go(!sha1) 64.8µs ± 2% 64.9µs ± 3% ~ (p=0.841 n=5+5)
neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 20.5µs ± 3% 20.9µs ± 2% ~ (p=0.222 n=5+5)
neo/go/sqlite-zhash.py 378µs ± 4% 325µs ± 8% -14.16% (p=0.008 n=5+5)
neo/go/sqlite-zhash.go 129µs ± 3% 104µs ± 1% -18.91% (p=0.008 n=5+5)
neo/go/sqlite-zhash.go+prefetch128 34.8µs ± 2% 34.4µs ± 3% ~ (p=0.548 n=5+5)
neo/go/sqlite-zhash.go(!sha1) 125µs ± 5% 101µs ± 6% -19.41% (p=0.008 n=5+5)
neo/go/sqlite-zhash.go+prefetch128(!sha1) 34.5µs ± 1% 34.8µs ± 1% +1.04% (p=0.040 n=5+5)

name old req/s new req/s delta
cluster:z6001 dataset:wczblk1-8
fs1-zwrk.go·1 231k ± 1% 228k ± 6% ~ (p=1.000 n=5+5)
fs1-zwrk.go·2 446k ± 2% 446k ± 1% ~ (p=0.841 n=5+5)
fs1-zwrk.go·3 659k ± 2% 661k ± 2% ~ (p=0.690 n=5+5)
fs1-zwrk.go·4 876k ± 2% 877k ± 1% ~ (p=0.841 n=5+5)
fs1-zwrk.go·8 1.75M ± 1% 1.78M ± 1% ~ (p=0.056 n=5+5)
fs1-zwrk.go·12 2.53M ± 2% 2.55M ± 3% ~ (p=0.548 n=5+5)
fs1-zwrk.go·16 2.91M ± 1% 2.92M ± 1% ~ (p=0.841 n=5+5)
zeo/py/fs1-zwrk.go·1 5.14k ± 1% 5.09k ± 1% ~ (p=0.056 n=5+5)
zeo/py/fs1-zwrk.go·2 6.35k ± 0% 6.38k ± 2% ~ (p=0.905 n=4+5)
zeo/py/fs1-zwrk.go·3 7.08k ± 0% 6.88k ± 0% -2.84% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·4 7.19k ± 2% 7.12k ± 1% ~ (p=0.095 n=5+5)
zeo/py/fs1-zwrk.go·8 7.54k ± 2% 7.45k ± 2% ~ (p=0.095 n=5+5)
zeo/py/fs1-zwrk.go·12 7.57k ± 2% 7.65k ± 2% ~ (p=0.310 n=5+5)
zeo/py/fs1-zwrk.go·16 7.66k ± 2% 7.64k ± 2% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 4.54k ± 1% 4.51k ± 2% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 5.68k ± 2% 5.54k ± 0% -2.48% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 5.70k ± 2% 5.52k ± 1% -3.16% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 5.65k ± 1% 5.49k ± 0% -2.87% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 5.64k ± 1% 5.59k ± 2% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 5.60k ± 6% 5.39k ± 7% ~ (p=0.095 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 5.55k ± 4% 5.56k ± 0% ~ (p=0.190 n=5+4)
neo/py(!log)/sql-zwrk.go·1 3.62k ± 3% 3.58k ± 3% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·2 4.26k ± 4% 4.25k ± 1% ~ (p=0.310 n=5+5)
neo/py(!log)/sql-zwrk.go·3 4.29k ± 0% 4.09k ± 5% -4.61% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·4 4.21k ± 4% 4.26k ± 1% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·8 4.20k ± 1% 4.22k ± 1% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·12 4.19k ± 3% 4.18k ± 4% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·16 4.21k ± 1% 4.03k ± 4% ~ (p=0.056 n=5+5)
neo/go/fs1-zwrk.go·1 11.1k ± 3% 11.1k ± 5% ~ (p=0.690 n=5+5)
neo/go/fs1-zwrk.go·2 23.0k ± 1% 23.0k ± 1% ~ (p=0.548 n=5+5)
neo/go/fs1-zwrk.go·3 32.2k ± 0% 32.2k ± 1% ~ (p=1.000 n=5+5)
neo/go/fs1-zwrk.go·4 43.5k ± 0% 43.4k ± 0% ~ (p=0.548 n=5+5)
neo/go/fs1-zwrk.go·8 78.3k ± 0% 77.9k ± 0% -0.48% (p=0.016 n=5+5)
neo/go/fs1-zwrk.go·12 92.5k ± 0% 92.2k ± 0% ~ (p=0.095 n=5+5)
neo/go/fs1-zwrk.go·16 102k ± 0% 102k ± 0% ~ (p=0.056 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 15.0k ± 6% 15.3k ± 7% ~ (p=0.310 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 31.8k ± 1% 31.9k ± 0% ~ (p=0.841 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 44.1k ± 0% 44.1k ± 0% ~ (p=0.222 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 57.9k ± 1% 57.9k ± 0% ~ (p=0.841 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 100k ± 0% 100k ± 0% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 116k ± 0% 116k ± 0% ~ (p=0.841 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 126k ± 0% 126k ± 0% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go·1 7.20k ± 1% 8.71k ± 2% +20.95% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·2 13.7k ± 0% 17.0k ± 0% +24.20% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·3 20.0k ± 1% 24.7k ± 1% +23.18% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·4 25.7k ± 0% 31.5k ± 0% +22.87% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·8 45.3k ± 0% 54.1k ± 1% +19.59% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·12 56.4k ± 0% 63.1k ± 0% +11.78% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·16 58.2k ± 1% 63.7k ± 1% +9.42% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 7.73k ± 1% 9.66k ± 2% +24.99% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 14.7k ± 1% 18.7k ± 1% +27.48% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 21.7k ± 0% 27.7k ± 0% +27.80% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 28.2k ± 0% 35.3k ± 1% +25.02% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 49.0k ± 0% 57.4k ± 0% +17.18% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 60.5k ± 0% 67.6k ± 1% +11.77% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 61.9k ± 0% 66.9k ± 1% +8.09% (p=0.008 n=5+5)
cluster:z6001 dataset:prod1-1024
fs1-zwrk.go·1 349k ± 1% 353k ± 0% +1.37% (p=0.016 n=5+4)
fs1-zwrk.go·2 672k ± 1% 672k ± 3% ~ (p=0.841 n=5+5)
fs1-zwrk.go·3 982k ± 2% 1000k ± 3% ~ (p=0.310 n=5+5)
fs1-zwrk.go·4 1.29M ± 7% 1.31M ± 3% ~ (p=0.548 n=5+5)
fs1-zwrk.go·8 2.53M ± 3% 2.57M ± 2% ~ (p=0.310 n=5+5)
fs1-zwrk.go·12 3.05M ± 1% 3.07M ± 1% ~ (p=0.310 n=5+5)
fs1-zwrk.go·16 3.06M ± 1% 3.08M ± 1% ~ (p=0.310 n=5+5)
zeo/py/fs1-zwrk.go·1 6.13k ± 1% 6.06k ± 3% ~ (p=0.151 n=5+5)
zeo/py/fs1-zwrk.go·2 8.21k ± 2% 8.11k ± 2% ~ (p=0.095 n=5+5)
zeo/py/fs1-zwrk.go·3 9.03k ± 2% 8.85k ± 0% -1.92% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·4 9.37k ± 2% 9.21k ± 1% -1.75% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·8 9.85k ± 5% 9.72k ± 3% ~ (p=0.548 n=5+5)
zeo/py/fs1-zwrk.go·12 9.57k ± 9% 9.98k ± 0% ~ (p=0.730 n=5+4)
zeo/py/fs1-zwrk.go·16 10.3k ± 1% 10.0k ± 7% ~ (p=0.095 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 4.90k ± 1% 4.83k ± 1% ~ (p=0.056 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 5.90k ± 0% 5.77k ± 0% -2.16% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 5.86k ± 1% 5.75k ± 0% -1.78% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 5.75k ± 0% 5.50k ± 8% ~ (p=0.190 n=4+5)
neo/py(!log)/sqlite-zwrk.go·8 5.84k ± 1% 5.74k ± 0% -1.67% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 5.51k ± 6% 5.72k ± 1% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 5.71k ± 1% 5.66k ± 7% ~ (p=0.548 n=5+5)
neo/py(!log)/sql-zwrk.go·1 3.64k ± 7% 3.79k ± 2% ~ (p=0.310 n=5+5)
neo/py(!log)/sql-zwrk.go·2 4.35k ± 0% 4.38k ± 0% +0.65% (p=0.029 n=4+4)
neo/py(!log)/sql-zwrk.go·3 4.36k ± 2% 4.36k ± 0% ~ (p=0.286 n=5+4)
neo/py(!log)/sql-zwrk.go·4 4.32k ± 0% 4.36k ± 0% +0.93% (p=0.029 n=4+4)
neo/py(!log)/sql-zwrk.go·8 4.37k ± 1% 4.32k ± 1% ~ (p=0.151 n=5+5)
neo/py(!log)/sql-zwrk.go·12 4.40k ± 1% 4.32k ± 1% -1.77% (p=0.032 n=5+5)
neo/py(!log)/sql-zwrk.go·16 4.34k ± 1% 4.28k ± 2% ~ (p=0.151 n=5+5)
neo/go/fs1-zwrk.go·1 14.2k ± 1% 14.0k ± 3% ~ (p=0.421 n=5+5)
neo/go/fs1-zwrk.go·2 28.5k ± 1% 28.3k ± 1% ~ (p=0.151 n=5+5)
neo/go/fs1-zwrk.go·3 40.6k ± 0% 40.6k ± 0% ~ (p=0.310 n=5+5)
neo/go/fs1-zwrk.go·4 53.2k ± 1% 53.0k ± 0% ~ (p=0.222 n=5+5)
neo/go/fs1-zwrk.go·8 90.1k ± 1% 90.4k ± 1% ~ (p=0.310 n=5+5)
neo/go/fs1-zwrk.go·12 96.0k ± 1% 95.3k ± 1% ~ (p=0.310 n=5+5)
neo/go/fs1-zwrk.go·16 91.4k ± 1% 89.7k ± 2% -1.86% (p=0.016 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 16.4k ± 1% 16.5k ± 4% ~ (p=0.421 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 33.4k ± 1% 33.3k ± 1% ~ (p=0.222 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 46.7k ± 0% 46.5k ± 1% -0.48% (p=0.032 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 60.4k ± 0% 60.3k ± 0% ~ (p=0.310 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 98.9k ± 1% 99.0k ± 1% ~ (p=0.841 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 103k ± 1% 103k ± 1% ~ (p=0.690 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 97.2k ± 1% 97.0k ± 1% ~ (p=0.548 n=5+5)
neo/go/sqlite-zwrk.go·1 7.92k ± 2% 9.85k ± 1% +24.42% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·2 14.7k ± 1% 18.9k ± 1% +28.67% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·3 21.3k ± 0% 27.4k ± 2% +28.93% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·4 27.5k ± 1% 34.7k ± 1% +26.17% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·8 44.9k ± 1% 51.8k ± 1% +15.20% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·12 52.3k ± 0% 55.7k ± 1% +6.46% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·16 48.4k ± 1% 50.8k ± 1% +4.92% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 8.17k ± 2% 10.11k ± 1% +23.70% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 15.2k ± 1% 19.6k ± 0% +29.40% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 22.0k ± 0% 28.5k ± 0% +29.64% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 28.2k ± 0% 36.1k ± 0% +27.93% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 45.3k ± 0% 52.9k ± 1% +16.77% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 52.0k ± 1% 57.1k ± 1% +9.93% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 48.4k ± 1% 51.5k ± 1% +6.45% (p=0.008 n=5+5)

name old latency-time/object new latency-time/object delta
cluster:z6001 dataset:wczblk1-8
fs1-zwrk.go·1 4.33µs ± 1% 4.39µs ± 6% ~ (p=1.000 n=5+5)
fs1-zwrk.go·2 4.49µs ± 2% 4.49µs ± 1% ~ (p=0.841 n=5+5)
fs1-zwrk.go·3 4.56µs ± 2% 4.54µs ± 2% ~ (p=0.690 n=5+5)
fs1-zwrk.go·4 4.57µs ± 2% 4.56µs ± 1% ~ (p=0.841 n=5+5)
fs1-zwrk.go·8 4.56µs ± 1% 4.50µs ± 1% ~ (p=0.056 n=5+5)
fs1-zwrk.go·12 4.75µs ± 2% 4.70µs ± 3% ~ (p=0.548 n=5+5)
fs1-zwrk.go·16 5.49µs ± 1% 5.48µs ± 1% ~ (p=0.841 n=5+5)
zeo/py/fs1-zwrk.go·1 195µs ± 1% 196µs ± 1% ~ (p=0.056 n=5+5)
zeo/py/fs1-zwrk.go·2 315µs ± 0% 313µs ± 2% ~ (p=0.905 n=4+5)
zeo/py/fs1-zwrk.go·3 424µs ± 0% 436µs ± 0% +2.93% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·4 556µs ± 2% 562µs ± 1% ~ (p=0.095 n=5+5)
zeo/py/fs1-zwrk.go·8 1.06ms ± 2% 1.07ms ± 2% ~ (p=0.095 n=5+5)
zeo/py/fs1-zwrk.go·12 1.58ms ± 2% 1.57ms ± 2% ~ (p=0.310 n=5+5)
zeo/py/fs1-zwrk.go·16 2.09ms ± 2% 2.10ms ± 2% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 220µs ± 1% 222µs ± 2% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 352µs ± 2% 361µs ± 0% +2.53% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 526µs ± 2% 543µs ± 1% +3.26% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 708µs ± 1% 729µs ± 0% +2.94% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 1.42ms ± 1% 1.43ms ± 2% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 2.15ms ± 6% 2.23ms ± 8% ~ (p=0.095 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 2.89ms ± 4% 2.88ms ± 0% ~ (p=0.190 n=5+4)
neo/py(!log)/sql-zwrk.go·1 276µs ± 3% 279µs ± 3% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·2 470µs ± 4% 470µs ± 1% ~ (p=0.310 n=5+5)
neo/py(!log)/sql-zwrk.go·3 699µs ± 0% 734µs ± 5% +4.97% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·4 950µs ± 5% 938µs ± 1% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·8 1.91ms ± 1% 1.89ms ± 1% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·12 2.87ms ± 3% 2.87ms ± 4% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·16 3.80ms ± 1% 3.97ms ± 5% ~ (p=0.056 n=5+5)
neo/go/fs1-zwrk.go·1 90.5µs ± 3% 90.5µs ± 5% ~ (p=0.690 n=5+5)
neo/go/fs1-zwrk.go·2 86.9µs ± 1% 87.1µs ± 1% ~ (p=0.548 n=5+5)
neo/go/fs1-zwrk.go·3 93.2µs ± 0% 93.2µs ± 1% ~ (p=1.000 n=5+5)
neo/go/fs1-zwrk.go·4 91.9µs ± 0% 92.1µs ± 0% ~ (p=0.548 n=5+5)
neo/go/fs1-zwrk.go·8 102µs ± 0% 103µs ± 0% +0.48% (p=0.016 n=5+5)
neo/go/fs1-zwrk.go·12 130µs ± 0% 130µs ± 0% ~ (p=0.095 n=5+5)
neo/go/fs1-zwrk.go·16 156µs ± 0% 157µs ± 0% ~ (p=0.056 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 66.6µs ± 6% 65.3µs ± 8% ~ (p=0.310 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 62.9µs ± 1% 62.8µs ± 0% ~ (p=0.841 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 68.0µs ± 0% 68.1µs ± 0% ~ (p=0.222 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 69.0µs ± 1% 69.1µs ± 0% ~ (p=0.841 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 79.8µs ± 0% 79.8µs ± 0% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 103µs ± 0% 103µs ± 0% ~ (p=0.841 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 127µs ± 0% 127µs ± 0% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go·1 139µs ± 1% 115µs ± 2% -17.32% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·2 147µs ± 0% 118µs ± 0% -19.49% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·3 150µs ± 1% 122µs ± 1% -18.81% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·4 156µs ± 0% 127µs ± 0% -18.61% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·8 177µs ± 0% 148µs ± 1% -16.38% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·12 213µs ± 0% 190µs ± 0% -10.54% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·16 275µs ± 1% 251µs ± 1% -8.61% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 129µs ± 1% 103µs ± 2% -19.99% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 136µs ± 1% 107µs ± 0% -21.56% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 138µs ± 0% 108µs ± 0% -21.75% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 142µs ± 0% 113µs ± 1% -20.01% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 163µs ± 0% 139µs ± 0% -14.66% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 198µs ± 0% 178µs ± 1% -10.53% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 259µs ± 0% 239µs ± 1% -7.48% (p=0.008 n=5+5)
cluster:z6001 dataset:prod1-1024
fs1-zwrk.go·1 2.87µs ± 1% 2.83µs ± 0% -1.35% (p=0.016 n=5+4)
fs1-zwrk.go·2 2.98µs ± 1% 2.98µs ± 3% ~ (p=0.841 n=5+5)
fs1-zwrk.go·3 3.05µs ± 2% 3.00µs ± 3% ~ (p=0.310 n=5+5)
fs1-zwrk.go·4 3.10µs ± 7% 3.05µs ± 3% ~ (p=0.500 n=5+5)
fs1-zwrk.go·8 3.16µs ± 3% 3.11µs ± 2% ~ (p=0.310 n=5+5)
fs1-zwrk.go·12 3.94µs ± 1% 3.91µs ± 1% ~ (p=0.310 n=5+5)
fs1-zwrk.go·16 5.23µs ± 1% 5.20µs ± 1% ~ (p=0.310 n=5+5)
zeo/py/fs1-zwrk.go·1 163µs ± 1% 165µs ± 3% ~ (p=0.151 n=5+5)
zeo/py/fs1-zwrk.go·2 244µs ± 2% 246µs ± 2% ~ (p=0.095 n=5+5)
zeo/py/fs1-zwrk.go·3 332µs ± 2% 339µs ± 0% +1.94% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·4 427µs ± 2% 434µs ± 1% +1.78% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·8 813µs ± 5% 823µs ± 3% ~ (p=0.548 n=5+5)
zeo/py/fs1-zwrk.go·12 1.26ms ± 9% 1.20ms ± 0% ~ (p=0.730 n=5+4)
zeo/py/fs1-zwrk.go·16 1.55ms ± 1% 1.60ms ± 8% ~ (p=0.095 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 204µs ± 1% 207µs ± 1% ~ (p=0.056 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 339µs ± 0% 347µs ± 0% +2.21% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 512µs ± 1% 522µs ± 0% +1.80% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 695µs ± 0% 730µs ± 9% ~ (p=0.190 n=4+5)
neo/py(!log)/sqlite-zwrk.go·8 1.37ms ± 1% 1.39ms ± 0% +1.68% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 2.18ms ± 6% 2.10ms ± 1% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 2.80ms ± 1% 2.83ms ± 8% ~ (p=0.548 n=5+5)
neo/py(!log)/sql-zwrk.go·1 275µs ± 7% 264µs ± 2% ~ (p=0.310 n=5+5)
neo/py(!log)/sql-zwrk.go·2 460µs ± 0% 457µs ± 0% -0.64% (p=0.029 n=4+4)
neo/py(!log)/sql-zwrk.go·3 689µs ± 1% 688µs ± 0% ~ (p=0.286 n=5+4)
neo/py(!log)/sql-zwrk.go·4 927µs ± 0% 918µs ± 0% -0.92% (p=0.029 n=4+4)
neo/py(!log)/sql-zwrk.go·8 1.83ms ± 1% 1.85ms ± 1% ~ (p=0.151 n=5+5)
neo/py(!log)/sql-zwrk.go·12 2.73ms ± 1% 2.78ms ± 1% +1.81% (p=0.032 n=5+5)
neo/py(!log)/sql-zwrk.go·16 3.69ms ± 1% 3.74ms ± 2% ~ (p=0.151 n=5+5)
neo/go/fs1-zwrk.go·1 70.2µs ± 1% 71.4µs ± 3% ~ (p=0.421 n=5+5)
neo/go/fs1-zwrk.go·2 70.3µs ± 1% 70.8µs ± 1% ~ (p=0.151 n=5+5)
neo/go/fs1-zwrk.go·3 73.8µs ± 0% 74.0µs ± 0% ~ (p=0.310 n=5+5)
neo/go/fs1-zwrk.go·4 75.2µs ± 1% 75.4µs ± 0% ~ (p=0.222 n=5+5)
neo/go/fs1-zwrk.go·8 88.8µs ± 1% 88.5µs ± 1% ~ (p=0.310 n=5+5)
neo/go/fs1-zwrk.go·12 125µs ± 1% 126µs ± 1% ~ (p=0.310 n=5+5)
neo/go/fs1-zwrk.go·16 175µs ± 1% 178µs ± 2% +1.89% (p=0.016 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 61.1µs ± 1% 60.8µs ± 4% ~ (p=0.421 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 59.8µs ± 1% 60.1µs ± 1% ~ (p=0.222 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 64.2µs ± 0% 64.5µs ± 1% +0.49% (p=0.032 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 66.2µs ± 0% 66.3µs ± 0% ~ (p=0.310 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 80.9µs ± 1% 80.8µs ± 1% ~ (p=0.841 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 117µs ± 1% 116µs ± 1% ~ (p=0.690 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 165µs ± 1% 165µs ± 1% ~ (p=0.548 n=5+5)
neo/go/sqlite-zwrk.go·1 126µs ± 2% 102µs ± 1% -19.63% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·2 136µs ± 1% 106µs ± 1% -22.28% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·3 141µs ± 0% 109µs ± 1% -22.43% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·4 145µs ± 1% 115µs ± 1% -20.75% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·8 178µs ± 1% 155µs ± 1% -13.19% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·12 229µs ± 0% 215µs ± 1% -6.06% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·16 331µs ± 1% 315µs ± 1% -4.68% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 122µs ± 2% 99µs ± 1% -19.17% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 132µs ± 1% 102µs ± 0% -22.72% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 136µs ± 0% 105µs ± 0% -22.86% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 142µs ± 0% 111µs ± 0% -21.83% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 177µs ± 0% 151µs ± 1% -14.36% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 231µs ± 1% 210µs ± 1% -9.03% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 331µs ± 1% 311µs ± 1% -6.06% (p=0.008 n=5+5)

70c63882

18 Mar, 2018 6 commits

. · 41c7bf5d
Kirill Smelkov authored Mar 18, 2018

41c7bf5d

X rio: localhost timings · 6b816d6f

Kirill Smelkov authored Mar 18, 2018

Similarly to deco and neo1, neo/go/sqlite is speed-up a bit. And
everything else is within noise.

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

$ benchstat -split node,cluster,dataset 20180308-rio-ffixed-noc_C1$1µs$-zwrk1s.txt 20180318-rio.txt

name old pystone/s new pystone/s delta
node:rio
pystone 142k ± 3% 144k ± 2% ~ (p=0.548 n=5+5)

name old time/op new time/op delta
node:rio
crc32/py/4K 4.77µs ± 1% 4.81µs ± 1% ~ (p=0.056 n=5+5)
crc32/go/4K 1.49µs ± 0% 1.49µs ± 0% -0.21% (p=0.032 n=5+5)
sha1/py/4K 8.07µs ± 4% 7.99µs ± 2% ~ (p=0.246 n=5+5)
sha1/go/4K 8.93µs ± 0% 8.93µs ± 0% ~ (p=0.667 n=4+5)
unzlib/py/wczdata 25.1µs ± 1% 25.2µs ± 0% ~ (p=0.548 n=5+5)
unzlib/go/wczdata 22.9µs ± 0% 22.8µs ± 0% -0.14% (p=0.032 n=5+5)
unzlib/py/prod1-avg 6.85µs ±25% 7.25µs ± 1% ~ (p=0.905 n=5+4)
unzlib/go/prod1-avg 5.02µs ± 1% 5.01µs ± 0% ~ (p=0.349 n=5+5)
disk/randread/direct/4K-min 93.4µs ± 0% 92.0µs ± 0% -1.48% (p=0.016 n=5+4)
disk/randread/direct/4K-avg 116µs ± 0% 115µs ± 0% -0.81% (p=0.008 n=5+5)
disk/randread/pagecache/4K-min 570ns ± 1% 567ns ± 1% ~ (p=0.690 n=5+5)
disk/randread/pagecache/4K-avg 1.00µs ± 1% 1.00µs ± 1% ~ (p=0.214 n=5+5)

name old time/object new time/object delta
cluster:rio dataset:wczblk1-8
fs1-zhash.py 29.0µs ± 2% 29.0µs ± 2% ~ (p=0.905 n=5+4)
fs1-zhash.go 4.60µs ± 0% 4.70µs ± 0% +2.17% (p=0.029 n=4+4)
fs1-zhash.go+prefetch128 4.62µs ± 5% 4.44µs ± 4% ~ (p=0.071 n=5+5)
zeo/py/fs1-zhash.py 375µs ± 2% 377µs ± 4% ~ (p=0.841 n=5+5)
zeo/py/fs1-zhash.go 135µs ± 1% 137µs ± 2% ~ (p=0.151 n=5+5)
zeo/py/fs1-zhash.go+prefetch128 73.6µs ± 3% 76.6µs ± 4% +4.13% (p=0.032 n=5+5)
neo/py(!log)/sqlite-zhash.py 315µs ± 6% 310µs ± 7% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zhash.go 155µs ± 5% 149µs ± 4% ~ (p=0.056 n=5+5)
neo/py(!log)/sqlite-zhash.go+prefetch128 126µs ± 1% 122µs ± 2% -3.13% (p=0.008 n=5+5)
neo/py(!log)/sql-zhash.py 376µs ±41% 380µs ±55% ~ (p=0.690 n=5+5)
neo/py(!log)/sql-zhash.go 183µs ± 2% 179µs ± 7% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zhash.go+prefetch128 161µs ± 3% 152µs ± 2% -5.56% (p=0.008 n=5+5)
neo/go/fs1-zhash.py 216µs ± 1% 215µs ±12% ~ (p=0.135 n=5+5)
neo/go/fs1-zhash.go 67.9µs ± 1% 65.9µs ± 1% -2.95% (p=0.008 n=5+5)
neo/go/fs1-zhash.go+prefetch128 28.4µs ± 5% 28.3µs ± 2% ~ (p=0.476 n=5+5)
neo/go/fs1(!sha1)-zhash.go(!sha1) 44.1µs ± 4% 41.3µs ± 3% -6.26% (p=0.016 n=5+5)
neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 19.1µs ± 6% 18.4µs ± 4% ~ (p=0.254 n=5+5)
neo/go/sqlite-zhash.py 252µs ± 1% 234µs ± 4% -6.95% (p=0.008 n=5+5)
neo/go/sqlite-zhash.go 103µs ± 3% 80µs ± 3% -21.74% (p=0.008 n=5+5)
neo/go/sqlite-zhash.go+prefetch128 38.0µs ± 9% 33.7µs ± 2% -11.22% (p=0.016 n=5+5)
neo/go/sqlite-zhash.go(!sha1) 93.0µs ± 2% 72.7µs ± 2% -21.79% (p=0.008 n=5+5)
neo/go/sqlite-zhash.go+prefetch128(!sha1) 33.4µs ± 3% 32.7µs ± 2% ~ (p=0.111 n=5+5)
cluster:rio dataset:prod1-1024
fs1-zhash.py 23.8µs ± 2% 24.0µs ± 1% ~ (p=0.381 n=5+4)
fs1-zhash.go 3.40µs ± 0% 3.40µs ± 0% ~ (all equal)
fs1-zhash.go+prefetch128 3.16µs ± 8% 3.00µs ± 7% ~ (p=0.159 n=5+5)
zeo/py/fs1-zhash.py 346µs ± 2% 348µs ± 8% ~ (p=0.690 n=5+5)
zeo/py/fs1-zhash.go 114µs ± 1% 112µs ± 1% ~ (p=0.063 n=5+5)
zeo/py/fs1-zhash.go+prefetch128 64.4µs ± 2% 64.3µs ± 1% ~ (p=0.881 n=5+5)
neo/py(!log)/sqlite-zhash.py 291µs ± 0% 308µs ± 7% +6.03% (p=0.016 n=5+5)
neo/py(!log)/sqlite-zhash.go 142µs ± 2% 145µs ± 2% ~ (p=0.167 n=5+5)
neo/py(!log)/sqlite-zhash.go+prefetch128 117µs ± 1% 117µs ± 2% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zhash.py 374µs ±41% 381µs ±49% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zhash.go 173µs ± 8% 165µs ± 1% -4.65% (p=0.016 n=5+5)
neo/py(!log)/sql-zhash.go+prefetch128 148µs ± 2% 147µs ± 2% ~ (p=0.310 n=5+5)
neo/go/fs1-zhash.py 210µs ± 3% 204µs ± 3% ~ (p=0.151 n=5+5)
neo/go/fs1-zhash.go 50.2µs ± 2% 46.9µs ± 1% -6.61% (p=0.008 n=5+5)
neo/go/fs1-zhash.go+prefetch128 19.4µs ± 2% 18.9µs ± 5% ~ (p=0.246 n=5+5)
neo/go/fs1(!sha1)-zhash.go(!sha1) 40.6µs ± 2% 39.2µs ± 2% -3.50% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 15.8µs ± 2% 15.4µs ± 3% ~ (p=0.095 n=5+5)
neo/go/sqlite-zhash.py 262µs ± 4% 229µs ± 2% -12.50% (p=0.008 n=5+5)
neo/go/sqlite-zhash.go 93.8µs ± 1% 70.7µs ± 1% -24.57% (p=0.008 n=5+5)
neo/go/sqlite-zhash.go+prefetch128 33.4µs ± 6% 30.3µs ± 2% -9.29% (p=0.008 n=5+5)
neo/go/sqlite-zhash.go(!sha1) 90.9µs ± 4% 67.9µs ± 1% -25.30% (p=0.008 n=5+5)
neo/go/sqlite-zhash.go+prefetch128(!sha1) 33.2µs ± 2% 30.8µs ± 2% -7.41% (p=0.008 n=5+5)

name old req/s new req/s delta
cluster:rio dataset:wczblk1-8
fs1-zwrk.go·1 301k ± 1% 303k ± 0% +0.54% (p=0.008 n=5+5)
fs1-zwrk.go·2 551k ± 0% 552k ± 1% ~ (p=1.000 n=5+5)
fs1-zwrk.go·3 814k ± 0% 815k ± 0% ~ (p=1.000 n=5+5)
fs1-zwrk.go·4 1.08M ± 1% 1.08M ± 0% ~ (p=0.421 n=5+5)
fs1-zwrk.go·8 1.43M ± 0% 1.42M ± 0% ~ (p=0.421 n=5+5)
fs1-zwrk.go·12 1.55M ± 0% 1.55M ± 0% +0.43% (p=0.032 n=5+5)
fs1-zwrk.go·16 1.54M ± 0% 1.55M ± 0% ~ (p=0.421 n=5+5)
zeo/py/fs1-zwrk.go·1 7.50k ± 1% 7.37k ± 1% -1.70% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·2 8.89k ± 2% 8.81k ± 2% ~ (p=0.421 n=5+5)
zeo/py/fs1-zwrk.go·3 9.61k ± 1% 9.62k ± 1% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·4 9.92k ± 1% 9.92k ± 1% ~ (p=0.690 n=5+5)
zeo/py/fs1-zwrk.go·8 10.2k ± 2% 10.2k ± 1% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·12 10.6k ± 1% 10.3k ± 0% -2.66% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·16 10.5k ± 1% 10.4k ± 2% ~ (p=0.310 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 6.70k ± 2% 6.83k ± 4% ~ (p=0.151 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 8.54k ± 0% 8.53k ± 4% ~ (p=0.190 n=4+5)
neo/py(!log)/sqlite-zwrk.go·3 8.43k ± 1% 8.51k ± 2% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 8.37k ± 4% 8.50k ± 4% ~ (p=0.222 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 8.44k ± 0% 8.55k ± 2% ~ (p=0.190 n=4+5)
neo/py(!log)/sqlite-zwrk.go·12 8.23k ± 5% 8.38k ± 9% ~ (p=0.151 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 8.46k ± 1% 8.42k ± 9% ~ (p=0.151 n=5+5)
neo/py(!log)/sql-zwrk.go·1 5.66k ± 2% 5.72k ± 3% ~ (p=0.222 n=5+5)
neo/py(!log)/sql-zwrk.go·2 6.75k ± 2% 6.86k ± 3% ~ (p=0.222 n=5+5)
neo/py(!log)/sql-zwrk.go·3 6.68k ± 2% 6.71k ± 4% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zwrk.go·4 6.70k ± 2% 6.80k ± 3% ~ (p=0.310 n=5+5)
neo/py(!log)/sql-zwrk.go·8 6.50k ± 5% 6.88k ± 1% +5.87% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·12 6.67k ± 2% 6.90k ± 2% +3.41% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·16 6.72k ± 3% 6.77k ± 2% ~ (p=0.548 n=5+5)
neo/go/fs1-zwrk.go·1 15.7k ± 0% 16.1k ± 0% +2.89% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·2 30.2k ± 0% 31.0k ± 1% +2.68% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·3 39.8k ± 0% 40.6k ± 0% +2.02% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·4 49.7k ± 0% 51.0k ± 0% +2.64% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·8 68.8k ± 0% 70.0k ± 0% +1.84% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·12 73.0k ± 0% 74.1k ± 0% +1.54% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·16 73.7k ± 0% 74.8k ± 0% +1.44% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 25.5k ± 3% 26.5k ± 1% +4.12% (p=0.016 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 47.9k ± 0% 48.8k ± 0% +1.85% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 59.7k ± 0% 61.8k ± 0% +3.48% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 72.7k ± 0% 75.4k ± 0% +3.76% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 97.0k ± 0% 99.4k ± 1% +2.52% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 110k ± 0% 113k ± 0% +2.58% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 113k ± 1% 115k ± 1% +1.86% (p=0.016 n=5+5)
neo/go/sqlite-zwrk.go·1 10.0k ± 1% 12.7k ± 1% +28.02% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·2 18.4k ± 0% 23.9k ± 1% +29.46% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·3 25.5k ± 0% 31.6k ± 0% +24.11% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·4 30.4k ± 0% 38.2k ± 0% +25.76% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·8 39.4k ± 1% 47.1k ± 1% +19.51% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·12 40.7k ± 2% 47.1k ± 2% +15.72% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·16 40.8k ± 2% 46.7k ± 2% +14.50% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 11.1k ± 0% 14.6k ± 1% +31.01% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 20.1k ± 0% 26.3k ± 0% +30.98% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 27.9k ± 0% 37.0k ± 0% +32.82% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 34.2k ± 0% 43.7k ± 0% +27.80% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 44.0k ± 1% 51.2k ± 1% +16.37% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 43.4k ± 2% 49.4k ± 3% +14.01% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 41.4k ± 2% 46.6k ± 4% +12.52% (p=0.008 n=5+5)
cluster:rio dataset:prod1-1024
fs1-zwrk.go·1 461k ± 1% 464k ± 1% ~ (p=0.222 n=5+5)
fs1-zwrk.go·2 906k ± 1% 918k ± 1% ~ (p=0.056 n=5+5)
fs1-zwrk.go·3 1.35M ± 0% 1.36M ± 0% +1.14% (p=0.008 n=5+5)
fs1-zwrk.go·4 1.78M ± 1% 1.80M ± 2% ~ (p=0.222 n=5+5)
fs1-zwrk.go·8 2.33M ± 1% 2.37M ± 1% +1.78% (p=0.016 n=5+5)
fs1-zwrk.go·12 2.40M ± 0% 2.41M ± 0% ~ (p=0.548 n=5+5)
fs1-zwrk.go·16 2.40M ± 0% 2.41M ± 1% ~ (p=0.056 n=5+5)
zeo/py/fs1-zwrk.go·1 9.06k ± 1% 9.19k ± 1% ~ (p=0.056 n=5+5)
zeo/py/fs1-zwrk.go·2 11.7k ± 2% 11.7k ± 2% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·3 12.9k ± 1% 12.8k ± 2% ~ (p=0.690 n=5+5)
zeo/py/fs1-zwrk.go·4 13.4k ± 3% 13.4k ± 1% ~ (p=0.690 n=5+5)
zeo/py/fs1-zwrk.go·8 13.9k ± 2% 14.1k ± 2% ~ (p=0.310 n=5+5)
zeo/py/fs1-zwrk.go·12 14.2k ± 2% 14.3k ± 2% ~ (p=0.421 n=5+5)
zeo/py/fs1-zwrk.go·16 14.4k ± 1% 14.3k ± 3% ~ (p=0.841 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 7.28k ± 2% 7.19k ± 3% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 8.70k ± 3% 8.54k ± 1% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 8.73k ± 3% 8.54k ± 1% ~ (p=0.151 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 8.69k ± 1% 8.59k ± 1% ~ (p=0.151 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 8.77k ± 2% 8.51k ± 2% -2.93% (p=0.032 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 8.59k ± 7% 8.51k ± 2% ~ (p=0.310 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 8.67k ± 1% 8.39k ± 5% -3.20% (p=0.032 n=5+5)
neo/py(!log)/sql-zwrk.go·1 5.98k ± 1% 6.02k ± 4% ~ (p=0.151 n=5+5)
neo/py(!log)/sql-zwrk.go·2 6.86k ± 4% 6.91k ± 3% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zwrk.go·3 6.86k ± 3% 6.93k ± 2% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·4 6.90k ± 1% 6.88k ± 2% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·8 6.62k ± 6% 6.77k ± 6% ~ (p=0.310 n=5+5)
neo/py(!log)/sql-zwrk.go·12 6.78k ± 2% 6.75k ± 6% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·16 6.78k ± 3% 6.78k ± 7% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·1 21.6k ± 0% 22.7k ± 0% +5.46% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·2 39.0k ± 0% 40.5k ± 0% +3.84% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·3 51.0k ± 1% 52.9k ± 0% +3.74% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·4 62.3k ± 0% 64.7k ± 0% +3.96% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·8 79.7k ± 1% 81.5k ± 1% +2.27% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·12 81.8k ± 2% 80.3k ± 3% ~ (p=0.421 n=5+5)
neo/go/fs1-zwrk.go·16 80.8k ± 3% 77.8k ± 3% -3.71% (p=0.032 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 26.9k ± 1% 26.9k ± 1% ~ (p=0.690 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 49.3k ± 0% 51.3k ± 0% +4.00% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 62.3k ± 0% 65.4k ± 1% +4.82% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 74.7k ± 0% 78.6k ± 0% +5.26% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 93.5k ± 2% 96.7k ± 1% +3.44% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 96.9k ± 2% 99.2k ± 4% ~ (p=0.095 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 94.5k ± 3% 94.2k ± 3% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go·1 11.0k ± 0% 14.7k ± 0% +33.72% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·2 19.3k ± 0% 25.2k ± 0% +30.66% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·3 26.4k ± 0% 34.6k ± 1% +30.78% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·4 31.8k ± 0% 40.3k ± 0% +26.68% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·8 38.6k ± 1% 41.4k ± 3% +7.22% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·12 36.5k ± 2% 38.7k ± 3% +5.82% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·16 36.0k ± 1% 37.9k ± 3% +5.33% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 11.4k ± 0% 15.7k ± 1% +37.97% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 19.9k ± 0% 26.9k ± 0% +35.56% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 27.4k ± 0% 37.6k ± 0% +37.02% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 33.3k ± 0% 43.6k ± 1% +31.11% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 38.8k ± 2% 45.2k ± 2% +16.46% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 36.0k ± 2% 41.5k ± 2% +15.07% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 35.4k ± 1% 40.5k ± 1% +14.47% (p=0.008 n=5+5)

name old latency-time/object new latency-time/object delta
cluster:rio dataset:wczblk1-8
fs1-zwrk.go·1 3.32µs ± 1% 3.30µs ± 0% -0.55% (p=0.008 n=5+5)
fs1-zwrk.go·2 3.63µs ± 0% 3.63µs ± 1% ~ (p=0.738 n=5+5)
fs1-zwrk.go·3 3.69µs ± 0% 3.68µs ± 0% ~ (p=0.952 n=5+5)
fs1-zwrk.go·4 3.70µs ± 1% 3.70µs ± 0% ~ (p=0.460 n=5+5)
fs1-zwrk.go·8 5.61µs ± 0% 5.62µs ± 0% ~ (p=0.421 n=5+5)
fs1-zwrk.go·12 7.76µs ± 0% 7.73µs ± 0% -0.43% (p=0.032 n=5+5)
fs1-zwrk.go·16 10.4µs ± 0% 10.3µs ± 0% ~ (p=0.381 n=5+5)
zeo/py/fs1-zwrk.go·1 133µs ± 1% 136µs ± 1% +1.72% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·2 225µs ± 2% 227µs ± 2% ~ (p=0.421 n=5+5)
zeo/py/fs1-zwrk.go·3 312µs ± 1% 312µs ± 1% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·4 403µs ± 1% 403µs ± 1% ~ (p=0.690 n=5+5)
zeo/py/fs1-zwrk.go·8 781µs ± 2% 785µs ± 1% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·12 1.13ms ± 1% 1.16ms ± 0% +2.73% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·16 1.52ms ± 1% 1.54ms ± 2% ~ (p=0.310 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 149µs ± 2% 146µs ± 4% ~ (p=0.151 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 234µs ± 0% 235µs ± 4% ~ (p=0.190 n=4+5)
neo/py(!log)/sqlite-zwrk.go·3 356µs ± 1% 353µs ± 2% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 478µs ± 4% 471µs ± 4% ~ (p=0.222 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 948µs ± 0% 936µs ± 2% ~ (p=0.190 n=4+5)
neo/py(!log)/sqlite-zwrk.go·12 1.46ms ± 5% 1.40ms ± 1% -3.91% (p=0.016 n=5+4)
neo/py(!log)/sqlite-zwrk.go·16 1.89ms ± 1% 1.86ms ± 1% -1.63% (p=0.016 n=5+4)
neo/py(!log)/sql-zwrk.go·1 177µs ± 2% 175µs ± 3% ~ (p=0.222 n=5+5)
neo/py(!log)/sql-zwrk.go·2 297µs ± 2% 292µs ± 3% ~ (p=0.222 n=5+5)
neo/py(!log)/sql-zwrk.go·3 449µs ± 2% 447µs ± 4% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zwrk.go·4 597µs ± 2% 589µs ± 3% ~ (p=0.310 n=5+5)
neo/py(!log)/sql-zwrk.go·8 1.23ms ± 5% 1.16ms ± 1% -5.61% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·12 1.80ms ± 2% 1.74ms ± 2% -3.31% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·16 2.38ms ± 3% 2.36ms ± 2% ~ (p=0.548 n=5+5)
neo/go/fs1-zwrk.go·1 63.9µs ± 0% 62.1µs ± 0% -2.81% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·2 66.2µs ± 0% 64.5µs ± 1% -2.61% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·3 75.5µs ± 0% 74.0µs ± 0% -1.98% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·4 80.6µs ± 0% 78.5µs ± 0% -2.57% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·8 116µs ± 0% 114µs ± 0% -1.81% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·12 164µs ± 0% 162µs ± 0% -1.52% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·16 217µs ± 0% 214µs ± 0% -1.42% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 39.3µs ± 3% 37.7µs ± 1% -3.99% (p=0.016 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 41.7µs ± 0% 41.0µs ± 0% -1.82% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 50.3µs ± 0% 48.6µs ± 0% -3.36% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 55.0µs ± 0% 53.0µs ± 0% -3.63% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 82.5µs ± 0% 80.5µs ± 1% -2.46% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 109µs ± 0% 107µs ± 0% -2.51% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 141µs ± 1% 139µs ± 1% -1.83% (p=0.016 n=5+5)
neo/go/sqlite-zwrk.go·1 100µs ± 1% 78µs ± 1% -21.89% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·2 108µs ± 0% 84µs ± 1% -22.76% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·3 118µs ± 0% 95µs ± 0% -19.43% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·4 132µs ± 0% 105µs ± 0% -20.48% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·8 203µs ± 1% 170µs ± 1% -16.32% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·12 295µs ± 2% 255µs ± 2% -13.58% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·16 393µs ± 2% 343µs ± 3% -12.65% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 89.9µs ± 0% 68.7µs ± 1% -23.67% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 100µs ± 0% 76µs ± 0% -23.65% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 108µs ± 0% 81µs ± 0% -24.71% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 117µs ± 0% 92µs ± 0% -21.75% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 182µs ± 1% 156µs ± 1% -14.07% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 277µs ± 2% 243µs ± 3% -12.27% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 386µs ± 2% 343µs ± 4% -11.10% (p=0.008 n=5+5)
cluster:rio dataset:prod1-1024
fs1-zwrk.go·1 2.17µs ± 1% 2.16µs ± 1% ~ (p=0.222 n=5+5)
fs1-zwrk.go·2 2.21µs ± 1% 2.18µs ± 1% ~ (p=0.063 n=5+5)
fs1-zwrk.go·3 2.23µs ± 0% 2.20µs ± 0% -1.12% (p=0.008 n=5+5)
fs1-zwrk.go·4 2.24µs ± 1% 2.23µs ± 2% ~ (p=0.222 n=5+5)
fs1-zwrk.go·8 3.43µs ± 1% 3.37µs ± 1% -1.75% (p=0.016 n=5+5)
fs1-zwrk.go·12 4.99µs ± 0% 4.99µs ± 0% ~ (p=0.548 n=5+5)
fs1-zwrk.go·16 6.65µs ± 0% 6.63µs ± 1% ~ (p=0.056 n=5+5)
zeo/py/fs1-zwrk.go·1 110µs ± 1% 109µs ± 1% ~ (p=0.056 n=5+5)
zeo/py/fs1-zwrk.go·2 171µs ± 2% 171µs ± 2% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·3 233µs ± 1% 234µs ± 2% ~ (p=0.690 n=5+5)
zeo/py/fs1-zwrk.go·4 300µs ± 3% 300µs ± 1% ~ (p=0.690 n=5+5)
zeo/py/fs1-zwrk.go·8 574µs ± 2% 566µs ± 2% ~ (p=0.310 n=5+5)
zeo/py/fs1-zwrk.go·12 844µs ± 2% 840µs ± 2% ~ (p=0.421 n=5+5)
zeo/py/fs1-zwrk.go·16 1.11ms ± 1% 1.12ms ± 3% ~ (p=0.841 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 137µs ± 2% 139µs ± 3% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 230µs ± 3% 234µs ± 1% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 344µs ± 3% 351µs ± 1% ~ (p=0.151 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 461µs ± 1% 466µs ± 1% ~ (p=0.151 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 912µs ± 2% 940µs ± 2% +3.02% (p=0.032 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 1.40ms ± 7% 1.41ms ± 2% ~ (p=0.310 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 1.85ms ± 1% 1.91ms ± 5% +3.39% (p=0.032 n=5+5)
neo/py(!log)/sql-zwrk.go·1 167µs ± 1% 166µs ± 4% ~ (p=0.151 n=5+5)
neo/py(!log)/sql-zwrk.go·2 292µs ± 5% 289µs ± 3% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zwrk.go·3 437µs ± 3% 433µs ± 2% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·4 580µs ± 1% 581µs ± 2% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·8 1.21ms ± 6% 1.18ms ± 7% ~ (p=0.310 n=5+5)
neo/py(!log)/sql-zwrk.go·12 1.77ms ± 2% 1.78ms ± 6% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·16 2.36ms ± 3% 2.36ms ± 7% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·1 46.4µs ± 0% 44.0µs ± 0% -5.18% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·2 51.3µs ± 0% 49.4µs ± 0% -3.70% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·3 58.8µs ± 1% 56.7µs ± 0% -3.60% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·4 64.3µs ± 0% 61.8µs ± 0% -3.81% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·8 100µs ± 1% 98µs ± 1% -2.22% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·12 147µs ± 2% 149µs ± 3% ~ (p=0.421 n=5+5)
neo/go/fs1-zwrk.go·16 198µs ± 3% 206µs ± 3% +3.86% (p=0.032 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 37.2µs ± 1% 37.1µs ± 1% ~ (p=0.690 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 40.6µs ± 0% 39.0µs ± 0% -3.85% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 48.1µs ± 0% 45.9µs ± 1% -4.60% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 53.6µs ± 0% 50.9µs ± 0% -5.00% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 85.6µs ± 2% 82.7µs ± 1% -3.33% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 124µs ± 2% 121µs ± 4% ~ (p=0.095 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 169µs ± 3% 170µs ± 3% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go·1 91.0µs ± 0% 68.1µs ± 0% -25.21% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·2 104µs ± 0% 79µs ± 0% -23.47% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·3 114µs ± 0% 87µs ± 1% -23.53% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·4 126µs ± 0% 99µs ± 0% -21.06% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·8 207µs ± 1% 193µs ± 3% -6.71% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·12 329µs ± 2% 311µs ± 3% -5.49% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·16 445µs ± 1% 423µs ± 3% -5.04% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 87.8µs ± 0% 63.6µs ± 1% -27.52% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 101µs ± 0% 74µs ± 0% -26.23% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 109µs ± 0% 80µs ± 0% -27.02% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 120µs ± 0% 92µs ± 1% -23.72% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 206µs ± 2% 177µs ± 2% -14.13% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 333µs ± 3% 289µs ± 2% -13.11% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 452µs ± 1% 395µs ± 1% -12.64% (p=0.008 n=5+5)

6b816d6f

X neo1: localhost timings · f3fc4bdd

Kirill Smelkov authored Mar 18, 2018

Similarly to deco there is some neo/go/sqlite speedup. Everything else
is noise.

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

$ benchstat -split node,cluster,dataset 20180308-neo1-ffixed-noc_C1$3µs$-zwrk1s.txt 20180318-neo1.txt

name old pystone/s new pystone/s delta
node:neo1
pystone 105k ± 0% 106k ± 1% +1.33% (p=0.008 n=5+5)

name old time/op new time/op delta
node:neo1
crc32/py/4K 5.15µs ± 1% 5.14µs ± 1% ~ (p=0.421 n=5+5)
crc32/go/4K 2.79µs ± 0% 2.79µs ± 0% ~ (p=0.206 n=4+5)
sha1/py/4K 13.5µs ± 3% 13.3µs ± 1% -1.56% (p=0.032 n=5+5)
sha1/go/4K 9.81µs ± 0% 9.81µs ± 0% ~ (p=0.794 n=5+5)
unzlib/py/wczdata 35.5µs ± 7% 36.1µs ± 2% ~ (p=0.556 n=5+4)
unzlib/go/wczdata 30.9µs ± 1% 31.1µs ± 2% ~ (p=0.310 n=5+5)
unzlib/py/prod1-avg 16.0µs ± 2% 16.1µs ± 2% ~ (p=0.690 n=5+5)
unzlib/go/prod1-avg 9.26µs ± 1% 9.27µs ± 1% ~ (p=0.548 n=5+5)
disk/randread/direct/4K-min 158µs ± 2% 162µs ± 0% +2.01% (p=0.016 n=5+4)
disk/randread/direct/4K-avg 172µs ± 0% 172µs ± 0% ~ (p=0.833 n=5+5)
disk/randread/pagecache/4K-min 392ns ± 2% 390ns ± 1% ~ (p=0.381 n=5+5)
disk/randread/pagecache/4K-avg 904ns ± 1% 897ns ± 1% -0.69% (p=0.040 n=5+5)

name old time/object new time/object delta
cluster:neo1 dataset:wczblk1-8
fs1-zhash.py 34.7µs ± 2% 35.3µs ± 3% ~ (p=0.175 n=5+5)
fs1-zhash.go 5.90µs ± 0% 5.95µs ± 3% ~ (p=1.000 n=4+4)
fs1-zhash.go+prefetch128 6.32µs ± 3% 6.28µs ± 4% ~ (p=0.873 n=5+5)
zeo/py/fs1-zhash.py 459µs ± 0% 484µs ± 6% +5.54% (p=0.016 n=4+5)
zeo/py/fs1-zhash.go 174µs ± 2% 175µs ± 1% ~ (p=0.841 n=5+5)
zeo/py/fs1-zhash.go+prefetch128 98.5µs ± 2% 101.8µs ± 2% +3.37% (p=0.032 n=5+5)
neo/py(!log)/sqlite-zhash.py 390µs ± 1% 394µs ± 2% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zhash.go 196µs ± 2% 204µs ± 8% +4.40% (p=0.032 n=5+5)
neo/py(!log)/sqlite-zhash.go+prefetch128 164µs ± 2% 168µs ± 2% +2.78% (p=0.032 n=5+5)
neo/py(!log)/sql-zhash.py 459µs ± 1% 450µs ± 6% ~ (p=0.686 n=4+4)
neo/py(!log)/sql-zhash.go 249µs ± 3% 245µs ± 3% ~ (p=0.333 n=5+5)
neo/py(!log)/sql-zhash.go+prefetch128 217µs ± 1% 215µs ± 3% ~ (p=0.421 n=5+5)
neo/go/fs1-zhash.py 274µs ± 1% 272µs ± 1% ~ (p=0.206 n=5+4)
neo/go/fs1-zhash.go 80.4µs ± 4% 80.0µs ± 4% ~ (p=0.548 n=5+5)
neo/go/fs1-zhash.go+prefetch128 35.3µs ± 6% 34.4µs ± 4% ~ (p=0.421 n=5+5)
neo/go/fs1(!sha1)-zhash.go(!sha1) 56.5µs ± 2% 55.3µs ± 2% ~ (p=0.087 n=5+5)
neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 23.2µs ± 7% 22.8µs ± 3% ~ (p=0.722 n=5+5)
neo/go/sqlite-zhash.py 322µs ± 1% 304µs ± 2% -5.70% (p=0.008 n=5+5)
neo/go/sqlite-zhash.go 134µs ±12% 102µs ± 2% -24.18% (p=0.008 n=5+5)
neo/go/sqlite-zhash.go+prefetch128 49.4µs ± 9% 42.1µs ± 9% -14.66% (p=0.008 n=5+5)
neo/go/sqlite-zhash.go(!sha1) 114µs ± 2% 91µs ± 3% -19.98% (p=0.008 n=5+5)
neo/go/sqlite-zhash.go+prefetch128(!sha1) 46.3µs ± 5% 41.2µs ± 4% -10.93% (p=0.008 n=5+5)
cluster:neo1 dataset:prod1-1024
fs1-zhash.py 29.3µs ± 0% 29.1µs ± 2% ~ (p=0.167 n=5+5)
fs1-zhash.go 3.80µs ± 0% 3.70µs ± 0% ~ (p=0.079 n=4+5)
fs1-zhash.go+prefetch128 3.78µs ± 3% 3.78µs ± 6% ~ (p=0.921 n=5+5)
zeo/py/fs1-zhash.py 436µs ± 2% 440µs ± 2% ~ (p=0.421 n=5+5)
zeo/py/fs1-zhash.go 150µs ± 2% 150µs ± 2% ~ (p=0.500 n=5+5)
zeo/py/fs1-zhash.go+prefetch128 88.0µs ± 1% 87.6µs ± 1% ~ (p=0.532 n=5+5)
neo/py(!log)/sqlite-zhash.py 387µs ± 5% 383µs ± 2% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zhash.go 185µs ± 4% 184µs ± 3% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zhash.go+prefetch128 150µs ± 2% 152µs ± 1% ~ (p=0.151 n=5+5)
neo/py(!log)/sql-zhash.py 477µs ±40% 440µs ± 3% ~ (p=0.730 n=5+4)
neo/py(!log)/sql-zhash.go 236µs ± 2% 233µs ± 2% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zhash.go+prefetch128 202µs ± 2% 205µs ± 1% ~ (p=0.111 n=5+5)
neo/go/fs1-zhash.py 267µs ±11% 265µs ±11% ~ (p=0.548 n=5+5)
neo/go/fs1-zhash.go 60.8µs ± 2% 60.8µs ± 1% ~ (p=0.683 n=5+5)
neo/go/fs1-zhash.go+prefetch128 22.2µs ± 1% 22.3µs ± 4% ~ (p=0.198 n=5+5)
neo/go/fs1(!sha1)-zhash.go(!sha1) 52.7µs ± 3% 52.2µs ± 4% ~ (p=0.690 n=5+5)
neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 18.4µs ± 5% 18.0µs ± 2% ~ (p=0.294 n=5+5)
neo/go/sqlite-zhash.py 312µs ± 1% 292µs ± 2% -6.49% (p=0.008 n=5+5)
neo/go/sqlite-zhash.go 112µs ± 1% 91µs ± 1% -18.39% (p=0.008 n=5+5)
neo/go/sqlite-zhash.go+prefetch128 41.2µs ± 7% 38.8µs ± 3% ~ (p=0.071 n=5+5)
neo/go/sqlite-zhash.go(!sha1) 107µs ± 2% 89µs ± 3% -16.90% (p=0.008 n=5+5)
neo/go/sqlite-zhash.go+prefetch128(!sha1) 41.5µs ± 4% 43.5µs ±16% ~ (p=0.651 n=5+5)

name old req/s new req/s delta
cluster:neo1 dataset:wczblk1-8
fs1-zwrk.go·1 230k ± 0% 230k ± 0% ~ (p=0.190 n=5+4)
fs1-zwrk.go·2 425k ± 7% 431k ± 8% ~ (p=0.690 n=5+5)
fs1-zwrk.go·3 660k ± 1% 661k ± 0% ~ (p=0.548 n=5+5)
fs1-zwrk.go·4 869k ± 1% 861k ± 1% ~ (p=0.063 n=4+5)
fs1-zwrk.go·8 1.00M ± 0% 1.00M ± 1% ~ (p=1.000 n=5+5)
fs1-zwrk.go·12 1.01M ± 0% 1.02M ± 0% +0.33% (p=0.008 n=5+5)
fs1-zwrk.go·16 1.02M ± 0% 1.02M ± 0% ~ (p=0.556 n=5+4)
zeo/py/fs1-zwrk.go·1 5.83k ± 1% 5.79k ± 1% ~ (p=0.222 n=5+5)
zeo/py/fs1-zwrk.go·2 7.21k ± 1% 7.09k ± 1% -1.61% (p=0.016 n=5+5)
zeo/py/fs1-zwrk.go·3 7.80k ± 3% 7.78k ± 2% ~ (p=0.548 n=5+5)
zeo/py/fs1-zwrk.go·4 8.01k ± 1% 8.00k ± 1% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·8 8.46k ± 1% 8.30k ± 1% -1.81% (p=0.032 n=5+5)
zeo/py/fs1-zwrk.go·12 8.52k ± 2% 8.28k ± 3% -2.83% (p=0.032 n=5+5)
zeo/py/fs1-zwrk.go·16 8.51k ± 2% 8.43k ± 1% ~ (p=0.310 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 5.23k ± 2% 5.19k ± 1% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 6.30k ± 2% 6.27k ± 2% ~ (p=0.548 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 6.33k ± 1% 5.97k ± 3% -5.61% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 6.30k ± 3% 6.16k ± 3% ~ (p=0.056 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 6.27k ± 3% 6.27k ± 0% ~ (p=0.730 n=5+4)
neo/py(!log)/sqlite-zwrk.go·12 6.36k ± 2% 6.05k ±10% ~ (p=0.056 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 6.33k ± 2% 6.31k ± 0% ~ (p=0.190 n=5+4)
neo/py(!log)/sql-zwrk.go·1 4.10k ± 5% 4.14k ± 3% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zwrk.go·2 4.85k ± 2% 4.75k ± 4% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·3 4.80k ± 4% 4.72k ± 5% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·4 4.78k ± 1% 4.67k ± 5% ~ (p=0.151 n=5+5)
neo/py(!log)/sql-zwrk.go·8 4.73k ± 7% 4.80k ± 2% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zwrk.go·12 4.67k ± 6% 4.87k ± 2% ~ (p=0.056 n=5+5)
neo/py(!log)/sql-zwrk.go·16 4.68k ± 9% 4.64k ±11% ~ (p=1.000 n=5+5)
neo/go/fs1-zwrk.go·1 13.0k ± 1% 13.0k ± 1% ~ (p=0.690 n=5+5)
neo/go/fs1-zwrk.go·2 25.0k ± 1% 25.0k ± 0% ~ (p=1.000 n=5+5)
neo/go/fs1-zwrk.go·3 32.4k ± 0% 32.5k ± 0% ~ (p=0.151 n=5+5)
neo/go/fs1-zwrk.go·4 40.9k ± 0% 41.0k ± 0% +0.36% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·8 54.8k ± 1% 55.0k ± 0% ~ (p=0.190 n=5+4)
neo/go/fs1-zwrk.go·12 57.4k ± 1% 56.9k ± 1% -0.81% (p=0.032 n=5+5)
neo/go/fs1-zwrk.go·16 55.8k ± 1% 55.7k ± 2% ~ (p=0.690 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 19.3k ± 1% 19.1k ± 2% ~ (p=0.548 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 38.0k ± 1% 38.0k ± 0% ~ (p=0.286 n=5+4)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 48.2k ± 0% 48.3k ± 0% ~ (p=0.690 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 59.3k ± 0% 59.5k ± 0% ~ (p=0.056 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 78.4k ± 0% 78.4k ± 0% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 82.7k ± 1% 82.5k ± 0% ~ (p=0.421 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 81.3k ± 2% 80.8k ± 1% ~ (p=0.413 n=5+4)
neo/go/sqlite-zwrk.go·1 8.23k ± 1% 9.93k ± 0% +20.66% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·2 15.0k ± 0% 18.3k ± 0% +22.40% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·3 20.7k ± 0% 24.8k ± 0% +19.63% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·4 24.9k ± 0% 29.9k ± 0% +20.32% (p=0.016 n=5+4)
neo/go/sqlite-zwrk.go·8 30.9k ± 8% 36.5k ± 1% +18.18% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·12 31.3k ± 1% 35.5k ± 2% +13.29% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·16 30.6k ± 3% 34.3k ± 2% +12.38% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 9.08k ± 0% 11.04k ± 3% +21.65% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 16.4k ± 0% 20.1k ± 0% +22.36% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 22.7k ± 0% 28.2k ± 0% +24.10% (p=0.016 n=4+5)
neo/go/sqlite-zwrk.go(!sha1)·4 27.8k ± 0% 33.7k ± 0% +21.34% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 34.6k ± 1% 38.7k ± 1% +11.83% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 33.5k ± 1% 38.0k ± 1% +13.32% (p=0.016 n=5+4)
neo/go/sqlite-zwrk.go(!sha1)·16 32.8k ± 2% 37.3k ± 1% +13.55% (p=0.008 n=5+5)
cluster:neo1 dataset:prod1-1024
fs1-zwrk.go·1 454k ± 0% 444k ±10% ~ (p=1.000 n=4+5)
fs1-zwrk.go·2 869k ± 6% 905k ± 0% +4.14% (p=0.016 n=5+4)
fs1-zwrk.go·3 1.33M ± 1% 1.31M ± 6% ~ (p=0.841 n=5+5)
fs1-zwrk.go·4 1.73M ± 2% 1.75M ± 3% ~ (p=0.421 n=5+5)
fs1-zwrk.go·8 1.99M ± 2% 2.02M ± 0% ~ (p=0.095 n=5+5)
fs1-zwrk.go·12 2.03M ± 0% 2.03M ± 0% ~ (p=0.905 n=4+5)
fs1-zwrk.go·16 2.04M ± 0% 2.03M ± 1% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·1 6.83k ± 1% 6.81k ± 0% ~ (p=0.905 n=5+4)
zeo/py/fs1-zwrk.go·2 8.72k ± 3% 8.67k ± 1% ~ (p=0.421 n=5+5)
zeo/py/fs1-zwrk.go·3 9.26k ± 6% 9.41k ± 3% ~ (p=0.310 n=5+5)
zeo/py/fs1-zwrk.go·4 9.78k ± 3% 9.74k ± 3% ~ (p=0.548 n=5+5)
zeo/py/fs1-zwrk.go·8 10.4k ± 1% 10.3k ± 2% ~ (p=0.310 n=5+5)
zeo/py/fs1-zwrk.go·12 10.6k ± 1% 10.3k ± 4% ~ (p=0.056 n=5+5)
zeo/py/fs1-zwrk.go·16 10.5k ± 5% 10.5k ± 2% ~ (p=0.841 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 5.57k ± 3% 5.53k ± 3% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 6.51k ± 1% 6.42k ± 3% ~ (p=0.151 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 6.39k ± 6% 6.41k ± 1% ~ (p=0.310 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 6.43k ± 1% 6.36k ± 2% ~ (p=0.310 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 6.33k ± 2% 6.33k ± 3% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 6.30k ± 3% 6.29k ± 3% ~ (p=0.841 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 6.37k ± 3% 6.27k ± 5% ~ (p=0.548 n=5+5)
neo/py(!log)/sql-zwrk.go·1 4.34k ± 2% 4.32k ± 4% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·2 4.94k ± 4% 4.87k ± 6% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·3 4.69k ± 5% 4.78k ± 3% ~ (p=0.222 n=5+5)
neo/py(!log)/sql-zwrk.go·4 4.78k ± 4% 4.61k ± 8% ~ (p=0.222 n=5+5)
neo/py(!log)/sql-zwrk.go·8 4.92k ± 1% 4.76k ± 2% -3.12% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·12 4.76k ± 3% 4.76k ± 4% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·16 4.90k ± 3% 4.77k ± 3% ~ (p=0.095 n=5+5)
neo/go/fs1-zwrk.go·1 17.4k ± 1% 17.1k ± 6% ~ (p=0.310 n=5+5)
neo/go/fs1-zwrk.go·2 32.9k ± 1% 32.7k ± 1% ~ (p=0.056 n=5+5)
neo/go/fs1-zwrk.go·3 43.5k ± 0% 43.3k ± 0% -0.44% (p=0.016 n=4+5)
neo/go/fs1-zwrk.go·4 53.2k ± 0% 53.1k ± 1% ~ (p=0.095 n=5+5)
neo/go/fs1-zwrk.go·8 67.0k ± 2% 65.2k ± 2% -2.59% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·12 62.6k ± 3% 59.5k ± 5% -4.89% (p=0.016 n=5+5)
neo/go/fs1-zwrk.go·16 54.3k ±11% 53.7k ± 2% ~ (p=0.151 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 20.2k ± 5% 20.1k ± 3% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 40.8k ± 1% 40.8k ± 1% ~ (p=0.690 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 51.9k ± 1% 51.7k ± 0% ~ (p=0.190 n=5+4)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 62.7k ± 0% 62.6k ± 0% ~ (p=0.310 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 75.1k ± 4% 74.6k ± 3% ~ (p=0.548 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 69.5k ± 1% 67.8k ± 4% ~ (p=0.151 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 61.0k ± 2% 59.3k ± 2% ~ (p=0.056 n=5+5)
neo/go/sqlite-zwrk.go·1 9.16k ± 1% 11.15k ± 0% +21.74% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·2 16.0k ± 0% 20.0k ± 0% +25.10% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·3 22.1k ± 0% 27.2k ± 0% +23.34% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·4 26.7k ± 0% 31.8k ± 2% +19.00% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·8 30.9k ± 2% 32.8k ± 3% +6.19% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·12 29.5k ± 1% 32.1k ± 2% +8.71% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·16 29.6k ± 2% 32.8k ± 2% +10.86% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 9.51k ± 1% 11.74k ± 2% +23.39% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 16.5k ± 0% 21.1k ± 1% +27.77% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 22.7k ± 0% 28.9k ± 0% +27.72% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 27.4k ± 1% 34.3k ± 0% +25.08% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 31.2k ± 2% 35.5k ± 2% +13.70% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 29.5k ± 2% 34.2k ± 3% +16.00% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 28.8k ±10% 35.8k ± 1% +24.19% (p=0.008 n=5+5)

name old latency-time/object new latency-time/object delta
cluster:neo1 dataset:wczblk1-8
fs1-zwrk.go·1 4.36µs ± 0% 4.35µs ± 0% ~ (p=0.206 n=5+4)
fs1-zwrk.go·2 4.71µs ± 8% 4.65µs ± 8% ~ (p=0.690 n=5+5)
fs1-zwrk.go·3 4.55µs ± 1% 4.54µs ± 0% ~ (p=0.524 n=5+5)
fs1-zwrk.go·4 4.60µs ± 1% 4.65µs ± 1% +0.99% (p=0.048 n=4+5)
fs1-zwrk.go·8 8.03µs ± 0% 8.04µs ± 1% ~ (p=1.000 n=5+5)
fs1-zwrk.go·12 11.8µs ± 0% 11.8µs ± 0% -0.33% (p=0.008 n=5+5)
fs1-zwrk.go·16 15.7µs ± 0% 15.7µs ± 0% ~ (p=0.556 n=5+4)
zeo/py/fs1-zwrk.go·1 172µs ± 1% 173µs ± 1% ~ (p=0.222 n=5+5)
zeo/py/fs1-zwrk.go·2 277µs ± 1% 282µs ± 1% +1.63% (p=0.016 n=5+5)
zeo/py/fs1-zwrk.go·3 384µs ± 3% 386µs ± 2% ~ (p=0.548 n=5+5)
zeo/py/fs1-zwrk.go·4 500µs ± 1% 500µs ± 1% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·8 946µs ± 1% 963µs ± 1% +1.85% (p=0.032 n=5+5)
zeo/py/fs1-zwrk.go·12 1.41ms ± 2% 1.45ms ± 3% +2.92% (p=0.032 n=5+5)
zeo/py/fs1-zwrk.go·16 1.88ms ± 2% 1.90ms ± 1% ~ (p=0.310 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 191µs ± 2% 193µs ± 1% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 317µs ± 2% 319µs ± 2% ~ (p=0.548 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 474µs ± 1% 503µs ± 3% +5.98% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 635µs ± 3% 650µs ± 3% ~ (p=0.056 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 1.28ms ± 3% 1.28ms ± 0% ~ (p=0.730 n=5+4)
neo/py(!log)/sqlite-zwrk.go·12 1.89ms ± 2% 1.99ms ±11% ~ (p=0.056 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 2.53ms ± 2% 2.53ms ± 0% ~ (p=0.190 n=5+4)
neo/py(!log)/sql-zwrk.go·1 244µs ± 6% 242µs ± 3% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zwrk.go·2 412µs ± 3% 422µs ± 4% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·3 625µs ± 4% 637µs ± 5% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·4 837µs ± 1% 857µs ± 5% ~ (p=0.151 n=5+5)
neo/py(!log)/sql-zwrk.go·8 1.69ms ± 7% 1.67ms ± 2% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zwrk.go·12 2.57ms ± 6% 2.47ms ± 2% ~ (p=0.056 n=5+5)
neo/py(!log)/sql-zwrk.go·16 3.42ms ± 9% 3.46ms ±12% ~ (p=1.000 n=5+5)
neo/go/fs1-zwrk.go·1 76.7µs ± 1% 77.2µs ± 1% ~ (p=0.690 n=5+5)
neo/go/fs1-zwrk.go·2 79.9µs ± 1% 80.0µs ± 0% ~ (p=1.000 n=5+5)
neo/go/fs1-zwrk.go·3 92.5µs ± 0% 92.3µs ± 0% ~ (p=0.151 n=5+5)
neo/go/fs1-zwrk.go·4 97.9µs ± 0% 97.5µs ± 0% -0.36% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·8 146µs ± 1% 145µs ± 0% ~ (p=0.190 n=5+4)
neo/go/fs1-zwrk.go·12 209µs ± 1% 211µs ± 1% +0.82% (p=0.032 n=5+5)
neo/go/fs1-zwrk.go·16 287µs ± 1% 287µs ± 2% ~ (p=0.690 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 51.9µs ± 2% 52.3µs ± 2% ~ (p=0.548 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 52.7µs ± 1% 52.6µs ± 0% ~ (p=0.286 n=5+4)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 62.2µs ± 0% 62.1µs ± 0% ~ (p=0.690 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 67.4µs ± 0% 67.2µs ± 0% ~ (p=0.056 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 102µs ± 0% 102µs ± 0% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 145µs ± 1% 145µs ± 0% ~ (p=0.421 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 197µs ± 2% 198µs ± 1% ~ (p=0.413 n=5+4)
neo/go/sqlite-zwrk.go·1 122µs ± 1% 101µs ± 0% -17.13% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·2 134µs ± 0% 109µs ± 0% -18.30% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·3 145µs ± 0% 121µs ± 0% -16.41% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·4 161µs ± 0% 134µs ± 0% -16.89% (p=0.016 n=5+4)
neo/go/sqlite-zwrk.go·8 260µs ± 9% 219µs ± 1% -15.53% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·12 383µs ± 1% 338µs ± 2% -11.73% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·16 524µs ± 3% 466µs ± 2% -11.01% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 110µs ± 0% 91µs ± 3% -17.78% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 122µs ± 0% 100µs ± 0% -18.28% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 132µs ± 0% 106µs ± 0% -19.42% (p=0.016 n=4+5)
neo/go/sqlite-zwrk.go(!sha1)·4 144µs ± 0% 119µs ± 0% -17.59% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 231µs ± 1% 207µs ± 1% -10.58% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 358µs ± 1% 316µs ± 1% -11.76% (p=0.016 n=5+4)
neo/go/sqlite-zwrk.go(!sha1)·16 487µs ± 2% 429µs ± 1% -11.95% (p=0.008 n=5+5)
cluster:neo1 dataset:prod1-1024
fs1-zwrk.go·1 2.20µs ± 0% 2.26µs ±11% ~ (p=1.000 n=4+5)
fs1-zwrk.go·2 2.31µs ± 6% 2.21µs ± 0% -4.17% (p=0.000 n=5+4)
fs1-zwrk.go·3 2.25µs ± 1% 2.29µs ± 7% ~ (p=0.841 n=5+5)
fs1-zwrk.go·4 2.31µs ± 2% 2.29µs ± 3% ~ (p=0.421 n=5+5)
fs1-zwrk.go·8 4.02µs ± 2% 3.96µs ± 0% ~ (p=0.095 n=5+5)
fs1-zwrk.go·12 5.91µs ± 0% 5.90µs ± 0% ~ (p=0.841 n=4+5)
fs1-zwrk.go·16 7.86µs ± 0% 7.86µs ± 1% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·1 146µs ± 1% 147µs ± 0% ~ (p=0.905 n=5+4)
zeo/py/fs1-zwrk.go·2 229µs ± 3% 231µs ± 1% ~ (p=0.421 n=5+5)
zeo/py/fs1-zwrk.go·3 324µs ± 6% 319µs ± 3% ~ (p=0.310 n=5+5)
zeo/py/fs1-zwrk.go·4 409µs ± 3% 411µs ± 3% ~ (p=0.548 n=5+5)
zeo/py/fs1-zwrk.go·8 766µs ± 1% 774µs ± 2% ~ (p=0.310 n=5+5)
zeo/py/fs1-zwrk.go·12 1.13ms ± 1% 1.16ms ± 4% ~ (p=0.056 n=5+5)
zeo/py/fs1-zwrk.go·16 1.53ms ± 5% 1.52ms ± 2% ~ (p=0.841 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 180µs ± 3% 181µs ± 3% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 307µs ± 1% 311µs ± 3% ~ (p=0.151 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 470µs ± 6% 468µs ± 1% ~ (p=0.310 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 622µs ± 1% 629µs ± 2% ~ (p=0.310 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 1.26ms ± 2% 1.26ms ± 3% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 1.91ms ± 3% 1.91ms ± 3% ~ (p=0.841 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 2.51ms ± 3% 2.55ms ± 5% ~ (p=0.548 n=5+5)
neo/py(!log)/sql-zwrk.go·1 230µs ± 2% 232µs ± 4% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·2 405µs ± 4% 411µs ± 7% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·3 640µs ± 5% 628µs ± 3% ~ (p=0.222 n=5+5)
neo/py(!log)/sql-zwrk.go·4 837µs ± 4% 870µs ± 9% ~ (p=0.222 n=5+5)
neo/py(!log)/sql-zwrk.go·8 1.63ms ± 1% 1.68ms ± 2% +3.24% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·12 2.52ms ± 3% 2.52ms ± 4% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·16 3.27ms ± 3% 3.35ms ± 3% ~ (p=0.095 n=5+5)
neo/go/fs1-zwrk.go·1 57.4µs ± 1% 58.5µs ± 6% ~ (p=0.310 n=5+5)
neo/go/fs1-zwrk.go·2 60.8µs ± 1% 61.2µs ± 1% ~ (p=0.056 n=5+5)
neo/go/fs1-zwrk.go·3 69.0µs ± 0% 69.3µs ± 0% +0.44% (p=0.016 n=4+5)
neo/go/fs1-zwrk.go·4 75.1µs ± 0% 75.4µs ± 1% ~ (p=0.103 n=5+5)
neo/go/fs1-zwrk.go·8 119µs ± 2% 123µs ± 2% +2.66% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·12 192µs ± 3% 202µs ± 5% +5.20% (p=0.016 n=5+5)
neo/go/fs1-zwrk.go·16 296µs ±12% 298µs ± 2% ~ (p=0.151 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 49.5µs ± 5% 49.8µs ± 3% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 49.0µs ± 1% 49.0µs ± 1% ~ (p=0.690 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 57.8µs ± 1% 58.0µs ± 0% ~ (p=0.190 n=5+4)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 63.7µs ± 0% 63.9µs ± 0% ~ (p=0.310 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 107µs ± 5% 107µs ± 4% ~ (p=0.548 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 173µs ± 1% 177µs ± 4% ~ (p=0.151 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 262µs ± 2% 270µs ± 2% ~ (p=0.056 n=5+5)
neo/go/sqlite-zwrk.go·1 109µs ± 1% 90µs ± 0% -17.86% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·2 125µs ± 0% 100µs ± 0% -20.06% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·3 136µs ± 0% 110µs ± 0% -18.92% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·4 150µs ± 0% 126µs ± 2% -15.96% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·8 259µs ± 2% 244µs ± 3% -5.81% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·12 407µs ± 1% 374µs ± 2% -8.01% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·16 541µs ± 2% 488µs ± 2% -9.80% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 105µs ± 1% 85µs ± 2% -18.95% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 121µs ± 0% 95µs ± 1% -21.73% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 132µs ± 0% 104µs ± 0% -21.71% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 146µs ± 1% 117µs ± 0% -20.05% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 256µs ± 2% 225µs ± 2% -12.05% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 407µs ± 2% 351µs ± 3% -13.79% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 557µs ±10% 447µs ± 1% -19.70% (p=0.008 n=5+5)

f3fc4bdd

X deco: localhost timings · fcb32916

Kirill Smelkov authored Mar 18, 2018

neo/go/sqlite is speed-up a bit, because we are now not retaking
database file lock on every query which is expensive to do (see 57fa0d99
for details). E.g.

---- 8< ----
cluster:deco dataset:wczblk1-8
neo/go/sqlite-zhash.go 93.7µs ± 1% 72.8µs ± 1% -22.30% (p=0.008 n=5+5)
neo/go/sqlite-zhash.go(!sha1) 86.4µs ± 3% 66.2µs ± 2% -23.37% (p=0.008 n=5+5)

neo/go/sqlite-zwrk.go·1 91.2µs ± 0% 71.1µs ± 0% -22.02% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·2 109µs ± 1% 81µs ± 1% -25.66% (p=0.016 n=4+5)
neo/go/sqlite-zwrk.go·3 124µs ± 0% 96µs ± 1% -22.71% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·4 149µs ± 1% 122µs ± 1% -18.25% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·8 270µs ± 2% 229µs ± 2% -15.27% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·12 410µs ± 2% 351µs ± 3% -14.41% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·16 560µs ± 1% 479µs ± 2% -14.47% (p=0.008 n=5+5)

cluster:deco dataset:prod1-1024
neo/go/sqlite-zhash.go 86.3µs ± 0% 65.9µs ± 1% -23.65% (p=0.008 n=5+5)
neo/go/sqlite-zhash.go(!sha1) 83.8µs ± 2% 63.3µs ± 1% -24.49% (p=0.008 n=5+5)

neo/go/sqlite-zwrk.go·1 85.5µs ± 1% 64.3µs ± 0% -24.84% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·2 106µs ± 1% 78µs ± 1% -25.95% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·3 123µs ± 2% 95µs ± 1% -23.01% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·4 154µs ± 3% 123µs ± 1% -19.85% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·8 325µs ± 5% 271µs ± 3% -16.50% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·12 507µs ± 3% 424µs ± 2% -16.39% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·16 665µs ± 3% 549µs ± 1% -17.44% (p=0.008 n=5+5)
---- 8< ----

Everything else is probably within noise except

---- 8< ----
zeo/py/fs1-zhash.go 112µs ± 1% 130µs ± 1% +15.41% (p=0.008 n=5+5)
---- 8< ----

which has no explanation, but probably it was due to e.g. other
short-lived program also running on my machine.

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

$ benchstat -split node,cluster,dataset 20180306-deco-ffixed-noc_C1$2µs$.txt 20180318-deco.txt

name old pystone/s new pystone/s delta
node:deco
pystone 218k ± 2% 218k ± 2% ~ (p=0.690 n=5+5)

name old time/op new time/op delta
node:deco
crc32/py/4K 5.72µs ± 0% 5.72µs ± 0% ~ (p=0.460 n=5+5)
crc32/go/4K 280ns ± 1% 279ns ± 0% ~ (p=0.444 n=5+5)
sha1/py/4K 6.72µs ± 1% 6.70µs ± 0% ~ (p=0.381 n=5+5)
sha1/go/4K 5.59µs ± 0% 5.59µs ± 0% ~ (p=0.603 n=4+5)
unzlib/py/wczdata 27.2µs ± 1% 27.1µs ± 1% ~ (p=0.151 n=5+5)
unzlib/go/wczdata 26.8µs ± 0% 26.7µs ± 0% -0.54% (p=0.008 n=5+5)
unzlib/py/prod1-avg 5.08µs ± 1% 5.12µs ± 2% ~ (p=0.310 n=5+5)
unzlib/go/prod1-avg 5.29µs ± 1% 5.25µs ± 0% -0.71% (p=0.008 n=5+5)
disk/randread/direct/4K-min 105µs ± 0% 123µs ± 1% +17.41% (p=0.008 n=5+5)
disk/randread/direct/4K-avg 142µs ± 0% 141µs ± 0% -0.40% (p=0.016 n=5+4)
disk/randread/pagecache/4K-min 582ns ± 0% 581ns ± 1% ~ (p=0.540 n=5+5)
disk/randread/pagecache/4K-avg 987ns ± 0% 975ns ± 0% -1.28% (p=0.008 n=5+5)

name old time/object new time/object delta
cluster:deco dataset:wczblk1-8
fs1-zhash.py 20.2µs ± 1% 20.1µs ± 1% ~ (p=0.206 n=5+4)
fs1-zhash.go 3.20µs ± 0% 3.20µs ± 0% ~ (all equal)
fs1-zhash.go+prefetch128 4.14µs ± 1% 3.98µs ±10% ~ (p=0.206 n=5+5)
zeo/py/fs1-zhash.py 361µs ± 3% 376µs ± 3% +3.88% (p=0.032 n=5+5)
zeo/py/fs1-zhash.go 112µs ± 1% 130µs ± 1% +15.41% (p=0.008 n=5+5)
zeo/py/fs1-zhash.go+prefetch128 63.9µs ± 1% 64.0µs ± 3% ~ (p=0.738 n=5+5)
neo/py(!log)/sqlite-zhash.py 321µs ± 8% 329µs ± 6% ~ (p=0.548 n=5+5)
neo/py(!log)/sqlite-zhash.go 141µs ± 3% 147µs ± 3% +4.26% (p=0.016 n=5+5)
neo/py(!log)/sqlite-zhash.go+prefetch128 119µs ± 1% 124µs ± 1% +4.53% (p=0.008 n=5+5)
neo/py(!log)/sql-zhash.py 376µs ± 2% 375µs ± 3% ~ (p=0.971 n=4+4)
neo/py(!log)/sql-zhash.go 187µs ± 5% 183µs ± 3% ~ (p=0.206 n=5+5)
neo/py(!log)/sql-zhash.go+prefetch128 164µs ± 2% 163µs ± 1% ~ (p=0.881 n=5+5)
neo/go/fs1-zhash.py 226µs ± 2% 226µs ± 3% ~ (p=1.000 n=5+5)
neo/go/fs1-zhash.go 57.1µs ± 1% 55.9µs ± 1% -2.17% (p=0.008 n=5+5)
neo/go/fs1-zhash.go+prefetch128 24.0µs ± 4% 24.2µs ± 5% ~ (p=0.841 n=5+5)
neo/go/fs1(!sha1)-zhash.go(!sha1) 40.3µs ± 1% 39.3µs ± 1% -2.48% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 17.2µs ± 4% 16.9µs ± 8% ~ (p=0.548 n=5+5)
neo/go/sqlite-zhash.py 253µs ± 1% 249µs ± 2% ~ (p=0.056 n=5+5)
neo/go/sqlite-zhash.go 93.7µs ± 1% 72.8µs ± 1% -22.30% (p=0.008 n=5+5)
neo/go/sqlite-zhash.go+prefetch128 39.5µs ± 6% 34.3µs ±12% -13.18% (p=0.032 n=5+5)
neo/go/sqlite-zhash.go(!sha1) 86.4µs ± 3% 66.2µs ± 2% -23.37% (p=0.008 n=5+5)
neo/go/sqlite-zhash.go+prefetch128(!sha1) 39.4µs ± 7% 31.5µs ±12% -20.01% (p=0.008 n=5+5)
cluster:deco dataset:prod1-1024
fs1-zhash.py 15.9µs ± 2% 15.9µs ± 1% ~ (p=1.032 n=5+4)
fs1-zhash.go 2.80µs ± 0% 2.70µs ± 0% -3.57% (p=0.029 n=4+4)
fs1-zhash.go+prefetch128 3.34µs ± 2% 3.30µs ± 0% ~ (p=0.333 n=5+4)
zeo/py/fs1-zhash.py 347µs ± 3% 345µs ± 3% ~ (p=0.841 n=5+5)
zeo/py/fs1-zhash.go 105µs ± 0% 105µs ± 1% ~ (p=0.659 n=5+5)
zeo/py/fs1-zhash.go+prefetch128 58.9µs ± 1% 58.9µs ± 1% ~ (p=0.984 n=5+5)
neo/py(!log)/sqlite-zhash.py 317µs ± 5% 328µs ± 6% ~ (p=0.222 n=5+5)
neo/py(!log)/sqlite-zhash.go 138µs ± 1% 140µs ± 1% +1.64% (p=0.024 n=5+5)
neo/py(!log)/sqlite-zhash.go+prefetch128 112µs ± 1% 117µs ± 1% +4.25% (p=0.008 n=5+5)
neo/py(!log)/sql-zhash.py 377µs ± 2% 373µs ± 3% ~ (p=0.686 n=4+4)
neo/py(!log)/sql-zhash.go 184µs ± 2% 181µs ± 1% ~ (p=0.151 n=5+5)
neo/py(!log)/sql-zhash.go+prefetch128 160µs ± 2% 153µs ± 1% -3.91% (p=0.008 n=5+5)
neo/go/fs1-zhash.py 225µs ± 1% 229µs ± 1% +1.86% (p=0.024 n=5+5)
neo/go/fs1-zhash.go 44.6µs ± 0% 43.5µs ± 0% -2.42% (p=0.000 n=5+4)
neo/go/fs1-zhash.go+prefetch128 17.2µs ± 3% 16.8µs ± 3% ~ (p=0.127 n=5+5)
neo/go/fs1(!sha1)-zhash.go(!sha1) 39.1µs ± 3% 38.1µs ± 1% -2.46% (p=0.016 n=5+5)
neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 15.2µs ± 3% 14.3µs ± 3% -5.79% (p=0.008 n=5+5)
neo/go/sqlite-zhash.py 254µs ± 1% 257µs ± 1% ~ (p=0.063 n=5+5)
neo/go/sqlite-zhash.go 86.3µs ± 0% 65.9µs ± 1% -23.65% (p=0.008 n=5+5)
neo/go/sqlite-zhash.go+prefetch128 36.6µs ± 5% 29.8µs ± 2% -18.52% (p=0.008 n=5+5)
neo/go/sqlite-zhash.go(!sha1) 83.8µs ± 2% 63.3µs ± 1% -24.49% (p=0.008 n=5+5)
neo/go/sqlite-zhash.go+prefetch128(!sha1) 36.9µs ± 8% 29.3µs ± 3% -20.63% (p=0.008 n=5+5)

name old req/s new req/s delta
cluster:deco dataset:wczblk1-8
fs1-zwrk.go·1 431k ± 1% 452k ± 1% +4.99% (p=0.008 n=5+5)
fs1-zwrk.go·2 760k ± 3% 790k ± 4% +3.92% (p=0.032 n=5+5)
fs1-zwrk.go·3 1.08M ± 2% 1.09M ± 0% +1.52% (p=0.008 n=5+5)
fs1-zwrk.go·4 1.16M ± 1% 1.20M ± 1% +3.40% (p=0.008 n=5+5)
fs1-zwrk.go·8 1.27M ± 1% 1.28M ± 1% +0.83% (p=0.016 n=5+5)
fs1-zwrk.go·12 1.28M ± 1% 1.29M ± 1% +1.01% (p=0.032 n=5+5)
fs1-zwrk.go·16 1.28M ± 1% 1.29M ± 0% ~ (p=0.095 n=5+5)
zeo/py/fs1-zwrk.go·1 8.04k ± 4% 8.14k ± 3% ~ (p=0.222 n=5+5)
zeo/py/fs1-zwrk.go·2 9.54k ± 1% 9.64k ± 0% +1.03% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·3 10.5k ± 0% 10.5k ± 1% ~ (p=0.548 n=5+5)
zeo/py/fs1-zwrk.go·4 11.0k ± 1% 11.0k ± 1% ~ (p=0.841 n=5+5)
zeo/py/fs1-zwrk.go·8 11.4k ± 1% 11.4k ± 0% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·12 11.7k ± 0% 11.6k ± 1% ~ (p=0.690 n=5+5)
zeo/py/fs1-zwrk.go·16 11.8k ± 2% 11.8k ± 0% ~ (p=0.841 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 7.04k ± 1% 6.90k ± 1% -2.00% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 8.52k ± 1% 8.25k ± 1% -3.15% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 8.51k ± 1% 8.28k ± 1% -2.68% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 8.50k ± 1% 8.27k ± 1% -2.75% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 8.53k ± 1% 8.26k ± 1% -3.12% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 8.48k ± 2% 8.28k ± 1% -2.42% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 8.48k ± 1% 8.25k ± 1% -2.62% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·1 5.37k ± 3% 5.41k ± 2% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·2 6.34k ± 0% 6.39k ± 1% +0.80% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·3 6.28k ± 1% 6.33k ± 1% ~ (p=0.310 n=5+5)
neo/py(!log)/sql-zwrk.go·4 6.29k ± 1% 6.32k ± 1% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·8 6.29k ± 1% 6.36k ± 1% ~ (p=0.095 n=5+5)
neo/py(!log)/sql-zwrk.go·12 6.25k ± 1% 6.33k ± 1% +1.38% (p=0.016 n=5+5)
neo/py(!log)/sql-zwrk.go·16 6.23k ± 2% 6.29k ± 1% ~ (p=0.421 n=5+5)
neo/go/fs1-zwrk.go·1 18.4k ± 0% 18.8k ± 0% +2.52% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·2 38.3k ± 1% 39.2k ± 0% +2.26% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·3 45.9k ± 0% 46.5k ± 3% ~ (p=0.151 n=5+5)
neo/go/fs1-zwrk.go·4 50.0k ± 0% 51.2k ± 0% +2.40% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·8 60.3k ± 1% 61.5k ± 0% +1.95% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·12 62.1k ± 1% 62.9k ± 1% ~ (p=0.421 n=5+5)
neo/go/fs1-zwrk.go·16 61.6k ± 1% 63.0k ± 1% +2.18% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 26.3k ± 0% 27.0k ± 0% +2.53% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 55.7k ± 1% 56.9k ± 0% +2.14% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 62.8k ± 1% 64.2k ± 1% +2.16% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 69.4k ± 1% 70.7k ± 1% +1.89% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 88.3k ± 1% 90.1k ± 0% +2.01% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 93.5k ± 1% 94.9k ± 0% +1.45% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 93.8k ± 0% 95.3k ± 0% +1.61% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·1 11.0k ± 0% 14.1k ± 0% +28.25% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·2 18.3k ± 1% 24.7k ± 1% +34.52% (p=0.016 n=4+5)
neo/go/sqlite-zwrk.go·3 24.2k ± 0% 31.3k ± 1% +29.39% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·4 26.8k ± 1% 32.8k ± 1% +22.33% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·8 29.6k ± 2% 34.9k ± 2% +18.02% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·12 29.3k ± 2% 34.2k ± 3% +16.85% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·16 28.6k ± 1% 33.4k ± 2% +16.93% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 11.9k ± 1% 15.6k ± 0% +31.16% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 19.6k ± 1% 25.9k ± 0% +32.17% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 26.4k ± 0% 35.3k ± 1% +33.49% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 30.0k ± 0% 38.8k ± 1% +29.36% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 31.2k ± 2% 37.4k ± 2% +19.86% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 28.8k ± 3% 36.5k ± 2% +26.88% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 28.4k ± 1% 39.4k ± 2% +38.81% (p=0.008 n=5+5)
cluster:deco dataset:prod1-1024
fs1-zwrk.go·1 556k ± 0% 566k ± 1% +1.85% (p=0.008 n=5+5)
fs1-zwrk.go·2 994k ± 6% 1047k ± 5% ~ (p=0.056 n=5+5)
fs1-zwrk.go·3 1.33M ± 2% 1.34M ± 1% ~ (p=0.151 n=5+5)
fs1-zwrk.go·4 1.53M ± 0% 1.55M ± 2% ~ (p=0.151 n=5+5)
fs1-zwrk.go·8 1.59M ± 1% 1.61M ± 0% +1.50% (p=0.008 n=5+5)
fs1-zwrk.go·12 1.60M ± 1% 1.62M ± 0% +1.45% (p=0.008 n=5+5)
fs1-zwrk.go·16 1.59M ± 0% 1.62M ± 0% +1.46% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·1 9.75k ± 1% 9.77k ± 0% ~ (p=0.841 n=5+5)
zeo/py/fs1-zwrk.go·2 12.4k ± 1% 12.3k ± 1% ~ (p=0.095 n=5+5)
zeo/py/fs1-zwrk.go·3 14.2k ± 1% 14.3k ± 1% +0.91% (p=0.016 n=5+5)
zeo/py/fs1-zwrk.go·4 14.9k ± 1% 14.9k ± 1% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·8 15.6k ± 1% 15.7k ± 0% +0.45% (p=0.032 n=5+5)
zeo/py/fs1-zwrk.go·12 16.0k ± 1% 16.0k ± 0% ~ (p=0.190 n=5+4)
zeo/py/fs1-zwrk.go·16 16.0k ± 6% 16.3k ± 0% ~ (p=0.222 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 7.45k ± 2% 7.20k ± 1% -3.34% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 8.71k ± 1% 8.32k ± 0% -4.47% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 8.69k ± 1% 8.27k ± 1% -4.82% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 8.61k ± 1% 8.25k ± 1% -4.22% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 8.61k ± 1% 8.37k ± 1% -2.80% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 8.59k ± 1% 8.35k ± 1% -2.86% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 8.60k ± 1% 8.39k ± 1% -2.42% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·1 5.45k ± 2% 5.55k ± 1% +1.89% (p=0.016 n=5+5)
neo/py(!log)/sql-zwrk.go·2 6.25k ± 1% 6.46k ± 1% +3.27% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·3 6.24k ± 1% 6.41k ± 1% +2.66% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·4 6.27k ± 1% 6.41k ± 1% +2.20% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·8 6.28k ± 1% 6.41k ± 0% +2.12% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·12 6.33k ± 0% 6.43k ± 1% +1.51% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·16 6.30k ± 1% 6.41k ± 1% +1.84% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·1 23.9k ± 0% 24.4k ± 0% +2.37% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·2 45.5k ± 1% 46.4k ± 1% +2.10% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·3 55.1k ± 0% 56.7k ± 1% +2.90% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·4 60.4k ± 0% 61.9k ± 1% +2.45% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·8 69.2k ± 2% 70.5k ± 2% ~ (p=0.095 n=5+5)
neo/go/fs1-zwrk.go·12 68.0k ± 5% 70.4k ± 4% ~ (p=0.222 n=5+5)
neo/go/fs1-zwrk.go·16 68.1k ± 3% 70.9k ± 6% ~ (p=0.056 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 27.2k ± 1% 28.0k ± 1% +3.05% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 55.5k ± 1% 57.5k ± 0% +3.45% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 64.0k ± 1% 65.4k ± 0% +2.13% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 69.1k ± 1% 71.4k ± 1% +3.28% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 81.1k ± 4% 82.8k ± 2% ~ (p=0.222 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 77.8k ± 8% 83.4k ± 5% ~ (p=0.056 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 76.8k ± 5% 79.9k ± 3% ~ (p=0.056 n=5+5)
neo/go/sqlite-zwrk.go·1 11.7k ± 1% 15.6k ± 0% +33.04% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·2 18.9k ± 1% 25.6k ± 1% +35.04% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·3 24.4k ± 2% 31.6k ± 1% +29.89% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·4 26.0k ± 3% 32.5k ± 1% +24.74% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·8 24.6k ± 5% 29.5k ± 3% +19.67% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·12 23.7k ± 3% 28.3k ± 2% +19.59% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·16 24.1k ± 3% 29.2k ± 1% +21.07% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 12.2k ± 1% 16.2k ± 0% +33.34% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 19.6k ± 1% 26.2k ± 1% +33.41% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 25.5k ± 1% 33.2k ± 1% +30.52% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 27.5k ± 2% 34.3k ± 2% +24.53% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 25.6k ± 2% 29.4k ± 3% +14.78% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 24.0k ± 2% 29.6k ± 2% +23.18% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 24.2k ± 1% 33.1k ± 1% +37.12% (p=0.008 n=5+5)

name old latency-time/object new latency-time/object delta
cluster:deco dataset:wczblk1-8
fs1-zwrk.go·1 2.32µs ± 1% 2.21µs ± 1% -4.76% (p=0.008 n=5+5)
fs1-zwrk.go·2 2.63µs ± 3% 2.53µs ± 3% -3.76% (p=0.032 n=5+5)
fs1-zwrk.go·3 2.78µs ± 2% 2.74µs ± 0% -1.51% (p=0.008 n=5+5)
fs1-zwrk.go·4 3.44µs ± 1% 3.33µs ± 1% -3.29% (p=0.008 n=5+5)
fs1-zwrk.go·8 6.28µs ± 1% 6.23µs ± 1% -0.82% (p=0.016 n=5+5)
fs1-zwrk.go·12 9.40µs ± 1% 9.31µs ± 1% -1.00% (p=0.032 n=5+5)
fs1-zwrk.go·16 12.5µs ± 1% 12.4µs ± 0% ~ (p=0.095 n=5+5)
zeo/py/fs1-zwrk.go·1 125µs ± 4% 123µs ± 3% ~ (p=0.222 n=5+5)
zeo/py/fs1-zwrk.go·2 210µs ± 1% 208µs ± 0% -1.02% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·3 286µs ± 0% 285µs ± 1% ~ (p=0.548 n=5+5)
zeo/py/fs1-zwrk.go·4 365µs ± 1% 365µs ± 1% ~ (p=0.841 n=5+5)
zeo/py/fs1-zwrk.go·8 699µs ± 1% 700µs ± 0% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·12 1.03ms ± 0% 1.03ms ± 1% ~ (p=0.690 n=5+5)
zeo/py/fs1-zwrk.go·16 1.36ms ± 2% 1.36ms ± 0% ~ (p=0.841 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 142µs ± 1% 145µs ± 1% +2.03% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 235µs ± 1% 242µs ± 1% +3.25% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 353µs ± 1% 362µs ± 1% +2.74% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 470µs ± 1% 484µs ± 1% +2.82% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 938µs ± 1% 968µs ± 1% +3.22% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 1.41ms ± 2% 1.45ms ± 1% +2.47% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 1.89ms ± 1% 1.94ms ± 1% +2.69% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·1 186µs ± 3% 185µs ± 2% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·2 315µs ± 0% 313µs ± 1% -0.79% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·3 478µs ± 1% 474µs ± 1% ~ (p=0.310 n=5+5)
neo/py(!log)/sql-zwrk.go·4 636µs ± 1% 633µs ± 1% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·8 1.27ms ± 1% 1.26ms ± 1% ~ (p=0.095 n=5+5)
neo/py(!log)/sql-zwrk.go·12 1.92ms ± 1% 1.90ms ± 1% -1.36% (p=0.016 n=5+5)
neo/py(!log)/sql-zwrk.go·16 2.57ms ± 2% 2.55ms ± 1% ~ (p=0.421 n=5+5)
neo/go/fs1-zwrk.go·1 54.4µs ± 0% 53.1µs ± 0% -2.46% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·2 52.2µs ± 1% 51.1µs ± 0% -2.21% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·3 65.3µs ± 0% 64.6µs ± 3% ~ (p=0.151 n=5+5)
neo/go/fs1-zwrk.go·4 80.0µs ± 0% 78.1µs ± 0% -2.34% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·8 133µs ± 1% 130µs ± 0% -1.92% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·12 193µs ± 1% 191µs ± 1% ~ (p=0.421 n=5+5)
neo/go/fs1-zwrk.go·16 260µs ± 1% 254µs ± 1% -2.14% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 38.0µs ± 0% 37.0µs ± 0% -2.47% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 35.9µs ± 1% 35.1µs ± 0% -2.10% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 47.7µs ± 1% 46.7µs ± 1% -2.11% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 57.7µs ± 1% 56.6µs ± 1% -1.85% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 90.6µs ± 1% 88.8µs ± 0% -1.97% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 128µs ± 1% 126µs ± 0% -1.43% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 171µs ± 0% 168µs ± 0% -1.58% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·1 91.2µs ± 0% 71.1µs ± 0% -22.02% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·2 109µs ± 1% 81µs ± 1% -25.66% (p=0.016 n=4+5)
neo/go/sqlite-zwrk.go·3 124µs ± 0% 96µs ± 1% -22.71% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·4 149µs ± 1% 122µs ± 1% -18.25% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·8 270µs ± 2% 229µs ± 2% -15.27% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·12 410µs ± 2% 351µs ± 3% -14.41% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·16 560µs ± 1% 479µs ± 2% -14.47% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 84.0µs ± 1% 64.0µs ± 0% -23.76% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 102µs ± 1% 77µs ± 0% -24.34% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 113µs ± 0% 85µs ± 1% -25.08% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 133µs ± 0% 103µs ± 1% -22.69% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 257µs ± 2% 214µs ± 2% -16.57% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 417µs ± 3% 328µs ± 2% -21.20% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 563µs ± 1% 406µs ± 2% -27.95% (p=0.008 n=5+5)
cluster:deco dataset:prod1-1024
fs1-zwrk.go·1 1.80µs ± 0% 1.77µs ± 1% -1.83% (p=0.008 n=5+5)
fs1-zwrk.go·2 2.01µs ± 6% 1.91µs ± 5% ~ (p=0.056 n=5+5)
fs1-zwrk.go·3 2.26µs ± 2% 2.23µs ± 1% ~ (p=0.135 n=5+5)
fs1-zwrk.go·4 2.61µs ± 0% 2.59µs ± 2% ~ (p=0.135 n=5+5)
fs1-zwrk.go·8 5.04µs ± 1% 4.96µs ± 0% -1.48% (p=0.016 n=5+5)
fs1-zwrk.go·12 7.52µs ± 1% 7.42µs ± 0% -1.42% (p=0.008 n=5+5)
fs1-zwrk.go·16 10.0µs ± 0% 9.9µs ± 0% -1.44% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·1 103µs ± 1% 102µs ± 0% ~ (p=0.841 n=5+5)
zeo/py/fs1-zwrk.go·2 161µs ± 1% 162µs ± 1% ~ (p=0.095 n=5+5)
zeo/py/fs1-zwrk.go·3 212µs ± 1% 210µs ± 1% -0.90% (p=0.016 n=5+5)
zeo/py/fs1-zwrk.go·4 268µs ± 1% 269µs ± 1% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·8 512µs ± 1% 509µs ± 0% -0.45% (p=0.032 n=5+5)
zeo/py/fs1-zwrk.go·12 752µs ± 1% 750µs ± 0% ~ (p=0.190 n=5+4)
zeo/py/fs1-zwrk.go·16 1.00ms ± 6% 0.98ms ± 0% ~ (p=0.222 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 134µs ± 1% 139µs ± 1% +3.45% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 230µs ± 1% 240µs ± 0% +4.68% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 345µs ± 1% 363µs ± 1% +5.06% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 465µs ± 1% 485µs ± 1% +4.41% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 929µs ± 1% 956µs ± 1% +2.89% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 1.40ms ± 1% 1.44ms ± 1% +2.94% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 1.86ms ± 1% 1.91ms ± 1% +2.47% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·1 184µs ± 2% 180µs ± 1% -1.86% (p=0.016 n=5+5)
neo/py(!log)/sql-zwrk.go·2 320µs ± 1% 310µs ± 1% -3.17% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·3 481µs ± 1% 468µs ± 1% -2.59% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·4 638µs ± 1% 624µs ± 1% -2.15% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·8 1.27ms ± 1% 1.25ms ± 0% -2.09% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·12 1.89ms ± 0% 1.87ms ± 1% -1.49% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·16 2.54ms ± 1% 2.49ms ± 1% -1.80% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·1 41.9µs ± 0% 40.9µs ± 0% -2.31% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·2 44.0µs ± 1% 43.1µs ± 1% -2.06% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·3 54.5µs ± 0% 52.9µs ± 1% -2.82% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·4 66.2µs ± 0% 64.6µs ± 1% -2.39% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·8 116µs ± 2% 113µs ± 2% ~ (p=0.095 n=5+5)
neo/go/fs1-zwrk.go·12 177µs ± 5% 171µs ± 5% ~ (p=0.222 n=5+5)
neo/go/fs1-zwrk.go·16 235µs ± 3% 226µs ± 5% ~ (p=0.056 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 36.8µs ± 1% 35.7µs ± 1% -2.95% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 36.0µs ± 1% 34.8µs ± 0% -3.34% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 46.9µs ± 1% 45.9µs ± 0% -2.09% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 57.9µs ± 1% 56.0µs ± 1% -3.18% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 98.6µs ± 4% 96.7µs ± 2% ~ (p=0.222 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 155µs ± 8% 144µs ± 5% ~ (p=0.056 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 208µs ± 5% 200µs ± 3% ~ (p=0.056 n=5+5)
neo/go/sqlite-zwrk.go·1 85.5µs ± 1% 64.3µs ± 0% -24.84% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·2 106µs ± 1% 78µs ± 1% -25.95% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·3 123µs ± 2% 95µs ± 1% -23.01% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·4 154µs ± 3% 123µs ± 1% -19.85% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·8 325µs ± 5% 271µs ± 3% -16.50% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·12 507µs ± 3% 424µs ± 2% -16.39% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·16 665µs ± 3% 549µs ± 1% -17.44% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 82.3µs ± 1% 61.7µs ± 0% -25.01% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 102µs ± 1% 76µs ± 1% -25.04% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 118µs ± 1% 90µs ± 1% -23.38% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 145µs ± 2% 117µs ± 2% -19.71% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 312µs ± 2% 272µs ± 3% -12.87% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 500µs ± 2% 406µs ± 2% -18.82% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 662µs ± 1% 483µs ± 1% -27.07% (p=0.008 n=5+5)

fcb32916

. · a407d9dd
Kirill Smelkov authored Mar 18, 2018

a407d9dd
X on generating own sqlite query wrappers · b66bd11f
Kirill Smelkov authored Mar 18, 2018

b66bd11f

14 Mar, 2018 2 commits
- . · 18be70c7
  Kirill Smelkov authored Mar 14, 2018
  
  18be70c7
- . · e87b841b
  Kirill Smelkov authored Mar 14, 2018
  
  e87b841b
13 Mar, 2018 1 commit
- . · 57fa0d99
  Kirill Smelkov authored Mar 13, 2018
  
  57fa0d99
12 Mar, 2018 4 commits
- . · 4ae3b11d
  Kirill Smelkov authored Mar 12, 2018
  
  4ae3b11d
- . · 26b50ea7
  Kirill Smelkov authored Mar 12, 2018
  
  26b50ea7
- X neo/py uses n(replica) as n(real-replica) - 1 · 590f0a46
  Kirill Smelkov authored Mar 12, 2018
  
  590f0a46
- . · ca0c734d
  Kirill Smelkov authored Mar 12, 2018
  
  ca0c734d
09 Mar, 2018 12 commits

X tcpenalty: My draft program to show C-state related penalty · b190e483

Kirill Smelkov authored Mar 09, 2018

The penalty turned out to be actually depending on the predictor logic
inside OS kernel, so this program was canceled. Saving anyway as this
in some form might become useful in the future.

b190e483

. · 115b25d2
Kirill Smelkov authored Mar 09, 2018

115b25d2

X rio: localhost timings, C > C1 disabled, zwrk@1s · 26ad577f

Kirill Smelkov authored Mar 09, 2018

Compared to C-states enabled it is not clear what is going on - it helps
a bit to serial cases, but that is close to noise:

---- 8< ----
cluster:rio dataset:wczblk1-8
zeo/py/fs1-zhash.py 398µs ± 1% 375µs ± 2% -5.82% (p=0.008 n=5+5)
neo/go/sqlite-zhash.py 264µs ± 1% 252µs ± 1% -4.51% (p=0.008 n=5+5)
neo/go/sqlite-zhash.go+prefetch128(!sha1) 36.9µs ± 6% 33.4µs ± 3% -9.47% (p=0.008 n=5+5)

cluster:rio dataset:prod1-1024
neo/py(!log)/sqlite-zhash.py 326µs ± 8% 291µs ± 0% -10.77% (p=0.008 n=5+5)
---- 8< ----

and neo/py/sql timing is _not_ denoised:

---- 8< ----
cluster:rio dataset:wczblk1-8
neo/py(!log)/sql-zhash.py 406µs ±39% 376µs ±41% ~ (p=0.246 n=5+5)

cluster:rio dataset:prod1-1024
neo/py(!log)/sql-zhash.py 342µs ± 4% 374µs ±41% ~ (p=0.905 n=4+5)
---- 8< ----

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

$ benchstat -split node,cluster,dataset 20180308-rio-ffixed-c-zwrk10s.txt 20180308-rio-ffixed-noc_C1$1µs$-zwrk1s.txt

name old pystone/s new pystone/s delta
node:rio
pystone 140k ±12% 142k ± 3% ~ (p=1.000 n=5+5)

name old time/op new time/op delta
node:rio
crc32/py/4K 4.79µs ± 1% 4.77µs ± 1% ~ (p=0.341 n=5+5)
crc32/go/4K 1.49µs ± 0% 1.49µs ± 0% ~ (p=1.000 n=4+5)
sha1/py/4K 8.02µs ± 2% 8.07µs ± 4% ~ (p=1.000 n=5+5)
sha1/go/4K 8.93µs ± 0% 8.93µs ± 0% ~ (p=0.400 n=4+4)
unzlib/py/wczdata 25.2µs ± 1% 25.1µs ± 1% ~ (p=0.421 n=5+5)
unzlib/go/wczdata 23.0µs ± 0% 22.9µs ± 0% -0.58% (p=0.008 n=5+5)
unzlib/py/prod1-avg 7.27µs ± 1% 6.85µs ±25% ~ (p=0.690 n=5+5)
unzlib/go/prod1-avg 5.07µs ± 2% 5.02µs ± 1% ~ (p=0.095 n=5+5)
disk/randread/direct/4K-min 93.1µs ± 1% 93.4µs ± 0% ~ (p=0.460 n=5+5)
disk/randread/direct/4K-avg 116µs ± 0% 116µs ± 0% ~ (p=0.238 n=5+5)
disk/randread/pagecache/4K-min 570ns ± 1% 570ns ± 1% ~ (p=0.984 n=5+5)
disk/randread/pagecache/4K-avg 1.00µs ± 1% 1.00µs ± 1% ~ (p=0.357 n=5+5)

name old time/object new time/object delta
cluster:rio dataset:wczblk1-8
fs1-zhash.py 29.0µs ± 5% 29.0µs ± 2% ~ (p=0.730 n=5+5)
fs1-zhash.go 4.60µs ± 0% 4.60µs ± 0% ~ (all equal)
fs1-zhash.go+prefetch128 4.74µs ± 3% 4.62µs ± 5% ~ (p=0.111 n=5+5)
zeo/py/fs1-zhash.py 398µs ± 1% 375µs ± 2% -5.82% (p=0.008 n=5+5)
zeo/py/fs1-zhash.go 138µs ± 1% 135µs ± 1% -2.25% (p=0.024 n=5+5)
zeo/py/fs1-zhash.go+prefetch128 74.5µs ± 2% 73.6µs ± 3% ~ (p=0.238 n=5+5)
neo/py(!log)/sqlite-zhash.py 321µs ± 4% 315µs ± 6% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zhash.go 155µs ± 2% 155µs ± 5% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zhash.go+prefetch128 122µs ± 1% 126µs ± 1% +3.38% (p=0.008 n=5+5)
neo/py(!log)/sql-zhash.py 406µs ±39% 376µs ±41% ~ (p=0.246 n=5+5)
neo/py(!log)/sql-zhash.go 181µs ± 6% 183µs ± 2% ~ (p=0.310 n=5+5)
neo/py(!log)/sql-zhash.go+prefetch128 160µs ± 2% 161µs ± 3% ~ (p=0.841 n=5+5)
neo/go/fs1-zhash.py 223µs ± 6% 216µs ± 1% ~ (p=0.087 n=5+5)
neo/go/fs1-zhash.go 67.2µs ± 1% 67.9µs ± 1% +1.04% (p=0.032 n=5+5)
neo/go/fs1-zhash.go+prefetch128 28.8µs ± 3% 28.4µs ± 5% ~ (p=0.651 n=5+5)
neo/go/fs1(!sha1)-zhash.go(!sha1) 43.9µs ± 2% 44.1µs ± 4% ~ (p=0.627 n=5+5)
neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 18.7µs ± 4% 19.1µs ± 6% ~ (p=0.548 n=5+5)
neo/go/sqlite-zhash.py 264µs ± 1% 252µs ± 1% -4.51% (p=0.008 n=5+5)
neo/go/sqlite-zhash.go 105µs ± 1% 103µs ± 3% ~ (p=0.159 n=5+5)
neo/go/sqlite-zhash.go+prefetch128 37.9µs ± 9% 38.0µs ± 9% ~ (p=0.897 n=5+5)
neo/go/sqlite-zhash.go(!sha1) 94.4µs ± 3% 93.0µs ± 2% ~ (p=0.206 n=5+5)
neo/go/sqlite-zhash.go+prefetch128(!sha1) 36.9µs ± 6% 33.4µs ± 3% -9.47% (p=0.008 n=5+5)
cluster:rio dataset:prod1-1024
fs1-zhash.py 24.1µs ± 1% 23.8µs ± 2% ~ (p=0.325 n=5+5)
fs1-zhash.go 3.40µs ± 0% 3.40µs ± 0% ~ (all equal)
fs1-zhash.go+prefetch128 3.00µs ± 0% 3.16µs ± 8% ~ (p=0.556 n=4+5)
zeo/py/fs1-zhash.py 352µs ± 1% 346µs ± 2% ~ (p=0.056 n=5+5)
zeo/py/fs1-zhash.go 116µs ± 2% 114µs ± 1% ~ (p=0.063 n=5+5)
zeo/py/fs1-zhash.go+prefetch128 65.9µs ± 1% 64.4µs ± 2% -2.34% (p=0.024 n=5+5)
neo/py(!log)/sqlite-zhash.py 326µs ± 8% 291µs ± 0% -10.77% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zhash.go 142µs ± 2% 142µs ± 2% ~ (p=0.952 n=5+5)
neo/py(!log)/sqlite-zhash.go+prefetch128 116µs ± 1% 117µs ± 1% ~ (p=0.357 n=5+5)
neo/py(!log)/sql-zhash.py 342µs ± 4% 374µs ±41% ~ (p=0.905 n=4+5)
neo/py(!log)/sql-zhash.go 173µs ± 3% 173µs ± 8% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zhash.go+prefetch128 148µs ± 2% 148µs ± 2% ~ (p=0.841 n=5+5)
neo/go/fs1-zhash.py 220µs ± 4% 210µs ± 3% ~ (p=0.095 n=5+5)
neo/go/fs1-zhash.go 49.7µs ± 1% 50.2µs ± 2% ~ (p=0.286 n=5+5)
neo/go/fs1-zhash.go+prefetch128 18.9µs ± 3% 19.4µs ± 2% ~ (p=0.103 n=5+5)
neo/go/fs1(!sha1)-zhash.go(!sha1) 40.7µs ± 1% 40.6µs ± 2% ~ (p=0.746 n=5+5)
neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 16.2µs ± 2% 15.8µs ± 2% ~ (p=0.079 n=5+5)
neo/go/sqlite-zhash.py 261µs ± 2% 262µs ± 4% ~ (p=1.000 n=5+5)
neo/go/sqlite-zhash.go 93.3µs ± 1% 93.8µs ± 1% ~ (p=0.357 n=5+5)
neo/go/sqlite-zhash.go+prefetch128 33.3µs ± 3% 33.4µs ± 6% ~ (p=0.500 n=5+5)
neo/go/sqlite-zhash.go(!sha1) 89.9µs ± 1% 90.9µs ± 4% ~ (p=0.341 n=5+5)
neo/go/sqlite-zhash.go+prefetch128(!sha1) 33.0µs ± 1% 33.2µs ± 2% ~ (p=0.952 n=5+5)

name old req/s new req/s delta
cluster:rio dataset:wczblk1-8
fs1-zwrk.go·1 300k ± 0% 301k ± 1% ~ (p=0.151 n=5+5)
fs1-zwrk.go·2 550k ± 0% 551k ± 0% ~ (p=0.548 n=5+5)
fs1-zwrk.go·3 816k ± 0% 814k ± 0% ~ (p=0.222 n=5+5)
fs1-zwrk.go·4 1.08M ± 0% 1.08M ± 1% ~ (p=0.690 n=5+5)
fs1-zwrk.go·8 1.43M ± 0% 1.43M ± 0% ~ (p=0.548 n=5+5)
fs1-zwrk.go·12 1.55M ± 0% 1.55M ± 0% ~ (p=0.310 n=5+5)
fs1-zwrk.go·16 1.55M ± 1% 1.54M ± 0% ~ (p=0.222 n=5+5)
zeo/py/fs1-zwrk.go·1 7.40k ± 0% 7.50k ± 1% +1.32% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·2 8.89k ± 0% 8.89k ± 2% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·3 9.62k ± 1% 9.61k ± 1% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·4 9.91k ± 0% 9.92k ± 1% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·8 10.3k ± 0% 10.2k ± 2% ~ (p=0.690 n=5+5)
zeo/py/fs1-zwrk.go·12 10.4k ± 1% 10.6k ± 1% +1.95% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·16 10.5k ± 1% 10.5k ± 1% ~ (p=0.151 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 6.82k ± 1% 6.70k ± 2% ~ (p=0.095 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 8.63k ± 1% 8.54k ± 0% ~ (p=0.111 n=5+4)
neo/py(!log)/sqlite-zwrk.go·3 8.56k ± 2% 8.43k ± 1% ~ (p=0.095 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 8.54k ± 1% 8.37k ± 4% ~ (p=0.056 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 8.53k ± 1% 8.44k ± 0% -1.04% (p=0.016 n=5+4)
neo/py(!log)/sqlite-zwrk.go·12 8.56k ± 0% 8.23k ± 5% -3.82% (p=0.016 n=4+5)
neo/py(!log)/sqlite-zwrk.go·16 8.53k ± 1% 8.46k ± 1% ~ (p=0.151 n=5+5)
neo/py(!log)/sql-zwrk.go·1 5.57k ± 2% 5.66k ± 2% ~ (p=0.151 n=5+5)
neo/py(!log)/sql-zwrk.go·2 6.64k ± 2% 6.75k ± 2% ~ (p=0.095 n=5+5)
neo/py(!log)/sql-zwrk.go·3 6.60k ± 1% 6.68k ± 2% ~ (p=0.310 n=5+5)
neo/py(!log)/sql-zwrk.go·4 6.54k ± 2% 6.70k ± 2% +2.49% (p=0.032 n=5+5)
neo/py(!log)/sql-zwrk.go·8 6.64k ± 1% 6.50k ± 5% ~ (p=0.310 n=5+5)
neo/py(!log)/sql-zwrk.go·12 6.64k ± 2% 6.67k ± 2% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zwrk.go·16 6.62k ± 2% 6.72k ± 3% ~ (p=0.310 n=5+5)
neo/go/fs1-zwrk.go·1 15.6k ± 0% 15.7k ± 0% ~ (p=0.095 n=5+5)
neo/go/fs1-zwrk.go·2 30.0k ± 0% 30.2k ± 0% +0.78% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·3 39.6k ± 0% 39.8k ± 0% +0.47% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·4 49.5k ± 0% 49.7k ± 0% +0.30% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·8 69.0k ± 0% 68.8k ± 0% ~ (p=0.056 n=5+5)
neo/go/fs1-zwrk.go·12 73.3k ± 0% 73.0k ± 0% -0.44% (p=0.032 n=5+5)
neo/go/fs1-zwrk.go·16 74.2k ± 0% 73.7k ± 0% -0.61% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 25.6k ± 1% 25.5k ± 3% ~ (p=0.690 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 47.3k ± 0% 47.9k ± 0% +1.21% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 59.5k ± 0% 59.7k ± 0% +0.36% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 72.2k ± 0% 72.7k ± 0% +0.66% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 96.6k ± 0% 97.0k ± 0% +0.37% (p=0.016 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 110k ± 0% 110k ± 0% ~ (p=0.690 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 114k ± 0% 113k ± 1% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go·1 9.89k ± 0% 9.95k ± 1% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go·2 18.1k ± 0% 18.4k ± 0% +1.93% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·3 25.0k ± 0% 25.5k ± 0% +1.90% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·4 29.7k ± 0% 30.4k ± 0% +2.23% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·8 38.1k ± 0% 39.4k ± 1% +3.56% (p=0.016 n=4+5)
neo/go/sqlite-zwrk.go·12 40.5k ± 2% 40.7k ± 2% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go·16 41.3k ± 1% 40.8k ± 2% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 11.0k ± 0% 11.1k ± 0% +1.11% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 19.6k ± 0% 20.1k ± 0% +2.36% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 27.2k ± 0% 27.9k ± 0% +2.43% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 33.1k ± 0% 34.2k ± 0% +3.31% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 42.4k ± 2% 44.0k ± 1% +3.60% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 42.8k ± 1% 43.4k ± 2% ~ (p=0.095 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 42.8k ± 3% 41.4k ± 2% -3.25% (p=0.016 n=5+5)
cluster:rio dataset:prod1-1024
fs1-zwrk.go·1 460k ± 1% 461k ± 1% ~ (p=1.000 n=5+5)
fs1-zwrk.go·2 901k ± 2% 906k ± 1% ~ (p=0.421 n=5+5)
fs1-zwrk.go·3 1.34M ± 1% 1.35M ± 0% ~ (p=0.151 n=5+5)
fs1-zwrk.go·4 1.78M ± 0% 1.78M ± 1% ~ (p=0.690 n=5+5)
fs1-zwrk.go·8 2.37M ± 1% 2.33M ± 1% -1.46% (p=0.032 n=5+5)
fs1-zwrk.go·12 2.40M ± 0% 2.40M ± 0% ~ (p=0.222 n=5+5)
fs1-zwrk.go·16 2.40M ± 0% 2.40M ± 0% ~ (p=0.310 n=5+5)
zeo/py/fs1-zwrk.go·1 8.87k ± 0% 9.06k ± 1% +2.15% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·2 11.4k ± 1% 11.7k ± 2% +2.18% (p=0.016 n=5+5)
zeo/py/fs1-zwrk.go·3 12.6k ± 1% 12.9k ± 1% +2.32% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·4 13.1k ± 1% 13.4k ± 3% ~ (p=0.095 n=5+5)
zeo/py/fs1-zwrk.go·8 13.7k ± 0% 13.9k ± 2% +1.50% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·12 13.8k ± 1% 14.2k ± 2% +2.85% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·16 13.9k ± 1% 14.4k ± 1% +3.31% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 7.23k ± 0% 7.28k ± 2% ~ (p=0.222 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 8.71k ± 1% 8.70k ± 3% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 8.71k ± 1% 8.73k ± 3% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 8.69k ± 1% 8.69k ± 1% ~ (p=0.841 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 8.75k ± 1% 8.77k ± 2% ~ (p=0.310 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 8.66k ± 2% 8.59k ± 7% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 8.67k ± 2% 8.67k ± 1% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·1 5.83k ± 1% 5.98k ± 1% +2.55% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·2 6.83k ± 1% 6.86k ± 4% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·3 6.80k ± 1% 6.86k ± 3% ~ (p=0.222 n=5+5)
neo/py(!log)/sql-zwrk.go·4 6.76k ± 2% 6.90k ± 1% +2.02% (p=0.016 n=5+5)
neo/py(!log)/sql-zwrk.go·8 6.68k ± 2% 6.62k ± 6% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zwrk.go·12 6.84k ± 2% 6.78k ± 2% ~ (p=0.151 n=5+5)
neo/py(!log)/sql-zwrk.go·16 6.81k ± 1% 6.78k ± 3% ~ (p=0.222 n=5+5)
neo/go/fs1-zwrk.go·1 21.8k ± 0% 21.6k ± 0% -1.08% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·2 39.2k ± 0% 39.0k ± 0% -0.42% (p=0.016 n=5+5)
neo/go/fs1-zwrk.go·3 51.4k ± 0% 51.0k ± 1% -0.66% (p=0.016 n=5+5)
neo/go/fs1-zwrk.go·4 62.9k ± 0% 62.3k ± 0% -0.97% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·8 82.9k ± 2% 79.7k ± 1% -3.87% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·12 88.0k ± 2% 81.8k ± 2% -7.00% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·16 89.6k ± 3% 80.8k ± 3% -9.89% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 26.6k ± 0% 26.9k ± 1% +1.27% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 48.7k ± 0% 49.3k ± 0% +1.10% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 62.0k ± 0% 62.3k ± 0% +0.53% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 74.4k ± 0% 74.7k ± 0% +0.39% (p=0.016 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 94.2k ± 0% 93.5k ± 2% -0.76% (p=0.016 n=4+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 104k ± 5% 97k ± 2% -6.48% (p=0.016 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 107k ± 2% 95k ± 3% -11.82% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·1 11.1k ± 1% 11.0k ± 0% -0.58% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·2 19.4k ± 0% 19.3k ± 0% -0.84% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·3 26.7k ± 0% 26.4k ± 0% -0.93% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·4 32.1k ± 0% 31.8k ± 0% -1.04% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·8 37.4k ± 2% 38.6k ± 1% +3.25% (p=0.016 n=5+5)
neo/go/sqlite-zwrk.go·12 35.8k ± 3% 36.5k ± 2% ~ (p=0.056 n=5+5)
neo/go/sqlite-zwrk.go·16 35.0k ± 3% 36.0k ± 1% +2.79% (p=0.032 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 11.5k ± 0% 11.4k ± 0% -1.34% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 19.9k ± 1% 19.9k ± 0% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 27.3k ± 1% 27.4k ± 0% ~ (p=0.310 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 33.1k ± 0% 33.3k ± 0% +0.70% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 37.6k ± 2% 38.8k ± 2% +3.32% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 36.3k ± 4% 36.0k ± 2% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 35.2k ± 3% 35.4k ± 1% ~ (p=1.000 n=5+5)

name old latency-time/object new latency-time/object delta
cluster:rio dataset:wczblk1-8
fs1-zwrk.go·1 3.33µs ± 0% 3.32µs ± 1% ~ (p=0.151 n=5+5)
fs1-zwrk.go·2 3.63µs ± 0% 3.63µs ± 0% ~ (p=0.500 n=5+5)
fs1-zwrk.go·3 3.68µs ± 0% 3.69µs ± 0% ~ (p=0.230 n=5+5)
fs1-zwrk.go·4 3.70µs ± 0% 3.70µs ± 1% ~ (p=0.643 n=5+5)
fs1-zwrk.go·8 5.60µs ± 0% 5.61µs ± 0% ~ (p=0.595 n=5+5)
fs1-zwrk.go·12 7.75µs ± 0% 7.76µs ± 0% ~ (p=0.286 n=5+5)
fs1-zwrk.go·16 10.3µs ± 1% 10.4µs ± 0% ~ (p=0.222 n=5+5)
zeo/py/fs1-zwrk.go·1 135µs ± 0% 133µs ± 1% -1.30% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·2 225µs ± 0% 225µs ± 2% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·3 312µs ± 1% 312µs ± 1% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·4 403µs ± 0% 403µs ± 1% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·8 778µs ± 0% 781µs ± 2% ~ (p=0.690 n=5+5)
zeo/py/fs1-zwrk.go·12 1.15ms ± 1% 1.13ms ± 1% -1.91% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·16 1.53ms ± 1% 1.52ms ± 1% ~ (p=0.151 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 147µs ± 1% 149µs ± 2% ~ (p=0.095 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 232µs ± 1% 234µs ± 0% ~ (p=0.111 n=5+4)
neo/py(!log)/sqlite-zwrk.go·3 350µs ± 2% 356µs ± 1% ~ (p=0.095 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 469µs ± 1% 478µs ± 4% ~ (p=0.056 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 938µs ± 1% 948µs ± 0% +1.06% (p=0.016 n=5+4)
neo/py(!log)/sqlite-zwrk.go·12 1.40ms ± 0% 1.46ms ± 5% +4.10% (p=0.016 n=4+5)
neo/py(!log)/sqlite-zwrk.go·16 1.88ms ± 1% 1.89ms ± 1% ~ (p=0.151 n=5+5)
neo/py(!log)/sql-zwrk.go·1 180µs ± 2% 177µs ± 2% ~ (p=0.151 n=5+5)
neo/py(!log)/sql-zwrk.go·2 301µs ± 2% 297µs ± 2% ~ (p=0.095 n=5+5)
neo/py(!log)/sql-zwrk.go·3 454µs ± 1% 449µs ± 2% ~ (p=0.310 n=5+5)
neo/py(!log)/sql-zwrk.go·4 612µs ± 2% 597µs ± 2% -2.43% (p=0.032 n=5+5)
neo/py(!log)/sql-zwrk.go·8 1.20ms ± 1% 1.23ms ± 5% ~ (p=0.310 n=5+5)
neo/py(!log)/sql-zwrk.go·12 1.81ms ± 2% 1.80ms ± 2% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zwrk.go·16 2.42ms ± 2% 2.38ms ± 3% ~ (p=0.310 n=5+5)
neo/go/fs1-zwrk.go·1 64.1µs ± 0% 63.9µs ± 0% ~ (p=0.095 n=5+5)
neo/go/fs1-zwrk.go·2 66.7µs ± 0% 66.2µs ± 0% -0.77% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·3 75.8µs ± 0% 75.5µs ± 0% -0.47% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·4 80.8µs ± 0% 80.6µs ± 0% -0.30% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·8 116µs ± 0% 116µs ± 0% ~ (p=0.056 n=5+5)
neo/go/fs1-zwrk.go·12 164µs ± 0% 164µs ± 0% +0.45% (p=0.032 n=5+5)
neo/go/fs1-zwrk.go·16 216µs ± 0% 217µs ± 0% +0.62% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 39.1µs ± 1% 39.3µs ± 3% ~ (p=0.690 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 42.2µs ± 0% 41.7µs ± 0% -1.20% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 50.4µs ± 0% 50.3µs ± 0% -0.36% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 55.4µs ± 0% 55.0µs ± 0% -0.65% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 82.8µs ± 0% 82.5µs ± 0% -0.36% (p=0.016 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 109µs ± 0% 109µs ± 0% ~ (p=0.690 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 141µs ± 0% 141µs ± 1% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go·1 101µs ± 0% 100µs ± 1% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go·2 110µs ± 0% 108µs ± 0% -1.89% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·3 120µs ± 0% 118µs ± 0% -1.86% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·4 135µs ± 0% 132µs ± 0% -2.19% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·8 210µs ± 0% 203µs ± 1% -3.44% (p=0.016 n=4+5)
neo/go/sqlite-zwrk.go·12 297µs ± 2% 295µs ± 2% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go·16 388µs ± 1% 393µs ± 2% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 90.9µs ± 0% 89.9µs ± 0% -1.10% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 102µs ± 0% 100µs ± 0% -2.31% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 110µs ± 0% 108µs ± 0% -2.38% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 121µs ± 0% 117µs ± 0% -3.20% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 188µs ± 2% 182µs ± 1% -3.48% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 280µs ± 2% 277µs ± 2% ~ (p=0.095 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 374µs ± 3% 386µs ± 2% +3.35% (p=0.016 n=5+5)
cluster:rio dataset:prod1-1024
fs1-zwrk.go·1 2.17µs ± 1% 2.17µs ± 1% ~ (p=1.000 n=5+5)
fs1-zwrk.go·2 2.22µs ± 1% 2.21µs ± 1% ~ (p=0.421 n=5+5)
fs1-zwrk.go·3 2.24µs ± 1% 2.23µs ± 0% ~ (p=0.135 n=5+5)
fs1-zwrk.go·4 2.25µs ± 0% 2.24µs ± 1% ~ (p=0.690 n=5+5)
fs1-zwrk.go·8 3.38µs ± 1% 3.43µs ± 1% +1.48% (p=0.032 n=5+5)
fs1-zwrk.go·12 5.00µs ± 0% 4.99µs ± 0% ~ (p=0.270 n=5+5)
fs1-zwrk.go·16 6.67µs ± 0% 6.65µs ± 0% ~ (p=0.286 n=5+5)
zeo/py/fs1-zwrk.go·1 113µs ± 0% 110µs ± 1% -2.10% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·2 175µs ± 1% 171µs ± 2% -2.13% (p=0.016 n=5+5)
zeo/py/fs1-zwrk.go·3 238µs ± 1% 233µs ± 1% -2.26% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·4 306µs ± 1% 300µs ± 3% ~ (p=0.095 n=5+5)
zeo/py/fs1-zwrk.go·8 582µs ± 0% 574µs ± 2% -1.47% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·12 868µs ± 1% 844µs ± 2% -2.77% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·16 1.15ms ± 1% 1.11ms ± 1% -3.20% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 138µs ± 0% 137µs ± 2% ~ (p=0.222 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 230µs ± 1% 230µs ± 3% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 344µs ± 1% 344µs ± 3% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 461µs ± 1% 461µs ± 1% ~ (p=0.841 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 914µs ± 1% 912µs ± 2% ~ (p=0.310 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 1.39ms ± 2% 1.40ms ± 7% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 1.85ms ± 2% 1.85ms ± 1% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·1 172µs ± 1% 167µs ± 1% -2.49% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·2 293µs ± 1% 292µs ± 5% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·3 441µs ± 1% 437µs ± 3% ~ (p=0.222 n=5+5)
neo/py(!log)/sql-zwrk.go·4 592µs ± 2% 580µs ± 1% -1.99% (p=0.016 n=5+5)
neo/py(!log)/sql-zwrk.go·8 1.20ms ± 3% 1.21ms ± 6% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zwrk.go·12 1.75ms ± 2% 1.77ms ± 2% ~ (p=0.151 n=5+5)
neo/py(!log)/sql-zwrk.go·16 2.35ms ± 1% 2.36ms ± 3% ~ (p=0.222 n=5+5)
neo/go/fs1-zwrk.go·1 45.9µs ± 0% 46.4µs ± 0% +1.09% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·2 51.0µs ± 0% 51.3µs ± 0% +0.43% (p=0.016 n=5+5)
neo/go/fs1-zwrk.go·3 58.4µs ± 0% 58.8µs ± 1% +0.67% (p=0.016 n=5+5)
neo/go/fs1-zwrk.go·4 63.6µs ± 0% 64.3µs ± 0% +0.98% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·8 96.5µs ± 2% 100.4µs ± 1% +4.03% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·12 136µs ± 2% 147µs ± 2% +7.53% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·16 179µs ± 3% 198µs ± 3% +10.98% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 37.6µs ± 0% 37.2µs ± 1% -1.25% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 41.0µs ± 0% 40.6µs ± 0% -1.09% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 48.4µs ± 0% 48.1µs ± 0% -0.53% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 53.8µs ± 0% 53.6µs ± 0% -0.39% (p=0.016 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 84.9µs ± 0% 85.6µs ± 2% +0.78% (p=0.016 n=4+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 116µs ± 5% 124µs ± 2% +6.87% (p=0.016 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 149µs ± 2% 169µs ± 3% +13.44% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·1 90.5µs ± 1% 91.0µs ± 0% +0.58% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·2 103µs ± 0% 104µs ± 0% +0.85% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·3 112µs ± 0% 114µs ± 0% +0.94% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·4 124µs ± 0% 126µs ± 0% +1.05% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·8 214µs ± 3% 207µs ± 1% -3.16% (p=0.016 n=5+5)
neo/go/sqlite-zwrk.go·12 336µs ± 3% 329µs ± 2% ~ (p=0.056 n=5+5)
neo/go/sqlite-zwrk.go·16 458µs ± 3% 445µs ± 1% -2.73% (p=0.032 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 86.6µs ± 0% 87.8µs ± 0% +1.36% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 100µs ± 1% 101µs ± 0% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 110µs ± 1% 109µs ± 0% ~ (p=0.310 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 121µs ± 0% 120µs ± 0% -0.69% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 213µs ± 2% 206µs ± 2% -3.22% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 331µs ± 4% 333µs ± 3% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 454µs ± 3% 452µs ± 1% ~ (p=1.000 n=5+5)

26ad577f

X rio: localhost timings, Cenabled, zwrk@10s · 9282fca1

Kirill Smelkov authored Mar 09, 2018

Compared to zwrk@1s it helps but only a very tiny tiny bit: Besides
everything else that might be noise the improvements are:

---- 8< ----
cluster:rio dataset:prod1-1024
neo/go/fs1-zwrk.go·16 200µs ± 3% 179µs ± 3% -10.62% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 128µs ± 2% 116µs ± 5% -9.16% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 178µs ± 3% 149µs ± 2% -16.06% (p=0.008 n=5+5)
---- 8< ----

and noise on neo/py/sql is back:

---- 8< ----
cluster:rio dataset:wczblk1-8
neo/py(!log)/sql-zhash.py 342µs ± 2% 406µs ±39% ~ (p=0.063 n=4+5)
---- 8< ----

The next commit will add measurements with C-states disabled.

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

$ benchstat -split node,cluster,dataset 20180308-rio-ffixed-c-zwrk1s.txt 20180308-rio-ffixed-c-zwrk10s.txt

name old pystone/s new pystone/s delta
node:rio
pystone 144k ± 3% 140k ±12% ~ (p=0.690 n=5+5)

name old time/op new time/op delta
node:rio
crc32/py/4K 4.79µs ± 1% 4.79µs ± 1% ~ (p=0.889 n=5+5)
crc32/go/4K 1.49µs ± 0% 1.49µs ± 0% ~ (p=0.873 n=5+4)
sha1/py/4K 7.98µs ± 1% 8.02µs ± 2% ~ (p=0.548 n=5+5)
sha1/go/4K 9.29µs ±12% 8.93µs ± 0% ~ (p=0.111 n=5+4)
unzlib/py/wczdata 25.2µs ± 1% 25.2µs ± 1% ~ (p=0.690 n=5+5)
unzlib/go/wczdata 23.0µs ± 0% 23.0µs ± 0% +0.17% (p=0.016 n=5+5)
unzlib/py/prod1-avg 7.26µs ± 3% 7.27µs ± 1% ~ (p=1.000 n=5+5)
unzlib/go/prod1-avg 5.06µs ± 1% 5.07µs ± 2% ~ (p=0.690 n=5+5)
disk/randread/direct/4K-min 93.0µs ± 0% 93.1µs ± 1% ~ (p=0.690 n=5+5)
disk/randread/direct/4K-avg 116µs ± 1% 116µs ± 0% ~ (p=0.373 n=5+5)
disk/randread/pagecache/4K-min 570ns ± 1% 570ns ± 1% ~ (p=1.000 n=5+5)
disk/randread/pagecache/4K-avg 995ns ± 0% 999ns ± 1% ~ (p=0.135 n=5+5)

name old time/object new time/object delta
cluster:rio dataset:wczblk1-8
fs1-zhash.py 28.9µs ± 1% 29.0µs ± 5% ~ (p=0.730 n=4+5)
fs1-zhash.go 4.60µs ± 0% 4.60µs ± 0% ~ (all equal)
fs1-zhash.go+prefetch128 4.62µs ± 3% 4.74µs ± 3% ~ (p=0.119 n=5+5)
zeo/py/fs1-zhash.py 412µs ± 4% 398µs ± 1% ~ (p=0.095 n=5+5)
zeo/py/fs1-zhash.go 139µs ± 3% 138µs ± 1% ~ (p=0.889 n=5+5)
zeo/py/fs1-zhash.go+prefetch128 75.2µs ± 5% 74.5µs ± 2% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zhash.py 315µs ± 3% 321µs ± 4% ~ (p=0.246 n=5+5)
neo/py(!log)/sqlite-zhash.go 156µs ± 6% 155µs ± 2% ~ (p=0.548 n=5+5)
neo/py(!log)/sqlite-zhash.go+prefetch128 125µs ± 2% 122µs ± 1% -2.28% (p=0.032 n=5+5)
neo/py(!log)/sql-zhash.py 342µs ± 2% 406µs ±39% ~ (p=0.063 n=4+5)
neo/py(!log)/sql-zhash.go 178µs ± 2% 181µs ± 6% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zhash.go+prefetch128 159µs ± 2% 160µs ± 2% ~ (p=1.000 n=5+5)
neo/go/fs1-zhash.py 224µs ± 4% 223µs ± 6% ~ (p=0.548 n=5+5)
neo/go/fs1-zhash.go 67.0µs ± 1% 67.2µs ± 1% ~ (p=0.810 n=5+5)
neo/go/fs1-zhash.go+prefetch128 28.3µs ± 1% 28.8µs ± 3% ~ (p=0.175 n=5+5)
neo/go/fs1(!sha1)-zhash.go(!sha1) 45.0µs ± 6% 43.9µs ± 2% ~ (p=0.516 n=5+5)
neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 19.0µs ± 3% 18.7µs ± 4% ~ (p=0.365 n=5+5)
neo/go/sqlite-zhash.py 266µs ± 2% 264µs ± 1% ~ (p=1.000 n=5+5)
neo/go/sqlite-zhash.go 103µs ± 2% 105µs ± 1% ~ (p=0.143 n=5+5)
neo/go/sqlite-zhash.go+prefetch128 37.6µs ± 2% 37.9µs ± 9% ~ (p=0.690 n=5+5)
neo/go/sqlite-zhash.go(!sha1) 94.7µs ± 1% 94.4µs ± 3% ~ (p=0.500 n=5+5)
neo/go/sqlite-zhash.go+prefetch128(!sha1) 35.1µs ± 6% 36.9µs ± 6% ~ (p=0.230 n=5+5)
cluster:rio dataset:prod1-1024
fs1-zhash.py 24.2µs ± 1% 24.1µs ± 1% ~ (p=0.540 n=4+5)
fs1-zhash.go 3.40µs ± 0% 3.40µs ± 0% ~ (all equal)
fs1-zhash.go+prefetch128 3.06µs ± 2% 3.00µs ± 0% ~ (p=0.095 n=5+4)
zeo/py/fs1-zhash.py 368µs ± 1% 352µs ± 1% -4.55% (p=0.008 n=5+5)
zeo/py/fs1-zhash.go 115µs ± 2% 116µs ± 2% ~ (p=0.730 n=5+5)
zeo/py/fs1-zhash.go+prefetch128 65.6µs ± 1% 65.9µs ± 1% ~ (p=0.508 n=5+5)
neo/py(!log)/sqlite-zhash.py 316µs ± 6% 326µs ± 8% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zhash.go 142µs ± 5% 142µs ± 2% ~ (p=0.841 n=5+5)
neo/py(!log)/sqlite-zhash.go+prefetch128 116µs ± 1% 116µs ± 1% ~ (p=0.690 n=5+5)
neo/py(!log)/sql-zhash.py 339µs ± 5% 342µs ± 4% ~ (p=1.000 n=4+4)
neo/py(!log)/sql-zhash.go 172µs ± 1% 173µs ± 3% ~ (p=0.579 n=5+5)
neo/py(!log)/sql-zhash.go+prefetch128 150µs ± 1% 148µs ± 2% ~ (p=0.151 n=5+5)
neo/go/fs1-zhash.py 219µs ± 2% 220µs ± 4% ~ (p=1.000 n=5+5)
neo/go/fs1-zhash.go 49.9µs ± 1% 49.7µs ± 1% ~ (p=0.421 n=5+5)
neo/go/fs1-zhash.go+prefetch128 19.1µs ± 3% 18.9µs ± 3% ~ (p=0.540 n=5+5)
neo/go/fs1(!sha1)-zhash.go(!sha1) 41.1µs ± 2% 40.7µs ± 1% ~ (p=0.333 n=5+5)
neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 16.2µs ± 5% 16.2µs ± 2% ~ (p=0.873 n=5+5)
neo/go/sqlite-zhash.py 261µs ± 5% 261µs ± 2% ~ (p=1.000 n=5+5)
neo/go/sqlite-zhash.go 94.3µs ± 1% 93.3µs ± 1% ~ (p=0.087 n=5+5)
neo/go/sqlite-zhash.go+prefetch128 33.6µs ± 5% 33.3µs ± 3% ~ (p=0.810 n=5+5)
neo/go/sqlite-zhash.go(!sha1) 90.3µs ± 2% 89.9µs ± 1% ~ (p=0.738 n=5+5)
neo/go/sqlite-zhash.go+prefetch128(!sha1) 33.0µs ± 4% 33.0µs ± 1% ~ (p=0.952 n=5+5)

name old req/s new req/s delta
cluster:rio dataset:wczblk1-8
fs1-zwrk.go·1 301k ± 0% 300k ± 0% ~ (p=0.056 n=5+5)
fs1-zwrk.go·2 550k ± 3% 550k ± 0% ~ (p=0.548 n=5+5)
fs1-zwrk.go·3 817k ± 1% 816k ± 0% ~ (p=1.000 n=5+5)
fs1-zwrk.go·4 1.08M ± 0% 1.08M ± 0% ~ (p=0.310 n=5+5)
fs1-zwrk.go·8 1.42M ± 0% 1.43M ± 0% ~ (p=0.056 n=5+5)
fs1-zwrk.go·12 1.55M ± 0% 1.55M ± 0% ~ (p=0.548 n=5+5)
fs1-zwrk.go·16 1.55M ± 0% 1.55M ± 1% ~ (p=0.841 n=5+5)
zeo/py/fs1-zwrk.go·1 7.38k ± 1% 7.40k ± 0% ~ (p=0.222 n=5+5)
zeo/py/fs1-zwrk.go·2 8.96k ± 2% 8.89k ± 0% ~ (p=0.690 n=5+5)
zeo/py/fs1-zwrk.go·3 9.66k ± 3% 9.62k ± 1% ~ (p=0.690 n=5+5)
zeo/py/fs1-zwrk.go·4 9.87k ± 1% 9.91k ± 0% ~ (p=0.222 n=5+5)
zeo/py/fs1-zwrk.go·8 10.3k ± 1% 10.3k ± 0% ~ (p=0.222 n=5+5)
zeo/py/fs1-zwrk.go·12 10.4k ± 1% 10.4k ± 1% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·16 10.5k ± 1% 10.5k ± 1% ~ (p=0.548 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 6.88k ± 2% 6.82k ± 1% ~ (p=0.151 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 8.63k ± 3% 8.63k ± 1% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 8.66k ± 0% 8.56k ± 2% ~ (p=0.111 n=4+5)
neo/py(!log)/sqlite-zwrk.go·4 8.71k ± 1% 8.54k ± 1% -1.95% (p=0.016 n=4+5)
neo/py(!log)/sqlite-zwrk.go·8 8.60k ± 2% 8.53k ± 1% ~ (p=0.310 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 8.63k ± 2% 8.56k ± 0% ~ (p=0.190 n=5+4)
neo/py(!log)/sqlite-zwrk.go·16 8.54k ± 3% 8.53k ± 1% ~ (p=0.548 n=5+5)
neo/py(!log)/sql-zwrk.go·1 5.69k ± 1% 5.57k ± 2% -2.20% (p=0.032 n=5+5)
neo/py(!log)/sql-zwrk.go·2 6.73k ± 5% 6.64k ± 2% ~ (p=0.222 n=5+5)
neo/py(!log)/sql-zwrk.go·3 6.69k ± 2% 6.60k ± 1% ~ (p=0.222 n=5+5)
neo/py(!log)/sql-zwrk.go·4 6.60k ±11% 6.54k ± 2% ~ (p=0.151 n=5+5)
neo/py(!log)/sql-zwrk.go·8 6.65k ± 2% 6.64k ± 1% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·12 6.58k ±11% 6.64k ± 2% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·16 6.70k ± 1% 6.62k ± 2% ~ (p=0.413 n=4+5)
neo/go/fs1-zwrk.go·1 15.7k ± 0% 15.6k ± 0% ~ (p=0.095 n=5+5)
neo/go/fs1-zwrk.go·2 30.3k ± 0% 30.0k ± 0% -1.12% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·3 39.8k ± 0% 39.6k ± 0% -0.49% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·4 49.7k ± 0% 49.5k ± 0% -0.41% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·8 68.7k ± 1% 69.0k ± 0% ~ (p=0.222 n=5+5)
neo/go/fs1-zwrk.go·12 73.0k ± 0% 73.3k ± 0% ~ (p=0.095 n=5+5)
neo/go/fs1-zwrk.go·16 73.9k ± 0% 74.2k ± 0% +0.38% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 25.6k ± 3% 25.6k ± 1% ~ (p=0.690 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 47.8k ± 0% 47.3k ± 0% -1.02% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 59.6k ± 0% 59.5k ± 0% ~ (p=0.056 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 72.7k ± 0% 72.2k ± 0% -0.66% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 97.0k ± 0% 96.6k ± 0% ~ (p=0.056 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 109k ± 1% 110k ± 0% ~ (p=0.222 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 113k ± 1% 114k ± 0% ~ (p=0.056 n=5+5)
neo/go/sqlite-zwrk.go·1 9.88k ± 1% 9.89k ± 0% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go·2 18.4k ± 0% 18.1k ± 0% -1.38% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·3 25.5k ± 0% 25.0k ± 0% -2.00% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·4 30.4k ± 0% 29.7k ± 0% -2.24% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·8 39.5k ± 0% 38.1k ± 0% -3.72% (p=0.016 n=5+4)
neo/go/sqlite-zwrk.go·12 40.9k ± 1% 40.5k ± 2% ~ (p=0.095 n=5+5)
neo/go/sqlite-zwrk.go·16 40.4k ± 2% 41.3k ± 1% +2.15% (p=0.032 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 11.0k ± 1% 11.0k ± 0% ~ (p=0.310 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 19.9k ± 0% 19.6k ± 0% -1.25% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 27.7k ± 0% 27.2k ± 0% -1.89% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 34.0k ± 1% 33.1k ± 0% -2.60% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 43.8k ± 1% 42.4k ± 2% -3.00% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 42.8k ± 2% 42.8k ± 1% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 40.9k ± 2% 42.8k ± 3% +4.65% (p=0.008 n=5+5)
cluster:rio dataset:prod1-1024
fs1-zwrk.go·1 462k ± 1% 460k ± 1% ~ (p=0.690 n=5+5)
fs1-zwrk.go·2 910k ± 1% 901k ± 2% ~ (p=0.095 n=5+5)
fs1-zwrk.go·3 1.35M ± 0% 1.34M ± 1% -1.12% (p=0.032 n=5+5)
fs1-zwrk.go·4 1.79M ± 1% 1.78M ± 0% -0.73% (p=0.016 n=5+5)
fs1-zwrk.go·8 2.38M ± 1% 2.37M ± 1% ~ (p=0.548 n=5+5)
fs1-zwrk.go·12 2.40M ± 1% 2.40M ± 0% ~ (p=0.421 n=5+5)
fs1-zwrk.go·16 2.40M ± 0% 2.40M ± 0% ~ (p=0.841 n=5+5)
zeo/py/fs1-zwrk.go·1 8.91k ± 2% 8.87k ± 0% ~ (p=0.310 n=5+5)
zeo/py/fs1-zwrk.go·2 11.7k ± 1% 11.4k ± 1% -2.04% (p=0.016 n=5+5)
zeo/py/fs1-zwrk.go·3 13.0k ± 1% 12.6k ± 1% -3.20% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·4 13.4k ± 2% 13.1k ± 1% ~ (p=0.056 n=5+5)
zeo/py/fs1-zwrk.go·8 14.2k ± 2% 13.7k ± 0% -3.44% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·12 14.1k ± 2% 13.8k ± 1% -1.88% (p=0.032 n=5+5)
zeo/py/fs1-zwrk.go·16 14.4k ± 2% 13.9k ± 1% -3.29% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 7.12k ± 2% 7.23k ± 0% ~ (p=0.095 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 8.37k ± 6% 8.71k ± 1% +4.06% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 8.60k ± 1% 8.71k ± 1% +1.25% (p=0.032 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 8.40k ± 8% 8.69k ± 1% ~ (p=0.310 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 8.61k ± 3% 8.75k ± 1% ~ (p=0.310 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 8.56k ± 2% 8.66k ± 2% ~ (p=0.151 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 8.46k ± 5% 8.67k ± 2% ~ (p=0.222 n=5+5)
neo/py(!log)/sql-zwrk.go·1 5.78k ± 5% 5.83k ± 1% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·2 6.77k ± 4% 6.83k ± 1% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zwrk.go·3 6.85k ± 1% 6.80k ± 1% ~ (p=0.095 n=5+5)
neo/py(!log)/sql-zwrk.go·4 6.79k ± 2% 6.76k ± 2% ~ (p=0.794 n=5+5)
neo/py(!log)/sql-zwrk.go·8 6.80k ± 5% 6.68k ± 2% ~ (p=0.222 n=5+5)
neo/py(!log)/sql-zwrk.go·12 6.50k ± 5% 6.84k ± 2% ~ (p=0.095 n=5+5)
neo/py(!log)/sql-zwrk.go·16 6.81k ± 1% 6.81k ± 1% ~ (p=1.000 n=5+5)
neo/go/fs1-zwrk.go·1 21.6k ± 1% 21.8k ± 0% ~ (p=0.095 n=5+5)
neo/go/fs1-zwrk.go·2 39.2k ± 1% 39.2k ± 0% ~ (p=0.690 n=5+5)
neo/go/fs1-zwrk.go·3 51.3k ± 0% 51.4k ± 0% ~ (p=0.310 n=5+5)
neo/go/fs1-zwrk.go·4 62.7k ± 0% 62.9k ± 0% +0.30% (p=0.016 n=5+5)
neo/go/fs1-zwrk.go·8 81.7k ± 1% 82.9k ± 2% +1.50% (p=0.032 n=5+5)
neo/go/fs1-zwrk.go·12 82.1k ± 3% 88.0k ± 2% +7.14% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·16 80.1k ± 3% 89.6k ± 3% +11.90% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 26.5k ± 1% 26.6k ± 0% ~ (p=0.690 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 49.1k ± 0% 48.7k ± 0% -0.65% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 62.2k ± 0% 62.0k ± 0% ~ (p=0.151 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 74.2k ± 0% 74.4k ± 0% ~ (p=0.421 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 92.4k ± 1% 94.2k ± 0% +2.01% (p=0.016 n=5+4)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 94.1k ± 2% 103.6k ± 5% +10.13% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 90.0k ± 3% 107.2k ± 2% +19.10% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·1 10.9k ± 1% 11.1k ± 1% +1.37% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·2 19.3k ± 0% 19.4k ± 0% +0.80% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·3 26.4k ± 1% 26.7k ± 0% +0.86% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·4 31.8k ± 0% 32.1k ± 0% +1.02% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·8 38.1k ± 3% 37.4k ± 2% ~ (p=0.310 n=5+5)
neo/go/sqlite-zwrk.go·12 37.1k ± 2% 35.8k ± 3% -3.52% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·16 36.3k ± 2% 35.0k ± 3% -3.60% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 11.5k ± 1% 11.5k ± 0% ~ (p=0.056 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 20.1k ± 0% 19.9k ± 1% -0.77% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 27.6k ± 0% 27.3k ± 1% -1.08% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 33.5k ± 2% 33.1k ± 0% -1.32% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 40.0k ± 1% 37.6k ± 2% -5.99% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 37.9k ± 0% 36.3k ± 4% -4.29% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 36.7k ± 1% 35.2k ± 3% -3.99% (p=0.008 n=5+5)

name old latency-time/object new latency-time/object delta
cluster:rio dataset:wczblk1-8
fs1-zwrk.go·1 3.32µs ± 0% 3.33µs ± 0% +0.42% (p=0.048 n=5+5)
fs1-zwrk.go·2 3.64µs ± 3% 3.63µs ± 0% ~ (p=0.500 n=5+5)
fs1-zwrk.go·3 3.67µs ± 1% 3.68µs ± 0% ~ (p=0.937 n=5+5)
fs1-zwrk.go·4 3.70µs ± 0% 3.70µs ± 0% ~ (p=0.381 n=5+5)
fs1-zwrk.go·8 5.62µs ± 0% 5.60µs ± 0% ~ (p=0.056 n=5+5)
fs1-zwrk.go·12 7.76µs ± 0% 7.75µs ± 0% ~ (p=0.516 n=5+5)
fs1-zwrk.go·16 10.3µs ± 0% 10.3µs ± 1% ~ (p=0.746 n=5+5)
zeo/py/fs1-zwrk.go·1 136µs ± 1% 135µs ± 0% ~ (p=0.222 n=5+5)
zeo/py/fs1-zwrk.go·2 223µs ± 2% 225µs ± 0% ~ (p=0.690 n=5+5)
zeo/py/fs1-zwrk.go·3 311µs ± 3% 312µs ± 1% ~ (p=0.690 n=5+5)
zeo/py/fs1-zwrk.go·4 405µs ± 1% 403µs ± 0% ~ (p=0.222 n=5+5)
zeo/py/fs1-zwrk.go·8 774µs ± 1% 778µs ± 0% ~ (p=0.222 n=5+5)
zeo/py/fs1-zwrk.go·12 1.15ms ± 1% 1.15ms ± 1% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·16 1.52ms ± 1% 1.53ms ± 1% ~ (p=0.548 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 145µs ± 2% 147µs ± 1% ~ (p=0.151 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 232µs ± 3% 232µs ± 1% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 347µs ± 0% 350µs ± 2% ~ (p=0.111 n=4+5)
neo/py(!log)/sqlite-zwrk.go·4 459µs ± 1% 469µs ± 1% +1.99% (p=0.016 n=4+5)
neo/py(!log)/sqlite-zwrk.go·8 930µs ± 2% 938µs ± 1% ~ (p=0.310 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 1.39ms ± 2% 1.40ms ± 0% ~ (p=0.190 n=5+4)
neo/py(!log)/sqlite-zwrk.go·16 1.87ms ± 3% 1.88ms ± 1% ~ (p=0.548 n=5+5)
neo/py(!log)/sql-zwrk.go·1 176µs ± 1% 180µs ± 2% +2.26% (p=0.032 n=5+5)
neo/py(!log)/sql-zwrk.go·2 298µs ± 5% 301µs ± 2% ~ (p=0.222 n=5+5)
neo/py(!log)/sql-zwrk.go·3 449µs ± 2% 454µs ± 1% ~ (p=0.222 n=5+5)
neo/py(!log)/sql-zwrk.go·4 589µs ± 1% 612µs ± 2% +3.90% (p=0.016 n=4+5)
neo/py(!log)/sql-zwrk.go·8 1.20ms ± 2% 1.20ms ± 1% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·12 1.83ms ±12% 1.81ms ± 2% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·16 2.39ms ± 1% 2.42ms ± 2% ~ (p=0.413 n=4+5)
neo/go/fs1-zwrk.go·1 63.9µs ± 0% 64.1µs ± 0% ~ (p=0.095 n=5+5)
neo/go/fs1-zwrk.go·2 66.0µs ± 0% 66.7µs ± 0% +1.14% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·3 75.4µs ± 0% 75.8µs ± 0% +0.50% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·4 80.5µs ± 0% 80.8µs ± 0% +0.41% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·8 116µs ± 1% 116µs ± 0% ~ (p=0.222 n=5+5)
neo/go/fs1-zwrk.go·12 164µs ± 0% 164µs ± 0% ~ (p=0.095 n=5+5)
neo/go/fs1-zwrk.go·16 217µs ± 0% 216µs ± 0% -0.37% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 39.0µs ± 3% 39.1µs ± 1% ~ (p=0.690 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 41.8µs ± 0% 42.2µs ± 0% +1.03% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 50.3µs ± 0% 50.4µs ± 0% ~ (p=0.056 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 55.0µs ± 0% 55.4µs ± 0% +0.66% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 82.5µs ± 0% 82.8µs ± 0% ~ (p=0.056 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 110µs ± 1% 109µs ± 0% ~ (p=0.222 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 142µs ± 1% 141µs ± 0% ~ (p=0.056 n=5+5)
neo/go/sqlite-zwrk.go·1 101µs ± 1% 101µs ± 0% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go·2 109µs ± 0% 110µs ± 0% +1.40% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·3 118µs ± 0% 120µs ± 0% +2.04% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·4 132µs ± 0% 135µs ± 0% +2.29% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·8 202µs ± 0% 210µs ± 0% +3.86% (p=0.016 n=5+4)
neo/go/sqlite-zwrk.go·12 294µs ± 1% 297µs ± 2% ~ (p=0.095 n=5+5)
neo/go/sqlite-zwrk.go·16 396µs ± 3% 388µs ± 1% -2.11% (p=0.032 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 91.1µs ± 1% 90.9µs ± 0% ~ (p=0.310 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 101µs ± 0% 102µs ± 0% +1.26% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 108µs ± 0% 110µs ± 0% +1.92% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 118µs ± 1% 121µs ± 0% +2.67% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 183µs ± 1% 188µs ± 2% +3.10% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 280µs ± 2% 280µs ± 2% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 391µs ± 2% 374µs ± 3% -4.44% (p=0.008 n=5+5)
cluster:rio dataset:prod1-1024
fs1-zwrk.go·1 2.17µs ± 1% 2.17µs ± 1% ~ (p=0.738 n=5+5)
fs1-zwrk.go·2 2.20µs ± 0% 2.22µs ± 1% ~ (p=0.103 n=5+5)
fs1-zwrk.go·3 2.21µs ± 0% 2.24µs ± 1% +1.15% (p=0.024 n=5+5)
fs1-zwrk.go·4 2.23µs ± 1% 2.25µs ± 0% +0.73% (p=0.024 n=5+5)
fs1-zwrk.go·8 3.37µs ± 1% 3.38µs ± 1% ~ (p=0.548 n=5+5)
fs1-zwrk.go·12 5.00µs ± 1% 5.00µs ± 0% ~ (p=0.310 n=5+5)
fs1-zwrk.go·16 6.67µs ± 0% 6.67µs ± 0% ~ (p=0.841 n=5+5)
zeo/py/fs1-zwrk.go·1 112µs ± 2% 113µs ± 0% ~ (p=0.310 n=5+5)
zeo/py/fs1-zwrk.go·2 171µs ± 1% 175µs ± 1% +2.08% (p=0.016 n=5+5)
zeo/py/fs1-zwrk.go·3 230µs ± 1% 238µs ± 1% +3.31% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·4 298µs ± 2% 306µs ± 1% ~ (p=0.056 n=5+5)
zeo/py/fs1-zwrk.go·8 562µs ± 2% 582µs ± 0% +3.55% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·12 852µs ± 2% 868µs ± 1% +1.91% (p=0.032 n=5+5)
zeo/py/fs1-zwrk.go·16 1.11ms ± 2% 1.15ms ± 1% +3.39% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 141µs ± 2% 138µs ± 0% ~ (p=0.095 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 239µs ± 6% 230µs ± 1% -3.99% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 349µs ± 1% 344µs ± 1% -1.24% (p=0.032 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 477µs ± 9% 461µs ± 1% ~ (p=0.310 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 929µs ± 3% 914µs ± 1% ~ (p=0.310 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 1.40ms ± 2% 1.39ms ± 2% ~ (p=0.151 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 1.89ms ± 5% 1.85ms ± 2% ~ (p=0.222 n=5+5)
neo/py(!log)/sql-zwrk.go·1 173µs ± 6% 172µs ± 1% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·2 295µs ± 4% 293µs ± 1% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zwrk.go·3 438µs ± 1% 441µs ± 1% ~ (p=0.095 n=5+5)
neo/py(!log)/sql-zwrk.go·4 589µs ± 2% 592µs ± 2% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zwrk.go·8 1.18ms ± 6% 1.20ms ± 3% ~ (p=0.222 n=5+5)
neo/py(!log)/sql-zwrk.go·12 1.85ms ± 5% 1.75ms ± 2% ~ (p=0.095 n=5+5)
neo/py(!log)/sql-zwrk.go·16 2.35ms ± 1% 2.35ms ± 1% ~ (p=1.000 n=5+5)
neo/go/fs1-zwrk.go·1 46.3µs ± 1% 45.9µs ± 0% ~ (p=0.095 n=5+5)
neo/go/fs1-zwrk.go·2 51.0µs ± 1% 51.0µs ± 0% ~ (p=0.690 n=5+5)
neo/go/fs1-zwrk.go·3 58.4µs ± 0% 58.4µs ± 0% ~ (p=0.310 n=5+5)
neo/go/fs1-zwrk.go·4 63.8µs ± 0% 63.6µs ± 0% -0.30% (p=0.016 n=5+5)
neo/go/fs1-zwrk.go·8 97.9µs ± 1% 96.5µs ± 2% -1.48% (p=0.032 n=5+5)
neo/go/fs1-zwrk.go·12 146µs ± 3% 136µs ± 2% -6.67% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·16 200µs ± 3% 179µs ± 3% -10.62% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 37.7µs ± 1% 37.6µs ± 0% ~ (p=0.690 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 40.8µs ± 0% 41.0µs ± 0% +0.66% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 48.3µs ± 0% 48.4µs ± 0% ~ (p=0.151 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 53.9µs ± 0% 53.8µs ± 0% ~ (p=0.421 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 86.6µs ± 1% 84.9µs ± 0% -1.98% (p=0.016 n=5+4)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 128µs ± 2% 116µs ± 5% -9.16% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 178µs ± 3% 149µs ± 2% -16.06% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·1 91.7µs ± 1% 90.5µs ± 1% -1.35% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·2 104µs ± 0% 103µs ± 0% -0.80% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·3 113µs ± 1% 112µs ± 0% -0.86% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·4 126µs ± 0% 124µs ± 0% -1.01% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·8 210µs ± 3% 214µs ± 3% ~ (p=0.310 n=5+5)
neo/go/sqlite-zwrk.go·12 324µs ± 2% 336µs ± 3% +3.66% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·16 441µs ± 2% 458µs ± 3% +3.75% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 87.2µs ± 1% 86.6µs ± 0% ~ (p=0.056 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 100µs ± 0% 100µs ± 1% +0.77% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 109µs ± 0% 110µs ± 1% +1.09% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 119µs ± 2% 121µs ± 0% +1.33% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 200µs ± 1% 213µs ± 2% +6.39% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 316µs ± 0% 331µs ± 4% +4.54% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 436µs ± 1% 454µs ± 3% +4.17% (p=0.008 n=5+5)

9282fca1

X rio: localhost timings, Cenabled, zwrk@1s · 31d87ace

Kirill Smelkov authored Mar 09, 2018

Remeasure with the same sattings as previous rio localhost with C-enabled (31dc070d):

Like on neo1 & z6001 data is moreorless the same.

the pystone/s change is nose as pystone/s for C-enabled case was 146k on
prev-prev run (see 31dc070d).

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

$ benchstat -split node,cluster,dataset 20180306-rio-ffixed-c.txt 20180308-rio-ffixed-c-zwrk1s.txt

name old pystone/s new pystone/s delta
node:rio
pystone 115k ±12% 144k ± 3% +24.95% (p=0.008 n=5+5)

name old time/op new time/op delta
node:rio
crc32/py/4K 4.77µs ± 0% 4.79µs ± 1% ~ (p=0.730 n=4+5)
crc32/go/4K 1.49µs ± 0% 1.49µs ± 0% -0.21% (p=0.016 n=5+5)
sha1/py/4K 8.04µs ± 1% 7.98µs ± 1% ~ (p=0.206 n=5+5)
sha1/go/4K 8.93µs ± 0% 9.29µs ±12% ~ (p=0.167 n=5+5)
unzlib/py/wczdata 25.1µs ± 1% 25.2µs ± 1% ~ (p=0.421 n=5+5)
unzlib/go/wczdata 23.0µs ± 0% 23.0µs ± 0% -0.20% (p=0.016 n=5+5)
unzlib/py/prod1-avg 7.16µs ± 1% 7.26µs ± 3% ~ (p=0.222 n=5+5)
unzlib/go/prod1-avg 5.08µs ± 1% 5.06µs ± 1% ~ (p=0.095 n=5+5)
disk/randread/direct/4K-min 92.4µs ± 0% 93.0µs ± 0% +0.67% (p=0.024 n=5+5)
disk/randread/direct/4K-avg 115µs ± 0% 116µs ± 1% +0.99% (p=0.008 n=5+5)
disk/randread/pagecache/4K-min 565ns ± 2% 570ns ± 1% ~ (p=0.167 n=5+5)
disk/randread/pagecache/4K-avg 992ns ± 0% 995ns ± 0% +0.26% (p=0.016 n=4+5)

name old time/object new time/object delta
cluster:rio dataset:wczblk1-8
fs1-zhash.py 29.2µs ± 1% 28.9µs ± 1% ~ (p=0.086 n=4+4)
fs1-zhash.go 4.68µs ± 5% 4.60µs ± 0% ~ (p=0.333 n=5+4)
fs1-zhash.go+prefetch128 4.78µs ± 5% 4.62µs ± 3% ~ (p=0.111 n=5+5)
zeo/py/fs1-zhash.py 400µs ± 0% 412µs ± 4% ~ (p=0.151 n=5+5)
zeo/py/fs1-zhash.go 138µs ± 1% 139µs ± 3% ~ (p=0.548 n=5+5)
zeo/py/fs1-zhash.go+prefetch128 74.7µs ± 2% 75.2µs ± 5% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zhash.py 318µs ± 7% 315µs ± 3% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zhash.go 154µs ± 4% 156µs ± 6% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zhash.go+prefetch128 125µs ± 3% 125µs ± 2% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zhash.py 400µs ±57% 342µs ± 2% ~ (p=0.730 n=5+4)
neo/py(!log)/sql-zhash.go 183µs ±11% 178µs ± 2% ~ (p=0.889 n=5+5)
neo/py(!log)/sql-zhash.go+prefetch128 158µs ± 3% 159µs ± 2% ~ (p=0.968 n=5+5)
neo/go/fs1-zhash.py 222µs ± 4% 224µs ± 4% ~ (p=1.000 n=5+5)
neo/go/fs1-zhash.go 68.6µs ± 2% 67.0µs ± 1% -2.30% (p=0.008 n=5+5)
neo/go/fs1-zhash.go+prefetch128 29.0µs ± 6% 28.3µs ± 1% ~ (p=0.143 n=5+5)
neo/go/fs1(!sha1)-zhash.go(!sha1) 43.9µs ± 3% 45.0µs ± 6% ~ (p=0.500 n=5+5)
neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 18.8µs ± 5% 19.0µs ± 3% ~ (p=0.810 n=5+5)
neo/go/sqlite-zhash.py 273µs ± 3% 266µs ± 2% ~ (p=0.095 n=5+5)
neo/go/sqlite-zhash.go 104µs ± 1% 103µs ± 2% ~ (p=0.294 n=5+5)
neo/go/sqlite-zhash.go+prefetch128 36.3µs ± 3% 37.6µs ± 2% +3.75% (p=0.016 n=5+5)
neo/go/sqlite-zhash.go(!sha1) 94.2µs ± 3% 94.7µs ± 1% ~ (p=0.413 n=5+5)
neo/go/sqlite-zhash.go+prefetch128(!sha1) 35.1µs ± 6% 35.1µs ± 6% ~ (p=1.000 n=5+5)
cluster:rio dataset:prod1-1024
fs1-zhash.py 23.9µs ± 1% 24.2µs ± 1% ~ (p=0.143 n=4+4)
fs1-zhash.go 3.40µs ± 0% 3.40µs ± 0% ~ (all equal)
fs1-zhash.go+prefetch128 3.02µs ± 9% 3.06µs ± 2% ~ (p=0.238 n=5+5)
zeo/py/fs1-zhash.py 372µs ±10% 368µs ± 1% ~ (p=1.000 n=5+5)
zeo/py/fs1-zhash.go 114µs ± 1% 115µs ± 2% ~ (p=0.222 n=5+5)
zeo/py/fs1-zhash.go+prefetch128 64.6µs ± 1% 65.6µs ± 1% +1.55% (p=0.040 n=5+5)
neo/py(!log)/sqlite-zhash.py 321µs ±11% 316µs ± 6% ~ (p=0.952 n=5+5)
neo/py(!log)/sqlite-zhash.go 142µs ± 3% 142µs ± 5% ~ (p=0.841 n=5+5)
neo/py(!log)/sqlite-zhash.go+prefetch128 117µs ± 1% 116µs ± 1% ~ (p=0.111 n=5+5)
neo/py(!log)/sql-zhash.py 330µs ± 1% 339µs ± 5% ~ (p=0.486 n=4+4)
neo/py(!log)/sql-zhash.go 172µs ± 1% 172µs ± 1% ~ (p=0.889 n=5+5)
neo/py(!log)/sql-zhash.go+prefetch128 149µs ± 2% 150µs ± 1% ~ (p=0.421 n=5+5)
neo/go/fs1-zhash.py 217µs ± 1% 219µs ± 2% ~ (p=0.389 n=5+5)
neo/go/fs1-zhash.go 49.8µs ± 2% 49.9µs ± 1% ~ (p=0.786 n=5+5)
neo/go/fs1-zhash.go+prefetch128 18.8µs ± 1% 19.1µs ± 3% ~ (p=0.167 n=5+5)
neo/go/fs1(!sha1)-zhash.go(!sha1) 40.4µs ± 3% 41.1µs ± 2% ~ (p=0.103 n=5+5)
neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 16.1µs ± 2% 16.2µs ± 5% ~ (p=1.000 n=5+5)
neo/go/sqlite-zhash.py 263µs ± 4% 261µs ± 5% ~ (p=0.548 n=5+5)
neo/go/sqlite-zhash.go 93.1µs ± 1% 94.3µs ± 1% +1.29% (p=0.024 n=5+5)
neo/go/sqlite-zhash.go+prefetch128 32.7µs ± 2% 33.6µs ± 5% ~ (p=0.381 n=5+5)
neo/go/sqlite-zhash.go(!sha1) 89.6µs ± 1% 90.3µs ± 2% ~ (p=0.175 n=5+5)
neo/go/sqlite-zhash.go+prefetch128(!sha1) 34.0µs ± 2% 33.0µs ± 4% ~ (p=0.238 n=5+5)

name old req/s new req/s delta
cluster:rio dataset:wczblk1-8
fs1-zwrk.go·1 300k ± 0% 301k ± 0% ~ (p=0.056 n=5+5)
fs1-zwrk.go·2 546k ± 0% 550k ± 3% ~ (p=0.151 n=5+5)
fs1-zwrk.go·3 810k ± 0% 817k ± 1% +0.82% (p=0.008 n=5+5)
fs1-zwrk.go·4 1.08M ± 0% 1.08M ± 0% +0.58% (p=0.008 n=5+5)
fs1-zwrk.go·8 1.42M ± 0% 1.42M ± 0% ~ (p=0.222 n=5+5)
fs1-zwrk.go·12 1.55M ± 0% 1.55M ± 0% ~ (p=1.000 n=5+5)
fs1-zwrk.go·16 1.55M ± 0% 1.55M ± 0% ~ (p=0.222 n=5+5)
zeo/py/fs1-zwrk.go·1 7.41k ± 1% 7.38k ± 1% ~ (p=0.421 n=5+5)
zeo/py/fs1-zwrk.go·2 9.03k ± 1% 8.96k ± 2% ~ (p=0.421 n=5+5)
zeo/py/fs1-zwrk.go·3 9.77k ± 1% 9.66k ± 3% ~ (p=0.421 n=5+5)
zeo/py/fs1-zwrk.go·4 10.1k ± 3% 9.9k ± 1% ~ (p=0.222 n=5+5)
zeo/py/fs1-zwrk.go·8 10.5k ± 0% 10.3k ± 1% -1.89% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·12 10.6k ± 1% 10.4k ± 1% -1.61% (p=0.016 n=5+5)
zeo/py/fs1-zwrk.go·16 10.6k ± 1% 10.5k ± 1% ~ (p=0.056 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 6.80k ± 2% 6.88k ± 2% ~ (p=0.222 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 8.31k ± 7% 8.63k ± 3% ~ (p=0.095 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 8.60k ± 1% 8.66k ± 0% ~ (p=0.190 n=5+4)
neo/py(!log)/sqlite-zwrk.go·4 8.60k ± 1% 8.71k ± 1% +1.17% (p=0.029 n=4+4)
neo/py(!log)/sqlite-zwrk.go·8 8.61k ± 1% 8.60k ± 2% ~ (p=0.841 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 8.56k ± 1% 8.63k ± 2% ~ (p=0.095 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 8.49k ± 3% 8.54k ± 3% ~ (p=0.548 n=5+5)
neo/py(!log)/sql-zwrk.go·1 5.62k ± 6% 5.69k ± 1% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zwrk.go·2 6.75k ± 4% 6.73k ± 5% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zwrk.go·3 6.77k ± 2% 6.69k ± 2% ~ (p=0.222 n=5+5)
neo/py(!log)/sql-zwrk.go·4 6.51k ± 7% 6.60k ±11% ~ (p=0.310 n=5+5)
neo/py(!log)/sql-zwrk.go·8 6.56k ± 4% 6.65k ± 2% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·12 6.84k ± 1% 6.58k ±11% ~ (p=0.063 n=4+5)
neo/py(!log)/sql-zwrk.go·16 6.73k ± 3% 6.70k ± 1% ~ (p=0.413 n=5+4)
neo/go/fs1-zwrk.go·1 15.5k ± 0% 15.7k ± 0% +0.83% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·2 29.9k ± 1% 30.3k ± 0% +1.32% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·3 39.4k ± 0% 39.8k ± 0% +0.83% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·4 49.4k ± 0% 49.7k ± 0% +0.72% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·8 68.4k ± 0% 68.7k ± 1% ~ (p=0.151 n=5+5)
neo/go/fs1-zwrk.go·12 72.5k ± 0% 73.0k ± 0% +0.68% (p=0.032 n=5+5)
neo/go/fs1-zwrk.go·16 73.2k ± 0% 73.9k ± 0% +0.99% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 26.2k ± 1% 25.6k ± 3% ~ (p=0.095 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 47.6k ± 0% 47.8k ± 0% +0.49% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 59.4k ± 0% 59.6k ± 0% +0.37% (p=0.016 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 72.2k ± 0% 72.7k ± 0% +0.68% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 96.7k ± 0% 97.0k ± 0% ~ (p=0.095 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 109k ± 0% 109k ± 1% ~ (p=0.690 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 113k ± 1% 113k ± 1% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go·1 9.82k ± 0% 9.88k ± 1% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go·2 18.3k ± 0% 18.4k ± 0% +0.51% (p=0.016 n=5+5)
neo/go/sqlite-zwrk.go·3 25.3k ± 0% 25.5k ± 0% +0.67% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·4 30.3k ± 0% 30.4k ± 0% ~ (p=0.310 n=5+5)
neo/go/sqlite-zwrk.go·8 39.5k ± 0% 39.5k ± 0% ~ (p=0.548 n=5+5)
neo/go/sqlite-zwrk.go·12 40.8k ± 2% 40.9k ± 1% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go·16 40.5k ± 2% 40.4k ± 2% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 11.0k ± 1% 11.0k ± 1% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 20.0k ± 0% 19.9k ± 0% -0.65% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 27.9k ± 0% 27.7k ± 0% -0.55% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 34.1k ± 0% 34.0k ± 1% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 44.1k ± 1% 43.8k ± 1% ~ (p=0.095 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 43.1k ± 1% 42.8k ± 2% ~ (p=0.548 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 41.2k ± 2% 40.9k ± 2% ~ (p=0.421 n=5+5)
cluster:rio dataset:prod1-1024
fs1-zwrk.go·1 465k ± 1% 462k ± 1% ~ (p=0.095 n=5+5)
fs1-zwrk.go·2 920k ± 0% 910k ± 1% -1.07% (p=0.016 n=4+5)
fs1-zwrk.go·3 1.36M ± 1% 1.35M ± 0% ~ (p=0.056 n=5+5)
fs1-zwrk.go·4 1.81M ± 0% 1.79M ± 1% -1.07% (p=0.008 n=5+5)
fs1-zwrk.go·8 2.37M ± 1% 2.38M ± 1% ~ (p=0.841 n=5+5)
fs1-zwrk.go·12 2.41M ± 0% 2.40M ± 1% -0.61% (p=0.008 n=5+5)
fs1-zwrk.go·16 2.42M ± 0% 2.40M ± 0% -1.00% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·1 8.98k ± 1% 8.91k ± 2% ~ (p=0.310 n=5+5)
zeo/py/fs1-zwrk.go·2 11.7k ± 1% 11.7k ± 1% ~ (p=0.690 n=5+5)
zeo/py/fs1-zwrk.go·3 12.9k ± 2% 13.0k ± 1% ~ (p=0.151 n=5+5)
zeo/py/fs1-zwrk.go·4 13.4k ± 4% 13.4k ± 2% ~ (p=0.690 n=5+5)
zeo/py/fs1-zwrk.go·8 14.0k ± 2% 14.2k ± 2% ~ (p=0.095 n=5+5)
zeo/py/fs1-zwrk.go·12 14.2k ± 2% 14.1k ± 2% ~ (p=0.548 n=5+5)
zeo/py/fs1-zwrk.go·16 14.2k ± 3% 14.4k ± 2% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 7.16k ± 4% 7.12k ± 2% ~ (p=0.841 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 8.75k ± 1% 8.37k ± 6% -4.30% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 8.65k ± 4% 8.60k ± 1% ~ (p=0.151 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 8.53k ± 6% 8.40k ± 8% ~ (p=0.548 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 8.61k ± 3% 8.61k ± 3% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 8.64k ± 0% 8.56k ± 2% ~ (p=0.556 n=4+5)
neo/py(!log)/sqlite-zwrk.go·16 8.64k ± 1% 8.46k ± 5% ~ (p=0.548 n=5+5)
neo/py(!log)/sql-zwrk.go·1 5.88k ± 1% 5.78k ± 5% ~ (p=0.310 n=5+5)
neo/py(!log)/sql-zwrk.go·2 6.79k ± 2% 6.77k ± 4% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zwrk.go·3 6.58k ± 4% 6.85k ± 1% +4.08% (p=0.016 n=5+5)
neo/py(!log)/sql-zwrk.go·4 6.68k ± 4% 6.79k ± 2% ~ (p=0.643 n=5+5)
neo/py(!log)/sql-zwrk.go·8 6.83k ± 1% 6.80k ± 5% ~ (p=0.548 n=5+5)
neo/py(!log)/sql-zwrk.go·12 6.66k ± 4% 6.50k ± 5% ~ (p=0.690 n=5+5)
neo/py(!log)/sql-zwrk.go·16 6.65k ± 5% 6.81k ± 1% ~ (p=0.421 n=5+5)
neo/go/fs1-zwrk.go·1 21.8k ± 1% 21.6k ± 1% ~ (p=0.151 n=5+5)
neo/go/fs1-zwrk.go·2 39.2k ± 1% 39.2k ± 1% ~ (p=0.548 n=5+5)
neo/go/fs1-zwrk.go·3 51.4k ± 0% 51.3k ± 0% -0.22% (p=0.032 n=5+5)
neo/go/fs1-zwrk.go·4 62.8k ± 0% 62.7k ± 0% ~ (p=0.421 n=5+5)
neo/go/fs1-zwrk.go·8 80.7k ± 1% 81.7k ± 1% ~ (p=0.095 n=5+5)
neo/go/fs1-zwrk.go·12 80.0k ± 2% 82.1k ± 3% ~ (p=0.056 n=5+5)
neo/go/fs1-zwrk.go·16 78.3k ± 2% 80.1k ± 3% ~ (p=0.095 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 26.5k ± 1% 26.5k ± 1% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 48.8k ± 0% 49.1k ± 0% +0.55% (p=0.032 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 61.8k ± 0% 62.2k ± 0% +0.57% (p=0.016 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 74.0k ± 0% 74.2k ± 0% ~ (p=0.151 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 91.3k ± 0% 92.4k ± 1% ~ (p=0.111 n=4+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 93.1k ± 2% 94.1k ± 2% ~ (p=0.421 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 89.7k ± 2% 90.0k ± 3% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go·1 11.0k ± 1% 10.9k ± 1% -1.12% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·2 19.4k ± 1% 19.3k ± 0% -0.67% (p=0.016 n=5+5)
neo/go/sqlite-zwrk.go·3 26.6k ± 0% 26.4k ± 1% ~ (p=0.056 n=5+5)
neo/go/sqlite-zwrk.go·4 31.9k ± 0% 31.8k ± 0% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go·8 37.4k ± 2% 38.1k ± 3% ~ (p=0.310 n=5+5)
neo/go/sqlite-zwrk.go·12 35.2k ± 3% 37.1k ± 2% +5.41% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·16 34.6k ± 2% 36.3k ± 2% +4.86% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 11.5k ± 1% 11.5k ± 1% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 20.1k ± 0% 20.1k ± 0% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 27.6k ± 0% 27.6k ± 0% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 33.4k ± 0% 33.5k ± 2% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 38.8k ± 2% 40.0k ± 1% +2.97% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 36.4k ± 1% 37.9k ± 0% +4.32% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 35.2k ± 2% 36.7k ± 1% +4.28% (p=0.008 n=5+5)

name old latency-time/object new latency-time/object delta
cluster:rio dataset:wczblk1-8
fs1-zwrk.go·1 3.33µs ± 0% 3.32µs ± 0% -0.44% (p=0.048 n=5+5)
fs1-zwrk.go·2 3.67µs ± 0% 3.64µs ± 3% ~ (p=0.143 n=5+5)
fs1-zwrk.go·3 3.70µs ± 0% 3.67µs ± 1% -0.80% (p=0.008 n=5+5)
fs1-zwrk.go·4 3.72µs ± 0% 3.70µs ± 0% -0.58% (p=0.008 n=5+5)
fs1-zwrk.go·8 5.62µs ± 0% 5.62µs ± 0% ~ (p=0.206 n=5+5)
fs1-zwrk.go·12 7.76µs ± 0% 7.76µs ± 0% ~ (p=1.000 n=5+5)
fs1-zwrk.go·16 10.3µs ± 0% 10.3µs ± 0% ~ (p=0.222 n=5+5)
zeo/py/fs1-zwrk.go·1 135µs ± 1% 136µs ± 1% ~ (p=0.421 n=5+5)
zeo/py/fs1-zwrk.go·2 222µs ± 1% 223µs ± 2% ~ (p=0.421 n=5+5)
zeo/py/fs1-zwrk.go·3 307µs ± 1% 311µs ± 3% ~ (p=0.421 n=5+5)
zeo/py/fs1-zwrk.go·4 398µs ± 3% 405µs ± 1% ~ (p=0.222 n=5+5)
zeo/py/fs1-zwrk.go·8 759µs ± 0% 774µs ± 1% +1.93% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·12 1.13ms ± 1% 1.15ms ± 1% +1.64% (p=0.016 n=5+5)
zeo/py/fs1-zwrk.go·16 1.50ms ± 1% 1.52ms ± 1% ~ (p=0.056 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 147µs ± 2% 145µs ± 2% ~ (p=0.222 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 241µs ± 8% 232µs ± 3% ~ (p=0.095 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 349µs ± 1% 347µs ± 0% ~ (p=0.190 n=5+4)
neo/py(!log)/sqlite-zwrk.go·4 465µs ± 1% 459µs ± 1% -1.16% (p=0.029 n=4+4)
neo/py(!log)/sqlite-zwrk.go·8 930µs ± 1% 930µs ± 2% ~ (p=0.841 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 1.40ms ± 1% 1.39ms ± 2% ~ (p=0.095 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 1.88ms ± 3% 1.87ms ± 3% ~ (p=0.548 n=5+5)
neo/py(!log)/sql-zwrk.go·1 178µs ± 6% 176µs ± 1% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zwrk.go·2 297µs ± 4% 298µs ± 5% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zwrk.go·3 443µs ± 2% 449µs ± 2% ~ (p=0.222 n=5+5)
neo/py(!log)/sql-zwrk.go·4 616µs ± 8% 589µs ± 1% ~ (p=0.063 n=5+4)
neo/py(!log)/sql-zwrk.go·8 1.22ms ± 5% 1.20ms ± 2% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·12 1.75ms ± 1% 1.83ms ±12% ~ (p=0.063 n=4+5)
neo/py(!log)/sql-zwrk.go·16 2.38ms ± 3% 2.39ms ± 1% ~ (p=0.413 n=5+4)
neo/go/fs1-zwrk.go·1 64.4µs ± 0% 63.9µs ± 0% -0.82% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·2 66.8µs ± 1% 66.0µs ± 0% -1.30% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·3 76.1µs ± 0% 75.4µs ± 0% -0.82% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·4 81.0µs ± 0% 80.5µs ± 0% -0.72% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·8 117µs ± 0% 116µs ± 1% ~ (p=0.151 n=5+5)
neo/go/fs1-zwrk.go·12 165µs ± 0% 164µs ± 0% -0.68% (p=0.032 n=5+5)
neo/go/fs1-zwrk.go·16 219µs ± 0% 217µs ± 0% -0.98% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 38.2µs ± 1% 39.0µs ± 3% ~ (p=0.095 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 42.0µs ± 0% 41.8µs ± 0% -0.49% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 50.5µs ± 0% 50.3µs ± 0% -0.37% (p=0.016 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 55.4µs ± 0% 55.0µs ± 0% -0.67% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 82.8µs ± 0% 82.5µs ± 0% ~ (p=0.095 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 110µs ± 0% 110µs ± 1% ~ (p=0.690 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 142µs ± 1% 142µs ± 1% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go·1 102µs ± 0% 101µs ± 1% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go·2 110µs ± 0% 109µs ± 0% -0.50% (p=0.016 n=5+5)
neo/go/sqlite-zwrk.go·3 119µs ± 0% 118µs ± 0% -0.66% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·4 132µs ± 0% 132µs ± 0% ~ (p=0.310 n=5+5)
neo/go/sqlite-zwrk.go·8 203µs ± 0% 202µs ± 0% ~ (p=0.548 n=5+5)
neo/go/sqlite-zwrk.go·12 294µs ± 2% 294µs ± 1% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go·16 395µs ± 2% 396µs ± 3% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 91.1µs ± 1% 91.1µs ± 1% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 100µs ± 0% 101µs ± 0% +0.66% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 108µs ± 0% 108µs ± 0% +0.56% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 117µs ± 0% 118µs ± 1% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 182µs ± 1% 183µs ± 1% ~ (p=0.095 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 279µs ± 1% 280µs ± 2% ~ (p=0.548 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 388µs ± 2% 391µs ± 2% ~ (p=0.421 n=5+5)
cluster:rio dataset:prod1-1024
fs1-zwrk.go·1 2.15µs ± 1% 2.17µs ± 1% ~ (p=0.079 n=5+5)
fs1-zwrk.go·2 2.17µs ± 0% 2.20µs ± 0% +1.09% (p=0.016 n=4+5)
fs1-zwrk.go·3 2.20µs ± 1% 2.21µs ± 0% ~ (p=0.063 n=5+5)
fs1-zwrk.go·4 2.21µs ± 0% 2.23µs ± 1% +1.09% (p=0.008 n=5+5)
fs1-zwrk.go·8 3.37µs ± 1% 3.37µs ± 1% ~ (p=0.841 n=5+5)
fs1-zwrk.go·12 4.97µs ± 0% 5.00µs ± 1% +0.62% (p=0.008 n=5+5)
fs1-zwrk.go·16 6.61µs ± 0% 6.67µs ± 0% +1.01% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·1 111µs ± 1% 112µs ± 2% ~ (p=0.310 n=5+5)
zeo/py/fs1-zwrk.go·2 171µs ± 1% 171µs ± 1% ~ (p=0.690 n=5+5)
zeo/py/fs1-zwrk.go·3 233µs ± 2% 230µs ± 1% ~ (p=0.151 n=5+5)
zeo/py/fs1-zwrk.go·4 298µs ± 4% 298µs ± 2% ~ (p=0.690 n=5+5)
zeo/py/fs1-zwrk.go·8 572µs ± 2% 562µs ± 2% ~ (p=0.095 n=5+5)
zeo/py/fs1-zwrk.go·12 844µs ± 2% 852µs ± 2% ~ (p=0.548 n=5+5)
zeo/py/fs1-zwrk.go·16 1.12ms ± 3% 1.11ms ± 2% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 140µs ± 4% 141µs ± 2% ~ (p=0.841 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 229µs ± 1% 239µs ± 6% +4.59% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 347µs ± 5% 349µs ± 1% ~ (p=0.151 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 470µs ± 7% 477µs ± 9% ~ (p=0.548 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 929µs ± 3% 929µs ± 3% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 1.39ms ± 0% 1.40ms ± 2% ~ (p=0.556 n=4+5)
neo/py(!log)/sqlite-zwrk.go·16 1.85ms ± 1% 1.89ms ± 5% ~ (p=0.548 n=5+5)
neo/py(!log)/sql-zwrk.go·1 170µs ± 1% 173µs ± 6% ~ (p=0.310 n=5+5)
neo/py(!log)/sql-zwrk.go·2 294µs ± 2% 295µs ± 4% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zwrk.go·3 456µs ± 4% 438µs ± 1% -3.97% (p=0.016 n=5+5)
neo/py(!log)/sql-zwrk.go·4 599µs ± 4% 589µs ± 2% ~ (p=0.690 n=5+5)
neo/py(!log)/sql-zwrk.go·8 1.17ms ± 1% 1.18ms ± 6% ~ (p=0.548 n=5+5)
neo/py(!log)/sql-zwrk.go·12 1.80ms ± 4% 1.85ms ± 5% ~ (p=0.690 n=5+5)
neo/py(!log)/sql-zwrk.go·16 2.41ms ± 5% 2.35ms ± 1% ~ (p=0.421 n=5+5)
neo/go/fs1-zwrk.go·1 45.9µs ± 1% 46.3µs ± 1% ~ (p=0.151 n=5+5)
neo/go/fs1-zwrk.go·2 51.0µs ± 1% 51.0µs ± 1% ~ (p=0.548 n=5+5)
neo/go/fs1-zwrk.go·3 58.3µs ± 0% 58.4µs ± 0% +0.22% (p=0.032 n=5+5)
neo/go/fs1-zwrk.go·4 63.7µs ± 0% 63.8µs ± 0% ~ (p=0.421 n=5+5)
neo/go/fs1-zwrk.go·8 99.2µs ± 1% 97.9µs ± 1% ~ (p=0.095 n=5+5)
neo/go/fs1-zwrk.go·12 150µs ± 2% 146µs ± 3% ~ (p=0.056 n=5+5)
neo/go/fs1-zwrk.go·16 204µs ± 3% 200µs ± 3% ~ (p=0.095 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 37.7µs ± 1% 37.7µs ± 1% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 41.0µs ± 0% 40.8µs ± 0% -0.55% (p=0.032 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 48.5µs ± 0% 48.3µs ± 0% -0.56% (p=0.016 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 54.0µs ± 0% 53.9µs ± 0% ~ (p=0.151 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 87.6µs ± 0% 86.6µs ± 1% ~ (p=0.111 n=4+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 129µs ± 2% 128µs ± 2% ~ (p=0.421 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 178µs ± 2% 178µs ± 3% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go·1 90.7µs ± 1% 91.7µs ± 1% +1.13% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·2 103µs ± 1% 104µs ± 0% +0.68% (p=0.016 n=5+5)
neo/go/sqlite-zwrk.go·3 113µs ± 0% 113µs ± 1% ~ (p=0.056 n=5+5)
neo/go/sqlite-zwrk.go·4 125µs ± 0% 126µs ± 0% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go·8 214µs ± 2% 210µs ± 3% ~ (p=0.310 n=5+5)
neo/go/sqlite-zwrk.go·12 341µs ± 3% 324µs ± 2% -5.15% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·16 462µs ± 2% 441µs ± 2% -4.63% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 86.7µs ± 1% 87.2µs ± 1% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 100µs ± 0% 100µs ± 0% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 109µs ± 0% 109µs ± 0% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 120µs ± 0% 119µs ± 2% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 206µs ± 2% 200µs ± 1% -2.89% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 330µs ± 1% 316µs ± 0% -4.15% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 455µs ± 2% 436µs ± 1% -4.11% (p=0.008 n=5+5)

31d87ace

X z6001: localhost timings, C > C1 disabled, zwrk@1s · 5685f384

Kirill Smelkov authored Mar 09, 2018

Like on neo1, comparing to Cenabled run, even when there each zwrk was
run for 10s, similarly to previous measure with Cstates disabled
(65de70b8) it shows clear improvment:

---- 8< ----
cluster:z6001 dataset:wczblk1-8
zeo/py/fs1-zwrk.go·1 217µs ± 3% 195µs ± 1% -10.29% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 306µs ± 6% 220µs ± 1% -27.99% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·1 395µs ±11% 276µs ± 3% -30.18% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·2 514µs ± 5% 470µs ± 4% -8.50% (p=0.016 n=5+5)
neo/py(!log)/sql-zwrk.go·3 741µs ± 3% 699µs ± 0% -5.64% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·4 1.02ms ± 7% 0.95ms ± 5% -6.66% (p=0.032 n=5+5)
neo/py(!log)/sql-zwrk.go·8 2.00ms ± 7% 1.91ms ± 1% -4.52% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·12 2.94ms ± 3% 2.87ms ± 3% ~ (p=0.056 n=5+5)
neo/py(!log)/sql-zwrk.go·16 4.04ms ±11% 3.80ms ± 1% -5.78% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·1 203µs ± 3% 139µs ± 1% -31.68% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·2 167µs ± 0% 147µs ± 0% -12.19% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·3 158µs ± 0% 150µs ± 1% -5.38% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·4 163µs ± 0% 156µs ± 0% -4.11% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 178µs ± 1% 129µs ± 1% -27.30% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 153µs ± 1% 136µs ± 1% -11.08% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 149µs ± 0% 138µs ± 0% -6.78% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 149µs ± 0% 142µs ± 0% -4.85% (p=0.008 n=5+5)

cluster:z6001 dataset:prod1-1024
zeo/py/fs1-zwrk.go·1 186µs ± 4% 163µs ± 1% -12.16% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 273µs ± 4% 204µs ± 1% -25.07% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·1 365µs ±11% 275µs ± 7% -24.47% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·2 524µs ± 5% 460µs ± 0% -12.15% (p=0.016 n=5+4)
neo/py(!log)/sql-zwrk.go·3 754µs ±10% 689µs ± 1% -8.64% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·4 975µs ±11% 927µs ± 0% -4.98% (p=0.016 n=5+4)
neo/py(!log)/sql-zwrk.go·8 1.92ms ± 2% 1.83ms ± 1% -4.53% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·12 2.95ms ± 9% 2.73ms ± 1% -7.65% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·16 4.12ms ± 8% 3.69ms ± 1% -10.36% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·1 174µs ± 3% 126µs ± 2% -27.44% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·2 149µs ± 0% 136µs ± 1% -9.09% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·3 147µs ± 0% 141µs ± 0% -4.28% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 169µs ± 3% 122µs ± 2% -27.64% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 147µs ± 0% 132µs ± 1% -10.22% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 144µs ± 1% 136µs ± 0% -5.05% (p=0.008 n=5+5)
---- 8< ----

not to mention that zhash.{py,go}, for which runtime was not changed,
are also improved/denoised like it was in 65de70b8, thus confirming
timings from there:

---- 8< ----
cluster:z6001 dataset:wczblk1-8
fs1-zhash.go+prefetch128 8.35µs ± 2% 7.34µs ± 5% -12.10% (p=0.016 n=4+5)
zeo/py/fs1-zhash.py 675µs ± 5% 590µs ± 4% -12.51% (p=0.008 n=5+5)
zeo/py/fs1-zhash.go 267µs ± 7% 201µs ± 3% -24.73% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zhash.py 673µs ± 8% 482µs ± 4% -28.32% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zhash.go 291µs ±11% 222µs ± 1% -23.78% (p=0.008 n=5+5)
neo/py(!log)/sql-zhash.py 958µs ±28% 529µs ± 4% -44.74% (p=0.016 n=5+4)
neo/py(!log)/sql-zhash.go 441µs ± 6% 275µs ± 1% -37.68% (p=0.008 n=5+5)
neo/go/fs1-zhash.py 509µs ±15% 342µs ± 2% -32.79% (p=0.008 n=5+5)
neo/go/fs1-zhash.go 106µs ± 8% 91µs ± 2% -14.00% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zhash.go(!sha1) 76.2µs ± 8% 68.8µs ± 3% -9.79% (p=0.016 n=5+5)
neo/go/sqlite-zhash.py 531µs ± 9% 373µs ± 7% -29.80% (p=0.008 n=5+5)
neo/go/sqlite-zhash.go 200µs ±13% 143µs ± 3% -28.59% (p=0.008 n=5+5)
neo/go/sqlite-zhash.go(!sha1) 185µs ±14% 133µs ± 5% -28.19% (p=0.008 n=5+5)

cluster:z6001 dataset:prod1-1024
zeo/py/fs1-zhash.py 646µs ± 3% 555µs ± 2% -14.12% (p=0.008 n=5+5)
zeo/py/fs1-zhash.go 233µs ± 3% 169µs ± 1% -27.63% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zhash.py 653µs ± 7% 467µs ± 4% -28.50% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zhash.go 261µs ± 6% 205µs ± 0% -21.60% (p=0.008 n=5+5)
neo/py(!log)/sql-zhash.py 961µs ±38% 518µs ± 2% -46.11% (p=0.016 n=5+4)
neo/py(!log)/sql-zhash.go 363µs ±12% 267µs ± 1% -26.59% (p=0.008 n=5+5)
neo/py(!log)/sql-zhash.go+prefetch128 262µs ±11% 226µs ± 9% -13.79% (p=0.016 n=5+5)
neo/go/fs1-zhash.py 490µs ± 8% 320µs ±11% -34.68% (p=0.008 n=5+5)
neo/go/fs1-zhash.go 81.4µs ± 5% 76.3µs ± 3% -6.34% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zhash.go(!sha1) 70.5µs ± 6% 64.8µs ± 2% -8.03% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 21.0µs ± 2% 20.5µs ± 3% -2.38% (p=0.048 n=5+5)
neo/go/sqlite-zhash.py 521µs ± 6% 378µs ± 4% -27.44% (p=0.008 n=5+5)
neo/go/sqlite-zhash.go 168µs ±10% 129µs ± 3% -23.43% (p=0.008 n=5+5)
neo/go/sqlite-zhash.go(!sha1) 167µs ±14% 125µs ± 5% -25.50% (p=0.008 n=5+5)
---- 8< ----

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

$ benchstat -split node,cluster,dataset 20180308-z6001-ffixed-c-zwrk10s.txt 20180308-z6001-ffixed-noc_C1$3µs$-zwrk1s.txt

name old pystone/s new pystone/s delta
node:z6001
pystone 114k ± 1% 115k ± 1% ~ (p=0.310 n=5+5)

name old time/op new time/op delta
node:z6001
crc32/py/4K 5.10µs ± 0% 5.12µs ± 2% ~ (p=0.690 n=5+5)
crc32/go/4K 1.77µs ± 8% 1.72µs ± 0% ~ (p=0.651 n=5+4)
sha1/py/4K 14.6µs ± 0% 14.7µs ± 1% +0.38% (p=0.016 n=4+5)
sha1/go/4K 10.3µs ± 0% 10.3µs ± 0% ~ (p=0.143 n=4+4)
unzlib/py/wczdata 36.4µs ± 1% 36.5µs ± 1% ~ (p=0.310 n=5+5)
unzlib/go/wczdata 31.5µs ± 0% 31.2µs ± 0% -0.95% (p=0.008 n=5+5)
unzlib/py/prod1-avg 18.4µs ± 3% 18.6µs ± 1% ~ (p=0.413 n=5+4)
unzlib/go/prod1-avg 10.0µs ± 1% 9.9µs ± 1% ~ (p=0.151 n=5+5)
disk/randread/direct/4K-min 133µs ± 6% 127µs ± 1% ~ (p=0.460 n=5+5)
disk/randread/direct/4K-avg 201µs ± 6% 168µs ± 0% -16.39% (p=0.008 n=5+5)
disk/randread/pagecache/4K-min 797ns ± 2% 788ns ± 1% ~ (p=0.333 n=5+5)
disk/randread/pagecache/4K-avg 1.40µs ± 7% 1.50µs ± 3% ~ (p=0.063 n=5+5)

name old time/object new time/object delta
cluster:z6001 dataset:wczblk1-8
fs1-zhash.py 37.4µs ± 2% 37.6µs ± 1% ~ (p=0.389 n=5+5)
fs1-zhash.go 6.04µs ± 1% 5.98µs ± 2% ~ (p=0.397 n=5+5)
fs1-zhash.go+prefetch128 8.35µs ± 2% 7.34µs ± 5% -12.10% (p=0.016 n=4+5)
zeo/py/fs1-zhash.py 675µs ± 5% 590µs ± 4% -12.51% (p=0.008 n=5+5)
zeo/py/fs1-zhash.go 267µs ± 7% 201µs ± 3% -24.73% (p=0.008 n=5+5)
zeo/py/fs1-zhash.go+prefetch128 101µs ± 2% 102µs ± 2% ~ (p=0.444 n=5+5)
neo/py(!log)/sqlite-zhash.py 673µs ± 8% 482µs ± 4% -28.32% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zhash.go 291µs ±11% 222µs ± 1% -23.78% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zhash.go+prefetch128 176µs ± 1% 179µs ± 2% ~ (p=0.222 n=5+5)
neo/py(!log)/sql-zhash.py 958µs ±28% 529µs ± 4% -44.74% (p=0.016 n=5+4)
neo/py(!log)/sql-zhash.go 441µs ± 6% 275µs ± 1% -37.68% (p=0.008 n=5+5)
neo/py(!log)/sql-zhash.go+prefetch128 269µs ±15% 237µs ± 5% ~ (p=0.222 n=5+5)
neo/go/fs1-zhash.py 509µs ±15% 342µs ± 2% -32.79% (p=0.008 n=5+5)
neo/go/fs1-zhash.go 106µs ± 8% 91µs ± 2% -14.00% (p=0.008 n=5+5)
neo/go/fs1-zhash.go+prefetch128 37.1µs ± 6% 36.6µs ± 2% ~ (p=0.651 n=5+5)
neo/go/fs1(!sha1)-zhash.go(!sha1) 76.2µs ± 8% 68.8µs ± 3% -9.79% (p=0.016 n=5+5)
neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 26.0µs ± 2% 26.5µs ± 3% ~ (p=0.135 n=5+5)
neo/go/sqlite-zhash.py 531µs ± 9% 373µs ± 7% -29.80% (p=0.008 n=5+5)
neo/go/sqlite-zhash.go 200µs ±13% 143µs ± 3% -28.59% (p=0.008 n=5+5)
neo/go/sqlite-zhash.go+prefetch128 39.9µs ± 2% 39.0µs ± 5% ~ (p=0.381 n=5+5)
neo/go/sqlite-zhash.go(!sha1) 185µs ±14% 133µs ± 5% -28.19% (p=0.008 n=5+5)
neo/go/sqlite-zhash.go+prefetch128(!sha1) 37.2µs ± 6% 36.6µs ± 5% ~ (p=0.548 n=5+5)
cluster:z6001 dataset:prod1-1024
fs1-zhash.py 30.2µs ± 2% 30.5µs ± 2% ~ (p=0.349 n=5+5)
fs1-zhash.go 4.60µs ± 0% 4.60µs ± 0% ~ (all equal)
fs1-zhash.go+prefetch128 5.70µs ± 7% 5.44µs ± 3% ~ (p=0.119 n=5+5)
zeo/py/fs1-zhash.py 646µs ± 3% 555µs ± 2% -14.12% (p=0.008 n=5+5)
zeo/py/fs1-zhash.go 233µs ± 3% 169µs ± 1% -27.63% (p=0.008 n=5+5)
zeo/py/fs1-zhash.go+prefetch128 87.5µs ± 3% 88.4µs ± 2% ~ (p=0.651 n=5+5)
neo/py(!log)/sqlite-zhash.py 653µs ± 7% 467µs ± 4% -28.50% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zhash.go 261µs ± 6% 205µs ± 0% -21.60% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zhash.go+prefetch128 161µs ± 2% 161µs ± 1% ~ (p=0.952 n=5+5)
neo/py(!log)/sql-zhash.py 961µs ±38% 518µs ± 2% -46.11% (p=0.016 n=5+4)
neo/py(!log)/sql-zhash.go 363µs ±12% 267µs ± 1% -26.59% (p=0.008 n=5+5)
neo/py(!log)/sql-zhash.go+prefetch128 262µs ±11% 226µs ± 9% -13.79% (p=0.016 n=5+5)
neo/go/fs1-zhash.py 490µs ± 8% 320µs ±11% -34.68% (p=0.008 n=5+5)
neo/go/fs1-zhash.go 81.4µs ± 5% 76.3µs ± 3% -6.34% (p=0.008 n=5+5)
neo/go/fs1-zhash.go+prefetch128 23.9µs ± 2% 23.6µs ± 2% ~ (p=0.230 n=5+5)
neo/go/fs1(!sha1)-zhash.go(!sha1) 70.5µs ± 6% 64.8µs ± 2% -8.03% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 21.0µs ± 2% 20.5µs ± 3% -2.38% (p=0.048 n=5+5)
neo/go/sqlite-zhash.py 521µs ± 6% 378µs ± 4% -27.44% (p=0.008 n=5+5)
neo/go/sqlite-zhash.go 168µs ±10% 129µs ± 3% -23.43% (p=0.008 n=5+5)
neo/go/sqlite-zhash.go+prefetch128 35.1µs ± 3% 34.8µs ± 2% ~ (p=0.690 n=5+5)
neo/go/sqlite-zhash.go(!sha1) 167µs ±14% 125µs ± 5% -25.50% (p=0.008 n=5+5)
neo/go/sqlite-zhash.go+prefetch128(!sha1) 35.0µs ± 2% 34.5µs ± 1% ~ (p=0.214 n=5+5)

name old req/s new req/s delta
cluster:z6001 dataset:wczblk1-8
fs1-zwrk.go·1 229k ± 2% 231k ± 1% ~ (p=0.421 n=5+5)
fs1-zwrk.go·2 438k ± 0% 446k ± 2% ~ (p=0.056 n=5+5)
fs1-zwrk.go·3 665k ± 1% 659k ± 2% ~ (p=0.548 n=5+5)
fs1-zwrk.go·4 868k ± 1% 876k ± 2% ~ (p=0.222 n=5+5)
fs1-zwrk.go·8 1.75M ± 1% 1.75M ± 1% ~ (p=0.841 n=5+5)
fs1-zwrk.go·12 2.57M ± 1% 2.53M ± 2% ~ (p=0.095 n=5+5)
fs1-zwrk.go·16 2.90M ± 1% 2.91M ± 1% ~ (p=0.095 n=5+5)
zeo/py/fs1-zwrk.go·1 4.61k ± 3% 5.14k ± 1% +11.45% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·2 6.31k ± 2% 6.35k ± 0% ~ (p=0.730 n=5+4)
zeo/py/fs1-zwrk.go·3 6.98k ± 2% 7.08k ± 0% ~ (p=0.222 n=5+5)
zeo/py/fs1-zwrk.go·4 7.11k ± 3% 7.19k ± 2% ~ (p=0.548 n=5+5)
zeo/py/fs1-zwrk.go·8 7.41k ± 4% 7.54k ± 2% ~ (p=0.222 n=5+5)
zeo/py/fs1-zwrk.go·12 7.63k ± 1% 7.57k ± 2% ~ (p=0.222 n=5+5)
zeo/py/fs1-zwrk.go·16 7.65k ± 3% 7.66k ± 2% ~ (p=0.841 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 3.27k ± 6% 4.54k ± 1% +38.70% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 5.64k ± 2% 5.68k ± 2% ~ (p=0.548 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 5.57k ± 3% 5.70k ± 2% ~ (p=0.056 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 5.59k ± 3% 5.65k ± 1% ~ (p=0.548 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 5.63k ± 2% 5.64k ± 1% ~ (p=0.841 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 5.57k ± 3% 5.60k ± 6% ~ (p=0.310 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 5.63k ± 2% 5.55k ± 4% ~ (p=0.310 n=5+5)
neo/py(!log)/sql-zwrk.go·1 2.55k ±11% 3.62k ± 3% +42.42% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·2 3.89k ± 5% 4.26k ± 4% +9.26% (p=0.016 n=5+5)
neo/py(!log)/sql-zwrk.go·3 4.05k ± 3% 4.29k ± 0% +5.95% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·4 3.93k ± 6% 4.21k ± 4% +7.06% (p=0.032 n=5+5)
neo/py(!log)/sql-zwrk.go·8 4.02k ± 7% 4.20k ± 1% +4.56% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·12 4.08k ± 3% 4.19k ± 3% ~ (p=0.056 n=5+5)
neo/py(!log)/sql-zwrk.go·16 3.98k ±10% 4.21k ± 1% +5.85% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·1 10.6k ± 2% 11.1k ± 3% +4.24% (p=0.032 n=5+5)
neo/go/fs1-zwrk.go·2 22.4k ± 0% 23.0k ± 1% +2.86% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·3 31.8k ± 0% 32.2k ± 0% +1.23% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·4 43.1k ± 0% 43.5k ± 0% +0.86% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·8 78.1k ± 0% 78.3k ± 0% ~ (p=0.095 n=5+5)
neo/go/fs1-zwrk.go·12 92.4k ± 0% 92.5k ± 0% ~ (p=0.310 n=5+5)
neo/go/fs1-zwrk.go·16 102k ± 0% 102k ± 0% ~ (p=0.421 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 15.2k ± 1% 15.0k ± 6% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 31.4k ± 0% 31.8k ± 1% +1.20% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 43.8k ± 0% 44.1k ± 0% +0.81% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 57.6k ± 0% 57.9k ± 1% +0.56% (p=0.032 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 100k ± 0% 100k ± 0% ~ (p=0.151 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 116k ± 0% 116k ± 0% +0.43% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 126k ± 0% 126k ± 0% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go·1 4.92k ± 3% 7.20k ± 1% +46.31% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·2 12.0k ± 0% 13.7k ± 0% +13.89% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·3 18.9k ± 0% 20.0k ± 1% +5.69% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·4 24.6k ± 0% 25.7k ± 0% +4.29% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·8 44.3k ± 1% 45.3k ± 0% +2.21% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·12 55.5k ± 1% 56.4k ± 0% +1.60% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·16 58.0k ± 0% 58.2k ± 1% ~ (p=0.095 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 5.62k ± 1% 7.73k ± 1% +37.54% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 13.1k ± 1% 14.7k ± 1% +12.47% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 20.2k ± 0% 21.7k ± 0% +7.27% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 26.9k ± 0% 28.2k ± 0% +5.09% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 47.7k ± 1% 49.0k ± 0% +2.68% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 59.7k ± 1% 60.5k ± 0% +1.26% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 62.8k ± 0% 61.9k ± 0% -1.48% (p=0.008 n=5+5)
cluster:z6001 dataset:prod1-1024
fs1-zwrk.go·1 349k ± 0% 349k ± 1% ~ (p=0.690 n=5+5)
fs1-zwrk.go·2 659k ± 2% 672k ± 1% ~ (p=0.095 n=5+5)
fs1-zwrk.go·3 990k ± 3% 982k ± 2% ~ (p=0.310 n=5+5)
fs1-zwrk.go·4 1.31M ± 1% 1.29M ± 7% ~ (p=0.690 n=5+5)
fs1-zwrk.go·8 2.52M ± 1% 2.53M ± 3% ~ (p=0.690 n=5+5)
fs1-zwrk.go·12 2.81M ± 1% 3.05M ± 1% +8.30% (p=0.008 n=5+5)
fs1-zwrk.go·16 2.86M ± 0% 3.06M ± 1% +6.87% (p=0.016 n=4+5)
zeo/py/fs1-zwrk.go·1 5.39k ± 4% 6.13k ± 1% +13.78% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·2 8.20k ± 1% 8.21k ± 2% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·3 8.93k ± 2% 9.03k ± 2% ~ (p=0.421 n=5+5)
zeo/py/fs1-zwrk.go·4 9.34k ± 4% 9.37k ± 2% ~ (p=0.841 n=5+5)
zeo/py/fs1-zwrk.go·8 9.93k ± 3% 9.85k ± 5% ~ (p=0.841 n=5+5)
zeo/py/fs1-zwrk.go·12 9.43k ±16% 9.57k ± 9% ~ (p=0.690 n=5+5)
zeo/py/fs1-zwrk.go·16 10.1k ± 4% 10.3k ± 1% ~ (p=0.151 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 3.67k ± 4% 4.90k ± 1% +33.35% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 5.82k ± 0% 5.90k ± 0% +1.38% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 5.78k ± 0% 5.86k ± 1% ~ (p=0.056 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 5.67k ± 3% 5.75k ± 0% ~ (p=0.190 n=5+4)
neo/py(!log)/sqlite-zwrk.go·8 5.80k ± 2% 5.84k ± 1% ~ (p=0.548 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 5.85k ± 2% 5.51k ± 6% -5.93% (p=0.024 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 5.78k ± 3% 5.71k ± 1% ~ (p=0.310 n=5+5)
neo/py(!log)/sql-zwrk.go·1 2.75k ±10% 3.64k ± 7% +32.25% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·2 3.83k ± 5% 4.35k ± 0% +13.62% (p=0.016 n=5+4)
neo/py(!log)/sql-zwrk.go·3 3.99k ± 9% 4.36k ± 2% +9.20% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·4 4.11k ±10% 4.32k ± 0% +4.92% (p=0.016 n=5+4)
neo/py(!log)/sql-zwrk.go·8 4.18k ± 2% 4.37k ± 1% +4.73% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·12 4.07k ± 9% 4.40k ± 1% +7.95% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·16 3.90k ± 8% 4.34k ± 1% +11.34% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·1 13.7k ± 0% 14.2k ± 1% +3.69% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·2 28.0k ± 0% 28.5k ± 1% +1.73% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·3 40.3k ± 0% 40.6k ± 0% +0.85% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·4 52.8k ± 0% 53.2k ± 1% +0.77% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·8 91.0k ± 0% 90.1k ± 1% -1.06% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·12 98.3k ± 1% 96.0k ± 1% -2.30% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·16 101k ± 3% 91k ± 1% -9.91% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 16.1k ± 1% 16.4k ± 1% +1.47% (p=0.016 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 32.9k ± 0% 33.4k ± 1% +1.65% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 46.2k ± 0% 46.7k ± 0% +1.11% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 60.1k ± 0% 60.4k ± 0% +0.60% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 100k ± 0% 99k ± 1% -0.70% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 106k ± 1% 103k ± 1% -3.32% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 110k ± 1% 97k ± 1% -11.30% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·1 5.74k ± 3% 7.92k ± 2% +37.81% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·2 13.4k ± 0% 14.7k ± 1% +10.00% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·3 20.4k ± 0% 21.3k ± 0% +4.48% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·4 26.8k ± 1% 27.5k ± 1% +2.60% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·8 45.6k ± 1% 44.9k ± 1% -1.38% (p=0.032 n=5+5)
neo/go/sqlite-zwrk.go·12 53.9k ± 1% 52.3k ± 0% -2.91% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·16 50.5k ± 1% 48.4k ± 1% -4.22% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 5.92k ± 3% 8.17k ± 2% +38.16% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 13.6k ± 0% 15.2k ± 1% +11.39% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 20.9k ± 1% 22.0k ± 0% +5.32% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 27.6k ± 0% 28.2k ± 0% +2.12% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 46.7k ± 2% 45.3k ± 0% -2.97% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 55.2k ± 1% 52.0k ± 1% -5.91% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 51.5k ± 2% 48.4k ± 1% -5.99% (p=0.008 n=5+5)

name old latency-time/object new latency-time/object delta
cluster:z6001 dataset:wczblk1-8
fs1-zwrk.go·1 4.38µs ± 2% 4.33µs ± 1% ~ (p=0.421 n=5+5)
fs1-zwrk.go·2 4.56µs ± 0% 4.49µs ± 2% ~ (p=0.056 n=5+5)
fs1-zwrk.go·3 4.51µs ± 1% 4.56µs ± 2% ~ (p=0.548 n=5+5)
fs1-zwrk.go·4 4.61µs ± 1% 4.57µs ± 2% ~ (p=0.222 n=5+5)
fs1-zwrk.go·8 4.56µs ± 1% 4.56µs ± 1% ~ (p=0.841 n=5+5)
fs1-zwrk.go·12 4.67µs ± 1% 4.75µs ± 2% ~ (p=0.095 n=5+5)
fs1-zwrk.go·16 5.52µs ± 1% 5.49µs ± 1% ~ (p=0.095 n=5+5)
zeo/py/fs1-zwrk.go·1 217µs ± 3% 195µs ± 1% -10.29% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·2 317µs ± 2% 315µs ± 0% ~ (p=0.730 n=5+4)
zeo/py/fs1-zwrk.go·3 430µs ± 2% 424µs ± 0% ~ (p=0.222 n=5+5)
zeo/py/fs1-zwrk.go·4 563µs ± 3% 556µs ± 2% ~ (p=0.548 n=5+5)
zeo/py/fs1-zwrk.go·8 1.08ms ± 4% 1.06ms ± 2% ~ (p=0.222 n=5+5)
zeo/py/fs1-zwrk.go·12 1.57ms ± 1% 1.58ms ± 2% ~ (p=0.222 n=5+5)
zeo/py/fs1-zwrk.go·16 2.09ms ± 3% 2.09ms ± 2% ~ (p=0.841 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 306µs ± 6% 220µs ± 1% -27.99% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 355µs ± 2% 352µs ± 2% ~ (p=0.548 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 539µs ± 4% 526µs ± 2% ~ (p=0.056 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 715µs ± 3% 708µs ± 1% ~ (p=0.548 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 1.42ms ± 2% 1.42ms ± 1% ~ (p=0.841 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 2.16ms ± 3% 2.15ms ± 6% ~ (p=0.310 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 2.84ms ± 2% 2.89ms ± 4% ~ (p=0.310 n=5+5)
neo/py(!log)/sql-zwrk.go·1 395µs ±11% 276µs ± 3% -30.18% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·2 514µs ± 5% 470µs ± 4% -8.50% (p=0.016 n=5+5)
neo/py(!log)/sql-zwrk.go·3 741µs ± 3% 699µs ± 0% -5.64% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·4 1.02ms ± 7% 0.95ms ± 5% -6.66% (p=0.032 n=5+5)
neo/py(!log)/sql-zwrk.go·8 2.00ms ± 7% 1.91ms ± 1% -4.52% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·12 2.94ms ± 3% 2.87ms ± 3% ~ (p=0.056 n=5+5)
neo/py(!log)/sql-zwrk.go·16 4.04ms ±11% 3.80ms ± 1% -5.78% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·1 94.3µs ± 2% 90.5µs ± 3% -4.03% (p=0.032 n=5+5)
neo/go/fs1-zwrk.go·2 89.4µs ± 0% 86.9µs ± 1% -2.78% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·3 94.4µs ± 0% 93.2µs ± 0% -1.21% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·4 92.7µs ± 0% 91.9µs ± 0% -0.85% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·8 102µs ± 0% 102µs ± 0% ~ (p=0.095 n=5+5)
neo/go/fs1-zwrk.go·12 130µs ± 0% 130µs ± 0% ~ (p=0.310 n=5+5)
neo/go/fs1-zwrk.go·16 156µs ± 0% 156µs ± 0% ~ (p=0.452 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 65.9µs ± 1% 66.6µs ± 6% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 63.6µs ± 0% 62.9µs ± 1% -1.19% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 68.5µs ± 0% 68.0µs ± 0% -0.80% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 69.4µs ± 0% 69.0µs ± 1% -0.55% (p=0.032 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 80.1µs ± 0% 79.8µs ± 0% ~ (p=0.151 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 104µs ± 0% 103µs ± 0% -0.42% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 127µs ± 0% 127µs ± 0% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go·1 203µs ± 3% 139µs ± 1% -31.68% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·2 167µs ± 0% 147µs ± 0% -12.19% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·3 158µs ± 0% 150µs ± 1% -5.38% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·4 163µs ± 0% 156µs ± 0% -4.11% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·8 181µs ± 1% 177µs ± 0% -2.17% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·12 216µs ± 1% 213µs ± 0% -1.57% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·16 276µs ± 0% 275µs ± 1% ~ (p=0.095 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 178µs ± 1% 129µs ± 1% -27.30% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 153µs ± 1% 136µs ± 1% -11.08% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 149µs ± 0% 138µs ± 0% -6.78% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 149µs ± 0% 142µs ± 0% -4.85% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 168µs ± 1% 163µs ± 0% -2.61% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 201µs ± 1% 198µs ± 0% -1.25% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 255µs ± 0% 259µs ± 0% +1.51% (p=0.008 n=5+5)
cluster:z6001 dataset:prod1-1024
fs1-zwrk.go·1 2.87µs ± 0% 2.87µs ± 1% ~ (p=0.683 n=5+5)
fs1-zwrk.go·2 3.04µs ± 2% 2.98µs ± 1% ~ (p=0.095 n=5+5)
fs1-zwrk.go·3 3.03µs ± 3% 3.05µs ± 2% ~ (p=0.310 n=5+5)
fs1-zwrk.go·4 3.06µs ± 1% 3.10µs ± 7% ~ (p=0.651 n=5+5)
fs1-zwrk.go·8 3.18µs ± 1% 3.16µs ± 3% ~ (p=0.690 n=5+5)
fs1-zwrk.go·12 4.26µs ± 1% 3.94µs ± 1% -7.65% (p=0.008 n=5+5)
fs1-zwrk.go·16 5.59µs ± 0% 5.23µs ± 1% -6.43% (p=0.016 n=4+5)
zeo/py/fs1-zwrk.go·1 186µs ± 4% 163µs ± 1% -12.16% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·2 244µs ± 1% 244µs ± 2% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·3 336µs ± 2% 332µs ± 2% ~ (p=0.421 n=5+5)
zeo/py/fs1-zwrk.go·4 428µs ± 4% 427µs ± 2% ~ (p=0.841 n=5+5)
zeo/py/fs1-zwrk.go·8 806µs ± 3% 813µs ± 5% ~ (p=0.841 n=5+5)
zeo/py/fs1-zwrk.go·12 1.29ms ±17% 1.26ms ± 9% ~ (p=0.690 n=5+5)
zeo/py/fs1-zwrk.go·16 1.59ms ± 4% 1.55ms ± 1% ~ (p=0.151 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 273µs ± 4% 204µs ± 1% -25.07% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 344µs ± 0% 339µs ± 0% -1.36% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 519µs ± 0% 512µs ± 1% ~ (p=0.056 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 705µs ± 3% 695µs ± 0% ~ (p=0.190 n=5+4)
neo/py(!log)/sqlite-zwrk.go·8 1.38ms ± 2% 1.37ms ± 1% ~ (p=0.548 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 2.05ms ± 2% 2.18ms ± 6% +6.50% (p=0.032 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 2.77ms ± 3% 2.80ms ± 1% ~ (p=0.310 n=5+5)
neo/py(!log)/sql-zwrk.go·1 365µs ±11% 275µs ± 7% -24.47% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·2 524µs ± 5% 460µs ± 0% -12.15% (p=0.016 n=5+4)
neo/py(!log)/sql-zwrk.go·3 754µs ±10% 689µs ± 1% -8.64% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·4 975µs ±11% 927µs ± 0% -4.98% (p=0.016 n=5+4)
neo/py(!log)/sql-zwrk.go·8 1.92ms ± 2% 1.83ms ± 1% -4.53% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·12 2.95ms ± 9% 2.73ms ± 1% -7.65% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·16 4.12ms ± 8% 3.69ms ± 1% -10.36% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·1 72.8µs ± 0% 70.2µs ± 1% -3.56% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·2 71.5µs ± 0% 70.3µs ± 1% -1.70% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·3 74.4µs ± 0% 73.8µs ± 0% -0.85% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·4 75.8µs ± 0% 75.2µs ± 1% -0.76% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·8 87.9µs ± 0% 88.8µs ± 1% +1.07% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·12 122µs ± 1% 125µs ± 1% +2.36% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·16 158µs ± 3% 175µs ± 1% +10.97% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 62.0µs ± 1% 61.1µs ± 1% -1.45% (p=0.016 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 60.8µs ± 0% 59.8µs ± 1% -1.62% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 64.9µs ± 0% 64.2µs ± 0% -1.10% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 66.6µs ± 0% 66.2µs ± 0% -0.60% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 80.3µs ± 0% 80.9µs ± 1% +0.71% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 113µs ± 1% 117µs ± 1% +3.44% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 146µs ± 1% 165µs ± 1% +12.74% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·1 174µs ± 3% 126µs ± 2% -27.44% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·2 149µs ± 0% 136µs ± 1% -9.09% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·3 147µs ± 0% 141µs ± 0% -4.28% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·4 149µs ± 1% 145µs ± 1% -2.53% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·8 176µs ± 1% 178µs ± 1% +1.40% (p=0.032 n=5+5)
neo/go/sqlite-zwrk.go·12 223µs ± 1% 229µs ± 0% +3.00% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·16 317µs ± 1% 331µs ± 1% +4.40% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 169µs ± 3% 122µs ± 2% -27.64% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 147µs ± 0% 132µs ± 1% -10.22% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 144µs ± 1% 136µs ± 0% -5.05% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 145µs ± 0% 142µs ± 0% -2.07% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 171µs ± 2% 177µs ± 0% +3.05% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 217µs ± 1% 231µs ± 1% +6.28% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 311µs ± 2% 331µs ± 1% +6.37% (p=0.008 n=5+5)

5685f384

X z6001: localhost timings, Cenabled, zwrk@10s · 20788052

Kirill Smelkov authored Mar 09, 2018

Compared to zwrk@1 it helps, but only a tiny bit, and the timings are
still noisy:

---- 8< ----
cluster:z6001 dataset:wczblk1-8
neo/py(!log)/sql-zwrk.go·8 2.21ms ±11% 2.00ms ± 7% -9.61% (p=0.032 n=5+5)
neo/py(!log)/sql-zwrk.go·12 3.31ms ± 6% 2.94ms ± 3% -11.20% (p=0.008 n=5+5)

cluster:z6001 dataset:prod1-1024
zeo/py/fs1-zwrk.go·1 204µs ± 6% 186µs ± 4% -9.09% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·3 818µs ± 8% 754µs ±10% -7.83% (p=0.032 n=5+5)
neo/go/fs1-zwrk.go·16 178µs ± 1% 158µs ± 3% -11.35% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 164µs ± 2% 146µs ± 1% -11.22% (p=0.008 n=5+5)
---- 8< ----

The help is much less compared to the signidican speedup with Cstates
disabled (65de70b8).

The next commit will add remeasurements with C-states disabled.

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

$ benchstat -split node,cluster,dataset 20180308-z6001-ffixed-c-zwrk1s.txt 20180308-z6001-ffixed-c-zwrk10s.txt

name old pystone/s new pystone/s delta
node:z6001
pystone 114k ± 1% 114k ± 1% ~ (p=0.690 n=5+5)

name old time/op new time/op delta
node:z6001
crc32/py/4K 5.10µs ± 0% 5.10µs ± 0% ~ (p=0.587 n=5+5)
crc32/go/4K 1.72µs ± 0% 1.77µs ± 8% ~ (p=0.381 n=4+5)
sha1/py/4K 14.6µs ± 0% 14.6µs ± 0% ~ (p=0.556 n=5+4)
sha1/go/4K 10.3µs ± 0% 10.3µs ± 0% ~ (p=0.714 n=5+4)
unzlib/py/wczdata 36.2µs ± 1% 36.4µs ± 1% ~ (p=0.548 n=5+5)
unzlib/go/wczdata 31.5µs ± 0% 31.5µs ± 0% ~ (p=0.310 n=5+5)
unzlib/py/prod1-avg 18.2µs ± 1% 18.4µs ± 3% ~ (p=0.222 n=5+5)
unzlib/go/prod1-avg 10.0µs ± 2% 10.0µs ± 1% ~ (p=0.548 n=5+5)
disk/randread/direct/4K-min 129µs ± 4% 133µs ± 6% ~ (p=0.841 n=5+5)
disk/randread/direct/4K-avg 201µs ± 7% 201µs ± 6% ~ (p=0.794 n=5+5)
disk/randread/pagecache/4K-min 793ns ± 2% 797ns ± 2% ~ (p=0.548 n=5+5)
disk/randread/pagecache/4K-avg 1.41µs ± 4% 1.40µs ± 7% ~ (p=0.881 n=5+5)

name old time/object new time/object delta
cluster:z6001 dataset:wczblk1-8
fs1-zhash.py 37.5µs ± 1% 37.4µs ± 2% ~ (p=0.897 n=5+5)
fs1-zhash.go 5.90µs ± 0% 6.04µs ± 1% +2.37% (p=0.008 n=5+5)
fs1-zhash.go+prefetch128 8.10µs ± 5% 8.35µs ± 2% ~ (p=0.286 n=5+4)
zeo/py/fs1-zhash.py 661µs ± 8% 675µs ± 5% ~ (p=0.841 n=5+5)
zeo/py/fs1-zhash.go 267µs ± 8% 267µs ± 7% ~ (p=1.000 n=5+5)
zeo/py/fs1-zhash.go+prefetch128 102µs ± 1% 101µs ± 2% ~ (p=0.397 n=5+5)
neo/py(!log)/sqlite-zhash.py 692µs ± 4% 673µs ± 8% ~ (p=0.310 n=5+5)
neo/py(!log)/sqlite-zhash.go 309µs ±15% 291µs ±11% ~ (p=0.310 n=5+5)
neo/py(!log)/sqlite-zhash.go+prefetch128 176µs ± 1% 176µs ± 1% ~ (p=0.548 n=5+5)
neo/py(!log)/sql-zhash.py 992µs ±31% 958µs ±28% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zhash.go 377µs ±16% 441µs ± 6% +16.96% (p=0.016 n=5+5)
neo/py(!log)/sql-zhash.go+prefetch128 268µs ±12% 269µs ±15% ~ (p=1.000 n=5+5)
neo/go/fs1-zhash.py 482µs ±20% 509µs ±15% ~ (p=0.548 n=5+5)
neo/go/fs1-zhash.go 102µs ± 9% 106µs ± 8% ~ (p=0.310 n=5+5)
neo/go/fs1-zhash.go+prefetch128 37.2µs ± 2% 37.1µs ± 6% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zhash.go(!sha1) 73.1µs ±12% 76.2µs ± 8% ~ (p=0.421 n=5+5)
neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 26.9µs ± 7% 26.0µs ± 2% ~ (p=0.198 n=5+5)
neo/go/sqlite-zhash.py 525µs ±10% 531µs ± 9% ~ (p=1.000 n=5+5)
neo/go/sqlite-zhash.go 193µs ±16% 200µs ±13% ~ (p=0.548 n=5+5)
neo/go/sqlite-zhash.go+prefetch128 39.6µs ± 4% 39.9µs ± 2% ~ (p=0.690 n=5+5)
neo/go/sqlite-zhash.go(!sha1) 195µs ±25% 185µs ±14% ~ (p=0.690 n=5+5)
neo/go/sqlite-zhash.go+prefetch128(!sha1) 36.7µs ± 3% 37.2µs ± 6% ~ (p=0.452 n=5+5)
cluster:z6001 dataset:prod1-1024
fs1-zhash.py 30.3µs ± 2% 30.2µs ± 2% ~ (p=0.738 n=5+5)
fs1-zhash.go 4.56µs ± 1% 4.60µs ± 0% ~ (p=0.444 n=5+5)
fs1-zhash.go+prefetch128 5.96µs ± 9% 5.70µs ± 7% ~ (p=0.397 n=5+5)
zeo/py/fs1-zhash.py 615µs ±13% 646µs ± 3% ~ (p=0.222 n=5+5)
zeo/py/fs1-zhash.go 235µs ± 6% 233µs ± 3% ~ (p=1.000 n=5+5)
zeo/py/fs1-zhash.go+prefetch128 87.6µs ± 1% 87.5µs ± 3% ~ (p=0.802 n=5+5)
neo/py(!log)/sqlite-zhash.py 658µs ± 5% 653µs ± 7% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zhash.go 256µs ± 8% 261µs ± 6% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zhash.go+prefetch128 161µs ± 0% 161µs ± 2% ~ (p=0.659 n=5+5)
neo/py(!log)/sql-zhash.py 1.02ms ±33% 0.96ms ±38% ~ (p=0.310 n=5+5)
neo/py(!log)/sql-zhash.go 385µs ± 8% 363µs ±12% ~ (p=0.222 n=5+5)
neo/py(!log)/sql-zhash.go+prefetch128 263µs ±11% 262µs ±11% ~ (p=0.690 n=5+5)
neo/go/fs1-zhash.py 461µs ±16% 490µs ± 8% ~ (p=0.421 n=5+5)
neo/go/fs1-zhash.go 82.9µs ± 5% 81.4µs ± 5% ~ (p=0.341 n=5+5)
neo/go/fs1-zhash.go+prefetch128 23.9µs ± 3% 23.9µs ± 2% ~ (p=0.810 n=5+5)
neo/go/fs1(!sha1)-zhash.go(!sha1) 69.7µs ±11% 70.5µs ± 6% ~ (p=0.548 n=5+5)
neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 21.0µs ± 2% 21.0µs ± 2% ~ (p=0.762 n=5+5)
neo/go/sqlite-zhash.py 541µs ± 9% 521µs ± 6% ~ (p=0.310 n=5+5)
neo/go/sqlite-zhash.go 181µs ±13% 168µs ±10% ~ (p=0.310 n=5+5)
neo/go/sqlite-zhash.go+prefetch128 35.5µs ± 2% 35.1µs ± 3% ~ (p=0.452 n=5+5)
neo/go/sqlite-zhash.go(!sha1) 162µs ±14% 167µs ±14% ~ (p=0.548 n=5+5)
neo/go/sqlite-zhash.go+prefetch128(!sha1) 35.3µs ± 1% 35.0µs ± 2% ~ (p=0.794 n=5+5)

name old req/s new req/s delta
cluster:z6001 dataset:wczblk1-8
fs1-zwrk.go·1 228k ± 3% 229k ± 2% ~ (p=0.841 n=5+5)
fs1-zwrk.go·2 444k ± 1% 438k ± 0% -1.35% (p=0.016 n=5+5)
fs1-zwrk.go·3 660k ± 3% 665k ± 1% ~ (p=1.000 n=5+5)
fs1-zwrk.go·4 882k ± 1% 868k ± 1% -1.54% (p=0.016 n=5+5)
fs1-zwrk.go·8 1.75M ± 2% 1.75M ± 1% ~ (p=1.000 n=5+5)
fs1-zwrk.go·12 2.50M ± 3% 2.57M ± 1% +2.64% (p=0.032 n=5+5)
fs1-zwrk.go·16 2.88M ± 1% 2.90M ± 1% ~ (p=0.151 n=5+5)
zeo/py/fs1-zwrk.go·1 4.44k ± 6% 4.61k ± 3% ~ (p=0.095 n=5+5)
zeo/py/fs1-zwrk.go·2 6.32k ± 0% 6.31k ± 2% ~ (p=0.690 n=5+5)
zeo/py/fs1-zwrk.go·3 6.89k ± 0% 6.98k ± 2% ~ (p=0.135 n=5+5)
zeo/py/fs1-zwrk.go·4 7.15k ± 1% 7.11k ± 3% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·8 7.46k ± 2% 7.41k ± 4% ~ (p=0.690 n=5+5)
zeo/py/fs1-zwrk.go·12 7.55k ± 1% 7.63k ± 1% ~ (p=0.063 n=5+5)
zeo/py/fs1-zwrk.go·16 7.55k ± 1% 7.65k ± 3% ~ (p=0.310 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 3.74k ±12% 3.27k ± 6% ~ (p=0.056 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 5.59k ± 1% 5.64k ± 2% ~ (p=0.222 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 5.58k ± 1% 5.57k ± 3% ~ (p=0.310 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 5.54k ± 1% 5.59k ± 3% ~ (p=0.310 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 5.65k ± 0% 5.63k ± 2% ~ (p=0.222 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 5.59k ± 0% 5.57k ± 3% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 5.58k ± 1% 5.63k ± 2% ~ (p=0.151 n=5+5)
neo/py(!log)/sql-zwrk.go·1 2.61k ± 5% 2.55k ±11% ~ (p=0.690 n=5+5)
neo/py(!log)/sql-zwrk.go·2 3.88k ±11% 3.89k ± 5% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zwrk.go·3 3.80k ±12% 4.05k ± 3% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·4 3.85k ± 5% 3.93k ± 6% ~ (p=0.690 n=5+5)
neo/py(!log)/sql-zwrk.go·8 3.64k ±12% 4.02k ± 7% +10.28% (p=0.032 n=5+5)
neo/py(!log)/sql-zwrk.go·12 3.62k ± 6% 4.08k ± 3% +12.51% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·16 3.92k ±13% 3.98k ±10% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·1 10.6k ± 5% 10.6k ± 2% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·2 22.4k ± 1% 22.4k ± 0% ~ (p=0.310 n=5+5)
neo/go/fs1-zwrk.go·3 31.9k ± 1% 31.8k ± 0% ~ (p=0.095 n=5+5)
neo/go/fs1-zwrk.go·4 43.2k ± 0% 43.1k ± 0% ~ (p=0.310 n=5+5)
neo/go/fs1-zwrk.go·8 78.2k ± 0% 78.1k ± 0% ~ (p=0.548 n=5+5)
neo/go/fs1-zwrk.go·12 92.3k ± 0% 92.4k ± 0% ~ (p=0.151 n=5+5)
neo/go/fs1-zwrk.go·16 102k ± 1% 102k ± 0% ~ (p=0.690 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 15.0k ± 4% 15.2k ± 1% ~ (p=0.310 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 31.4k ± 1% 31.4k ± 0% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 43.9k ± 0% 43.8k ± 0% ~ (p=0.421 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 57.6k ± 0% 57.6k ± 0% ~ (p=0.635 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 100k ± 0% 100k ± 0% -0.33% (p=0.032 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 116k ± 0% 116k ± 0% -0.44% (p=0.032 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 126k ± 0% 126k ± 0% -0.28% (p=0.032 n=5+5)
neo/go/sqlite-zwrk.go·1 5.06k ± 8% 4.92k ± 3% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go·2 11.9k ± 2% 12.0k ± 0% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go·3 19.0k ± 1% 18.9k ± 0% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go·4 24.6k ± 1% 24.6k ± 0% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go·8 44.8k ± 0% 44.3k ± 1% -1.06% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·12 56.3k ± 0% 55.5k ± 1% -1.29% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·16 58.2k ± 0% 58.0k ± 0% ~ (p=0.056 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 5.71k ± 8% 5.62k ± 1% ~ (p=0.794 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 13.2k ± 3% 13.1k ± 1% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 20.4k ± 1% 20.2k ± 0% -0.96% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 27.1k ± 1% 26.9k ± 0% -1.07% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 48.3k ± 0% 47.7k ± 1% -1.13% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 60.2k ± 0% 59.7k ± 1% -0.85% (p=0.032 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 61.7k ± 0% 62.8k ± 0% +1.77% (p=0.008 n=5+5)
cluster:z6001 dataset:prod1-1024
fs1-zwrk.go·1 347k ± 2% 349k ± 0% ~ (p=0.690 n=5+5)
fs1-zwrk.go·2 662k ± 1% 659k ± 2% ~ (p=0.841 n=5+5)
fs1-zwrk.go·3 982k ± 1% 990k ± 3% ~ (p=0.548 n=5+5)
fs1-zwrk.go·4 1.30M ± 2% 1.31M ± 1% ~ (p=0.310 n=5+5)
fs1-zwrk.go·8 2.56M ± 2% 2.52M ± 1% -1.81% (p=0.032 n=5+5)
fs1-zwrk.go·12 2.83M ± 1% 2.81M ± 1% ~ (p=1.000 n=5+5)
fs1-zwrk.go·16 2.82M ± 1% 2.86M ± 0% +1.58% (p=0.016 n=5+4)
zeo/py/fs1-zwrk.go·1 4.90k ± 6% 5.39k ± 4% +9.97% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·2 8.11k ± 0% 8.20k ± 1% +1.11% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·3 9.07k ± 2% 8.93k ± 2% ~ (p=0.310 n=5+5)
zeo/py/fs1-zwrk.go·4 9.36k ± 0% 9.34k ± 4% ~ (p=0.690 n=5+5)
zeo/py/fs1-zwrk.go·8 10.0k ± 2% 9.9k ± 3% ~ (p=0.548 n=5+5)
zeo/py/fs1-zwrk.go·12 10.2k ± 2% 9.4k ±16% ~ (p=1.000 n=4+5)
zeo/py/fs1-zwrk.go·16 10.3k ± 2% 10.1k ± 4% ~ (p=0.151 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 3.80k ±13% 3.67k ± 4% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 5.80k ± 0% 5.82k ± 0% ~ (p=0.151 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 5.57k ± 8% 5.78k ± 0% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 5.80k ± 0% 5.67k ± 3% -2.26% (p=0.016 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 5.78k ± 2% 5.80k ± 2% ~ (p=0.548 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 5.77k ± 0% 5.85k ± 2% ~ (p=0.151 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 5.80k ± 0% 5.78k ± 3% ~ (p=0.690 n=5+5)
neo/py(!log)/sql-zwrk.go·1 2.74k ±24% 2.75k ±10% ~ (p=0.548 n=5+5)
neo/py(!log)/sql-zwrk.go·2 3.69k ± 8% 3.83k ± 5% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·3 3.68k ± 8% 3.99k ± 9% +8.34% (p=0.032 n=5+5)
neo/py(!log)/sql-zwrk.go·4 3.80k ±10% 4.11k ±10% ~ (p=0.095 n=5+5)
neo/py(!log)/sql-zwrk.go·8 3.94k ±12% 4.18k ± 2% ~ (p=0.310 n=5+5)
neo/py(!log)/sql-zwrk.go·12 4.04k ±12% 4.07k ± 9% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zwrk.go·16 3.82k ±10% 3.90k ± 8% ~ (p=0.690 n=5+5)
neo/go/fs1-zwrk.go·1 13.7k ± 4% 13.7k ± 0% ~ (p=0.690 n=5+5)
neo/go/fs1-zwrk.go·2 28.0k ± 0% 28.0k ± 0% ~ (p=0.151 n=5+5)
neo/go/fs1-zwrk.go·3 40.2k ± 0% 40.3k ± 0% ~ (p=0.548 n=5+5)
neo/go/fs1-zwrk.go·4 52.8k ± 0% 52.8k ± 0% ~ (p=1.000 n=5+5)
neo/go/fs1-zwrk.go·8 90.5k ± 0% 91.0k ± 0% +0.61% (p=0.016 n=5+5)
neo/go/fs1-zwrk.go·12 95.9k ± 1% 98.3k ± 1% +2.47% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·16 89.9k ± 1% 101.4k ± 3% +12.84% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 16.2k ± 3% 16.1k ± 1% ~ (p=0.151 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 33.0k ± 0% 32.9k ± 0% -0.47% (p=0.032 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 46.1k ± 1% 46.2k ± 0% ~ (p=0.151 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 60.2k ± 0% 60.1k ± 0% ~ (p=0.690 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 99.2k ± 1% 99.6k ± 0% ~ (p=0.095 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 103k ± 0% 106k ± 1% +3.11% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 97.3k ± 2% 109.6k ± 1% +12.63% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·1 5.79k ± 8% 5.74k ± 3% ~ (p=0.548 n=5+5)
neo/go/sqlite-zwrk.go·2 13.3k ± 1% 13.4k ± 0% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go·3 20.3k ± 1% 20.4k ± 0% ~ (p=0.056 n=5+5)
neo/go/sqlite-zwrk.go·4 26.4k ± 1% 26.8k ± 1% +1.42% (p=0.016 n=5+5)
neo/go/sqlite-zwrk.go·8 44.7k ± 0% 45.6k ± 1% +2.04% (p=0.016 n=4+5)
neo/go/sqlite-zwrk.go·12 52.6k ± 0% 53.9k ± 1% +2.38% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·16 48.6k ± 1% 50.5k ± 1% +3.98% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 5.81k ±12% 5.92k ± 3% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 13.1k ± 3% 13.6k ± 0% +3.75% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 20.5k ± 1% 20.9k ± 1% +1.84% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 27.2k ± 2% 27.6k ± 0% +1.50% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 45.3k ± 0% 46.7k ± 2% +3.11% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 53.3k ± 1% 55.2k ± 1% +3.56% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 49.9k ± 1% 51.5k ± 2% +3.18% (p=0.008 n=5+5)

name old latency-time/object new latency-time/object delta
cluster:z6001 dataset:wczblk1-8
fs1-zwrk.go·1 4.39µs ± 4% 4.38µs ± 2% ~ (p=0.841 n=5+5)
fs1-zwrk.go·2 4.50µs ± 1% 4.56µs ± 0% +1.36% (p=0.016 n=5+5)
fs1-zwrk.go·3 4.55µs ± 3% 4.51µs ± 1% ~ (p=1.000 n=5+5)
fs1-zwrk.go·4 4.54µs ± 1% 4.61µs ± 1% +1.56% (p=0.016 n=5+5)
fs1-zwrk.go·8 4.57µs ± 2% 4.56µs ± 1% ~ (p=1.000 n=5+5)
fs1-zwrk.go·12 4.80µs ± 3% 4.67µs ± 1% -2.60% (p=0.024 n=5+5)
fs1-zwrk.go·16 5.56µs ± 1% 5.52µs ± 1% ~ (p=0.135 n=5+5)
zeo/py/fs1-zwrk.go·1 225µs ± 6% 217µs ± 3% ~ (p=0.095 n=5+5)
zeo/py/fs1-zwrk.go·2 317µs ± 0% 317µs ± 2% ~ (p=0.690 n=5+5)
zeo/py/fs1-zwrk.go·3 435µs ± 0% 430µs ± 2% ~ (p=0.151 n=5+5)
zeo/py/fs1-zwrk.go·4 559µs ± 1% 563µs ± 3% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·8 1.07ms ± 2% 1.08ms ± 4% ~ (p=0.690 n=5+5)
zeo/py/fs1-zwrk.go·12 1.59ms ± 1% 1.57ms ± 1% ~ (p=0.056 n=5+5)
zeo/py/fs1-zwrk.go·16 2.12ms ± 1% 2.09ms ± 3% ~ (p=0.310 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 269µs ±12% 306µs ± 6% ~ (p=0.056 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 358µs ± 1% 355µs ± 2% ~ (p=0.222 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 537µs ± 1% 539µs ± 4% ~ (p=0.310 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 721µs ± 1% 715µs ± 3% ~ (p=0.310 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 1.42ms ± 0% 1.42ms ± 2% ~ (p=0.222 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 2.15ms ± 0% 2.16ms ± 3% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 2.87ms ± 1% 2.84ms ± 2% ~ (p=0.151 n=5+5)
neo/py(!log)/sql-zwrk.go·1 384µs ± 5% 395µs ±11% ~ (p=0.690 n=5+5)
neo/py(!log)/sql-zwrk.go·2 518µs ±11% 514µs ± 5% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zwrk.go·3 795µs ±13% 741µs ± 3% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·4 1.04ms ± 5% 1.02ms ± 7% ~ (p=0.690 n=5+5)
neo/py(!log)/sql-zwrk.go·8 2.21ms ±11% 2.00ms ± 7% -9.61% (p=0.032 n=5+5)
neo/py(!log)/sql-zwrk.go·12 3.31ms ± 6% 2.94ms ± 3% -11.20% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·16 4.10ms ±15% 4.04ms ±11% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·1 94.0µs ± 5% 94.3µs ± 2% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·2 89.1µs ± 1% 89.4µs ± 0% ~ (p=0.310 n=5+5)
neo/go/fs1-zwrk.go·3 94.0µs ± 1% 94.4µs ± 0% ~ (p=0.095 n=5+5)
neo/go/fs1-zwrk.go·4 92.7µs ± 0% 92.7µs ± 0% ~ (p=0.310 n=5+5)
neo/go/fs1-zwrk.go·8 102µs ± 0% 102µs ± 0% ~ (p=0.548 n=5+5)
neo/go/fs1-zwrk.go·12 130µs ± 0% 130µs ± 0% ~ (p=0.151 n=5+5)
neo/go/fs1-zwrk.go·16 156µs ± 1% 156µs ± 0% ~ (p=0.690 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 66.5µs ± 4% 65.9µs ± 1% ~ (p=0.310 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 63.6µs ± 1% 63.6µs ± 0% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 68.4µs ± 0% 68.5µs ± 0% ~ (p=0.421 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 69.4µs ± 0% 69.4µs ± 0% ~ (p=0.635 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 79.8µs ± 0% 80.1µs ± 0% +0.33% (p=0.032 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 103µs ± 0% 104µs ± 0% +0.45% (p=0.032 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 127µs ± 0% 127µs ± 0% +0.28% (p=0.032 n=5+5)
neo/go/sqlite-zwrk.go·1 198µs ± 8% 203µs ± 3% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go·2 169µs ± 2% 167µs ± 0% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go·3 158µs ± 1% 158µs ± 0% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go·4 162µs ± 1% 163µs ± 0% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go·8 179µs ± 0% 181µs ± 1% +1.07% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·12 213µs ± 0% 216µs ± 1% +1.31% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·16 275µs ± 0% 276µs ± 0% ~ (p=0.056 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 175µs ± 8% 178µs ± 1% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 152µs ± 3% 153µs ± 1% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 147µs ± 1% 149µs ± 0% +0.96% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 147µs ± 1% 149µs ± 0% +1.08% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 166µs ± 0% 168µs ± 1% +1.14% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 199µs ± 0% 201µs ± 1% +0.86% (p=0.032 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 259µs ± 0% 255µs ± 0% -1.74% (p=0.008 n=5+5)
cluster:z6001 dataset:prod1-1024
fs1-zwrk.go·1 2.88µs ± 2% 2.87µs ± 0% ~ (p=0.651 n=5+5)
fs1-zwrk.go·2 3.02µs ± 1% 3.04µs ± 2% ~ (p=0.794 n=5+5)
fs1-zwrk.go·3 3.05µs ± 1% 3.03µs ± 3% ~ (p=0.548 n=5+5)
fs1-zwrk.go·4 3.08µs ± 2% 3.06µs ± 1% ~ (p=0.310 n=5+5)
fs1-zwrk.go·8 3.12µs ± 2% 3.18µs ± 1% +1.83% (p=0.032 n=5+5)
fs1-zwrk.go·12 4.25µs ± 1% 4.26µs ± 1% ~ (p=1.000 n=5+5)
fs1-zwrk.go·16 5.68µs ± 1% 5.59µs ± 0% -1.57% (p=0.016 n=5+4)
zeo/py/fs1-zwrk.go·1 204µs ± 6% 186µs ± 4% -9.09% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·2 247µs ± 0% 244µs ± 1% -1.09% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·3 331µs ± 2% 336µs ± 2% ~ (p=0.310 n=5+5)
zeo/py/fs1-zwrk.go·4 427µs ± 0% 428µs ± 4% ~ (p=0.690 n=5+5)
zeo/py/fs1-zwrk.go·8 801µs ± 2% 806µs ± 3% ~ (p=0.548 n=5+5)
zeo/py/fs1-zwrk.go·12 1.17ms ± 2% 1.29ms ±17% ~ (p=1.000 n=4+5)
zeo/py/fs1-zwrk.go·16 1.55ms ± 2% 1.59ms ± 4% ~ (p=0.151 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 265µs ±12% 273µs ± 4% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 345µs ± 0% 344µs ± 0% ~ (p=0.151 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 540µs ± 8% 519µs ± 0% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 689µs ± 0% 705µs ± 3% +2.35% (p=0.016 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 1.38ms ± 2% 1.38ms ± 2% ~ (p=0.548 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 2.08ms ± 0% 2.05ms ± 2% ~ (p=0.151 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 2.76ms ± 0% 2.77ms ± 3% ~ (p=0.690 n=5+5)
neo/py(!log)/sql-zwrk.go·1 372µs ±21% 365µs ±11% ~ (p=0.548 n=5+5)
neo/py(!log)/sql-zwrk.go·2 543µs ± 8% 524µs ± 5% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·3 818µs ± 8% 754µs ±10% -7.83% (p=0.032 n=5+5)
neo/py(!log)/sql-zwrk.go·4 1.06ms ±10% 0.98ms ±11% ~ (p=0.095 n=5+5)
neo/py(!log)/sql-zwrk.go·8 2.05ms ±13% 1.92ms ± 2% ~ (p=0.310 n=5+5)
neo/py(!log)/sql-zwrk.go·12 2.98ms ±13% 2.95ms ± 9% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zwrk.go·16 4.20ms ±10% 4.12ms ± 8% ~ (p=0.690 n=5+5)
neo/go/fs1-zwrk.go·1 73.3µs ± 4% 72.8µs ± 0% ~ (p=0.690 n=5+5)
neo/go/fs1-zwrk.go·2 71.3µs ± 0% 71.5µs ± 0% ~ (p=0.151 n=5+5)
neo/go/fs1-zwrk.go·3 74.5µs ± 0% 74.4µs ± 0% ~ (p=0.548 n=5+5)
neo/go/fs1-zwrk.go·4 75.8µs ± 0% 75.8µs ± 0% ~ (p=1.000 n=5+5)
neo/go/fs1-zwrk.go·8 88.4µs ± 0% 87.9µs ± 0% -0.60% (p=0.016 n=5+5)
neo/go/fs1-zwrk.go·12 125µs ± 1% 122µs ± 1% -2.41% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·16 178µs ± 1% 158µs ± 3% -11.35% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 61.6µs ± 3% 62.0µs ± 1% ~ (p=0.151 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 60.5µs ± 0% 60.8µs ± 0% +0.47% (p=0.032 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 65.1µs ± 1% 64.9µs ± 0% ~ (p=0.151 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 66.5µs ± 0% 66.6µs ± 0% ~ (p=0.690 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 80.7µs ± 1% 80.3µs ± 0% ~ (p=0.095 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 116µs ± 0% 113µs ± 1% -3.01% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 164µs ± 2% 146µs ± 1% -11.22% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·1 173µs ± 8% 174µs ± 3% ~ (p=0.548 n=5+5)
neo/go/sqlite-zwrk.go·2 151µs ± 1% 149µs ± 0% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go·3 148µs ± 1% 147µs ± 0% ~ (p=0.056 n=5+5)
neo/go/sqlite-zwrk.go·4 151µs ± 1% 149µs ± 1% -1.41% (p=0.016 n=5+5)
neo/go/sqlite-zwrk.go·8 179µs ± 0% 176µs ± 1% -1.99% (p=0.016 n=4+5)
neo/go/sqlite-zwrk.go·12 228µs ± 0% 223µs ± 1% -2.33% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·16 329µs ± 1% 317µs ± 1% -3.83% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 173µs ±13% 169µs ± 3% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 153µs ± 3% 147µs ± 0% -3.67% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 146µs ± 1% 144µs ± 1% -1.81% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 147µs ± 2% 145µs ± 0% -1.49% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 177µs ± 0% 171µs ± 2% -3.01% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 225µs ± 1% 217µs ± 1% -3.44% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 321µs ± 1% 311µs ± 2% -3.07% (p=0.008 n=5+5)

20788052

X z6001: localhost timings, Cenabled, zwrk@1s · 7f785235

Kirill Smelkov authored Mar 09, 2018

Remeasure with the same sattings as previous z6001 localhost with C-enabled (850bfb9d):

Like on neo1 the data is more or less the same and in particular timings
for either sql backend or python client or even neo/go vs go client are noisy.

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

$ benchstat -split node,cluster,dataset 20180306-z6001-ffixed-c.txt 20180308-z6001-ffixed-c-zwrk1s.txt

name old pystone/s new pystone/s delta
node:z6001
pystone 109k ± 9% 114k ± 1% ~ (p=0.421 n=5+5)

name old time/op new time/op delta
node:z6001
crc32/py/4K 5.11µs ± 1% 5.10µs ± 0% ~ (p=0.968 n=5+5)
crc32/go/4K 1.72µs ± 0% 1.72µs ± 0% ~ (p=1.000 n=4+4)
sha1/py/4K 14.7µs ± 1% 14.6µs ± 0% -0.55% (p=0.032 n=5+5)
sha1/go/4K 10.3µs ± 0% 10.3µs ± 0% ~ (p=0.103 n=5+5)
unzlib/py/wczdata 37.1µs ± 8% 36.2µs ± 1% ~ (p=0.421 n=5+5)
unzlib/go/wczdata 31.5µs ± 0% 31.5µs ± 0% ~ (p=0.889 n=5+5)
unzlib/py/prod1-avg 18.5µs ± 3% 18.2µs ± 1% ~ (p=0.222 n=5+5)
unzlib/go/prod1-avg 10.0µs ± 1% 10.0µs ± 2% ~ (p=0.690 n=5+5)
disk/randread/direct/4K-min 126µs ± 1% 129µs ± 4% +2.33% (p=0.048 n=4+5)
disk/randread/direct/4K-avg 199µs ± 9% 201µs ± 7% ~ (p=1.000 n=5+5)
disk/randread/pagecache/4K-min 806ns ± 3% 793ns ± 2% ~ (p=0.310 n=5+5)
disk/randread/pagecache/4K-avg 1.44µs ± 7% 1.41µs ± 4% ~ (p=0.635 n=5+5)

name old time/object new time/object delta
cluster:z6001 dataset:wczblk1-8
fs1-zhash.py 37.6µs ± 2% 37.5µs ± 1% ~ (p=0.738 n=5+5)
fs1-zhash.go 6.00µs ± 2% 5.90µs ± 0% -1.67% (p=0.048 n=5+5)
fs1-zhash.go+prefetch128 8.00µs ± 5% 8.10µs ± 5% ~ (p=0.659 n=5+5)
zeo/py/fs1-zhash.py 650µs ± 7% 661µs ± 8% ~ (p=0.421 n=5+5)
zeo/py/fs1-zhash.go 274µs ±13% 267µs ± 8% ~ (p=0.841 n=5+5)
zeo/py/fs1-zhash.go+prefetch128 101µs ± 2% 102µs ± 1% ~ (p=0.548 n=5+5)
neo/py(!log)/sqlite-zhash.py 696µs ± 1% 692µs ± 4% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zhash.go 338µs ± 7% 309µs ±15% ~ (p=0.095 n=5+5)
neo/py(!log)/sqlite-zhash.go+prefetch128 177µs ± 1% 176µs ± 1% ~ (p=0.056 n=5+5)
neo/py(!log)/sql-zhash.py 1.00ms ±38% 0.99ms ±31% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zhash.go 434µs ± 6% 377µs ±16% -13.15% (p=0.032 n=5+5)
neo/py(!log)/sql-zhash.go+prefetch128 277µs ± 9% 268µs ±12% ~ (p=0.690 n=5+5)
neo/go/fs1-zhash.py 526µs ± 8% 482µs ±20% ~ (p=0.222 n=5+5)
neo/go/fs1-zhash.go 102µs ± 8% 102µs ± 9% ~ (p=0.841 n=5+5)
neo/go/fs1-zhash.go+prefetch128 36.6µs ± 4% 37.2µs ± 2% ~ (p=0.238 n=5+5)
neo/go/fs1(!sha1)-zhash.go(!sha1) 76.4µs ± 5% 73.1µs ±12% ~ (p=0.151 n=5+5)
neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 26.5µs ± 2% 26.9µs ± 7% ~ (p=0.730 n=5+5)
neo/go/sqlite-zhash.py 528µs ±15% 525µs ±10% ~ (p=1.000 n=5+5)
neo/go/sqlite-zhash.go 204µs ±22% 193µs ±16% ~ (p=0.690 n=5+5)
neo/go/sqlite-zhash.go+prefetch128 39.9µs ± 4% 39.6µs ± 4% ~ (p=0.817 n=5+5)
neo/go/sqlite-zhash.go(!sha1) 194µs ± 9% 195µs ±25% ~ (p=0.690 n=5+5)
neo/go/sqlite-zhash.go+prefetch128(!sha1) 38.2µs ± 7% 36.7µs ± 3% ~ (p=0.151 n=5+5)
cluster:z6001 dataset:prod1-1024
fs1-zhash.py 30.3µs ± 1% 30.3µs ± 2% ~ (p=1.000 n=5+5)
fs1-zhash.go 4.62µs ± 3% 4.56µs ± 1% ~ (p=0.397 n=5+5)
fs1-zhash.go+prefetch128 5.76µs ± 8% 5.96µs ± 9% ~ (p=0.413 n=5+5)
zeo/py/fs1-zhash.py 632µs ±15% 615µs ±13% ~ (p=0.421 n=5+5)
zeo/py/fs1-zhash.go 235µs ± 7% 235µs ± 6% ~ (p=1.000 n=5+5)
zeo/py/fs1-zhash.go+prefetch128 87.2µs ± 1% 87.6µs ± 1% ~ (p=0.270 n=5+5)
neo/py(!log)/sqlite-zhash.py 664µs ± 2% 658µs ± 5% ~ (p=0.310 n=5+5)
neo/py(!log)/sqlite-zhash.go 269µs ± 7% 256µs ± 8% ~ (p=0.151 n=5+5)
neo/py(!log)/sqlite-zhash.go+prefetch128 162µs ± 0% 161µs ± 0% -0.74% (p=0.016 n=4+5)
neo/py(!log)/sql-zhash.py 1.03ms ±29% 1.02ms ±33% ~ (p=0.548 n=5+5)
neo/py(!log)/sql-zhash.go 406µs ± 2% 385µs ± 8% ~ (p=0.095 n=5+5)
neo/py(!log)/sql-zhash.go+prefetch128 268µs ± 5% 263µs ±11% ~ (p=0.690 n=5+5)
neo/go/fs1-zhash.py 520µs ± 9% 461µs ±16% ~ (p=0.222 n=5+5)
neo/go/fs1-zhash.go 83.2µs ± 7% 82.9µs ± 5% ~ (p=1.000 n=5+5)
neo/go/fs1-zhash.go+prefetch128 24.0µs ± 5% 23.9µs ± 3% ~ (p=0.968 n=5+5)
neo/go/fs1(!sha1)-zhash.go(!sha1) 67.0µs ± 3% 69.7µs ±11% ~ (p=0.548 n=5+5)
neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 21.2µs ± 4% 21.0µs ± 2% ~ (p=0.619 n=5+5)
neo/go/sqlite-zhash.py 539µs ±11% 541µs ± 9% ~ (p=1.000 n=5+5)
neo/go/sqlite-zhash.go 196µs ± 9% 181µs ±13% ~ (p=0.151 n=5+5)
neo/go/sqlite-zhash.go+prefetch128 35.0µs ± 3% 35.5µs ± 2% ~ (p=0.238 n=5+5)
neo/go/sqlite-zhash.go(!sha1) 168µs ± 8% 162µs ±14% ~ (p=0.690 n=5+5)
neo/go/sqlite-zhash.go+prefetch128(!sha1) 35.1µs ± 4% 35.3µs ± 1% ~ (p=0.500 n=5+5)

name old req/s new req/s delta
cluster:z6001 dataset:wczblk1-8
fs1-zwrk.go·1 230k ± 1% 228k ± 3% ~ (p=1.000 n=5+5)
fs1-zwrk.go·2 437k ± 5% 444k ± 1% ~ (p=0.310 n=5+5)
fs1-zwrk.go·3 663k ± 4% 660k ± 3% ~ (p=0.548 n=5+5)
fs1-zwrk.go·4 880k ± 1% 882k ± 1% ~ (p=1.000 n=5+5)
fs1-zwrk.go·8 1.75M ± 2% 1.75M ± 2% ~ (p=0.841 n=5+5)
fs1-zwrk.go·12 2.56M ± 0% 2.50M ± 3% -2.26% (p=0.016 n=4+5)
fs1-zwrk.go·16 2.89M ± 1% 2.88M ± 1% ~ (p=0.222 n=5+5)
zeo/py/fs1-zwrk.go·1 4.30k ± 8% 4.44k ± 6% ~ (p=0.421 n=5+5)
zeo/py/fs1-zwrk.go·2 6.33k ± 0% 6.32k ± 0% ~ (p=0.063 n=4+5)
zeo/py/fs1-zwrk.go·3 6.90k ± 0% 6.89k ± 0% ~ (p=0.365 n=4+5)
zeo/py/fs1-zwrk.go·4 7.14k ± 1% 7.15k ± 1% ~ (p=1.000 n=4+5)
zeo/py/fs1-zwrk.go·8 7.53k ± 2% 7.46k ± 2% ~ (p=0.690 n=5+5)
zeo/py/fs1-zwrk.go·12 7.65k ± 0% 7.55k ± 1% ~ (p=0.063 n=4+5)
zeo/py/fs1-zwrk.go·16 7.57k ± 0% 7.55k ± 1% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 3.50k ±15% 3.74k ±12% ~ (p=0.222 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 5.58k ± 0% 5.59k ± 1% ~ (p=1.000 n=4+5)
neo/py(!log)/sqlite-zwrk.go·3 5.63k ± 2% 5.58k ± 1% ~ (p=0.310 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 5.56k ± 1% 5.54k ± 1% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 5.61k ± 2% 5.65k ± 0% ~ (p=0.548 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 5.62k ± 1% 5.59k ± 0% ~ (p=0.222 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 5.62k ± 1% 5.58k ± 1% ~ (p=0.413 n=4+5)
neo/py(!log)/sql-zwrk.go·1 2.53k ±17% 2.61k ± 5% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zwrk.go·2 3.57k ± 9% 3.88k ±11% ~ (p=0.151 n=5+5)
neo/py(!log)/sql-zwrk.go·3 3.65k ±14% 3.80k ±12% ~ (p=0.548 n=5+5)
neo/py(!log)/sql-zwrk.go·4 3.56k ±16% 3.85k ± 5% ~ (p=0.151 n=5+5)
neo/py(!log)/sql-zwrk.go·8 3.78k ±12% 3.64k ±12% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·12 3.73k ±13% 3.62k ± 6% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·16 3.47k ± 9% 3.92k ±13% ~ (p=0.056 n=5+5)
neo/go/fs1-zwrk.go·1 10.7k ± 5% 10.6k ± 5% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·2 22.3k ± 1% 22.4k ± 1% ~ (p=0.421 n=5+5)
neo/go/fs1-zwrk.go·3 31.7k ± 1% 31.9k ± 1% ~ (p=0.151 n=5+5)
neo/go/fs1-zwrk.go·4 43.2k ± 1% 43.2k ± 0% ~ (p=1.000 n=5+5)
neo/go/fs1-zwrk.go·8 78.3k ± 0% 78.2k ± 0% ~ (p=0.151 n=5+5)
neo/go/fs1-zwrk.go·12 92.5k ± 0% 92.3k ± 0% ~ (p=0.421 n=5+5)
neo/go/fs1-zwrk.go·16 103k ± 1% 102k ± 1% ~ (p=0.421 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 15.0k ± 5% 15.0k ± 4% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 31.5k ± 1% 31.4k ± 1% ~ (p=0.421 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 43.8k ± 0% 43.9k ± 0% ~ (p=0.548 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 57.4k ± 0% 57.6k ± 0% ~ (p=0.087 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 100k ± 0% 100k ± 0% ~ (p=0.690 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 116k ± 0% 116k ± 0% ~ (p=0.310 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 126k ± 1% 126k ± 0% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go·1 4.85k ±15% 5.06k ± 8% ~ (p=0.548 n=5+5)
neo/go/sqlite-zwrk.go·2 12.0k ± 2% 11.9k ± 2% ~ (p=0.548 n=5+5)
neo/go/sqlite-zwrk.go·3 19.0k ± 1% 19.0k ± 1% ~ (p=0.548 n=5+5)
neo/go/sqlite-zwrk.go·4 24.7k ± 0% 24.6k ± 1% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go·8 44.8k ± 0% 44.8k ± 0% ~ (p=0.548 n=5+5)
neo/go/sqlite-zwrk.go·12 56.3k ± 0% 56.3k ± 0% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go·16 58.0k ± 0% 58.2k ± 0% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 5.41k ± 4% 5.71k ± 8% ~ (p=0.095 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 12.8k ± 1% 13.2k ± 3% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 20.2k ± 1% 20.4k ± 1% +1.19% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 26.8k ± 1% 27.1k ± 1% +1.11% (p=0.016 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 48.1k ± 1% 48.3k ± 0% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 60.3k ± 0% 60.2k ± 0% ~ (p=0.095 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 61.7k ± 1% 61.7k ± 0% ~ (p=0.548 n=5+5)
cluster:z6001 dataset:prod1-1024
fs1-zwrk.go·1 347k ± 2% 347k ± 2% ~ (p=1.000 n=5+5)
fs1-zwrk.go·2 660k ± 3% 662k ± 1% ~ (p=1.000 n=5+5)
fs1-zwrk.go·3 985k ± 4% 982k ± 1% ~ (p=0.310 n=5+5)
fs1-zwrk.go·4 1.31M ± 2% 1.30M ± 2% ~ (p=0.151 n=5+5)
fs1-zwrk.go·8 2.55M ± 4% 2.56M ± 2% ~ (p=1.000 n=5+5)
fs1-zwrk.go·12 2.81M ± 1% 2.83M ± 1% ~ (p=0.690 n=5+5)
fs1-zwrk.go·16 2.85M ± 2% 2.82M ± 1% ~ (p=0.310 n=5+5)
zeo/py/fs1-zwrk.go·1 4.80k ± 5% 4.90k ± 6% ~ (p=0.421 n=5+5)
zeo/py/fs1-zwrk.go·2 8.18k ± 1% 8.11k ± 0% ~ (p=0.310 n=5+5)
zeo/py/fs1-zwrk.go·3 8.96k ± 1% 9.07k ± 2% ~ (p=0.222 n=5+5)
zeo/py/fs1-zwrk.go·4 8.88k ± 9% 9.36k ± 0% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·8 10.0k ± 2% 10.0k ± 2% ~ (p=0.286 n=4+5)
zeo/py/fs1-zwrk.go·12 9.80k ± 6% 10.22k ± 2% ~ (p=0.063 n=5+4)
zeo/py/fs1-zwrk.go·16 10.1k ± 6% 10.3k ± 2% ~ (p=0.095 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 3.70k ± 6% 3.80k ±13% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 5.77k ± 0% 5.80k ± 0% +0.52% (p=0.016 n=4+5)
neo/py(!log)/sqlite-zwrk.go·3 5.77k ± 0% 5.57k ± 8% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 5.77k ± 0% 5.80k ± 0% +0.67% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 5.84k ± 1% 5.78k ± 2% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 5.78k ± 2% 5.77k ± 0% ~ (p=0.548 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 5.80k ± 1% 5.80k ± 0% ~ (p=0.690 n=5+5)
neo/py(!log)/sql-zwrk.go·1 2.51k ±12% 2.74k ±24% ~ (p=0.548 n=5+5)
neo/py(!log)/sql-zwrk.go·2 3.62k ± 8% 3.69k ± 8% ~ (p=0.548 n=5+5)
neo/py(!log)/sql-zwrk.go·3 3.86k ±11% 3.68k ± 8% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·4 3.82k ±11% 3.80k ±10% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·8 3.89k ±10% 3.94k ±12% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·12 3.98k ± 7% 4.04k ±12% ~ (p=0.690 n=5+5)
neo/py(!log)/sql-zwrk.go·16 3.72k ±13% 3.82k ±10% ~ (p=0.690 n=5+5)
neo/go/fs1-zwrk.go·1 13.8k ± 3% 13.7k ± 4% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·2 28.1k ± 0% 28.0k ± 0% ~ (p=0.690 n=5+5)
neo/go/fs1-zwrk.go·3 40.2k ± 0% 40.2k ± 0% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·4 52.8k ± 1% 52.8k ± 0% ~ (p=1.000 n=5+5)
neo/go/fs1-zwrk.go·8 90.6k ± 0% 90.5k ± 0% ~ (p=0.421 n=5+5)
neo/go/fs1-zwrk.go·12 95.8k ± 1% 95.9k ± 1% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·16 90.9k ± 1% 89.9k ± 1% ~ (p=0.151 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 16.2k ± 2% 16.2k ± 3% ~ (p=0.548 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 32.9k ± 1% 33.0k ± 0% ~ (p=0.151 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 46.2k ± 0% 46.1k ± 1% ~ (p=0.151 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 59.8k ± 1% 60.2k ± 0% ~ (p=0.095 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 98.1k ± 0% 99.2k ± 1% +1.06% (p=0.016 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 102k ± 1% 103k ± 0% +1.27% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 97.0k ± 2% 97.3k ± 2% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go·1 5.67k ± 8% 5.79k ± 8% ~ (p=0.548 n=5+5)
neo/go/sqlite-zwrk.go·2 13.3k ± 2% 13.3k ± 1% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go·3 20.3k ± 1% 20.3k ± 1% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go·4 26.5k ± 0% 26.4k ± 1% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go·8 44.5k ± 1% 44.7k ± 0% ~ (p=0.111 n=5+4)
neo/go/sqlite-zwrk.go·12 52.3k ± 1% 52.6k ± 0% ~ (p=0.095 n=5+5)
neo/go/sqlite-zwrk.go·16 48.9k ± 1% 48.6k ± 1% ~ (p=0.310 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 5.69k ± 4% 5.81k ±12% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 13.2k ± 3% 13.1k ± 3% ~ (p=0.548 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 20.5k ± 1% 20.5k ± 1% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 27.1k ± 2% 27.2k ± 2% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 45.4k ± 1% 45.3k ± 0% ~ (p=0.222 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 53.3k ± 1% 53.3k ± 1% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 49.8k ± 1% 49.9k ± 1% ~ (p=0.690 n=5+5)

name old latency-time/object new latency-time/object delta
cluster:z6001 dataset:wczblk1-8
fs1-zwrk.go·1 4.34µs ± 1% 4.39µs ± 4% ~ (p=1.000 n=5+5)
fs1-zwrk.go·2 4.58µs ± 5% 4.50µs ± 1% ~ (p=0.310 n=5+5)
fs1-zwrk.go·3 4.52µs ± 4% 4.55µs ± 3% ~ (p=0.444 n=5+5)
fs1-zwrk.go·4 4.55µs ± 1% 4.54µs ± 1% ~ (p=1.000 n=5+5)
fs1-zwrk.go·8 4.58µs ± 2% 4.57µs ± 2% ~ (p=0.841 n=5+5)
fs1-zwrk.go·12 4.69µs ± 0% 4.80µs ± 3% +2.35% (p=0.016 n=4+5)
fs1-zwrk.go·16 5.53µs ± 1% 5.56µs ± 1% ~ (p=0.214 n=5+5)
zeo/py/fs1-zwrk.go·1 233µs ± 8% 225µs ± 6% ~ (p=0.421 n=5+5)
zeo/py/fs1-zwrk.go·2 315µs ± 2% 317µs ± 0% +0.55% (p=0.032 n=5+5)
zeo/py/fs1-zwrk.go·3 435µs ± 0% 435µs ± 0% ~ (p=0.413 n=4+5)
zeo/py/fs1-zwrk.go·4 560µs ± 1% 559µs ± 1% ~ (p=1.000 n=4+5)
zeo/py/fs1-zwrk.go·8 1.06ms ± 2% 1.07ms ± 2% ~ (p=0.690 n=5+5)
zeo/py/fs1-zwrk.go·12 1.57ms ± 0% 1.59ms ± 1% ~ (p=0.063 n=4+5)
zeo/py/fs1-zwrk.go·16 2.11ms ± 0% 2.12ms ± 1% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 288µs ±14% 269µs ±12% ~ (p=0.222 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 358µs ± 0% 358µs ± 1% ~ (p=1.000 n=4+5)
neo/py(!log)/sqlite-zwrk.go·3 533µs ± 2% 537µs ± 1% ~ (p=0.310 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 720µs ± 1% 721µs ± 1% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 1.43ms ± 2% 1.42ms ± 0% ~ (p=0.548 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 2.14ms ± 1% 2.15ms ± 0% ~ (p=0.222 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 2.85ms ± 1% 2.87ms ± 1% ~ (p=0.413 n=4+5)
neo/py(!log)/sql-zwrk.go·1 400µs ±16% 384µs ± 5% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zwrk.go·2 562µs ± 8% 518µs ±11% ~ (p=0.151 n=5+5)
neo/py(!log)/sql-zwrk.go·3 827µs ±13% 795µs ±13% ~ (p=0.548 n=5+5)
neo/py(!log)/sql-zwrk.go·4 1.13ms ±14% 1.04ms ± 5% ~ (p=0.151 n=5+5)
neo/py(!log)/sql-zwrk.go·8 2.13ms ±13% 2.21ms ±11% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·12 3.24ms ±12% 3.31ms ± 6% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·16 4.62ms ± 8% 4.10ms ±15% ~ (p=0.056 n=5+5)
neo/go/fs1-zwrk.go·1 93.9µs ± 4% 94.0µs ± 5% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·2 89.6µs ± 1% 89.1µs ± 1% ~ (p=0.421 n=5+5)
neo/go/fs1-zwrk.go·3 94.6µs ± 1% 94.0µs ± 1% ~ (p=0.151 n=5+5)
neo/go/fs1-zwrk.go·4 92.6µs ± 1% 92.7µs ± 0% ~ (p=1.000 n=5+5)
neo/go/fs1-zwrk.go·8 102µs ± 0% 102µs ± 0% ~ (p=0.151 n=5+5)
neo/go/fs1-zwrk.go·12 130µs ± 0% 130µs ± 0% ~ (p=0.421 n=5+5)
neo/go/fs1-zwrk.go·16 156µs ± 1% 156µs ± 1% ~ (p=0.421 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 66.8µs ± 5% 66.5µs ± 4% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 63.5µs ± 1% 63.6µs ± 1% ~ (p=0.421 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 68.5µs ± 0% 68.4µs ± 0% ~ (p=0.548 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 69.7µs ± 0% 69.4µs ± 0% ~ (p=0.087 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 79.7µs ± 0% 79.8µs ± 0% ~ (p=0.690 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 103µs ± 0% 103µs ± 0% ~ (p=0.310 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 127µs ± 1% 127µs ± 0% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go·1 208µs ±14% 198µs ± 8% ~ (p=0.548 n=5+5)
neo/go/sqlite-zwrk.go·2 166µs ± 2% 169µs ± 2% ~ (p=0.548 n=5+5)
neo/go/sqlite-zwrk.go·3 158µs ± 1% 158µs ± 1% ~ (p=0.548 n=5+5)
neo/go/sqlite-zwrk.go·4 162µs ± 0% 162µs ± 1% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go·8 178µs ± 0% 179µs ± 0% ~ (p=0.548 n=5+5)
neo/go/sqlite-zwrk.go·12 213µs ± 0% 213µs ± 0% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go·16 276µs ± 0% 275µs ± 0% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 185µs ± 4% 175µs ± 8% ~ (p=0.095 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 156µs ± 1% 152µs ± 3% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 149µs ± 1% 147µs ± 1% -1.17% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 149µs ± 1% 147µs ± 1% -1.10% (p=0.016 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 166µs ± 1% 166µs ± 0% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 199µs ± 0% 199µs ± 0% ~ (p=0.095 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 259µs ± 1% 259µs ± 0% ~ (p=0.548 n=5+5)
cluster:z6001 dataset:prod1-1024
fs1-zwrk.go·1 2.88µs ± 2% 2.88µs ± 2% ~ (p=1.000 n=5+5)
fs1-zwrk.go·2 3.03µs ± 3% 3.02µs ± 1% ~ (p=0.952 n=5+5)
fs1-zwrk.go·3 3.05µs ± 4% 3.05µs ± 1% ~ (p=0.310 n=5+5)
fs1-zwrk.go·4 3.05µs ± 2% 3.08µs ± 2% ~ (p=0.167 n=5+5)
fs1-zwrk.go·8 3.14µs ± 4% 3.12µs ± 2% ~ (p=1.000 n=5+5)
fs1-zwrk.go·12 4.28µs ± 1% 4.25µs ± 1% ~ (p=0.690 n=5+5)
fs1-zwrk.go·16 5.63µs ± 2% 5.68µs ± 1% ~ (p=0.310 n=5+5)
zeo/py/fs1-zwrk.go·1 208µs ± 5% 204µs ± 6% ~ (p=0.421 n=5+5)
zeo/py/fs1-zwrk.go·2 245µs ± 1% 247µs ± 0% ~ (p=0.310 n=5+5)
zeo/py/fs1-zwrk.go·3 335µs ± 1% 331µs ± 2% ~ (p=0.222 n=5+5)
zeo/py/fs1-zwrk.go·4 453µs ±10% 427µs ± 0% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·8 803µs ± 2% 801µs ± 2% ~ (p=0.286 n=4+5)
zeo/py/fs1-zwrk.go·12 1.23ms ± 6% 1.17ms ± 2% ~ (p=0.063 n=5+4)
zeo/py/fs1-zwrk.go·16 1.59ms ± 6% 1.55ms ± 2% ~ (p=0.095 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 271µs ± 7% 265µs ±12% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 346µs ± 0% 345µs ± 0% -0.51% (p=0.016 n=4+5)
neo/py(!log)/sqlite-zwrk.go·3 520µs ± 0% 540µs ± 8% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 694µs ± 0% 689µs ± 0% -0.67% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 1.37ms ± 1% 1.38ms ± 2% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 2.07ms ± 2% 2.08ms ± 0% ~ (p=0.548 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 2.76ms ± 1% 2.76ms ± 0% ~ (p=0.690 n=5+5)
neo/py(!log)/sql-zwrk.go·1 400µs ±11% 372µs ±21% ~ (p=0.548 n=5+5)
neo/py(!log)/sql-zwrk.go·2 554µs ± 7% 543µs ± 8% ~ (p=0.548 n=5+5)
neo/py(!log)/sql-zwrk.go·3 783µs ±11% 818µs ± 8% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·4 1.06ms ±11% 1.06ms ±10% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·8 2.07ms ± 9% 2.05ms ±13% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·12 3.02ms ± 7% 2.98ms ±13% ~ (p=0.690 n=5+5)
neo/py(!log)/sql-zwrk.go·16 4.32ms ±12% 4.20ms ±10% ~ (p=0.690 n=5+5)
neo/go/fs1-zwrk.go·1 72.6µs ± 3% 73.3µs ± 4% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·2 71.2µs ± 0% 71.3µs ± 0% ~ (p=0.690 n=5+5)
neo/go/fs1-zwrk.go·3 74.6µs ± 0% 74.5µs ± 0% ~ (p=0.881 n=5+5)
neo/go/fs1-zwrk.go·4 75.7µs ± 1% 75.8µs ± 0% ~ (p=1.000 n=5+5)
neo/go/fs1-zwrk.go·8 88.3µs ± 0% 88.4µs ± 0% ~ (p=0.421 n=5+5)
neo/go/fs1-zwrk.go·12 125µs ± 1% 125µs ± 1% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·16 176µs ± 1% 178µs ± 1% ~ (p=0.151 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 61.7µs ± 2% 61.6µs ± 3% ~ (p=0.548 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 60.7µs ± 1% 60.5µs ± 0% ~ (p=0.151 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 64.9µs ± 0% 65.1µs ± 1% ~ (p=0.151 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 66.9µs ± 1% 66.5µs ± 0% ~ (p=0.095 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 81.5µs ± 0% 80.7µs ± 1% -1.05% (p=0.016 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 118µs ± 1% 116µs ± 0% -1.26% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 165µs ± 2% 164µs ± 2% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go·1 177µs ± 8% 173µs ± 8% ~ (p=0.548 n=5+5)
neo/go/sqlite-zwrk.go·2 151µs ± 2% 151µs ± 1% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go·3 148µs ± 1% 148µs ± 1% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go·4 151µs ± 0% 151µs ± 1% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go·8 180µs ± 1% 179µs ± 0% ~ (p=0.111 n=5+4)
neo/go/sqlite-zwrk.go·12 229µs ± 1% 228µs ± 0% ~ (p=0.095 n=5+5)
neo/go/sqlite-zwrk.go·16 327µs ± 1% 329µs ± 1% ~ (p=0.310 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 176µs ± 4% 173µs ±13% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 152µs ± 3% 153µs ± 3% ~ (p=0.548 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 147µs ± 1% 146µs ± 1% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 148µs ± 2% 147µs ± 2% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 176µs ± 1% 177µs ± 0% ~ (p=0.222 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 225µs ± 1% 225µs ± 1% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 321µs ± 1% 321µs ± 1% ~ (p=0.690 n=5+5)

7f785235

X neo1: localhost timings, C > C1 disabled, zwrk@1s · 23f8d82e

Kirill Smelkov authored Mar 09, 2018

Comparing to Cenalbled run, even when there each zwrk was run for 10s,
similarly to previous measure with Cstates disabled (f40c8b4b) it shows
clear improvement:

---- 8< ----
cluster:neo1 dataset:wczblk1-8
zeo/py/fs1-zwrk.go·1 195µs ± 1% 172µs ± 1% -11.98% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 230µs ± 1% 191µs ± 2% -16.86% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·1 305µs ± 7% 244µs ± 6% -19.90% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·2 491µs ± 2% 412µs ± 3% -15.94% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·3 740µs ± 2% 625µs ± 4% -15.61% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·4 976µs ± 2% 837µs ± 1% -14.28% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·8 1.98ms ± 2% 1.69ms ± 7% -14.60% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·12 2.98ms ± 2% 2.57ms ± 6% -13.56% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·16 4.03ms ± 3% 3.42ms ± 9% -14.95% (p=0.008 n=5+5)

cluster:neo1 dataset:prod1-1024
zeo/py/fs1-zwrk.go·1 170µs ± 1% 146µs ± 1% -13.66% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 209µs ± 3% 180µs ± 3% -14.26% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·1 294µs ± 4% 230µs ± 2% -21.61% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·2 483µs ± 2% 405µs ± 4% -16.22% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·3 728µs ± 1% 640µs ± 5% -11.98% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·4 978µs ± 3% 837µs ± 4% -14.42% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·8 1.92ms ± 2% 1.63ms ± 1% -15.10% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·12 2.94ms ± 2% 2.52ms ± 3% -14.18% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·16 3.87ms ± 3% 3.27ms ± 3% -15.56% (p=0.008 n=5+5)
---- 8< ----

not to mention that zhash.{py,go}, for which runtime was not changed,
are also improved like it was in f40c8b4b, thus confirming timings from
there:

---- 8< ----
cluster:neo1 dataset:wczblk1-8
zeo/py/fs1-zhash.py 516µs ± 8% 459µs ± 0% -11.00% (p=0.016 n=5+4)
zeo/py/fs1-zhash.go 200µs ± 4% 174µs ± 2% -12.99% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zhash.py 692µs ± 5% 390µs ± 1% -43.67% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zhash.go 230µs ± 4% 196µs ± 2% -14.72% (p=0.008 n=5+5)
neo/py(!log)/sql-zhash.py 938µs ±50% 459µs ± 1% -51.03% (p=0.016 n=5+4)
neo/py(!log)/sql-zhash.go 310µs ±10% 249µs ± 3% -19.61% (p=0.008 n=5+5)
neo/py(!log)/sql-zhash.go+prefetch128 244µs ± 8% 217µs ± 1% -10.95% (p=0.008 n=5+5)
neo/go/fs1-zhash.py 368µs ±27% 274µs ± 1% -25.36% (p=0.008 n=5+5)
neo/go/sqlite-zhash.py 406µs ± 8% 322µs ± 1% -20.74% (p=0.008 n=5+5)

cluster:neo1 dataset:prod1-1024
zeo/py/fs1-zhash.py 499µs ± 2% 436µs ± 2% -12.61% (p=0.008 n=5+5)
zeo/py/fs1-zhash.go 171µs ± 4% 150µs ± 2% -12.19% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zhash.py 678µs ± 3% 387µs ± 5% -42.91% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zhash.go 211µs ± 6% 185µs ± 4% -12.53% (p=0.008 n=5+5)
neo/py(!log)/sql-zhash.py 922µs ±53% 477µs ±40% -48.31% (p=0.008 n=5+5)
neo/py(!log)/sql-zhash.go 289µs ± 5% 236µs ± 2% -18.35% (p=0.008 n=5+5)
neo/py(!log)/sql-zhash.go+prefetch128 228µs ± 4% 202µs ± 2% -11.68% (p=0.008 n=5+5)
neo/go/fs1-zhash.py 359µs ±15% 267µs ±11% -25.72% (p=0.008 n=5+5)
neo/go/sqlite-zhash.py 396µs ± 4% 312µs ± 1% -21.16% (p=0.008 n=5+5)
---- 8< ----

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

$ benchstat -split node,cluster,dataset 20180308-neo1-ffixed-c-zwrk10s.txt 20180308-neo1-ffixed-noc_C1$3µs$-zwrk1s.txt

name old pystone/s new pystone/s delta
node:neo1
pystone 106k ± 1% 105k ± 0% -1.36% (p=0.008 n=5+5)

name old time/op new time/op delta
node:neo1
crc32/py/4K 5.16µs ± 1% 5.15µs ± 1% ~ (p=0.690 n=5+5)
crc32/go/4K 2.79µs ± 0% 2.79µs ± 0% -0.12% (p=0.029 n=4+4)
sha1/py/4K 13.5µs ± 1% 13.5µs ± 3% ~ (p=0.421 n=5+5)
sha1/go/4K 9.82µs ± 0% 9.81µs ± 0% ~ (p=0.516 n=5+5)
unzlib/py/wczdata 36.1µs ± 1% 35.5µs ± 7% ~ (p=0.690 n=5+5)
unzlib/go/wczdata 31.3µs ± 0% 30.9µs ± 1% -1.22% (p=0.008 n=5+5)
unzlib/py/prod1-avg 16.4µs ± 1% 16.0µs ± 2% ~ (p=0.095 n=5+5)
unzlib/go/prod1-avg 9.41µs ± 1% 9.26µs ± 1% -1.58% (p=0.008 n=5+5)
disk/randread/direct/4K-min 162µs ± 0% 158µs ± 2% -1.99% (p=0.008 n=5+5)
disk/randread/direct/4K-avg 187µs ± 0% 172µs ± 0% -7.92% (p=0.008 n=5+5)
disk/randread/pagecache/4K-min 386ns ± 1% 392ns ± 2% ~ (p=0.190 n=4+5)
disk/randread/pagecache/4K-avg 804ns ± 0% 904ns ± 1% +12.46% (p=0.016 n=4+5)

name old time/object new time/object delta
cluster:neo1 dataset:wczblk1-8
fs1-zhash.py 34.9µs ± 1% 34.7µs ± 2% ~ (p=0.476 n=5+5)
fs1-zhash.go 6.00µs ± 0% 5.90µs ± 0% -1.67% (p=0.029 n=4+4)
fs1-zhash.go+prefetch128 6.58µs ± 2% 6.32µs ± 3% -3.95% (p=0.032 n=5+5)
zeo/py/fs1-zhash.py 516µs ± 8% 459µs ± 0% -11.00% (p=0.016 n=5+4)
zeo/py/fs1-zhash.go 200µs ± 4% 174µs ± 2% -12.99% (p=0.008 n=5+5)
zeo/py/fs1-zhash.go+prefetch128 98.5µs ± 2% 98.5µs ± 2% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zhash.py 692µs ± 5% 390µs ± 1% -43.67% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zhash.go 230µs ± 4% 196µs ± 2% -14.72% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zhash.go+prefetch128 165µs ± 3% 164µs ± 2% ~ (p=0.690 n=5+5)
neo/py(!log)/sql-zhash.py 938µs ±50% 459µs ± 1% -51.03% (p=0.016 n=5+4)
neo/py(!log)/sql-zhash.go 310µs ±10% 249µs ± 3% -19.61% (p=0.008 n=5+5)
neo/py(!log)/sql-zhash.go+prefetch128 244µs ± 8% 217µs ± 1% -10.95% (p=0.008 n=5+5)
neo/go/fs1-zhash.py 368µs ±27% 274µs ± 1% -25.36% (p=0.008 n=5+5)
neo/go/fs1-zhash.go 80.2µs ± 2% 80.4µs ± 4% ~ (p=1.000 n=5+5)
neo/go/fs1-zhash.go+prefetch128 34.8µs ± 5% 35.3µs ± 6% ~ (p=0.690 n=5+5)
neo/go/fs1(!sha1)-zhash.go(!sha1) 56.7µs ± 3% 56.5µs ± 2% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 22.7µs ± 3% 23.2µs ± 7% ~ (p=0.413 n=5+5)
neo/go/sqlite-zhash.py 406µs ± 8% 322µs ± 1% -20.74% (p=0.008 n=5+5)
neo/go/sqlite-zhash.go 125µs ± 2% 134µs ±12% ~ (p=0.548 n=5+5)
neo/go/sqlite-zhash.go+prefetch128 47.9µs ± 5% 49.4µs ± 9% ~ (p=0.548 n=5+5)
neo/go/sqlite-zhash.go(!sha1) 115µs ± 1% 114µs ± 2% ~ (p=0.421 n=5+5)
neo/go/sqlite-zhash.go+prefetch128(!sha1) 47.2µs ±13% 46.3µs ± 5% ~ (p=0.841 n=5+5)
cluster:neo1 dataset:prod1-1024
fs1-zhash.py 29.1µs ± 2% 29.3µs ± 0% ~ (p=0.413 n=5+5)
fs1-zhash.go 3.74µs ± 2% 3.80µs ± 0% ~ (p=0.238 n=5+4)
fs1-zhash.go+prefetch128 3.88µs ± 3% 3.78µs ± 3% ~ (p=0.190 n=5+5)
zeo/py/fs1-zhash.py 499µs ± 2% 436µs ± 2% -12.61% (p=0.008 n=5+5)
zeo/py/fs1-zhash.go 171µs ± 4% 150µs ± 2% -12.19% (p=0.008 n=5+5)
zeo/py/fs1-zhash.go+prefetch128 87.9µs ± 1% 88.0µs ± 1% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zhash.py 678µs ± 3% 387µs ± 5% -42.91% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zhash.go 211µs ± 6% 185µs ± 4% -12.53% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zhash.go+prefetch128 150µs ± 1% 150µs ± 2% ~ (p=0.881 n=5+5)
neo/py(!log)/sql-zhash.py 922µs ±53% 477µs ±40% -48.31% (p=0.008 n=5+5)
neo/py(!log)/sql-zhash.go 289µs ± 5% 236µs ± 2% -18.35% (p=0.008 n=5+5)
neo/py(!log)/sql-zhash.go+prefetch128 228µs ± 4% 202µs ± 2% -11.68% (p=0.008 n=5+5)
neo/go/fs1-zhash.py 359µs ±15% 267µs ±11% -25.72% (p=0.008 n=5+5)
neo/go/fs1-zhash.go 62.1µs ± 0% 60.8µs ± 2% -2.12% (p=0.024 n=5+5)
neo/go/fs1-zhash.go+prefetch128 22.5µs ± 1% 22.2µs ± 1% ~ (p=0.087 n=5+5)
neo/go/fs1(!sha1)-zhash.go(!sha1) 51.4µs ± 4% 52.7µs ± 3% ~ (p=0.056 n=5+5)
neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 18.6µs ± 3% 18.4µs ± 5% ~ (p=0.683 n=5+5)
neo/go/sqlite-zhash.py 396µs ± 4% 312µs ± 1% -21.16% (p=0.008 n=5+5)
neo/go/sqlite-zhash.go 114µs ± 1% 112µs ± 1% -1.48% (p=0.016 n=5+5)
neo/go/sqlite-zhash.go+prefetch128 41.5µs ± 6% 41.2µs ± 7% ~ (p=0.802 n=5+5)
neo/go/sqlite-zhash.go(!sha1) 109µs ± 1% 107µs ± 2% -1.58% (p=0.016 n=5+5)
neo/go/sqlite-zhash.go+prefetch128(!sha1) 41.4µs ± 3% 41.5µs ± 4% ~ (p=0.984 n=5+5)

name old req/s new req/s delta
cluster:neo1 dataset:wczblk1-8
fs1-zwrk.go·1 229k ± 1% 230k ± 0% ~ (p=0.548 n=5+5)
fs1-zwrk.go·2 446k ± 1% 425k ± 7% -4.73% (p=0.008 n=5+5)
fs1-zwrk.go·3 665k ± 1% 660k ± 1% ~ (p=0.056 n=5+5)
fs1-zwrk.go·4 868k ± 1% 869k ± 1% ~ (p=0.730 n=5+4)
fs1-zwrk.go·8 988k ± 1% 996k ± 0% +0.76% (p=0.016 n=5+5)
fs1-zwrk.go·12 1.01M ± 1% 1.01M ± 0% ~ (p=1.000 n=5+5)
fs1-zwrk.go·16 1.01M ± 1% 1.02M ± 0% ~ (p=0.222 n=5+5)
zeo/py/fs1-zwrk.go·1 5.13k ± 1% 5.83k ± 1% +13.62% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·2 6.93k ± 1% 7.21k ± 1% +4.08% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·3 7.54k ± 1% 7.80k ± 3% +3.49% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·4 7.75k ± 1% 8.01k ± 1% +3.29% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·8 8.09k ± 0% 8.46k ± 1% +4.57% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·12 8.46k ± 0% 8.52k ± 2% ~ (p=0.151 n=5+5)
zeo/py/fs1-zwrk.go·16 8.52k ± 0% 8.51k ± 2% ~ (p=0.841 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 4.35k ± 1% 5.23k ± 2% +20.31% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 6.33k ± 2% 6.30k ± 2% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 6.22k ± 4% 6.33k ± 1% ~ (p=0.056 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 6.25k ± 1% 6.30k ± 3% ~ (p=0.222 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 6.25k ± 2% 6.27k ± 3% ~ (p=0.548 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 6.26k ± 2% 6.36k ± 2% ~ (p=0.056 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 6.24k ± 1% 6.33k ± 2% ~ (p=0.095 n=5+5)
neo/py(!log)/sql-zwrk.go·1 3.29k ± 7% 4.10k ± 5% +24.73% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·2 4.08k ± 2% 4.85k ± 2% +18.97% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·3 4.05k ± 2% 4.80k ± 4% +18.54% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·4 4.10k ± 2% 4.78k ± 1% +16.65% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·8 4.04k ± 2% 4.73k ± 7% +17.24% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·12 4.03k ± 2% 4.67k ± 6% +15.80% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·16 3.97k ± 3% 4.68k ± 9% +17.82% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·1 12.9k ± 0% 13.0k ± 1% +1.38% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·2 24.8k ± 1% 25.0k ± 1% +1.00% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·3 32.3k ± 1% 32.4k ± 0% +0.51% (p=0.016 n=5+5)
neo/go/fs1-zwrk.go·4 40.7k ± 1% 40.9k ± 0% ~ (p=0.087 n=5+5)
neo/go/fs1-zwrk.go·8 54.5k ± 1% 54.8k ± 1% ~ (p=0.310 n=5+5)
neo/go/fs1-zwrk.go·12 57.2k ± 1% 57.4k ± 1% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·16 58.3k ± 1% 55.8k ± 1% -4.22% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 19.1k ± 1% 19.3k ± 1% ~ (p=0.310 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 37.7k ± 1% 38.0k ± 1% ~ (p=0.056 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 47.7k ± 1% 48.2k ± 0% +1.00% (p=0.016 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 58.6k ± 1% 59.3k ± 0% +1.29% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 77.6k ± 1% 78.4k ± 0% +1.04% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 83.1k ± 1% 82.7k ± 1% ~ (p=0.222 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 84.9k ± 2% 81.3k ± 2% -4.30% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·1 8.06k ± 0% 8.23k ± 1% +2.09% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·2 14.7k ± 1% 15.0k ± 0% +1.78% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·3 20.3k ± 1% 20.7k ± 0% +1.91% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·4 24.1k ± 1% 24.9k ± 0% +3.24% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·8 30.4k ± 1% 30.9k ± 8% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go·12 30.8k ± 3% 31.3k ± 1% ~ (p=0.095 n=5+5)
neo/go/sqlite-zwrk.go·16 30.1k ± 2% 30.6k ± 3% ~ (p=0.095 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 8.84k ± 0% 9.08k ± 0% +2.62% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 16.1k ± 1% 16.4k ± 0% +2.16% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 22.1k ± 1% 22.7k ± 0% +2.80% (p=0.016 n=5+4)
neo/go/sqlite-zwrk.go(!sha1)·4 26.8k ± 1% 27.8k ± 0% +3.66% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 33.1k ± 2% 34.6k ± 1% +4.43% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 32.9k ± 2% 33.5k ± 1% +1.90% (p=0.032 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 32.1k ± 2% 32.8k ± 2% ~ (p=0.095 n=5+5)
cluster:neo1 dataset:prod1-1024
fs1-zwrk.go·1 453k ± 0% 454k ± 0% ~ (p=0.063 n=5+4)
fs1-zwrk.go·2 891k ± 0% 869k ± 6% ~ (p=0.690 n=5+5)
fs1-zwrk.go·3 1.32M ± 3% 1.33M ± 1% ~ (p=0.548 n=5+5)
fs1-zwrk.go·4 1.77M ± 1% 1.73M ± 2% ~ (p=0.222 n=5+5)
fs1-zwrk.go·8 2.00M ± 2% 1.99M ± 2% ~ (p=0.421 n=5+5)
fs1-zwrk.go·12 2.04M ± 0% 2.03M ± 0% -0.47% (p=0.029 n=4+4)
fs1-zwrk.go·16 2.03M ± 2% 2.04M ± 0% ~ (p=0.421 n=5+5)
zeo/py/fs1-zwrk.go·1 5.90k ± 1% 6.83k ± 1% +15.81% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·2 8.50k ± 0% 8.72k ± 3% ~ (p=0.151 n=5+5)
zeo/py/fs1-zwrk.go·3 9.32k ± 1% 9.26k ± 6% ~ (p=0.690 n=5+5)
zeo/py/fs1-zwrk.go·4 9.70k ± 1% 9.78k ± 3% ~ (p=0.151 n=5+5)
zeo/py/fs1-zwrk.go·8 10.2k ± 2% 10.4k ± 1% +2.11% (p=0.032 n=5+5)
zeo/py/fs1-zwrk.go·12 10.4k ± 0% 10.6k ± 1% +1.42% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·16 10.5k ± 1% 10.5k ± 5% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 4.78k ± 3% 5.57k ± 3% +16.64% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 6.42k ± 2% 6.51k ± 1% +1.40% (p=0.032 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 6.40k ± 2% 6.39k ± 6% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 6.40k ± 1% 6.43k ± 1% ~ (p=0.310 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 6.39k ± 1% 6.33k ± 2% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 6.44k ± 1% 6.30k ± 3% ~ (p=0.151 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 6.38k ± 1% 6.37k ± 3% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·1 3.41k ± 4% 4.34k ± 2% +27.52% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·2 4.14k ± 2% 4.94k ± 4% +19.38% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·3 4.12k ± 1% 4.69k ± 5% +13.72% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·4 4.09k ± 3% 4.78k ± 4% +16.85% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·8 4.18k ± 2% 4.92k ± 1% +17.77% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·12 4.09k ± 2% 4.76k ± 3% +16.56% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·16 4.14k ± 3% 4.90k ± 3% +18.44% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·1 17.2k ± 1% 17.4k ± 1% +1.23% (p=0.032 n=5+5)
neo/go/fs1-zwrk.go·2 32.5k ± 1% 32.9k ± 1% +1.14% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·3 43.0k ± 1% 43.5k ± 0% +0.98% (p=0.016 n=5+4)
neo/go/fs1-zwrk.go·4 52.7k ± 1% 53.2k ± 0% +0.94% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·8 67.3k ± 1% 67.0k ± 2% ~ (p=0.421 n=5+5)
neo/go/fs1-zwrk.go·12 64.9k ± 2% 62.6k ± 3% -3.51% (p=0.016 n=5+5)
neo/go/fs1-zwrk.go·16 57.3k ± 4% 54.3k ±11% ~ (p=0.056 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 20.3k ± 2% 20.2k ± 5% ~ (p=0.421 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 40.4k ± 1% 40.8k ± 1% ~ (p=0.056 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 51.5k ± 1% 51.9k ± 1% +0.79% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 62.0k ± 1% 62.7k ± 0% +1.15% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 77.1k ± 2% 75.1k ± 4% ~ (p=0.151 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 75.3k ± 3% 69.5k ± 1% -7.81% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 63.9k ± 2% 61.0k ± 2% -4.52% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·1 8.99k ± 0% 9.16k ± 1% +1.81% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·2 15.8k ± 1% 16.0k ± 0% +1.04% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·3 21.5k ± 1% 22.1k ± 0% +2.67% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·4 25.7k ± 1% 26.7k ± 0% +4.05% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·8 28.7k ± 2% 30.9k ± 2% +7.45% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·12 27.3k ± 3% 29.5k ± 1% +8.03% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·16 27.1k ± 2% 29.6k ± 2% +9.24% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 9.31k ± 0% 9.51k ± 1% +2.23% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 16.3k ± 0% 16.5k ± 0% +0.90% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 22.3k ± 1% 22.7k ± 0% +1.41% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 26.8k ± 1% 27.4k ± 1% +2.07% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 30.1k ± 0% 31.2k ± 2% +3.80% (p=0.016 n=4+5)
neo/go/sqlite-zwrk.go(!sha1)·12 28.4k ± 2% 29.5k ± 2% +3.78% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 27.9k ± 3% 28.8k ±10% ~ (p=0.151 n=5+5)

name old latency-time/object new latency-time/object delta
cluster:neo1 dataset:wczblk1-8
fs1-zwrk.go·1 4.37µs ± 1% 4.36µs ± 0% ~ (p=0.548 n=5+5)
fs1-zwrk.go·2 4.48µs ± 1% 4.71µs ± 8% +5.18% (p=0.008 n=5+5)
fs1-zwrk.go·3 4.51µs ± 1% 4.55µs ± 1% ~ (p=0.056 n=5+5)
fs1-zwrk.go·4 4.61µs ± 1% 4.60µs ± 1% ~ (p=0.603 n=5+4)
fs1-zwrk.go·8 8.10µs ± 1% 8.03µs ± 0% -0.75% (p=0.016 n=5+5)
fs1-zwrk.go·12 11.9µs ± 1% 11.8µs ± 0% ~ (p=1.000 n=5+5)
fs1-zwrk.go·16 15.8µs ± 1% 15.7µs ± 0% ~ (p=0.206 n=5+5)
zeo/py/fs1-zwrk.go·1 195µs ± 1% 172µs ± 1% -11.98% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·2 289µs ± 1% 277µs ± 1% -3.92% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·3 398µs ± 1% 384µs ± 3% -3.36% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·4 516µs ± 1% 500µs ± 1% -3.18% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·8 989µs ± 0% 946µs ± 1% -4.37% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·12 1.42ms ± 0% 1.41ms ± 2% ~ (p=0.151 n=5+5)
zeo/py/fs1-zwrk.go·16 1.88ms ± 0% 1.88ms ± 2% ~ (p=0.841 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 230µs ± 1% 191µs ± 2% -16.86% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 316µs ± 2% 317µs ± 2% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 483µs ± 4% 474µs ± 1% ~ (p=0.056 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 640µs ± 1% 635µs ± 3% ~ (p=0.222 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 1.28ms ± 2% 1.28ms ± 3% ~ (p=0.548 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 1.92ms ± 2% 1.89ms ± 2% ~ (p=0.056 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 2.57ms ± 1% 2.53ms ± 2% ~ (p=0.095 n=5+5)
neo/py(!log)/sql-zwrk.go·1 305µs ± 7% 244µs ± 6% -19.90% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·2 491µs ± 2% 412µs ± 3% -15.94% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·3 740µs ± 2% 625µs ± 4% -15.61% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·4 976µs ± 2% 837µs ± 1% -14.28% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·8 1.98ms ± 2% 1.69ms ± 7% -14.60% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·12 2.98ms ± 2% 2.57ms ± 6% -13.56% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·16 4.03ms ± 3% 3.42ms ± 9% -14.95% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·1 77.8µs ± 0% 76.7µs ± 1% -1.36% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·2 80.7µs ± 1% 79.9µs ± 1% -0.99% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·3 93.0µs ± 1% 92.5µs ± 0% -0.51% (p=0.016 n=5+5)
neo/go/fs1-zwrk.go·4 98.4µs ± 1% 97.9µs ± 0% ~ (p=0.087 n=5+5)
neo/go/fs1-zwrk.go·8 147µs ± 1% 146µs ± 1% ~ (p=0.310 n=5+5)
neo/go/fs1-zwrk.go·12 210µs ± 1% 209µs ± 1% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·16 274µs ± 1% 287µs ± 1% +4.40% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 52.3µs ± 1% 51.9µs ± 2% ~ (p=0.310 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 53.1µs ± 1% 52.7µs ± 1% ~ (p=0.056 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 62.8µs ± 1% 62.2µs ± 0% -0.99% (p=0.016 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 68.3µs ± 1% 67.4µs ± 0% -1.27% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 103µs ± 1% 102µs ± 0% -1.03% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 144µs ± 1% 145µs ± 1% ~ (p=0.222 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 188µs ± 2% 197µs ± 2% +4.49% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·1 124µs ± 0% 122µs ± 1% -2.04% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·2 136µs ± 1% 134µs ± 0% -1.75% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·3 148µs ± 1% 145µs ± 0% -1.87% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·4 166µs ± 1% 161µs ± 0% -3.14% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·8 263µs ± 1% 260µs ± 9% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go·12 390µs ± 3% 383µs ± 1% ~ (p=0.095 n=5+5)
neo/go/sqlite-zwrk.go·16 532µs ± 2% 524µs ± 3% ~ (p=0.095 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 113µs ± 0% 110µs ± 0% -2.56% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 125µs ± 1% 122µs ± 0% -2.11% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 136µs ± 1% 132µs ± 0% -2.73% (p=0.016 n=5+4)
neo/go/sqlite-zwrk.go(!sha1)·4 149µs ± 1% 144µs ± 0% -3.53% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 242µs ± 2% 231µs ± 1% -4.25% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 365µs ± 2% 358µs ± 1% -1.87% (p=0.032 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 499µs ± 2% 487µs ± 2% ~ (p=0.095 n=5+5)
cluster:neo1 dataset:prod1-1024
fs1-zwrk.go·1 2.21µs ± 0% 2.20µs ± 0% ~ (p=0.063 n=5+4)
fs1-zwrk.go·2 2.24µs ± 0% 2.31µs ± 6% ~ (p=0.635 n=5+5)
fs1-zwrk.go·3 2.27µs ± 3% 2.25µs ± 1% ~ (p=0.476 n=5+5)
fs1-zwrk.go·4 2.27µs ± 1% 2.31µs ± 2% ~ (p=0.167 n=5+5)
fs1-zwrk.go·8 4.00µs ± 2% 4.02µs ± 2% ~ (p=0.421 n=5+5)
fs1-zwrk.go·12 5.88µs ± 0% 5.91µs ± 0% +0.47% (p=0.029 n=4+4)
fs1-zwrk.go·16 7.83µs ± 0% 7.86µs ± 0% ~ (p=0.127 n=4+5)
zeo/py/fs1-zwrk.go·1 170µs ± 1% 146µs ± 1% -13.66% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·2 235µs ± 0% 229µs ± 3% ~ (p=0.151 n=5+5)
zeo/py/fs1-zwrk.go·3 322µs ± 1% 324µs ± 6% ~ (p=0.690 n=5+5)
zeo/py/fs1-zwrk.go·4 412µs ± 1% 409µs ± 3% ~ (p=0.151 n=5+5)
zeo/py/fs1-zwrk.go·8 782µs ± 2% 766µs ± 1% -2.08% (p=0.032 n=5+5)
zeo/py/fs1-zwrk.go·12 1.15ms ± 0% 1.13ms ± 1% -1.39% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·16 1.52ms ± 1% 1.53ms ± 5% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 209µs ± 3% 180µs ± 3% -14.26% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 312µs ± 2% 307µs ± 1% -1.39% (p=0.032 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 469µs ± 2% 470µs ± 6% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 625µs ± 1% 622µs ± 1% ~ (p=0.310 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 1.25ms ± 1% 1.26ms ± 2% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 1.86ms ± 1% 1.91ms ± 3% ~ (p=0.151 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 2.51ms ± 1% 2.51ms ± 3% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·1 294µs ± 4% 230µs ± 2% -21.61% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·2 483µs ± 2% 405µs ± 4% -16.22% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·3 728µs ± 1% 640µs ± 5% -11.98% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·4 978µs ± 3% 837µs ± 4% -14.42% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·8 1.92ms ± 2% 1.63ms ± 1% -15.10% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·12 2.94ms ± 2% 2.52ms ± 3% -14.18% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·16 3.87ms ± 3% 3.27ms ± 3% -15.56% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·1 58.1µs ± 1% 57.4µs ± 1% -1.21% (p=0.032 n=5+5)
neo/go/fs1-zwrk.go·2 61.5µs ± 1% 60.8µs ± 1% -1.13% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·3 69.7µs ± 1% 69.0µs ± 0% -0.97% (p=0.016 n=5+4)
neo/go/fs1-zwrk.go·4 75.8µs ± 1% 75.1µs ± 0% -0.94% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·8 119µs ± 2% 119µs ± 2% ~ (p=0.421 n=5+5)
neo/go/fs1-zwrk.go·12 185µs ± 2% 192µs ± 3% +3.65% (p=0.016 n=5+5)
neo/go/fs1-zwrk.go·16 280µs ± 4% 296µs ±12% ~ (p=0.056 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 49.4µs ± 2% 49.5µs ± 5% ~ (p=0.421 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 49.5µs ± 1% 49.0µs ± 1% ~ (p=0.056 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 58.2µs ± 1% 57.8µs ± 1% -0.78% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 64.5µs ± 1% 63.7µs ± 0% -1.14% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 104µs ± 2% 107µs ± 5% ~ (p=0.151 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 159µs ± 3% 173µs ± 1% +8.44% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 250µs ± 2% 262µs ± 2% +4.74% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·1 111µs ± 0% 109µs ± 1% -1.78% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·2 127µs ± 1% 125µs ± 0% -1.03% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·3 140µs ± 1% 136µs ± 0% -2.60% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·4 156µs ± 1% 150µs ± 0% -3.89% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·8 279µs ± 2% 259µs ± 2% -6.95% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·12 440µs ± 3% 407µs ± 1% -7.45% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·16 591µs ± 2% 541µs ± 2% -8.47% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 107µs ± 0% 105µs ± 1% -2.18% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 122µs ± 0% 121µs ± 0% -0.89% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 134µs ± 1% 132µs ± 0% -1.39% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 149µs ± 1% 146µs ± 1% -2.03% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 266µs ± 0% 256µs ± 2% -3.65% (p=0.016 n=4+5)
neo/go/sqlite-zwrk.go(!sha1)·12 423µs ± 2% 407µs ± 2% -3.65% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 574µs ± 3% 557µs ±10% ~ (p=0.151 n=5+5)

23f8d82e

X neo1: localhost timings, Cenabled, zwrk was running for 10s at each iteration · 5db60f7e

Kirill Smelkov authored Mar 09, 2018

Compared to zwrk@1s (previous commit) the changes are in within, or
close to be in within, noise and in particular it does not help for
-zwrk.go timings like it did with Cstates disabled (f40c8b4b).

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

$ benchstat -split node,cluster,dataset 20180308-neo1-ffixed-c-zwrk1s.txt 20180308-neo1-ffixed-c-zwrk10s.txt

name old pystone/s new pystone/s delta
node:neo1
pystone 106k ± 1% 106k ± 1% ~ (p=1.000 n=5+5)

name old time/op new time/op delta
node:neo1
crc32/py/4K 5.13µs ± 1% 5.16µs ± 1% ~ (p=0.310 n=5+5)
crc32/go/4K 2.79µs ± 0% 2.79µs ± 0% ~ (p=0.238 n=5+4)
sha1/py/4K 13.5µs ± 1% 13.5µs ± 1% ~ (p=0.905 n=4+5)
sha1/go/4K 9.82µs ± 0% 9.82µs ± 0% ~ (p=0.444 n=5+5)
unzlib/py/wczdata 35.9µs ± 1% 36.1µs ± 1% ~ (p=0.548 n=5+5)
unzlib/go/wczdata 31.2µs ± 0% 31.3µs ± 0% ~ (p=0.548 n=5+5)
unzlib/py/prod1-avg 16.1µs ± 3% 16.4µs ± 1% ~ (p=0.095 n=5+5)
unzlib/go/prod1-avg 9.38µs ± 1% 9.41µs ± 1% ~ (p=0.548 n=5+5)
disk/randread/direct/4K-min 162µs ± 0% 162µs ± 0% ~ (p=0.460 n=4+5)
disk/randread/direct/4K-avg 187µs ± 1% 187µs ± 0% ~ (p=1.000 n=5+5)
disk/randread/pagecache/4K-min 392ns ± 1% 386ns ± 1% -1.35% (p=0.032 n=5+4)
disk/randread/pagecache/4K-avg 808ns ± 0% 804ns ± 0% -0.56% (p=0.016 n=5+4)

name old time/object new time/object delta
cluster:neo1 dataset:wczblk1-8
fs1-zhash.py 34.8µs ± 1% 34.9µs ± 1% ~ (p=0.762 n=5+5)
fs1-zhash.go 5.96µs ± 1% 6.00µs ± 0% ~ (p=0.556 n=5+4)
fs1-zhash.go+prefetch128 6.60µs ± 0% 6.58µs ± 2% ~ (p=0.762 n=4+5)
zeo/py/fs1-zhash.py 524µs ± 2% 516µs ± 8% ~ (p=1.000 n=5+5)
zeo/py/fs1-zhash.go 197µs ± 6% 200µs ± 4% ~ (p=1.000 n=5+5)
zeo/py/fs1-zhash.go+prefetch128 100µs ± 2% 98µs ± 2% ~ (p=0.135 n=5+5)
neo/py(!log)/sqlite-zhash.py 625µs ±20% 692µs ± 5% +10.75% (p=0.032 n=5+5)
neo/py(!log)/sqlite-zhash.go 231µs ± 5% 230µs ± 4% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zhash.go+prefetch128 164µs ± 1% 165µs ± 3% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zhash.py 992µs ±44% 938µs ±50% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zhash.go 329µs ±14% 310µs ±10% ~ (p=0.310 n=5+5)
neo/py(!log)/sql-zhash.go+prefetch128 242µs ± 5% 244µs ± 8% ~ (p=0.548 n=5+5)
neo/go/fs1-zhash.py 373µs ±19% 368µs ±27% ~ (p=0.802 n=5+5)
neo/go/fs1-zhash.go 80.0µs ± 2% 80.2µs ± 2% ~ (p=1.000 n=5+5)
neo/go/fs1-zhash.go+prefetch128 34.8µs ± 5% 34.8µs ± 5% ~ (p=0.889 n=5+5)
neo/go/fs1(!sha1)-zhash.go(!sha1) 57.5µs ± 3% 56.7µs ± 3% ~ (p=0.421 n=5+5)
neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 23.8µs ± 7% 22.7µs ± 3% ~ (p=0.063 n=5+5)
neo/go/sqlite-zhash.py 415µs ± 3% 406µs ± 8% ~ (p=0.222 n=5+5)
neo/go/sqlite-zhash.go 126µs ± 1% 125µs ± 2% ~ (p=0.690 n=5+5)
neo/go/sqlite-zhash.go+prefetch128 45.6µs ± 6% 47.9µs ± 5% ~ (p=0.310 n=5+5)
neo/go/sqlite-zhash.go(!sha1) 117µs ± 3% 115µs ± 1% ~ (p=0.135 n=5+5)
neo/go/sqlite-zhash.go+prefetch128(!sha1) 45.8µs ± 4% 47.2µs ±13% ~ (p=0.841 n=5+5)
cluster:neo1 dataset:prod1-1024
fs1-zhash.py 29.1µs ± 1% 29.1µs ± 2% ~ (p=1.000 n=5+5)
fs1-zhash.go 3.76µs ± 2% 3.74µs ± 2% ~ (p=1.000 n=5+5)
fs1-zhash.go+prefetch128 3.82µs ± 3% 3.88µs ± 3% ~ (p=0.484 n=5+5)
zeo/py/fs1-zhash.py 490µs ± 1% 499µs ± 2% ~ (p=0.095 n=5+5)
zeo/py/fs1-zhash.go 173µs ±12% 171µs ± 4% ~ (p=0.548 n=5+5)
zeo/py/fs1-zhash.go+prefetch128 86.6µs ± 1% 87.9µs ± 1% +1.50% (p=0.032 n=5+5)
neo/py(!log)/sqlite-zhash.py 639µs ±23% 678µs ± 3% ~ (p=0.651 n=5+5)
neo/py(!log)/sqlite-zhash.go 216µs ± 3% 211µs ± 6% ~ (p=0.500 n=5+5)
neo/py(!log)/sqlite-zhash.go+prefetch128 150µs ± 2% 150µs ± 1% ~ (p=0.984 n=5+5)
neo/py(!log)/sql-zhash.py 912µs ±50% 922µs ±53% ~ (p=0.690 n=5+5)
neo/py(!log)/sql-zhash.go 307µs ±10% 289µs ± 5% ~ (p=0.310 n=5+5)
neo/py(!log)/sql-zhash.go+prefetch128 227µs ± 3% 228µs ± 4% ~ (p=0.841 n=5+5)
neo/go/fs1-zhash.py 336µs ±11% 359µs ±15% ~ (p=0.786 n=5+5)
neo/go/fs1-zhash.go 61.5µs ± 3% 62.1µs ± 0% ~ (p=0.389 n=5+5)
neo/go/fs1-zhash.go+prefetch128 22.6µs ± 3% 22.5µs ± 1% ~ (p=0.556 n=5+5)
neo/go/fs1(!sha1)-zhash.go(!sha1) 52.5µs ± 4% 51.4µs ± 4% ~ (p=0.175 n=5+5)
neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 18.2µs ± 4% 18.6µs ± 3% ~ (p=0.206 n=5+5)
neo/go/sqlite-zhash.py 387µs ± 4% 396µs ± 4% ~ (p=0.310 n=5+5)
neo/go/sqlite-zhash.go 113µs ± 1% 114µs ± 1% ~ (p=0.722 n=5+5)
neo/go/sqlite-zhash.go+prefetch128 41.7µs ± 3% 41.5µs ± 6% ~ (p=0.889 n=5+5)
neo/go/sqlite-zhash.go(!sha1) 110µs ± 2% 109µs ± 1% ~ (p=0.222 n=5+5)
neo/go/sqlite-zhash.go+prefetch128(!sha1) 40.9µs ± 5% 41.4µs ± 3% ~ (p=0.595 n=5+5)

name old req/s new req/s delta
cluster:neo1 dataset:wczblk1-8
fs1-zwrk.go·1 230k ± 0% 229k ± 1% ~ (p=0.151 n=5+5)
fs1-zwrk.go·2 447k ± 1% 446k ± 1% ~ (p=1.000 n=5+5)
fs1-zwrk.go·3 666k ± 0% 665k ± 1% ~ (p=0.690 n=5+5)
fs1-zwrk.go·4 870k ± 0% 868k ± 1% ~ (p=0.730 n=4+5)
fs1-zwrk.go·8 991k ± 0% 988k ± 1% ~ (p=0.690 n=5+5)
fs1-zwrk.go·12 1.02M ± 0% 1.01M ± 1% ~ (p=0.310 n=5+5)
fs1-zwrk.go·16 1.02M ± 0% 1.01M ± 1% ~ (p=0.548 n=5+5)
zeo/py/fs1-zwrk.go·1 5.06k ± 1% 5.13k ± 1% +1.45% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·2 6.93k ± 2% 6.93k ± 1% ~ (p=0.841 n=5+5)
zeo/py/fs1-zwrk.go·3 7.48k ± 1% 7.54k ± 1% +0.84% (p=0.032 n=5+5)
zeo/py/fs1-zwrk.go·4 7.69k ± 2% 7.75k ± 1% ~ (p=0.151 n=5+5)
zeo/py/fs1-zwrk.go·8 8.02k ± 1% 8.09k ± 0% +0.83% (p=0.032 n=5+5)
zeo/py/fs1-zwrk.go·12 8.40k ± 2% 8.46k ± 0% ~ (p=0.222 n=5+5)
zeo/py/fs1-zwrk.go·16 8.46k ± 1% 8.52k ± 0% ~ (p=0.095 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 4.22k ± 2% 4.35k ± 1% +2.92% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 6.29k ± 3% 6.33k ± 2% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 6.29k ± 2% 6.22k ± 4% ~ (p=0.310 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 6.26k ± 3% 6.25k ± 1% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 6.18k ± 3% 6.25k ± 2% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 6.04k ± 5% 6.26k ± 2% ~ (p=0.222 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 6.21k ± 5% 6.24k ± 1% ~ (p=0.548 n=5+5)
neo/py(!log)/sql-zwrk.go·1 3.27k ±13% 3.29k ± 7% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·2 3.98k ± 3% 4.08k ± 2% ~ (p=0.095 n=5+5)
neo/py(!log)/sql-zwrk.go·3 3.97k ± 4% 4.05k ± 2% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·4 3.95k ± 5% 4.10k ± 2% ~ (p=0.095 n=5+5)
neo/py(!log)/sql-zwrk.go·8 4.07k ± 4% 4.04k ± 2% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zwrk.go·12 4.11k ± 6% 4.03k ± 2% ~ (p=0.548 n=5+5)
neo/py(!log)/sql-zwrk.go·16 4.03k ± 9% 3.97k ± 3% ~ (p=1.000 n=5+5)
neo/go/fs1-zwrk.go·1 12.9k ± 1% 12.9k ± 0% ~ (p=0.548 n=5+5)
neo/go/fs1-zwrk.go·2 24.9k ± 0% 24.8k ± 1% ~ (p=0.548 n=5+5)
neo/go/fs1-zwrk.go·3 32.3k ± 0% 32.3k ± 1% ~ (p=0.421 n=5+5)
neo/go/fs1-zwrk.go·4 40.9k ± 0% 40.7k ± 1% -0.55% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·8 54.7k ± 1% 54.5k ± 1% ~ (p=0.421 n=5+5)
neo/go/fs1-zwrk.go·12 56.5k ± 1% 57.2k ± 1% +1.18% (p=0.016 n=5+5)
neo/go/fs1-zwrk.go·16 54.5k ± 1% 58.3k ± 1% +6.99% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 19.0k ± 2% 19.1k ± 1% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 37.5k ± 2% 37.7k ± 1% ~ (p=0.548 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 48.0k ± 0% 47.7k ± 1% ~ (p=0.056 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 59.0k ± 0% 58.6k ± 1% ~ (p=0.095 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 78.1k ± 0% 77.6k ± 1% ~ (p=0.056 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 80.7k ± 7% 83.1k ± 1% +3.04% (p=0.032 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 80.7k ± 1% 84.9k ± 2% +5.23% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·1 8.12k ± 0% 8.06k ± 0% -0.75% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·2 14.9k ± 0% 14.7k ± 1% -1.31% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·3 20.9k ± 0% 20.3k ± 1% -2.48% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·4 25.0k ± 0% 24.1k ± 1% -3.69% (p=0.016 n=4+5)
neo/go/sqlite-zwrk.go·8 32.1k ± 1% 30.4k ± 1% -5.40% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·12 32.3k ± 1% 30.8k ± 3% -4.56% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·16 30.6k ±10% 30.1k ± 2% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 8.84k ± 1% 8.84k ± 0% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 16.2k ± 0% 16.1k ± 1% -0.67% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 22.5k ± 0% 22.1k ± 1% -1.73% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 27.5k ± 0% 26.8k ± 1% -2.68% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 34.2k ± 1% 33.1k ± 2% -3.21% (p=0.016 n=4+5)
neo/go/sqlite-zwrk.go(!sha1)·12 33.4k ± 2% 32.9k ± 2% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 32.8k ± 2% 32.1k ± 2% ~ (p=0.056 n=5+5)
cluster:neo1 dataset:prod1-1024
fs1-zwrk.go·1 454k ± 0% 453k ± 0% ~ (p=0.310 n=5+5)
fs1-zwrk.go·2 899k ± 0% 891k ± 0% -0.83% (p=0.008 n=5+5)
fs1-zwrk.go·3 1.31M ± 8% 1.32M ± 3% ~ (p=1.000 n=5+5)
fs1-zwrk.go·4 1.77M ± 1% 1.77M ± 1% ~ (p=0.841 n=5+5)
fs1-zwrk.go·8 2.02M ± 2% 2.00M ± 2% ~ (p=0.421 n=5+5)
fs1-zwrk.go·12 2.04M ± 0% 2.04M ± 0% ~ (p=0.063 n=5+4)
fs1-zwrk.go·16 2.04M ± 0% 2.03M ± 2% ~ (p=0.421 n=5+5)
zeo/py/fs1-zwrk.go·1 5.84k ± 4% 5.90k ± 1% ~ (p=0.548 n=5+5)
zeo/py/fs1-zwrk.go·2 8.59k ± 2% 8.50k ± 0% ~ (p=0.151 n=5+5)
zeo/py/fs1-zwrk.go·3 9.37k ± 2% 9.32k ± 1% ~ (p=0.548 n=5+5)
zeo/py/fs1-zwrk.go·4 9.75k ± 3% 9.70k ± 1% ~ (p=0.690 n=5+5)
zeo/py/fs1-zwrk.go·8 10.2k ± 3% 10.2k ± 2% ~ (p=0.690 n=5+5)
zeo/py/fs1-zwrk.go·12 10.5k ± 1% 10.4k ± 0% ~ (p=0.095 n=5+5)
zeo/py/fs1-zwrk.go·16 10.5k ± 1% 10.5k ± 1% ~ (p=0.310 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 4.79k ± 5% 4.78k ± 3% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 6.49k ± 0% 6.42k ± 2% ~ (p=0.063 n=4+5)
neo/py(!log)/sqlite-zwrk.go·3 6.37k ± 6% 6.40k ± 2% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 6.41k ± 1% 6.40k ± 1% ~ (p=0.841 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 6.36k ± 5% 6.39k ± 1% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 6.43k ± 0% 6.44k ± 1% ~ (p=0.556 n=4+5)
neo/py(!log)/sqlite-zwrk.go·16 6.37k ± 1% 6.38k ± 1% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zwrk.go·1 3.32k ±13% 3.41k ± 4% ~ (p=0.690 n=5+5)
neo/py(!log)/sql-zwrk.go·2 4.08k ± 7% 4.14k ± 2% ~ (p=0.548 n=5+5)
neo/py(!log)/sql-zwrk.go·3 4.11k ± 3% 4.12k ± 1% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·4 4.08k ± 4% 4.09k ± 3% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·8 3.98k ± 3% 4.18k ± 2% +4.87% (p=0.016 n=5+5)
neo/py(!log)/sql-zwrk.go·12 4.11k ± 5% 4.09k ± 2% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zwrk.go·16 4.22k ± 4% 4.14k ± 3% ~ (p=0.310 n=5+5)
neo/go/fs1-zwrk.go·1 17.3k ± 1% 17.2k ± 1% ~ (p=0.222 n=5+5)
neo/go/fs1-zwrk.go·2 32.8k ± 1% 32.5k ± 1% ~ (p=0.111 n=4+5)
neo/go/fs1-zwrk.go·3 43.3k ± 0% 43.0k ± 1% -0.61% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·4 53.0k ± 0% 52.7k ± 1% ~ (p=0.421 n=5+5)
neo/go/fs1-zwrk.go·8 66.5k ± 1% 67.3k ± 1% ~ (p=0.095 n=5+5)
neo/go/fs1-zwrk.go·12 60.7k ± 2% 64.9k ± 2% +6.81% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·16 55.5k ± 2% 57.3k ± 4% +3.28% (p=0.032 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 20.1k ± 2% 20.3k ± 2% ~ (p=0.310 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 40.2k ± 1% 40.4k ± 1% ~ (p=0.151 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 51.5k ± 0% 51.5k ± 1% ~ (p=0.690 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 62.1k ± 0% 62.0k ± 1% ~ (p=0.690 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 74.3k ± 2% 77.1k ± 2% +3.66% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 67.1k ± 3% 75.3k ± 3% +12.21% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 59.5k ± 2% 63.9k ± 2% +7.44% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·1 8.89k ± 4% 8.99k ± 0% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go·2 15.9k ± 0% 15.8k ± 1% ~ (p=0.222 n=5+5)
neo/go/sqlite-zwrk.go·3 21.8k ± 1% 21.5k ± 1% -1.24% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·4 26.2k ± 0% 25.7k ± 1% -2.11% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·8 29.9k ± 1% 28.7k ± 2% -4.03% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·12 28.7k ± 0% 27.3k ± 3% -4.85% (p=0.016 n=4+5)
neo/go/sqlite-zwrk.go·16 28.8k ± 1% 27.1k ± 2% -5.85% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 9.33k ± 1% 9.31k ± 0% ~ (p=0.310 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 16.4k ± 0% 16.3k ± 0% ~ (p=0.190 n=4+5)
neo/go/sqlite-zwrk.go(!sha1)·3 22.7k ± 0% 22.3k ± 1% -1.53% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 27.4k ± 0% 26.8k ± 1% -2.06% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 31.4k ± 1% 30.1k ± 0% -4.24% (p=0.016 n=5+4)
neo/go/sqlite-zwrk.go(!sha1)·12 29.8k ± 1% 28.4k ± 2% -4.78% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 29.6k ± 2% 27.9k ± 3% -5.82% (p=0.008 n=5+5)

name old latency-time/object new latency-time/object delta
cluster:neo1 dataset:wczblk1-8
fs1-zwrk.go·1 4.35µs ± 0% 4.37µs ± 1% ~ (p=0.135 n=5+5)
fs1-zwrk.go·2 4.47µs ± 1% 4.48µs ± 1% ~ (p=0.968 n=5+5)
fs1-zwrk.go·3 4.51µs ± 0% 4.51µs ± 1% ~ (p=0.651 n=5+5)
fs1-zwrk.go·4 4.60µs ± 0% 4.61µs ± 1% ~ (p=0.730 n=4+5)
fs1-zwrk.go·8 8.07µs ± 0% 8.10µs ± 1% ~ (p=0.571 n=5+5)
fs1-zwrk.go·12 11.8µs ± 0% 11.9µs ± 1% ~ (p=0.341 n=5+5)
fs1-zwrk.go·16 15.7µs ± 0% 15.8µs ± 1% ~ (p=0.516 n=5+5)
zeo/py/fs1-zwrk.go·1 198µs ± 1% 195µs ± 1% -1.43% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·2 289µs ± 2% 289µs ± 1% ~ (p=0.841 n=5+5)
zeo/py/fs1-zwrk.go·3 401µs ± 1% 398µs ± 1% -0.84% (p=0.032 n=5+5)
zeo/py/fs1-zwrk.go·4 520µs ± 2% 516µs ± 1% ~ (p=0.151 n=5+5)
zeo/py/fs1-zwrk.go·8 1.00ms ± 1% 0.99ms ± 0% -0.82% (p=0.032 n=5+5)
zeo/py/fs1-zwrk.go·12 1.43ms ± 2% 1.42ms ± 0% ~ (p=0.222 n=5+5)
zeo/py/fs1-zwrk.go·16 1.89ms ± 1% 1.88ms ± 0% ~ (p=0.095 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 237µs ± 2% 230µs ± 1% -2.86% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 318µs ± 3% 316µs ± 2% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 477µs ± 2% 483µs ± 4% ~ (p=0.310 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 639µs ± 3% 640µs ± 1% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 1.30ms ± 3% 1.28ms ± 2% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 1.99ms ± 5% 1.92ms ± 2% ~ (p=0.222 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 2.58ms ± 5% 2.57ms ± 1% ~ (p=0.548 n=5+5)
neo/py(!log)/sql-zwrk.go·1 308µs ±13% 305µs ± 7% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·2 503µs ± 3% 491µs ± 2% ~ (p=0.095 n=5+5)
neo/py(!log)/sql-zwrk.go·3 756µs ± 4% 740µs ± 2% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·4 1.01ms ± 5% 0.98ms ± 2% ~ (p=0.095 n=5+5)
neo/py(!log)/sql-zwrk.go·8 1.97ms ± 4% 1.98ms ± 2% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zwrk.go·12 2.92ms ± 6% 2.98ms ± 2% ~ (p=0.548 n=5+5)
neo/py(!log)/sql-zwrk.go·16 3.98ms ± 8% 4.03ms ± 3% ~ (p=1.000 n=5+5)
neo/go/fs1-zwrk.go·1 77.3µs ± 1% 77.8µs ± 0% ~ (p=0.548 n=5+5)
neo/go/fs1-zwrk.go·2 80.4µs ± 0% 80.7µs ± 1% ~ (p=0.548 n=5+5)
neo/go/fs1-zwrk.go·3 92.8µs ± 0% 93.0µs ± 1% ~ (p=0.421 n=5+5)
neo/go/fs1-zwrk.go·4 97.8µs ± 0% 98.4µs ± 1% +0.56% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·8 146µs ± 1% 147µs ± 1% ~ (p=0.421 n=5+5)
neo/go/fs1-zwrk.go·12 212µs ± 1% 210µs ± 1% -1.16% (p=0.016 n=5+5)
neo/go/fs1-zwrk.go·16 294µs ± 1% 274µs ± 1% -6.53% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 52.6µs ± 2% 52.3µs ± 1% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 53.3µs ± 2% 53.1µs ± 1% ~ (p=0.548 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 62.5µs ± 0% 62.8µs ± 1% ~ (p=0.056 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 67.8µs ± 0% 68.3µs ± 1% ~ (p=0.095 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 102µs ± 0% 103µs ± 1% ~ (p=0.056 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 149µs ± 7% 144µs ± 1% -3.07% (p=0.032 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 198µs ± 1% 188µs ± 2% -4.97% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·1 123µs ± 0% 124µs ± 0% +0.76% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·2 134µs ± 0% 136µs ± 1% +1.33% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·3 144µs ± 0% 148µs ± 1% +2.55% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·4 160µs ± 0% 166µs ± 1% +3.84% (p=0.016 n=4+5)
neo/go/sqlite-zwrk.go·8 249µs ± 1% 263µs ± 1% +5.71% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·12 372µs ± 1% 390µs ± 3% +4.80% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·16 524µs ±11% 532µs ± 2% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 113µs ± 1% 113µs ± 0% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 124µs ± 0% 125µs ± 1% +0.67% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 133µs ± 0% 136µs ± 1% +1.76% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 145µs ± 0% 149µs ± 1% +2.75% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 234µs ± 1% 242µs ± 2% +3.33% (p=0.016 n=4+5)
neo/go/sqlite-zwrk.go(!sha1)·12 360µs ± 2% 365µs ± 2% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 487µs ± 2% 499µs ± 2% ~ (p=0.056 n=5+5)
cluster:neo1 dataset:prod1-1024
fs1-zwrk.go·1 2.21µs ± 0% 2.21µs ± 0% ~ (p=0.286 n=5+5)
fs1-zwrk.go·2 2.23µs ± 0% 2.24µs ± 0% +0.84% (p=0.008 n=5+5)
fs1-zwrk.go·3 2.30µs ± 9% 2.27µs ± 3% ~ (p=0.849 n=5+5)
fs1-zwrk.go·4 2.26µs ± 1% 2.27µs ± 1% ~ (p=0.794 n=5+5)
fs1-zwrk.go·8 3.97µs ± 2% 4.00µs ± 2% ~ (p=0.421 n=5+5)
fs1-zwrk.go·12 5.90µs ± 0% 5.88µs ± 0% -0.28% (p=0.032 n=5+4)
fs1-zwrk.go·16 7.86µs ± 0% 7.83µs ± 0% ~ (p=0.111 n=5+4)
zeo/py/fs1-zwrk.go·1 171µs ± 4% 170µs ± 1% ~ (p=0.548 n=5+5)
zeo/py/fs1-zwrk.go·2 233µs ± 2% 235µs ± 0% ~ (p=0.151 n=5+5)
zeo/py/fs1-zwrk.go·3 320µs ± 2% 322µs ± 1% ~ (p=0.548 n=5+5)
zeo/py/fs1-zwrk.go·4 410µs ± 3% 412µs ± 1% ~ (p=0.690 n=5+5)
zeo/py/fs1-zwrk.go·8 783µs ± 3% 782µs ± 2% ~ (p=0.690 n=5+5)
zeo/py/fs1-zwrk.go·12 1.14ms ± 1% 1.15ms ± 0% ~ (p=0.095 n=5+5)
zeo/py/fs1-zwrk.go·16 1.53ms ± 1% 1.52ms ± 1% ~ (p=0.310 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 209µs ± 5% 209µs ± 3% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 308µs ± 0% 312µs ± 2% ~ (p=0.063 n=4+5)
neo/py(!log)/sqlite-zwrk.go·3 472µs ± 6% 469µs ± 2% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 624µs ± 1% 625µs ± 1% ~ (p=0.841 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 1.26ms ± 6% 1.25ms ± 1% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 1.87ms ± 0% 1.86ms ± 1% ~ (p=0.556 n=4+5)
neo/py(!log)/sqlite-zwrk.go·16 2.51ms ± 1% 2.51ms ± 1% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zwrk.go·1 304µs ±13% 294µs ± 4% ~ (p=0.690 n=5+5)
neo/py(!log)/sql-zwrk.go·2 491µs ± 7% 483µs ± 2% ~ (p=0.548 n=5+5)
neo/py(!log)/sql-zwrk.go·3 730µs ± 3% 728µs ± 1% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·4 982µs ± 4% 978µs ± 3% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·8 2.01ms ± 3% 1.92ms ± 2% -4.68% (p=0.016 n=5+5)
neo/py(!log)/sql-zwrk.go·12 2.92ms ± 5% 2.94ms ± 2% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zwrk.go·16 3.79ms ± 4% 3.87ms ± 3% ~ (p=0.310 n=5+5)
neo/go/fs1-zwrk.go·1 57.8µs ± 1% 58.1µs ± 1% ~ (p=0.222 n=5+5)
neo/go/fs1-zwrk.go·2 61.1µs ± 1% 61.5µs ± 1% ~ (p=0.111 n=4+5)
neo/go/fs1-zwrk.go·3 69.3µs ± 0% 69.7µs ± 1% +0.62% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·4 75.5µs ± 0% 75.8µs ± 1% ~ (p=0.421 n=5+5)
neo/go/fs1-zwrk.go·8 120µs ± 1% 119µs ± 2% ~ (p=0.095 n=5+5)
neo/go/fs1-zwrk.go·12 198µs ± 2% 185µs ± 2% -6.38% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·16 289µs ± 2% 280µs ± 4% -3.14% (p=0.032 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 49.9µs ± 2% 49.4µs ± 2% ~ (p=0.310 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 49.8µs ± 1% 49.5µs ± 1% ~ (p=0.151 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 58.3µs ± 0% 58.2µs ± 1% ~ (p=0.690 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 64.4µs ± 0% 64.5µs ± 1% ~ (p=0.690 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 108µs ± 2% 104µs ± 2% -3.52% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 179µs ± 3% 159µs ± 3% -10.88% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 269µs ± 2% 250µs ± 2% -6.92% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·1 113µs ± 4% 111µs ± 0% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go·2 126µs ± 0% 127µs ± 1% ~ (p=0.222 n=5+5)
neo/go/sqlite-zwrk.go·3 138µs ± 1% 140µs ± 1% +1.26% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·4 152µs ± 0% 156µs ± 1% +2.16% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·8 267µs ± 1% 279µs ± 2% +4.21% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·12 418µs ± 0% 440µs ± 3% +5.13% (p=0.016 n=4+5)
neo/go/sqlite-zwrk.go·16 556µs ± 1% 591µs ± 2% +6.23% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 107µs ± 1% 107µs ± 0% ~ (p=0.310 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 122µs ± 0% 122µs ± 0% ~ (p=0.190 n=4+5)
neo/go/sqlite-zwrk.go(!sha1)·3 132µs ± 0% 134µs ± 1% +1.56% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 146µs ± 0% 149µs ± 1% +2.10% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 255µs ± 1% 266µs ± 0% +4.43% (p=0.016 n=5+4)
neo/go/sqlite-zwrk.go(!sha1)·12 403µs ± 1% 423µs ± 2% +5.03% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 541µs ± 2% 574µs ± 3% +6.20% (p=0.008 n=5+5)

5db60f7e

X neo1: localhost timings, Cenabled, zwrk was running for 1s at each iteration · 4cbd62f7

Kirill Smelkov authored Mar 09, 2018

Remeasure with same settings as previous neo1 localhost with C-enabled (9644774a):

The data is more or less the same and in particular timings for either
sql backend or python client are noisy.

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

$ benchstat -split node,cluster,dataset 20180306-neo1-ffixed-c.txt 20180308-neo1-ffixed-c-zwrk1s.txt

name old pystone/s new pystone/s delta
node:neo1
pystone 106k ± 1% 106k ± 1% ~ (p=0.690 n=5+5)

name old time/op new time/op delta
node:neo1
crc32/py/4K 5.13µs ± 1% 5.13µs ± 1% ~ (p=1.000 n=5+5)
crc32/go/4K 2.79µs ± 0% 2.79µs ± 0% ~ (p=1.000 n=5+5)
sha1/py/4K 13.4µs ± 1% 13.5µs ± 1% ~ (p=0.730 n=5+4)
sha1/go/4K 9.83µs ± 0% 9.82µs ± 0% ~ (p=0.810 n=5+5)
unzlib/py/wczdata 36.1µs ± 0% 35.9µs ± 1% ~ (p=0.421 n=5+5)
unzlib/go/wczdata 31.1µs ± 1% 31.2µs ± 0% ~ (p=0.421 n=5+5)
unzlib/py/prod1-avg 16.3µs ± 2% 16.1µs ± 3% ~ (p=0.310 n=5+5)
unzlib/go/prod1-avg 9.42µs ± 0% 9.38µs ± 1% ~ (p=0.222 n=5+5)
disk/randread/direct/4K-min 162µs ± 0% 162µs ± 0% ~ (p=0.619 n=5+4)
disk/randread/direct/4K-avg 187µs ± 2% 187µs ± 1% ~ (p=0.952 n=5+5)
disk/randread/pagecache/4K-min 389ns ± 1% 392ns ± 1% ~ (p=0.167 n=5+5)
disk/randread/pagecache/4K-avg 804ns ± 0% 808ns ± 0% +0.53% (p=0.016 n=4+5)

name old time/object new time/object delta
cluster:neo1 dataset:wczblk1-8
fs1-zhash.py 34.7µs ± 2% 34.8µs ± 1% ~ (p=0.770 n=5+5)
fs1-zhash.go 6.00µs ± 2% 5.96µs ± 1% ~ (p=0.683 n=5+5)
fs1-zhash.go+prefetch128 6.52µs ± 4% 6.60µs ± 0% ~ (p=0.397 n=5+4)
zeo/py/fs1-zhash.py 523µs ± 1% 524µs ± 2% ~ (p=0.841 n=5+5)
zeo/py/fs1-zhash.go 194µs ± 4% 197µs ± 6% ~ (p=0.421 n=5+5)
zeo/py/fs1-zhash.go+prefetch128 98.6µs ± 3% 100.1µs ± 2% ~ (p=0.135 n=5+5)
neo/py(!log)/sqlite-zhash.py 684µs ± 3% 625µs ±20% ~ (p=0.056 n=5+5)
neo/py(!log)/sqlite-zhash.go 236µs ± 2% 231µs ± 5% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zhash.go+prefetch128 162µs ± 2% 164µs ± 1% ~ (p=0.095 n=5+5)
neo/py(!log)/sql-zhash.py 942µs ±47% 992µs ±44% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zhash.go 300µs ±17% 329µs ±14% ~ (p=0.548 n=5+5)
neo/py(!log)/sql-zhash.go+prefetch128 240µs ± 6% 242µs ± 5% ~ (p=1.000 n=5+5)
neo/go/fs1-zhash.py 383µs ±20% 373µs ±19% ~ (p=0.802 n=5+5)
neo/go/fs1-zhash.go 81.3µs ± 1% 80.0µs ± 2% -1.62% (p=0.040 n=5+5)
neo/go/fs1-zhash.go+prefetch128 33.8µs ± 5% 34.8µs ± 5% ~ (p=0.389 n=5+5)
neo/go/fs1(!sha1)-zhash.go(!sha1) 57.6µs ± 3% 57.5µs ± 3% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 22.9µs ± 6% 23.8µs ± 7% ~ (p=0.103 n=5+5)
neo/go/sqlite-zhash.py 402µs ± 6% 415µs ± 3% ~ (p=0.421 n=5+5)
neo/go/sqlite-zhash.go 125µs ± 1% 126µs ± 1% ~ (p=0.421 n=5+5)
neo/go/sqlite-zhash.go+prefetch128 48.4µs ± 8% 45.6µs ± 6% ~ (p=0.310 n=5+5)
neo/go/sqlite-zhash.go(!sha1) 116µs ± 2% 117µs ± 3% ~ (p=0.413 n=5+5)
neo/go/sqlite-zhash.go+prefetch128(!sha1) 45.9µs ± 5% 45.8µs ± 4% ~ (p=0.841 n=5+5)
cluster:neo1 dataset:prod1-1024
fs1-zhash.py 28.9µs ± 1% 29.1µs ± 1% ~ (p=0.167 n=5+5)
fs1-zhash.go 3.76µs ± 4% 3.76µs ± 2% ~ (p=1.000 n=5+5)
fs1-zhash.go+prefetch128 3.86µs ± 2% 3.82µs ± 3% ~ (p=0.683 n=5+5)
zeo/py/fs1-zhash.py 474µs ± 2% 490µs ± 1% +3.34% (p=0.008 n=5+5)
zeo/py/fs1-zhash.go 170µs ± 3% 173µs ±12% ~ (p=0.690 n=5+5)
zeo/py/fs1-zhash.go+prefetch128 87.8µs ± 1% 86.6µs ± 1% -1.32% (p=0.032 n=5+5)
neo/py(!log)/sqlite-zhash.py 665µs ± 2% 639µs ±23% ~ (p=0.651 n=5+5)
neo/py(!log)/sqlite-zhash.go 219µs ± 2% 216µs ± 3% ~ (p=0.206 n=5+5)
neo/py(!log)/sqlite-zhash.go+prefetch128 151µs ± 1% 150µs ± 2% ~ (p=0.611 n=5+5)
neo/py(!log)/sql-zhash.py 886µs ±56% 912µs ±50% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zhash.go 298µs ± 9% 307µs ±10% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zhash.go+prefetch128 230µs ± 3% 227µs ± 3% ~ (p=0.421 n=5+5)
neo/go/fs1-zhash.py 319µs ±11% 336µs ±11% ~ (p=0.389 n=5+5)
neo/go/fs1-zhash.go 61.3µs ± 3% 61.5µs ± 3% ~ (p=0.968 n=5+5)
neo/go/fs1-zhash.go+prefetch128 22.5µs ± 3% 22.6µs ± 3% ~ (p=0.857 n=5+5)
neo/go/fs1(!sha1)-zhash.go(!sha1) 52.0µs ± 3% 52.5µs ± 4% ~ (p=0.841 n=5+5)
neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 18.3µs ± 2% 18.2µs ± 4% ~ (p=0.968 n=5+5)
neo/go/sqlite-zhash.py 382µs ± 6% 387µs ± 4% ~ (p=0.690 n=5+5)
neo/go/sqlite-zhash.go 113µs ± 1% 113µs ± 1% ~ (p=0.524 n=5+5)
neo/go/sqlite-zhash.go+prefetch128 40.9µs ± 4% 41.7µs ± 3% ~ (p=0.341 n=5+5)
neo/go/sqlite-zhash.go(!sha1) 108µs ± 1% 110µs ± 2% ~ (p=0.063 n=5+5)
neo/go/sqlite-zhash.go+prefetch128(!sha1) 41.1µs ± 5% 40.9µs ± 5% ~ (p=0.841 n=5+5)

name old req/s new req/s delta
cluster:neo1 dataset:wczblk1-8
fs1-zwrk.go·1 229k ± 0% 230k ± 0% +0.37% (p=0.016 n=5+5)
fs1-zwrk.go·2 443k ± 1% 447k ± 1% +1.08% (p=0.032 n=5+5)
fs1-zwrk.go·3 662k ± 1% 666k ± 0% +0.61% (p=0.032 n=5+5)
fs1-zwrk.go·4 867k ± 1% 870k ± 0% ~ (p=0.413 n=5+4)
fs1-zwrk.go·8 988k ± 0% 991k ± 0% ~ (p=0.095 n=5+5)
fs1-zwrk.go·12 1.02M ± 0% 1.02M ± 0% ~ (p=0.841 n=5+5)
fs1-zwrk.go·16 976k ±12% 1016k ± 0% ~ (p=0.421 n=5+5)
zeo/py/fs1-zwrk.go·1 5.15k ± 1% 5.06k ± 1% -1.78% (p=0.032 n=5+5)
zeo/py/fs1-zwrk.go·2 7.08k ± 1% 6.93k ± 2% -2.23% (p=0.032 n=5+5)
zeo/py/fs1-zwrk.go·3 7.73k ± 1% 7.48k ± 1% -3.20% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·4 7.97k ± 4% 7.69k ± 2% ~ (p=0.095 n=5+5)
zeo/py/fs1-zwrk.go·8 8.30k ± 2% 8.02k ± 1% -3.33% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·12 8.15k ± 1% 8.40k ± 2% +3.06% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·16 8.25k ± 1% 8.46k ± 1% +2.60% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 4.31k ± 4% 4.22k ± 2% ~ (p=0.222 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 6.28k ± 5% 6.29k ± 3% ~ (p=0.548 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 6.38k ± 0% 6.29k ± 2% -1.48% (p=0.016 n=4+5)
neo/py(!log)/sqlite-zwrk.go·4 6.15k ± 5% 6.26k ± 3% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 6.27k ± 4% 6.18k ± 3% ~ (p=0.222 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 6.33k ± 2% 6.04k ± 5% -4.50% (p=0.032 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 6.25k ± 4% 6.21k ± 5% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·1 3.10k ± 6% 3.27k ±13% ~ (p=0.548 n=5+5)
neo/py(!log)/sql-zwrk.go·2 3.98k ± 1% 3.98k ± 3% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·3 4.04k ± 3% 3.97k ± 4% ~ (p=0.690 n=5+5)
neo/py(!log)/sql-zwrk.go·4 4.06k ± 4% 3.95k ± 5% ~ (p=0.222 n=5+5)
neo/py(!log)/sql-zwrk.go·8 3.79k ± 7% 4.07k ± 4% +7.21% (p=0.032 n=5+5)
neo/py(!log)/sql-zwrk.go·12 3.98k ± 3% 4.11k ± 6% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·16 3.94k ± 1% 4.03k ± 9% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·1 12.8k ± 0% 12.9k ± 1% ~ (p=0.548 n=5+5)
neo/go/fs1-zwrk.go·2 24.8k ± 0% 24.9k ± 0% ~ (p=0.556 n=4+5)
neo/go/fs1-zwrk.go·3 32.3k ± 0% 32.3k ± 0% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·4 40.7k ± 0% 40.9k ± 0% +0.37% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·8 54.5k ± 1% 54.7k ± 1% ~ (p=0.421 n=5+5)
neo/go/fs1-zwrk.go·12 56.5k ± 1% 56.5k ± 1% ~ (p=1.000 n=5+5)
neo/go/fs1-zwrk.go·16 53.2k ±10% 54.5k ± 1% ~ (p=0.548 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 19.0k ± 2% 19.0k ± 2% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 37.8k ± 0% 37.5k ± 2% ~ (p=0.222 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 48.0k ± 1% 48.0k ± 0% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 59.0k ± 0% 59.0k ± 0% ~ (p=0.548 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 78.0k ± 1% 78.1k ± 0% ~ (p=0.690 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 82.2k ± 2% 80.7k ± 7% ~ (p=0.421 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 80.4k ± 1% 80.7k ± 1% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go·1 8.06k ± 4% 8.12k ± 0% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go·2 14.9k ± 0% 14.9k ± 0% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go·3 20.7k ± 0% 20.9k ± 0% +0.59% (p=0.016 n=5+5)
neo/go/sqlite-zwrk.go·4 24.8k ± 0% 25.0k ± 0% +0.78% (p=0.016 n=5+4)
neo/go/sqlite-zwrk.go·8 31.7k ± 1% 32.1k ± 1% +1.34% (p=0.016 n=5+5)
neo/go/sqlite-zwrk.go·12 30.8k ± 5% 32.3k ± 1% +4.85% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·16 30.4k ± 2% 30.6k ±10% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 8.95k ± 1% 8.84k ± 1% -1.25% (p=0.032 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 16.2k ± 1% 16.2k ± 0% ~ (p=0.548 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 22.6k ± 0% 22.5k ± 0% -0.34% (p=0.016 n=4+5)
neo/go/sqlite-zwrk.go(!sha1)·4 27.9k ± 0% 27.5k ± 0% -1.27% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 35.0k ± 1% 34.2k ± 1% -2.32% (p=0.016 n=5+4)
neo/go/sqlite-zwrk.go(!sha1)·12 34.7k ± 1% 33.4k ± 2% -3.75% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 33.0k ±11% 32.8k ± 2% ~ (p=0.222 n=5+5)
cluster:neo1 dataset:prod1-1024
fs1-zwrk.go·1 451k ± 0% 454k ± 0% ~ (p=0.056 n=5+5)
fs1-zwrk.go·2 893k ± 0% 899k ± 0% +0.68% (p=0.008 n=5+5)
fs1-zwrk.go·3 1.34M ± 1% 1.31M ± 8% ~ (p=0.841 n=5+5)
fs1-zwrk.go·4 1.77M ± 0% 1.77M ± 1% ~ (p=0.841 n=5+5)
fs1-zwrk.go·8 1.99M ± 1% 2.02M ± 2% ~ (p=0.151 n=5+5)
fs1-zwrk.go·12 2.03M ± 1% 2.04M ± 0% ~ (p=0.190 n=4+5)
fs1-zwrk.go·16 2.03M ± 0% 2.04M ± 0% ~ (p=0.841 n=5+5)
zeo/py/fs1-zwrk.go·1 5.79k ± 3% 5.84k ± 4% ~ (p=0.548 n=5+5)
zeo/py/fs1-zwrk.go·2 8.55k ± 1% 8.59k ± 2% ~ (p=0.310 n=5+5)
zeo/py/fs1-zwrk.go·3 9.28k ± 7% 9.37k ± 2% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·4 9.72k ± 1% 9.75k ± 3% ~ (p=0.841 n=5+5)
zeo/py/fs1-zwrk.go·8 10.4k ± 1% 10.2k ± 3% -1.89% (p=0.032 n=5+5)
zeo/py/fs1-zwrk.go·12 10.5k ± 1% 10.5k ± 1% ~ (p=0.841 n=5+5)
zeo/py/fs1-zwrk.go·16 10.4k ± 4% 10.5k ± 1% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 4.90k ± 7% 4.79k ± 5% ~ (p=0.548 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 6.28k ± 4% 6.49k ± 0% ~ (p=0.190 n=5+4)
neo/py(!log)/sqlite-zwrk.go·3 6.32k ± 5% 6.37k ± 6% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 6.45k ± 2% 6.41k ± 1% ~ (p=0.548 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 6.45k ± 2% 6.36k ± 5% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 6.31k ± 3% 6.43k ± 0% ~ (p=0.556 n=5+4)
neo/py(!log)/sqlite-zwrk.go·16 6.36k ± 5% 6.37k ± 1% ~ (p=0.310 n=5+5)
neo/py(!log)/sql-zwrk.go·1 3.50k ± 9% 3.32k ±13% ~ (p=0.310 n=5+5)
neo/py(!log)/sql-zwrk.go·2 4.05k ± 6% 4.08k ± 7% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zwrk.go·3 4.06k ± 7% 4.11k ± 3% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·4 3.98k ± 4% 4.08k ± 4% ~ (p=0.548 n=5+5)
neo/py(!log)/sql-zwrk.go·8 4.15k ± 3% 3.98k ± 3% ~ (p=0.056 n=5+5)
neo/py(!log)/sql-zwrk.go·12 4.00k ± 5% 4.11k ± 5% ~ (p=0.310 n=5+5)
neo/py(!log)/sql-zwrk.go·16 3.96k ±11% 4.22k ± 4% ~ (p=0.151 n=5+5)
neo/go/fs1-zwrk.go·1 17.1k ± 1% 17.3k ± 1% +1.36% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·2 32.6k ± 0% 32.8k ± 1% ~ (p=0.111 n=5+4)
neo/go/fs1-zwrk.go·3 43.3k ± 0% 43.3k ± 0% ~ (p=0.690 n=5+5)
neo/go/fs1-zwrk.go·4 52.9k ± 0% 53.0k ± 0% ~ (p=0.690 n=5+5)
neo/go/fs1-zwrk.go·8 66.3k ± 1% 66.5k ± 1% ~ (p=0.905 n=4+5)
neo/go/fs1-zwrk.go·12 61.6k ± 1% 60.7k ± 2% ~ (p=0.310 n=5+5)
neo/go/fs1-zwrk.go·16 55.6k ± 4% 55.5k ± 2% ~ (p=0.841 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 19.6k ± 5% 20.1k ± 2% ~ (p=0.151 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 40.3k ± 0% 40.2k ± 1% ~ (p=0.548 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 51.6k ± 0% 51.5k ± 0% ~ (p=0.548 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 62.0k ± 0% 62.1k ± 0% ~ (p=0.548 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 74.2k ± 4% 74.3k ± 2% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 64.8k ± 7% 67.1k ± 3% ~ (p=0.222 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 59.5k ± 4% 59.5k ± 2% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go·1 9.02k ± 1% 8.89k ± 4% ~ (p=0.310 n=5+5)
neo/go/sqlite-zwrk.go·2 16.0k ± 0% 15.9k ± 0% -0.66% (p=0.016 n=5+5)
neo/go/sqlite-zwrk.go·3 21.8k ± 1% 21.8k ± 1% ~ (p=0.286 n=4+5)
neo/go/sqlite-zwrk.go·4 26.2k ± 0% 26.2k ± 0% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go·8 30.0k ± 2% 29.9k ± 1% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go·12 28.6k ± 2% 28.7k ± 0% ~ (p=0.556 n=5+4)
neo/go/sqlite-zwrk.go·16 28.7k ± 1% 28.8k ± 1% ~ (p=0.905 n=4+5)
neo/go/sqlite-zwrk.go(!sha1)·1 9.45k ± 1% 9.33k ± 1% -1.20% (p=0.032 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 16.6k ± 1% 16.4k ± 0% -1.24% (p=0.016 n=5+4)
neo/go/sqlite-zwrk.go(!sha1)·3 23.0k ± 0% 22.7k ± 0% -1.44% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 28.0k ± 1% 27.4k ± 0% -2.10% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 32.3k ± 0% 31.4k ± 1% -2.83% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 30.6k ± 2% 29.8k ± 1% -2.48% (p=0.016 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 30.3k ± 2% 29.6k ± 2% -2.37% (p=0.032 n=5+5)

name old latency-time/object new latency-time/object delta
cluster:neo1 dataset:wczblk1-8
fs1-zwrk.go·1 4.36µs ± 0% 4.35µs ± 0% -0.37% (p=0.016 n=5+5)
fs1-zwrk.go·2 4.52µs ± 1% 4.47µs ± 1% -1.07% (p=0.032 n=5+5)
fs1-zwrk.go·3 4.53µs ± 1% 4.51µs ± 0% -0.61% (p=0.040 n=5+5)
fs1-zwrk.go·4 4.61µs ± 1% 4.60µs ± 0% ~ (p=0.413 n=5+4)
fs1-zwrk.go·8 8.10µs ± 0% 8.07µs ± 0% ~ (p=0.095 n=5+5)
fs1-zwrk.go·12 11.8µs ± 0% 11.8µs ± 0% ~ (p=0.841 n=5+5)
fs1-zwrk.go·16 16.5µs ±13% 15.7µs ± 0% ~ (p=0.421 n=5+5)
zeo/py/fs1-zwrk.go·1 194µs ± 1% 198µs ± 1% +1.81% (p=0.032 n=5+5)
zeo/py/fs1-zwrk.go·2 282µs ± 1% 289µs ± 2% +2.29% (p=0.032 n=5+5)
zeo/py/fs1-zwrk.go·3 388µs ± 1% 401µs ± 1% +3.30% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·4 502µs ± 5% 520µs ± 2% ~ (p=0.095 n=5+5)
zeo/py/fs1-zwrk.go·8 964µs ± 2% 997µs ± 1% +3.43% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·12 1.47ms ± 1% 1.43ms ± 2% -2.97% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·16 1.94ms ± 1% 1.89ms ± 1% -2.54% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 232µs ± 4% 237µs ± 2% ~ (p=0.222 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 319µs ± 5% 318µs ± 3% ~ (p=0.548 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 470µs ± 0% 477µs ± 2% +1.52% (p=0.016 n=4+5)
neo/py(!log)/sqlite-zwrk.go·4 651µs ± 5% 639µs ± 3% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 1.28ms ± 4% 1.30ms ± 3% ~ (p=0.222 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 1.90ms ± 2% 1.99ms ± 5% +4.85% (p=0.032 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 2.56ms ± 4% 2.58ms ± 5% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·1 323µs ± 6% 308µs ±13% ~ (p=0.548 n=5+5)
neo/py(!log)/sql-zwrk.go·2 503µs ± 2% 503µs ± 3% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·3 742µs ± 3% 756µs ± 4% ~ (p=0.690 n=5+5)
neo/py(!log)/sql-zwrk.go·4 986µs ± 4% 1014µs ± 5% ~ (p=0.222 n=5+5)
neo/py(!log)/sql-zwrk.go·8 2.11ms ± 8% 1.97ms ± 4% -6.85% (p=0.032 n=5+5)
neo/py(!log)/sql-zwrk.go·12 3.02ms ± 3% 2.92ms ± 6% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·16 4.06ms ± 1% 3.98ms ± 8% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·1 77.8µs ± 0% 77.3µs ± 1% ~ (p=0.548 n=5+5)
neo/go/fs1-zwrk.go·2 80.6µs ± 0% 80.4µs ± 0% ~ (p=0.556 n=4+5)
neo/go/fs1-zwrk.go·3 92.8µs ± 0% 92.8µs ± 0% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·4 98.2µs ± 0% 97.8µs ± 0% -0.36% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·8 147µs ± 1% 146µs ± 1% ~ (p=0.421 n=5+5)
neo/go/fs1-zwrk.go·12 212µs ± 1% 212µs ± 1% ~ (p=1.000 n=5+5)
neo/go/fs1-zwrk.go·16 293µs ± 1% 294µs ± 1% ~ (p=0.905 n=4+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 52.7µs ± 2% 52.6µs ± 2% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 53.0µs ± 0% 53.3µs ± 2% ~ (p=0.222 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 62.5µs ± 1% 62.5µs ± 0% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 67.8µs ± 0% 67.8µs ± 0% ~ (p=0.548 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 103µs ± 1% 102µs ± 0% ~ (p=0.690 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 146µs ± 2% 149µs ± 7% ~ (p=0.421 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 199µs ± 1% 198µs ± 1% ~ (p=0.802 n=5+5)
neo/go/sqlite-zwrk.go·1 124µs ± 4% 123µs ± 0% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go·2 134µs ± 0% 134µs ± 0% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go·3 145µs ± 0% 144µs ± 0% -0.59% (p=0.016 n=5+5)
neo/go/sqlite-zwrk.go·4 161µs ± 0% 160µs ± 0% -0.77% (p=0.016 n=5+4)
neo/go/sqlite-zwrk.go·8 252µs ± 1% 249µs ± 1% -1.32% (p=0.016 n=5+5)
neo/go/sqlite-zwrk.go·12 390µs ± 5% 372µs ± 1% -4.68% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·16 526µs ± 2% 524µs ±11% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 112µs ± 1% 113µs ± 1% +1.26% (p=0.032 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 124µs ± 1% 124µs ± 0% ~ (p=0.548 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 133µs ± 0% 133µs ± 0% +0.34% (p=0.016 n=4+5)
neo/go/sqlite-zwrk.go(!sha1)·4 143µs ± 0% 145µs ± 0% +1.29% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 228µs ± 1% 234µs ± 1% +2.37% (p=0.016 n=5+4)
neo/go/sqlite-zwrk.go(!sha1)·12 346µs ± 1% 360µs ± 2% +3.91% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 486µs ±11% 487µs ± 2% ~ (p=0.222 n=5+5)
cluster:neo1 dataset:prod1-1024
fs1-zwrk.go·1 2.22µs ± 1% 2.21µs ± 0% ~ (p=0.056 n=5+5)
fs1-zwrk.go·2 2.24µs ± 0% 2.23µs ± 0% -0.69% (p=0.008 n=5+5)
fs1-zwrk.go·3 2.25µs ± 1% 2.30µs ± 9% ~ (p=0.841 n=5+5)
fs1-zwrk.go·4 2.26µs ± 0% 2.26µs ± 1% ~ (p=0.714 n=5+5)
fs1-zwrk.go·8 4.02µs ± 1% 3.97µs ± 2% ~ (p=0.111 n=5+5)
fs1-zwrk.go·12 5.92µs ± 1% 5.90µs ± 0% ~ (p=0.190 n=4+5)
fs1-zwrk.go·16 7.87µs ± 0% 7.86µs ± 0% ~ (p=0.738 n=5+5)
zeo/py/fs1-zwrk.go·1 173µs ± 3% 171µs ± 4% ~ (p=0.548 n=5+5)
zeo/py/fs1-zwrk.go·2 234µs ± 1% 233µs ± 2% ~ (p=0.310 n=5+5)
zeo/py/fs1-zwrk.go·3 324µs ± 7% 320µs ± 2% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·4 412µs ± 1% 410µs ± 3% ~ (p=0.841 n=5+5)
zeo/py/fs1-zwrk.go·8 768µs ± 1% 783µs ± 3% +1.95% (p=0.032 n=5+5)
zeo/py/fs1-zwrk.go·12 1.14ms ± 1% 1.14ms ± 1% ~ (p=0.841 n=5+5)
zeo/py/fs1-zwrk.go·16 1.54ms ± 4% 1.53ms ± 1% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 204µs ± 8% 209µs ± 5% ~ (p=0.548 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 319µs ± 4% 308µs ± 0% ~ (p=0.190 n=5+4)
neo/py(!log)/sqlite-zwrk.go·3 475µs ± 5% 472µs ± 6% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 620µs ± 2% 624µs ± 1% ~ (p=0.548 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 1.24ms ± 2% 1.26ms ± 6% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 1.90ms ± 3% 1.87ms ± 0% ~ (p=0.556 n=5+4)
neo/py(!log)/sqlite-zwrk.go·16 2.52ms ± 5% 2.51ms ± 1% ~ (p=0.310 n=5+5)
neo/py(!log)/sql-zwrk.go·1 287µs ± 8% 304µs ±13% ~ (p=0.310 n=5+5)
neo/py(!log)/sql-zwrk.go·2 495µs ± 6% 491µs ± 7% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zwrk.go·3 740µs ± 8% 730µs ± 3% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·4 1.01ms ± 4% 0.98ms ± 4% ~ (p=0.548 n=5+5)
neo/py(!log)/sql-zwrk.go·8 1.93ms ± 3% 2.01ms ± 3% ~ (p=0.056 n=5+5)
neo/py(!log)/sql-zwrk.go·12 3.01ms ± 4% 2.92ms ± 5% ~ (p=0.310 n=5+5)
neo/py(!log)/sql-zwrk.go·16 4.05ms ±10% 3.79ms ± 4% ~ (p=0.151 n=5+5)
neo/go/fs1-zwrk.go·1 58.5µs ± 1% 57.8µs ± 1% -1.34% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·2 61.4µs ± 0% 61.1µs ± 1% ~ (p=0.111 n=5+4)
neo/go/fs1-zwrk.go·3 69.3µs ± 0% 69.3µs ± 0% ~ (p=0.651 n=5+5)
neo/go/fs1-zwrk.go·4 75.6µs ± 0% 75.5µs ± 0% ~ (p=0.690 n=5+5)
neo/go/fs1-zwrk.go·8 121µs ± 1% 120µs ± 1% ~ (p=0.905 n=4+5)
neo/go/fs1-zwrk.go·12 195µs ± 1% 198µs ± 2% ~ (p=0.310 n=5+5)
neo/go/fs1-zwrk.go·16 288µs ± 4% 289µs ± 2% ~ (p=0.841 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 50.9µs ± 5% 49.9µs ± 2% ~ (p=0.151 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 49.7µs ± 0% 49.8µs ± 1% ~ (p=0.548 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 58.2µs ± 0% 58.3µs ± 0% ~ (p=0.548 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 64.5µs ± 0% 64.4µs ± 0% ~ (p=0.548 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 108µs ± 4% 108µs ± 2% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 185µs ± 8% 179µs ± 3% ~ (p=0.222 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 269µs ± 4% 269µs ± 2% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go·1 111µs ± 1% 113µs ± 4% ~ (p=0.310 n=5+5)
neo/go/sqlite-zwrk.go·2 125µs ± 0% 126µs ± 0% +0.66% (p=0.016 n=5+5)
neo/go/sqlite-zwrk.go·3 137µs ± 1% 138µs ± 1% ~ (p=0.286 n=4+5)
neo/go/sqlite-zwrk.go·4 153µs ± 0% 152µs ± 0% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go·8 267µs ± 1% 267µs ± 1% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go·12 420µs ± 2% 418µs ± 0% ~ (p=0.556 n=5+4)
neo/go/sqlite-zwrk.go·16 558µs ± 1% 556µs ± 1% ~ (p=0.905 n=4+5)
neo/go/sqlite-zwrk.go(!sha1)·1 106µs ± 1% 107µs ± 1% +1.21% (p=0.032 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 121µs ± 1% 122µs ± 0% +1.25% (p=0.016 n=5+4)
neo/go/sqlite-zwrk.go(!sha1)·3 130µs ± 0% 132µs ± 0% +1.47% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 143µs ± 1% 146µs ± 0% +2.14% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 248µs ± 0% 255µs ± 1% +2.92% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 393µs ± 2% 403µs ± 1% +2.53% (p=0.016 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 528µs ± 2% 541µs ± 2% +2.42% (p=0.032 n=5+5)

4cbd62f7

fixup! X neotest: Also show target-latency for C-states · 1e438610
Kirill Smelkov authored Mar 09, 2018

1e438610

08 Mar, 2018 3 commits
- X neotest: Tzwrk1 - place to control running time of 1 zwrk iteration · ca0d828b
  Kirill Smelkov authored Mar 08, 2018
  
  ca0d828b
- X neotest: Also show target-latency for C-states · 4af48245
  Kirill Smelkov authored Mar 08, 2018
  
  4af48245
- X neotest: Don't fail silently if network address detection fails · f694d643
  Kirill Smelkov authored Mar 08, 2018
```
(spotted/fixed on my phone in termux)
```
  f694d643
06 Mar, 2018 10 commits

X deco: localhost timings, C > C1 disabled (remeasure) · 620b723c

Kirill Smelkov authored Mar 06, 2018

As it was promised in 0867c981 here comes remeasurement of deco timings
with C-states disabled. And the results are the same, thus confirming
zeo/py/fs-<go-client> both speedup and slowdown:

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

$ benchstat -split node,cluster,dataset "20180306-deco-ffixed-c.txt" "20180306-deco-ffixed-noc_C1(2µs).txt.2"

name old pystone/s new pystone/s delta
node:deco
pystone 217k ± 4% 217k ± 2% ~ (p=1.000 n=5+5)

name old time/op new time/op delta
node:deco
crc32/py/4K 5.73µs ± 0% 5.73µs ± 0% ~ (p=0.841 n=5+5)
crc32/go/4K 279ns ± 0% 279ns ± 0% ~ (all equal)
sha1/py/4K 6.74µs ± 1% 6.71µs ± 1% ~ (p=0.310 n=5+5)
sha1/go/4K 5.60µs ± 0% 5.59µs ± 0% -0.18% (p=0.024 n=5+5)
unzlib/py/wczdata 27.2µs ± 1% 27.1µs ± 1% ~ (p=0.452 n=5+5)
unzlib/go/wczdata 27.0µs ± 0% 26.8µs ± 0% -0.62% (p=0.008 n=5+5)
unzlib/py/prod1-avg 5.14µs ± 3% 5.13µs ± 1% ~ (p=1.000 n=5+5)
unzlib/go/prod1-avg 5.30µs ± 1% 5.28µs ± 0% -0.47% (p=0.016 n=5+5)
disk/randread/direct/4K-min 104µs ± 2% 105µs ± 0% +1.48% (p=0.016 n=5+4)
disk/randread/direct/4K-avg 141µs ± 0% 142µs ± 0% +0.95% (p=0.008 n=5+5)
disk/randread/pagecache/4K-min 579ns ± 2% 584ns ± 2% ~ (p=0.310 n=5+5)
disk/randread/pagecache/4K-avg 993ns ± 0% 986ns ± 0% -0.70% (p=0.008 n=5+5)

name old time/object new time/object delta
cluster:deco dataset:wczblk1-8
fs1-zhash.py 20.3µs ± 1% 20.3µs ± 2% ~ (p=0.524 n=4+5)
fs1-zhash.go 3.26µs ± 4% 3.20µs ± 0% ~ (p=0.333 n=5+4)
fs1-zhash.go+prefetch128 4.04µs ± 1% 4.00µs ± 7% ~ (p=1.000 n=5+5)
zeo/py/fs1-zhash.py 383µs ± 5% 364µs ± 5% ~ (p=0.095 n=5+5)
zeo/py/fs1-zhash.go 126µs ± 1% 113µs ± 1% -10.03% (p=0.008 n=5+5)
zeo/py/fs1-zhash.go+prefetch128 63.1µs ± 1% 64.0µs ± 2% ~ (p=0.254 n=5+5)
neo/py(!log)/sqlite-zhash.py 344µs ± 6% 318µs ± 2% -7.43% (p=0.016 n=5+5)
neo/py(!log)/sqlite-zhash.go 140µs ± 1% 142µs ± 3% ~ (p=0.286 n=5+5)
neo/py(!log)/sqlite-zhash.go+prefetch128 119µs ± 2% 119µs ± 2% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zhash.py 386µs ± 1% 382µs ± 3% ~ (p=0.686 n=4+4)
neo/py(!log)/sql-zhash.go 183µs ± 3% 189µs ± 4% ~ (p=0.222 n=5+5)
neo/py(!log)/sql-zhash.go+prefetch128 164µs ± 3% 164µs ± 2% ~ (p=0.841 n=5+5)
neo/go/fs1-zhash.py 226µs ± 3% 222µs ± 2% ~ (p=0.167 n=5+5)
neo/go/fs1-zhash.go 57.1µs ± 0% 56.7µs ± 0% -0.84% (p=0.008 n=5+5)
neo/go/fs1-zhash.go+prefetch128 24.7µs ± 5% 24.5µs ± 5% ~ (p=0.643 n=5+5)
neo/go/fs1(!sha1)-zhash.go(!sha1) 40.2µs ± 1% 40.3µs ± 2% ~ (p=0.849 n=5+5)
neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 17.1µs ± 6% 17.3µs ± 7% ~ (p=0.881 n=5+5)
neo/go/sqlite-zhash.py 272µs ± 3% 254µs ± 2% -6.63% (p=0.008 n=5+5)
neo/go/sqlite-zhash.go 92.8µs ± 0% 94.8µs ± 0% +2.20% (p=0.016 n=4+5)
neo/go/sqlite-zhash.go+prefetch128 40.5µs ± 5% 41.6µs ±13% ~ (p=0.421 n=5+5)
neo/go/sqlite-zhash.go(!sha1) 86.5µs ± 2% 87.0µs ± 2% ~ (p=0.175 n=5+5)
neo/go/sqlite-zhash.go+prefetch128(!sha1) 38.8µs ± 9% 37.9µs ± 9% ~ (p=0.421 n=5+5)
cluster:deco dataset:prod1-1024
fs1-zhash.py 15.8µs ± 3% 15.8µs ± 1% ~ (p=0.619 n=4+5)
fs1-zhash.go 2.80µs ± 0% 2.80µs ± 0% ~ (all equal)
fs1-zhash.go+prefetch128 3.42µs ± 8% 3.50µs ±17% ~ (p=1.000 n=5+5)
zeo/py/fs1-zhash.py 361µs ± 5% 355µs ± 4% ~ (p=0.421 n=5+5)
zeo/py/fs1-zhash.go 105µs ± 0% 105µs ± 1% ~ (p=0.595 n=5+5)
zeo/py/fs1-zhash.go+prefetch128 58.9µs ± 1% 58.5µs ± 2% ~ (p=0.302 n=5+5)
neo/py(!log)/sqlite-zhash.py 344µs ± 7% 315µs ± 5% -8.63% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zhash.go 137µs ± 2% 135µs ± 1% ~ (p=0.103 n=5+5)
neo/py(!log)/sqlite-zhash.go+prefetch128 114µs ± 1% 112µs ± 0% -1.67% (p=0.008 n=5+5)
neo/py(!log)/sql-zhash.py 380µs ± 4% 376µs ± 2% ~ (p=0.886 n=4+4)
neo/py(!log)/sql-zhash.go 180µs ± 1% 183µs ± 2% +2.06% (p=0.016 n=5+5)
neo/py(!log)/sql-zhash.go+prefetch128 159µs ± 1% 158µs ± 1% -0.79% (p=0.048 n=5+5)
neo/go/fs1-zhash.py 221µs ± 1% 223µs ± 2% ~ (p=0.524 n=5+5)
neo/go/fs1-zhash.go 45.2µs ± 2% 44.3µs ± 1% -1.99% (p=0.008 n=5+5)
neo/go/fs1-zhash.go+prefetch128 17.6µs ± 2% 17.4µs ± 6% ~ (p=0.246 n=5+5)
neo/go/fs1(!sha1)-zhash.go(!sha1) 39.1µs ± 2% 39.0µs ± 1% ~ (p=0.643 n=5+5)
neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 14.6µs ± 4% 14.5µs ± 3% ~ (p=1.000 n=5+5)
neo/go/sqlite-zhash.py 271µs ± 2% 252µs ± 1% -7.10% (p=0.008 n=5+5)
neo/go/sqlite-zhash.go 86.4µs ± 0% 86.6µs ± 1% ~ (p=0.444 n=5+5)
neo/go/sqlite-zhash.go+prefetch128 35.8µs ± 2% 37.6µs ± 2% +5.02% (p=0.008 n=5+5)
neo/go/sqlite-zhash.go(!sha1) 84.0µs ± 1% 83.5µs ± 1% ~ (p=0.230 n=5+5)
neo/go/sqlite-zhash.go+prefetch128(!sha1) 36.5µs ± 5% 35.7µs ± 7% ~ (p=0.381 n=5+5)

name old req/s new req/s delta
cluster:deco dataset:wczblk1-8
fs1-zwrk.go·1 436k ± 0% 437k ± 1% ~ (p=0.222 n=5+5)
fs1-zwrk.go·2 744k ± 1% 750k ± 3% ~ (p=0.690 n=5+5)
fs1-zwrk.go·3 1.09M ± 0% 1.08M ± 0% -0.42% (p=0.016 n=5+5)
fs1-zwrk.go·4 1.16M ± 1% 1.16M ± 1% ~ (p=0.841 n=5+5)
fs1-zwrk.go·8 1.27M ± 1% 1.27M ± 1% ~ (p=0.421 n=5+5)
fs1-zwrk.go·12 1.27M ± 1% 1.28M ± 0% ~ (p=0.190 n=5+4)
fs1-zwrk.go·16 1.27M ± 1% 1.28M ± 1% ~ (p=0.151 n=5+5)
zeo/py/fs1-zwrk.go·1 9.12k ± 0% 8.14k ± 0% -10.75% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·2 11.6k ± 1% 9.5k ± 1% -17.53% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·3 13.4k ± 1% 10.5k ± 1% -21.27% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·4 14.0k ± 1% 10.9k ± 1% -22.08% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·8 14.7k ± 1% 11.5k ± 1% -21.84% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·12 15.0k ± 1% 11.6k ± 2% -22.49% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·16 15.1k ± 0% 11.8k ± 1% -22.02% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 7.09k ± 1% 7.08k ± 1% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 8.48k ± 1% 8.52k ± 0% ~ (p=0.095 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 8.48k ± 1% 8.48k ± 1% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 8.47k ± 1% 8.45k ± 1% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 8.43k ± 1% 8.52k ± 1% ~ (p=0.095 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 8.46k ± 1% 8.57k ± 1% ~ (p=0.056 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 8.46k ± 1% 8.57k ± 0% +1.32% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·1 5.51k ± 1% 5.36k ± 2% -2.78% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·2 6.32k ± 1% 6.21k ± 1% -1.66% (p=0.016 n=5+5)
neo/py(!log)/sql-zwrk.go·3 6.29k ± 1% 6.24k ± 0% ~ (p=0.190 n=5+4)
neo/py(!log)/sql-zwrk.go·4 6.27k ± 1% 6.17k ± 2% -1.63% (p=0.032 n=5+5)
neo/py(!log)/sql-zwrk.go·8 6.27k ± 1% 6.12k ± 0% -2.39% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·12 6.29k ± 0% 6.15k ± 1% -2.22% (p=0.016 n=5+4)
neo/py(!log)/sql-zwrk.go·16 6.22k ± 1% 6.14k ± 3% ~ (p=0.151 n=5+5)
neo/go/fs1-zwrk.go·1 18.4k ± 1% 18.4k ± 0% ~ (p=0.548 n=5+5)
neo/go/fs1-zwrk.go·2 38.1k ± 1% 38.3k ± 0% ~ (p=0.421 n=5+5)
neo/go/fs1-zwrk.go·3 46.0k ± 1% 46.1k ± 1% ~ (p=0.421 n=5+5)
neo/go/fs1-zwrk.go·4 50.2k ± 1% 50.3k ± 1% ~ (p=0.690 n=5+5)
neo/go/fs1-zwrk.go·8 61.0k ± 0% 60.8k ± 1% ~ (p=0.421 n=5+5)
neo/go/fs1-zwrk.go·12 62.1k ± 1% 62.5k ± 1% ~ (p=0.421 n=5+5)
neo/go/fs1-zwrk.go·16 62.5k ± 1% 62.1k ± 2% ~ (p=0.310 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 26.3k ± 1% 26.3k ± 0% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 55.3k ± 1% 55.1k ± 0% ~ (p=0.421 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 62.7k ± 1% 62.6k ± 1% ~ (p=0.421 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 69.3k ± 1% 69.0k ± 1% ~ (p=0.310 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 88.2k ± 0% 87.7k ± 0% -0.47% (p=0.016 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 93.4k ± 0% 92.4k ± 1% -1.02% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 93.5k ± 2% 93.5k ± 1% ~ (p=0.548 n=5+5)
neo/go/sqlite-zwrk.go·1 11.0k ± 1% 10.9k ± 0% -1.25% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·2 18.4k ± 1% 18.2k ± 0% ~ (p=0.056 n=5+5)
neo/go/sqlite-zwrk.go·3 24.4k ± 1% 24.2k ± 1% ~ (p=0.095 n=5+5)
neo/go/sqlite-zwrk.go·4 26.8k ± 0% 26.8k ± 1% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go·8 30.4k ± 2% 30.0k ± 2% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go·12 30.5k ± 1% 29.5k ± 1% -3.47% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·16 29.9k ± 2% 28.5k ± 1% -4.81% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 11.9k ± 1% 11.9k ± 0% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 19.7k ± 0% 19.6k ± 1% ~ (p=0.548 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 26.5k ± 1% 26.7k ± 0% +0.84% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 30.0k ± 0% 30.4k ± 1% +1.43% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 31.2k ± 2% 32.1k ± 0% +2.82% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 28.9k ± 1% 30.2k ± 2% +4.46% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 28.4k ± 2% 29.7k ± 2% +4.60% (p=0.008 n=5+5)
cluster:deco dataset:prod1-1024
fs1-zwrk.go·1 555k ± 0% 558k ± 1% ~ (p=0.222 n=5+5)
fs1-zwrk.go·2 1.01M ± 3% 1.01M ± 8% ~ (p=0.548 n=5+5)
fs1-zwrk.go·3 1.32M ± 1% 1.33M ± 0% +0.69% (p=0.032 n=5+5)
fs1-zwrk.go·4 1.55M ± 2% 1.54M ± 3% ~ (p=1.000 n=5+5)
fs1-zwrk.go·8 1.59M ± 0% 1.59M ± 0% ~ (p=1.000 n=5+5)
fs1-zwrk.go·12 1.59M ± 0% 1.59M ± 0% ~ (p=0.095 n=5+5)
fs1-zwrk.go·16 1.59M ± 0% 1.59M ± 0% ~ (p=0.690 n=5+5)
zeo/py/fs1-zwrk.go·1 9.70k ± 0% 9.66k ± 0% ~ (p=0.095 n=5+5)
zeo/py/fs1-zwrk.go·2 12.4k ± 1% 12.3k ± 1% ~ (p=0.548 n=5+5)
zeo/py/fs1-zwrk.go·3 14.2k ± 1% 14.2k ± 1% ~ (p=0.310 n=5+5)
zeo/py/fs1-zwrk.go·4 14.9k ± 0% 14.9k ± 1% ~ (p=0.421 n=5+5)
zeo/py/fs1-zwrk.go·8 15.6k ± 0% 15.7k ± 1% ~ (p=0.151 n=5+5)
zeo/py/fs1-zwrk.go·12 15.2k ±11% 16.0k ± 1% +5.04% (p=0.032 n=5+4)
zeo/py/fs1-zwrk.go·16 16.1k ± 1% 16.1k ± 1% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 7.44k ± 1% 7.46k ± 1% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 8.59k ± 1% 8.67k ± 1% +0.91% (p=0.016 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 8.61k ± 1% 8.71k ± 1% +1.16% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 8.57k ± 1% 8.68k ± 0% +1.33% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 8.56k ± 1% 8.73k ± 1% +2.01% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 8.51k ± 1% 8.66k ± 1% +1.69% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 8.54k ± 1% 8.62k ± 1% ~ (p=0.222 n=5+5)
neo/py(!log)/sql-zwrk.go·1 5.55k ± 2% 5.47k ± 2% ~ (p=0.310 n=5+5)
neo/py(!log)/sql-zwrk.go·2 6.36k ± 1% 6.37k ± 0% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·3 6.31k ± 0% 6.30k ± 1% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·4 6.28k ± 0% 6.33k ± 0% +0.78% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·8 6.34k ± 1% 6.36k ± 1% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zwrk.go·12 6.35k ± 1% 6.36k ± 1% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·16 6.36k ± 0% 6.35k ± 0% ~ (p=0.690 n=5+5)
neo/go/fs1-zwrk.go·1 23.7k ± 0% 24.0k ± 0% +1.23% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·2 45.4k ± 0% 45.6k ± 1% ~ (p=0.056 n=5+5)
neo/go/fs1-zwrk.go·3 55.2k ± 1% 55.5k ± 1% ~ (p=0.056 n=5+5)
neo/go/fs1-zwrk.go·4 60.7k ± 2% 60.7k ± 0% ~ (p=1.000 n=5+5)
neo/go/fs1-zwrk.go·8 70.9k ± 2% 69.3k ± 3% ~ (p=0.095 n=5+5)
neo/go/fs1-zwrk.go·12 71.1k ± 3% 69.5k ± 7% ~ (p=0.421 n=5+5)
neo/go/fs1-zwrk.go·16 71.0k ± 3% 67.8k ± 2% -4.43% (p=0.016 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 27.3k ± 0% 27.1k ± 0% -0.92% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 55.4k ± 1% 55.4k ± 1% ~ (p=0.841 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 64.0k ± 1% 62.9k ± 1% -1.62% (p=0.016 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 69.0k ± 1% 68.4k ± 1% -0.87% (p=0.032 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 80.9k ± 2% 79.9k ± 3% ~ (p=0.310 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 78.3k ± 5% 77.6k ± 4% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 75.4k ± 3% 77.7k ± 7% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go·1 11.7k ± 1% 11.7k ± 0% ~ (p=0.310 n=5+5)
neo/go/sqlite-zwrk.go·2 19.0k ± 0% 19.1k ± 0% ~ (p=0.056 n=5+5)
neo/go/sqlite-zwrk.go·3 24.5k ± 1% 24.3k ± 1% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go·4 26.3k ± 1% 26.3k ± 1% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go·8 24.9k ± 3% 24.8k ± 3% ~ (p=0.548 n=5+5)
neo/go/sqlite-zwrk.go·12 24.0k ± 5% 23.6k ± 2% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go·16 25.4k ± 1% 24.3k ± 1% -4.16% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 12.2k ± 0% 12.2k ± 0% ~ (p=0.095 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 19.8k ± 0% 19.6k ± 0% -0.97% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 26.2k ± 1% 26.2k ± 2% ~ (p=0.222 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 28.7k ± 1% 29.1k ± 1% +1.21% (p=0.032 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 27.2k ± 3% 27.3k ± 2% ~ (p=0.548 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 25.3k ± 2% 25.5k ± 1% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 25.3k ± 1% 25.5k ± 1% ~ (p=0.095 n=5+5)

name old latency-time/object new latency-time/object delta
cluster:deco dataset:wczblk1-8
fs1-zwrk.go·1 2.29µs ± 0% 2.29µs ± 1% ~ (p=0.198 n=5+5)
fs1-zwrk.go·2 2.69µs ± 1% 2.67µs ± 3% ~ (p=0.738 n=5+5)
fs1-zwrk.go·3 2.76µs ± 0% 2.77µs ± 0% +0.42% (p=0.016 n=5+5)
fs1-zwrk.go·4 3.44µs ± 1% 3.44µs ± 1% ~ (p=0.730 n=5+5)
fs1-zwrk.go·8 6.28µs ± 1% 6.29µs ± 1% ~ (p=0.421 n=5+5)
fs1-zwrk.go·12 9.46µs ± 1% 9.35µs ± 0% ~ (p=0.159 n=5+4)
fs1-zwrk.go·16 12.6µs ± 1% 12.5µs ± 1% ~ (p=0.151 n=5+5)
zeo/py/fs1-zwrk.go·1 110µs ± 0% 123µs ± 0% +12.04% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·2 173µs ± 1% 210µs ± 1% +21.26% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·3 224µs ± 1% 285µs ± 1% +27.02% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·4 286µs ± 1% 366µs ± 1% +28.34% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·8 545µs ± 1% 698µs ± 1% +27.94% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·12 802µs ± 1% 1034µs ± 2% +29.03% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·16 1.06ms ± 0% 1.36ms ± 1% +28.25% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 141µs ± 1% 141µs ± 1% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 236µs ± 1% 235µs ± 0% ~ (p=0.095 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 354µs ± 1% 354µs ± 1% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 472µs ± 1% 474µs ± 1% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 949µs ± 1% 939µs ± 1% ~ (p=0.095 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 1.42ms ± 1% 1.40ms ± 1% ~ (p=0.056 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 1.89ms ± 1% 1.87ms ± 0% -1.30% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·1 181µs ± 1% 187µs ± 2% +2.87% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·2 317µs ± 1% 322µs ± 1% +1.68% (p=0.016 n=5+5)
neo/py(!log)/sql-zwrk.go·3 477µs ± 1% 481µs ± 0% ~ (p=0.190 n=5+4)
neo/py(!log)/sql-zwrk.go·4 638µs ± 1% 648µs ± 2% +1.66% (p=0.032 n=5+5)
neo/py(!log)/sql-zwrk.go·8 1.28ms ± 1% 1.31ms ± 0% +2.44% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·12 1.91ms ± 0% 1.95ms ± 1% +2.28% (p=0.016 n=5+4)
neo/py(!log)/sql-zwrk.go·16 2.57ms ± 1% 2.61ms ± 3% ~ (p=0.151 n=5+5)
neo/go/fs1-zwrk.go·1 54.2µs ± 1% 54.2µs ± 0% ~ (p=0.548 n=5+5)
neo/go/fs1-zwrk.go·2 52.5µs ± 1% 52.2µs ± 0% ~ (p=0.421 n=5+5)
neo/go/fs1-zwrk.go·3 65.3µs ± 1% 65.1µs ± 1% ~ (p=0.421 n=5+5)
neo/go/fs1-zwrk.go·4 79.6µs ± 1% 79.5µs ± 1% ~ (p=0.690 n=5+5)
neo/go/fs1-zwrk.go·8 131µs ± 0% 132µs ± 1% ~ (p=0.421 n=5+5)
neo/go/fs1-zwrk.go·12 193µs ± 1% 192µs ± 1% ~ (p=0.421 n=5+5)
neo/go/fs1-zwrk.go·16 256µs ± 1% 258µs ± 2% ~ (p=0.310 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 38.0µs ± 1% 38.0µs ± 0% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 36.1µs ± 1% 36.3µs ± 0% ~ (p=0.421 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 47.8µs ± 1% 47.9µs ± 1% ~ (p=0.421 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 57.7µs ± 1% 58.0µs ± 1% ~ (p=0.310 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 90.7µs ± 0% 91.2µs ± 0% +0.47% (p=0.016 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 129µs ± 0% 130µs ± 1% +1.04% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 171µs ± 2% 171µs ± 1% ~ (p=0.548 n=5+5)
neo/go/sqlite-zwrk.go·1 90.7µs ± 1% 91.8µs ± 0% +1.26% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·2 109µs ± 1% 110µs ± 0% ~ (p=0.056 n=5+5)
neo/go/sqlite-zwrk.go·3 123µs ± 1% 124µs ± 1% ~ (p=0.095 n=5+5)
neo/go/sqlite-zwrk.go·4 149µs ± 0% 149µs ± 1% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go·8 263µs ± 2% 267µs ± 2% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go·12 393µs ± 1% 407µs ± 1% +3.60% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·16 534µs ± 2% 561µs ± 1% +5.04% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 84.0µs ± 1% 84.1µs ± 0% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 102µs ± 0% 102µs ± 1% ~ (p=0.548 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 113µs ± 1% 112µs ± 0% -0.83% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 133µs ± 0% 132µs ± 1% -1.41% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 257µs ± 2% 250µs ± 0% -2.76% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 415µs ± 1% 397µs ± 2% -4.26% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 563µs ± 2% 538µs ± 2% -4.40% (p=0.008 n=5+5)
cluster:deco dataset:prod1-1024
fs1-zwrk.go·1 1.80µs ± 0% 1.79µs ± 1% ~ (p=0.222 n=5+5)
fs1-zwrk.go·2 1.98µs ± 3% 1.98µs ± 8% ~ (p=0.548 n=5+5)
fs1-zwrk.go·3 2.27µs ± 1% 2.25µs ± 0% -0.68% (p=0.032 n=5+5)
fs1-zwrk.go·4 2.58µs ± 2% 2.59µs ± 3% ~ (p=0.952 n=5+5)
fs1-zwrk.go·8 5.04µs ± 0% 5.04µs ± 0% ~ (p=1.000 n=5+5)
fs1-zwrk.go·12 7.55µs ± 0% 7.53µs ± 0% ~ (p=0.095 n=5+5)
fs1-zwrk.go·16 10.0µs ± 0% 10.0µs ± 0% ~ (p=0.690 n=5+5)
zeo/py/fs1-zwrk.go·1 103µs ± 0% 104µs ± 0% ~ (p=0.095 n=5+5)
zeo/py/fs1-zwrk.go·2 162µs ± 1% 162µs ± 1% ~ (p=0.548 n=5+5)
zeo/py/fs1-zwrk.go·3 212µs ± 1% 211µs ± 1% ~ (p=0.310 n=5+5)
zeo/py/fs1-zwrk.go·4 269µs ± 0% 268µs ± 1% ~ (p=0.421 n=5+5)
zeo/py/fs1-zwrk.go·8 512µs ± 0% 510µs ± 1% ~ (p=0.151 n=5+5)
zeo/py/fs1-zwrk.go·12 793µs ±12% 752µs ± 1% -5.18% (p=0.032 n=5+4)
zeo/py/fs1-zwrk.go·16 991µs ± 1% 992µs ± 1% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 134µs ± 1% 134µs ± 1% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 233µs ± 1% 231µs ± 1% -0.91% (p=0.016 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 348µs ± 1% 344µs ± 1% -1.15% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 467µs ± 1% 461µs ± 0% -1.32% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 935µs ± 1% 916µs ± 1% -1.97% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 1.41ms ± 1% 1.39ms ± 1% -1.66% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 1.87ms ± 1% 1.86ms ± 1% ~ (p=0.222 n=5+5)
neo/py(!log)/sql-zwrk.go·1 180µs ± 2% 183µs ± 2% ~ (p=0.310 n=5+5)
neo/py(!log)/sql-zwrk.go·2 315µs ± 1% 314µs ± 0% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·3 475µs ± 0% 476µs ± 1% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·4 637µs ± 0% 632µs ± 0% -0.78% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·8 1.26ms ± 1% 1.26ms ± 1% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zwrk.go·12 1.89ms ± 1% 1.89ms ± 1% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·16 2.52ms ± 0% 2.52ms ± 0% ~ (p=0.690 n=5+5)
neo/go/fs1-zwrk.go·1 42.2µs ± 0% 41.7µs ± 0% -1.21% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·2 44.1µs ± 0% 43.8µs ± 1% ~ (p=0.056 n=5+5)
neo/go/fs1-zwrk.go·3 54.4µs ± 1% 54.1µs ± 1% ~ (p=0.056 n=5+5)
neo/go/fs1-zwrk.go·4 65.9µs ± 2% 65.9µs ± 0% ~ (p=1.000 n=5+5)
neo/go/fs1-zwrk.go·8 113µs ± 2% 115µs ± 3% ~ (p=0.095 n=5+5)
neo/go/fs1-zwrk.go·12 169µs ± 4% 173µs ± 7% ~ (p=0.421 n=5+5)
neo/go/fs1-zwrk.go·16 225µs ± 3% 236µs ± 2% +4.62% (p=0.016 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 36.6µs ± 0% 36.9µs ± 0% +0.93% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 36.1µs ± 1% 36.1µs ± 1% ~ (p=0.841 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 46.9µs ± 1% 47.7µs ± 1% +1.64% (p=0.016 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 57.9µs ± 1% 58.4µs ± 1% +0.88% (p=0.032 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 98.9µs ± 2% 100.2µs ± 3% ~ (p=0.310 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 153µs ± 5% 155µs ± 4% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 212µs ± 3% 206µs ± 7% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go·1 85.1µs ± 1% 85.3µs ± 0% ~ (p=0.310 n=5+5)
neo/go/sqlite-zwrk.go·2 105µs ± 0% 105µs ± 0% ~ (p=0.056 n=5+5)
neo/go/sqlite-zwrk.go·3 123µs ± 1% 123µs ± 1% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go·4 152µs ± 1% 152µs ± 1% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go·8 321µs ± 3% 323µs ± 3% ~ (p=0.548 n=5+5)
neo/go/sqlite-zwrk.go·12 500µs ± 5% 508µs ± 2% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go·16 630µs ± 1% 657µs ± 1% +4.34% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 82.0µs ± 0% 82.3µs ± 0% ~ (p=0.095 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 101µs ± 0% 102µs ± 0% +0.98% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 115µs ± 1% 115µs ± 3% ~ (p=0.222 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 139µs ± 1% 138µs ± 1% -1.19% (p=0.032 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 295µs ± 3% 293µs ± 2% ~ (p=0.548 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 474µs ± 2% 470µs ± 1% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 632µs ± 1% 627µs ± 1% ~ (p=0.095 n=5+5)

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

$ benchstat -split node,cluster,dataset "20180306-deco-ffixed-noc_C1(2µs).txt" "20180306-deco-ffixed-noc_C1(2µs).txt.2"

name old pystone/s new pystone/s delta
node:deco
pystone 218k ± 2% 217k ± 2% ~ (p=1.000 n=5+5)

name old time/op new time/op delta
node:deco
crc32/py/4K 5.72µs ± 0% 5.73µs ± 0% ~ (p=0.151 n=5+5)
crc32/go/4K 280ns ± 1% 279ns ± 0% ~ (p=0.333 n=5+4)
sha1/py/4K 6.72µs ± 1% 6.71µs ± 1% ~ (p=1.000 n=5+5)
sha1/go/4K 5.59µs ± 0% 5.59µs ± 0% ~ (p=1.000 n=4+5)
unzlib/py/wczdata 27.2µs ± 1% 27.1µs ± 1% ~ (p=0.421 n=5+5)
unzlib/go/wczdata 26.8µs ± 0% 26.8µs ± 0% ~ (p=0.548 n=5+5)
unzlib/py/prod1-avg 5.08µs ± 1% 5.13µs ± 1% ~ (p=0.095 n=5+5)
unzlib/go/prod1-avg 5.29µs ± 1% 5.28µs ± 0% ~ (p=0.333 n=5+5)
disk/randread/direct/4K-min 105µs ± 0% 105µs ± 0% ~ (p=0.111 n=5+4)
disk/randread/direct/4K-avg 142µs ± 0% 142µs ± 0% +0.35% (p=0.040 n=5+5)
disk/randread/pagecache/4K-min 582ns ± 0% 584ns ± 2% ~ (p=0.286 n=5+5)
disk/randread/pagecache/4K-avg 987ns ± 0% 986ns ± 0% ~ (p=0.460 n=5+5)

name old time/object new time/object delta
cluster:deco dataset:wczblk1-8
fs1-zhash.py 20.2µs ± 1% 20.3µs ± 2% ~ (p=1.000 n=5+5)
fs1-zhash.go 3.20µs ± 0% 3.20µs ± 0% ~ (all equal)
fs1-zhash.go+prefetch128 4.14µs ± 1% 4.00µs ± 7% ~ (p=0.159 n=5+5)
zeo/py/fs1-zhash.py 361µs ± 3% 364µs ± 5% ~ (p=0.841 n=5+5)
zeo/py/fs1-zhash.go 112µs ± 1% 113µs ± 1% +0.93% (p=0.024 n=5+5)
zeo/py/fs1-zhash.go+prefetch128 63.9µs ± 1% 64.0µs ± 2% ~ (p=0.952 n=5+5)
neo/py(!log)/sqlite-zhash.py 321µs ± 8% 318µs ± 2% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zhash.go 141µs ± 3% 142µs ± 3% ~ (p=0.595 n=5+5)
neo/py(!log)/sqlite-zhash.go+prefetch128 119µs ± 1% 119µs ± 2% ~ (p=0.794 n=5+5)
neo/py(!log)/sql-zhash.py 376µs ± 2% 382µs ± 3% ~ (p=0.486 n=4+4)
neo/py(!log)/sql-zhash.go 187µs ± 5% 189µs ± 4% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zhash.go+prefetch128 164µs ± 2% 164µs ± 2% ~ (p=0.841 n=5+5)
neo/go/fs1-zhash.py 226µs ± 2% 222µs ± 2% ~ (p=0.222 n=5+5)
neo/go/fs1-zhash.go 57.1µs ± 1% 56.7µs ± 0% -0.81% (p=0.016 n=5+5)
neo/go/fs1-zhash.go+prefetch128 24.0µs ± 4% 24.5µs ± 5% ~ (p=0.460 n=5+5)
neo/go/fs1(!sha1)-zhash.go(!sha1) 40.3µs ± 1% 40.3µs ± 2% ~ (p=0.833 n=5+5)
neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 17.2µs ± 4% 17.3µs ± 7% ~ (p=0.730 n=5+5)
neo/go/sqlite-zhash.py 253µs ± 1% 254µs ± 2% ~ (p=0.952 n=5+5)
neo/go/sqlite-zhash.go 93.7µs ± 1% 94.8µs ± 0% +1.20% (p=0.008 n=5+5)
neo/go/sqlite-zhash.go+prefetch128 39.5µs ± 6% 41.6µs ±13% ~ (p=0.310 n=5+5)
neo/go/sqlite-zhash.go(!sha1) 86.4µs ± 3% 87.0µs ± 2% ~ (p=0.079 n=5+5)
neo/go/sqlite-zhash.go+prefetch128(!sha1) 39.4µs ± 7% 37.9µs ± 9% ~ (p=0.690 n=5+5)
cluster:deco dataset:prod1-1024
fs1-zhash.py 15.9µs ± 2% 15.8µs ± 1% ~ (p=0.571 n=5+5)
fs1-zhash.go 2.80µs ± 0% 2.80µs ± 0% ~ (all equal)
fs1-zhash.go+prefetch128 3.34µs ± 2% 3.50µs ±17% ~ (p=0.683 n=5+5)
zeo/py/fs1-zhash.py 347µs ± 3% 355µs ± 4% ~ (p=0.222 n=5+5)
zeo/py/fs1-zhash.go 105µs ± 0% 105µs ± 1% +0.52% (p=0.040 n=5+5)
zeo/py/fs1-zhash.go+prefetch128 58.9µs ± 1% 58.5µs ± 2% ~ (p=0.198 n=5+5)
neo/py(!log)/sqlite-zhash.py 317µs ± 5% 315µs ± 5% ~ (p=0.841 n=5+5)
neo/py(!log)/sqlite-zhash.go 138µs ± 1% 135µs ± 1% -1.86% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zhash.go+prefetch128 112µs ± 1% 112µs ± 0% ~ (p=0.508 n=5+5)
neo/py(!log)/sql-zhash.py 377µs ± 2% 376µs ± 2% ~ (p=0.686 n=4+4)
neo/py(!log)/sql-zhash.go 184µs ± 2% 183µs ± 2% ~ (p=0.690 n=5+5)
neo/py(!log)/sql-zhash.go+prefetch128 160µs ± 2% 158µs ± 1% -1.18% (p=0.024 n=5+5)
neo/go/fs1-zhash.py 225µs ± 1% 223µs ± 2% ~ (p=0.278 n=5+5)
neo/go/fs1-zhash.go 44.6µs ± 0% 44.3µs ± 1% -0.63% (p=0.048 n=5+5)
neo/go/fs1-zhash.go+prefetch128 17.2µs ± 3% 17.4µs ± 6% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zhash.go(!sha1) 39.1µs ± 3% 39.0µs ± 1% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 15.2µs ± 3% 14.5µs ± 3% -4.47% (p=0.008 n=5+5)
neo/go/sqlite-zhash.py 254µs ± 1% 252µs ± 1% ~ (p=0.111 n=5+5)
neo/go/sqlite-zhash.go 86.3µs ± 0% 86.6µs ± 1% +0.42% (p=0.040 n=5+5)
neo/go/sqlite-zhash.go+prefetch128 36.6µs ± 5% 37.6µs ± 2% ~ (p=0.310 n=5+5)
neo/go/sqlite-zhash.go(!sha1) 83.8µs ± 2% 83.5µs ± 1% ~ (p=0.548 n=5+5)
neo/go/sqlite-zhash.go+prefetch128(!sha1) 36.9µs ± 8% 35.7µs ± 7% ~ (p=0.310 n=5+5)

name old req/s new req/s delta
cluster:deco dataset:wczblk1-8
fs1-zwrk.go·1 431k ± 1% 437k ± 1% +1.51% (p=0.008 n=5+5)
fs1-zwrk.go·2 760k ± 3% 750k ± 3% ~ (p=0.310 n=5+5)
fs1-zwrk.go·3 1.08M ± 2% 1.08M ± 0% ~ (p=0.841 n=5+5)
fs1-zwrk.go·4 1.16M ± 1% 1.16M ± 1% ~ (p=1.000 n=5+5)
fs1-zwrk.go·8 1.27M ± 1% 1.27M ± 1% ~ (p=0.548 n=5+5)
fs1-zwrk.go·12 1.28M ± 1% 1.28M ± 0% ~ (p=0.190 n=5+4)
fs1-zwrk.go·16 1.28M ± 1% 1.28M ± 1% ~ (p=0.841 n=5+5)
zeo/py/fs1-zwrk.go·1 8.04k ± 4% 8.14k ± 0% ~ (p=0.690 n=5+5)
zeo/py/fs1-zwrk.go·2 9.54k ± 1% 9.54k ± 1% ~ (p=0.841 n=5+5)
zeo/py/fs1-zwrk.go·3 10.5k ± 0% 10.5k ± 1% ~ (p=0.548 n=5+5)
zeo/py/fs1-zwrk.go·4 11.0k ± 1% 10.9k ± 1% ~ (p=0.222 n=5+5)
zeo/py/fs1-zwrk.go·8 11.4k ± 1% 11.5k ± 1% ~ (p=0.548 n=5+5)
zeo/py/fs1-zwrk.go·12 11.7k ± 0% 11.6k ± 2% ~ (p=0.310 n=5+5)
zeo/py/fs1-zwrk.go·16 11.8k ± 2% 11.8k ± 1% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 7.04k ± 1% 7.08k ± 1% ~ (p=0.222 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 8.52k ± 1% 8.52k ± 0% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 8.51k ± 1% 8.48k ± 1% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 8.50k ± 1% 8.45k ± 1% ~ (p=0.310 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 8.53k ± 1% 8.52k ± 1% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 8.48k ± 2% 8.57k ± 1% ~ (p=0.151 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 8.48k ± 1% 8.57k ± 0% +1.08% (p=0.016 n=5+5)
neo/py(!log)/sql-zwrk.go·1 5.37k ± 3% 5.36k ± 2% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·2 6.34k ± 0% 6.21k ± 1% -2.02% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·3 6.28k ± 1% 6.24k ± 0% ~ (p=0.190 n=5+4)
neo/py(!log)/sql-zwrk.go·4 6.29k ± 1% 6.17k ± 2% -1.87% (p=0.016 n=5+5)
neo/py(!log)/sql-zwrk.go·8 6.29k ± 1% 6.12k ± 0% -2.68% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·12 6.25k ± 1% 6.15k ± 1% -1.54% (p=0.016 n=5+4)
neo/py(!log)/sql-zwrk.go·16 6.23k ± 2% 6.14k ± 3% ~ (p=0.222 n=5+5)
neo/go/fs1-zwrk.go·1 18.4k ± 0% 18.4k ± 0% ~ (p=0.095 n=5+5)
neo/go/fs1-zwrk.go·2 38.3k ± 1% 38.3k ± 0% ~ (p=1.000 n=5+5)
neo/go/fs1-zwrk.go·3 45.9k ± 0% 46.1k ± 1% ~ (p=0.151 n=5+5)
neo/go/fs1-zwrk.go·4 50.0k ± 0% 50.3k ± 1% ~ (p=0.056 n=5+5)
neo/go/fs1-zwrk.go·8 60.3k ± 1% 60.8k ± 1% ~ (p=0.151 n=5+5)
neo/go/fs1-zwrk.go·12 62.1k ± 1% 62.5k ± 1% +0.67% (p=0.032 n=5+5)
neo/go/fs1-zwrk.go·16 61.6k ± 1% 62.1k ± 2% ~ (p=0.151 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 26.3k ± 0% 26.3k ± 0% ~ (p=0.690 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 55.7k ± 1% 55.1k ± 0% -1.12% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 62.8k ± 1% 62.6k ± 1% ~ (p=0.222 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 69.4k ± 1% 69.0k ± 1% ~ (p=0.056 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 88.3k ± 1% 87.7k ± 0% ~ (p=0.095 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 93.5k ± 1% 92.4k ± 1% -1.17% (p=0.032 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 93.8k ± 0% 93.5k ± 1% ~ (p=0.056 n=5+5)
neo/go/sqlite-zwrk.go·1 11.0k ± 0% 10.9k ± 0% -0.70% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·2 18.3k ± 1% 18.2k ± 0% ~ (p=0.111 n=4+5)
neo/go/sqlite-zwrk.go·3 24.2k ± 0% 24.2k ± 1% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go·4 26.8k ± 1% 26.8k ± 1% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go·8 29.6k ± 2% 30.0k ± 2% ~ (p=0.222 n=5+5)
neo/go/sqlite-zwrk.go·12 29.3k ± 2% 29.5k ± 1% ~ (p=0.548 n=5+5)
neo/go/sqlite-zwrk.go·16 28.6k ± 1% 28.5k ± 1% ~ (p=0.222 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 11.9k ± 1% 11.9k ± 0% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 19.6k ± 1% 19.6k ± 1% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 26.4k ± 0% 26.7k ± 0% +1.08% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 30.0k ± 0% 30.4k ± 1% +1.43% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 31.2k ± 2% 32.1k ± 0% +2.86% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 28.8k ± 3% 30.2k ± 2% +4.93% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 28.4k ± 1% 29.7k ± 2% +4.69% (p=0.008 n=5+5)
cluster:deco dataset:prod1-1024
fs1-zwrk.go·1 556k ± 0% 558k ± 1% ~ (p=0.690 n=5+5)
fs1-zwrk.go·2 994k ± 6% 1011k ± 8% ~ (p=0.310 n=5+5)
fs1-zwrk.go·3 1.33M ± 2% 1.33M ± 0% ~ (p=0.690 n=5+5)
fs1-zwrk.go·4 1.53M ± 0% 1.54M ± 3% ~ (p=0.222 n=5+5)
fs1-zwrk.go·8 1.59M ± 1% 1.59M ± 0% ~ (p=0.548 n=5+5)
fs1-zwrk.go·12 1.60M ± 1% 1.59M ± 0% ~ (p=1.000 n=5+5)
fs1-zwrk.go·16 1.59M ± 0% 1.59M ± 0% ~ (p=0.841 n=5+5)
zeo/py/fs1-zwrk.go·1 9.75k ± 1% 9.66k ± 0% -0.94% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·2 12.4k ± 1% 12.3k ± 1% ~ (p=0.310 n=5+5)
zeo/py/fs1-zwrk.go·3 14.2k ± 1% 14.2k ± 1% ~ (p=0.222 n=5+5)
zeo/py/fs1-zwrk.go·4 14.9k ± 1% 14.9k ± 1% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·8 15.6k ± 1% 15.7k ± 1% ~ (p=0.548 n=5+5)
zeo/py/fs1-zwrk.go·12 16.0k ± 1% 16.0k ± 1% ~ (p=1.000 n=5+4)
zeo/py/fs1-zwrk.go·16 16.0k ± 6% 16.1k ± 1% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 7.45k ± 2% 7.46k ± 1% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 8.71k ± 1% 8.67k ± 1% ~ (p=0.310 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 8.69k ± 1% 8.71k ± 1% ~ (p=0.802 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 8.61k ± 1% 8.68k ± 0% +0.88% (p=0.016 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 8.61k ± 1% 8.73k ± 1% +1.42% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 8.59k ± 1% 8.66k ± 1% ~ (p=0.222 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 8.60k ± 1% 8.62k ± 1% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·1 5.45k ± 2% 5.47k ± 2% ~ (p=0.690 n=5+5)
neo/py(!log)/sql-zwrk.go·2 6.25k ± 1% 6.37k ± 0% +1.89% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·3 6.24k ± 1% 6.30k ± 1% +0.96% (p=0.032 n=5+5)
neo/py(!log)/sql-zwrk.go·4 6.27k ± 1% 6.33k ± 0% +0.97% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·8 6.28k ± 1% 6.36k ± 1% ~ (p=0.056 n=5+5)
neo/py(!log)/sql-zwrk.go·12 6.33k ± 0% 6.36k ± 1% ~ (p=0.222 n=5+5)
neo/py(!log)/sql-zwrk.go·16 6.30k ± 1% 6.35k ± 0% +0.81% (p=0.016 n=5+5)
neo/go/fs1-zwrk.go·1 23.9k ± 0% 24.0k ± 0% +0.52% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·2 45.5k ± 1% 45.6k ± 1% ~ (p=0.222 n=5+5)
neo/go/fs1-zwrk.go·3 55.1k ± 0% 55.5k ± 1% +0.75% (p=0.016 n=5+5)
neo/go/fs1-zwrk.go·4 60.4k ± 0% 60.7k ± 0% ~ (p=0.056 n=5+5)
neo/go/fs1-zwrk.go·8 69.2k ± 2% 69.3k ± 3% ~ (p=0.548 n=5+5)
neo/go/fs1-zwrk.go·12 68.0k ± 5% 69.5k ± 7% ~ (p=0.548 n=5+5)
neo/go/fs1-zwrk.go·16 68.1k ± 3% 67.8k ± 2% ~ (p=0.841 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 27.2k ± 1% 27.1k ± 0% ~ (p=0.690 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 55.5k ± 1% 55.4k ± 1% ~ (p=0.841 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 64.0k ± 1% 62.9k ± 1% -1.69% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 69.1k ± 1% 68.4k ± 1% ~ (p=0.056 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 81.1k ± 4% 79.9k ± 3% ~ (p=0.151 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 77.8k ± 8% 77.6k ± 4% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 76.8k ± 5% 77.7k ± 7% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go·1 11.7k ± 1% 11.7k ± 0% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go·2 18.9k ± 1% 19.1k ± 0% ~ (p=0.056 n=5+5)
neo/go/sqlite-zwrk.go·3 24.4k ± 2% 24.3k ± 1% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go·4 26.0k ± 3% 26.3k ± 1% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go·8 24.6k ± 5% 24.8k ± 3% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go·12 23.7k ± 3% 23.6k ± 2% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go·16 24.1k ± 3% 24.3k ± 1% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 12.2k ± 1% 12.2k ± 0% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 19.6k ± 1% 19.6k ± 0% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 25.5k ± 1% 26.2k ± 2% +2.75% (p=0.032 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 27.5k ± 2% 29.1k ± 1% +5.64% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 25.6k ± 2% 27.3k ± 2% +6.33% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 24.0k ± 2% 25.5k ± 1% +6.19% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 24.2k ± 1% 25.5k ± 1% +5.65% (p=0.008 n=5+5)

name old latency-time/object new latency-time/object delta
cluster:deco dataset:wczblk1-8
fs1-zwrk.go·1 2.32µs ± 1% 2.29µs ± 1% -1.48% (p=0.016 n=5+5)
fs1-zwrk.go·2 2.63µs ± 3% 2.67µs ± 3% ~ (p=0.310 n=5+5)
fs1-zwrk.go·3 2.78µs ± 2% 2.77µs ± 0% ~ (p=0.841 n=5+5)
fs1-zwrk.go·4 3.44µs ± 1% 3.44µs ± 1% ~ (p=1.000 n=5+5)
fs1-zwrk.go·8 6.28µs ± 1% 6.29µs ± 1% ~ (p=0.548 n=5+5)
fs1-zwrk.go·12 9.40µs ± 1% 9.35µs ± 0% ~ (p=0.159 n=5+4)
fs1-zwrk.go·16 12.5µs ± 1% 12.5µs ± 1% ~ (p=0.841 n=5+5)
zeo/py/fs1-zwrk.go·1 125µs ± 4% 123µs ± 0% ~ (p=0.690 n=5+5)
zeo/py/fs1-zwrk.go·2 210µs ± 1% 210µs ± 1% ~ (p=0.841 n=5+5)
zeo/py/fs1-zwrk.go·3 286µs ± 0% 285µs ± 1% ~ (p=0.548 n=5+5)
zeo/py/fs1-zwrk.go·4 365µs ± 1% 366µs ± 1% ~ (p=0.222 n=5+5)
zeo/py/fs1-zwrk.go·8 699µs ± 1% 698µs ± 1% ~ (p=0.548 n=5+5)
zeo/py/fs1-zwrk.go·12 1.03ms ± 0% 1.03ms ± 2% ~ (p=0.310 n=5+5)
zeo/py/fs1-zwrk.go·16 1.36ms ± 2% 1.36ms ± 1% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 142µs ± 1% 141µs ± 1% ~ (p=0.222 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 235µs ± 1% 235µs ± 0% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 353µs ± 1% 354µs ± 1% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 470µs ± 1% 474µs ± 1% ~ (p=0.310 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 938µs ± 1% 939µs ± 1% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 1.41ms ± 2% 1.40ms ± 1% ~ (p=0.151 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 1.89ms ± 1% 1.87ms ± 0% -1.07% (p=0.016 n=5+5)
neo/py(!log)/sql-zwrk.go·1 186µs ± 3% 187µs ± 2% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·2 315µs ± 0% 322µs ± 1% +2.07% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·3 478µs ± 1% 481µs ± 0% ~ (p=0.190 n=5+4)
neo/py(!log)/sql-zwrk.go·4 636µs ± 1% 648µs ± 2% +1.91% (p=0.016 n=5+5)
neo/py(!log)/sql-zwrk.go·8 1.27ms ± 1% 1.31ms ± 0% +2.75% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·12 1.92ms ± 1% 1.95ms ± 1% +1.57% (p=0.016 n=5+4)
neo/py(!log)/sql-zwrk.go·16 2.57ms ± 2% 2.61ms ± 3% ~ (p=0.222 n=5+5)
neo/go/fs1-zwrk.go·1 54.4µs ± 0% 54.2µs ± 0% ~ (p=0.095 n=5+5)
neo/go/fs1-zwrk.go·2 52.2µs ± 1% 52.2µs ± 0% ~ (p=1.000 n=5+5)
neo/go/fs1-zwrk.go·3 65.3µs ± 0% 65.1µs ± 1% ~ (p=0.151 n=5+5)
neo/go/fs1-zwrk.go·4 80.0µs ± 0% 79.5µs ± 1% ~ (p=0.056 n=5+5)
neo/go/fs1-zwrk.go·8 133µs ± 1% 132µs ± 1% ~ (p=0.151 n=5+5)
neo/go/fs1-zwrk.go·12 193µs ± 1% 192µs ± 1% -0.67% (p=0.032 n=5+5)
neo/go/fs1-zwrk.go·16 260µs ± 1% 258µs ± 2% ~ (p=0.151 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 38.0µs ± 0% 38.0µs ± 0% ~ (p=0.690 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 35.9µs ± 1% 36.3µs ± 0% +1.13% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 47.7µs ± 1% 47.9µs ± 1% ~ (p=0.222 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 57.7µs ± 1% 58.0µs ± 1% ~ (p=0.056 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 90.6µs ± 1% 91.2µs ± 0% ~ (p=0.095 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 128µs ± 1% 130µs ± 1% +1.18% (p=0.032 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 171µs ± 0% 171µs ± 1% ~ (p=0.056 n=5+5)
neo/go/sqlite-zwrk.go·1 91.2µs ± 0% 91.8µs ± 0% +0.71% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·2 109µs ± 1% 110µs ± 0% ~ (p=0.111 n=4+5)
neo/go/sqlite-zwrk.go·3 124µs ± 0% 124µs ± 1% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go·4 149µs ± 1% 149µs ± 1% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go·8 270µs ± 2% 267µs ± 2% ~ (p=0.222 n=5+5)
neo/go/sqlite-zwrk.go·12 410µs ± 2% 407µs ± 1% ~ (p=0.548 n=5+5)
neo/go/sqlite-zwrk.go·16 560µs ± 1% 561µs ± 1% ~ (p=0.222 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 84.0µs ± 1% 84.1µs ± 0% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 102µs ± 1% 102µs ± 1% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 113µs ± 0% 112µs ± 0% -1.07% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 133µs ± 0% 132µs ± 1% -1.41% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 257µs ± 2% 250µs ± 0% -2.80% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 417µs ± 3% 397µs ± 2% -4.72% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 563µs ± 1% 538µs ± 2% -4.47% (p=0.008 n=5+5)
cluster:deco dataset:prod1-1024
fs1-zwrk.go·1 1.80µs ± 0% 1.79µs ± 1% ~ (p=0.524 n=5+5)
fs1-zwrk.go·2 2.01µs ± 6% 1.98µs ± 8% ~ (p=0.310 n=5+5)
fs1-zwrk.go·3 2.26µs ± 2% 2.25µs ± 0% ~ (p=0.690 n=5+5)
fs1-zwrk.go·4 2.61µs ± 0% 2.59µs ± 3% ~ (p=0.198 n=5+5)
fs1-zwrk.go·8 5.04µs ± 1% 5.04µs ± 0% ~ (p=0.548 n=5+5)
fs1-zwrk.go·12 7.52µs ± 1% 7.53µs ± 0% ~ (p=1.000 n=5+5)
fs1-zwrk.go·16 10.0µs ± 0% 10.0µs ± 0% ~ (p=0.841 n=5+5)
zeo/py/fs1-zwrk.go·1 103µs ± 1% 104µs ± 0% +0.95% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·2 161µs ± 1% 162µs ± 1% ~ (p=0.310 n=5+5)
zeo/py/fs1-zwrk.go·3 212µs ± 1% 211µs ± 1% ~ (p=0.222 n=5+5)
zeo/py/fs1-zwrk.go·4 268µs ± 1% 268µs ± 1% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·8 512µs ± 1% 510µs ± 1% ~ (p=0.548 n=5+5)
zeo/py/fs1-zwrk.go·12 752µs ± 1% 752µs ± 1% ~ (p=1.000 n=5+4)
zeo/py/fs1-zwrk.go·16 1.00ms ± 6% 0.99ms ± 1% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 134µs ± 1% 134µs ± 1% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 230µs ± 1% 231µs ± 1% ~ (p=0.310 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 345µs ± 1% 344µs ± 1% ~ (p=0.841 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 465µs ± 1% 461µs ± 0% -0.88% (p=0.016 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 929µs ± 1% 916µs ± 1% -1.41% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 1.40ms ± 1% 1.39ms ± 1% ~ (p=0.222 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 1.86ms ± 1% 1.86ms ± 1% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·1 184µs ± 2% 183µs ± 2% ~ (p=0.690 n=5+5)
neo/py(!log)/sql-zwrk.go·2 320µs ± 1% 314µs ± 0% -1.86% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·3 481µs ± 1% 476µs ± 1% -0.95% (p=0.032 n=5+5)
neo/py(!log)/sql-zwrk.go·4 638µs ± 1% 632µs ± 0% -0.96% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·8 1.27ms ± 1% 1.26ms ± 1% ~ (p=0.056 n=5+5)
neo/py(!log)/sql-zwrk.go·12 1.89ms ± 0% 1.89ms ± 1% ~ (p=0.222 n=5+5)
neo/py(!log)/sql-zwrk.go·16 2.54ms ± 1% 2.52ms ± 0% -0.80% (p=0.016 n=5+5)
neo/go/fs1-zwrk.go·1 41.9µs ± 0% 41.7µs ± 0% -0.51% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·2 44.0µs ± 1% 43.8µs ± 1% ~ (p=0.222 n=5+5)
neo/go/fs1-zwrk.go·3 54.5µs ± 0% 54.1µs ± 1% -0.74% (p=0.016 n=5+5)
neo/go/fs1-zwrk.go·4 66.2µs ± 0% 65.9µs ± 0% ~ (p=0.056 n=5+5)
neo/go/fs1-zwrk.go·8 116µs ± 2% 115µs ± 3% ~ (p=0.548 n=5+5)
neo/go/fs1-zwrk.go·12 177µs ± 5% 173µs ± 7% ~ (p=0.548 n=5+5)
neo/go/fs1-zwrk.go·16 235µs ± 3% 236µs ± 2% ~ (p=0.841 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 36.8µs ± 1% 36.9µs ± 0% ~ (p=0.690 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 36.0µs ± 1% 36.1µs ± 1% ~ (p=0.841 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 46.9µs ± 1% 47.7µs ± 1% +1.72% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 57.9µs ± 1% 58.4µs ± 1% ~ (p=0.056 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 98.6µs ± 4% 100.2µs ± 3% ~ (p=0.151 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 155µs ± 8% 155µs ± 4% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 208µs ± 5% 206µs ± 7% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go·1 85.5µs ± 1% 85.3µs ± 0% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go·2 106µs ± 1% 105µs ± 0% ~ (p=0.063 n=5+5)
neo/go/sqlite-zwrk.go·3 123µs ± 2% 123µs ± 1% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go·4 154µs ± 3% 152µs ± 1% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go·8 325µs ± 5% 323µs ± 3% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go·12 507µs ± 3% 508µs ± 2% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go·16 665µs ± 3% 657µs ± 1% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 82.3µs ± 1% 82.3µs ± 0% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 102µs ± 1% 102µs ± 0% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 118µs ± 1% 115µs ± 3% -2.66% (p=0.032 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 145µs ± 2% 138µs ± 1% -5.36% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 312µs ± 2% 293µs ± 2% -5.95% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 500µs ± 2% 470µs ± 1% -5.84% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 662µs ± 1% 627µs ± 1% -5.35% (p=0.008 n=5+5)

620b723c

X rio: localhost timings, C > C1 disabled · 3695ff12

Kirill Smelkov authored Mar 06, 2018

Disabling C-states on rio tendto help serial cases, like it was on neo1
and z6001, but it is closer to noise.

---- 8< ----
cluster:rio dataset:wczblk1-8
zeo/py/fs1-zhash.py 400µs ± 0% 370µs ± 1% -7.32% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zhash.py 318µs ± 7% 295µs ± 0% -7.16% (p=0.008 n=5+5)
neo/py(!log)/sql-zhash.go+prefetch128 158µs ± 3% 158µs ± 2% ~ (p=1.000 n=5+5)
neo/go/fs1-zhash.py 222µs ± 4% 214µs ± 2% -3.73% (p=0.040 n=5+5)
neo/go/sqlite-zhash.py 273µs ± 3% 256µs ± 4% -6.45% (p=0.008 n=5+5)

cluster:rio dataset:prod1-1024
zeo/py/fs1-zhash.py 372µs ±10% 347µs ± 5% -6.84% (p=0.032 n=5+5)
neo/py(!log)/sqlite-zhash.py 321µs ±11% 298µs ± 5% -7.13% (p=0.048 n=5+5)
---- 8< ----

the pystone/s change is nose as pystone/s for C-enabled case was 146k on
prev-prev run (see 31dc070d).

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

$ benchstat -split node,cluster,dataset 20180306-rio-ffixed-c.txt 20180306-rio-ffixed-noc_C1$1µs$.txt

name old pystone/s new pystone/s delta
node:rio
pystone 115k ±12% 144k ± 1% +25.53% (p=0.008 n=5+5)

name old time/op new time/op delta
node:rio
crc32/py/4K 4.77µs ± 0% 4.78µs ± 1% ~ (p=0.825 n=4+5)
crc32/go/4K 1.49µs ± 0% 1.49µs ± 0% ~ (p=0.484 n=5+5)
sha1/py/4K 8.04µs ± 1% 8.00µs ± 1% ~ (p=0.206 n=5+5)
sha1/go/4K 8.93µs ± 0% 8.93µs ± 0% ~ (p=0.389 n=5+5)
unzlib/py/wczdata 25.1µs ± 1% 25.1µs ± 1% ~ (p=1.000 n=5+5)
unzlib/go/wczdata 23.0µs ± 0% 22.9µs ± 0% -0.45% (p=0.016 n=5+5)
unzlib/py/prod1-avg 7.16µs ± 1% 7.08µs ± 1% ~ (p=0.056 n=5+5)
unzlib/go/prod1-avg 5.08µs ± 1% 5.04µs ± 0% -0.82% (p=0.008 n=5+5)
disk/randread/direct/4K-min 92.4µs ± 0% 92.7µs ± 0% ~ (p=0.198 n=5+5)
disk/randread/direct/4K-avg 115µs ± 0% 115µs ± 0% +0.37% (p=0.008 n=5+5)
disk/randread/pagecache/4K-min 565ns ± 2% 562ns ± 1% ~ (p=0.444 n=5+5)
disk/randread/pagecache/4K-avg 992ns ± 0% 992ns ± 0% ~ (p=1.032 n=4+5)

name old time/object new time/object delta
cluster:rio dataset:wczblk1-8
fs1-zhash.py 29.2µs ± 1% 28.8µs ± 2% ~ (p=0.111 n=4+5)
fs1-zhash.go 4.68µs ± 5% 4.60µs ± 0% ~ (p=0.444 n=5+5)
fs1-zhash.go+prefetch128 4.78µs ± 5% 4.62µs ±15% ~ (p=0.159 n=5+5)
zeo/py/fs1-zhash.py 400µs ± 0% 370µs ± 1% -7.32% (p=0.008 n=5+5)
zeo/py/fs1-zhash.go 138µs ± 1% 136µs ± 2% ~ (p=0.087 n=5+5)
zeo/py/fs1-zhash.go+prefetch128 74.7µs ± 2% 74.9µs ± 2% ~ (p=0.730 n=5+5)
neo/py(!log)/sqlite-zhash.py 318µs ± 7% 295µs ± 0% -7.16% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zhash.go 154µs ± 4% 151µs ± 6% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zhash.go+prefetch128 125µs ± 3% 126µs ± 2% ~ (p=0.746 n=5+5)
neo/py(!log)/sql-zhash.py 400µs ±57% 325µs ± 2% ~ (p=0.063 n=5+4)
neo/py(!log)/sql-zhash.go 183µs ±11% 178µs ± 2% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zhash.go+prefetch128 158µs ± 3% 158µs ± 2% ~ (p=1.000 n=5+5)
neo/go/fs1-zhash.py 222µs ± 4% 214µs ± 2% -3.73% (p=0.040 n=5+5)
neo/go/fs1-zhash.go 68.6µs ± 2% 68.9µs ± 3% ~ (p=0.722 n=5+5)
neo/go/fs1-zhash.go+prefetch128 29.0µs ± 6% 28.3µs ± 4% ~ (p=0.135 n=5+5)
neo/go/fs1(!sha1)-zhash.go(!sha1) 43.9µs ± 3% 43.7µs ± 2% ~ (p=0.881 n=5+5)
neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 18.8µs ± 5% 18.6µs ± 4% ~ (p=0.516 n=5+5)
neo/go/sqlite-zhash.py 273µs ± 3% 256µs ± 4% -6.45% (p=0.008 n=5+5)
neo/go/sqlite-zhash.go 104µs ± 1% 104µs ± 2% ~ (p=0.651 n=5+5)
neo/go/sqlite-zhash.go+prefetch128 36.3µs ± 3% 37.0µs ± 8% ~ (p=0.595 n=5+5)
neo/go/sqlite-zhash.go(!sha1) 94.2µs ± 3% 93.1µs ± 3% ~ (p=0.151 n=5+5)
neo/go/sqlite-zhash.go+prefetch128(!sha1) 35.1µs ± 6% 35.7µs ±13% ~ (p=1.000 n=5+5)
cluster:rio dataset:prod1-1024
fs1-zhash.py 23.9µs ± 1% 24.0µs ± 2% ~ (p=0.937 n=4+5)
fs1-zhash.go 3.40µs ± 0% 3.40µs ± 0% ~ (all equal)
fs1-zhash.go+prefetch128 3.02µs ± 9% 3.04µs ± 2% ~ (p=0.397 n=5+5)
zeo/py/fs1-zhash.py 372µs ±10% 347µs ± 5% -6.84% (p=0.032 n=5+5)
zeo/py/fs1-zhash.go 114µs ± 1% 114µs ± 2% ~ (p=0.548 n=5+5)
zeo/py/fs1-zhash.go+prefetch128 64.6µs ± 1% 66.6µs ± 1% +3.07% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zhash.py 321µs ±11% 298µs ± 5% -7.13% (p=0.048 n=5+5)
neo/py(!log)/sqlite-zhash.go 142µs ± 3% 142µs ± 3% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zhash.go+prefetch128 117µs ± 1% 115µs ± 1% ~ (p=0.087 n=5+5)
neo/py(!log)/sql-zhash.py 330µs ± 1% 380µs ±34% +15.42% (p=0.016 n=4+5)
neo/py(!log)/sql-zhash.go 172µs ± 1% 170µs ± 2% ~ (p=0.310 n=5+5)
neo/py(!log)/sql-zhash.go+prefetch128 149µs ± 2% 148µs ± 1% ~ (p=0.222 n=5+5)
neo/go/fs1-zhash.py 217µs ± 1% 214µs ± 5% ~ (p=0.643 n=5+5)
neo/go/fs1-zhash.go 49.8µs ± 2% 49.5µs ± 1% ~ (p=0.246 n=5+5)
neo/go/fs1-zhash.go+prefetch128 18.8µs ± 1% 19.1µs ± 2% +2.03% (p=0.048 n=5+5)
neo/go/fs1(!sha1)-zhash.go(!sha1) 40.4µs ± 3% 40.5µs ± 2% ~ (p=0.587 n=5+5)
neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 16.1µs ± 2% 15.8µs ± 3% ~ (p=0.238 n=5+5)
neo/go/sqlite-zhash.py 263µs ± 4% 253µs ± 3% -3.90% (p=0.024 n=5+5)
neo/go/sqlite-zhash.go 93.1µs ± 1% 92.7µs ± 1% ~ (p=0.595 n=5+5)
neo/go/sqlite-zhash.go+prefetch128 32.7µs ± 2% 32.6µs ± 4% ~ (p=0.659 n=5+5)
neo/go/sqlite-zhash.go(!sha1) 89.6µs ± 1% 91.2µs ± 1% +1.79% (p=0.024 n=5+5)
neo/go/sqlite-zhash.go+prefetch128(!sha1) 34.0µs ± 2% 32.7µs ± 2% -3.82% (p=0.008 n=5+5)

name old req/s new req/s delta
cluster:rio dataset:wczblk1-8
fs1-zwrk.go·1 300k ± 0% 299k ± 1% ~ (p=0.310 n=5+5)
fs1-zwrk.go·2 546k ± 0% 547k ± 1% ~ (p=0.690 n=5+5)
fs1-zwrk.go·3 810k ± 0% 812k ± 0% ~ (p=0.310 n=5+5)
fs1-zwrk.go·4 1.08M ± 0% 1.08M ± 0% ~ (p=0.841 n=5+5)
fs1-zwrk.go·8 1.42M ± 0% 1.42M ± 0% ~ (p=1.000 n=5+5)
fs1-zwrk.go·12 1.55M ± 0% 1.55M ± 0% ~ (p=1.000 n=5+5)
fs1-zwrk.go·16 1.55M ± 0% 1.54M ± 0% -0.34% (p=0.016 n=5+5)
zeo/py/fs1-zwrk.go·1 7.41k ± 1% 7.42k ± 1% ~ (p=0.690 n=5+5)
zeo/py/fs1-zwrk.go·2 9.03k ± 1% 8.95k ± 1% ~ (p=0.310 n=5+5)
zeo/py/fs1-zwrk.go·3 9.77k ± 1% 9.86k ± 1% ~ (p=0.151 n=5+5)
zeo/py/fs1-zwrk.go·4 10.1k ± 3% 10.1k ± 2% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·8 10.5k ± 0% 10.4k ± 2% -1.37% (p=0.032 n=5+5)
zeo/py/fs1-zwrk.go·12 10.6k ± 1% 10.6k ± 2% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·16 10.6k ± 1% 10.6k ± 1% ~ (p=0.222 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 6.80k ± 2% 6.78k ± 1% ~ (p=0.841 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 8.31k ± 7% 8.25k ± 8% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 8.60k ± 1% 8.48k ± 1% ~ (p=0.056 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 8.60k ± 1% 8.52k ± 0% ~ (p=0.114 n=4+4)
neo/py(!log)/sqlite-zwrk.go·8 8.61k ± 1% 8.51k ± 1% ~ (p=0.095 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 8.56k ± 1% 8.46k ± 2% ~ (p=0.151 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 8.49k ± 3% 8.51k ± 1% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·1 5.62k ± 6% 5.59k ± 2% ~ (p=0.310 n=5+5)
neo/py(!log)/sql-zwrk.go·2 6.75k ± 4% 6.83k ± 1% ~ (p=0.190 n=5+4)
neo/py(!log)/sql-zwrk.go·3 6.77k ± 2% 6.71k ± 2% ~ (p=0.548 n=5+5)
neo/py(!log)/sql-zwrk.go·4 6.51k ± 7% 6.56k ± 4% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·8 6.56k ± 4% 6.68k ± 4% ~ (p=0.310 n=5+5)
neo/py(!log)/sql-zwrk.go·12 6.84k ± 1% 6.73k ± 6% ~ (p=0.730 n=4+5)
neo/py(!log)/sql-zwrk.go·16 6.73k ± 3% 6.71k ± 3% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·1 15.5k ± 0% 15.6k ± 0% ~ (p=0.095 n=5+5)
neo/go/fs1-zwrk.go·2 29.9k ± 1% 30.2k ± 1% +0.84% (p=0.032 n=5+5)
neo/go/fs1-zwrk.go·3 39.4k ± 0% 39.7k ± 0% +0.70% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·4 49.4k ± 0% 49.6k ± 0% +0.54% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·8 68.4k ± 0% 68.8k ± 0% +0.62% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·12 72.5k ± 0% 73.0k ± 0% +0.66% (p=0.016 n=5+5)
neo/go/fs1-zwrk.go·16 73.2k ± 0% 73.7k ± 1% +0.79% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 26.2k ± 1% 25.3k ± 2% -3.17% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 47.6k ± 0% 47.8k ± 0% +0.46% (p=0.032 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 59.4k ± 0% 59.6k ± 0% ~ (p=0.095 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 72.2k ± 0% 72.4k ± 0% ~ (p=0.056 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 96.7k ± 0% 96.8k ± 0% ~ (p=0.841 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 109k ± 0% 110k ± 0% ~ (p=0.841 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 113k ± 1% 113k ± 1% ~ (p=0.548 n=5+5)
neo/go/sqlite-zwrk.go·1 9.82k ± 0% 9.91k ± 0% +0.88% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·2 18.3k ± 0% 18.4k ± 0% +0.56% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·3 25.3k ± 0% 25.5k ± 0% +0.91% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·4 30.3k ± 0% 30.6k ± 0% +0.80% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·8 39.5k ± 0% 40.1k ± 0% +1.54% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·12 40.8k ± 2% 41.8k ± 1% +2.31% (p=0.016 n=5+5)
neo/go/sqlite-zwrk.go·16 40.5k ± 2% 41.8k ± 2% +3.20% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 11.0k ± 1% 11.1k ± 1% ~ (p=0.222 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 20.0k ± 0% 20.1k ± 0% +0.35% (p=0.016 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 27.9k ± 0% 28.0k ± 0% +0.27% (p=0.016 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 34.1k ± 0% 34.3k ± 0% +0.62% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 44.1k ± 1% 44.7k ± 1% +1.53% (p=0.016 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 43.1k ± 1% 44.5k ± 1% +3.33% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 41.2k ± 2% 43.0k ± 2% +4.21% (p=0.008 n=5+5)
cluster:rio dataset:prod1-1024
fs1-zwrk.go·1 465k ± 1% 461k ± 1% ~ (p=0.056 n=5+5)
fs1-zwrk.go·2 920k ± 0% 918k ± 0% ~ (p=0.730 n=4+5)
fs1-zwrk.go·3 1.36M ± 1% 1.37M ± 1% ~ (p=0.548 n=5+5)
fs1-zwrk.go·4 1.81M ± 0% 1.80M ± 3% ~ (p=0.310 n=5+5)
fs1-zwrk.go·8 2.37M ± 1% 2.38M ± 2% ~ (p=0.690 n=5+5)
fs1-zwrk.go·12 2.41M ± 0% 2.42M ± 0% ~ (p=0.690 n=5+5)
fs1-zwrk.go·16 2.42M ± 0% 2.41M ± 0% ~ (p=0.056 n=5+5)
zeo/py/fs1-zwrk.go·1 8.98k ± 1% 8.88k ± 1% -1.08% (p=0.032 n=5+5)
zeo/py/fs1-zwrk.go·2 11.7k ± 1% 11.6k ± 2% ~ (p=0.310 n=5+5)
zeo/py/fs1-zwrk.go·3 12.9k ± 2% 12.5k ± 2% -2.84% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·4 13.4k ± 4% 13.1k ± 2% ~ (p=0.095 n=5+5)
zeo/py/fs1-zwrk.go·8 14.0k ± 2% 13.6k ± 1% -2.77% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·12 14.2k ± 2% 13.9k ± 1% -2.05% (p=0.032 n=5+5)
zeo/py/fs1-zwrk.go·16 14.2k ± 3% 13.8k ± 1% -2.84% (p=0.032 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 7.16k ± 4% 7.12k ± 3% ~ (p=0.548 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 8.75k ± 1% 8.64k ± 7% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 8.65k ± 4% 8.79k ± 1% ~ (p=0.548 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 8.53k ± 6% 8.73k ± 2% ~ (p=0.310 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 8.61k ± 3% 8.60k ± 2% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 8.64k ± 0% 8.78k ± 1% +1.63% (p=0.016 n=4+5)
neo/py(!log)/sqlite-zwrk.go·16 8.64k ± 1% 8.58k ± 3% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·1 5.88k ± 1% 5.91k ± 1% ~ (p=0.548 n=5+5)
neo/py(!log)/sql-zwrk.go·2 6.79k ± 2% 6.71k ± 9% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zwrk.go·3 6.58k ± 4% 6.85k ± 2% ~ (p=0.056 n=5+5)
neo/py(!log)/sql-zwrk.go·4 6.68k ± 4% 6.82k ± 1% ~ (p=0.730 n=5+4)
neo/py(!log)/sql-zwrk.go·8 6.83k ± 1% 6.80k ± 6% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·12 6.66k ± 4% 6.87k ± 2% +3.10% (p=0.016 n=5+5)
neo/py(!log)/sql-zwrk.go·16 6.65k ± 5% 6.90k ± 2% ~ (p=0.151 n=5+5)
neo/go/fs1-zwrk.go·1 21.8k ± 1% 21.9k ± 2% ~ (p=0.222 n=5+5)
neo/go/fs1-zwrk.go·2 39.2k ± 1% 39.6k ± 1% +0.94% (p=0.016 n=5+5)
neo/go/fs1-zwrk.go·3 51.4k ± 0% 51.5k ± 0% ~ (p=0.421 n=5+5)
neo/go/fs1-zwrk.go·4 62.8k ± 0% 62.8k ± 0% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·8 80.7k ± 1% 80.2k ± 1% ~ (p=0.421 n=5+5)
neo/go/fs1-zwrk.go·12 80.0k ± 2% 79.6k ± 3% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·16 78.3k ± 2% 77.1k ± 5% ~ (p=0.421 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 26.5k ± 1% 26.9k ± 1% +1.52% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 48.8k ± 0% 49.2k ± 0% +0.89% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 61.8k ± 0% 62.1k ± 0% ~ (p=0.056 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 74.0k ± 0% 74.2k ± 0% ~ (p=0.151 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 91.3k ± 0% 91.9k ± 2% ~ (p=0.190 n=4+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 93.1k ± 2% 92.9k ± 2% ~ (p=0.841 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 89.7k ± 2% 90.1k ± 2% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go·1 11.0k ± 1% 11.1k ± 0% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go·2 19.4k ± 1% 19.4k ± 0% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go·3 26.6k ± 0% 26.5k ± 0% ~ (p=0.095 n=5+5)
neo/go/sqlite-zwrk.go·4 31.9k ± 0% 31.7k ± 0% -0.47% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·8 37.4k ± 2% 37.3k ± 2% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go·12 35.2k ± 3% 35.4k ± 2% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go·16 34.6k ± 2% 34.8k ± 2% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 11.5k ± 1% 11.4k ± 1% -1.34% (p=0.032 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 20.1k ± 0% 19.8k ± 0% -1.52% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 27.6k ± 0% 27.3k ± 1% -0.93% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 33.4k ± 0% 33.1k ± 1% -0.81% (p=0.016 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 38.8k ± 2% 38.8k ± 1% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 36.4k ± 1% 36.0k ± 2% ~ (p=0.222 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 35.2k ± 2% 35.1k ± 2% ~ (p=0.690 n=5+5)

name old latency-time/object new latency-time/object delta
cluster:rio dataset:wczblk1-8
fs1-zwrk.go·1 3.33µs ± 0% 3.34µs ± 1% ~ (p=0.286 n=5+5)
fs1-zwrk.go·2 3.67µs ± 0% 3.65µs ± 1% ~ (p=0.667 n=5+5)
fs1-zwrk.go·3 3.70µs ± 0% 3.69µs ± 0% ~ (p=0.310 n=5+5)
fs1-zwrk.go·4 3.72µs ± 0% 3.72µs ± 0% ~ (p=0.984 n=5+5)
fs1-zwrk.go·8 5.62µs ± 0% 5.62µs ± 0% ~ (p=0.889 n=5+5)
fs1-zwrk.go·12 7.76µs ± 0% 7.76µs ± 0% ~ (p=1.000 n=5+5)
fs1-zwrk.go·16 10.3µs ± 0% 10.4µs ± 0% +0.34% (p=0.016 n=5+5)
zeo/py/fs1-zwrk.go·1 135µs ± 1% 135µs ± 1% ~ (p=0.690 n=5+5)
zeo/py/fs1-zwrk.go·2 222µs ± 1% 223µs ± 1% ~ (p=0.310 n=5+5)
zeo/py/fs1-zwrk.go·3 307µs ± 1% 304µs ± 1% ~ (p=0.151 n=5+5)
zeo/py/fs1-zwrk.go·4 398µs ± 3% 397µs ± 2% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·8 759µs ± 0% 770µs ± 2% +1.41% (p=0.032 n=5+5)
zeo/py/fs1-zwrk.go·12 1.13ms ± 1% 1.14ms ± 2% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·16 1.50ms ± 1% 1.51ms ± 1% ~ (p=0.222 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 147µs ± 2% 147µs ± 1% ~ (p=0.841 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 241µs ± 8% 243µs ± 8% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 349µs ± 1% 354µs ± 1% ~ (p=0.056 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 465µs ± 1% 470µs ± 0% ~ (p=0.114 n=4+4)
neo/py(!log)/sqlite-zwrk.go·8 930µs ± 1% 940µs ± 1% ~ (p=0.095 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 1.40ms ± 1% 1.42ms ± 2% ~ (p=0.151 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 1.88ms ± 3% 1.88ms ± 1% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·1 178µs ± 6% 179µs ± 2% ~ (p=0.310 n=5+5)
neo/py(!log)/sql-zwrk.go·2 297µs ± 4% 293µs ± 1% ~ (p=0.190 n=5+4)
neo/py(!log)/sql-zwrk.go·3 443µs ± 2% 447µs ± 2% ~ (p=0.548 n=5+5)
neo/py(!log)/sql-zwrk.go·4 616µs ± 8% 610µs ± 4% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·8 1.22ms ± 5% 1.20ms ± 4% ~ (p=0.310 n=5+5)
neo/py(!log)/sql-zwrk.go·12 1.75ms ± 1% 1.79ms ± 6% ~ (p=0.730 n=4+5)
neo/py(!log)/sql-zwrk.go·16 2.38ms ± 3% 2.38ms ± 3% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·1 64.4µs ± 0% 64.1µs ± 0% ~ (p=0.095 n=5+5)
neo/go/fs1-zwrk.go·2 66.8µs ± 1% 66.3µs ± 1% -0.83% (p=0.032 n=5+5)
neo/go/fs1-zwrk.go·3 76.1µs ± 0% 75.5µs ± 0% -0.69% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·4 81.0µs ± 0% 80.6µs ± 0% -0.53% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·8 117µs ± 0% 116µs ± 0% -0.62% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·12 165µs ± 0% 164µs ± 0% -0.65% (p=0.016 n=5+5)
neo/go/fs1-zwrk.go·16 219µs ± 0% 217µs ± 1% -0.78% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 38.2µs ± 1% 39.5µs ± 2% +3.29% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 42.0µs ± 0% 41.8µs ± 0% -0.45% (p=0.032 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 50.5µs ± 0% 50.4µs ± 0% ~ (p=0.095 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 55.4µs ± 0% 55.3µs ± 0% ~ (p=0.063 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 82.8µs ± 0% 82.7µs ± 0% ~ (p=0.841 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 110µs ± 0% 110µs ± 0% ~ (p=0.841 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 142µs ± 1% 142µs ± 1% ~ (p=0.548 n=5+5)
neo/go/sqlite-zwrk.go·1 102µs ± 0% 101µs ± 0% -0.87% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·2 110µs ± 0% 109µs ± 0% -0.55% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·3 119µs ± 0% 117µs ± 0% -0.90% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·4 132µs ± 0% 131µs ± 0% -0.79% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·8 203µs ± 0% 200µs ± 0% -1.52% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·12 294µs ± 2% 287µs ± 1% -2.26% (p=0.016 n=5+5)
neo/go/sqlite-zwrk.go·16 395µs ± 2% 383µs ± 2% -3.11% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 91.1µs ± 1% 90.4µs ± 1% ~ (p=0.222 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 100µs ± 0% 100µs ± 0% -0.35% (p=0.016 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 108µs ± 0% 107µs ± 0% -0.27% (p=0.016 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 117µs ± 0% 117µs ± 0% -0.62% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 182µs ± 1% 179µs ± 1% -1.51% (p=0.016 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 279µs ± 1% 270µs ± 1% -3.22% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 388µs ± 2% 372µs ± 2% -4.03% (p=0.008 n=5+5)
cluster:rio dataset:prod1-1024
fs1-zwrk.go·1 2.15µs ± 1% 2.17µs ± 1% ~ (p=0.056 n=5+5)
fs1-zwrk.go·2 2.17µs ± 0% 2.18µs ± 0% ~ (p=0.603 n=4+5)
fs1-zwrk.go·3 2.20µs ± 1% 2.20µs ± 1% ~ (p=0.460 n=5+5)
fs1-zwrk.go·4 2.21µs ± 0% 2.23µs ± 3% ~ (p=0.278 n=5+5)
fs1-zwrk.go·8 3.37µs ± 1% 3.36µs ± 2% ~ (p=0.690 n=5+5)
fs1-zwrk.go·12 4.97µs ± 0% 4.97µs ± 0% ~ (p=0.675 n=5+5)
fs1-zwrk.go·16 6.61µs ± 0% 6.63µs ± 0% ~ (p=0.063 n=5+5)
zeo/py/fs1-zwrk.go·1 111µs ± 1% 113µs ± 1% +1.09% (p=0.032 n=5+5)
zeo/py/fs1-zwrk.go·2 171µs ± 1% 173µs ± 2% ~ (p=0.310 n=5+5)
zeo/py/fs1-zwrk.go·3 233µs ± 2% 240µs ± 2% +2.94% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·4 298µs ± 4% 306µs ± 2% ~ (p=0.095 n=5+5)
zeo/py/fs1-zwrk.go·8 572µs ± 2% 588µs ± 1% +2.84% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·12 844µs ± 2% 861µs ± 1% +2.07% (p=0.032 n=5+5)
zeo/py/fs1-zwrk.go·16 1.12ms ± 3% 1.16ms ± 1% +2.90% (p=0.032 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 140µs ± 4% 140µs ± 3% ~ (p=0.548 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 229µs ± 1% 232µs ± 7% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 347µs ± 5% 341µs ± 1% ~ (p=0.548 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 470µs ± 7% 458µs ± 2% ~ (p=0.310 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 929µs ± 3% 930µs ± 2% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 1.39ms ± 0% 1.37ms ± 1% -1.60% (p=0.016 n=4+5)
neo/py(!log)/sqlite-zwrk.go·16 1.85ms ± 1% 1.86ms ± 3% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·1 170µs ± 1% 169µs ± 1% ~ (p=0.548 n=5+5)
neo/py(!log)/sql-zwrk.go·2 294µs ± 2% 299µs ±10% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zwrk.go·3 456µs ± 4% 438µs ± 1% ~ (p=0.056 n=5+5)
neo/py(!log)/sql-zwrk.go·4 599µs ± 4% 587µs ± 1% ~ (p=0.730 n=5+4)
neo/py(!log)/sql-zwrk.go·8 1.17ms ± 1% 1.18ms ± 6% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·12 1.80ms ± 4% 1.75ms ± 2% -3.05% (p=0.016 n=5+5)
neo/py(!log)/sql-zwrk.go·16 2.41ms ± 5% 2.32ms ± 2% ~ (p=0.151 n=5+5)
neo/go/fs1-zwrk.go·1 45.9µs ± 1% 45.6µs ± 2% ~ (p=0.167 n=5+5)
neo/go/fs1-zwrk.go·2 51.0µs ± 1% 50.6µs ± 1% -0.94% (p=0.016 n=5+5)
neo/go/fs1-zwrk.go·3 58.3µs ± 0% 58.3µs ± 0% ~ (p=0.421 n=5+5)
neo/go/fs1-zwrk.go·4 63.7µs ± 0% 63.7µs ± 0% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·8 99.2µs ± 1% 99.8µs ± 1% ~ (p=0.421 n=5+5)
neo/go/fs1-zwrk.go·12 150µs ± 2% 151µs ± 3% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·16 204µs ± 3% 208µs ± 5% ~ (p=0.421 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 37.7µs ± 1% 37.2µs ± 1% -1.50% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 41.0µs ± 0% 40.6µs ± 0% -0.88% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 48.5µs ± 0% 48.3µs ± 0% ~ (p=0.056 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 54.0µs ± 0% 53.9µs ± 0% ~ (p=0.151 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 87.6µs ± 0% 87.1µs ± 2% ~ (p=0.190 n=4+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 129µs ± 2% 129µs ± 2% ~ (p=0.841 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 178µs ± 2% 178µs ± 2% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go·1 90.7µs ± 1% 90.4µs ± 0% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go·2 103µs ± 1% 103µs ± 0% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go·3 113µs ± 0% 113µs ± 0% ~ (p=0.095 n=5+5)
neo/go/sqlite-zwrk.go·4 125µs ± 0% 126µs ± 0% +0.47% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·8 214µs ± 2% 215µs ± 2% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go·12 341µs ± 3% 339µs ± 2% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go·16 462µs ± 2% 460µs ± 2% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 86.7µs ± 1% 87.9µs ± 1% +1.36% (p=0.032 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 100µs ± 0% 101µs ± 0% +1.54% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 109µs ± 0% 110µs ± 1% +0.94% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 120µs ± 0% 121µs ± 1% +0.82% (p=0.016 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 206µs ± 2% 206µs ± 1% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 330µs ± 1% 333µs ± 2% ~ (p=0.222 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 455µs ± 2% 456µs ± 2% ~ (p=0.690 n=5+5)

3695ff12

X z6001: localhost timings, C > C1 disabled · 65de70b8

Kirill Smelkov authored Mar 06, 2018

Like for neo1 disabling C-states helps serial cases for zeo/py and
neo/py/sqlite and serial and parallel cases for neo/py/sql. For
neo/py/sql it also tends to make timings less noisy:

---- 8< ----
cluster:z6001 dataset:wczblk1-8
zeo/py/fs1-zhash.py 650µs ± 7% 583µs ± 9% -10.33% (p=0.032 n=5+5)
zeo/py/fs1-zhash.go 274µs ±13% 202µs ± 1% -26.34% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zhash.py 696µs ± 1% 476µs ± 4% -31.64% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zhash.go 338µs ± 7% 225µs ± 6% -33.47% (p=0.008 n=5+5)
neo/py(!log)/sql-zhash.py 1.00ms ±38% 0.59ms ±36% -41.17% (p=0.016 n=5+5)
neo/py(!log)/sql-zhash.go 434µs ± 6% 282µs ± 3% -35.10% (p=0.008 n=5+5)
neo/py(!log)/sql-zhash.go+prefetch128 277µs ± 9% 237µs ± 2% -14.37% (p=0.008 n=5+5)

zeo/py/fs1-zwrk.go·1 233µs ± 8% 195µs ± 2% -16.41% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 288µs ±14% 220µs ± 2% -23.74% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·1 400µs ±16% 278µs ± 1% -30.47% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·2 562µs ± 8% 470µs ± 0% -16.47% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·3 827µs ±13% 699µs ± 1% -15.44% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·4 1.13ms ±14% 0.96ms ±10% -15.10% (p=0.016 n=5+5)
neo/py(!log)/sql-zwrk.go·8 2.13ms ±13% 1.90ms ± 1% -10.78% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·12 3.24ms ±12% 2.82ms ± 2% -12.82% (p=0.032 n=5+5)
neo/py(!log)/sql-zwrk.go·16 4.62ms ± 8% 3.76ms ± 1% -18.69% (p=0.016 n=5+4)

cluster:z6001 dataset:prod1-1024
zeo/py/fs1-zhash.go 235µs ± 7% 167µs ± 1% -28.85% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zhash.py 664µs ± 2% 452µs ±10% -31.89% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zhash.go 269µs ± 7% 208µs ± 1% -22.79% (p=0.008 n=5+5)
neo/py(!log)/sql-zhash.py 1.03ms ±29% 0.57ms ±38% -44.81% (p=0.008 n=5+5)
neo/py(!log)/sql-zhash.go 406µs ± 2% 267µs ± 3% -34.15% (p=0.008 n=5+5)

zeo/py/fs1-zwrk.go·1 208µs ± 5% 163µs ± 1% -21.69% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 271µs ± 7% 210µs ± 6% -22.43% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·1 400µs ±11% 261µs ± 1% -34.78% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·2 554µs ± 7% 463µs ± 1% -16.42% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·3 783µs ±11% 692µs ± 0% -11.57% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·4 1.06ms ±11% 0.92ms ± 1% -12.52% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·8 2.07ms ± 9% 1.83ms ± 2% -11.28% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·12 3.02ms ± 7% 2.80ms ± 3% -7.52% (p=0.032 n=5+5)
neo/py(!log)/sql-zwrk.go·16 4.32ms ±12% 3.67ms ± 2% -15.10% (p=0.008 n=5+5)
---- 8< ----

Like on neo1 it also seems to be helping neo/go/* with slower python
client, but for neo/go/sqlite with go client too:

---- 8< ----
cluster:z6001 dataset:wczblk1-8
neo/go/fs1-zhash.py 526µs ± 8% 333µs ±10% -36.81% (p=0.008 n=5+5)
neo/go/sqlite-zhash.py 528µs ±15% 385µs ± 6% -27.15% (p=0.008 n=5+5)
neo/go/sqlite-zhash.go 204µs ±22% 142µs ± 1% -30.26% (p=0.008 n=5+5)
neo/go/sqlite-zhash.go(!sha1) 194µs ± 9% 132µs ± 3% -31.76% (p=0.008 n=5+5)

neo/go/sqlite-zwrk.go·1 208µs ±14% 139µs ± 1% -32.89% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·2 166µs ± 2% 147µs ± 1% -11.70% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·3 158µs ± 1% 150µs ± 0% -4.60% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·4 162µs ± 0% 157µs ± 0% -3.12% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 185µs ± 4% 130µs ± 1% -29.53% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 156µs ± 1% 136µs ± 1% -12.98% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 149µs ± 1% 139µs ± 0% -6.76% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 149µs ± 1% 142µs ± 0% -4.81% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 166µs ± 1% 163µs ± 0% -2.04% (p=0.008 n=5+5)

cluster:z6001 dataset:prod1-1024
neo/go/fs1-zhash.py 520µs ± 9% 321µs ±11% -38.25% (p=0.008 n=5+5)
neo/go/fs1-zhash.go 83.2µs ± 7% 74.8µs ± 3% -10.14% (p=0.008 n=5+5)
neo/go/sqlite-zhash.py 539µs ±11% 361µs ± 6% -32.97% (p=0.008 n=5+5)
neo/go/sqlite-zhash.go 196µs ± 9% 128µs ± 2% -34.66% (p=0.008 n=5+5)
neo/go/sqlite-zhash.go(!sha1) 168µs ± 8% 125µs ± 4% -25.63% (p=0.008 n=5+5)

neo/go/sqlite-zwrk.go·1 177µs ± 8% 126µs ± 1% -29.04% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·2 151µs ± 2% 136µs ± 1% -9.65% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·3 148µs ± 1% 140µs ± 0% -5.57% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·4 151µs ± 0% 145µs ± 0% -3.78% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·8 180µs ± 1% 177µs ± 1% -1.31% (p=0.016 n=5+5)

neo/go/sqlite-zwrk.go(!sha1)·1 176µs ± 4% 120µs ± 2% -31.54% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 152µs ± 3% 131µs ± 1% -13.38% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 147µs ± 1% 135µs ± 0% -7.68% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 148µs ± 2% 140µs ± 1% -5.20% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 176µs ± 1% 173µs ± 1% -1.65% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 225µs ± 1% 224µs ± 0% ~ (p=0.222 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 321µs ± 1% 321µs ± 1% ~ (p=1.000 n=5+5)
---- 8< ----

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

$ benchstat -split node,cluster,dataset 20180306-z6001-ffixed-c.txt 20180306-z6001-ffixed-noc_C1$3µs$.txt

name old pystone/s new pystone/s delta
node:z6001
pystone 109k ± 9% 114k ± 1% ~ (p=0.421 n=5+5)

name old time/op new time/op delta
node:z6001
crc32/py/4K 5.11µs ± 1% 5.15µs ± 4% ~ (p=0.738 n=5+5)
crc32/go/4K 1.72µs ± 0% 1.72µs ± 0% ~ (p=1.000 n=4+4)
sha1/py/4K 14.7µs ± 1% 14.7µs ± 1% ~ (p=0.841 n=5+5)
sha1/go/4K 10.3µs ± 0% 10.3µs ± 0% ~ (p=0.103 n=5+5)
unzlib/py/wczdata 37.1µs ± 8% 36.3µs ± 1% ~ (p=0.310 n=5+5)
unzlib/go/wczdata 31.5µs ± 0% 31.2µs ± 0% -1.12% (p=0.008 n=5+5)
unzlib/py/prod1-avg 18.5µs ± 3% 18.6µs ± 3% ~ (p=0.841 n=5+5)
unzlib/go/prod1-avg 10.0µs ± 1% 9.9µs ± 1% ~ (p=0.095 n=5+5)
disk/randread/direct/4K-min 126µs ± 1% 127µs ± 1% ~ (p=1.000 n=4+5)
disk/randread/direct/4K-avg 199µs ± 9% 168µs ± 0% -15.84% (p=0.008 n=5+5)
disk/randread/pagecache/4K-min 806ns ± 3% 799ns ± 1% ~ (p=0.746 n=5+5)
disk/randread/pagecache/4K-avg 1.44µs ± 7% 1.52µs ± 3% ~ (p=0.079 n=5+5)

name old time/object new time/object delta
cluster:z6001 dataset:wczblk1-8
fs1-zhash.py 37.6µs ± 2% 37.4µs ± 2% ~ (p=0.571 n=5+5)
fs1-zhash.go 6.00µs ± 2% 5.96µs ± 1% ~ (p=0.643 n=5+5)
fs1-zhash.go+prefetch128 8.00µs ± 5% 7.24µs ± 6% -9.50% (p=0.016 n=5+5)
zeo/py/fs1-zhash.py 650µs ± 7% 583µs ± 9% -10.33% (p=0.032 n=5+5)
zeo/py/fs1-zhash.go 274µs ±13% 202µs ± 1% -26.34% (p=0.008 n=5+5)
zeo/py/fs1-zhash.go+prefetch128 101µs ± 2% 102µs ± 2% ~ (p=0.310 n=5+5)
neo/py(!log)/sqlite-zhash.py 696µs ± 1% 476µs ± 4% -31.64% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zhash.go 338µs ± 7% 225µs ± 6% -33.47% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zhash.go+prefetch128 177µs ± 1% 179µs ± 1% ~ (p=0.143 n=5+5)
neo/py(!log)/sql-zhash.py 1.00ms ±38% 0.59ms ±36% -41.17% (p=0.016 n=5+5)
neo/py(!log)/sql-zhash.go 434µs ± 6% 282µs ± 3% -35.10% (p=0.008 n=5+5)
neo/py(!log)/sql-zhash.go+prefetch128 277µs ± 9% 237µs ± 2% -14.37% (p=0.008 n=5+5)
neo/go/fs1-zhash.py 526µs ± 8% 333µs ±10% -36.81% (p=0.008 n=5+5)
neo/go/fs1-zhash.go 102µs ± 8% 94µs ± 6% -8.17% (p=0.032 n=5+5)
neo/go/fs1-zhash.go+prefetch128 36.6µs ± 4% 36.6µs ± 3% ~ (p=0.841 n=5+5)
neo/go/fs1(!sha1)-zhash.go(!sha1) 76.4µs ± 5% 69.7µs ± 8% -8.75% (p=0.032 n=5+5)
neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 26.5µs ± 2% 26.4µs ± 5% ~ (p=0.730 n=5+5)
neo/go/sqlite-zhash.py 528µs ±15% 385µs ± 6% -27.15% (p=0.008 n=5+5)
neo/go/sqlite-zhash.go 204µs ±22% 142µs ± 1% -30.26% (p=0.008 n=5+5)
neo/go/sqlite-zhash.go+prefetch128 39.9µs ± 4% 41.4µs ± 5% ~ (p=0.111 n=5+5)
neo/go/sqlite-zhash.go(!sha1) 194µs ± 9% 132µs ± 3% -31.76% (p=0.008 n=5+5)
neo/go/sqlite-zhash.go+prefetch128(!sha1) 38.2µs ± 7% 36.7µs ± 5% ~ (p=0.151 n=5+5)
cluster:z6001 dataset:prod1-1024
fs1-zhash.py 30.3µs ± 1% 30.0µs ± 1% ~ (p=0.373 n=5+5)
fs1-zhash.go 4.62µs ± 3% 4.60µs ± 0% ~ (p=0.968 n=5+4)
fs1-zhash.go+prefetch128 5.76µs ± 8% 5.48µs ± 4% ~ (p=0.056 n=5+5)
zeo/py/fs1-zhash.py 632µs ±15% 560µs ± 3% ~ (p=0.151 n=5+5)
zeo/py/fs1-zhash.go 235µs ± 7% 167µs ± 1% -28.85% (p=0.008 n=5+5)
zeo/py/fs1-zhash.go+prefetch128 87.2µs ± 1% 88.5µs ± 1% +1.49% (p=0.048 n=5+5)
neo/py(!log)/sqlite-zhash.py 664µs ± 2% 452µs ±10% -31.89% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zhash.go 269µs ± 7% 208µs ± 1% -22.79% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zhash.go+prefetch128 162µs ± 0% 163µs ± 0% ~ (p=0.397 n=4+5)
neo/py(!log)/sql-zhash.py 1.03ms ±29% 0.57ms ±38% -44.81% (p=0.008 n=5+5)
neo/py(!log)/sql-zhash.go 406µs ± 2% 267µs ± 3% -34.15% (p=0.008 n=5+5)
neo/py(!log)/sql-zhash.go+prefetch128 268µs ± 5% 228µs ±10% -14.87% (p=0.008 n=5+5)
neo/go/fs1-zhash.py 520µs ± 9% 321µs ±11% -38.25% (p=0.008 n=5+5)
neo/go/fs1-zhash.go 83.2µs ± 7% 74.8µs ± 3% -10.14% (p=0.008 n=5+5)
neo/go/fs1-zhash.go+prefetch128 24.0µs ± 5% 24.1µs ± 1% ~ (p=0.548 n=5+5)
neo/go/fs1(!sha1)-zhash.go(!sha1) 67.0µs ± 3% 65.2µs ± 5% ~ (p=0.095 n=5+5)
neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 21.2µs ± 4% 21.1µs ± 2% ~ (p=0.952 n=5+5)
neo/go/sqlite-zhash.py 539µs ±11% 361µs ± 6% -32.97% (p=0.008 n=5+5)
neo/go/sqlite-zhash.go 196µs ± 9% 128µs ± 2% -34.66% (p=0.008 n=5+5)
neo/go/sqlite-zhash.go+prefetch128 35.0µs ± 3% 34.6µs ± 2% ~ (p=0.302 n=5+5)
neo/go/sqlite-zhash.go(!sha1) 168µs ± 8% 125µs ± 4% -25.63% (p=0.008 n=5+5)
neo/go/sqlite-zhash.go+prefetch128(!sha1) 35.1µs ± 4% 34.9µs ± 2% ~ (p=1.000 n=5+5)

name old req/s new req/s delta
cluster:z6001 dataset:wczblk1-8
fs1-zwrk.go·1 230k ± 1% 231k ± 1% ~ (p=0.548 n=5+5)
fs1-zwrk.go·2 437k ± 5% 444k ± 1% ~ (p=0.421 n=5+5)
fs1-zwrk.go·3 663k ± 4% 661k ± 4% ~ (p=1.000 n=5+5)
fs1-zwrk.go·4 880k ± 1% 878k ± 3% ~ (p=0.841 n=5+5)
fs1-zwrk.go·8 1.75M ± 2% 1.76M ± 2% ~ (p=0.548 n=5+5)
fs1-zwrk.go·12 2.56M ± 0% 2.51M ± 3% ~ (p=0.063 n=4+5)
fs1-zwrk.go·16 2.89M ± 1% 2.90M ± 1% ~ (p=0.310 n=5+5)
zeo/py/fs1-zwrk.go·1 4.30k ± 8% 5.14k ± 2% +19.34% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·2 6.33k ± 0% 6.38k ± 2% +0.85% (p=0.016 n=4+5)
zeo/py/fs1-zwrk.go·3 6.90k ± 0% 7.05k ± 1% +2.13% (p=0.016 n=4+5)
zeo/py/fs1-zwrk.go·4 7.14k ± 1% 7.22k ± 2% ~ (p=0.111 n=4+5)
zeo/py/fs1-zwrk.go·8 7.53k ± 2% 7.50k ± 1% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·12 7.65k ± 0% 7.53k ± 0% -1.59% (p=0.016 n=4+5)
zeo/py/fs1-zwrk.go·16 7.57k ± 0% 7.66k ± 1% +1.17% (p=0.032 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 3.50k ±15% 4.55k ± 2% +30.01% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 5.58k ± 0% 5.59k ± 1% ~ (p=0.730 n=4+5)
neo/py(!log)/sqlite-zwrk.go·3 5.63k ± 2% 5.56k ± 0% ~ (p=0.190 n=5+4)
neo/py(!log)/sqlite-zwrk.go·4 5.56k ± 1% 5.54k ± 0% ~ (p=0.095 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 5.61k ± 2% 5.59k ± 2% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 5.62k ± 1% 5.57k ± 0% -0.82% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 5.62k ± 1% 5.58k ± 0% ~ (p=0.413 n=4+5)
neo/py(!log)/sql-zwrk.go·1 2.53k ±17% 3.59k ± 1% +41.99% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·2 3.57k ± 9% 4.26k ± 0% +19.25% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·3 3.65k ±14% 4.29k ± 1% +17.53% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·4 3.56k ±16% 4.17k ± 9% +17.25% (p=0.016 n=5+5)
neo/py(!log)/sql-zwrk.go·8 3.78k ±12% 4.20k ± 1% +11.12% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·12 3.73k ±13% 4.25k ± 2% +13.97% (p=0.032 n=5+5)
neo/py(!log)/sql-zwrk.go·16 3.47k ± 9% 4.26k ± 1% +22.71% (p=0.016 n=5+4)
neo/go/fs1-zwrk.go·1 10.7k ± 5% 11.1k ± 7% ~ (p=0.310 n=5+5)
neo/go/fs1-zwrk.go·2 22.3k ± 1% 23.1k ± 2% +3.68% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·3 31.7k ± 1% 32.1k ± 1% +1.34% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·4 43.2k ± 1% 43.5k ± 0% +0.72% (p=0.032 n=5+5)
neo/go/fs1-zwrk.go·8 78.3k ± 0% 78.1k ± 0% ~ (p=0.222 n=5+5)
neo/go/fs1-zwrk.go·12 92.5k ± 0% 92.4k ± 0% ~ (p=0.690 n=5+5)
neo/go/fs1-zwrk.go·16 103k ± 1% 102k ± 0% ~ (p=0.310 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 15.0k ± 5% 15.1k ± 3% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 31.5k ± 1% 31.8k ± 1% +0.91% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 43.8k ± 0% 44.1k ± 0% +0.82% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 57.4k ± 0% 57.9k ± 0% +0.92% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 100k ± 0% 100k ± 0% ~ (p=0.222 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 116k ± 0% 116k ± 0% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 126k ± 1% 126k ± 0% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go·1 4.85k ±15% 7.17k ± 1% +47.73% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·2 12.0k ± 2% 13.6k ± 1% +13.23% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·3 19.0k ± 1% 19.9k ± 0% +4.82% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·4 24.7k ± 0% 25.5k ± 0% +3.22% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·8 44.8k ± 0% 44.9k ± 0% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go·12 56.3k ± 0% 55.7k ± 0% -0.92% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·16 58.0k ± 0% 57.4k ± 1% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 5.41k ± 4% 7.67k ± 1% +41.83% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 12.8k ± 1% 14.7k ± 1% +14.92% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 20.2k ± 1% 21.6k ± 0% +7.25% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 26.8k ± 1% 28.2k ± 0% +5.05% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 48.1k ± 1% 49.1k ± 0% +2.08% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 60.3k ± 0% 60.4k ± 0% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 61.7k ± 1% 61.9k ± 1% ~ (p=0.690 n=5+5)
cluster:z6001 dataset:prod1-1024
fs1-zwrk.go·1 347k ± 2% 347k ± 2% ~ (p=1.000 n=5+5)
fs1-zwrk.go·2 660k ± 3% 659k ± 2% ~ (p=0.841 n=5+5)
fs1-zwrk.go·3 985k ± 4% 978k ± 4% ~ (p=0.421 n=5+5)
fs1-zwrk.go·4 1.31M ± 2% 1.30M ± 4% ~ (p=0.421 n=5+5)
fs1-zwrk.go·8 2.55M ± 4% 2.52M ± 6% ~ (p=0.690 n=5+5)
fs1-zwrk.go·12 2.81M ± 1% 3.02M ± 1% +7.78% (p=0.008 n=5+5)
fs1-zwrk.go·16 2.85M ± 2% 3.06M ± 1% +7.51% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·1 4.80k ± 5% 6.13k ± 1% +27.58% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·2 8.18k ± 1% 8.16k ± 2% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·3 8.96k ± 1% 8.99k ± 2% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·4 8.88k ± 9% 9.37k ± 1% ~ (p=0.548 n=5+5)
zeo/py/fs1-zwrk.go·8 10.0k ± 2% 9.8k ± 5% ~ (p=0.905 n=4+5)
zeo/py/fs1-zwrk.go·12 9.80k ± 6% 9.19k ± 8% ~ (p=0.056 n=5+5)
zeo/py/fs1-zwrk.go·16 10.1k ± 6% 8.9k ±15% ~ (p=0.095 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 3.70k ± 6% 4.77k ± 6% +29.01% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 5.77k ± 0% 5.92k ± 0% +2.58% (p=0.029 n=4+4)
neo/py(!log)/sqlite-zwrk.go·3 5.77k ± 0% 5.76k ± 0% -0.25% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 5.77k ± 0% 5.82k ± 2% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 5.84k ± 1% 5.75k ± 0% -1.67% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 5.78k ± 2% 5.71k ± 0% -1.27% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 5.80k ± 1% 5.71k ± 0% -1.63% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·1 2.51k ±12% 3.83k ± 1% +52.68% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·2 3.62k ± 8% 4.32k ± 1% +19.32% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·3 3.86k ±11% 4.33k ± 0% +12.15% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·4 3.82k ±11% 4.33k ± 1% +13.35% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·8 3.89k ±10% 4.36k ± 2% +12.29% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·12 3.98k ± 7% 4.29k ± 3% +7.85% (p=0.032 n=5+5)
neo/py(!log)/sql-zwrk.go·16 3.72k ±13% 4.36k ± 2% +17.09% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·1 13.8k ± 3% 14.0k ± 3% ~ (p=0.310 n=5+5)
neo/go/fs1-zwrk.go·2 28.1k ± 0% 28.4k ± 1% +1.29% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·3 40.2k ± 0% 40.5k ± 0% +0.60% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·4 52.8k ± 1% 53.1k ± 0% +0.54% (p=0.032 n=5+5)
neo/go/fs1-zwrk.go·8 90.6k ± 0% 90.2k ± 0% -0.48% (p=0.032 n=5+5)
neo/go/fs1-zwrk.go·12 95.8k ± 1% 95.0k ± 2% ~ (p=0.151 n=5+5)
neo/go/fs1-zwrk.go·16 90.9k ± 1% 90.4k ± 2% ~ (p=0.841 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 16.2k ± 2% 16.3k ± 2% ~ (p=0.690 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 32.9k ± 1% 33.4k ± 0% +1.52% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 46.2k ± 0% 46.5k ± 0% +0.68% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 59.8k ± 1% 60.4k ± 0% +0.91% (p=0.016 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 98.1k ± 0% 98.7k ± 1% ~ (p=0.056 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 102k ± 1% 103k ± 1% ~ (p=0.095 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 97.0k ± 2% 98.4k ± 2% ~ (p=0.095 n=5+5)
neo/go/sqlite-zwrk.go·1 5.67k ± 8% 7.97k ± 1% +40.55% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·2 13.3k ± 2% 14.7k ± 1% +10.67% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·3 20.3k ± 1% 21.5k ± 0% +5.90% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·4 26.5k ± 0% 27.6k ± 0% +3.93% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·8 44.5k ± 1% 45.1k ± 1% +1.33% (p=0.016 n=5+5)
neo/go/sqlite-zwrk.go·12 52.3k ± 1% 52.6k ± 0% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go·16 48.9k ± 1% 48.8k ± 1% ~ (p=0.548 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 5.69k ± 4% 8.31k ± 2% +45.99% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 13.2k ± 3% 15.2k ± 1% +15.42% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 20.5k ± 1% 22.2k ± 0% +8.31% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 27.1k ± 2% 28.6k ± 1% +5.47% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 45.4k ± 1% 46.2k ± 1% +1.67% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 53.3k ± 1% 53.5k ± 0% ~ (p=0.222 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 49.8k ± 1% 49.8k ± 1% ~ (p=1.000 n=5+5)

name old latency-time/object new latency-time/object delta
cluster:z6001 dataset:wczblk1-8
fs1-zwrk.go·1 4.34µs ± 1% 4.33µs ± 1% ~ (p=0.540 n=5+5)
fs1-zwrk.go·2 4.58µs ± 5% 4.51µs ± 1% ~ (p=0.381 n=5+5)
fs1-zwrk.go·3 4.52µs ± 4% 4.54µs ± 4% ~ (p=0.952 n=5+5)
fs1-zwrk.go·4 4.55µs ± 1% 4.56µs ± 3% ~ (p=0.841 n=5+5)
fs1-zwrk.go·8 4.58µs ± 2% 4.56µs ± 2% ~ (p=0.548 n=5+5)
fs1-zwrk.go·12 4.69µs ± 0% 4.77µs ± 3% ~ (p=0.063 n=4+5)
fs1-zwrk.go·16 5.53µs ± 1% 5.51µs ± 1% ~ (p=0.310 n=5+5)
zeo/py/fs1-zwrk.go·1 233µs ± 8% 195µs ± 2% -16.41% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·2 315µs ± 2% 314µs ± 2% ~ (p=0.095 n=5+5)
zeo/py/fs1-zwrk.go·3 435µs ± 0% 426µs ± 1% -2.08% (p=0.016 n=4+5)
zeo/py/fs1-zwrk.go·4 560µs ± 1% 554µs ± 2% ~ (p=0.111 n=4+5)
zeo/py/fs1-zwrk.go·8 1.06ms ± 2% 1.07ms ± 1% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·12 1.57ms ± 0% 1.59ms ± 0% +1.62% (p=0.016 n=4+5)
zeo/py/fs1-zwrk.go·16 2.11ms ± 0% 2.09ms ± 1% -1.15% (p=0.032 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 288µs ±14% 220µs ± 2% -23.74% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 358µs ± 0% 358µs ± 1% ~ (p=0.730 n=4+5)
neo/py(!log)/sqlite-zwrk.go·3 533µs ± 2% 539µs ± 0% ~ (p=0.190 n=5+4)
neo/py(!log)/sqlite-zwrk.go·4 720µs ± 1% 723µs ± 0% ~ (p=0.095 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 1.43ms ± 2% 1.43ms ± 2% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 2.14ms ± 1% 2.15ms ± 0% +0.82% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 2.85ms ± 1% 2.87ms ± 0% ~ (p=0.413 n=4+5)
neo/py(!log)/sql-zwrk.go·1 400µs ±16% 278µs ± 1% -30.47% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·2 562µs ± 8% 470µs ± 0% -16.47% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·3 827µs ±13% 699µs ± 1% -15.44% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·4 1.13ms ±14% 0.96ms ±10% -15.10% (p=0.016 n=5+5)
neo/py(!log)/sql-zwrk.go·8 2.13ms ±13% 1.90ms ± 1% -10.78% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·12 3.24ms ±12% 2.82ms ± 2% -12.82% (p=0.032 n=5+5)
neo/py(!log)/sql-zwrk.go·16 4.62ms ± 8% 3.76ms ± 1% -18.69% (p=0.016 n=5+4)
neo/go/fs1-zwrk.go·1 93.9µs ± 4% 90.4µs ± 7% ~ (p=0.310 n=5+5)
neo/go/fs1-zwrk.go·2 89.6µs ± 1% 86.5µs ± 2% -3.55% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·3 94.6µs ± 1% 93.3µs ± 1% -1.33% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·4 92.6µs ± 1% 91.9µs ± 0% -0.71% (p=0.032 n=5+5)
neo/go/fs1-zwrk.go·8 102µs ± 0% 102µs ± 0% ~ (p=0.222 n=5+5)
neo/go/fs1-zwrk.go·12 130µs ± 0% 130µs ± 0% ~ (p=0.690 n=5+5)
neo/go/fs1-zwrk.go·16 156µs ± 1% 157µs ± 0% ~ (p=0.310 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 66.8µs ± 5% 66.1µs ± 3% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 63.5µs ± 1% 62.9µs ± 1% -0.90% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 68.5µs ± 0% 68.0µs ± 0% -0.81% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 69.7µs ± 0% 69.0µs ± 0% -0.91% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 79.7µs ± 0% 79.9µs ± 0% ~ (p=0.222 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 103µs ± 0% 103µs ± 0% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 127µs ± 1% 127µs ± 0% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go·1 208µs ±14% 139µs ± 1% -32.89% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·2 166µs ± 2% 147µs ± 1% -11.70% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·3 158µs ± 1% 150µs ± 0% -4.60% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·4 162µs ± 0% 157µs ± 0% -3.12% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·8 178µs ± 0% 178µs ± 0% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go·12 213µs ± 0% 215µs ± 0% +0.93% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·16 276µs ± 0% 279µs ± 1% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 185µs ± 4% 130µs ± 1% -29.53% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 156µs ± 1% 136µs ± 1% -12.98% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 149µs ± 1% 139µs ± 0% -6.76% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 149µs ± 1% 142µs ± 0% -4.81% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 166µs ± 1% 163µs ± 0% -2.04% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 199µs ± 0% 199µs ± 0% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 259µs ± 1% 259µs ± 1% ~ (p=0.690 n=5+5)
cluster:z6001 dataset:prod1-1024
fs1-zwrk.go·1 2.88µs ± 2% 2.88µs ± 2% ~ (p=1.000 n=5+5)
fs1-zwrk.go·2 3.03µs ± 3% 3.03µs ± 3% ~ (p=0.841 n=5+5)
fs1-zwrk.go·3 3.05µs ± 4% 3.07µs ± 4% ~ (p=0.421 n=5+5)
fs1-zwrk.go·4 3.05µs ± 2% 3.09µs ± 4% ~ (p=0.421 n=5+5)
fs1-zwrk.go·8 3.14µs ± 4% 3.18µs ± 6% ~ (p=0.690 n=5+5)
fs1-zwrk.go·12 4.28µs ± 1% 3.97µs ± 1% -7.22% (p=0.008 n=5+5)
fs1-zwrk.go·16 5.63µs ± 2% 5.23µs ± 1% -7.01% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·1 208µs ± 5% 163µs ± 1% -21.69% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·2 245µs ± 1% 245µs ± 2% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·3 335µs ± 1% 334µs ± 2% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·4 453µs ±10% 427µs ± 1% ~ (p=0.548 n=5+5)
zeo/py/fs1-zwrk.go·8 803µs ± 2% 815µs ± 5% ~ (p=0.905 n=4+5)
zeo/py/fs1-zwrk.go·12 1.23ms ± 6% 1.31ms ± 8% ~ (p=0.056 n=5+5)
zeo/py/fs1-zwrk.go·16 1.59ms ± 6% 1.82ms ±14% ~ (p=0.095 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 271µs ± 7% 210µs ± 6% -22.43% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 346µs ± 0% 338µs ± 0% -2.52% (p=0.029 n=4+4)
neo/py(!log)/sqlite-zwrk.go·3 520µs ± 0% 521µs ± 0% +0.25% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 694µs ± 0% 688µs ± 2% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 1.37ms ± 1% 1.39ms ± 0% +1.68% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 2.07ms ± 2% 2.10ms ± 0% +1.28% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 2.76ms ± 1% 2.80ms ± 0% +1.65% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·1 400µs ±11% 261µs ± 1% -34.78% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·2 554µs ± 7% 463µs ± 1% -16.42% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·3 783µs ±11% 692µs ± 0% -11.57% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·4 1.06ms ±11% 0.92ms ± 1% -12.52% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·8 2.07ms ± 9% 1.83ms ± 2% -11.28% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·12 3.02ms ± 7% 2.80ms ± 3% -7.52% (p=0.032 n=5+5)
neo/py(!log)/sql-zwrk.go·16 4.32ms ±12% 3.67ms ± 2% -15.10% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·1 72.6µs ± 3% 71.5µs ± 3% ~ (p=0.310 n=5+5)
neo/go/fs1-zwrk.go·2 71.2µs ± 0% 70.3µs ± 1% -1.27% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·3 74.6µs ± 0% 74.1µs ± 0% -0.59% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·4 75.7µs ± 1% 75.3µs ± 0% -0.54% (p=0.032 n=5+5)
neo/go/fs1-zwrk.go·8 88.3µs ± 0% 88.7µs ± 0% +0.48% (p=0.032 n=5+5)
neo/go/fs1-zwrk.go·12 125µs ± 1% 126µs ± 2% ~ (p=0.151 n=5+5)
neo/go/fs1-zwrk.go·16 176µs ± 1% 177µs ± 2% ~ (p=0.841 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 61.7µs ± 2% 61.3µs ± 2% ~ (p=0.651 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 60.7µs ± 1% 59.8µs ± 0% -1.50% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 64.9µs ± 0% 64.5µs ± 0% -0.68% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 66.9µs ± 1% 66.3µs ± 0% -0.90% (p=0.016 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 81.5µs ± 0% 81.0µs ± 1% ~ (p=0.056 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 118µs ± 1% 116µs ± 1% ~ (p=0.095 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 165µs ± 2% 163µs ± 2% ~ (p=0.095 n=5+5)
neo/go/sqlite-zwrk.go·1 177µs ± 8% 126µs ± 1% -29.04% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·2 151µs ± 2% 136µs ± 1% -9.65% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·3 148µs ± 1% 140µs ± 0% -5.57% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·4 151µs ± 0% 145µs ± 0% -3.78% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·8 180µs ± 1% 177µs ± 1% -1.31% (p=0.016 n=5+5)
neo/go/sqlite-zwrk.go·12 229µs ± 1% 228µs ± 0% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go·16 327µs ± 1% 328µs ± 1% ~ (p=0.548 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 176µs ± 4% 120µs ± 2% -31.54% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 152µs ± 3% 131µs ± 1% -13.38% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 147µs ± 1% 135µs ± 0% -7.68% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 148µs ± 2% 140µs ± 1% -5.20% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 176µs ± 1% 173µs ± 1% -1.65% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 225µs ± 1% 224µs ± 0% ~ (p=0.222 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 321µs ± 1% 321µs ± 1% ~ (p=1.000 n=5+5)

65de70b8

X neo1: localhost timings, C > C1 disabled · f40c8b4b

Kirill Smelkov authored Mar 06, 2018

$ benchstat -split node,cluster,dataset 20180306-neo1-ffixed-c.txt 20180306-neo1-ffixed-noc_C1$3µs$.txt

Disabling C states helps serial cases for zeo/py and neo/py/sqlite and
both serial and parallel cases for neo/py/sql. For neo/py/sql it also
denoises the timing.

---- 8< ----
cluster:neo1 dataset:wczblk1-8
zeo/py/fs1-zhash.py 523µs ± 1% 465µs ± 4% -11.04% (p=0.008 n=5+5)
zeo/py/fs1-zhash.go 194µs ± 4% 173µs ± 2% -10.70% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zhash.py 684µs ± 3% 389µs ± 1% -43.08% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zhash.go 236µs ± 2% 198µs ± 5% -16.19% (p=0.008 n=5+5)
neo/py(!log)/sql-zhash.py 942µs ±47% 448µs ± 3% -52.47% (p=0.016 n=5+4)
neo/py(!log)/sql-zhash.go 300µs ±17% 251µs ± 2% -16.37% (p=0.008 n=5+5)

zeo/py/fs1-zwrk.go·1 194µs ± 1% 171µs ± 1% -11.93% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 232µs ± 4% 198µs ± 3% -14.97% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·1 323µs ± 6% 242µs ± 1% -24.90% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·2 503µs ± 2% 421µs ± 5% -16.28% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·3 742µs ± 3% 639µs ± 4% -13.97% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·4 986µs ± 4% 838µs ± 2% -15.02% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·8 2.11ms ± 8% 1.71ms ± 4% -18.91% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·12 3.02ms ± 3% 2.57ms ± 3% -14.83% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·16 4.06ms ± 1% 3.39ms ± 3% -16.33% (p=0.008 n=5+5)

cluster:neo1 dataset:prod1-1024
zeo/py/fs1-zhash.go 170µs ± 3% 148µs ± 3% -13.05% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zhash.py 665µs ± 2% 382µs ± 3% -42.60% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zhash.go 219µs ± 2% 181µs ± 1% -17.27% (p=0.008 n=5+5)
neo/py(!log)/sql-zhash.py 886µs ±56% 426µs ± 1% -51.90% (p=0.016 n=5+4)
neo/py(!log)/sql-zhash.go 298µs ± 9% 234µs ± 2% -21.22% (p=0.008 n=5+5)

zeo/py/fs1-zwrk.go·1 173µs ± 3% 146µs ± 2% -15.31% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 204µs ± 8% 182µs ± 3% -11.14% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·1 287µs ± 8% 236µs ± 8% -17.73% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·2 495µs ± 6% 406µs ± 1% -17.95% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·3 740µs ± 8% 618µs ± 3% -16.50% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·4 1.01ms ± 4% 0.82ms ± 2% -18.75% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·8 1.93ms ± 3% 1.64ms ± 1% -15.14% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·12 3.01ms ± 4% 2.45ms ± 3% -18.53% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·16 4.05ms ±10% 3.33ms ± 8% -17.74% (p=0.008 n=5+5)
---- 8< ----

It looks to be also helping to neo/go/* with python (thus slower)
client:

---- 8< ----
cluster:neo1 dataset:wczblk1-8
neo/go/fs1-zhash.py 383µs ±20% 270µs ± 2% -29.62% (p=0.008 n=5+5)
neo/go/sqlite-zhash.py 402µs ± 6% 323µs ± 1% -19.66% (p=0.008 n=5+5)

cluster:neo1 dataset:prod1-1024
neo/go/fs1-zhash.py 319µs ±11% 260µs ± 2% -18.46% (p=0.008 n=5+5)
neo/go/sqlite-zhash.py 382µs ± 6% 310µs ± 2% -19.04% (p=0.008 n=5+5)
---- 8< ----

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

$ benchstat -split node,cluster,dataset 20180306-neo1-ffixed-c.txt 20180306-neo1-ffixed-noc_C1$3µs$.txt

name old pystone/s new pystone/s delta
node:neo1
pystone 106k ± 1% 106k ± 1% ~ (p=0.548 n=5+5)

name old time/op new time/op delta
node:neo1
crc32/py/4K 5.13µs ± 1% 5.13µs ± 1% ~ (p=1.000 n=5+5)
crc32/go/4K 2.79µs ± 0% 2.79µs ± 0% -0.06% (p=0.032 n=5+5)
sha1/py/4K 13.4µs ± 1% 13.5µs ± 1% ~ (p=0.548 n=5+5)
sha1/go/4K 9.83µs ± 0% 9.85µs ± 1% ~ (p=0.905 n=5+4)
unzlib/py/wczdata 36.1µs ± 0% 36.1µs ± 1% ~ (p=0.841 n=5+5)
unzlib/go/wczdata 31.1µs ± 1% 30.9µs ± 1% ~ (p=0.111 n=5+5)
unzlib/py/prod1-avg 16.3µs ± 2% 16.8µs ±10% ~ (p=0.548 n=5+5)
unzlib/go/prod1-avg 9.42µs ± 0% 9.27µs ± 1% -1.58% (p=0.008 n=5+5)
disk/randread/direct/4K-min 162µs ± 0% 162µs ± 0% ~ (p=0.270 n=5+4)
disk/randread/direct/4K-avg 187µs ± 2% 172µs ± 0% -8.20% (p=0.008 n=5+5)
disk/randread/pagecache/4K-min 389ns ± 1% 390ns ± 1% ~ (p=0.548 n=5+5)
disk/randread/pagecache/4K-avg 804ns ± 0% 894ns ± 0% +11.28% (p=0.016 n=4+5)

name old time/object new time/object delta
cluster:neo1 dataset:wczblk1-8
fs1-zhash.py 34.7µs ± 2% 34.4µs ± 2% ~ (p=0.119 n=5+5)
fs1-zhash.go 6.00µs ± 2% 5.90µs ± 0% ~ (p=0.095 n=5+4)
fs1-zhash.go+prefetch128 6.52µs ± 4% 6.26µs ± 3% ~ (p=0.079 n=5+5)
zeo/py/fs1-zhash.py 523µs ± 1% 465µs ± 4% -11.04% (p=0.008 n=5+5)
zeo/py/fs1-zhash.go 194µs ± 4% 173µs ± 2% -10.70% (p=0.008 n=5+5)
zeo/py/fs1-zhash.go+prefetch128 98.6µs ± 3% 98.8µs ± 1% ~ (p=0.810 n=5+5)
neo/py(!log)/sqlite-zhash.py 684µs ± 3% 389µs ± 1% -43.08% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zhash.go 236µs ± 2% 198µs ± 5% -16.19% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zhash.go+prefetch128 162µs ± 2% 165µs ± 4% ~ (p=0.310 n=5+5)
neo/py(!log)/sql-zhash.py 942µs ±47% 448µs ± 3% -52.47% (p=0.016 n=5+4)
neo/py(!log)/sql-zhash.go 300µs ±17% 251µs ± 2% -16.37% (p=0.008 n=5+5)
neo/py(!log)/sql-zhash.go+prefetch128 240µs ± 6% 220µs ± 1% -8.51% (p=0.008 n=5+5)
neo/go/fs1-zhash.py 383µs ±20% 270µs ± 2% -29.62% (p=0.008 n=5+5)
neo/go/fs1-zhash.go 81.3µs ± 1% 81.0µs ± 4% ~ (p=0.690 n=5+5)
neo/go/fs1-zhash.go+prefetch128 33.8µs ± 5% 34.9µs ± 6% ~ (p=0.381 n=5+5)
neo/go/fs1(!sha1)-zhash.go(!sha1) 57.6µs ± 3% 56.0µs ± 3% -2.71% (p=0.024 n=5+5)
neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 22.9µs ± 6% 22.7µs ± 7% ~ (p=1.000 n=5+5)
neo/go/sqlite-zhash.py 402µs ± 6% 323µs ± 1% -19.66% (p=0.008 n=5+5)
neo/go/sqlite-zhash.go 125µs ± 1% 124µs ± 1% ~ (p=0.056 n=5+5)
neo/go/sqlite-zhash.go+prefetch128 48.4µs ± 8% 46.9µs ± 2% ~ (p=0.690 n=5+5)
neo/go/sqlite-zhash.go(!sha1) 116µs ± 2% 113µs ± 2% -1.96% (p=0.032 n=5+5)
neo/go/sqlite-zhash.go+prefetch128(!sha1) 45.9µs ± 5% 46.6µs ± 4% ~ (p=0.341 n=5+5)
cluster:neo1 dataset:prod1-1024
fs1-zhash.py 28.9µs ± 1% 28.9µs ± 1% ~ (p=0.746 n=5+5)
fs1-zhash.go 3.76µs ± 4% 3.76µs ± 2% ~ (p=1.000 n=5+5)
fs1-zhash.go+prefetch128 3.86µs ± 2% 3.74µs ± 2% -3.11% (p=0.048 n=5+5)
zeo/py/fs1-zhash.py 474µs ± 2% 442µs ± 9% ~ (p=0.095 n=5+5)
zeo/py/fs1-zhash.go 170µs ± 3% 148µs ± 3% -13.05% (p=0.008 n=5+5)
zeo/py/fs1-zhash.go+prefetch128 87.8µs ± 1% 87.9µs ± 2% ~ (p=0.881 n=5+5)
neo/py(!log)/sqlite-zhash.py 665µs ± 2% 382µs ± 3% -42.60% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zhash.go 219µs ± 2% 181µs ± 1% -17.27% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zhash.go+prefetch128 151µs ± 1% 150µs ± 1% ~ (p=0.206 n=5+4)
neo/py(!log)/sql-zhash.py 886µs ±56% 426µs ± 1% -51.90% (p=0.016 n=5+4)
neo/py(!log)/sql-zhash.go 298µs ± 9% 234µs ± 2% -21.22% (p=0.008 n=5+5)
neo/py(!log)/sql-zhash.go+prefetch128 230µs ± 3% 210µs ± 6% -8.71% (p=0.008 n=5+5)
neo/go/fs1-zhash.py 319µs ±11% 260µs ± 2% -18.46% (p=0.008 n=5+5)
neo/go/fs1-zhash.go 61.3µs ± 3% 61.4µs ± 2% ~ (p=0.802 n=5+5)
neo/go/fs1-zhash.go+prefetch128 22.5µs ± 3% 22.2µs ± 5% ~ (p=0.595 n=5+5)
neo/go/fs1(!sha1)-zhash.go(!sha1) 52.0µs ± 3% 51.9µs ± 4% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 18.3µs ± 2% 18.3µs ± 3% ~ (p=0.667 n=5+5)
neo/go/sqlite-zhash.py 382µs ± 6% 310µs ± 2% -19.04% (p=0.008 n=5+5)
neo/go/sqlite-zhash.go 113µs ± 1% 112µs ± 1% ~ (p=0.063 n=5+5)
neo/go/sqlite-zhash.go+prefetch128 40.9µs ± 4% 41.9µs ± 4% ~ (p=0.190 n=5+5)
neo/go/sqlite-zhash.go(!sha1) 108µs ± 1% 107µs ± 1% ~ (p=0.056 n=5+5)
neo/go/sqlite-zhash.go+prefetch128(!sha1) 41.1µs ± 5% 41.1µs ± 2% ~ (p=0.881 n=5+5)

name old req/s new req/s delta
cluster:neo1 dataset:wczblk1-8
fs1-zwrk.go·1 229k ± 0% 229k ± 0% ~ (p=1.000 n=5+5)
fs1-zwrk.go·2 443k ± 1% 439k ± 0% ~ (p=0.111 n=5+4)
fs1-zwrk.go·3 662k ± 1% 660k ± 1% ~ (p=1.000 n=5+5)
fs1-zwrk.go·4 867k ± 1% 865k ± 0% ~ (p=1.000 n=5+5)
fs1-zwrk.go·8 988k ± 0% 959k ±11% ~ (p=0.548 n=5+5)
fs1-zwrk.go·12 1.02M ± 0% 1.02M ± 0% ~ (p=0.841 n=5+5)
fs1-zwrk.go·16 976k ±12% 1015k ± 0% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·1 5.15k ± 1% 5.84k ± 1% +13.54% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·2 7.08k ± 1% 7.05k ± 5% ~ (p=0.841 n=5+5)
zeo/py/fs1-zwrk.go·3 7.73k ± 1% 7.82k ± 1% +1.29% (p=0.032 n=5+5)
zeo/py/fs1-zwrk.go·4 7.97k ± 4% 8.07k ± 1% ~ (p=0.421 n=5+5)
zeo/py/fs1-zwrk.go·8 8.30k ± 2% 8.40k ± 2% ~ (p=0.095 n=5+5)
zeo/py/fs1-zwrk.go·12 8.15k ± 1% 8.40k ± 2% +3.08% (p=0.016 n=5+5)
zeo/py/fs1-zwrk.go·16 8.25k ± 1% 8.48k ± 1% +2.85% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 4.31k ± 4% 5.06k ± 3% +17.59% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 6.28k ± 5% 6.39k ± 0% ~ (p=0.730 n=5+4)
neo/py(!log)/sqlite-zwrk.go·3 6.38k ± 0% 6.28k ± 8% ~ (p=0.730 n=4+5)
neo/py(!log)/sqlite-zwrk.go·4 6.15k ± 5% 6.10k ± 5% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 6.27k ± 4% 6.22k ± 9% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 6.33k ± 2% 6.28k ± 6% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 6.25k ± 4% 6.17k ± 6% ~ (p=0.690 n=5+5)
neo/py(!log)/sql-zwrk.go·1 3.10k ± 6% 4.12k ± 1% +33.05% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·2 3.98k ± 1% 4.76k ± 5% +19.62% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·3 4.04k ± 3% 4.70k ± 4% +16.27% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·4 4.06k ± 4% 4.78k ± 2% +17.62% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·8 3.79k ± 7% 4.67k ± 5% +23.22% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·12 3.98k ± 3% 4.67k ± 3% +17.40% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·16 3.94k ± 1% 4.72k ± 3% +19.55% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·1 12.8k ± 0% 12.8k ± 1% ~ (p=0.421 n=5+5)
neo/go/fs1-zwrk.go·2 24.8k ± 0% 25.0k ± 1% ~ (p=0.063 n=4+5)
neo/go/fs1-zwrk.go·3 32.3k ± 0% 32.2k ± 2% ~ (p=0.222 n=5+5)
neo/go/fs1-zwrk.go·4 40.7k ± 0% 40.9k ± 0% +0.47% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·8 54.5k ± 1% 54.9k ± 0% +0.66% (p=0.016 n=5+5)
neo/go/fs1-zwrk.go·12 56.5k ± 1% 56.7k ± 1% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·16 53.2k ±10% 54.4k ± 2% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 19.0k ± 2% 19.3k ± 2% ~ (p=0.056 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 37.8k ± 0% 37.8k ± 1% ~ (p=0.841 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 48.0k ± 1% 48.2k ± 0% +0.50% (p=0.032 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 59.0k ± 0% 59.2k ± 0% +0.39% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 78.0k ± 1% 78.3k ± 0% ~ (p=0.095 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 82.2k ± 2% 82.5k ± 1% ~ (p=0.690 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 80.4k ± 1% 80.3k ± 2% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go·1 8.06k ± 4% 8.24k ± 1% +2.17% (p=0.016 n=5+5)
neo/go/sqlite-zwrk.go·2 14.9k ± 0% 15.0k ± 0% ~ (p=0.095 n=5+5)
neo/go/sqlite-zwrk.go·3 20.7k ± 0% 20.8k ± 0% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go·4 24.8k ± 0% 24.9k ± 0% +0.39% (p=0.016 n=5+5)
neo/go/sqlite-zwrk.go·8 31.7k ± 1% 31.6k ± 1% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go·12 30.8k ± 5% 31.4k ± 1% ~ (p=0.310 n=5+5)
neo/go/sqlite-zwrk.go·16 30.4k ± 2% 30.6k ± 3% ~ (p=0.548 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 8.95k ± 1% 9.05k ± 1% ~ (p=0.056 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 16.2k ± 1% 16.3k ± 1% +0.88% (p=0.016 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 22.6k ± 0% 22.6k ± 0% ~ (p=0.905 n=4+5)
neo/go/sqlite-zwrk.go(!sha1)·4 27.9k ± 0% 27.7k ± 0% -0.83% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 35.0k ± 1% 34.4k ± 1% -1.78% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 34.7k ± 1% 33.4k ± 2% -3.68% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 33.0k ±11% 32.9k ± 2% ~ (p=0.151 n=5+5)
cluster:neo1 dataset:prod1-1024
fs1-zwrk.go·1 451k ± 0% 451k ± 1% ~ (p=1.000 n=5+5)
fs1-zwrk.go·2 893k ± 0% 871k ± 9% ~ (p=0.690 n=5+5)
fs1-zwrk.go·3 1.34M ± 1% 1.33M ± 0% ~ (p=0.690 n=5+5)
fs1-zwrk.go·4 1.77M ± 0% 1.76M ± 0% ~ (p=0.310 n=5+5)
fs1-zwrk.go·8 1.99M ± 1% 2.00M ± 2% ~ (p=0.421 n=5+5)
fs1-zwrk.go·12 2.03M ± 1% 2.03M ± 0% ~ (p=0.556 n=4+5)
fs1-zwrk.go·16 2.03M ± 0% 2.03M ± 0% ~ (p=0.111 n=5+4)
zeo/py/fs1-zwrk.go·1 5.79k ± 3% 6.83k ± 2% +18.03% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·2 8.55k ± 1% 8.70k ± 1% +1.74% (p=0.016 n=5+5)
zeo/py/fs1-zwrk.go·3 9.28k ± 7% 9.54k ± 2% ~ (p=0.151 n=5+5)
zeo/py/fs1-zwrk.go·4 9.72k ± 1% 9.77k ± 1% ~ (p=0.151 n=5+5)
zeo/py/fs1-zwrk.go·8 10.4k ± 1% 10.5k ± 1% ~ (p=0.421 n=5+5)
zeo/py/fs1-zwrk.go·12 10.5k ± 1% 10.6k ± 1% ~ (p=0.310 n=5+5)
zeo/py/fs1-zwrk.go·16 10.4k ± 4% 10.7k ± 1% +2.75% (p=0.016 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 4.90k ± 7% 5.51k ± 3% +12.34% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 6.28k ± 4% 6.38k ± 3% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 6.32k ± 5% 6.27k ± 5% ~ (p=0.841 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 6.45k ± 2% 6.54k ± 0% +1.35% (p=0.032 n=5+4)
neo/py(!log)/sqlite-zwrk.go·8 6.45k ± 2% 6.48k ± 2% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 6.31k ± 3% 6.43k ± 2% ~ (p=0.151 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 6.36k ± 5% 6.41k ± 3% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·1 3.50k ± 9% 4.25k ± 7% +21.25% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·2 4.05k ± 6% 4.92k ± 1% +21.64% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·3 4.06k ± 7% 4.85k ± 3% +19.49% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·4 3.98k ± 4% 4.90k ± 2% +22.98% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·8 4.15k ± 3% 4.89k ± 1% +17.81% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·12 4.00k ± 5% 4.90k ± 3% +22.72% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·16 3.96k ±11% 4.81k ± 7% +21.32% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·1 17.1k ± 1% 17.4k ± 2% +2.02% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·2 32.6k ± 0% 32.8k ± 1% ~ (p=0.310 n=5+5)
neo/go/fs1-zwrk.go·3 43.3k ± 0% 43.2k ± 0% ~ (p=1.000 n=5+5)
neo/go/fs1-zwrk.go·4 52.9k ± 0% 52.9k ± 0% ~ (p=0.905 n=5+4)
neo/go/fs1-zwrk.go·8 66.3k ± 1% 65.4k ± 1% ~ (p=0.063 n=4+5)
neo/go/fs1-zwrk.go·12 61.6k ± 1% 59.6k ± 4% -3.20% (p=0.016 n=5+5)
neo/go/fs1-zwrk.go·16 55.6k ± 4% 53.9k ± 2% ~ (p=0.056 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 19.6k ± 5% 20.1k ± 2% ~ (p=0.310 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 40.3k ± 0% 39.9k ± 5% ~ (p=0.690 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 51.6k ± 0% 51.7k ± 0% ~ (p=0.421 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 62.0k ± 0% 62.5k ± 0% +0.78% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 74.2k ± 4% 74.0k ± 3% ~ (p=0.841 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 64.8k ± 7% 66.8k ± 3% ~ (p=0.222 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 59.5k ± 4% 58.6k ± 2% ~ (p=0.222 n=5+5)
neo/go/sqlite-zwrk.go·1 9.02k ± 1% 9.16k ± 1% +1.58% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·2 16.0k ± 0% 16.0k ± 1% ~ (p=0.548 n=5+5)
neo/go/sqlite-zwrk.go·3 21.8k ± 1% 21.8k ± 0% ~ (p=0.730 n=4+5)
neo/go/sqlite-zwrk.go·4 26.2k ± 0% 26.2k ± 1% ~ (p=0.905 n=5+4)
neo/go/sqlite-zwrk.go·8 30.0k ± 2% 29.9k ± 1% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go·12 28.6k ± 2% 28.5k ± 2% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go·16 28.7k ± 1% 28.9k ± 2% ~ (p=0.730 n=4+5)
neo/go/sqlite-zwrk.go(!sha1)·1 9.45k ± 1% 9.51k ± 1% ~ (p=0.222 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 16.6k ± 1% 16.5k ± 1% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 23.0k ± 0% 22.7k ± 0% -1.37% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 28.0k ± 1% 27.4k ± 0% -2.02% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 32.3k ± 0% 30.4k ±12% -5.86% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 30.6k ± 2% 29.6k ± 2% -3.24% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 30.3k ± 2% 29.5k ± 2% -2.73% (p=0.008 n=5+5)

name old latency-time/object new latency-time/object delta
cluster:neo1 dataset:wczblk1-8
fs1-zwrk.go·1 4.36µs ± 0% 4.37µs ± 0% ~ (p=1.000 n=5+5)
fs1-zwrk.go·2 4.52µs ± 1% 4.56µs ± 0% ~ (p=0.111 n=5+4)
fs1-zwrk.go·3 4.53µs ± 1% 4.54µs ± 1% ~ (p=0.881 n=5+5)
fs1-zwrk.go·4 4.61µs ± 1% 4.62µs ± 0% ~ (p=0.889 n=5+5)
fs1-zwrk.go·8 8.10µs ± 0% 8.37µs ±12% ~ (p=0.548 n=5+5)
fs1-zwrk.go·12 11.8µs ± 0% 11.8µs ± 0% ~ (p=0.841 n=5+5)
fs1-zwrk.go·16 16.5µs ±13% 15.8µs ± 0% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·1 194µs ± 1% 171µs ± 1% -11.93% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·2 282µs ± 1% 284µs ± 5% ~ (p=0.841 n=5+5)
zeo/py/fs1-zwrk.go·3 388µs ± 1% 383µs ± 1% -1.27% (p=0.032 n=5+5)
zeo/py/fs1-zwrk.go·4 502µs ± 5% 496µs ± 1% ~ (p=0.421 n=5+5)
zeo/py/fs1-zwrk.go·8 964µs ± 2% 952µs ± 2% ~ (p=0.095 n=5+5)
zeo/py/fs1-zwrk.go·12 1.47ms ± 1% 1.43ms ± 2% -2.98% (p=0.016 n=5+5)
zeo/py/fs1-zwrk.go·16 1.94ms ± 1% 1.89ms ± 1% -2.77% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 232µs ± 4% 198µs ± 3% -14.97% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 319µs ± 5% 313µs ± 0% ~ (p=0.730 n=5+4)
neo/py(!log)/sqlite-zwrk.go·3 470µs ± 0% 469µs ± 1% ~ (p=0.343 n=4+4)
neo/py(!log)/sqlite-zwrk.go·4 651µs ± 5% 656µs ± 5% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 1.28ms ± 4% 1.29ms ±10% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 1.90ms ± 2% 1.91ms ± 6% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 2.56ms ± 4% 2.60ms ± 6% ~ (p=0.690 n=5+5)
neo/py(!log)/sql-zwrk.go·1 323µs ± 6% 242µs ± 1% -24.90% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·2 503µs ± 2% 421µs ± 5% -16.28% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·3 742µs ± 3% 639µs ± 4% -13.97% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·4 986µs ± 4% 838µs ± 2% -15.02% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·8 2.11ms ± 8% 1.71ms ± 4% -18.91% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·12 3.02ms ± 3% 2.57ms ± 3% -14.83% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·16 4.06ms ± 1% 3.39ms ± 3% -16.33% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·1 77.8µs ± 0% 78.2µs ± 1% ~ (p=0.421 n=5+5)
neo/go/fs1-zwrk.go·2 80.6µs ± 0% 80.0µs ± 1% ~ (p=0.063 n=4+5)
neo/go/fs1-zwrk.go·3 92.8µs ± 0% 93.1µs ± 2% ~ (p=0.222 n=5+5)
neo/go/fs1-zwrk.go·4 98.2µs ± 0% 97.7µs ± 0% -0.47% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·8 147µs ± 1% 146µs ± 0% -0.66% (p=0.016 n=5+5)
neo/go/fs1-zwrk.go·12 212µs ± 1% 212µs ± 1% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·16 293µs ± 1% 294µs ± 2% ~ (p=0.556 n=4+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 52.7µs ± 2% 51.8µs ± 2% ~ (p=0.056 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 53.0µs ± 0% 52.9µs ± 1% ~ (p=0.841 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 62.5µs ± 1% 62.2µs ± 0% -0.50% (p=0.032 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 67.8µs ± 0% 67.6µs ± 0% -0.39% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 103µs ± 1% 102µs ± 0% ~ (p=0.095 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 146µs ± 2% 145µs ± 1% ~ (p=0.690 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 199µs ± 1% 199µs ± 2% ~ (p=0.794 n=5+5)
neo/go/sqlite-zwrk.go·1 124µs ± 4% 121µs ± 1% -2.17% (p=0.016 n=5+5)
neo/go/sqlite-zwrk.go·2 134µs ± 0% 134µs ± 0% ~ (p=0.095 n=5+5)
neo/go/sqlite-zwrk.go·3 145µs ± 0% 144µs ± 0% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go·4 161µs ± 0% 161µs ± 0% -0.38% (p=0.016 n=5+5)
neo/go/sqlite-zwrk.go·8 252µs ± 1% 253µs ± 1% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go·12 390µs ± 5% 382µs ± 1% ~ (p=0.310 n=5+5)
neo/go/sqlite-zwrk.go·16 526µs ± 2% 524µs ± 3% ~ (p=0.548 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 112µs ± 1% 110µs ± 1% ~ (p=0.056 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 124µs ± 1% 123µs ± 1% -0.87% (p=0.016 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 133µs ± 0% 133µs ± 0% ~ (p=0.905 n=4+5)
neo/go/sqlite-zwrk.go(!sha1)·4 143µs ± 0% 145µs ± 0% +0.83% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 228µs ± 1% 232µs ± 1% +1.81% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 346µs ± 1% 359µs ± 2% +3.82% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 486µs ±11% 486µs ± 2% ~ (p=0.151 n=5+5)
cluster:neo1 dataset:prod1-1024
fs1-zwrk.go·1 2.22µs ± 1% 2.22µs ± 1% ~ (p=0.889 n=5+5)
fs1-zwrk.go·2 2.24µs ± 0% 2.30µs ± 9% ~ (p=0.690 n=5+5)
fs1-zwrk.go·3 2.25µs ± 1% 2.25µs ± 0% ~ (p=0.738 n=5+5)
fs1-zwrk.go·4 2.26µs ± 0% 2.27µs ± 0% ~ (p=0.286 n=5+5)
fs1-zwrk.go·8 4.02µs ± 1% 4.00µs ± 2% ~ (p=0.460 n=5+5)
fs1-zwrk.go·12 5.92µs ± 1% 5.91µs ± 0% ~ (p=0.619 n=4+5)
fs1-zwrk.go·16 7.87µs ± 0% 7.88µs ± 0% ~ (p=0.127 n=5+4)
zeo/py/fs1-zwrk.go·1 173µs ± 3% 146µs ± 2% -15.31% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·2 234µs ± 1% 230µs ± 1% -1.71% (p=0.016 n=5+5)
zeo/py/fs1-zwrk.go·3 324µs ± 7% 315µs ± 2% ~ (p=0.151 n=5+5)
zeo/py/fs1-zwrk.go·4 412µs ± 1% 409µs ± 1% ~ (p=0.151 n=5+5)
zeo/py/fs1-zwrk.go·8 768µs ± 1% 765µs ± 1% ~ (p=0.421 n=5+5)
zeo/py/fs1-zwrk.go·12 1.14ms ± 1% 1.13ms ± 1% ~ (p=0.310 n=5+5)
zeo/py/fs1-zwrk.go·16 1.54ms ± 4% 1.49ms ± 1% -2.71% (p=0.016 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 204µs ± 8% 182µs ± 3% -11.14% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 319µs ± 4% 314µs ± 3% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 475µs ± 5% 479µs ± 5% ~ (p=0.841 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 620µs ± 2% 612µs ± 0% -1.34% (p=0.032 n=5+4)
neo/py(!log)/sqlite-zwrk.go·8 1.24ms ± 2% 1.23ms ± 2% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 1.90ms ± 3% 1.87ms ± 2% ~ (p=0.151 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 2.52ms ± 5% 2.49ms ± 3% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·1 287µs ± 8% 236µs ± 8% -17.73% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·2 495µs ± 6% 406µs ± 1% -17.95% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·3 740µs ± 8% 618µs ± 3% -16.50% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·4 1.01ms ± 4% 0.82ms ± 2% -18.75% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·8 1.93ms ± 3% 1.64ms ± 1% -15.14% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·12 3.01ms ± 4% 2.45ms ± 3% -18.53% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·16 4.05ms ±10% 3.33ms ± 8% -17.74% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·1 58.5µs ± 1% 57.4µs ± 2% -1.98% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·2 61.4µs ± 0% 61.1µs ± 1% ~ (p=0.238 n=5+5)
neo/go/fs1-zwrk.go·3 69.3µs ± 0% 69.4µs ± 0% ~ (p=0.881 n=5+5)
neo/go/fs1-zwrk.go·4 75.6µs ± 0% 75.6µs ± 0% ~ (p=0.952 n=5+4)
neo/go/fs1-zwrk.go·8 121µs ± 1% 122µs ± 1% ~ (p=0.063 n=4+5)
neo/go/fs1-zwrk.go·12 195µs ± 1% 201µs ± 4% +3.35% (p=0.016 n=5+5)
neo/go/fs1-zwrk.go·16 288µs ± 4% 297µs ± 2% ~ (p=0.056 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 50.9µs ± 5% 49.8µs ± 2% ~ (p=0.310 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 49.7µs ± 0% 50.1µs ± 5% ~ (p=0.690 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 58.2µs ± 0% 58.0µs ± 0% ~ (p=0.421 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 64.5µs ± 0% 64.0µs ± 0% -0.77% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 108µs ± 4% 108µs ± 3% ~ (p=0.841 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 185µs ± 8% 180µs ± 3% ~ (p=0.222 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 269µs ± 4% 273µs ± 2% ~ (p=0.222 n=5+5)
neo/go/sqlite-zwrk.go·1 111µs ± 1% 109µs ± 1% -1.55% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·2 125µs ± 0% 125µs ± 1% ~ (p=0.548 n=5+5)
neo/go/sqlite-zwrk.go·3 137µs ± 1% 137µs ± 0% ~ (p=0.730 n=4+5)
neo/go/sqlite-zwrk.go·4 153µs ± 0% 153µs ± 1% ~ (p=0.905 n=5+4)
neo/go/sqlite-zwrk.go·8 267µs ± 1% 267µs ± 1% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go·12 420µs ± 2% 421µs ± 2% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go·16 558µs ± 1% 554µs ± 2% ~ (p=0.730 n=4+5)
neo/go/sqlite-zwrk.go(!sha1)·1 106µs ± 1% 105µs ± 1% ~ (p=0.222 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 121µs ± 1% 121µs ± 1% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 130µs ± 0% 132µs ± 0% +1.39% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 143µs ± 1% 146µs ± 0% +2.06% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 248µs ± 0% 264µs ±13% +6.65% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 393µs ± 2% 406µs ± 2% +3.34% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 528µs ± 2% 543µs ± 2% +2.81% (p=0.008 n=5+5)

f40c8b4b

X deco: localhost timings, C > C1 disabled · 0867c981

Kirill Smelkov authored Mar 06, 2018

Probably what is above noise is:

---- 8< ----
cluster:deco dataset:wczblk1-8
zeo/py/fs1-zhash.go 126µs ± 1% 112µs ± 1% -10.86% (p=0.008 n=5+5)

zeo/py/fs1-zwrk.go·1 9.12k ± 0% 8.04k ± 4% -11.87% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·2 11.6k ± 1% 9.5k ± 1% -17.54% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·3 13.4k ± 1% 10.5k ± 0% -21.56% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·4 14.0k ± 1% 11.0k ± 1% -21.81% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·8 14.7k ± 1% 11.4k ± 1% -22.03% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·12 15.0k ± 1% 11.7k ± 0% -22.09% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·16 15.1k ± 0% 11.8k ± 2% -22.32% (p=0.008 n=5+5)

zeo/py/fs1-zwrk.go·1 110µs ± 0% 125µs ± 4% +13.55% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·2 173µs ± 1% 210µs ± 1% +21.27% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·3 224µs ± 1% 286µs ± 0% +27.49% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·4 286µs ± 1% 365µs ± 1% +27.90% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·8 545µs ± 1% 699µs ± 1% +28.25% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·12 802µs ± 1% 1029µs ± 0% +28.35% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·16 1.06ms ± 0% 1.36ms ± 2% +28.74% (p=0.008 n=5+5)
---- 8< ----

however it strangely shows that serial zeo-zhash.go latency improved
126µs -> 112µs and serial zeo-zwrk.go latency got worse 110µs -> 125µs,
so probably it is all noise and I will remeasure.

Otherwise no significant change.

$ benchstat -split node,cluster,dataset 20180306-deco-ffixed-c.txt 20180306-deco-ffixed-noc_C1$2µs$.txt

name old pystone/s new pystone/s delta
node:deco
pystone 217k ± 4% 218k ± 2% ~ (p=0.841 n=5+5)

name old time/op new time/op delta
node:deco
crc32/py/4K 5.73µs ± 0% 5.72µs ± 0% ~ (p=0.151 n=5+5)
crc32/go/4K 279ns ± 0% 280ns ± 1% ~ (p=0.444 n=5+5)
sha1/py/4K 6.74µs ± 1% 6.72µs ± 1% ~ (p=0.310 n=5+5)
sha1/go/4K 5.60µs ± 0% 5.59µs ± 0% -0.16% (p=0.016 n=5+4)
unzlib/py/wczdata 27.2µs ± 1% 27.2µs ± 1% ~ (p=0.690 n=5+5)
unzlib/go/wczdata 27.0µs ± 0% 26.8µs ± 0% -0.49% (p=0.032 n=5+5)
unzlib/py/prod1-avg 5.14µs ± 3% 5.08µs ± 1% ~ (p=0.690 n=5+5)
unzlib/go/prod1-avg 5.30µs ± 1% 5.29µs ± 1% ~ (p=0.151 n=5+5)
disk/randread/direct/4K-min 104µs ± 2% 105µs ± 0% +1.23% (p=0.016 n=5+5)
disk/randread/direct/4K-avg 141µs ± 0% 142µs ± 0% +0.60% (p=0.008 n=5+5)
disk/randread/pagecache/4K-min 579ns ± 2% 582ns ± 0% ~ (p=0.548 n=5+5)
disk/randread/pagecache/4K-avg 993ns ± 0% 987ns ± 0% -0.60% (p=0.008 n=5+5)

name old time/object new time/object delta
cluster:deco dataset:wczblk1-8
fs1-zhash.py 20.3µs ± 1% 20.2µs ± 1% ~ (p=0.444 n=4+5)
fs1-zhash.go 3.26µs ± 4% 3.20µs ± 0% ~ (p=0.444 n=5+5)
fs1-zhash.go+prefetch128 4.04µs ± 1% 4.14µs ± 1% ~ (p=0.079 n=5+5)
zeo/py/fs1-zhash.py 383µs ± 5% 361µs ± 3% ~ (p=0.056 n=5+5)
zeo/py/fs1-zhash.go 126µs ± 1% 112µs ± 1% -10.86% (p=0.008 n=5+5)
zeo/py/fs1-zhash.go+prefetch128 63.1µs ± 1% 63.9µs ± 1% +1.14% (p=0.040 n=5+5)
neo/py(!log)/sqlite-zhash.py 344µs ± 6% 321µs ± 8% ~ (p=0.151 n=5+5)
neo/py(!log)/sqlite-zhash.go 140µs ± 1% 141µs ± 3% ~ (p=0.286 n=5+5)
neo/py(!log)/sqlite-zhash.go+prefetch128 119µs ± 2% 119µs ± 1% ~ (p=0.897 n=5+5)
neo/py(!log)/sql-zhash.py 386µs ± 1% 376µs ± 2% ~ (p=0.114 n=4+4)
neo/py(!log)/sql-zhash.go 183µs ± 3% 187µs ± 5% ~ (p=0.341 n=5+5)
neo/py(!log)/sql-zhash.go+prefetch128 164µs ± 3% 164µs ± 2% ~ (p=1.000 n=5+5)
neo/go/fs1-zhash.py 226µs ± 3% 226µs ± 2% ~ (p=0.841 n=5+5)
neo/go/fs1-zhash.go 57.1µs ± 0% 57.1µs ± 1% ~ (p=1.000 n=5+5)
neo/go/fs1-zhash.go+prefetch128 24.7µs ± 5% 24.0µs ± 4% -2.91% (p=0.048 n=5+5)
neo/go/fs1(!sha1)-zhash.go(!sha1) 40.2µs ± 1% 40.3µs ± 1% ~ (p=0.952 n=5+5)
neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 17.1µs ± 6% 17.2µs ± 4% ~ (p=0.786 n=5+5)
neo/go/sqlite-zhash.py 272µs ± 3% 253µs ± 1% -6.99% (p=0.008 n=5+5)
neo/go/sqlite-zhash.go 92.8µs ± 0% 93.7µs ± 1% +0.99% (p=0.016 n=4+5)
neo/go/sqlite-zhash.go+prefetch128 40.5µs ± 5% 39.5µs ± 6% ~ (p=0.222 n=5+5)
neo/go/sqlite-zhash.go(!sha1) 86.5µs ± 2% 86.4µs ± 3% ~ (p=0.571 n=5+5)
neo/go/sqlite-zhash.go+prefetch128(!sha1) 38.8µs ± 9% 39.4µs ± 7% ~ (p=0.730 n=5+5)
cluster:deco dataset:prod1-1024
fs1-zhash.py 15.8µs ± 3% 15.9µs ± 2% ~ (p=0.413 n=4+5)
fs1-zhash.go 2.80µs ± 0% 2.80µs ± 0% ~ (all equal)
fs1-zhash.go+prefetch128 3.42µs ± 8% 3.34µs ± 2% ~ (p=0.683 n=5+5)
zeo/py/fs1-zhash.py 361µs ± 5% 347µs ± 3% ~ (p=0.095 n=5+5)
zeo/py/fs1-zhash.go 105µs ± 0% 105µs ± 0% -0.42% (p=0.016 n=5+5)
zeo/py/fs1-zhash.go+prefetch128 58.9µs ± 1% 58.9µs ± 1% ~ (p=0.508 n=5+5)
neo/py(!log)/sqlite-zhash.py 344µs ± 7% 317µs ± 5% -7.93% (p=0.016 n=5+5)
neo/py(!log)/sqlite-zhash.go 137µs ± 2% 138µs ± 1% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zhash.go+prefetch128 114µs ± 1% 112µs ± 1% -1.48% (p=0.024 n=5+5)
neo/py(!log)/sql-zhash.py 380µs ± 4% 377µs ± 2% ~ (p=1.000 n=4+4)
neo/py(!log)/sql-zhash.go 180µs ± 1% 184µs ± 2% +2.44% (p=0.032 n=5+5)
neo/py(!log)/sql-zhash.go+prefetch128 159µs ± 1% 160µs ± 2% ~ (p=0.889 n=5+5)
neo/go/fs1-zhash.py 221µs ± 1% 225µs ± 1% +1.59% (p=0.016 n=5+5)
neo/go/fs1-zhash.go 45.2µs ± 2% 44.6µs ± 0% -1.37% (p=0.016 n=5+5)
neo/go/fs1-zhash.go+prefetch128 17.6µs ± 2% 17.2µs ± 3% ~ (p=0.087 n=5+5)
neo/go/fs1(!sha1)-zhash.go(!sha1) 39.1µs ± 2% 39.1µs ± 3% ~ (p=0.659 n=5+5)
neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 14.6µs ± 4% 15.2µs ± 3% +4.25% (p=0.024 n=5+5)
neo/go/sqlite-zhash.py 271µs ± 2% 254µs ± 1% -6.14% (p=0.008 n=5+5)
neo/go/sqlite-zhash.go 86.4µs ± 0% 86.3µs ± 0% ~ (p=0.325 n=5+5)
neo/go/sqlite-zhash.go+prefetch128 35.8µs ± 2% 36.6µs ± 5% ~ (p=0.690 n=5+5)
neo/go/sqlite-zhash.go(!sha1) 84.0µs ± 1% 83.8µs ± 2% ~ (p=0.952 n=5+5)
neo/go/sqlite-zhash.go+prefetch128(!sha1) 36.5µs ± 5% 36.9µs ± 8% ~ (p=1.000 n=5+5)

name old req/s new req/s delta
cluster:deco dataset:wczblk1-8
fs1-zwrk.go·1 436k ± 0% 431k ± 1% -1.23% (p=0.008 n=5+5)
fs1-zwrk.go·2 744k ± 1% 760k ± 3% ~ (p=0.056 n=5+5)
fs1-zwrk.go·3 1.09M ± 0% 1.08M ± 2% ~ (p=0.095 n=5+5)
fs1-zwrk.go·4 1.16M ± 1% 1.16M ± 1% ~ (p=1.000 n=5+5)
fs1-zwrk.go·8 1.27M ± 1% 1.27M ± 1% ~ (p=1.000 n=5+5)
fs1-zwrk.go·12 1.27M ± 1% 1.28M ± 1% ~ (p=0.310 n=5+5)
fs1-zwrk.go·16 1.27M ± 1% 1.28M ± 1% ~ (p=0.222 n=5+5)
zeo/py/fs1-zwrk.go·1 9.12k ± 0% 8.04k ± 4% -11.87% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·2 11.6k ± 1% 9.5k ± 1% -17.54% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·3 13.4k ± 1% 10.5k ± 0% -21.56% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·4 14.0k ± 1% 11.0k ± 1% -21.81% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·8 14.7k ± 1% 11.4k ± 1% -22.03% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·12 15.0k ± 1% 11.7k ± 0% -22.09% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·16 15.1k ± 0% 11.8k ± 2% -22.32% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 7.09k ± 1% 7.04k ± 1% ~ (p=0.151 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 8.48k ± 1% 8.52k ± 1% ~ (p=0.548 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 8.48k ± 1% 8.51k ± 1% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 8.47k ± 1% 8.50k ± 1% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 8.43k ± 1% 8.53k ± 1% +1.16% (p=0.032 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 8.46k ± 1% 8.48k ± 2% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 8.46k ± 1% 8.48k ± 1% ~ (p=0.690 n=5+5)
neo/py(!log)/sql-zwrk.go·1 5.51k ± 1% 5.37k ± 3% ~ (p=0.151 n=5+5)
neo/py(!log)/sql-zwrk.go·2 6.32k ± 1% 6.34k ± 0% ~ (p=0.690 n=5+5)
neo/py(!log)/sql-zwrk.go·3 6.29k ± 1% 6.28k ± 1% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·4 6.27k ± 1% 6.29k ± 1% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·8 6.27k ± 1% 6.29k ± 1% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·12 6.29k ± 0% 6.25k ± 1% ~ (p=0.056 n=5+5)
neo/py(!log)/sql-zwrk.go·16 6.22k ± 1% 6.23k ± 2% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·1 18.4k ± 1% 18.4k ± 0% ~ (p=0.151 n=5+5)
neo/go/fs1-zwrk.go·2 38.1k ± 1% 38.3k ± 1% ~ (p=0.310 n=5+5)
neo/go/fs1-zwrk.go·3 46.0k ± 1% 45.9k ± 0% ~ (p=1.000 n=5+5)
neo/go/fs1-zwrk.go·4 50.2k ± 1% 50.0k ± 0% ~ (p=0.056 n=5+5)
neo/go/fs1-zwrk.go·8 61.0k ± 0% 60.3k ± 1% -1.09% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·12 62.1k ± 1% 62.1k ± 1% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·16 62.5k ± 1% 61.6k ± 1% -1.37% (p=0.032 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 26.3k ± 1% 26.3k ± 0% ~ (p=0.841 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 55.3k ± 1% 55.7k ± 1% ~ (p=0.056 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 62.7k ± 1% 62.8k ± 1% ~ (p=0.690 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 69.3k ± 1% 69.4k ± 1% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 88.2k ± 0% 88.3k ± 1% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 93.4k ± 0% 93.5k ± 1% ~ (p=0.421 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 93.5k ± 2% 93.8k ± 0% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go·1 11.0k ± 1% 11.0k ± 0% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go·2 18.4k ± 1% 18.3k ± 1% ~ (p=0.556 n=5+4)
neo/go/sqlite-zwrk.go·3 24.4k ± 1% 24.2k ± 0% -0.73% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·4 26.8k ± 0% 26.8k ± 1% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go·8 30.4k ± 2% 29.6k ± 2% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go·12 30.5k ± 1% 29.3k ± 2% -4.15% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·16 29.9k ± 2% 28.6k ± 1% -4.50% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 11.9k ± 1% 11.9k ± 1% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 19.7k ± 0% 19.6k ± 1% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 26.5k ± 1% 26.4k ± 0% ~ (p=0.310 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 30.0k ± 0% 30.0k ± 0% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 31.2k ± 2% 31.2k ± 2% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 28.9k ± 1% 28.8k ± 3% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 28.4k ± 2% 28.4k ± 1% ~ (p=0.841 n=5+5)
cluster:deco dataset:prod1-1024
fs1-zwrk.go·1 555k ± 0% 556k ± 0% ~ (p=0.421 n=5+5)
fs1-zwrk.go·2 1.01M ± 3% 0.99M ± 6% ~ (p=0.310 n=5+5)
fs1-zwrk.go·3 1.32M ± 1% 1.33M ± 2% ~ (p=1.000 n=5+5)
fs1-zwrk.go·4 1.55M ± 2% 1.53M ± 0% ~ (p=0.421 n=5+5)
fs1-zwrk.go·8 1.59M ± 0% 1.59M ± 1% ~ (p=0.690 n=5+5)
fs1-zwrk.go·12 1.59M ± 0% 1.60M ± 1% ~ (p=0.095 n=5+5)
fs1-zwrk.go·16 1.59M ± 0% 1.59M ± 0% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·1 9.70k ± 0% 9.75k ± 1% ~ (p=0.095 n=5+5)
zeo/py/fs1-zwrk.go·2 12.4k ± 1% 12.4k ± 1% ~ (p=0.421 n=5+5)
zeo/py/fs1-zwrk.go·3 14.2k ± 1% 14.2k ± 1% ~ (p=0.841 n=5+5)
zeo/py/fs1-zwrk.go·4 14.9k ± 0% 14.9k ± 1% ~ (p=0.421 n=5+5)
zeo/py/fs1-zwrk.go·8 15.6k ± 0% 15.6k ± 1% ~ (p=0.548 n=5+5)
zeo/py/fs1-zwrk.go·12 15.2k ±11% 16.0k ± 1% ~ (p=0.056 n=5+5)
zeo/py/fs1-zwrk.go·16 16.1k ± 1% 16.0k ± 6% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 7.44k ± 1% 7.45k ± 2% ~ (p=0.841 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 8.59k ± 1% 8.71k ± 1% +1.33% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 8.61k ± 1% 8.69k ± 1% ~ (p=0.095 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 8.57k ± 1% 8.61k ± 1% ~ (p=0.310 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 8.56k ± 1% 8.61k ± 1% ~ (p=0.222 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 8.51k ± 1% 8.59k ± 1% ~ (p=0.222 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 8.54k ± 1% 8.60k ± 1% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·1 5.55k ± 2% 5.45k ± 2% ~ (p=0.056 n=5+5)
neo/py(!log)/sql-zwrk.go·2 6.36k ± 1% 6.25k ± 1% -1.67% (p=0.016 n=5+5)
neo/py(!log)/sql-zwrk.go·3 6.31k ± 0% 6.24k ± 1% -1.09% (p=0.016 n=5+5)
neo/py(!log)/sql-zwrk.go·4 6.28k ± 0% 6.27k ± 1% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·8 6.34k ± 1% 6.28k ± 1% ~ (p=0.095 n=5+5)
neo/py(!log)/sql-zwrk.go·12 6.35k ± 1% 6.33k ± 0% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zwrk.go·16 6.36k ± 0% 6.30k ± 1% -0.95% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·1 23.7k ± 0% 23.9k ± 0% +0.71% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·2 45.4k ± 0% 45.5k ± 1% ~ (p=0.421 n=5+5)
neo/go/fs1-zwrk.go·3 55.2k ± 1% 55.1k ± 0% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·4 60.7k ± 2% 60.4k ± 0% ~ (p=0.548 n=5+5)
neo/go/fs1-zwrk.go·8 70.9k ± 2% 69.2k ± 2% -2.41% (p=0.032 n=5+5)
neo/go/fs1-zwrk.go·12 71.1k ± 3% 68.0k ± 5% ~ (p=0.056 n=5+5)
neo/go/fs1-zwrk.go·16 71.0k ± 3% 68.1k ± 3% -4.07% (p=0.016 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 27.3k ± 0% 27.2k ± 1% ~ (p=0.548 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 55.4k ± 1% 55.5k ± 1% ~ (p=0.548 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 64.0k ± 1% 64.0k ± 1% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 69.0k ± 1% 69.1k ± 1% ~ (p=0.421 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 80.9k ± 2% 81.1k ± 4% ~ (p=0.690 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 78.3k ± 5% 77.8k ± 8% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 75.4k ± 3% 76.8k ± 5% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go·1 11.7k ± 1% 11.7k ± 1% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go·2 19.0k ± 0% 18.9k ± 1% ~ (p=0.548 n=5+5)
neo/go/sqlite-zwrk.go·3 24.5k ± 1% 24.4k ± 2% ~ (p=0.222 n=5+5)
neo/go/sqlite-zwrk.go·4 26.3k ± 1% 26.0k ± 3% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go·8 24.9k ± 3% 24.6k ± 5% ~ (p=0.548 n=5+5)
neo/go/sqlite-zwrk.go·12 24.0k ± 5% 23.7k ± 3% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go·16 25.4k ± 1% 24.1k ± 3% -5.14% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 12.2k ± 0% 12.2k ± 1% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 19.8k ± 0% 19.6k ± 1% -0.81% (p=0.032 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 26.2k ± 1% 25.5k ± 1% -2.65% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 28.7k ± 1% 27.5k ± 2% -4.20% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 27.2k ± 3% 25.6k ± 2% -5.54% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 25.3k ± 2% 24.0k ± 2% -5.13% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 25.3k ± 1% 24.2k ± 1% -4.63% (p=0.008 n=5+5)

name old latency-time/object new latency-time/object delta
cluster:deco dataset:wczblk1-8
fs1-zwrk.go·1 2.29µs ± 0% 2.32µs ± 1% +1.24% (p=0.008 n=5+5)
fs1-zwrk.go·2 2.69µs ± 1% 2.63µs ± 3% ~ (p=0.056 n=5+5)
fs1-zwrk.go·3 2.76µs ± 0% 2.78µs ± 2% ~ (p=0.079 n=5+5)
fs1-zwrk.go·4 3.44µs ± 1% 3.44µs ± 1% ~ (p=1.000 n=5+5)
fs1-zwrk.go·8 6.28µs ± 1% 6.28µs ± 1% ~ (p=0.984 n=5+5)
fs1-zwrk.go·12 9.46µs ± 1% 9.40µs ± 1% ~ (p=0.310 n=5+5)
fs1-zwrk.go·16 12.6µs ± 1% 12.5µs ± 1% ~ (p=0.222 n=5+5)
zeo/py/fs1-zwrk.go·1 110µs ± 0% 125µs ± 4% +13.55% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·2 173µs ± 1% 210µs ± 1% +21.27% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·3 224µs ± 1% 286µs ± 0% +27.49% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·4 286µs ± 1% 365µs ± 1% +27.90% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·8 545µs ± 1% 699µs ± 1% +28.25% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·12 802µs ± 1% 1029µs ± 0% +28.35% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·16 1.06ms ± 0% 1.36ms ± 2% +28.74% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 141µs ± 1% 142µs ± 1% ~ (p=0.151 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 236µs ± 1% 235µs ± 1% ~ (p=0.548 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 354µs ± 1% 353µs ± 1% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 472µs ± 1% 470µs ± 1% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 949µs ± 1% 938µs ± 1% -1.15% (p=0.032 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 1.42ms ± 1% 1.41ms ± 2% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 1.89ms ± 1% 1.89ms ± 1% ~ (p=0.690 n=5+5)
neo/py(!log)/sql-zwrk.go·1 181µs ± 1% 186µs ± 3% ~ (p=0.151 n=5+5)
neo/py(!log)/sql-zwrk.go·2 317µs ± 1% 315µs ± 0% ~ (p=0.690 n=5+5)
neo/py(!log)/sql-zwrk.go·3 477µs ± 1% 478µs ± 1% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·4 638µs ± 1% 636µs ± 1% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·8 1.28ms ± 1% 1.27ms ± 1% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·12 1.91ms ± 0% 1.92ms ± 1% ~ (p=0.056 n=5+5)
neo/py(!log)/sql-zwrk.go·16 2.57ms ± 1% 2.57ms ± 2% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·1 54.2µs ± 1% 54.4µs ± 0% ~ (p=0.151 n=5+5)
neo/go/fs1-zwrk.go·2 52.5µs ± 1% 52.2µs ± 1% ~ (p=0.333 n=5+5)
neo/go/fs1-zwrk.go·3 65.3µs ± 1% 65.3µs ± 0% ~ (p=1.000 n=5+5)
neo/go/fs1-zwrk.go·4 79.6µs ± 1% 80.0µs ± 0% ~ (p=0.056 n=5+5)
neo/go/fs1-zwrk.go·8 131µs ± 0% 133µs ± 1% +1.10% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·12 193µs ± 1% 193µs ± 1% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·16 256µs ± 1% 260µs ± 1% +1.38% (p=0.032 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 38.0µs ± 1% 38.0µs ± 0% ~ (p=0.889 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 36.1µs ± 1% 35.9µs ± 1% ~ (p=0.056 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 47.8µs ± 1% 47.7µs ± 1% ~ (p=0.690 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 57.7µs ± 1% 57.7µs ± 1% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 90.7µs ± 0% 90.6µs ± 1% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 129µs ± 0% 128µs ± 1% ~ (p=0.421 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 171µs ± 2% 171µs ± 0% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go·1 90.7µs ± 1% 91.2µs ± 0% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go·2 109µs ± 1% 109µs ± 1% ~ (p=0.556 n=5+4)
neo/go/sqlite-zwrk.go·3 123µs ± 1% 124µs ± 0% +0.74% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·4 149µs ± 0% 149µs ± 1% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go·8 263µs ± 2% 270µs ± 2% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go·12 393µs ± 1% 410µs ± 2% +4.33% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·16 534µs ± 2% 560µs ± 1% +4.70% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 84.0µs ± 1% 84.0µs ± 1% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 102µs ± 0% 102µs ± 1% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 113µs ± 1% 113µs ± 0% ~ (p=0.310 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 133µs ± 0% 133µs ± 0% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 257µs ± 2% 257µs ± 2% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 415µs ± 1% 417µs ± 3% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 563µs ± 2% 563µs ± 1% ~ (p=0.841 n=5+5)
cluster:deco dataset:prod1-1024
fs1-zwrk.go·1 1.80µs ± 0% 1.80µs ± 0% ~ (p=0.413 n=5+5)
fs1-zwrk.go·2 1.98µs ± 3% 2.01µs ± 6% ~ (p=0.310 n=5+5)
fs1-zwrk.go·3 2.27µs ± 1% 2.26µs ± 2% ~ (p=0.889 n=5+5)
fs1-zwrk.go·4 2.58µs ± 2% 2.61µs ± 0% ~ (p=0.492 n=5+5)
fs1-zwrk.go·8 5.04µs ± 0% 5.04µs ± 1% ~ (p=0.730 n=5+5)
fs1-zwrk.go·12 7.55µs ± 0% 7.52µs ± 1% ~ (p=0.095 n=5+5)
fs1-zwrk.go·16 10.0µs ± 0% 10.0µs ± 0% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·1 103µs ± 0% 103µs ± 1% ~ (p=0.095 n=5+5)
zeo/py/fs1-zwrk.go·2 162µs ± 1% 161µs ± 1% ~ (p=0.421 n=5+5)
zeo/py/fs1-zwrk.go·3 212µs ± 1% 212µs ± 1% ~ (p=0.841 n=5+5)
zeo/py/fs1-zwrk.go·4 269µs ± 0% 268µs ± 1% ~ (p=0.421 n=5+5)
zeo/py/fs1-zwrk.go·8 512µs ± 0% 512µs ± 1% ~ (p=0.548 n=5+5)
zeo/py/fs1-zwrk.go·12 793µs ±12% 752µs ± 1% ~ (p=0.056 n=5+5)
zeo/py/fs1-zwrk.go·16 991µs ± 1% 1001µs ± 6% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 134µs ± 1% 134µs ± 1% ~ (p=0.841 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 233µs ± 1% 230µs ± 1% -1.31% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 348µs ± 1% 345µs ± 1% ~ (p=0.095 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 467µs ± 1% 465µs ± 1% ~ (p=0.310 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 935µs ± 1% 929µs ± 1% ~ (p=0.222 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 1.41ms ± 1% 1.40ms ± 1% ~ (p=0.222 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 1.87ms ± 1% 1.86ms ± 1% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·1 180µs ± 2% 184µs ± 2% ~ (p=0.056 n=5+5)
neo/py(!log)/sql-zwrk.go·2 315µs ± 1% 320µs ± 1% +1.69% (p=0.016 n=5+5)
neo/py(!log)/sql-zwrk.go·3 475µs ± 0% 481µs ± 1% +1.11% (p=0.016 n=5+5)
neo/py(!log)/sql-zwrk.go·4 637µs ± 0% 638µs ± 1% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·8 1.26ms ± 1% 1.27ms ± 1% ~ (p=0.095 n=5+5)
neo/py(!log)/sql-zwrk.go·12 1.89ms ± 1% 1.89ms ± 0% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zwrk.go·16 2.52ms ± 0% 2.54ms ± 1% +0.96% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·1 42.2µs ± 0% 41.9µs ± 0% -0.70% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·2 44.1µs ± 0% 44.0µs ± 1% ~ (p=0.421 n=5+5)
neo/go/fs1-zwrk.go·3 54.4µs ± 1% 54.5µs ± 0% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·4 65.9µs ± 2% 66.2µs ± 0% ~ (p=0.548 n=5+5)
neo/go/fs1-zwrk.go·8 113µs ± 2% 116µs ± 2% +2.48% (p=0.032 n=5+5)
neo/go/fs1-zwrk.go·12 169µs ± 4% 177µs ± 5% ~ (p=0.056 n=5+5)
neo/go/fs1-zwrk.go·16 225µs ± 3% 235µs ± 3% +4.24% (p=0.016 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 36.6µs ± 0% 36.8µs ± 1% ~ (p=0.548 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 36.1µs ± 1% 36.0µs ± 1% ~ (p=0.548 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 46.9µs ± 1% 46.9µs ± 1% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 57.9µs ± 1% 57.9µs ± 1% ~ (p=0.421 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 98.9µs ± 2% 98.6µs ± 4% ~ (p=0.690 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 153µs ± 5% 155µs ± 8% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 212µs ± 3% 208µs ± 5% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go·1 85.1µs ± 1% 85.5µs ± 1% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go·2 105µs ± 0% 106µs ± 1% ~ (p=0.548 n=5+5)
neo/go/sqlite-zwrk.go·3 123µs ± 1% 123µs ± 2% ~ (p=0.222 n=5+5)
neo/go/sqlite-zwrk.go·4 152µs ± 1% 154µs ± 3% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go·8 321µs ± 3% 325µs ± 5% ~ (p=0.548 n=5+5)
neo/go/sqlite-zwrk.go·12 500µs ± 5% 507µs ± 3% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go·16 630µs ± 1% 665µs ± 3% +5.46% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 82.0µs ± 0% 82.3µs ± 1% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 101µs ± 0% 102µs ± 1% +0.82% (p=0.032 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 115µs ± 1% 118µs ± 1% +2.73% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 139µs ± 1% 145µs ± 2% +4.40% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 295µs ± 3% 312µs ± 2% +5.87% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 474µs ± 2% 500µs ± 2% +5.41% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 632µs ± 1% 662µs ± 1% +4.85% (p=0.008 n=5+5)

0867c981

X rio: localhost timings, Cenabled · 31dc070d

Kirill Smelkov authored Mar 06, 2018

Compared to yesterday shows relatively no significant change, though
some benchmarks, like on neo1 & z6001, are itself noisy.

Disk, like on neo1 is not stable from run to run (though it still shows
a magnitude).

$ benchstat -split node,cluster,dataset 20180305-rio-ffixed-c.txt 20180306-rio-ffixed-c.txt

name old pystone/s new pystone/s delta
node:rio
pystone 146k ± 1% 115k ±12% -21.20% (p=0.008 n=5+5)

name old time/op new time/op delta
node:rio
crc32/py/4K 4.76µs ± 0% 4.77µs ± 0% ~ (p=0.730 n=5+4)
crc32/go/4K 1.49µs ± 0% 1.49µs ± 0% +0.22% (p=0.016 n=4+5)
sha1/py/4K 8.02µs ± 2% 8.04µs ± 1% ~ (p=0.500 n=5+5)
sha1/go/4K 8.95µs ± 0% 8.93µs ± 0% ~ (p=0.397 n=4+5)
unzlib/py/wczdata 25.0µs ± 0% 25.1µs ± 1% ~ (p=0.778 n=4+5)
unzlib/go/wczdata 23.0µs ± 0% 23.0µs ± 0% ~ (p=0.548 n=5+5)
unzlib/py/prod1-avg 7.25µs ± 3% 7.16µs ± 1% ~ (p=0.151 n=5+5)
unzlib/go/prod1-avg 5.07µs ± 0% 5.08µs ± 1% ~ (p=0.841 n=5+5)
disk/randread/direct/4K-min 38.4µs ± 1% 92.4µs ± 0% +140.70% (p=0.008 n=5+5)
disk/randread/direct/4K-avg 96.9µs ± 0% 115.0µs ± 0% +18.72% (p=0.008 n=5+5)
disk/randread/pagecache/4K-min 571ns ± 1% 565ns ± 2% ~ (p=0.167 n=5+5)
disk/randread/pagecache/4K-avg 1.01µs ± 0% 0.99µs ± 0% -1.78% (p=0.029 n=4+4)

name old time/object new time/object delta
cluster:rio dataset:wczblk1-8
fs1-zhash.py 28.7µs ± 2% 29.2µs ± 1% ~ (p=0.063 n=5+4)
fs1-zhash.go 4.60µs ± 0% 4.68µs ± 5% ~ (p=0.444 n=5+5)
fs1-zhash.go+prefetch128 4.72µs ± 6% 4.78µs ± 5% ~ (p=0.460 n=5+5)
zeo/py/fs1-zhash.py 395µs ± 3% 400µs ± 0% ~ (p=0.690 n=5+5)
zeo/py/fs1-zhash.go 138µs ± 1% 138µs ± 1% ~ (p=0.897 n=5+5)
zeo/py/fs1-zhash.go+prefetch128 73.5µs ± 1% 74.7µs ± 2% +1.66% (p=0.048 n=5+5)
neo/py(!log)/sqlite-zhash.py 330µs ± 6% 318µs ± 7% ~ (p=0.310 n=5+5)
neo/py(!log)/sqlite-zhash.go 157µs ± 4% 154µs ± 4% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zhash.go+prefetch128 126µs ± 3% 125µs ± 3% ~ (p=0.548 n=5+5)
neo/py(!log)/sql-zhash.py 392µs ±45% 400µs ±57% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zhash.go 181µs ± 2% 183µs ±11% ~ (p=0.690 n=5+5)
neo/py(!log)/sql-zhash.go+prefetch128 159µs ± 4% 158µs ± 3% ~ (p=0.841 n=5+5)
neo/go/fs1-zhash.py 228µs ± 2% 222µs ± 4% ~ (p=0.079 n=5+5)
neo/go/fs1-zhash.go 68.5µs ± 1% 68.6µs ± 2% ~ (p=0.714 n=5+5)
neo/go/fs1-zhash.go+prefetch128 29.4µs ± 5% 29.0µs ± 6% ~ (p=0.381 n=5+5)
neo/go/fs1(!sha1)-zhash.go(!sha1) 44.2µs ± 2% 43.9µs ± 3% ~ (p=0.770 n=5+5)
neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 19.1µs ± 3% 18.8µs ± 5% ~ (p=0.643 n=5+5)
neo/go/sqlite-zhash.py 265µs ± 5% 273µs ± 3% ~ (p=0.095 n=5+5)
neo/go/sqlite-zhash.go 104µs ± 1% 104µs ± 1% ~ (p=0.690 n=5+5)
neo/go/sqlite-zhash.go+prefetch128 38.6µs ± 6% 36.3µs ± 3% -6.16% (p=0.048 n=5+5)
neo/go/sqlite-zhash.go(!sha1) 92.9µs ± 2% 94.2µs ± 3% ~ (p=0.095 n=5+5)
neo/go/sqlite-zhash.go+prefetch128(!sha1) 35.7µs ± 6% 35.1µs ± 6% ~ (p=0.413 n=5+5)
cluster:rio dataset:prod1-1024
fs1-zhash.py 23.9µs ± 1% 23.9µs ± 1% ~ (p=1.000 n=5+4)
fs1-zhash.go 3.40µs ± 0% 3.40µs ± 0% ~ (all equal)
fs1-zhash.go+prefetch128 3.00µs ± 0% 3.02µs ± 9% ~ (p=0.444 n=5+5)
zeo/py/fs1-zhash.py 367µs ± 5% 372µs ±10% ~ (p=1.000 n=5+5)
zeo/py/fs1-zhash.go 114µs ± 3% 114µs ± 1% ~ (p=0.421 n=5+5)
zeo/py/fs1-zhash.go+prefetch128 64.6µs ± 0% 64.6µs ± 1% ~ (p=0.913 n=5+5)
neo/py(!log)/sqlite-zhash.py 314µs ± 8% 321µs ±11% ~ (p=0.952 n=5+5)
neo/py(!log)/sqlite-zhash.go 144µs ± 2% 142µs ± 3% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zhash.go+prefetch128 115µs ± 1% 117µs ± 1% ~ (p=0.056 n=5+5)
neo/py(!log)/sql-zhash.py 378µs ±44% 330µs ± 1% ~ (p=0.286 n=5+4)
neo/py(!log)/sql-zhash.go 174µs ± 5% 172µs ± 1% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zhash.go+prefetch128 149µs ± 1% 149µs ± 2% ~ (p=0.952 n=5+5)
neo/go/fs1-zhash.py 218µs ± 1% 217µs ± 1% ~ (p=0.857 n=4+5)
neo/go/fs1-zhash.go 49.9µs ± 1% 49.8µs ± 2% ~ (p=0.984 n=5+5)
neo/go/fs1-zhash.go+prefetch128 19.0µs ± 1% 18.8µs ± 1% ~ (p=0.143 n=5+5)
neo/go/fs1(!sha1)-zhash.go(!sha1) 40.4µs ± 3% 40.4µs ± 3% ~ (p=0.794 n=5+5)
neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 16.2µs ± 5% 16.1µs ± 2% ~ (p=1.000 n=5+5)
neo/go/sqlite-zhash.py 266µs ± 3% 263µs ± 4% ~ (p=0.690 n=5+5)
neo/go/sqlite-zhash.go 94.0µs ± 1% 93.1µs ± 1% -1.00% (p=0.040 n=5+5)
neo/go/sqlite-zhash.go+prefetch128 33.0µs ± 4% 32.7µs ± 2% ~ (p=0.651 n=5+5)
neo/go/sqlite-zhash.go(!sha1) 90.1µs ± 2% 89.6µs ± 1% ~ (p=0.381 n=5+5)
neo/go/sqlite-zhash.go+prefetch128(!sha1) 32.9µs ± 4% 34.0µs ± 2% ~ (p=0.063 n=5+5)

name old req/s new req/s delta
cluster:rio dataset:wczblk1-8
fs1-zwrk.go·1 300k ± 0% 300k ± 0% ~ (p=0.151 n=5+5)
fs1-zwrk.go·2 549k ± 0% 546k ± 0% -0.53% (p=0.016 n=4+5)
fs1-zwrk.go·3 811k ± 0% 810k ± 0% ~ (p=0.421 n=5+5)
fs1-zwrk.go·4 1.07M ± 0% 1.08M ± 0% ~ (p=0.310 n=5+5)
fs1-zwrk.go·8 1.42M ± 0% 1.42M ± 0% ~ (p=0.841 n=5+5)
fs1-zwrk.go·12 1.54M ± 0% 1.55M ± 0% ~ (p=0.310 n=5+5)
fs1-zwrk.go·16 1.55M ± 0% 1.55M ± 0% ~ (p=0.151 n=5+5)
zeo/py/fs1-zwrk.go·1 7.55k ± 0% 7.41k ± 1% -1.87% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·2 9.17k ± 1% 9.03k ± 1% -1.60% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·3 9.74k ± 1% 9.77k ± 1% ~ (p=0.548 n=5+5)
zeo/py/fs1-zwrk.go·4 10.2k ± 2% 10.1k ± 3% ~ (p=0.095 n=5+5)
zeo/py/fs1-zwrk.go·8 10.6k ± 2% 10.5k ± 0% ~ (p=0.310 n=5+5)
zeo/py/fs1-zwrk.go·12 10.5k ± 1% 10.6k ± 1% ~ (p=0.222 n=5+5)
zeo/py/fs1-zwrk.go·16 10.6k ± 1% 10.6k ± 1% ~ (p=0.151 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 6.69k ± 4% 6.80k ± 2% ~ (p=0.310 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 8.31k ± 9% 8.31k ± 7% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 7.96k ± 6% 8.60k ± 1% +8.12% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 8.27k ± 9% 8.60k ± 1% +4.05% (p=0.016 n=5+4)
neo/py(!log)/sqlite-zwrk.go·8 8.42k ± 2% 8.61k ± 1% +2.20% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 8.46k ± 1% 8.56k ± 1% +1.19% (p=0.032 n=4+5)
neo/py(!log)/sqlite-zwrk.go·16 8.34k ± 4% 8.49k ± 3% ~ (p=0.310 n=5+5)
neo/py(!log)/sql-zwrk.go·1 5.63k ± 1% 5.62k ± 6% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·2 6.80k ± 2% 6.75k ± 4% ~ (p=0.548 n=5+5)
neo/py(!log)/sql-zwrk.go·3 6.68k ± 2% 6.77k ± 2% ~ (p=0.310 n=5+5)
neo/py(!log)/sql-zwrk.go·4 6.63k ± 3% 6.51k ± 7% ~ (p=0.690 n=5+5)
neo/py(!log)/sql-zwrk.go·8 6.73k ± 2% 6.56k ± 4% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·12 6.71k ± 1% 6.84k ± 1% +2.00% (p=0.016 n=5+4)
neo/py(!log)/sql-zwrk.go·16 6.77k ± 2% 6.73k ± 3% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·1 15.7k ± 1% 15.5k ± 0% -1.10% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·2 30.2k ± 0% 29.9k ± 1% -1.04% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·3 39.8k ± 0% 39.4k ± 0% -0.82% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·4 49.8k ± 0% 49.4k ± 0% -0.85% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·8 69.1k ± 1% 68.4k ± 0% -0.93% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·12 73.1k ± 1% 72.5k ± 0% -0.74% (p=0.016 n=5+5)
neo/go/fs1-zwrk.go·16 73.8k ± 0% 73.2k ± 0% -0.81% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 25.5k ± 2% 26.2k ± 1% +2.41% (p=0.016 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 47.9k ± 0% 47.6k ± 0% -0.60% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 59.8k ± 0% 59.4k ± 0% -0.63% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 72.7k ± 0% 72.2k ± 0% -0.75% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 97.0k ± 0% 96.7k ± 0% ~ (p=0.151 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 110k ± 0% 109k ± 0% -0.64% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 114k ± 0% 113k ± 1% ~ (p=0.056 n=5+5)
neo/go/sqlite-zwrk.go·1 9.84k ± 1% 9.82k ± 0% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go·2 18.2k ± 0% 18.3k ± 0% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go·3 25.4k ± 0% 25.3k ± 0% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go·4 30.3k ± 0% 30.3k ± 0% ~ (p=0.095 n=5+5)
neo/go/sqlite-zwrk.go·8 39.3k ± 1% 39.5k ± 0% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go·12 40.6k ± 2% 40.8k ± 2% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go·16 40.5k ± 1% 40.5k ± 2% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 11.1k ± 1% 11.0k ± 1% ~ (p=0.095 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 20.1k ± 0% 20.0k ± 0% -0.49% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 27.9k ± 0% 27.9k ± 0% ~ (p=0.056 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 34.1k ± 1% 34.1k ± 0% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 44.2k ± 1% 44.1k ± 1% ~ (p=0.310 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 43.2k ± 1% 43.1k ± 1% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 41.3k ± 2% 41.2k ± 2% ~ (p=1.000 n=5+5)
cluster:rio dataset:prod1-1024
fs1-zwrk.go·1 463k ± 1% 465k ± 1% ~ (p=0.095 n=5+5)
fs1-zwrk.go·2 882k ± 7% 920k ± 0% +4.29% (p=0.016 n=5+4)
fs1-zwrk.go·3 1.36M ± 1% 1.36M ± 1% ~ (p=0.056 n=5+5)
fs1-zwrk.go·4 1.79M ± 1% 1.81M ± 0% ~ (p=0.095 n=5+5)
fs1-zwrk.go·8 2.34M ± 2% 2.37M ± 1% ~ (p=0.151 n=5+5)
fs1-zwrk.go·12 2.40M ± 0% 2.41M ± 0% ~ (p=0.056 n=5+5)
fs1-zwrk.go·16 2.41M ± 0% 2.42M ± 0% +0.61% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·1 8.99k ± 1% 8.98k ± 1% ~ (p=0.841 n=5+5)
zeo/py/fs1-zwrk.go·2 11.8k ± 1% 11.7k ± 1% -1.10% (p=0.032 n=5+5)
zeo/py/fs1-zwrk.go·3 12.9k ± 1% 12.9k ± 2% ~ (p=0.690 n=5+5)
zeo/py/fs1-zwrk.go·4 13.4k ± 3% 13.4k ± 4% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·8 14.1k ± 1% 14.0k ± 2% ~ (p=0.421 n=5+5)
zeo/py/fs1-zwrk.go·12 14.4k ± 2% 14.2k ± 2% ~ (p=0.421 n=5+5)
zeo/py/fs1-zwrk.go·16 14.4k ± 1% 14.2k ± 3% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 7.18k ± 2% 7.16k ± 4% ~ (p=0.841 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 8.65k ± 3% 8.75k ± 1% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 8.63k ± 1% 8.65k ± 4% ~ (p=0.222 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 8.67k ± 1% 8.53k ± 6% ~ (p=0.841 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 8.47k ± 6% 8.61k ± 3% ~ (p=0.310 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 8.45k ± 5% 8.64k ± 0% ~ (p=0.286 n=5+4)
neo/py(!log)/sqlite-zwrk.go·16 8.37k ± 3% 8.64k ± 1% +3.14% (p=0.032 n=5+5)
neo/py(!log)/sql-zwrk.go·1 5.91k ± 3% 5.88k ± 1% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·2 6.86k ± 3% 6.79k ± 2% ~ (p=0.690 n=5+5)
neo/py(!log)/sql-zwrk.go·3 6.91k ± 4% 6.58k ± 4% -4.75% (p=0.016 n=5+5)
neo/py(!log)/sql-zwrk.go·4 6.84k ± 2% 6.68k ± 4% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·8 6.98k ± 1% 6.83k ± 1% -2.17% (p=0.016 n=5+5)
neo/py(!log)/sql-zwrk.go·12 6.84k ± 6% 6.66k ± 4% ~ (p=0.095 n=5+5)
neo/py(!log)/sql-zwrk.go·16 6.92k ± 4% 6.65k ± 5% ~ (p=0.056 n=5+5)
neo/go/fs1-zwrk.go·1 21.8k ± 0% 21.8k ± 1% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·2 39.4k ± 1% 39.2k ± 1% ~ (p=0.056 n=5+5)
neo/go/fs1-zwrk.go·3 51.6k ± 0% 51.4k ± 0% -0.37% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·4 62.9k ± 0% 62.8k ± 0% ~ (p=0.222 n=5+5)
neo/go/fs1-zwrk.go·8 80.3k ± 2% 80.7k ± 1% ~ (p=0.548 n=5+5)
neo/go/fs1-zwrk.go·12 79.7k ± 2% 80.0k ± 2% ~ (p=0.690 n=5+5)
neo/go/fs1-zwrk.go·16 78.1k ± 4% 78.3k ± 2% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 26.5k ± 2% 26.5k ± 1% ~ (p=0.841 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 49.2k ± 0% 48.8k ± 0% -0.90% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 62.4k ± 0% 61.8k ± 0% -0.97% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 74.5k ± 0% 74.0k ± 0% -0.63% (p=0.016 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 92.3k ± 2% 91.3k ± 0% ~ (p=0.190 n=5+4)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 93.6k ± 4% 93.1k ± 2% ~ (p=0.548 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 90.7k ± 5% 89.7k ± 2% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go·1 11.0k ± 0% 11.0k ± 1% +0.63% (p=0.016 n=5+5)
neo/go/sqlite-zwrk.go·2 19.4k ± 0% 19.4k ± 1% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go·3 26.5k ± 0% 26.6k ± 0% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go·4 31.8k ± 1% 31.9k ± 0% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go·8 37.5k ± 1% 37.4k ± 2% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go·12 36.4k ± 5% 35.2k ± 3% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go·16 36.5k ± 3% 34.6k ± 2% -5.21% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 11.5k ± 1% 11.5k ± 1% ~ (p=0.310 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 20.1k ± 1% 20.1k ± 0% ~ (p=0.548 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 28.0k ± 0% 27.6k ± 0% -1.43% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 34.0k ± 0% 33.4k ± 0% -1.74% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 40.2k ± 1% 38.8k ± 2% -3.35% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 38.1k ± 1% 36.4k ± 1% -4.51% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 36.8k ± 1% 35.2k ± 2% -4.47% (p=0.008 n=5+5)

name old latency-time/object new latency-time/object delta
cluster:rio dataset:wczblk1-8
fs1-zwrk.go·1 3.34µs ± 0% 3.33µs ± 0% ~ (p=0.222 n=5+5)
fs1-zwrk.go·2 3.65µs ± 0% 3.67µs ± 0% +0.53% (p=0.016 n=4+5)
fs1-zwrk.go·3 3.70µs ± 0% 3.70µs ± 0% ~ (p=0.421 n=5+5)
fs1-zwrk.go·4 3.72µs ± 0% 3.72µs ± 0% ~ (p=0.341 n=5+5)
fs1-zwrk.go·8 5.62µs ± 0% 5.62µs ± 0% ~ (p=0.889 n=5+5)
fs1-zwrk.go·12 7.77µs ± 0% 7.76µs ± 0% ~ (p=0.333 n=5+5)
fs1-zwrk.go·16 10.4µs ± 0% 10.3µs ± 0% ~ (p=0.151 n=5+5)
zeo/py/fs1-zwrk.go·1 132µs ± 0% 135µs ± 1% +1.91% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·2 218µs ± 1% 222µs ± 1% +1.62% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·3 308µs ± 1% 307µs ± 1% ~ (p=0.548 n=5+5)
zeo/py/fs1-zwrk.go·4 392µs ± 2% 398µs ± 3% ~ (p=0.095 n=5+5)
zeo/py/fs1-zwrk.go·8 754µs ± 2% 759µs ± 0% ~ (p=0.310 n=5+5)
zeo/py/fs1-zwrk.go·12 1.15ms ± 1% 1.13ms ± 1% ~ (p=0.222 n=5+5)
zeo/py/fs1-zwrk.go·16 1.51ms ± 1% 1.50ms ± 1% ~ (p=0.151 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 150µs ± 4% 147µs ± 2% ~ (p=0.310 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 235µs ± 1% 241µs ± 8% ~ (p=0.556 n=4+5)
neo/py(!log)/sqlite-zwrk.go·3 378µs ± 6% 349µs ± 1% -7.74% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 485µs ± 9% 465µs ± 1% -4.08% (p=0.016 n=5+4)
neo/py(!log)/sqlite-zwrk.go·8 950µs ± 2% 930µs ± 1% -2.15% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 1.42ms ± 1% 1.40ms ± 1% -1.18% (p=0.032 n=4+5)
neo/py(!log)/sqlite-zwrk.go·16 1.92ms ± 4% 1.88ms ± 3% ~ (p=0.310 n=5+5)
neo/py(!log)/sql-zwrk.go·1 178µs ± 1% 178µs ± 6% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·2 294µs ± 2% 297µs ± 4% ~ (p=0.548 n=5+5)
neo/py(!log)/sql-zwrk.go·3 449µs ± 2% 443µs ± 2% ~ (p=0.310 n=5+5)
neo/py(!log)/sql-zwrk.go·4 603µs ± 3% 616µs ± 8% ~ (p=0.690 n=5+5)
neo/py(!log)/sql-zwrk.go·8 1.19ms ± 2% 1.22ms ± 5% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·12 1.79ms ± 1% 1.75ms ± 1% -1.96% (p=0.016 n=5+4)
neo/py(!log)/sql-zwrk.go·16 2.36ms ± 2% 2.38ms ± 3% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·1 63.7µs ± 1% 64.4µs ± 0% +1.11% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·2 66.2µs ± 0% 66.8µs ± 1% +1.05% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·3 75.4µs ± 0% 76.1µs ± 0% +0.82% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·4 80.4µs ± 0% 81.0µs ± 0% +0.85% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·8 116µs ± 1% 117µs ± 0% +0.94% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·12 164µs ± 1% 165µs ± 0% +0.74% (p=0.016 n=5+5)
neo/go/fs1-zwrk.go·16 217µs ± 0% 219µs ± 0% +0.82% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 39.2µs ± 2% 38.2µs ± 1% -2.37% (p=0.016 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 41.8µs ± 0% 42.0µs ± 0% +0.60% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 50.2µs ± 0% 50.5µs ± 0% +0.64% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 55.0µs ± 0% 55.4µs ± 0% +0.76% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 82.5µs ± 0% 82.8µs ± 0% ~ (p=0.151 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 109µs ± 0% 110µs ± 0% +0.65% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 141µs ± 0% 142µs ± 1% ~ (p=0.056 n=5+5)
neo/go/sqlite-zwrk.go·1 102µs ± 1% 102µs ± 0% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go·2 110µs ± 0% 110µs ± 0% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go·3 118µs ± 0% 119µs ± 0% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go·4 132µs ± 0% 132µs ± 0% ~ (p=0.095 n=5+5)
neo/go/sqlite-zwrk.go·8 204µs ± 1% 203µs ± 0% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go·12 296µs ± 2% 294µs ± 2% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go·16 395µs ± 1% 395µs ± 2% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 90.2µs ± 1% 91.1µs ± 1% ~ (p=0.095 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 100µs ± 0% 100µs ± 0% +0.49% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 107µs ± 0% 108µs ± 0% ~ (p=0.056 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 117µs ± 1% 117µs ± 0% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 181µs ± 1% 182µs ± 1% ~ (p=0.310 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 278µs ± 1% 279µs ± 1% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 388µs ± 2% 388µs ± 2% ~ (p=1.000 n=5+5)
cluster:rio dataset:prod1-1024
fs1-zwrk.go·1 2.16µs ± 1% 2.15µs ± 1% ~ (p=0.079 n=5+5)
fs1-zwrk.go·2 2.27µs ± 7% 2.17µs ± 0% -4.29% (p=0.016 n=5+4)
fs1-zwrk.go·3 2.21µs ± 1% 2.20µs ± 1% ~ (p=0.056 n=5+5)
fs1-zwrk.go·4 2.23µs ± 1% 2.21µs ± 0% ~ (p=0.087 n=5+5)
fs1-zwrk.go·8 3.42µs ± 2% 3.37µs ± 1% ~ (p=0.151 n=5+5)
fs1-zwrk.go·12 4.99µs ± 0% 4.97µs ± 0% ~ (p=0.056 n=5+5)
fs1-zwrk.go·16 6.65µs ± 0% 6.61µs ± 0% -0.60% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·1 111µs ± 1% 111µs ± 1% ~ (p=0.841 n=5+5)
zeo/py/fs1-zwrk.go·2 169µs ± 1% 171µs ± 1% +1.12% (p=0.032 n=5+5)
zeo/py/fs1-zwrk.go·3 233µs ± 1% 233µs ± 2% ~ (p=0.690 n=5+5)
zeo/py/fs1-zwrk.go·4 298µs ± 3% 298µs ± 4% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·8 567µs ± 1% 572µs ± 2% ~ (p=0.421 n=5+5)
zeo/py/fs1-zwrk.go·12 835µs ± 2% 844µs ± 2% ~ (p=0.421 n=5+5)
zeo/py/fs1-zwrk.go·16 1.11ms ± 1% 1.12ms ± 3% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 139µs ± 2% 140µs ± 4% ~ (p=0.841 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 231µs ± 3% 229µs ± 1% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 348µs ± 1% 347µs ± 5% ~ (p=0.222 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 462µs ± 1% 470µs ± 7% ~ (p=0.841 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 945µs ± 6% 929µs ± 3% ~ (p=0.310 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 1.42ms ± 5% 1.39ms ± 0% ~ (p=0.286 n=5+4)
neo/py(!log)/sqlite-zwrk.go·16 1.91ms ± 3% 1.85ms ± 1% -3.07% (p=0.032 n=5+5)
neo/py(!log)/sql-zwrk.go·1 169µs ± 3% 170µs ± 1% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·2 292µs ± 3% 294µs ± 2% ~ (p=0.690 n=5+5)
neo/py(!log)/sql-zwrk.go·3 434µs ± 4% 456µs ± 4% +4.99% (p=0.016 n=5+5)
neo/py(!log)/sql-zwrk.go·4 585µs ± 2% 599µs ± 4% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·8 1.15ms ± 1% 1.17ms ± 1% +2.21% (p=0.016 n=5+5)
neo/py(!log)/sql-zwrk.go·12 1.76ms ± 7% 1.80ms ± 4% ~ (p=0.095 n=5+5)
neo/py(!log)/sql-zwrk.go·16 2.31ms ± 4% 2.41ms ± 5% ~ (p=0.056 n=5+5)
neo/go/fs1-zwrk.go·1 45.8µs ± 0% 45.9µs ± 1% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·2 50.7µs ± 1% 51.0µs ± 1% ~ (p=0.056 n=5+5)
neo/go/fs1-zwrk.go·3 58.1µs ± 0% 58.3µs ± 0% +0.37% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·4 63.6µs ± 0% 63.7µs ± 0% ~ (p=0.222 n=5+5)
neo/go/fs1-zwrk.go·8 100µs ± 1% 99µs ± 1% ~ (p=0.548 n=5+5)
neo/go/fs1-zwrk.go·12 151µs ± 2% 150µs ± 2% ~ (p=0.690 n=5+5)
neo/go/fs1-zwrk.go·16 205µs ± 4% 204µs ± 3% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 37.7µs ± 2% 37.7µs ± 1% ~ (p=0.841 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 40.6µs ± 0% 41.0µs ± 0% +0.91% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 48.1µs ± 0% 48.5µs ± 0% +0.98% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 53.7µs ± 0% 54.0µs ± 0% +0.63% (p=0.016 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 86.7µs ± 2% 87.6µs ± 0% ~ (p=0.190 n=5+4)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 128µs ± 4% 129µs ± 2% ~ (p=0.548 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 177µs ± 5% 178µs ± 2% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go·1 91.3µs ± 0% 90.7µs ± 1% -0.63% (p=0.016 n=5+5)
neo/go/sqlite-zwrk.go·2 103µs ± 0% 103µs ± 1% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go·3 113µs ± 0% 113µs ± 0% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go·4 126µs ± 1% 125µs ± 0% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go·8 214µs ± 1% 214µs ± 2% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go·12 330µs ± 5% 341µs ± 3% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go·16 438µs ± 3% 462µs ± 2% +5.47% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 87.2µs ± 1% 86.7µs ± 1% ~ (p=0.310 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 99.3µs ± 1% 99.7µs ± 0% ~ (p=0.548 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 107µs ± 0% 109µs ± 0% +1.45% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 118µs ± 0% 120µs ± 0% +1.77% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 199µs ± 1% 206µs ± 2% +3.47% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 315µs ± 1% 330µs ± 1% +4.73% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 434µs ± 1% 455µs ± 2% +4.69% (p=0.008 n=5+5)

31dc070d

X z6001: localhost timings, Cenabled · 850bfb9d

Kirill Smelkov authored Mar 06, 2018

Compared to yesterday shows relatively no significant change, though
some benchmarks, like on neo1, are itself noisy.

disk/randread/direct/4K-avg changes by 55%, probably showing we should
be taking into account mdev(=std) ioping gives us, not only averaging
the average it prints.

$ benchstat -split node,cluster,dataset 20180305-z6001-ffixed-c.txt 20180306-z6001-ffixed-c.txt

name old pystone/s new pystone/s delta
node:z6001
pystone 112k ± 8% 109k ± 9% ~ (p=0.548 n=5+5)

name old time/op new time/op delta
node:z6001
crc32/py/4K 5.11µs ± 2% 5.11µs ± 1% ~ (p=0.452 n=5+5)
crc32/go/4K 1.72µs ± 0% 1.72µs ± 0% ~ (p=1.000 n=4+4)
sha1/py/4K 17.1µs ±31% 14.7µs ± 1% ~ (p=0.056 n=5+5)
sha1/go/4K 10.6µs ± 5% 10.3µs ± 0% ~ (p=1.000 n=5+5)
unzlib/py/wczdata 36.4µs ± 1% 37.1µs ± 8% ~ (p=1.000 n=5+5)
unzlib/go/wczdata 31.5µs ± 0% 31.5µs ± 0% ~ (p=0.151 n=5+5)
unzlib/py/prod1-avg 18.5µs ± 2% 18.5µs ± 3% ~ (p=0.841 n=5+5)
unzlib/go/prod1-avg 10.0µs ± 0% 10.0µs ± 1% ~ (p=0.151 n=5+5)
disk/randread/direct/4K-min 125µs ± 1% 126µs ± 1% +0.92% (p=0.048 n=5+4)
disk/randread/direct/4K-avg 128µs ± 0% 199µs ± 9% +55.41% (p=0.016 n=4+5)
disk/randread/pagecache/4K-min 801ns ± 4% 806ns ± 3% ~ (p=0.452 n=5+5)
disk/randread/pagecache/4K-avg 1.39µs ±12% 1.44µs ± 7% ~ (p=0.643 n=5+5)

name old time/object new time/object delta
cluster:z6001 dataset:wczblk1-8
fs1-zhash.py 37.4µs ± 2% 37.6µs ± 2% ~ (p=0.579 n=5+5)
fs1-zhash.go 5.94µs ± 1% 6.00µs ± 2% ~ (p=0.365 n=5+5)
fs1-zhash.go+prefetch128 8.06µs ± 7% 8.00µs ± 5% ~ (p=1.000 n=5+5)
zeo/py/fs1-zhash.py 657µs ±14% 650µs ± 7% ~ (p=0.548 n=5+5)
zeo/py/fs1-zhash.go 273µs ± 4% 274µs ±13% ~ (p=0.889 n=5+5)
zeo/py/fs1-zhash.go+prefetch128 101µs ± 2% 101µs ± 2% ~ (p=0.968 n=5+5)
neo/py(!log)/sqlite-zhash.py 694µs ± 1% 696µs ± 1% ~ (p=0.841 n=5+5)
neo/py(!log)/sqlite-zhash.go 326µs ±20% 338µs ± 7% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zhash.go+prefetch128 174µs ± 2% 177µs ± 1% ~ (p=0.063 n=5+5)
neo/py(!log)/sql-zhash.py 934µs ± 3% 1000µs ±38% ~ (p=0.730 n=4+5)
neo/py(!log)/sql-zhash.go 422µs ±11% 434µs ± 6% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zhash.go+prefetch128 274µs ±10% 277µs ± 9% ~ (p=1.000 n=5+5)
neo/go/fs1-zhash.py 527µs ±13% 526µs ± 8% ~ (p=0.841 n=5+5)
neo/go/fs1-zhash.go 103µs ± 6% 102µs ± 8% ~ (p=1.000 n=5+5)
neo/go/fs1-zhash.go+prefetch128 35.7µs ± 3% 36.6µs ± 4% ~ (p=0.175 n=5+5)
neo/go/fs1(!sha1)-zhash.go(!sha1) 73.8µs ± 5% 76.4µs ± 5% ~ (p=0.151 n=5+5)
neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 27.2µs ± 6% 26.5µs ± 2% ~ (p=0.310 n=5+5)
neo/go/sqlite-zhash.py 553µs ±14% 528µs ±15% ~ (p=0.421 n=5+5)
neo/go/sqlite-zhash.go 222µs ±17% 204µs ±22% ~ (p=0.421 n=5+5)
neo/go/sqlite-zhash.go+prefetch128 39.6µs ± 4% 39.9µs ± 4% ~ (p=0.841 n=5+5)
neo/go/sqlite-zhash.go(!sha1) 188µs ±14% 194µs ± 9% ~ (p=0.690 n=5+5)
neo/go/sqlite-zhash.go+prefetch128(!sha1) 37.4µs ± 4% 38.2µs ± 7% ~ (p=0.278 n=5+5)
cluster:z6001 dataset:prod1-1024
fs1-zhash.py 30.3µs ± 3% 30.3µs ± 1% ~ (p=0.444 n=5+5)
fs1-zhash.go 4.60µs ± 0% 4.62µs ± 3% ~ (p=0.556 n=4+5)
fs1-zhash.go+prefetch128 5.90µs ± 5% 5.76µs ± 8% ~ (p=0.476 n=5+5)
zeo/py/fs1-zhash.py 617µs ± 9% 632µs ±15% ~ (p=0.841 n=5+5)
zeo/py/fs1-zhash.go 228µs ± 4% 235µs ± 7% ~ (p=0.389 n=5+5)
zeo/py/fs1-zhash.go+prefetch128 87.9µs ± 1% 87.2µs ± 1% ~ (p=0.206 n=5+5)
neo/py(!log)/sqlite-zhash.py 665µs ± 3% 664µs ± 2% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zhash.go 285µs ± 4% 269µs ± 7% ~ (p=0.095 n=5+5)
neo/py(!log)/sqlite-zhash.go+prefetch128 163µs ± 0% 162µs ± 0% -0.52% (p=0.029 n=4+4)
neo/py(!log)/sql-zhash.py 970µs ±41% 1029µs ±29% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zhash.go 386µs ±11% 406µs ± 2% ~ (p=0.548 n=5+5)
neo/py(!log)/sql-zhash.go+prefetch128 261µs ± 3% 268µs ± 5% ~ (p=0.310 n=5+5)
neo/go/fs1-zhash.py 515µs ±16% 520µs ± 9% ~ (p=1.000 n=5+5)
neo/go/fs1-zhash.go 82.5µs ± 7% 83.2µs ± 7% ~ (p=0.690 n=5+5)
neo/go/fs1-zhash.go+prefetch128 24.2µs ± 3% 24.0µs ± 5% ~ (p=0.452 n=5+5)
neo/go/fs1(!sha1)-zhash.go(!sha1) 70.4µs ± 2% 67.0µs ± 3% -4.80% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 20.9µs ± 2% 21.2µs ± 4% ~ (p=0.579 n=5+5)
neo/go/sqlite-zhash.py 527µs ± 9% 539µs ±11% ~ (p=0.587 n=5+5)
neo/go/sqlite-zhash.go 190µs ±23% 196µs ± 9% ~ (p=0.310 n=5+5)
neo/go/sqlite-zhash.go+prefetch128 34.7µs ± 2% 35.0µs ± 3% ~ (p=0.421 n=5+5)
neo/go/sqlite-zhash.go(!sha1) 159µs ±21% 168µs ± 8% ~ (p=0.310 n=5+5)
neo/go/sqlite-zhash.go+prefetch128(!sha1) 35.4µs ± 1% 35.1µs ± 4% ~ (p=0.556 n=5+5)

name old req/s new req/s delta
cluster:z6001 dataset:wczblk1-8
fs1-zwrk.go·1 231k ± 0% 230k ± 1% ~ (p=0.056 n=5+5)
fs1-zwrk.go·2 444k ± 2% 437k ± 5% ~ (p=0.548 n=5+5)
fs1-zwrk.go·3 667k ± 2% 663k ± 4% ~ (p=0.690 n=5+5)
fs1-zwrk.go·4 877k ± 0% 880k ± 1% ~ (p=0.286 n=4+5)
fs1-zwrk.go·8 1.74M ± 2% 1.75M ± 2% ~ (p=0.421 n=5+5)
fs1-zwrk.go·12 2.52M ± 3% 2.56M ± 0% ~ (p=0.190 n=5+4)
fs1-zwrk.go·16 2.88M ± 0% 2.89M ± 1% ~ (p=0.151 n=5+5)
zeo/py/fs1-zwrk.go·1 4.42k ± 5% 4.30k ± 8% ~ (p=0.548 n=5+5)
zeo/py/fs1-zwrk.go·2 6.33k ± 0% 6.33k ± 0% ~ (p=0.905 n=5+4)
zeo/py/fs1-zwrk.go·3 6.91k ± 0% 6.90k ± 0% ~ (p=0.730 n=5+4)
zeo/py/fs1-zwrk.go·4 7.12k ± 0% 7.14k ± 1% ~ (p=0.343 n=4+4)
zeo/py/fs1-zwrk.go·8 7.52k ± 1% 7.53k ± 2% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·12 7.55k ± 2% 7.65k ± 0% ~ (p=0.111 n=5+4)
zeo/py/fs1-zwrk.go·16 7.67k ± 2% 7.57k ± 0% ~ (p=0.151 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 3.41k ±12% 3.50k ±15% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 5.63k ± 0% 5.58k ± 0% -0.85% (p=0.016 n=5+4)
neo/py(!log)/sqlite-zwrk.go·3 5.54k ± 5% 5.63k ± 2% ~ (p=0.548 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 5.54k ± 1% 5.56k ± 1% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 5.74k ± 1% 5.61k ± 2% -2.19% (p=0.032 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 5.67k ± 1% 5.62k ± 1% ~ (p=0.151 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 5.64k ± 2% 5.62k ± 1% ~ (p=0.556 n=5+4)
neo/py(!log)/sql-zwrk.go·1 2.64k ± 8% 2.53k ±17% ~ (p=0.690 n=5+5)
neo/py(!log)/sql-zwrk.go·2 3.63k ± 9% 3.57k ± 9% ~ (p=0.690 n=5+5)
neo/py(!log)/sql-zwrk.go·3 3.91k ± 7% 3.65k ±14% ~ (p=0.151 n=5+5)
neo/py(!log)/sql-zwrk.go·4 3.73k ± 9% 3.56k ±16% ~ (p=0.310 n=5+5)
neo/py(!log)/sql-zwrk.go·8 3.79k ± 5% 3.78k ±12% ~ (p=0.690 n=5+5)
neo/py(!log)/sql-zwrk.go·12 3.65k ±11% 3.73k ±13% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zwrk.go·16 3.69k ±14% 3.47k ± 9% ~ (p=0.421 n=5+5)
neo/go/fs1-zwrk.go·1 10.8k ± 6% 10.7k ± 5% ~ (p=0.690 n=5+5)
neo/go/fs1-zwrk.go·2 22.5k ± 2% 22.3k ± 1% ~ (p=0.421 n=5+5)
neo/go/fs1-zwrk.go·3 31.8k ± 1% 31.7k ± 1% ~ (p=0.548 n=5+5)
neo/go/fs1-zwrk.go·4 43.3k ± 0% 43.2k ± 1% ~ (p=0.548 n=5+5)
neo/go/fs1-zwrk.go·8 78.1k ± 0% 78.3k ± 0% ~ (p=0.151 n=5+5)
neo/go/fs1-zwrk.go·12 92.5k ± 0% 92.5k ± 0% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·16 102k ± 1% 103k ± 1% ~ (p=0.548 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 15.3k ± 5% 15.0k ± 5% ~ (p=0.548 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 31.5k ± 1% 31.5k ± 1% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 43.8k ± 0% 43.8k ± 0% ~ (p=0.841 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 57.6k ± 0% 57.4k ± 0% ~ (p=0.310 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 100k ± 0% 100k ± 0% ~ (p=0.310 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 116k ± 0% 116k ± 0% ~ (p=0.222 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 126k ± 0% 126k ± 1% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go·1 5.05k ±10% 4.85k ±15% ~ (p=0.548 n=5+5)
neo/go/sqlite-zwrk.go·2 11.8k ± 2% 12.0k ± 2% +2.47% (p=0.032 n=5+5)
neo/go/sqlite-zwrk.go·3 19.0k ± 0% 19.0k ± 1% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go·4 24.6k ± 1% 24.7k ± 0% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go·8 44.5k ± 1% 44.8k ± 0% ~ (p=0.056 n=5+5)
neo/go/sqlite-zwrk.go·12 56.3k ± 1% 56.3k ± 0% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go·16 58.4k ± 0% 58.0k ± 0% -0.72% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 5.62k ± 7% 5.41k ± 4% ~ (p=0.222 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 13.1k ± 3% 12.8k ± 1% ~ (p=0.056 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 20.4k ± 1% 20.2k ± 1% -1.15% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 27.1k ± 1% 26.8k ± 1% ~ (p=0.095 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 48.4k ± 1% 48.1k ± 1% ~ (p=0.222 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 60.2k ± 0% 60.3k ± 0% ~ (p=0.095 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 61.6k ± 1% 61.7k ± 1% ~ (p=0.548 n=5+5)
cluster:z6001 dataset:prod1-1024
fs1-zwrk.go·1 342k ± 4% 347k ± 2% ~ (p=0.310 n=5+5)
fs1-zwrk.go·2 657k ± 6% 660k ± 3% ~ (p=0.841 n=5+5)
fs1-zwrk.go·3 985k ± 4% 985k ± 4% ~ (p=0.841 n=5+5)
fs1-zwrk.go·4 1.29M ± 2% 1.31M ± 2% ~ (p=0.222 n=5+5)
fs1-zwrk.go·8 2.57M ± 1% 2.55M ± 4% ~ (p=0.690 n=5+5)
fs1-zwrk.go·12 2.81M ± 2% 2.81M ± 1% ~ (p=1.000 n=5+5)
fs1-zwrk.go·16 2.85M ± 1% 2.85M ± 2% ~ (p=0.841 n=5+5)
zeo/py/fs1-zwrk.go·1 5.07k ± 5% 4.80k ± 5% ~ (p=0.056 n=5+5)
zeo/py/fs1-zwrk.go·2 8.17k ± 2% 8.18k ± 1% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·3 8.84k ± 5% 8.96k ± 1% ~ (p=0.421 n=5+5)
zeo/py/fs1-zwrk.go·4 9.19k ± 1% 8.88k ± 9% ~ (p=0.690 n=5+5)
zeo/py/fs1-zwrk.go·8 9.82k ± 1% 9.96k ± 2% ~ (p=0.111 n=5+4)
zeo/py/fs1-zwrk.go·12 9.67k ± 6% 9.80k ± 6% ~ (p=0.222 n=5+5)
zeo/py/fs1-zwrk.go·16 10.0k ± 9% 10.1k ± 6% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 3.69k ± 9% 3.70k ± 6% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 5.76k ± 0% 5.77k ± 0% ~ (p=0.343 n=4+4)
neo/py(!log)/sqlite-zwrk.go·3 5.44k ±11% 5.77k ± 0% +6.20% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 5.81k ± 1% 5.77k ± 0% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 5.85k ± 0% 5.84k ± 1% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 5.67k ± 3% 5.78k ± 2% +1.96% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 5.84k ± 0% 5.80k ± 1% ~ (p=0.730 n=4+5)
neo/py(!log)/sql-zwrk.go·1 2.63k ± 6% 2.51k ±12% ~ (p=0.310 n=5+5)
neo/py(!log)/sql-zwrk.go·2 3.83k ±11% 3.62k ± 8% ~ (p=0.222 n=5+5)
neo/py(!log)/sql-zwrk.go·3 3.64k ±13% 3.86k ±11% ~ (p=0.310 n=5+5)
neo/py(!log)/sql-zwrk.go·4 3.73k ±14% 3.82k ±11% ~ (p=0.548 n=5+5)
neo/py(!log)/sql-zwrk.go·8 4.12k ± 6% 3.89k ±10% ~ (p=0.222 n=5+5)
neo/py(!log)/sql-zwrk.go·12 3.89k ± 9% 3.98k ± 7% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zwrk.go·16 3.60k ± 9% 3.72k ±13% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·1 13.4k ± 3% 13.8k ± 3% ~ (p=0.222 n=5+5)
neo/go/fs1-zwrk.go·2 28.0k ± 1% 28.1k ± 0% ~ (p=0.548 n=5+5)
neo/go/fs1-zwrk.go·3 40.0k ± 0% 40.2k ± 0% +0.61% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·4 52.8k ± 0% 52.8k ± 1% ~ (p=1.000 n=5+5)
neo/go/fs1-zwrk.go·8 90.7k ± 0% 90.6k ± 0% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·12 96.4k ± 1% 95.8k ± 1% ~ (p=0.151 n=5+5)
neo/go/fs1-zwrk.go·16 91.2k ± 2% 90.9k ± 1% ~ (p=0.690 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 15.9k ± 2% 16.2k ± 2% +2.23% (p=0.032 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 33.0k ± 0% 32.9k ± 1% ~ (p=0.421 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 46.3k ± 0% 46.2k ± 0% ~ (p=0.548 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 59.9k ± 0% 59.8k ± 1% ~ (p=0.690 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 98.7k ± 1% 98.1k ± 0% ~ (p=0.151 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 103k ± 1% 102k ± 1% ~ (p=0.310 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 96.5k ± 3% 97.0k ± 2% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go·1 5.66k ±15% 5.67k ± 8% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go·2 13.3k ± 2% 13.3k ± 2% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go·3 20.4k ± 0% 20.3k ± 1% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go·4 26.6k ± 1% 26.5k ± 0% ~ (p=0.222 n=5+5)
neo/go/sqlite-zwrk.go·8 44.5k ± 0% 44.5k ± 1% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go·12 52.2k ± 1% 52.3k ± 1% ~ (p=0.548 n=5+5)
neo/go/sqlite-zwrk.go·16 48.8k ± 1% 48.9k ± 1% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 5.74k ± 8% 5.69k ± 4% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 13.3k ± 2% 13.2k ± 3% ~ (p=0.548 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 20.5k ± 1% 20.5k ± 1% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 27.0k ± 1% 27.1k ± 2% ~ (p=0.310 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 44.8k ± 2% 45.4k ± 1% ~ (p=0.095 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 53.1k ± 1% 53.3k ± 1% ~ (p=0.222 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 49.8k ± 2% 49.8k ± 1% ~ (p=1.000 n=5+5)

name old latency-time/object new latency-time/object delta
cluster:z6001 dataset:wczblk1-8
fs1-zwrk.go·1 4.32µs ± 0% 4.34µs ± 1% +0.47% (p=0.040 n=5+5)
fs1-zwrk.go·2 4.51µs ± 2% 4.58µs ± 5% ~ (p=0.548 n=5+5)
fs1-zwrk.go·3 4.50µs ± 2% 4.52µs ± 4% ~ (p=0.635 n=5+5)
fs1-zwrk.go·4 4.56µs ± 0% 4.55µs ± 1% ~ (p=0.381 n=4+5)
fs1-zwrk.go·8 4.60µs ± 2% 4.58µs ± 2% ~ (p=0.421 n=5+5)
fs1-zwrk.go·12 4.77µs ± 3% 4.69µs ± 0% ~ (p=0.190 n=5+4)
fs1-zwrk.go·16 5.56µs ± 0% 5.53µs ± 1% ~ (p=0.151 n=5+5)
zeo/py/fs1-zwrk.go·1 227µs ± 5% 233µs ± 8% ~ (p=0.548 n=5+5)
zeo/py/fs1-zwrk.go·2 316µs ± 0% 315µs ± 2% ~ (p=0.841 n=5+5)
zeo/py/fs1-zwrk.go·3 434µs ± 0% 435µs ± 0% ~ (p=0.730 n=5+4)
zeo/py/fs1-zwrk.go·4 562µs ± 0% 560µs ± 1% ~ (p=0.343 n=4+4)
zeo/py/fs1-zwrk.go·8 1.06ms ± 1% 1.06ms ± 2% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·12 1.59ms ± 2% 1.57ms ± 0% ~ (p=0.111 n=5+4)
zeo/py/fs1-zwrk.go·16 2.09ms ± 2% 2.11ms ± 0% ~ (p=0.151 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 295µs ±11% 288µs ±14% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 355µs ± 0% 358µs ± 0% +0.86% (p=0.016 n=5+4)
neo/py(!log)/sqlite-zwrk.go·3 542µs ± 5% 533µs ± 2% ~ (p=0.548 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 722µs ± 1% 720µs ± 1% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 1.39ms ± 1% 1.43ms ± 2% +2.25% (p=0.032 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 2.11ms ± 1% 2.14ms ± 1% ~ (p=0.151 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 2.84ms ± 2% 2.85ms ± 1% ~ (p=0.556 n=5+4)
neo/py(!log)/sql-zwrk.go·1 380µs ± 8% 400µs ±16% ~ (p=0.690 n=5+5)
neo/py(!log)/sql-zwrk.go·2 553µs ± 9% 562µs ± 8% ~ (p=0.690 n=5+5)
neo/py(!log)/sql-zwrk.go·3 769µs ± 7% 827µs ±13% ~ (p=0.151 n=5+5)
neo/py(!log)/sql-zwrk.go·4 1.08ms ± 9% 1.13ms ±14% ~ (p=0.310 n=5+5)
neo/py(!log)/sql-zwrk.go·8 2.11ms ± 5% 2.13ms ±13% ~ (p=0.690 n=5+5)
neo/py(!log)/sql-zwrk.go·12 3.31ms ±12% 3.24ms ±12% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zwrk.go·16 4.37ms ±15% 4.62ms ± 8% ~ (p=0.421 n=5+5)
neo/go/fs1-zwrk.go·1 92.9µs ± 6% 93.9µs ± 4% ~ (p=0.690 n=5+5)
neo/go/fs1-zwrk.go·2 88.7µs ± 2% 89.6µs ± 1% ~ (p=0.421 n=5+5)
neo/go/fs1-zwrk.go·3 94.4µs ± 1% 94.6µs ± 1% ~ (p=0.548 n=5+5)
neo/go/fs1-zwrk.go·4 92.5µs ± 0% 92.6µs ± 1% ~ (p=0.548 n=5+5)
neo/go/fs1-zwrk.go·8 102µs ± 0% 102µs ± 0% ~ (p=0.151 n=5+5)
neo/go/fs1-zwrk.go·12 130µs ± 0% 130µs ± 0% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·16 157µs ± 1% 156µs ± 1% ~ (p=0.548 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 65.6µs ± 5% 66.8µs ± 5% ~ (p=0.548 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 63.4µs ± 1% 63.5µs ± 1% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 68.4µs ± 0% 68.5µs ± 0% ~ (p=0.841 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 69.5µs ± 0% 69.7µs ± 0% ~ (p=0.310 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 79.9µs ± 0% 79.7µs ± 0% ~ (p=0.310 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 103µs ± 0% 103µs ± 0% ~ (p=0.222 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 127µs ± 0% 127µs ± 1% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go·1 198µs ± 9% 208µs ±14% ~ (p=0.548 n=5+5)
neo/go/sqlite-zwrk.go·2 170µs ± 2% 166µs ± 2% -2.41% (p=0.032 n=5+5)
neo/go/sqlite-zwrk.go·3 157µs ± 0% 158µs ± 1% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go·4 162µs ± 1% 162µs ± 0% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go·8 180µs ± 1% 178µs ± 0% ~ (p=0.056 n=5+5)
neo/go/sqlite-zwrk.go·12 213µs ± 1% 213µs ± 0% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go·16 274µs ± 0% 276µs ± 0% +0.72% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 178µs ± 7% 185µs ± 4% ~ (p=0.222 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 152µs ± 3% 156µs ± 1% ~ (p=0.056 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 147µs ± 1% 149µs ± 1% +1.17% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 148µs ± 1% 149µs ± 1% ~ (p=0.095 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 165µs ± 1% 166µs ± 1% ~ (p=0.222 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 199µs ± 0% 199µs ± 0% ~ (p=0.095 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 260µs ± 1% 259µs ± 1% ~ (p=0.548 n=5+5)
cluster:z6001 dataset:prod1-1024
fs1-zwrk.go·1 2.93µs ± 4% 2.88µs ± 2% ~ (p=0.310 n=5+5)
fs1-zwrk.go·2 3.05µs ± 6% 3.03µs ± 3% ~ (p=0.841 n=5+5)
fs1-zwrk.go·3 3.05µs ± 5% 3.05µs ± 4% ~ (p=0.841 n=5+5)
fs1-zwrk.go·4 3.10µs ± 2% 3.05µs ± 2% ~ (p=0.222 n=5+5)
fs1-zwrk.go·8 3.11µs ± 1% 3.14µs ± 4% ~ (p=0.690 n=5+5)
fs1-zwrk.go·12 4.27µs ± 2% 4.28µs ± 1% ~ (p=1.000 n=5+5)
fs1-zwrk.go·16 5.62µs ± 1% 5.63µs ± 2% ~ (p=0.841 n=5+5)
zeo/py/fs1-zwrk.go·1 198µs ± 6% 208µs ± 5% ~ (p=0.056 n=5+5)
zeo/py/fs1-zwrk.go·2 245µs ± 2% 245µs ± 1% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·3 340µs ± 5% 335µs ± 1% ~ (p=0.421 n=5+5)
zeo/py/fs1-zwrk.go·4 435µs ± 1% 453µs ±10% ~ (p=0.690 n=5+5)
zeo/py/fs1-zwrk.go·8 814µs ± 1% 803µs ± 2% ~ (p=0.111 n=5+4)
zeo/py/fs1-zwrk.go·12 1.24ms ± 7% 1.23ms ± 6% ~ (p=0.222 n=5+5)
zeo/py/fs1-zwrk.go·16 1.61ms ±10% 1.59ms ± 6% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 272µs ± 8% 271µs ± 7% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 347µs ± 0% 346µs ± 0% ~ (p=0.343 n=4+4)
neo/py(!log)/sqlite-zwrk.go·3 555µs ±12% 520µs ± 0% -6.28% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 688µs ± 1% 694µs ± 0% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 1.37ms ± 0% 1.37ms ± 1% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 2.12ms ± 3% 2.07ms ± 2% -1.93% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 2.74ms ± 0% 2.76ms ± 1% ~ (p=0.730 n=4+5)
neo/py(!log)/sql-zwrk.go·1 380µs ± 6% 400µs ±11% ~ (p=0.310 n=5+5)
neo/py(!log)/sql-zwrk.go·2 524µs ±10% 554µs ± 7% ~ (p=0.222 n=5+5)
neo/py(!log)/sql-zwrk.go·3 832µs ±12% 783µs ±11% ~ (p=0.310 n=5+5)
neo/py(!log)/sql-zwrk.go·4 1.08ms ±13% 1.06ms ±11% ~ (p=0.548 n=5+5)
neo/py(!log)/sql-zwrk.go·8 1.95ms ± 7% 2.07ms ± 9% ~ (p=0.222 n=5+5)
neo/py(!log)/sql-zwrk.go·12 3.09ms ±10% 3.02ms ± 7% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zwrk.go·16 4.45ms ± 8% 4.32ms ±12% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·1 74.5µs ± 3% 72.6µs ± 3% ~ (p=0.222 n=5+5)
neo/go/fs1-zwrk.go·2 71.4µs ± 1% 71.2µs ± 0% ~ (p=0.548 n=5+5)
neo/go/fs1-zwrk.go·3 75.0µs ± 0% 74.6µs ± 0% -0.61% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·4 75.8µs ± 0% 75.7µs ± 1% ~ (p=1.000 n=5+5)
neo/go/fs1-zwrk.go·8 88.2µs ± 0% 88.3µs ± 0% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·12 124µs ± 1% 125µs ± 1% ~ (p=0.151 n=5+5)
neo/go/fs1-zwrk.go·16 175µs ± 2% 176µs ± 1% ~ (p=0.690 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 63.1µs ± 2% 61.7µs ± 2% -2.19% (p=0.032 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 60.6µs ± 0% 60.7µs ± 1% ~ (p=0.421 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 64.8µs ± 0% 64.9µs ± 0% ~ (p=0.548 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 66.7µs ± 0% 66.9µs ± 1% ~ (p=0.690 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 81.1µs ± 1% 81.5µs ± 0% ~ (p=0.151 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 117µs ± 1% 118µs ± 1% ~ (p=0.310 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 166µs ± 3% 165µs ± 2% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go·1 178µs ±14% 177µs ± 8% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go·2 150µs ± 2% 151µs ± 2% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go·3 147µs ± 0% 148µs ± 1% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go·4 151µs ± 1% 151µs ± 0% ~ (p=0.222 n=5+5)
neo/go/sqlite-zwrk.go·8 180µs ± 0% 180µs ± 1% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go·12 230µs ± 1% 229µs ± 1% ~ (p=0.548 n=5+5)
neo/go/sqlite-zwrk.go·16 328µs ± 1% 327µs ± 1% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 175µs ± 8% 176µs ± 4% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 150µs ± 2% 152µs ± 3% ~ (p=0.548 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 147µs ± 1% 147µs ± 1% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 148µs ± 1% 148µs ± 2% ~ (p=0.310 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 179µs ± 2% 176µs ± 1% ~ (p=0.095 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 226µs ± 1% 225µs ± 1% ~ (p=0.222 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 322µs ± 2% 321µs ± 1% ~ (p=1.000 n=5+5)

850bfb9d

X neo1: localhost timings, Cenabled · 9644774a

Kirill Smelkov authored Mar 06, 2018

Compared to yesterday shows relatively no significant change, though
some benchmarks, usually related to sql are itself noisy.

$ benchstat -split node,cluster,dataset 20180305-neo1-ffixed-c.txt 20180306-neo1-ffixed-c.txt

name old pystone/s new pystone/s delta
node:neo1
pystone 106k ± 1% 106k ± 1% ~ (p=0.690 n=5+5)

name old time/op new time/op delta
node:neo1
crc32/py/4K 5.13µs ± 1% 5.13µs ± 1% ~ (p=0.548 n=5+5)
crc32/go/4K 2.79µs ± 0% 2.79µs ± 0% ~ (p=0.238 n=5+5)
sha1/py/4K 13.5µs ± 1% 13.4µs ± 1% ~ (p=0.548 n=5+5)
sha1/go/4K 9.83µs ± 0% 9.83µs ± 0% ~ (p=0.746 n=5+5)
unzlib/py/wczdata 36.2µs ± 1% 36.1µs ± 0% ~ (p=0.421 n=5+5)
unzlib/go/wczdata 31.2µs ± 1% 31.1µs ± 1% ~ (p=0.548 n=5+5)
unzlib/py/prod1-avg 16.4µs ± 2% 16.3µs ± 2% ~ (p=0.690 n=5+5)
unzlib/go/prod1-avg 9.42µs ± 0% 9.42µs ± 0% ~ (p=0.786 n=5+5)
disk/randread/direct/4K-min 161µs ± 0% 162µs ± 0% +0.37% (p=0.008 n=5+5)
disk/randread/direct/4K-avg 187µs ± 1% 187µs ± 2% ~ (p=0.381 n=5+5)
disk/randread/pagecache/4K-min 390ns ± 1% 389ns ± 1% ~ (p=0.317 n=5+5)
disk/randread/pagecache/4K-avg 801ns ± 0% 804ns ± 0% +0.34% (p=0.048 n=5+4)

name old time/object new time/object delta
cluster:neo1 dataset:wczblk1-8
fs1-zhash.py 34.9µs ± 1% 34.7µs ± 2% ~ (p=0.651 n=5+5)
fs1-zhash.go 5.96µs ± 1% 6.00µs ± 2% ~ (p=0.683 n=5+5)
fs1-zhash.go+prefetch128 6.64µs ± 2% 6.52µs ± 4% ~ (p=0.317 n=5+5)
zeo/py/fs1-zhash.py 517µs ± 2% 523µs ± 1% ~ (p=0.222 n=5+5)
zeo/py/fs1-zhash.go 200µs ± 3% 194µs ± 4% ~ (p=0.310 n=5+5)
zeo/py/fs1-zhash.go+prefetch128 99.3µs ± 4% 98.6µs ± 3% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zhash.py 668µs ±18% 684µs ± 3% ~ (p=0.841 n=5+5)
neo/py(!log)/sqlite-zhash.go 242µs ± 1% 236µs ± 2% -2.46% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zhash.go+prefetch128 166µs ± 1% 162µs ± 2% -2.30% (p=0.008 n=5+5)
neo/py(!log)/sql-zhash.py 933µs ±54% 942µs ±47% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zhash.go 317µs ± 8% 300µs ±17% ~ (p=0.690 n=5+5)
neo/py(!log)/sql-zhash.go+prefetch128 245µs ± 7% 240µs ± 6% ~ (p=0.548 n=5+5)
neo/go/fs1-zhash.py 382µs ±22% 383µs ±20% ~ (p=1.000 n=5+5)
neo/go/fs1-zhash.go 81.3µs ± 3% 81.3µs ± 1% ~ (p=0.532 n=5+5)
neo/go/fs1-zhash.go+prefetch128 33.9µs ± 4% 33.8µs ± 5% ~ (p=0.952 n=5+5)
neo/go/fs1(!sha1)-zhash.go(!sha1) 57.4µs ± 3% 57.6µs ± 3% ~ (p=0.746 n=5+5)
neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 23.2µs ± 4% 22.9µs ± 6% ~ (p=0.500 n=5+5)
neo/go/sqlite-zhash.py 410µs ± 3% 402µs ± 6% ~ (p=1.000 n=5+5)
neo/go/sqlite-zhash.go 125µs ± 1% 125µs ± 1% ~ (p=0.333 n=5+5)
neo/go/sqlite-zhash.go+prefetch128 47.4µs ± 3% 48.4µs ± 8% ~ (p=0.690 n=5+5)
neo/go/sqlite-zhash.go(!sha1) 114µs ± 2% 116µs ± 2% ~ (p=0.151 n=5+5)
neo/go/sqlite-zhash.go+prefetch128(!sha1) 47.0µs ±13% 45.9µs ± 5% ~ (p=1.000 n=5+5)
cluster:neo1 dataset:prod1-1024
fs1-zhash.py 29.0µs ± 1% 28.9µs ± 1% ~ (p=0.341 n=5+5)
fs1-zhash.go 3.76µs ± 2% 3.76µs ± 4% ~ (p=1.000 n=5+5)
fs1-zhash.go+prefetch128 3.80µs ± 0% 3.86µs ± 2% ~ (p=0.238 n=4+5)
zeo/py/fs1-zhash.py 481µs ± 3% 474µs ± 2% ~ (p=0.310 n=5+5)
zeo/py/fs1-zhash.go 170µs ± 5% 170µs ± 3% ~ (p=1.000 n=5+5)
zeo/py/fs1-zhash.go+prefetch128 87.7µs ± 2% 87.8µs ± 1% ~ (p=0.881 n=5+5)
neo/py(!log)/sqlite-zhash.py 657µs ±11% 665µs ± 2% ~ (p=0.841 n=5+5)
neo/py(!log)/sqlite-zhash.go 213µs ± 5% 219µs ± 2% ~ (p=0.222 n=5+5)
neo/py(!log)/sqlite-zhash.go+prefetch128 151µs ± 2% 151µs ± 1% ~ (p=0.881 n=5+5)
neo/py(!log)/sql-zhash.py 897µs ±54% 886µs ±56% ~ (p=0.690 n=5+5)
neo/py(!log)/sql-zhash.go 320µs ± 9% 298µs ± 9% ~ (p=0.151 n=5+5)
neo/py(!log)/sql-zhash.go+prefetch128 230µs ± 2% 230µs ± 3% ~ (p=1.000 n=5+5)
neo/go/fs1-zhash.py 346µs ±35% 319µs ±11% ~ (p=0.794 n=5+5)
neo/go/fs1-zhash.go 61.2µs ± 1% 61.3µs ± 3% ~ (p=0.794 n=5+5)
neo/go/fs1-zhash.go+prefetch128 22.6µs ± 2% 22.5µs ± 3% ~ (p=0.738 n=5+5)
neo/go/fs1(!sha1)-zhash.go(!sha1) 51.2µs ± 2% 52.0µs ± 3% ~ (p=0.135 n=5+5)
neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 18.5µs ± 5% 18.3µs ± 2% ~ (p=0.460 n=5+5)
neo/go/sqlite-zhash.py 391µs ± 7% 382µs ± 6% ~ (p=0.421 n=5+5)
neo/go/sqlite-zhash.go 113µs ± 1% 113µs ± 1% ~ (p=0.841 n=5+5)
neo/go/sqlite-zhash.go+prefetch128 41.5µs ± 6% 40.9µs ± 4% ~ (p=0.730 n=5+5)
neo/go/sqlite-zhash.go(!sha1) 109µs ± 1% 108µs ± 1% ~ (p=0.222 n=5+5)
neo/go/sqlite-zhash.go+prefetch128(!sha1) 41.1µs ± 3% 41.1µs ± 5% ~ (p=1.000 n=5+5)

name old req/s new req/s delta
cluster:neo1 dataset:wczblk1-8
fs1-zwrk.go·1 230k ± 0% 229k ± 0% ~ (p=0.095 n=5+5)
fs1-zwrk.go·2 446k ± 1% 443k ± 1% ~ (p=0.151 n=5+5)
fs1-zwrk.go·3 663k ± 0% 662k ± 1% ~ (p=0.730 n=4+5)
fs1-zwrk.go·4 868k ± 0% 867k ± 1% ~ (p=0.548 n=5+5)
fs1-zwrk.go·8 989k ± 1% 988k ± 0% ~ (p=1.000 n=5+5)
fs1-zwrk.go·12 1.02M ± 0% 1.02M ± 0% ~ (p=1.000 n=5+5)
fs1-zwrk.go·16 1.01M ± 0% 0.98M ±12% ~ (p=0.841 n=5+5)
zeo/py/fs1-zwrk.go·1 5.09k ± 2% 5.15k ± 1% ~ (p=0.421 n=5+5)
zeo/py/fs1-zwrk.go·2 7.08k ± 2% 7.08k ± 1% ~ (p=0.690 n=5+5)
zeo/py/fs1-zwrk.go·3 7.75k ± 1% 7.73k ± 1% ~ (p=0.548 n=5+5)
zeo/py/fs1-zwrk.go·4 7.93k ± 2% 7.97k ± 4% ~ (p=0.690 n=5+5)
zeo/py/fs1-zwrk.go·8 8.30k ± 2% 8.30k ± 2% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·12 8.43k ± 1% 8.15k ± 1% -3.31% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·16 8.41k ± 2% 8.25k ± 1% ~ (p=0.056 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 4.36k ± 4% 4.31k ± 4% ~ (p=0.841 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 6.27k ± 3% 6.28k ± 5% ~ (p=0.548 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 6.21k ± 2% 6.38k ± 0% +2.64% (p=0.016 n=5+4)
neo/py(!log)/sqlite-zwrk.go·4 6.07k ± 6% 6.15k ± 5% ~ (p=0.548 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 6.22k ± 3% 6.27k ± 4% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 6.19k ± 4% 6.33k ± 2% ~ (p=0.056 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 6.09k ± 6% 6.25k ± 4% ~ (p=0.310 n=5+5)
neo/py(!log)/sql-zwrk.go·1 3.12k ± 7% 3.10k ± 6% ~ (p=0.690 n=5+5)
neo/py(!log)/sql-zwrk.go·2 4.02k ± 7% 3.98k ± 1% ~ (p=0.690 n=5+5)
neo/py(!log)/sql-zwrk.go·3 4.08k ± 8% 4.04k ± 3% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zwrk.go·4 4.03k ± 4% 4.06k ± 4% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·8 3.95k ± 3% 3.79k ± 7% ~ (p=0.151 n=5+5)
neo/py(!log)/sql-zwrk.go·12 4.04k ± 5% 3.98k ± 3% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·16 3.97k ± 5% 3.94k ± 1% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·1 12.9k ± 2% 12.8k ± 0% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·2 24.9k ± 1% 24.8k ± 0% ~ (p=0.286 n=5+4)
neo/go/fs1-zwrk.go·3 32.4k ± 0% 32.3k ± 0% -0.29% (p=0.032 n=5+5)
neo/go/fs1-zwrk.go·4 40.8k ± 1% 40.7k ± 0% ~ (p=0.151 n=5+5)
neo/go/fs1-zwrk.go·8 54.8k ± 1% 54.5k ± 1% ~ (p=0.056 n=5+5)
neo/go/fs1-zwrk.go·12 56.5k ± 1% 56.5k ± 1% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·16 54.4k ± 2% 53.2k ±10% ~ (p=0.841 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 18.9k ± 2% 19.0k ± 2% ~ (p=0.690 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 37.8k ± 0% 37.8k ± 0% ~ (p=0.841 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 48.1k ± 0% 48.0k ± 1% ~ (p=0.222 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 59.2k ± 0% 59.0k ± 0% -0.45% (p=0.016 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 78.4k ± 0% 78.0k ± 1% ~ (p=0.056 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 82.9k ± 1% 82.2k ± 2% ~ (p=0.421 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 80.4k ± 2% 80.4k ± 1% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go·1 8.13k ± 0% 8.06k ± 4% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go·2 14.9k ± 0% 14.9k ± 0% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go·3 20.8k ± 1% 20.7k ± 0% ~ (p=0.310 n=5+5)
neo/go/sqlite-zwrk.go·4 24.9k ± 0% 24.8k ± 0% -0.37% (p=0.032 n=5+5)
neo/go/sqlite-zwrk.go·8 31.7k ± 1% 31.7k ± 1% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go·12 31.4k ± 1% 30.8k ± 5% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go·16 30.5k ± 2% 30.4k ± 2% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 8.96k ± 0% 8.95k ± 1% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 16.4k ± 0% 16.2k ± 1% -1.04% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 22.7k ± 0% 22.6k ± 0% -0.59% (p=0.016 n=5+4)
neo/go/sqlite-zwrk.go(!sha1)·4 27.7k ± 0% 27.9k ± 0% +0.58% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 34.4k ± 0% 35.0k ± 1% +1.92% (p=0.016 n=4+5)
neo/go/sqlite-zwrk.go(!sha1)·12 33.5k ± 2% 34.7k ± 1% +3.56% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 33.0k ± 2% 33.0k ±11% ~ (p=0.222 n=5+5)
cluster:neo1 dataset:prod1-1024
fs1-zwrk.go·1 452k ± 1% 451k ± 0% ~ (p=0.690 n=5+5)
fs1-zwrk.go·2 895k ± 0% 893k ± 0% -0.30% (p=0.032 n=5+5)
fs1-zwrk.go·3 1.33M ± 1% 1.34M ± 1% ~ (p=0.151 n=5+5)
fs1-zwrk.go·4 1.76M ± 1% 1.77M ± 0% ~ (p=0.690 n=5+5)
fs1-zwrk.go·8 1.94M ±12% 1.99M ± 1% ~ (p=0.841 n=5+5)
fs1-zwrk.go·12 2.03M ± 0% 2.03M ± 1% ~ (p=0.286 n=5+4)
fs1-zwrk.go·16 2.03M ± 0% 2.03M ± 0% ~ (p=0.095 n=5+5)
zeo/py/fs1-zwrk.go·1 6.00k ± 2% 5.79k ± 3% -3.52% (p=0.032 n=5+5)
zeo/py/fs1-zwrk.go·2 8.45k ± 7% 8.55k ± 1% ~ (p=0.690 n=5+5)
zeo/py/fs1-zwrk.go·3 9.33k ± 2% 9.28k ± 7% ~ (p=0.841 n=5+5)
zeo/py/fs1-zwrk.go·4 9.80k ± 0% 9.72k ± 1% -0.89% (p=0.032 n=5+5)
zeo/py/fs1-zwrk.go·8 10.4k ± 1% 10.4k ± 1% ~ (p=0.841 n=5+5)
zeo/py/fs1-zwrk.go·12 10.5k ± 2% 10.5k ± 1% ~ (p=0.421 n=5+5)
zeo/py/fs1-zwrk.go·16 10.4k ± 4% 10.4k ± 4% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 4.87k ±11% 4.90k ± 7% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 6.44k ± 1% 6.28k ± 4% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 6.31k ± 6% 6.32k ± 5% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 6.36k ± 7% 6.45k ± 2% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 6.47k ± 1% 6.45k ± 2% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 6.48k ± 1% 6.31k ± 3% ~ (p=0.056 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 6.35k ± 2% 6.36k ± 5% ~ (p=0.548 n=5+5)
neo/py(!log)/sql-zwrk.go·1 3.07k ± 9% 3.50k ± 9% +14.08% (p=0.032 n=5+5)
neo/py(!log)/sql-zwrk.go·2 4.09k ± 3% 4.05k ± 6% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·3 3.99k ±11% 4.06k ± 7% ~ (p=0.548 n=5+5)
neo/py(!log)/sql-zwrk.go·4 3.99k ± 2% 3.98k ± 4% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·8 4.15k ± 4% 4.15k ± 3% ~ (p=0.548 n=5+5)
neo/py(!log)/sql-zwrk.go·12 4.13k ± 5% 4.00k ± 5% ~ (p=0.222 n=5+5)
neo/py(!log)/sql-zwrk.go·16 4.22k ± 7% 3.96k ±11% ~ (p=0.151 n=5+5)
neo/go/fs1-zwrk.go·1 17.3k ± 1% 17.1k ± 1% ~ (p=0.063 n=5+5)
neo/go/fs1-zwrk.go·2 32.5k ± 1% 32.6k ± 0% ~ (p=0.222 n=5+5)
neo/go/fs1-zwrk.go·3 43.3k ± 0% 43.3k ± 0% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·4 52.9k ± 0% 52.9k ± 0% ~ (p=0.730 n=4+5)
neo/go/fs1-zwrk.go·8 65.3k ± 2% 66.3k ± 1% +1.57% (p=0.032 n=5+4)
neo/go/fs1-zwrk.go·12 61.0k ± 6% 61.6k ± 1% ~ (p=1.000 n=5+5)
neo/go/fs1-zwrk.go·16 55.9k ± 2% 55.6k ± 4% ~ (p=0.421 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 20.0k ± 3% 19.6k ± 5% ~ (p=0.421 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 40.5k ± 1% 40.3k ± 0% ~ (p=0.095 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 51.6k ± 0% 51.6k ± 0% ~ (p=0.841 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 62.6k ± 0% 62.0k ± 0% -0.83% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 74.6k ± 1% 74.2k ± 4% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 66.3k ± 4% 64.8k ± 7% ~ (p=0.548 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 58.9k ± 2% 59.5k ± 4% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go·1 9.01k ± 1% 9.02k ± 1% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go·2 15.9k ± 1% 16.0k ± 0% ~ (p=0.310 n=5+5)
neo/go/sqlite-zwrk.go·3 21.8k ± 0% 21.8k ± 1% ~ (p=1.000 n=4+4)
neo/go/sqlite-zwrk.go·4 26.3k ± 0% 26.2k ± 0% ~ (p=0.095 n=5+5)
neo/go/sqlite-zwrk.go·8 29.8k ± 1% 30.0k ± 2% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go·12 28.5k ± 1% 28.6k ± 2% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go·16 28.5k ± 8% 28.7k ± 1% ~ (p=0.730 n=5+4)
neo/go/sqlite-zwrk.go(!sha1)·1 9.38k ± 1% 9.45k ± 1% ~ (p=0.222 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 16.5k ± 0% 16.6k ± 1% ~ (p=0.095 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 22.7k ± 0% 23.0k ± 0% +1.59% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 27.5k ± 1% 28.0k ± 1% +1.81% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 32.3k ± 5% 32.3k ± 0% ~ (p=0.222 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 30.7k ± 2% 30.6k ± 2% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 30.3k ± 2% 30.3k ± 2% ~ (p=0.841 n=5+5)

name old latency-time/object new latency-time/object delta
cluster:neo1 dataset:wczblk1-8
fs1-zwrk.go·1 4.35µs ± 0% 4.36µs ± 0% ~ (p=0.095 n=5+5)
fs1-zwrk.go·2 4.49µs ± 1% 4.52µs ± 1% ~ (p=0.151 n=5+5)
fs1-zwrk.go·3 4.53µs ± 0% 4.53µs ± 1% ~ (p=0.730 n=4+5)
fs1-zwrk.go·4 4.61µs ± 0% 4.61µs ± 1% ~ (p=0.548 n=5+5)
fs1-zwrk.go·8 8.09µs ± 1% 8.10µs ± 0% ~ (p=1.000 n=5+5)
fs1-zwrk.go·12 11.8µs ± 0% 11.8µs ± 0% ~ (p=1.000 n=5+5)
fs1-zwrk.go·16 15.8µs ± 0% 16.5µs ±13% ~ (p=0.841 n=5+5)
zeo/py/fs1-zwrk.go·1 197µs ± 2% 194µs ± 1% ~ (p=0.421 n=5+5)
zeo/py/fs1-zwrk.go·2 283µs ± 2% 282µs ± 1% ~ (p=0.690 n=5+5)
zeo/py/fs1-zwrk.go·3 387µs ± 1% 388µs ± 1% ~ (p=0.548 n=5+5)
zeo/py/fs1-zwrk.go·4 504µs ± 2% 502µs ± 5% ~ (p=0.690 n=5+5)
zeo/py/fs1-zwrk.go·8 964µs ± 2% 964µs ± 2% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·12 1.42ms ± 1% 1.47ms ± 1% +3.43% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·16 1.90ms ± 2% 1.94ms ± 1% ~ (p=0.056 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 230µs ± 4% 232µs ± 4% ~ (p=0.841 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 319µs ± 3% 319µs ± 5% ~ (p=0.548 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 483µs ± 2% 470µs ± 0% -2.59% (p=0.016 n=5+4)
neo/py(!log)/sqlite-zwrk.go·4 661µs ± 6% 651µs ± 5% ~ (p=0.548 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 1.29ms ± 3% 1.28ms ± 4% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 1.94ms ± 4% 1.90ms ± 2% ~ (p=0.056 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 2.63ms ± 6% 2.56ms ± 4% ~ (p=0.310 n=5+5)
neo/py(!log)/sql-zwrk.go·1 321µs ± 7% 323µs ± 6% ~ (p=0.690 n=5+5)
neo/py(!log)/sql-zwrk.go·2 499µs ± 7% 503µs ± 2% ~ (p=0.690 n=5+5)
neo/py(!log)/sql-zwrk.go·3 737µs ± 8% 742µs ± 3% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zwrk.go·4 993µs ± 4% 986µs ± 4% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·8 2.03ms ± 3% 2.11ms ± 8% ~ (p=0.151 n=5+5)
neo/py(!log)/sql-zwrk.go·12 2.97ms ± 4% 3.02ms ± 3% ~ (p=0.421 n=5+5)
neo/py(!log)/sql-zwrk.go·16 4.03ms ± 4% 4.06ms ± 1% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·1 77.7µs ± 2% 77.8µs ± 0% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·2 80.2µs ± 1% 80.6µs ± 0% ~ (p=0.286 n=5+4)
neo/go/fs1-zwrk.go·3 92.5µs ± 0% 92.8µs ± 0% +0.30% (p=0.032 n=5+5)
neo/go/fs1-zwrk.go·4 98.1µs ± 1% 98.2µs ± 0% ~ (p=0.151 n=5+5)
neo/go/fs1-zwrk.go·8 146µs ± 1% 147µs ± 1% ~ (p=0.056 n=5+5)
neo/go/fs1-zwrk.go·12 212µs ± 1% 212µs ± 1% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·16 294µs ± 2% 293µs ± 1% ~ (p=0.905 n=5+4)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 52.8µs ± 2% 52.7µs ± 2% ~ (p=0.690 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 53.0µs ± 0% 53.0µs ± 0% ~ (p=0.889 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 62.3µs ± 0% 62.5µs ± 1% ~ (p=0.222 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 67.5µs ± 0% 67.8µs ± 0% +0.46% (p=0.016 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 102µs ± 0% 103µs ± 1% +0.54% (p=0.040 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 145µs ± 1% 146µs ± 2% ~ (p=0.421 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 199µs ± 2% 199µs ± 1% ~ (p=0.651 n=5+5)
neo/go/sqlite-zwrk.go·1 123µs ± 0% 124µs ± 4% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go·2 134µs ± 0% 134µs ± 0% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go·3 144µs ± 1% 145µs ± 0% ~ (p=0.310 n=5+5)
neo/go/sqlite-zwrk.go·4 161µs ± 0% 161µs ± 0% +0.38% (p=0.032 n=5+5)
neo/go/sqlite-zwrk.go·8 253µs ± 1% 252µs ± 1% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go·12 383µs ± 1% 390µs ± 5% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go·16 524µs ± 2% 526µs ± 2% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 112µs ± 0% 112µs ± 1% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 122µs ± 0% 124µs ± 1% +1.05% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 132µs ± 0% 133µs ± 0% +0.60% (p=0.016 n=5+4)
neo/go/sqlite-zwrk.go(!sha1)·4 144µs ± 0% 143µs ± 0% -0.57% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 233µs ± 0% 228µs ± 1% -1.88% (p=0.016 n=4+5)
neo/go/sqlite-zwrk.go(!sha1)·12 359µs ± 2% 346µs ± 1% -3.44% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 485µs ± 2% 486µs ±11% ~ (p=0.222 n=5+5)
cluster:neo1 dataset:prod1-1024
fs1-zwrk.go·1 2.21µs ± 1% 2.22µs ± 1% ~ (p=0.667 n=5+5)
fs1-zwrk.go·2 2.23µs ± 0% 2.24µs ± 0% +0.30% (p=0.040 n=5+5)
fs1-zwrk.go·3 2.25µs ± 1% 2.25µs ± 1% ~ (p=0.135 n=5+5)
fs1-zwrk.go·4 2.27µs ± 1% 2.26µs ± 0% ~ (p=0.611 n=5+5)
fs1-zwrk.go·8 4.15µs ±13% 4.02µs ± 1% ~ (p=0.841 n=5+5)
fs1-zwrk.go·12 5.90µs ± 0% 5.92µs ± 1% ~ (p=0.317 n=5+4)
fs1-zwrk.go·16 7.89µs ± 0% 7.87µs ± 0% ~ (p=0.087 n=5+5)
zeo/py/fs1-zwrk.go·1 167µs ± 2% 173µs ± 3% +3.68% (p=0.032 n=5+5)
zeo/py/fs1-zwrk.go·2 237µs ± 7% 234µs ± 1% ~ (p=0.690 n=5+5)
zeo/py/fs1-zwrk.go·3 322µs ± 2% 324µs ± 7% ~ (p=0.841 n=5+5)
zeo/py/fs1-zwrk.go·4 408µs ± 0% 412µs ± 1% +0.91% (p=0.032 n=5+5)
zeo/py/fs1-zwrk.go·8 770µs ± 1% 768µs ± 1% ~ (p=0.841 n=5+5)
zeo/py/fs1-zwrk.go·12 1.14ms ± 2% 1.14ms ± 1% ~ (p=0.421 n=5+5)
zeo/py/fs1-zwrk.go·16 1.54ms ± 4% 1.54ms ± 4% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 206µs ±11% 204µs ± 8% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 311µs ± 1% 319µs ± 4% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 476µs ± 7% 475µs ± 5% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 629µs ± 7% 620µs ± 2% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 1.24ms ± 1% 1.24ms ± 2% ~ (p=1.000 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 1.85ms ± 1% 1.90ms ± 3% ~ (p=0.056 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 2.52ms ± 2% 2.52ms ± 5% ~ (p=0.548 n=5+5)
neo/py(!log)/sql-zwrk.go·1 327µs ± 8% 287µs ± 8% -12.18% (p=0.032 n=5+5)
neo/py(!log)/sql-zwrk.go·2 489µs ± 3% 495µs ± 6% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·3 755µs ±10% 740µs ± 8% ~ (p=0.548 n=5+5)
neo/py(!log)/sql-zwrk.go·4 1.00ms ± 2% 1.01ms ± 4% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·8 1.93ms ± 3% 1.93ms ± 3% ~ (p=0.548 n=5+5)
neo/py(!log)/sql-zwrk.go·12 2.91ms ± 5% 3.01ms ± 4% ~ (p=0.222 n=5+5)
neo/py(!log)/sql-zwrk.go·16 3.80ms ± 7% 4.05ms ±10% ~ (p=0.151 n=5+5)
neo/go/fs1-zwrk.go·1 57.8µs ± 1% 58.5µs ± 1% ~ (p=0.063 n=5+5)
neo/go/fs1-zwrk.go·2 61.5µs ± 1% 61.4µs ± 0% ~ (p=0.254 n=5+5)
neo/go/fs1-zwrk.go·3 69.3µs ± 0% 69.3µs ± 0% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·4 75.6µs ± 0% 75.6µs ± 0% ~ (p=0.730 n=4+5)
neo/go/fs1-zwrk.go·8 123µs ± 2% 121µs ± 1% -1.56% (p=0.032 n=5+4)
neo/go/fs1-zwrk.go·12 197µs ± 6% 195µs ± 1% ~ (p=1.000 n=5+5)
neo/go/fs1-zwrk.go·16 286µs ± 2% 288µs ± 4% ~ (p=0.421 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 50.0µs ± 3% 50.9µs ± 5% ~ (p=0.421 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 49.4µs ± 1% 49.7µs ± 0% ~ (p=0.095 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 58.1µs ± 0% 58.2µs ± 0% ~ (p=0.841 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 63.9µs ± 0% 64.5µs ± 0% +0.84% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 107µs ± 1% 108µs ± 4% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 181µs ± 4% 185µs ± 8% ~ (p=0.548 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 272µs ± 2% 269µs ± 4% ~ (p=0.841 n=5+5)
neo/go/sqlite-zwrk.go·1 111µs ± 1% 111µs ± 1% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go·2 126µs ± 1% 125µs ± 0% ~ (p=0.310 n=5+5)
neo/go/sqlite-zwrk.go·3 137µs ± 0% 137µs ± 1% ~ (p=1.000 n=4+4)
neo/go/sqlite-zwrk.go·4 152µs ± 0% 153µs ± 0% ~ (p=0.095 n=5+5)
neo/go/sqlite-zwrk.go·8 268µs ± 1% 267µs ± 1% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go·12 421µs ± 1% 420µs ± 2% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go·16 562µs ± 8% 558µs ± 1% ~ (p=0.730 n=5+4)
neo/go/sqlite-zwrk.go(!sha1)·1 107µs ± 1% 106µs ± 1% ~ (p=0.222 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 121µs ± 0% 121µs ± 1% ~ (p=0.095 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 132µs ± 0% 130µs ± 0% -1.57% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 146µs ± 1% 143µs ± 1% -1.78% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 247µs ± 5% 248µs ± 0% ~ (p=0.222 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 391µs ± 2% 393µs ± 2% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 528µs ± 2% 528µs ± 2% ~ (p=0.841 n=5+5)

9644774a

X deco: localhost timings, Cenabled · dabeb4b8

Kirill Smelkov authored Mar 06, 2018

Compared to yesterday shows not significant change, thus meaning
benchmarking is more or less stable (+/- 5% at ·12 and ·16 is probably
due to scheduling):

$ benchstat -split node,cluster,dataset 20180305-deco-ffixed-c.txt 20180306-deco-ffixed-c.txt

name old pystone/s new pystone/s delta
node:deco
pystone 219k ± 3% 217k ± 4% ~ (p=0.548 n=5+5)

name old time/op new time/op delta
node:deco
crc32/py/4K 5.72µs ± 0% 5.73µs ± 0% ~ (p=0.460 n=5+5)
crc32/go/4K 279ns ± 0% 279ns ± 0% ~ (all equal)
sha1/py/4K 6.69µs ± 0% 6.74µs ± 1% +0.66% (p=0.024 n=5+5)
sha1/go/4K 5.59µs ± 0% 5.60µs ± 0% +0.19% (p=0.008 n=5+5)
unzlib/py/wczdata 27.2µs ± 0% 27.2µs ± 1% ~ (p=0.905 n=4+5)
unzlib/go/wczdata 26.9µs ± 1% 27.0µs ± 0% ~ (p=0.222 n=5+5)
unzlib/py/prod1-avg 5.06µs ± 0% 5.14µs ± 3% ~ (p=0.603 n=4+5)
unzlib/go/prod1-avg 5.33µs ± 1% 5.30µs ± 1% ~ (p=0.087 n=5+5)
disk/randread/direct/4K-min 105µs ± 0% 104µs ± 2% ~ (p=0.270 n=5+5)
disk/randread/direct/4K-avg 142µs ± 0% 141µs ± 0% -0.31% (p=0.032 n=5+5)
disk/randread/pagecache/4K-min 583ns ± 1% 579ns ± 2% ~ (p=0.246 n=5+5)
disk/randread/pagecache/4K-avg 1.00µs ± 1% 0.99µs ± 0% -0.98% (p=0.024 n=5+5)

name old time/object new time/object delta
cluster:deco dataset:wczblk1-8
fs1-zhash.py 20.2µs ± 1% 20.3µs ± 1% ~ (p=0.571 n=4+4)
fs1-zhash.go 3.20µs ± 0% 3.26µs ± 4% ~ (p=0.444 n=5+5)
fs1-zhash.go+prefetch128 4.14µs ± 6% 4.04µs ± 1% ~ (p=0.444 n=5+5)
zeo/py/fs1-zhash.py 379µs ± 3% 383µs ± 5% ~ (p=0.730 n=5+5)
zeo/py/fs1-zhash.go 127µs ± 1% 126µs ± 1% ~ (p=0.317 n=4+5)
zeo/py/fs1-zhash.go+prefetch128 64.1µs ± 2% 63.1µs ± 1% ~ (p=0.222 n=5+5)
neo/py(!log)/sqlite-zhash.py 335µs ± 4% 344µs ± 6% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zhash.go 145µs ± 2% 140µs ± 1% -3.07% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zhash.go+prefetch128 118µs ± 1% 119µs ± 2% ~ (p=0.548 n=5+5)
neo/py(!log)/sql-zhash.py 454µs ±61% 386µs ± 1% ~ (p=1.000 n=5+4)
neo/py(!log)/sql-zhash.go 183µs ± 1% 183µs ± 3% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zhash.go+prefetch128 164µs ± 2% 164µs ± 3% ~ (p=0.690 n=5+5)
neo/go/fs1-zhash.py 227µs ± 2% 226µs ± 3% ~ (p=0.690 n=5+5)
neo/go/fs1-zhash.go 56.9µs ± 1% 57.1µs ± 0% ~ (p=0.119 n=5+5)
neo/go/fs1-zhash.go+prefetch128 24.7µs ± 2% 24.7µs ± 5% ~ (p=0.571 n=5+5)
neo/go/fs1(!sha1)-zhash.go(!sha1) 40.5µs ± 1% 40.2µs ± 1% ~ (p=0.254 n=5+5)
neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 16.8µs ± 5% 17.1µs ± 6% ~ (p=0.579 n=5+5)
neo/go/sqlite-zhash.py 269µs ± 1% 272µs ± 3% ~ (p=0.690 n=5+5)
neo/go/sqlite-zhash.go 92.7µs ± 0% 92.8µs ± 0% ~ (p=0.397 n=5+4)
neo/go/sqlite-zhash.go+prefetch128 39.8µs ± 8% 40.5µs ± 5% ~ (p=0.548 n=5+5)
neo/go/sqlite-zhash.go(!sha1) 86.4µs ± 2% 86.5µs ± 2% ~ (p=0.571 n=5+5)
neo/go/sqlite-zhash.go+prefetch128(!sha1) 40.1µs ±11% 38.8µs ± 9% ~ (p=0.579 n=5+5)
cluster:deco dataset:prod1-1024
fs1-zhash.py 15.8µs ± 2% 15.8µs ± 3% ~ (p=0.629 n=4+4)
fs1-zhash.go 2.80µs ± 0% 2.80µs ± 0% ~ (all equal)
fs1-zhash.go+prefetch128 3.54µs ± 7% 3.42µs ± 8% ~ (p=0.381 n=5+5)
zeo/py/fs1-zhash.py 362µs ± 6% 361µs ± 5% ~ (p=1.000 n=5+5)
zeo/py/fs1-zhash.go 106µs ± 1% 105µs ± 0% ~ (p=0.214 n=5+5)
zeo/py/fs1-zhash.go+prefetch128 58.9µs ± 1% 58.9µs ± 1% ~ (p=0.881 n=5+5)
neo/py(!log)/sqlite-zhash.py 331µs ± 1% 344µs ± 7% ~ (p=0.063 n=5+5)
neo/py(!log)/sqlite-zhash.go 136µs ± 1% 137µs ± 2% ~ (p=0.222 n=5+5)
neo/py(!log)/sqlite-zhash.go+prefetch128 112µs ± 1% 114µs ± 1% +1.73% (p=0.008 n=5+5)
neo/py(!log)/sql-zhash.py 389µs ± 6% 380µs ± 4% ~ (p=0.486 n=4+4)
neo/py(!log)/sql-zhash.go 180µs ± 2% 180µs ± 1% ~ (p=0.548 n=5+5)
neo/py(!log)/sql-zhash.go+prefetch128 157µs ± 1% 159µs ± 1% ~ (p=0.095 n=5+5)
neo/go/fs1-zhash.py 223µs ± 0% 221µs ± 1% -0.79% (p=0.016 n=5+5)
neo/go/fs1-zhash.go 44.9µs ± 1% 45.2µs ± 2% ~ (p=0.357 n=5+5)
neo/go/fs1-zhash.go+prefetch128 17.6µs ± 5% 17.6µs ± 2% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zhash.go(!sha1) 39.1µs ± 1% 39.1µs ± 2% ~ (p=0.714 n=5+5)
neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 14.8µs ± 3% 14.6µs ± 4% ~ (p=0.302 n=5+5)
neo/go/sqlite-zhash.py 269µs ± 3% 271µs ± 2% ~ (p=0.548 n=5+5)
neo/go/sqlite-zhash.go 86.0µs ± 1% 86.4µs ± 0% ~ (p=0.206 n=5+5)
neo/go/sqlite-zhash.go+prefetch128 36.4µs ± 6% 35.8µs ± 2% ~ (p=0.532 n=5+5)
neo/go/sqlite-zhash.go(!sha1) 83.6µs ± 1% 84.0µs ± 1% ~ (p=0.516 n=5+5)
neo/go/sqlite-zhash.go+prefetch128(!sha1) 35.9µs ± 5% 36.5µs ± 5% ~ (p=0.444 n=5+5)

name old req/s new req/s delta
cluster:deco dataset:wczblk1-8
fs1-zwrk.go·1 438k ± 1% 436k ± 0% ~ (p=0.222 n=5+5)
fs1-zwrk.go·2 745k ± 1% 744k ± 1% ~ (p=0.548 n=5+5)
fs1-zwrk.go·3 1.09M ± 0% 1.09M ± 0% ~ (p=0.095 n=5+5)
fs1-zwrk.go·4 1.15M ± 1% 1.16M ± 1% ~ (p=0.095 n=5+5)
fs1-zwrk.go·8 1.27M ± 1% 1.27M ± 1% ~ (p=0.841 n=5+5)
fs1-zwrk.go·12 1.27M ± 1% 1.27M ± 1% ~ (p=0.690 n=5+5)
fs1-zwrk.go·16 1.28M ± 1% 1.27M ± 1% ~ (p=0.841 n=5+5)
zeo/py/fs1-zwrk.go·1 9.04k ± 1% 9.12k ± 0% +0.89% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·2 11.4k ± 1% 11.6k ± 1% +1.58% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·3 13.4k ± 1% 13.4k ± 1% ~ (p=0.310 n=5+5)
zeo/py/fs1-zwrk.go·4 14.0k ± 1% 14.0k ± 1% ~ (p=0.595 n=5+5)
zeo/py/fs1-zwrk.go·8 14.6k ± 4% 14.7k ± 1% ~ (p=0.690 n=5+5)
zeo/py/fs1-zwrk.go·12 14.9k ± 1% 15.0k ± 1% ~ (p=0.421 n=5+5)
zeo/py/fs1-zwrk.go·16 15.3k ± 1% 15.1k ± 0% -0.79% (p=0.016 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 7.03k ± 3% 7.09k ± 1% ~ (p=0.310 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 8.52k ± 1% 8.48k ± 1% ~ (p=0.151 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 8.48k ± 1% 8.48k ± 1% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 8.45k ± 1% 8.47k ± 1% ~ (p=0.841 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 8.44k ± 1% 8.43k ± 1% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 8.48k ± 1% 8.46k ± 1% ~ (p=0.841 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 8.49k ± 1% 8.46k ± 1% ~ (p=0.310 n=5+5)
neo/py(!log)/sql-zwrk.go·1 5.51k ± 1% 5.51k ± 1% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·2 6.31k ± 1% 6.32k ± 1% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zwrk.go·3 6.20k ± 1% 6.29k ± 1% +1.37% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·4 6.22k ± 1% 6.27k ± 1% +0.83% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·8 6.25k ± 1% 6.27k ± 1% ~ (p=0.548 n=5+5)
neo/py(!log)/sql-zwrk.go·12 6.26k ± 1% 6.29k ± 0% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zwrk.go·16 6.26k ± 1% 6.22k ± 1% ~ (p=0.421 n=5+5)
neo/go/fs1-zwrk.go·1 18.4k ± 0% 18.4k ± 1% ~ (p=0.167 n=5+5)
neo/go/fs1-zwrk.go·2 38.2k ± 1% 38.1k ± 1% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·3 45.8k ± 1% 46.0k ± 1% ~ (p=0.421 n=5+5)
neo/go/fs1-zwrk.go·4 49.8k ± 0% 50.2k ± 1% +0.94% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·8 60.3k ± 1% 61.0k ± 0% +1.16% (p=0.016 n=5+5)
neo/go/fs1-zwrk.go·12 61.6k ± 1% 62.1k ± 1% ~ (p=0.222 n=5+5)
neo/go/fs1-zwrk.go·16 61.4k ± 1% 62.5k ± 1% ~ (p=0.095 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 26.1k ± 1% 26.3k ± 1% ~ (p=0.222 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 55.3k ± 1% 55.3k ± 1% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 62.7k ± 1% 62.7k ± 1% ~ (p=0.841 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 69.1k ± 0% 69.3k ± 1% ~ (p=0.421 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 87.9k ± 0% 88.2k ± 0% ~ (p=0.310 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 92.2k ± 1% 93.4k ± 0% +1.32% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 93.4k ± 1% 93.5k ± 2% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go·1 11.1k ± 0% 11.0k ± 1% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go·2 18.5k ± 0% 18.4k ± 1% -0.68% (p=0.016 n=5+5)
neo/go/sqlite-zwrk.go·3 24.5k ± 0% 24.4k ± 1% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go·4 26.9k ± 1% 26.8k ± 0% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go·8 29.9k ± 2% 30.4k ± 2% ~ (p=0.310 n=5+5)
neo/go/sqlite-zwrk.go·12 29.2k ± 2% 30.5k ± 1% +4.49% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·16 28.4k ± 2% 29.9k ± 2% +5.53% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 11.8k ± 0% 11.9k ± 1% ~ (p=0.063 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 19.5k ± 0% 19.7k ± 0% +0.60% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 26.8k ± 1% 26.5k ± 1% -1.14% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 30.3k ± 1% 30.0k ± 0% -1.12% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 32.0k ± 2% 31.2k ± 2% -2.46% (p=0.032 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 30.2k ± 3% 28.9k ± 1% -4.20% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 29.7k ± 1% 28.4k ± 2% -4.27% (p=0.008 n=5+5)
cluster:deco dataset:prod1-1024
fs1-zwrk.go·1 555k ± 0% 555k ± 0% ~ (p=1.000 n=5+5)
fs1-zwrk.go·2 982k ± 2% 1008k ± 3% +2.66% (p=0.032 n=5+5)
fs1-zwrk.go·3 1.32M ± 1% 1.32M ± 1% ~ (p=0.421 n=5+5)
fs1-zwrk.go·4 1.51M ± 1% 1.55M ± 2% +2.80% (p=0.032 n=5+5)
fs1-zwrk.go·8 1.58M ± 1% 1.59M ± 0% ~ (p=0.548 n=5+5)
fs1-zwrk.go·12 1.59M ± 0% 1.59M ± 0% ~ (p=0.548 n=5+5)
fs1-zwrk.go·16 1.59M ± 0% 1.59M ± 0% ~ (p=0.095 n=5+5)
zeo/py/fs1-zwrk.go·1 9.70k ± 1% 9.70k ± 0% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·2 12.2k ± 1% 12.4k ± 1% +1.67% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·3 14.2k ± 1% 14.2k ± 1% ~ (p=0.095 n=5+5)
zeo/py/fs1-zwrk.go·4 14.9k ± 0% 14.9k ± 0% ~ (p=0.841 n=5+5)
zeo/py/fs1-zwrk.go·8 15.6k ± 0% 15.6k ± 0% ~ (p=0.548 n=5+5)
zeo/py/fs1-zwrk.go·12 15.9k ± 1% 15.2k ±11% ~ (p=0.310 n=5+5)
zeo/py/fs1-zwrk.go·16 16.1k ± 0% 16.1k ± 1% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 7.51k ± 1% 7.44k ± 1% -0.91% (p=0.016 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 8.72k ± 1% 8.59k ± 1% -1.45% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 8.69k ± 1% 8.61k ± 1% ~ (p=0.095 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 8.67k ± 1% 8.57k ± 1% ~ (p=0.095 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 8.72k ± 0% 8.56k ± 1% -1.83% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 8.63k ± 1% 8.51k ± 1% ~ (p=0.056 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 8.64k ± 1% 8.54k ± 1% ~ (p=0.095 n=5+5)
neo/py(!log)/sql-zwrk.go·1 5.56k ± 2% 5.55k ± 2% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·2 6.42k ± 0% 6.36k ± 1% -0.97% (p=0.032 n=5+5)
neo/py(!log)/sql-zwrk.go·3 6.40k ± 0% 6.31k ± 0% -1.44% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·4 6.38k ± 1% 6.28k ± 0% -1.57% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·8 6.39k ± 1% 6.34k ± 1% ~ (p=0.056 n=5+5)
neo/py(!log)/sql-zwrk.go·12 6.42k ± 1% 6.35k ± 1% -1.11% (p=0.016 n=5+5)
neo/py(!log)/sql-zwrk.go·16 6.41k ± 2% 6.36k ± 0% ~ (p=0.151 n=5+5)
neo/go/fs1-zwrk.go·1 23.8k ± 0% 23.7k ± 0% -0.33% (p=0.032 n=5+5)
neo/go/fs1-zwrk.go·2 45.0k ± 1% 45.4k ± 0% +0.93% (p=0.032 n=5+5)
neo/go/fs1-zwrk.go·3 55.1k ± 1% 55.2k ± 1% ~ (p=1.000 n=5+5)
neo/go/fs1-zwrk.go·4 60.1k ± 0% 60.7k ± 2% ~ (p=0.151 n=5+5)
neo/go/fs1-zwrk.go·8 68.3k ± 2% 70.9k ± 2% +3.72% (p=0.016 n=5+5)
neo/go/fs1-zwrk.go·12 69.3k ± 5% 71.1k ± 3% ~ (p=0.310 n=5+5)
neo/go/fs1-zwrk.go·16 68.8k ± 6% 71.0k ± 3% ~ (p=0.690 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 27.3k ± 0% 27.3k ± 0% ~ (p=0.095 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 54.9k ± 1% 55.4k ± 1% ~ (p=0.095 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 64.0k ± 0% 64.0k ± 1% ~ (p=0.841 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 68.7k ± 1% 69.0k ± 1% ~ (p=0.222 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 79.4k ± 2% 80.9k ± 2% ~ (p=0.222 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 77.9k ± 2% 78.3k ± 5% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 75.3k ± 6% 75.4k ± 3% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go·1 11.8k ± 0% 11.7k ± 1% ~ (p=0.095 n=5+5)
neo/go/sqlite-zwrk.go·2 19.2k ± 0% 19.0k ± 0% -0.85% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·3 24.5k ± 1% 24.5k ± 1% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go·4 26.6k ± 1% 26.3k ± 1% -1.38% (p=0.016 n=5+5)
neo/go/sqlite-zwrk.go·8 25.1k ± 3% 24.9k ± 3% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go·12 23.8k ± 2% 24.0k ± 5% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go·16 24.3k ± 2% 25.4k ± 1% +4.53% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 12.1k ± 1% 12.2k ± 0% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 19.6k ± 0% 19.8k ± 0% +0.98% (p=0.016 n=4+5)
neo/go/sqlite-zwrk.go(!sha1)·3 25.3k ± 1% 26.2k ± 1% +3.40% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 27.3k ± 1% 28.7k ± 1% +5.03% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 25.4k ± 3% 27.2k ± 3% +6.78% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 23.8k ± 2% 25.3k ± 2% +6.21% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 23.9k ± 2% 25.3k ± 1% +6.14% (p=0.008 n=5+5)

name old latency-time/object new latency-time/object delta
cluster:deco dataset:wczblk1-8
fs1-zwrk.go·1 2.29µs ± 1% 2.29µs ± 0% ~ (p=0.222 n=5+5)
fs1-zwrk.go·2 2.68µs ± 1% 2.69µs ± 1% ~ (p=0.524 n=5+5)
fs1-zwrk.go·3 2.76µs ± 0% 2.76µs ± 0% ~ (p=0.111 n=5+5)
fs1-zwrk.go·4 3.46µs ± 1% 3.44µs ± 1% ~ (p=0.095 n=5+5)
fs1-zwrk.go·8 6.28µs ± 1% 6.28µs ± 1% ~ (p=0.889 n=5+5)
fs1-zwrk.go·12 9.42µs ± 1% 9.46µs ± 1% ~ (p=0.690 n=5+5)
fs1-zwrk.go·16 12.5µs ± 1% 12.6µs ± 1% ~ (p=0.841 n=5+5)
zeo/py/fs1-zwrk.go·1 111µs ± 1% 110µs ± 0% -0.88% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·2 176µs ± 1% 173µs ± 1% -1.56% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·3 224µs ± 1% 224µs ± 1% ~ (p=0.310 n=5+5)
zeo/py/fs1-zwrk.go·4 285µs ± 1% 286µs ± 1% ~ (p=0.690 n=5+5)
zeo/py/fs1-zwrk.go·8 549µs ± 4% 545µs ± 1% ~ (p=0.690 n=5+5)
zeo/py/fs1-zwrk.go·12 805µs ± 1% 802µs ± 1% ~ (p=0.421 n=5+5)
zeo/py/fs1-zwrk.go·16 1.05ms ± 1% 1.06ms ± 0% +0.80% (p=0.016 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 142µs ± 3% 141µs ± 1% ~ (p=0.310 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 235µs ± 1% 236µs ± 1% ~ (p=0.151 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 354µs ± 1% 354µs ± 1% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 473µs ± 1% 472µs ± 1% ~ (p=0.841 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 948µs ± 1% 949µs ± 1% ~ (p=0.690 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 1.42ms ± 1% 1.42ms ± 1% ~ (p=0.841 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 1.88ms ± 1% 1.89ms ± 1% ~ (p=0.310 n=5+5)
neo/py(!log)/sql-zwrk.go·1 181µs ± 1% 181µs ± 1% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·2 317µs ± 1% 317µs ± 1% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zwrk.go·3 484µs ± 1% 477µs ± 1% -1.36% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·4 643µs ± 1% 638µs ± 1% -0.82% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·8 1.28ms ± 1% 1.28ms ± 1% ~ (p=0.548 n=5+5)
neo/py(!log)/sql-zwrk.go·12 1.92ms ± 1% 1.91ms ± 0% ~ (p=0.841 n=5+5)
neo/py(!log)/sql-zwrk.go·16 2.56ms ± 1% 2.57ms ± 1% ~ (p=0.421 n=5+5)
neo/go/fs1-zwrk.go·1 54.5µs ± 0% 54.2µs ± 1% ~ (p=0.167 n=5+5)
neo/go/fs1-zwrk.go·2 52.4µs ± 1% 52.5µs ± 1% ~ (p=0.841 n=5+5)
neo/go/fs1-zwrk.go·3 65.4µs ± 1% 65.3µs ± 1% ~ (p=0.421 n=5+5)
neo/go/fs1-zwrk.go·4 80.4µs ± 0% 79.6µs ± 1% -0.93% (p=0.008 n=5+5)
neo/go/fs1-zwrk.go·8 133µs ± 1% 131µs ± 0% -1.15% (p=0.016 n=5+5)
neo/go/fs1-zwrk.go·12 195µs ± 1% 193µs ± 1% ~ (p=0.222 n=5+5)
neo/go/fs1-zwrk.go·16 261µs ± 1% 256µs ± 1% ~ (p=0.095 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 38.3µs ± 1% 38.0µs ± 1% ~ (p=0.222 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 36.2µs ± 1% 36.1µs ± 1% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 47.8µs ± 1% 47.8µs ± 1% ~ (p=0.841 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 57.9µs ± 0% 57.7µs ± 1% ~ (p=0.421 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 91.0µs ± 0% 90.7µs ± 0% ~ (p=0.310 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 130µs ± 1% 129µs ± 0% -1.31% (p=0.008 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 171µs ± 1% 171µs ± 2% ~ (p=0.690 n=5+5)
neo/go/sqlite-zwrk.go·1 90.4µs ± 0% 90.7µs ± 1% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go·2 108µs ± 0% 109µs ± 1% +0.69% (p=0.016 n=5+5)
neo/go/sqlite-zwrk.go·3 123µs ± 0% 123µs ± 1% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go·4 148µs ± 1% 149µs ± 0% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go·8 267µs ± 2% 263µs ± 2% ~ (p=0.310 n=5+5)
neo/go/sqlite-zwrk.go·12 411µs ± 2% 393µs ± 1% -4.31% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·16 564µs ± 2% 534µs ± 2% -5.24% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 84.5µs ± 0% 84.0µs ± 1% ~ (p=0.063 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 102µs ± 0% 102µs ± 0% -0.60% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·3 112µs ± 1% 113µs ± 1% +1.16% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 132µs ± 1% 133µs ± 0% +1.13% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 250µs ± 2% 257µs ± 2% +2.52% (p=0.032 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 397µs ± 3% 415µs ± 1% +4.38% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 539µs ± 1% 563µs ± 2% +4.47% (p=0.008 n=5+5)
cluster:deco dataset:prod1-1024
fs1-zwrk.go·1 1.80µs ± 0% 1.80µs ± 0% ~ (p=0.968 n=5+5)
fs1-zwrk.go·2 2.04µs ± 2% 1.98µs ± 3% -2.55% (p=0.032 n=5+5)
fs1-zwrk.go·3 2.28µs ± 1% 2.27µs ± 1% ~ (p=0.389 n=5+5)
fs1-zwrk.go·4 2.65µs ± 1% 2.58µs ± 2% -2.71% (p=0.032 n=5+5)
fs1-zwrk.go·8 5.05µs ± 1% 5.04µs ± 0% ~ (p=0.548 n=5+5)
fs1-zwrk.go·12 7.54µs ± 0% 7.55µs ± 0% ~ (p=0.571 n=5+5)
fs1-zwrk.go·16 10.1µs ± 0% 10.0µs ± 0% ~ (p=0.095 n=5+5)
zeo/py/fs1-zwrk.go·1 103µs ± 1% 103µs ± 0% ~ (p=1.000 n=5+5)
zeo/py/fs1-zwrk.go·2 164µs ± 1% 162µs ± 1% -1.64% (p=0.008 n=5+5)
zeo/py/fs1-zwrk.go·3 211µs ± 1% 212µs ± 1% ~ (p=0.095 n=5+5)
zeo/py/fs1-zwrk.go·4 269µs ± 0% 269µs ± 0% ~ (p=0.841 n=5+5)
zeo/py/fs1-zwrk.go·8 512µs ± 0% 512µs ± 0% ~ (p=0.548 n=5+5)
zeo/py/fs1-zwrk.go·12 755µs ± 1% 793µs ±12% ~ (p=0.310 n=5+5)
zeo/py/fs1-zwrk.go·16 993µs ± 0% 991µs ± 1% ~ (p=0.421 n=5+5)
neo/py(!log)/sqlite-zwrk.go·1 133µs ± 1% 134µs ± 1% +0.92% (p=0.016 n=5+5)
neo/py(!log)/sqlite-zwrk.go·2 229µs ± 1% 233µs ± 1% +1.47% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·3 345µs ± 1% 348µs ± 1% ~ (p=0.095 n=5+5)
neo/py(!log)/sqlite-zwrk.go·4 461µs ± 1% 467µs ± 1% ~ (p=0.095 n=5+5)
neo/py(!log)/sqlite-zwrk.go·8 917µs ± 0% 935µs ± 1% +1.87% (p=0.008 n=5+5)
neo/py(!log)/sqlite-zwrk.go·12 1.39ms ± 1% 1.41ms ± 1% ~ (p=0.056 n=5+5)
neo/py(!log)/sqlite-zwrk.go·16 1.85ms ± 1% 1.87ms ± 1% ~ (p=0.095 n=5+5)
neo/py(!log)/sql-zwrk.go·1 180µs ± 2% 180µs ± 2% ~ (p=1.000 n=5+5)
neo/py(!log)/sql-zwrk.go·2 311µs ± 0% 315µs ± 1% +0.99% (p=0.032 n=5+5)
neo/py(!log)/sql-zwrk.go·3 468µs ± 0% 475µs ± 0% +1.47% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·4 627µs ± 1% 637µs ± 0% +1.59% (p=0.008 n=5+5)
neo/py(!log)/sql-zwrk.go·8 1.25ms ± 1% 1.26ms ± 1% ~ (p=0.056 n=5+5)
neo/py(!log)/sql-zwrk.go·12 1.87ms ± 1% 1.89ms ± 1% +1.13% (p=0.016 n=5+5)
neo/py(!log)/sql-zwrk.go·16 2.50ms ± 2% 2.52ms ± 0% ~ (p=0.151 n=5+5)
neo/go/fs1-zwrk.go·1 42.0µs ± 0% 42.2µs ± 0% +0.33% (p=0.032 n=5+5)
neo/go/fs1-zwrk.go·2 44.5µs ± 1% 44.1µs ± 0% -0.92% (p=0.032 n=5+5)
neo/go/fs1-zwrk.go·3 54.5µs ± 1% 54.4µs ± 1% ~ (p=1.000 n=5+5)
neo/go/fs1-zwrk.go·4 66.5µs ± 0% 65.9µs ± 2% ~ (p=0.151 n=5+5)
neo/go/fs1-zwrk.go·8 117µs ± 2% 113µs ± 2% -3.59% (p=0.016 n=5+5)
neo/go/fs1-zwrk.go·12 173µs ± 4% 169µs ± 4% ~ (p=0.310 n=5+5)
neo/go/fs1-zwrk.go·16 233µs ± 6% 225µs ± 3% ~ (p=0.690 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 36.7µs ± 0% 36.6µs ± 0% ~ (p=0.095 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 36.4µs ± 1% 36.1µs ± 1% ~ (p=0.095 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 46.9µs ± 0% 46.9µs ± 1% ~ (p=0.841 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 58.2µs ± 1% 57.9µs ± 1% ~ (p=0.222 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 101µs ± 2% 99µs ± 2% ~ (p=0.222 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 154µs ± 2% 153µs ± 5% ~ (p=1.000 n=5+5)
neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 213µs ± 6% 212µs ± 3% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go·1 84.7µs ± 0% 85.1µs ± 1% ~ (p=0.095 n=5+5)
neo/go/sqlite-zwrk.go·2 104µs ± 0% 105µs ± 0% +0.86% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go·3 123µs ± 1% 123µs ± 1% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go·4 150µs ± 1% 152µs ± 1% +1.40% (p=0.016 n=5+5)
neo/go/sqlite-zwrk.go·8 319µs ± 3% 321µs ± 3% ~ (p=0.421 n=5+5)
neo/go/sqlite-zwrk.go·12 504µs ± 2% 500µs ± 5% ~ (p=1.000 n=5+5)
neo/go/sqlite-zwrk.go·16 659µs ± 2% 630µs ± 1% -4.34% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·1 82.5µs ± 1% 82.0µs ± 0% ~ (p=0.151 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·2 102µs ± 0% 101µs ± 0% -0.97% (p=0.016 n=4+5)
neo/go/sqlite-zwrk.go(!sha1)·3 119µs ± 1% 115µs ± 1% -3.29% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·4 146µs ± 1% 139µs ± 1% -4.78% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·8 315µs ± 3% 295µs ± 3% -6.37% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·12 503µs ± 2% 474µs ± 2% -5.86% (p=0.008 n=5+5)
neo/go/sqlite-zwrk.go(!sha1)·16 671µs ± 2% 632µs ± 1% -5.79% (p=0.008 n=5+5)

dabeb4b8

X z6001 localhost timings after switch to zwrk + stabilizing benchmark format. · 6a5c1f93
Kirill Smelkov authored Mar 06, 2018

6a5c1f93