-
Kirill Smelkov authoredCompared to zwrk@1 it helps, but only a tiny bit, and the timings are still noisy: ---- 8< ---- cluster:z6001 dataset:wczblk1-8 neo/py(!log)/sql-zwrk.go·8 2.21ms ±11% 2.00ms ± 7% -9.61% (p=0.032 n=5+5) neo/py(!log)/sql-zwrk.go·12 3.31ms ± 6% 2.94ms ± 3% -11.20% (p=0.008 n=5+5) cluster:z6001 dataset:prod1-1024 zeo/py/fs1-zwrk.go·1 204µs ± 6% 186µs ± 4% -9.09% (p=0.008 n=5+5) neo/py(!log)/sql-zwrk.go·3 818µs ± 8% 754µs ±10% -7.83% (p=0.032 n=5+5) neo/go/fs1-zwrk.go·16 178µs ± 1% 158µs ± 3% -11.35% (p=0.008 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 164µs ± 2% 146µs ± 1% -11.22% (p=0.008 n=5+5) ---- 8< ---- The help is much less compared to the signidican speedup with Cstates disabled (65de70b8). The next commit will add remeasurements with C-states disabled. ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ $ benchstat -split node,cluster,dataset 20180308-z6001-ffixed-c-zwrk1s.txt 20180308-z6001-ffixed-c-zwrk10s.txt name old pystone/s new pystone/s delta node:z6001 pystone 114k ± 1% 114k ± 1% ~ (p=0.690 n=5+5) name old time/op new time/op delta node:z6001 crc32/py/4K 5.10µs ± 0% 5.10µs ± 0% ~ (p=0.587 n=5+5) crc32/go/4K 1.72µs ± 0% 1.77µs ± 8% ~ (p=0.381 n=4+5) sha1/py/4K 14.6µs ± 0% 14.6µs ± 0% ~ (p=0.556 n=5+4) sha1/go/4K 10.3µs ± 0% 10.3µs ± 0% ~ (p=0.714 n=5+4) unzlib/py/wczdata 36.2µs ± 1% 36.4µs ± 1% ~ (p=0.548 n=5+5) unzlib/go/wczdata 31.5µs ± 0% 31.5µs ± 0% ~ (p=0.310 n=5+5) unzlib/py/prod1-avg 18.2µs ± 1% 18.4µs ± 3% ~ (p=0.222 n=5+5) unzlib/go/prod1-avg 10.0µs ± 2% 10.0µs ± 1% ~ (p=0.548 n=5+5) disk/randread/direct/4K-min 129µs ± 4% 133µs ± 6% ~ (p=0.841 n=5+5) disk/randread/direct/4K-avg 201µs ± 7% 201µs ± 6% ~ (p=0.794 n=5+5) disk/randread/pagecache/4K-min 793ns ± 2% 797ns ± 2% ~ (p=0.548 n=5+5) disk/randread/pagecache/4K-avg 1.41µs ± 4% 1.40µs ± 7% ~ (p=0.881 n=5+5) name old time/object new time/object delta cluster:z6001 dataset:wczblk1-8 fs1-zhash.py 37.5µs ± 1% 37.4µs ± 2% ~ (p=0.897 n=5+5) fs1-zhash.go 5.90µs ± 0% 6.04µs ± 1% +2.37% (p=0.008 n=5+5) fs1-zhash.go+prefetch128 8.10µs ± 5% 8.35µs ± 2% ~ (p=0.286 n=5+4) zeo/py/fs1-zhash.py 661µs ± 8% 675µs ± 5% ~ (p=0.841 n=5+5) zeo/py/fs1-zhash.go 267µs ± 8% 267µs ± 7% ~ (p=1.000 n=5+5) zeo/py/fs1-zhash.go+prefetch128 102µs ± 1% 101µs ± 2% ~ (p=0.397 n=5+5) neo/py(!log)/sqlite-zhash.py 692µs ± 4% 673µs ± 8% ~ (p=0.310 n=5+5) neo/py(!log)/sqlite-zhash.go 309µs ±15% 291µs ±11% ~ (p=0.310 n=5+5) neo/py(!log)/sqlite-zhash.go+prefetch128 176µs ± 1% 176µs ± 1% ~ (p=0.548 n=5+5) neo/py(!log)/sql-zhash.py 992µs ±31% 958µs ±28% ~ (p=0.841 n=5+5) neo/py(!log)/sql-zhash.go 377µs ±16% 441µs ± 6% +16.96% (p=0.016 n=5+5) neo/py(!log)/sql-zhash.go+prefetch128 268µs ±12% 269µs ±15% ~ (p=1.000 n=5+5) neo/go/fs1-zhash.py 482µs ±20% 509µs ±15% ~ (p=0.548 n=5+5) neo/go/fs1-zhash.go 102µs ± 9% 106µs ± 8% ~ (p=0.310 n=5+5) neo/go/fs1-zhash.go+prefetch128 37.2µs ± 2% 37.1µs ± 6% ~ (p=1.000 n=5+5) neo/go/fs1(!sha1)-zhash.go(!sha1) 73.1µs ±12% 76.2µs ± 8% ~ (p=0.421 n=5+5) neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 26.9µs ± 7% 26.0µs ± 2% ~ (p=0.198 n=5+5) neo/go/sqlite-zhash.py 525µs ±10% 531µs ± 9% ~ (p=1.000 n=5+5) neo/go/sqlite-zhash.go 193µs ±16% 200µs ±13% ~ (p=0.548 n=5+5) neo/go/sqlite-zhash.go+prefetch128 39.6µs ± 4% 39.9µs ± 2% ~ (p=0.690 n=5+5) neo/go/sqlite-zhash.go(!sha1) 195µs ±25% 185µs ±14% ~ (p=0.690 n=5+5) neo/go/sqlite-zhash.go+prefetch128(!sha1) 36.7µs ± 3% 37.2µs ± 6% ~ (p=0.452 n=5+5) cluster:z6001 dataset:prod1-1024 fs1-zhash.py 30.3µs ± 2% 30.2µs ± 2% ~ (p=0.738 n=5+5) fs1-zhash.go 4.56µs ± 1% 4.60µs ± 0% ~ (p=0.444 n=5+5) fs1-zhash.go+prefetch128 5.96µs ± 9% 5.70µs ± 7% ~ (p=0.397 n=5+5) zeo/py/fs1-zhash.py 615µs ±13% 646µs ± 3% ~ (p=0.222 n=5+5) zeo/py/fs1-zhash.go 235µs ± 6% 233µs ± 3% ~ (p=1.000 n=5+5) zeo/py/fs1-zhash.go+prefetch128 87.6µs ± 1% 87.5µs ± 3% ~ (p=0.802 n=5+5) neo/py(!log)/sqlite-zhash.py 658µs ± 5% 653µs ± 7% ~ (p=1.000 n=5+5) neo/py(!log)/sqlite-zhash.go 256µs ± 8% 261µs ± 6% ~ (p=0.421 n=5+5) neo/py(!log)/sqlite-zhash.go+prefetch128 161µs ± 0% 161µs ± 2% ~ (p=0.659 n=5+5) neo/py(!log)/sql-zhash.py 1.02ms ±33% 0.96ms ±38% ~ (p=0.310 n=5+5) neo/py(!log)/sql-zhash.go 385µs ± 8% 363µs ±12% ~ (p=0.222 n=5+5) neo/py(!log)/sql-zhash.go+prefetch128 263µs ±11% 262µs ±11% ~ (p=0.690 n=5+5) neo/go/fs1-zhash.py 461µs ±16% 490µs ± 8% ~ (p=0.421 n=5+5) neo/go/fs1-zhash.go 82.9µs ± 5% 81.4µs ± 5% ~ (p=0.341 n=5+5) neo/go/fs1-zhash.go+prefetch128 23.9µs ± 3% 23.9µs ± 2% ~ (p=0.810 n=5+5) neo/go/fs1(!sha1)-zhash.go(!sha1) 69.7µs ±11% 70.5µs ± 6% ~ (p=0.548 n=5+5) neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 21.0µs ± 2% 21.0µs ± 2% ~ (p=0.762 n=5+5) neo/go/sqlite-zhash.py 541µs ± 9% 521µs ± 6% ~ (p=0.310 n=5+5) neo/go/sqlite-zhash.go 181µs ±13% 168µs ±10% ~ (p=0.310 n=5+5) neo/go/sqlite-zhash.go+prefetch128 35.5µs ± 2% 35.1µs ± 3% ~ (p=0.452 n=5+5) neo/go/sqlite-zhash.go(!sha1) 162µs ±14% 167µs ±14% ~ (p=0.548 n=5+5) neo/go/sqlite-zhash.go+prefetch128(!sha1) 35.3µs ± 1% 35.0µs ± 2% ~ (p=0.794 n=5+5) name old req/s new req/s delta cluster:z6001 dataset:wczblk1-8 fs1-zwrk.go·1 228k ± 3% 229k ± 2% ~ (p=0.841 n=5+5) fs1-zwrk.go·2 444k ± 1% 438k ± 0% -1.35% (p=0.016 n=5+5) fs1-zwrk.go·3 660k ± 3% 665k ± 1% ~ (p=1.000 n=5+5) fs1-zwrk.go·4 882k ± 1% 868k ± 1% -1.54% (p=0.016 n=5+5) fs1-zwrk.go·8 1.75M ± 2% 1.75M ± 1% ~ (p=1.000 n=5+5) fs1-zwrk.go·12 2.50M ± 3% 2.57M ± 1% +2.64% (p=0.032 n=5+5) fs1-zwrk.go·16 2.88M ± 1% 2.90M ± 1% ~ (p=0.151 n=5+5) zeo/py/fs1-zwrk.go·1 4.44k ± 6% 4.61k ± 3% ~ (p=0.095 n=5+5) zeo/py/fs1-zwrk.go·2 6.32k ± 0% 6.31k ± 2% ~ (p=0.690 n=5+5) zeo/py/fs1-zwrk.go·3 6.89k ± 0% 6.98k ± 2% ~ (p=0.135 n=5+5) zeo/py/fs1-zwrk.go·4 7.15k ± 1% 7.11k ± 3% ~ (p=1.000 n=5+5) zeo/py/fs1-zwrk.go·8 7.46k ± 2% 7.41k ± 4% ~ (p=0.690 n=5+5) zeo/py/fs1-zwrk.go·12 7.55k ± 1% 7.63k ± 1% ~ (p=0.063 n=5+5) zeo/py/fs1-zwrk.go·16 7.55k ± 1% 7.65k ± 3% ~ (p=0.310 n=5+5) neo/py(!log)/sqlite-zwrk.go·1 3.74k ±12% 3.27k ± 6% ~ (p=0.056 n=5+5) neo/py(!log)/sqlite-zwrk.go·2 5.59k ± 1% 5.64k ± 2% ~ (p=0.222 n=5+5) neo/py(!log)/sqlite-zwrk.go·3 5.58k ± 1% 5.57k ± 3% ~ (p=0.310 n=5+5) neo/py(!log)/sqlite-zwrk.go·4 5.54k ± 1% 5.59k ± 3% ~ (p=0.310 n=5+5) neo/py(!log)/sqlite-zwrk.go·8 5.65k ± 0% 5.63k ± 2% ~ (p=0.222 n=5+5) neo/py(!log)/sqlite-zwrk.go·12 5.59k ± 0% 5.57k ± 3% ~ (p=0.421 n=5+5) neo/py(!log)/sqlite-zwrk.go·16 5.58k ± 1% 5.63k ± 2% ~ (p=0.151 n=5+5) neo/py(!log)/sql-zwrk.go·1 2.61k ± 5% 2.55k ±11% ~ (p=0.690 n=5+5) neo/py(!log)/sql-zwrk.go·2 3.88k ±11% 3.89k ± 5% ~ (p=0.841 n=5+5) neo/py(!log)/sql-zwrk.go·3 3.80k ±12% 4.05k ± 3% ~ (p=0.421 n=5+5) neo/py(!log)/sql-zwrk.go·4 3.85k ± 5% 3.93k ± 6% ~ (p=0.690 n=5+5) neo/py(!log)/sql-zwrk.go·8 3.64k ±12% 4.02k ± 7% +10.28% (p=0.032 n=5+5) neo/py(!log)/sql-zwrk.go·12 3.62k ± 6% 4.08k ± 3% +12.51% (p=0.008 n=5+5) neo/py(!log)/sql-zwrk.go·16 3.92k ±13% 3.98k ±10% ~ (p=0.841 n=5+5) neo/go/fs1-zwrk.go·1 10.6k ± 5% 10.6k ± 2% ~ (p=0.841 n=5+5) neo/go/fs1-zwrk.go·2 22.4k ± 1% 22.4k ± 0% ~ (p=0.310 n=5+5) neo/go/fs1-zwrk.go·3 31.9k ± 1% 31.8k ± 0% ~ (p=0.095 n=5+5) neo/go/fs1-zwrk.go·4 43.2k ± 0% 43.1k ± 0% ~ (p=0.310 n=5+5) neo/go/fs1-zwrk.go·8 78.2k ± 0% 78.1k ± 0% ~ (p=0.548 n=5+5) neo/go/fs1-zwrk.go·12 92.3k ± 0% 92.4k ± 0% ~ (p=0.151 n=5+5) neo/go/fs1-zwrk.go·16 102k ± 1% 102k ± 0% ~ (p=0.690 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 15.0k ± 4% 15.2k ± 1% ~ (p=0.310 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 31.4k ± 1% 31.4k ± 0% ~ (p=1.000 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 43.9k ± 0% 43.8k ± 0% ~ (p=0.421 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 57.6k ± 0% 57.6k ± 0% ~ (p=0.635 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 100k ± 0% 100k ± 0% -0.33% (p=0.032 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 116k ± 0% 116k ± 0% -0.44% (p=0.032 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 126k ± 0% 126k ± 0% -0.28% (p=0.032 n=5+5) neo/go/sqlite-zwrk.go·1 5.06k ± 8% 4.92k ± 3% ~ (p=0.421 n=5+5) neo/go/sqlite-zwrk.go·2 11.9k ± 2% 12.0k ± 0% ~ (p=0.421 n=5+5) neo/go/sqlite-zwrk.go·3 19.0k ± 1% 18.9k ± 0% ~ (p=0.421 n=5+5) neo/go/sqlite-zwrk.go·4 24.6k ± 1% 24.6k ± 0% ~ (p=0.690 n=5+5) neo/go/sqlite-zwrk.go·8 44.8k ± 0% 44.3k ± 1% -1.06% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go·12 56.3k ± 0% 55.5k ± 1% -1.29% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go·16 58.2k ± 0% 58.0k ± 0% ~ (p=0.056 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·1 5.71k ± 8% 5.62k ± 1% ~ (p=0.794 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·2 13.2k ± 3% 13.1k ± 1% ~ (p=0.690 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·3 20.4k ± 1% 20.2k ± 0% -0.96% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·4 27.1k ± 1% 26.9k ± 0% -1.07% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·8 48.3k ± 0% 47.7k ± 1% -1.13% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·12 60.2k ± 0% 59.7k ± 1% -0.85% (p=0.032 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·16 61.7k ± 0% 62.8k ± 0% +1.77% (p=0.008 n=5+5) cluster:z6001 dataset:prod1-1024 fs1-zwrk.go·1 347k ± 2% 349k ± 0% ~ (p=0.690 n=5+5) fs1-zwrk.go·2 662k ± 1% 659k ± 2% ~ (p=0.841 n=5+5) fs1-zwrk.go·3 982k ± 1% 990k ± 3% ~ (p=0.548 n=5+5) fs1-zwrk.go·4 1.30M ± 2% 1.31M ± 1% ~ (p=0.310 n=5+5) fs1-zwrk.go·8 2.56M ± 2% 2.52M ± 1% -1.81% (p=0.032 n=5+5) fs1-zwrk.go·12 2.83M ± 1% 2.81M ± 1% ~ (p=1.000 n=5+5) fs1-zwrk.go·16 2.82M ± 1% 2.86M ± 0% +1.58% (p=0.016 n=5+4) zeo/py/fs1-zwrk.go·1 4.90k ± 6% 5.39k ± 4% +9.97% (p=0.008 n=5+5) zeo/py/fs1-zwrk.go·2 8.11k ± 0% 8.20k ± 1% +1.11% (p=0.008 n=5+5) zeo/py/fs1-zwrk.go·3 9.07k ± 2% 8.93k ± 2% ~ (p=0.310 n=5+5) zeo/py/fs1-zwrk.go·4 9.36k ± 0% 9.34k ± 4% ~ (p=0.690 n=5+5) zeo/py/fs1-zwrk.go·8 10.0k ± 2% 9.9k ± 3% ~ (p=0.548 n=5+5) zeo/py/fs1-zwrk.go·12 10.2k ± 2% 9.4k ±16% ~ (p=1.000 n=4+5) zeo/py/fs1-zwrk.go·16 10.3k ± 2% 10.1k ± 4% ~ (p=0.151 n=5+5) neo/py(!log)/sqlite-zwrk.go·1 3.80k ±13% 3.67k ± 4% ~ (p=0.690 n=5+5) neo/py(!log)/sqlite-zwrk.go·2 5.80k ± 0% 5.82k ± 0% ~ (p=0.151 n=5+5) neo/py(!log)/sqlite-zwrk.go·3 5.57k ± 8% 5.78k ± 0% ~ (p=0.690 n=5+5) neo/py(!log)/sqlite-zwrk.go·4 5.80k ± 0% 5.67k ± 3% -2.26% (p=0.016 n=5+5) neo/py(!log)/sqlite-zwrk.go·8 5.78k ± 2% 5.80k ± 2% ~ (p=0.548 n=5+5) neo/py(!log)/sqlite-zwrk.go·12 5.77k ± 0% 5.85k ± 2% ~ (p=0.151 n=5+5) neo/py(!log)/sqlite-zwrk.go·16 5.80k ± 0% 5.78k ± 3% ~ (p=0.690 n=5+5) neo/py(!log)/sql-zwrk.go·1 2.74k ±24% 2.75k ±10% ~ (p=0.548 n=5+5) neo/py(!log)/sql-zwrk.go·2 3.69k ± 8% 3.83k ± 5% ~ (p=0.421 n=5+5) neo/py(!log)/sql-zwrk.go·3 3.68k ± 8% 3.99k ± 9% +8.34% (p=0.032 n=5+5) neo/py(!log)/sql-zwrk.go·4 3.80k ±10% 4.11k ±10% ~ (p=0.095 n=5+5) neo/py(!log)/sql-zwrk.go·8 3.94k ±12% 4.18k ± 2% ~ (p=0.310 n=5+5) neo/py(!log)/sql-zwrk.go·12 4.04k ±12% 4.07k ± 9% ~ (p=0.841 n=5+5) neo/py(!log)/sql-zwrk.go·16 3.82k ±10% 3.90k ± 8% ~ (p=0.690 n=5+5) neo/go/fs1-zwrk.go·1 13.7k ± 4% 13.7k ± 0% ~ (p=0.690 n=5+5) neo/go/fs1-zwrk.go·2 28.0k ± 0% 28.0k ± 0% ~ (p=0.151 n=5+5) neo/go/fs1-zwrk.go·3 40.2k ± 0% 40.3k ± 0% ~ (p=0.548 n=5+5) neo/go/fs1-zwrk.go·4 52.8k ± 0% 52.8k ± 0% ~ (p=1.000 n=5+5) neo/go/fs1-zwrk.go·8 90.5k ± 0% 91.0k ± 0% +0.61% (p=0.016 n=5+5) neo/go/fs1-zwrk.go·12 95.9k ± 1% 98.3k ± 1% +2.47% (p=0.008 n=5+5) neo/go/fs1-zwrk.go·16 89.9k ± 1% 101.4k ± 3% +12.84% (p=0.008 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 16.2k ± 3% 16.1k ± 1% ~ (p=0.151 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 33.0k ± 0% 32.9k ± 0% -0.47% (p=0.032 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 46.1k ± 1% 46.2k ± 0% ~ (p=0.151 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 60.2k ± 0% 60.1k ± 0% ~ (p=0.690 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 99.2k ± 1% 99.6k ± 0% ~ (p=0.095 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 103k ± 0% 106k ± 1% +3.11% (p=0.008 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 97.3k ± 2% 109.6k ± 1% +12.63% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go·1 5.79k ± 8% 5.74k ± 3% ~ (p=0.548 n=5+5) neo/go/sqlite-zwrk.go·2 13.3k ± 1% 13.4k ± 0% ~ (p=0.151 n=5+5) neo/go/sqlite-zwrk.go·3 20.3k ± 1% 20.4k ± 0% ~ (p=0.056 n=5+5) neo/go/sqlite-zwrk.go·4 26.4k ± 1% 26.8k ± 1% +1.42% (p=0.016 n=5+5) neo/go/sqlite-zwrk.go·8 44.7k ± 0% 45.6k ± 1% +2.04% (p=0.016 n=4+5) neo/go/sqlite-zwrk.go·12 52.6k ± 0% 53.9k ± 1% +2.38% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go·16 48.6k ± 1% 50.5k ± 1% +3.98% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·1 5.81k ±12% 5.92k ± 3% ~ (p=1.000 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·2 13.1k ± 3% 13.6k ± 0% +3.75% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·3 20.5k ± 1% 20.9k ± 1% +1.84% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·4 27.2k ± 2% 27.6k ± 0% +1.50% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·8 45.3k ± 0% 46.7k ± 2% +3.11% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·12 53.3k ± 1% 55.2k ± 1% +3.56% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·16 49.9k ± 1% 51.5k ± 2% +3.18% (p=0.008 n=5+5) name old latency-time/object new latency-time/object delta cluster:z6001 dataset:wczblk1-8 fs1-zwrk.go·1 4.39µs ± 4% 4.38µs ± 2% ~ (p=0.841 n=5+5) fs1-zwrk.go·2 4.50µs ± 1% 4.56µs ± 0% +1.36% (p=0.016 n=5+5) fs1-zwrk.go·3 4.55µs ± 3% 4.51µs ± 1% ~ (p=1.000 n=5+5) fs1-zwrk.go·4 4.54µs ± 1% 4.61µs ± 1% +1.56% (p=0.016 n=5+5) fs1-zwrk.go·8 4.57µs ± 2% 4.56µs ± 1% ~ (p=1.000 n=5+5) fs1-zwrk.go·12 4.80µs ± 3% 4.67µs ± 1% -2.60% (p=0.024 n=5+5) fs1-zwrk.go·16 5.56µs ± 1% 5.52µs ± 1% ~ (p=0.135 n=5+5) zeo/py/fs1-zwrk.go·1 225µs ± 6% 217µs ± 3% ~ (p=0.095 n=5+5) zeo/py/fs1-zwrk.go·2 317µs ± 0% 317µs ± 2% ~ (p=0.690 n=5+5) zeo/py/fs1-zwrk.go·3 435µs ± 0% 430µs ± 2% ~ (p=0.151 n=5+5) zeo/py/fs1-zwrk.go·4 559µs ± 1% 563µs ± 3% ~ (p=1.000 n=5+5) zeo/py/fs1-zwrk.go·8 1.07ms ± 2% 1.08ms ± 4% ~ (p=0.690 n=5+5) zeo/py/fs1-zwrk.go·12 1.59ms ± 1% 1.57ms ± 1% ~ (p=0.056 n=5+5) zeo/py/fs1-zwrk.go·16 2.12ms ± 1% 2.09ms ± 3% ~ (p=0.310 n=5+5) neo/py(!log)/sqlite-zwrk.go·1 269µs ±12% 306µs ± 6% ~ (p=0.056 n=5+5) neo/py(!log)/sqlite-zwrk.go·2 358µs ± 1% 355µs ± 2% ~ (p=0.222 n=5+5) neo/py(!log)/sqlite-zwrk.go·3 537µs ± 1% 539µs ± 4% ~ (p=0.310 n=5+5) neo/py(!log)/sqlite-zwrk.go·4 721µs ± 1% 715µs ± 3% ~ (p=0.310 n=5+5) neo/py(!log)/sqlite-zwrk.go·8 1.42ms ± 0% 1.42ms ± 2% ~ (p=0.222 n=5+5) neo/py(!log)/sqlite-zwrk.go·12 2.15ms ± 0% 2.16ms ± 3% ~ (p=0.421 n=5+5) neo/py(!log)/sqlite-zwrk.go·16 2.87ms ± 1% 2.84ms ± 2% ~ (p=0.151 n=5+5) neo/py(!log)/sql-zwrk.go·1 384µs ± 5% 395µs ±11% ~ (p=0.690 n=5+5) neo/py(!log)/sql-zwrk.go·2 518µs ±11% 514µs ± 5% ~ (p=0.841 n=5+5) neo/py(!log)/sql-zwrk.go·3 795µs ±13% 741µs ± 3% ~ (p=0.421 n=5+5) neo/py(!log)/sql-zwrk.go·4 1.04ms ± 5% 1.02ms ± 7% ~ (p=0.690 n=5+5) neo/py(!log)/sql-zwrk.go·8 2.21ms ±11% 2.00ms ± 7% -9.61% (p=0.032 n=5+5) neo/py(!log)/sql-zwrk.go·12 3.31ms ± 6% 2.94ms ± 3% -11.20% (p=0.008 n=5+5) neo/py(!log)/sql-zwrk.go·16 4.10ms ±15% 4.04ms ±11% ~ (p=0.841 n=5+5) neo/go/fs1-zwrk.go·1 94.0µs ± 5% 94.3µs ± 2% ~ (p=0.841 n=5+5) neo/go/fs1-zwrk.go·2 89.1µs ± 1% 89.4µs ± 0% ~ (p=0.310 n=5+5) neo/go/fs1-zwrk.go·3 94.0µs ± 1% 94.4µs ± 0% ~ (p=0.095 n=5+5) neo/go/fs1-zwrk.go·4 92.7µs ± 0% 92.7µs ± 0% ~ (p=0.310 n=5+5) neo/go/fs1-zwrk.go·8 102µs ± 0% 102µs ± 0% ~ (p=0.548 n=5+5) neo/go/fs1-zwrk.go·12 130µs ± 0% 130µs ± 0% ~ (p=0.151 n=5+5) neo/go/fs1-zwrk.go·16 156µs ± 1% 156µs ± 0% ~ (p=0.690 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 66.5µs ± 4% 65.9µs ± 1% ~ (p=0.310 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 63.6µs ± 1% 63.6µs ± 0% ~ (p=1.000 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 68.4µs ± 0% 68.5µs ± 0% ~ (p=0.421 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 69.4µs ± 0% 69.4µs ± 0% ~ (p=0.635 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 79.8µs ± 0% 80.1µs ± 0% +0.33% (p=0.032 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 103µs ± 0% 104µs ± 0% +0.45% (p=0.032 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 127µs ± 0% 127µs ± 0% +0.28% (p=0.032 n=5+5) neo/go/sqlite-zwrk.go·1 198µs ± 8% 203µs ± 3% ~ (p=0.421 n=5+5) neo/go/sqlite-zwrk.go·2 169µs ± 2% 167µs ± 0% ~ (p=0.421 n=5+5) neo/go/sqlite-zwrk.go·3 158µs ± 1% 158µs ± 0% ~ (p=0.421 n=5+5) neo/go/sqlite-zwrk.go·4 162µs ± 1% 163µs ± 0% ~ (p=0.690 n=5+5) neo/go/sqlite-zwrk.go·8 179µs ± 0% 181µs ± 1% +1.07% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go·12 213µs ± 0% 216µs ± 1% +1.31% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go·16 275µs ± 0% 276µs ± 0% ~ (p=0.056 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·1 175µs ± 8% 178µs ± 1% ~ (p=0.841 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·2 152µs ± 3% 153µs ± 1% ~ (p=0.690 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·3 147µs ± 1% 149µs ± 0% +0.96% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·4 147µs ± 1% 149µs ± 0% +1.08% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·8 166µs ± 0% 168µs ± 1% +1.14% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·12 199µs ± 0% 201µs ± 1% +0.86% (p=0.032 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·16 259µs ± 0% 255µs ± 0% -1.74% (p=0.008 n=5+5) cluster:z6001 dataset:prod1-1024 fs1-zwrk.go·1 2.88µs ± 2% 2.87µs ± 0% ~ (p=0.651 n=5+5) fs1-zwrk.go·2 3.02µs ± 1% 3.04µs ± 2% ~ (p=0.794 n=5+5) fs1-zwrk.go·3 3.05µs ± 1% 3.03µs ± 3% ~ (p=0.548 n=5+5) fs1-zwrk.go·4 3.08µs ± 2% 3.06µs ± 1% ~ (p=0.310 n=5+5) fs1-zwrk.go·8 3.12µs ± 2% 3.18µs ± 1% +1.83% (p=0.032 n=5+5) fs1-zwrk.go·12 4.25µs ± 1% 4.26µs ± 1% ~ (p=1.000 n=5+5) fs1-zwrk.go·16 5.68µs ± 1% 5.59µs ± 0% -1.57% (p=0.016 n=5+4) zeo/py/fs1-zwrk.go·1 204µs ± 6% 186µs ± 4% -9.09% (p=0.008 n=5+5) zeo/py/fs1-zwrk.go·2 247µs ± 0% 244µs ± 1% -1.09% (p=0.008 n=5+5) zeo/py/fs1-zwrk.go·3 331µs ± 2% 336µs ± 2% ~ (p=0.310 n=5+5) zeo/py/fs1-zwrk.go·4 427µs ± 0% 428µs ± 4% ~ (p=0.690 n=5+5) zeo/py/fs1-zwrk.go·8 801µs ± 2% 806µs ± 3% ~ (p=0.548 n=5+5) zeo/py/fs1-zwrk.go·12 1.17ms ± 2% 1.29ms ±17% ~ (p=1.000 n=4+5) zeo/py/fs1-zwrk.go·16 1.55ms ± 2% 1.59ms ± 4% ~ (p=0.151 n=5+5) neo/py(!log)/sqlite-zwrk.go·1 265µs ±12% 273µs ± 4% ~ (p=0.690 n=5+5) neo/py(!log)/sqlite-zwrk.go·2 345µs ± 0% 344µs ± 0% ~ (p=0.151 n=5+5) neo/py(!log)/sqlite-zwrk.go·3 540µs ± 8% 519µs ± 0% ~ (p=0.690 n=5+5) neo/py(!log)/sqlite-zwrk.go·4 689µs ± 0% 705µs ± 3% +2.35% (p=0.016 n=5+5) neo/py(!log)/sqlite-zwrk.go·8 1.38ms ± 2% 1.38ms ± 2% ~ (p=0.548 n=5+5) neo/py(!log)/sqlite-zwrk.go·12 2.08ms ± 0% 2.05ms ± 2% ~ (p=0.151 n=5+5) neo/py(!log)/sqlite-zwrk.go·16 2.76ms ± 0% 2.77ms ± 3% ~ (p=0.690 n=5+5) neo/py(!log)/sql-zwrk.go·1 372µs ±21% 365µs ±11% ~ (p=0.548 n=5+5) neo/py(!log)/sql-zwrk.go·2 543µs ± 8% 524µs ± 5% ~ (p=0.421 n=5+5) neo/py(!log)/sql-zwrk.go·3 818µs ± 8% 754µs ±10% -7.83% (p=0.032 n=5+5) neo/py(!log)/sql-zwrk.go·4 1.06ms ±10% 0.98ms ±11% ~ (p=0.095 n=5+5) neo/py(!log)/sql-zwrk.go·8 2.05ms ±13% 1.92ms ± 2% ~ (p=0.310 n=5+5) neo/py(!log)/sql-zwrk.go·12 2.98ms ±13% 2.95ms ± 9% ~ (p=0.841 n=5+5) neo/py(!log)/sql-zwrk.go·16 4.20ms ±10% 4.12ms ± 8% ~ (p=0.690 n=5+5) neo/go/fs1-zwrk.go·1 73.3µs ± 4% 72.8µs ± 0% ~ (p=0.690 n=5+5) neo/go/fs1-zwrk.go·2 71.3µs ± 0% 71.5µs ± 0% ~ (p=0.151 n=5+5) neo/go/fs1-zwrk.go·3 74.5µs ± 0% 74.4µs ± 0% ~ (p=0.548 n=5+5) neo/go/fs1-zwrk.go·4 75.8µs ± 0% 75.8µs ± 0% ~ (p=1.000 n=5+5) neo/go/fs1-zwrk.go·8 88.4µs ± 0% 87.9µs ± 0% -0.60% (p=0.016 n=5+5) neo/go/fs1-zwrk.go·12 125µs ± 1% 122µs ± 1% -2.41% (p=0.008 n=5+5) neo/go/fs1-zwrk.go·16 178µs ± 1% 158µs ± 3% -11.35% (p=0.008 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 61.6µs ± 3% 62.0µs ± 1% ~ (p=0.151 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 60.5µs ± 0% 60.8µs ± 0% +0.47% (p=0.032 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 65.1µs ± 1% 64.9µs ± 0% ~ (p=0.151 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 66.5µs ± 0% 66.6µs ± 0% ~ (p=0.690 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 80.7µs ± 1% 80.3µs ± 0% ~ (p=0.095 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 116µs ± 0% 113µs ± 1% -3.01% (p=0.008 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 164µs ± 2% 146µs ± 1% -11.22% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go·1 173µs ± 8% 174µs ± 3% ~ (p=0.548 n=5+5) neo/go/sqlite-zwrk.go·2 151µs ± 1% 149µs ± 0% ~ (p=0.151 n=5+5) neo/go/sqlite-zwrk.go·3 148µs ± 1% 147µs ± 0% ~ (p=0.056 n=5+5) neo/go/sqlite-zwrk.go·4 151µs ± 1% 149µs ± 1% -1.41% (p=0.016 n=5+5) neo/go/sqlite-zwrk.go·8 179µs ± 0% 176µs ± 1% -1.99% (p=0.016 n=4+5) neo/go/sqlite-zwrk.go·12 228µs ± 0% 223µs ± 1% -2.33% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go·16 329µs ± 1% 317µs ± 1% -3.83% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·1 173µs ±13% 169µs ± 3% ~ (p=1.000 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·2 153µs ± 3% 147µs ± 0% -3.67% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·3 146µs ± 1% 144µs ± 1% -1.81% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·4 147µs ± 2% 145µs ± 0% -1.49% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·8 177µs ± 0% 171µs ± 2% -3.01% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·12 225µs ± 1% 217µs ± 1% -3.44% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·16 321µs ± 1% 311µs ± 2% -3.07% (p=0.008 n=5+5)
20788052