-
Kirill Smelkov authored
Compared to yesterday shows relatively no significant change, though some benchmarks, like on neo1 & z6001, are itself noisy. Disk, like on neo1 is not stable from run to run (though it still shows a magnitude). $ benchstat -split node,cluster,dataset 20180305-rio-ffixed-c.txt 20180306-rio-ffixed-c.txt name old pystone/s new pystone/s delta node:rio pystone 146k ± 1% 115k ±12% -21.20% (p=0.008 n=5+5) name old time/op new time/op delta node:rio crc32/py/4K 4.76µs ± 0% 4.77µs ± 0% ~ (p=0.730 n=5+4) crc32/go/4K 1.49µs ± 0% 1.49µs ± 0% +0.22% (p=0.016 n=4+5) sha1/py/4K 8.02µs ± 2% 8.04µs ± 1% ~ (p=0.500 n=5+5) sha1/go/4K 8.95µs ± 0% 8.93µs ± 0% ~ (p=0.397 n=4+5) unzlib/py/wczdata 25.0µs ± 0% 25.1µs ± 1% ~ (p=0.778 n=4+5) unzlib/go/wczdata 23.0µs ± 0% 23.0µs ± 0% ~ (p=0.548 n=5+5) unzlib/py/prod1-avg 7.25µs ± 3% 7.16µs ± 1% ~ (p=0.151 n=5+5) unzlib/go/prod1-avg 5.07µs ± 0% 5.08µs ± 1% ~ (p=0.841 n=5+5) disk/randread/direct/4K-min 38.4µs ± 1% 92.4µs ± 0% +140.70% (p=0.008 n=5+5) disk/randread/direct/4K-avg 96.9µs ± 0% 115.0µs ± 0% +18.72% (p=0.008 n=5+5) disk/randread/pagecache/4K-min 571ns ± 1% 565ns ± 2% ~ (p=0.167 n=5+5) disk/randread/pagecache/4K-avg 1.01µs ± 0% 0.99µs ± 0% -1.78% (p=0.029 n=4+4) name old time/object new time/object delta cluster:rio dataset:wczblk1-8 fs1-zhash.py 28.7µs ± 2% 29.2µs ± 1% ~ (p=0.063 n=5+4) fs1-zhash.go 4.60µs ± 0% 4.68µs ± 5% ~ (p=0.444 n=5+5) fs1-zhash.go+prefetch128 4.72µs ± 6% 4.78µs ± 5% ~ (p=0.460 n=5+5) zeo/py/fs1-zhash.py 395µs ± 3% 400µs ± 0% ~ (p=0.690 n=5+5) zeo/py/fs1-zhash.go 138µs ± 1% 138µs ± 1% ~ (p=0.897 n=5+5) zeo/py/fs1-zhash.go+prefetch128 73.5µs ± 1% 74.7µs ± 2% +1.66% (p=0.048 n=5+5) neo/py(!log)/sqlite-zhash.py 330µs ± 6% 318µs ± 7% ~ (p=0.310 n=5+5) neo/py(!log)/sqlite-zhash.go 157µs ± 4% 154µs ± 4% ~ (p=0.690 n=5+5) neo/py(!log)/sqlite-zhash.go+prefetch128 126µs ± 3% 125µs ± 3% ~ (p=0.548 n=5+5) neo/py(!log)/sql-zhash.py 392µs ±45% 400µs ±57% ~ (p=0.841 n=5+5) neo/py(!log)/sql-zhash.go 181µs ± 2% 183µs ±11% ~ (p=0.690 n=5+5) neo/py(!log)/sql-zhash.go+prefetch128 159µs ± 4% 158µs ± 3% ~ (p=0.841 n=5+5) neo/go/fs1-zhash.py 228µs ± 2% 222µs ± 4% ~ (p=0.079 n=5+5) neo/go/fs1-zhash.go 68.5µs ± 1% 68.6µs ± 2% ~ (p=0.714 n=5+5) neo/go/fs1-zhash.go+prefetch128 29.4µs ± 5% 29.0µs ± 6% ~ (p=0.381 n=5+5) neo/go/fs1(!sha1)-zhash.go(!sha1) 44.2µs ± 2% 43.9µs ± 3% ~ (p=0.770 n=5+5) neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 19.1µs ± 3% 18.8µs ± 5% ~ (p=0.643 n=5+5) neo/go/sqlite-zhash.py 265µs ± 5% 273µs ± 3% ~ (p=0.095 n=5+5) neo/go/sqlite-zhash.go 104µs ± 1% 104µs ± 1% ~ (p=0.690 n=5+5) neo/go/sqlite-zhash.go+prefetch128 38.6µs ± 6% 36.3µs ± 3% -6.16% (p=0.048 n=5+5) neo/go/sqlite-zhash.go(!sha1) 92.9µs ± 2% 94.2µs ± 3% ~ (p=0.095 n=5+5) neo/go/sqlite-zhash.go+prefetch128(!sha1) 35.7µs ± 6% 35.1µs ± 6% ~ (p=0.413 n=5+5) cluster:rio dataset:prod1-1024 fs1-zhash.py 23.9µs ± 1% 23.9µs ± 1% ~ (p=1.000 n=5+4) fs1-zhash.go 3.40µs ± 0% 3.40µs ± 0% ~ (all equal) fs1-zhash.go+prefetch128 3.00µs ± 0% 3.02µs ± 9% ~ (p=0.444 n=5+5) zeo/py/fs1-zhash.py 367µs ± 5% 372µs ±10% ~ (p=1.000 n=5+5) zeo/py/fs1-zhash.go 114µs ± 3% 114µs ± 1% ~ (p=0.421 n=5+5) zeo/py/fs1-zhash.go+prefetch128 64.6µs ± 0% 64.6µs ± 1% ~ (p=0.913 n=5+5) neo/py(!log)/sqlite-zhash.py 314µs ± 8% 321µs ±11% ~ (p=0.952 n=5+5) neo/py(!log)/sqlite-zhash.go 144µs ± 2% 142µs ± 3% ~ (p=0.690 n=5+5) neo/py(!log)/sqlite-zhash.go+prefetch128 115µs ± 1% 117µs ± 1% ~ (p=0.056 n=5+5) neo/py(!log)/sql-zhash.py 378µs ±44% 330µs ± 1% ~ (p=0.286 n=5+4) neo/py(!log)/sql-zhash.go 174µs ± 5% 172µs ± 1% ~ (p=1.000 n=5+5) neo/py(!log)/sql-zhash.go+prefetch128 149µs ± 1% 149µs ± 2% ~ (p=0.952 n=5+5) neo/go/fs1-zhash.py 218µs ± 1% 217µs ± 1% ~ (p=0.857 n=4+5) neo/go/fs1-zhash.go 49.9µs ± 1% 49.8µs ± 2% ~ (p=0.984 n=5+5) neo/go/fs1-zhash.go+prefetch128 19.0µs ± 1% 18.8µs ± 1% ~ (p=0.143 n=5+5) neo/go/fs1(!sha1)-zhash.go(!sha1) 40.4µs ± 3% 40.4µs ± 3% ~ (p=0.794 n=5+5) neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 16.2µs ± 5% 16.1µs ± 2% ~ (p=1.000 n=5+5) neo/go/sqlite-zhash.py 266µs ± 3% 263µs ± 4% ~ (p=0.690 n=5+5) neo/go/sqlite-zhash.go 94.0µs ± 1% 93.1µs ± 1% -1.00% (p=0.040 n=5+5) neo/go/sqlite-zhash.go+prefetch128 33.0µs ± 4% 32.7µs ± 2% ~ (p=0.651 n=5+5) neo/go/sqlite-zhash.go(!sha1) 90.1µs ± 2% 89.6µs ± 1% ~ (p=0.381 n=5+5) neo/go/sqlite-zhash.go+prefetch128(!sha1) 32.9µs ± 4% 34.0µs ± 2% ~ (p=0.063 n=5+5) name old req/s new req/s delta cluster:rio dataset:wczblk1-8 fs1-zwrk.go·1 300k ± 0% 300k ± 0% ~ (p=0.151 n=5+5) fs1-zwrk.go·2 549k ± 0% 546k ± 0% -0.53% (p=0.016 n=4+5) fs1-zwrk.go·3 811k ± 0% 810k ± 0% ~ (p=0.421 n=5+5) fs1-zwrk.go·4 1.07M ± 0% 1.08M ± 0% ~ (p=0.310 n=5+5) fs1-zwrk.go·8 1.42M ± 0% 1.42M ± 0% ~ (p=0.841 n=5+5) fs1-zwrk.go·12 1.54M ± 0% 1.55M ± 0% ~ (p=0.310 n=5+5) fs1-zwrk.go·16 1.55M ± 0% 1.55M ± 0% ~ (p=0.151 n=5+5) zeo/py/fs1-zwrk.go·1 7.55k ± 0% 7.41k ± 1% -1.87% (p=0.008 n=5+5) zeo/py/fs1-zwrk.go·2 9.17k ± 1% 9.03k ± 1% -1.60% (p=0.008 n=5+5) zeo/py/fs1-zwrk.go·3 9.74k ± 1% 9.77k ± 1% ~ (p=0.548 n=5+5) zeo/py/fs1-zwrk.go·4 10.2k ± 2% 10.1k ± 3% ~ (p=0.095 n=5+5) zeo/py/fs1-zwrk.go·8 10.6k ± 2% 10.5k ± 0% ~ (p=0.310 n=5+5) zeo/py/fs1-zwrk.go·12 10.5k ± 1% 10.6k ± 1% ~ (p=0.222 n=5+5) zeo/py/fs1-zwrk.go·16 10.6k ± 1% 10.6k ± 1% ~ (p=0.151 n=5+5) neo/py(!log)/sqlite-zwrk.go·1 6.69k ± 4% 6.80k ± 2% ~ (p=0.310 n=5+5) neo/py(!log)/sqlite-zwrk.go·2 8.31k ± 9% 8.31k ± 7% ~ (p=1.000 n=5+5) neo/py(!log)/sqlite-zwrk.go·3 7.96k ± 6% 8.60k ± 1% +8.12% (p=0.008 n=5+5) neo/py(!log)/sqlite-zwrk.go·4 8.27k ± 9% 8.60k ± 1% +4.05% (p=0.016 n=5+4) neo/py(!log)/sqlite-zwrk.go·8 8.42k ± 2% 8.61k ± 1% +2.20% (p=0.008 n=5+5) neo/py(!log)/sqlite-zwrk.go·12 8.46k ± 1% 8.56k ± 1% +1.19% (p=0.032 n=4+5) neo/py(!log)/sqlite-zwrk.go·16 8.34k ± 4% 8.49k ± 3% ~ (p=0.310 n=5+5) neo/py(!log)/sql-zwrk.go·1 5.63k ± 1% 5.62k ± 6% ~ (p=0.421 n=5+5) neo/py(!log)/sql-zwrk.go·2 6.80k ± 2% 6.75k ± 4% ~ (p=0.548 n=5+5) neo/py(!log)/sql-zwrk.go·3 6.68k ± 2% 6.77k ± 2% ~ (p=0.310 n=5+5) neo/py(!log)/sql-zwrk.go·4 6.63k ± 3% 6.51k ± 7% ~ (p=0.690 n=5+5) neo/py(!log)/sql-zwrk.go·8 6.73k ± 2% 6.56k ± 4% ~ (p=0.421 n=5+5) neo/py(!log)/sql-zwrk.go·12 6.71k ± 1% 6.84k ± 1% +2.00% (p=0.016 n=5+4) neo/py(!log)/sql-zwrk.go·16 6.77k ± 2% 6.73k ± 3% ~ (p=0.841 n=5+5) neo/go/fs1-zwrk.go·1 15.7k ± 1% 15.5k ± 0% -1.10% (p=0.008 n=5+5) neo/go/fs1-zwrk.go·2 30.2k ± 0% 29.9k ± 1% -1.04% (p=0.008 n=5+5) neo/go/fs1-zwrk.go·3 39.8k ± 0% 39.4k ± 0% -0.82% (p=0.008 n=5+5) neo/go/fs1-zwrk.go·4 49.8k ± 0% 49.4k ± 0% -0.85% (p=0.008 n=5+5) neo/go/fs1-zwrk.go·8 69.1k ± 1% 68.4k ± 0% -0.93% (p=0.008 n=5+5) neo/go/fs1-zwrk.go·12 73.1k ± 1% 72.5k ± 0% -0.74% (p=0.016 n=5+5) neo/go/fs1-zwrk.go·16 73.8k ± 0% 73.2k ± 0% -0.81% (p=0.008 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 25.5k ± 2% 26.2k ± 1% +2.41% (p=0.016 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 47.9k ± 0% 47.6k ± 0% -0.60% (p=0.008 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 59.8k ± 0% 59.4k ± 0% -0.63% (p=0.008 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 72.7k ± 0% 72.2k ± 0% -0.75% (p=0.008 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 97.0k ± 0% 96.7k ± 0% ~ (p=0.151 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 110k ± 0% 109k ± 0% -0.64% (p=0.008 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 114k ± 0% 113k ± 1% ~ (p=0.056 n=5+5) neo/go/sqlite-zwrk.go·1 9.84k ± 1% 9.82k ± 0% ~ (p=0.690 n=5+5) neo/go/sqlite-zwrk.go·2 18.2k ± 0% 18.3k ± 0% ~ (p=0.151 n=5+5) neo/go/sqlite-zwrk.go·3 25.4k ± 0% 25.3k ± 0% ~ (p=0.690 n=5+5) neo/go/sqlite-zwrk.go·4 30.3k ± 0% 30.3k ± 0% ~ (p=0.095 n=5+5) neo/go/sqlite-zwrk.go·8 39.3k ± 1% 39.5k ± 0% ~ (p=0.421 n=5+5) neo/go/sqlite-zwrk.go·12 40.6k ± 2% 40.8k ± 2% ~ (p=0.151 n=5+5) neo/go/sqlite-zwrk.go·16 40.5k ± 1% 40.5k ± 2% ~ (p=1.000 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·1 11.1k ± 1% 11.0k ± 1% ~ (p=0.095 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·2 20.1k ± 0% 20.0k ± 0% -0.49% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·3 27.9k ± 0% 27.9k ± 0% ~ (p=0.056 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·4 34.1k ± 1% 34.1k ± 0% ~ (p=0.421 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·8 44.2k ± 1% 44.1k ± 1% ~ (p=0.310 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·12 43.2k ± 1% 43.1k ± 1% ~ (p=0.690 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·16 41.3k ± 2% 41.2k ± 2% ~ (p=1.000 n=5+5) cluster:rio dataset:prod1-1024 fs1-zwrk.go·1 463k ± 1% 465k ± 1% ~ (p=0.095 n=5+5) fs1-zwrk.go·2 882k ± 7% 920k ± 0% +4.29% (p=0.016 n=5+4) fs1-zwrk.go·3 1.36M ± 1% 1.36M ± 1% ~ (p=0.056 n=5+5) fs1-zwrk.go·4 1.79M ± 1% 1.81M ± 0% ~ (p=0.095 n=5+5) fs1-zwrk.go·8 2.34M ± 2% 2.37M ± 1% ~ (p=0.151 n=5+5) fs1-zwrk.go·12 2.40M ± 0% 2.41M ± 0% ~ (p=0.056 n=5+5) fs1-zwrk.go·16 2.41M ± 0% 2.42M ± 0% +0.61% (p=0.008 n=5+5) zeo/py/fs1-zwrk.go·1 8.99k ± 1% 8.98k ± 1% ~ (p=0.841 n=5+5) zeo/py/fs1-zwrk.go·2 11.8k ± 1% 11.7k ± 1% -1.10% (p=0.032 n=5+5) zeo/py/fs1-zwrk.go·3 12.9k ± 1% 12.9k ± 2% ~ (p=0.690 n=5+5) zeo/py/fs1-zwrk.go·4 13.4k ± 3% 13.4k ± 4% ~ (p=1.000 n=5+5) zeo/py/fs1-zwrk.go·8 14.1k ± 1% 14.0k ± 2% ~ (p=0.421 n=5+5) zeo/py/fs1-zwrk.go·12 14.4k ± 2% 14.2k ± 2% ~ (p=0.421 n=5+5) zeo/py/fs1-zwrk.go·16 14.4k ± 1% 14.2k ± 3% ~ (p=0.421 n=5+5) neo/py(!log)/sqlite-zwrk.go·1 7.18k ± 2% 7.16k ± 4% ~ (p=0.841 n=5+5) neo/py(!log)/sqlite-zwrk.go·2 8.65k ± 3% 8.75k ± 1% ~ (p=0.421 n=5+5) neo/py(!log)/sqlite-zwrk.go·3 8.63k ± 1% 8.65k ± 4% ~ (p=0.222 n=5+5) neo/py(!log)/sqlite-zwrk.go·4 8.67k ± 1% 8.53k ± 6% ~ (p=0.841 n=5+5) neo/py(!log)/sqlite-zwrk.go·8 8.47k ± 6% 8.61k ± 3% ~ (p=0.310 n=5+5) neo/py(!log)/sqlite-zwrk.go·12 8.45k ± 5% 8.64k ± 0% ~ (p=0.286 n=5+4) neo/py(!log)/sqlite-zwrk.go·16 8.37k ± 3% 8.64k ± 1% +3.14% (p=0.032 n=5+5) neo/py(!log)/sql-zwrk.go·1 5.91k ± 3% 5.88k ± 1% ~ (p=0.421 n=5+5) neo/py(!log)/sql-zwrk.go·2 6.86k ± 3% 6.79k ± 2% ~ (p=0.690 n=5+5) neo/py(!log)/sql-zwrk.go·3 6.91k ± 4% 6.58k ± 4% -4.75% (p=0.016 n=5+5) neo/py(!log)/sql-zwrk.go·4 6.84k ± 2% 6.68k ± 4% ~ (p=0.421 n=5+5) neo/py(!log)/sql-zwrk.go·8 6.98k ± 1% 6.83k ± 1% -2.17% (p=0.016 n=5+5) neo/py(!log)/sql-zwrk.go·12 6.84k ± 6% 6.66k ± 4% ~ (p=0.095 n=5+5) neo/py(!log)/sql-zwrk.go·16 6.92k ± 4% 6.65k ± 5% ~ (p=0.056 n=5+5) neo/go/fs1-zwrk.go·1 21.8k ± 0% 21.8k ± 1% ~ (p=0.841 n=5+5) neo/go/fs1-zwrk.go·2 39.4k ± 1% 39.2k ± 1% ~ (p=0.056 n=5+5) neo/go/fs1-zwrk.go·3 51.6k ± 0% 51.4k ± 0% -0.37% (p=0.008 n=5+5) neo/go/fs1-zwrk.go·4 62.9k ± 0% 62.8k ± 0% ~ (p=0.222 n=5+5) neo/go/fs1-zwrk.go·8 80.3k ± 2% 80.7k ± 1% ~ (p=0.548 n=5+5) neo/go/fs1-zwrk.go·12 79.7k ± 2% 80.0k ± 2% ~ (p=0.690 n=5+5) neo/go/fs1-zwrk.go·16 78.1k ± 4% 78.3k ± 2% ~ (p=1.000 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 26.5k ± 2% 26.5k ± 1% ~ (p=0.841 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 49.2k ± 0% 48.8k ± 0% -0.90% (p=0.008 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 62.4k ± 0% 61.8k ± 0% -0.97% (p=0.008 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 74.5k ± 0% 74.0k ± 0% -0.63% (p=0.016 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 92.3k ± 2% 91.3k ± 0% ~ (p=0.190 n=5+4) neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 93.6k ± 4% 93.1k ± 2% ~ (p=0.548 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 90.7k ± 5% 89.7k ± 2% ~ (p=0.151 n=5+5) neo/go/sqlite-zwrk.go·1 11.0k ± 0% 11.0k ± 1% +0.63% (p=0.016 n=5+5) neo/go/sqlite-zwrk.go·2 19.4k ± 0% 19.4k ± 1% ~ (p=1.000 n=5+5) neo/go/sqlite-zwrk.go·3 26.5k ± 0% 26.6k ± 0% ~ (p=0.421 n=5+5) neo/go/sqlite-zwrk.go·4 31.8k ± 1% 31.9k ± 0% ~ (p=0.421 n=5+5) neo/go/sqlite-zwrk.go·8 37.5k ± 1% 37.4k ± 2% ~ (p=0.841 n=5+5) neo/go/sqlite-zwrk.go·12 36.4k ± 5% 35.2k ± 3% ~ (p=0.151 n=5+5) neo/go/sqlite-zwrk.go·16 36.5k ± 3% 34.6k ± 2% -5.21% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·1 11.5k ± 1% 11.5k ± 1% ~ (p=0.310 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·2 20.1k ± 1% 20.1k ± 0% ~ (p=0.548 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·3 28.0k ± 0% 27.6k ± 0% -1.43% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·4 34.0k ± 0% 33.4k ± 0% -1.74% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·8 40.2k ± 1% 38.8k ± 2% -3.35% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·12 38.1k ± 1% 36.4k ± 1% -4.51% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·16 36.8k ± 1% 35.2k ± 2% -4.47% (p=0.008 n=5+5) name old latency-time/object new latency-time/object delta cluster:rio dataset:wczblk1-8 fs1-zwrk.go·1 3.34µs ± 0% 3.33µs ± 0% ~ (p=0.222 n=5+5) fs1-zwrk.go·2 3.65µs ± 0% 3.67µs ± 0% +0.53% (p=0.016 n=4+5) fs1-zwrk.go·3 3.70µs ± 0% 3.70µs ± 0% ~ (p=0.421 n=5+5) fs1-zwrk.go·4 3.72µs ± 0% 3.72µs ± 0% ~ (p=0.341 n=5+5) fs1-zwrk.go·8 5.62µs ± 0% 5.62µs ± 0% ~ (p=0.889 n=5+5) fs1-zwrk.go·12 7.77µs ± 0% 7.76µs ± 0% ~ (p=0.333 n=5+5) fs1-zwrk.go·16 10.4µs ± 0% 10.3µs ± 0% ~ (p=0.151 n=5+5) zeo/py/fs1-zwrk.go·1 132µs ± 0% 135µs ± 1% +1.91% (p=0.008 n=5+5) zeo/py/fs1-zwrk.go·2 218µs ± 1% 222µs ± 1% +1.62% (p=0.008 n=5+5) zeo/py/fs1-zwrk.go·3 308µs ± 1% 307µs ± 1% ~ (p=0.548 n=5+5) zeo/py/fs1-zwrk.go·4 392µs ± 2% 398µs ± 3% ~ (p=0.095 n=5+5) zeo/py/fs1-zwrk.go·8 754µs ± 2% 759µs ± 0% ~ (p=0.310 n=5+5) zeo/py/fs1-zwrk.go·12 1.15ms ± 1% 1.13ms ± 1% ~ (p=0.222 n=5+5) zeo/py/fs1-zwrk.go·16 1.51ms ± 1% 1.50ms ± 1% ~ (p=0.151 n=5+5) neo/py(!log)/sqlite-zwrk.go·1 150µs ± 4% 147µs ± 2% ~ (p=0.310 n=5+5) neo/py(!log)/sqlite-zwrk.go·2 235µs ± 1% 241µs ± 8% ~ (p=0.556 n=4+5) neo/py(!log)/sqlite-zwrk.go·3 378µs ± 6% 349µs ± 1% -7.74% (p=0.008 n=5+5) neo/py(!log)/sqlite-zwrk.go·4 485µs ± 9% 465µs ± 1% -4.08% (p=0.016 n=5+4) neo/py(!log)/sqlite-zwrk.go·8 950µs ± 2% 930µs ± 1% -2.15% (p=0.008 n=5+5) neo/py(!log)/sqlite-zwrk.go·12 1.42ms ± 1% 1.40ms ± 1% -1.18% (p=0.032 n=4+5) neo/py(!log)/sqlite-zwrk.go·16 1.92ms ± 4% 1.88ms ± 3% ~ (p=0.310 n=5+5) neo/py(!log)/sql-zwrk.go·1 178µs ± 1% 178µs ± 6% ~ (p=0.421 n=5+5) neo/py(!log)/sql-zwrk.go·2 294µs ± 2% 297µs ± 4% ~ (p=0.548 n=5+5) neo/py(!log)/sql-zwrk.go·3 449µs ± 2% 443µs ± 2% ~ (p=0.310 n=5+5) neo/py(!log)/sql-zwrk.go·4 603µs ± 3% 616µs ± 8% ~ (p=0.690 n=5+5) neo/py(!log)/sql-zwrk.go·8 1.19ms ± 2% 1.22ms ± 5% ~ (p=0.421 n=5+5) neo/py(!log)/sql-zwrk.go·12 1.79ms ± 1% 1.75ms ± 1% -1.96% (p=0.016 n=5+4) neo/py(!log)/sql-zwrk.go·16 2.36ms ± 2% 2.38ms ± 3% ~ (p=0.841 n=5+5) neo/go/fs1-zwrk.go·1 63.7µs ± 1% 64.4µs ± 0% +1.11% (p=0.008 n=5+5) neo/go/fs1-zwrk.go·2 66.2µs ± 0% 66.8µs ± 1% +1.05% (p=0.008 n=5+5) neo/go/fs1-zwrk.go·3 75.4µs ± 0% 76.1µs ± 0% +0.82% (p=0.008 n=5+5) neo/go/fs1-zwrk.go·4 80.4µs ± 0% 81.0µs ± 0% +0.85% (p=0.008 n=5+5) neo/go/fs1-zwrk.go·8 116µs ± 1% 117µs ± 0% +0.94% (p=0.008 n=5+5) neo/go/fs1-zwrk.go·12 164µs ± 1% 165µs ± 0% +0.74% (p=0.016 n=5+5) neo/go/fs1-zwrk.go·16 217µs ± 0% 219µs ± 0% +0.82% (p=0.008 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 39.2µs ± 2% 38.2µs ± 1% -2.37% (p=0.016 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 41.8µs ± 0% 42.0µs ± 0% +0.60% (p=0.008 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 50.2µs ± 0% 50.5µs ± 0% +0.64% (p=0.008 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 55.0µs ± 0% 55.4µs ± 0% +0.76% (p=0.008 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 82.5µs ± 0% 82.8µs ± 0% ~ (p=0.151 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 109µs ± 0% 110µs ± 0% +0.65% (p=0.008 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 141µs ± 0% 142µs ± 1% ~ (p=0.056 n=5+5) neo/go/sqlite-zwrk.go·1 102µs ± 1% 102µs ± 0% ~ (p=0.690 n=5+5) neo/go/sqlite-zwrk.go·2 110µs ± 0% 110µs ± 0% ~ (p=0.151 n=5+5) neo/go/sqlite-zwrk.go·3 118µs ± 0% 119µs ± 0% ~ (p=0.690 n=5+5) neo/go/sqlite-zwrk.go·4 132µs ± 0% 132µs ± 0% ~ (p=0.095 n=5+5) neo/go/sqlite-zwrk.go·8 204µs ± 1% 203µs ± 0% ~ (p=0.421 n=5+5) neo/go/sqlite-zwrk.go·12 296µs ± 2% 294µs ± 2% ~ (p=0.151 n=5+5) neo/go/sqlite-zwrk.go·16 395µs ± 1% 395µs ± 2% ~ (p=1.000 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·1 90.2µs ± 1% 91.1µs ± 1% ~ (p=0.095 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·2 100µs ± 0% 100µs ± 0% +0.49% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·3 107µs ± 0% 108µs ± 0% ~ (p=0.056 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·4 117µs ± 1% 117µs ± 0% ~ (p=0.421 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·8 181µs ± 1% 182µs ± 1% ~ (p=0.310 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·12 278µs ± 1% 279µs ± 1% ~ (p=0.690 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·16 388µs ± 2% 388µs ± 2% ~ (p=1.000 n=5+5) cluster:rio dataset:prod1-1024 fs1-zwrk.go·1 2.16µs ± 1% 2.15µs ± 1% ~ (p=0.079 n=5+5) fs1-zwrk.go·2 2.27µs ± 7% 2.17µs ± 0% -4.29% (p=0.016 n=5+4) fs1-zwrk.go·3 2.21µs ± 1% 2.20µs ± 1% ~ (p=0.056 n=5+5) fs1-zwrk.go·4 2.23µs ± 1% 2.21µs ± 0% ~ (p=0.087 n=5+5) fs1-zwrk.go·8 3.42µs ± 2% 3.37µs ± 1% ~ (p=0.151 n=5+5) fs1-zwrk.go·12 4.99µs ± 0% 4.97µs ± 0% ~ (p=0.056 n=5+5) fs1-zwrk.go·16 6.65µs ± 0% 6.61µs ± 0% -0.60% (p=0.008 n=5+5) zeo/py/fs1-zwrk.go·1 111µs ± 1% 111µs ± 1% ~ (p=0.841 n=5+5) zeo/py/fs1-zwrk.go·2 169µs ± 1% 171µs ± 1% +1.12% (p=0.032 n=5+5) zeo/py/fs1-zwrk.go·3 233µs ± 1% 233µs ± 2% ~ (p=0.690 n=5+5) zeo/py/fs1-zwrk.go·4 298µs ± 3% 298µs ± 4% ~ (p=1.000 n=5+5) zeo/py/fs1-zwrk.go·8 567µs ± 1% 572µs ± 2% ~ (p=0.421 n=5+5) zeo/py/fs1-zwrk.go·12 835µs ± 2% 844µs ± 2% ~ (p=0.421 n=5+5) zeo/py/fs1-zwrk.go·16 1.11ms ± 1% 1.12ms ± 3% ~ (p=0.421 n=5+5) neo/py(!log)/sqlite-zwrk.go·1 139µs ± 2% 140µs ± 4% ~ (p=0.841 n=5+5) neo/py(!log)/sqlite-zwrk.go·2 231µs ± 3% 229µs ± 1% ~ (p=0.421 n=5+5) neo/py(!log)/sqlite-zwrk.go·3 348µs ± 1% 347µs ± 5% ~ (p=0.222 n=5+5) neo/py(!log)/sqlite-zwrk.go·4 462µs ± 1% 470µs ± 7% ~ (p=0.841 n=5+5) neo/py(!log)/sqlite-zwrk.go·8 945µs ± 6% 929µs ± 3% ~ (p=0.310 n=5+5) neo/py(!log)/sqlite-zwrk.go·12 1.42ms ± 5% 1.39ms ± 0% ~ (p=0.286 n=5+4) neo/py(!log)/sqlite-zwrk.go·16 1.91ms ± 3% 1.85ms ± 1% -3.07% (p=0.032 n=5+5) neo/py(!log)/sql-zwrk.go·1 169µs ± 3% 170µs ± 1% ~ (p=0.421 n=5+5) neo/py(!log)/sql-zwrk.go·2 292µs ± 3% 294µs ± 2% ~ (p=0.690 n=5+5) neo/py(!log)/sql-zwrk.go·3 434µs ± 4% 456µs ± 4% +4.99% (p=0.016 n=5+5) neo/py(!log)/sql-zwrk.go·4 585µs ± 2% 599µs ± 4% ~ (p=0.421 n=5+5) neo/py(!log)/sql-zwrk.go·8 1.15ms ± 1% 1.17ms ± 1% +2.21% (p=0.016 n=5+5) neo/py(!log)/sql-zwrk.go·12 1.76ms ± 7% 1.80ms ± 4% ~ (p=0.095 n=5+5) neo/py(!log)/sql-zwrk.go·16 2.31ms ± 4% 2.41ms ± 5% ~ (p=0.056 n=5+5) neo/go/fs1-zwrk.go·1 45.8µs ± 0% 45.9µs ± 1% ~ (p=0.841 n=5+5) neo/go/fs1-zwrk.go·2 50.7µs ± 1% 51.0µs ± 1% ~ (p=0.056 n=5+5) neo/go/fs1-zwrk.go·3 58.1µs ± 0% 58.3µs ± 0% +0.37% (p=0.008 n=5+5) neo/go/fs1-zwrk.go·4 63.6µs ± 0% 63.7µs ± 0% ~ (p=0.222 n=5+5) neo/go/fs1-zwrk.go·8 100µs ± 1% 99µs ± 1% ~ (p=0.548 n=5+5) neo/go/fs1-zwrk.go·12 151µs ± 2% 150µs ± 2% ~ (p=0.690 n=5+5) neo/go/fs1-zwrk.go·16 205µs ± 4% 204µs ± 3% ~ (p=1.000 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 37.7µs ± 2% 37.7µs ± 1% ~ (p=0.841 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 40.6µs ± 0% 41.0µs ± 0% +0.91% (p=0.008 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 48.1µs ± 0% 48.5µs ± 0% +0.98% (p=0.008 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 53.7µs ± 0% 54.0µs ± 0% +0.63% (p=0.016 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 86.7µs ± 2% 87.6µs ± 0% ~ (p=0.190 n=5+4) neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 128µs ± 4% 129µs ± 2% ~ (p=0.548 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 177µs ± 5% 178µs ± 2% ~ (p=0.151 n=5+5) neo/go/sqlite-zwrk.go·1 91.3µs ± 0% 90.7µs ± 1% -0.63% (p=0.016 n=5+5) neo/go/sqlite-zwrk.go·2 103µs ± 0% 103µs ± 1% ~ (p=1.000 n=5+5) neo/go/sqlite-zwrk.go·3 113µs ± 0% 113µs ± 0% ~ (p=0.421 n=5+5) neo/go/sqlite-zwrk.go·4 126µs ± 1% 125µs ± 0% ~ (p=0.421 n=5+5) neo/go/sqlite-zwrk.go·8 214µs ± 1% 214µs ± 2% ~ (p=0.841 n=5+5) neo/go/sqlite-zwrk.go·12 330µs ± 5% 341µs ± 3% ~ (p=0.151 n=5+5) neo/go/sqlite-zwrk.go·16 438µs ± 3% 462µs ± 2% +5.47% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·1 87.2µs ± 1% 86.7µs ± 1% ~ (p=0.310 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·2 99.3µs ± 1% 99.7µs ± 0% ~ (p=0.548 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·3 107µs ± 0% 109µs ± 0% +1.45% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·4 118µs ± 0% 120µs ± 0% +1.77% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·8 199µs ± 1% 206µs ± 2% +3.47% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·12 315µs ± 1% 330µs ± 1% +4.73% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·16 434µs ± 1% 455µs ± 2% +4.69% (p=0.008 n=5+5)
31dc070d