-
Kirill Smelkov authored
Compared to yesterday shows not significant change, thus meaning benchmarking is more or less stable (+/- 5% at ·12 and ·16 is probably due to scheduling): $ benchstat -split node,cluster,dataset 20180305-deco-ffixed-c.txt 20180306-deco-ffixed-c.txt name old pystone/s new pystone/s delta node:deco pystone 219k ± 3% 217k ± 4% ~ (p=0.548 n=5+5) name old time/op new time/op delta node:deco crc32/py/4K 5.72µs ± 0% 5.73µs ± 0% ~ (p=0.460 n=5+5) crc32/go/4K 279ns ± 0% 279ns ± 0% ~ (all equal) sha1/py/4K 6.69µs ± 0% 6.74µs ± 1% +0.66% (p=0.024 n=5+5) sha1/go/4K 5.59µs ± 0% 5.60µs ± 0% +0.19% (p=0.008 n=5+5) unzlib/py/wczdata 27.2µs ± 0% 27.2µs ± 1% ~ (p=0.905 n=4+5) unzlib/go/wczdata 26.9µs ± 1% 27.0µs ± 0% ~ (p=0.222 n=5+5) unzlib/py/prod1-avg 5.06µs ± 0% 5.14µs ± 3% ~ (p=0.603 n=4+5) unzlib/go/prod1-avg 5.33µs ± 1% 5.30µs ± 1% ~ (p=0.087 n=5+5) disk/randread/direct/4K-min 105µs ± 0% 104µs ± 2% ~ (p=0.270 n=5+5) disk/randread/direct/4K-avg 142µs ± 0% 141µs ± 0% -0.31% (p=0.032 n=5+5) disk/randread/pagecache/4K-min 583ns ± 1% 579ns ± 2% ~ (p=0.246 n=5+5) disk/randread/pagecache/4K-avg 1.00µs ± 1% 0.99µs ± 0% -0.98% (p=0.024 n=5+5) name old time/object new time/object delta cluster:deco dataset:wczblk1-8 fs1-zhash.py 20.2µs ± 1% 20.3µs ± 1% ~ (p=0.571 n=4+4) fs1-zhash.go 3.20µs ± 0% 3.26µs ± 4% ~ (p=0.444 n=5+5) fs1-zhash.go+prefetch128 4.14µs ± 6% 4.04µs ± 1% ~ (p=0.444 n=5+5) zeo/py/fs1-zhash.py 379µs ± 3% 383µs ± 5% ~ (p=0.730 n=5+5) zeo/py/fs1-zhash.go 127µs ± 1% 126µs ± 1% ~ (p=0.317 n=4+5) zeo/py/fs1-zhash.go+prefetch128 64.1µs ± 2% 63.1µs ± 1% ~ (p=0.222 n=5+5) neo/py(!log)/sqlite-zhash.py 335µs ± 4% 344µs ± 6% ~ (p=0.421 n=5+5) neo/py(!log)/sqlite-zhash.go 145µs ± 2% 140µs ± 1% -3.07% (p=0.008 n=5+5) neo/py(!log)/sqlite-zhash.go+prefetch128 118µs ± 1% 119µs ± 2% ~ (p=0.548 n=5+5) neo/py(!log)/sql-zhash.py 454µs ±61% 386µs ± 1% ~ (p=1.000 n=5+4) neo/py(!log)/sql-zhash.go 183µs ± 1% 183µs ± 3% ~ (p=1.000 n=5+5) neo/py(!log)/sql-zhash.go+prefetch128 164µs ± 2% 164µs ± 3% ~ (p=0.690 n=5+5) neo/go/fs1-zhash.py 227µs ± 2% 226µs ± 3% ~ (p=0.690 n=5+5) neo/go/fs1-zhash.go 56.9µs ± 1% 57.1µs ± 0% ~ (p=0.119 n=5+5) neo/go/fs1-zhash.go+prefetch128 24.7µs ± 2% 24.7µs ± 5% ~ (p=0.571 n=5+5) neo/go/fs1(!sha1)-zhash.go(!sha1) 40.5µs ± 1% 40.2µs ± 1% ~ (p=0.254 n=5+5) neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 16.8µs ± 5% 17.1µs ± 6% ~ (p=0.579 n=5+5) neo/go/sqlite-zhash.py 269µs ± 1% 272µs ± 3% ~ (p=0.690 n=5+5) neo/go/sqlite-zhash.go 92.7µs ± 0% 92.8µs ± 0% ~ (p=0.397 n=5+4) neo/go/sqlite-zhash.go+prefetch128 39.8µs ± 8% 40.5µs ± 5% ~ (p=0.548 n=5+5) neo/go/sqlite-zhash.go(!sha1) 86.4µs ± 2% 86.5µs ± 2% ~ (p=0.571 n=5+5) neo/go/sqlite-zhash.go+prefetch128(!sha1) 40.1µs ±11% 38.8µs ± 9% ~ (p=0.579 n=5+5) cluster:deco dataset:prod1-1024 fs1-zhash.py 15.8µs ± 2% 15.8µs ± 3% ~ (p=0.629 n=4+4) fs1-zhash.go 2.80µs ± 0% 2.80µs ± 0% ~ (all equal) fs1-zhash.go+prefetch128 3.54µs ± 7% 3.42µs ± 8% ~ (p=0.381 n=5+5) zeo/py/fs1-zhash.py 362µs ± 6% 361µs ± 5% ~ (p=1.000 n=5+5) zeo/py/fs1-zhash.go 106µs ± 1% 105µs ± 0% ~ (p=0.214 n=5+5) zeo/py/fs1-zhash.go+prefetch128 58.9µs ± 1% 58.9µs ± 1% ~ (p=0.881 n=5+5) neo/py(!log)/sqlite-zhash.py 331µs ± 1% 344µs ± 7% ~ (p=0.063 n=5+5) neo/py(!log)/sqlite-zhash.go 136µs ± 1% 137µs ± 2% ~ (p=0.222 n=5+5) neo/py(!log)/sqlite-zhash.go+prefetch128 112µs ± 1% 114µs ± 1% +1.73% (p=0.008 n=5+5) neo/py(!log)/sql-zhash.py 389µs ± 6% 380µs ± 4% ~ (p=0.486 n=4+4) neo/py(!log)/sql-zhash.go 180µs ± 2% 180µs ± 1% ~ (p=0.548 n=5+5) neo/py(!log)/sql-zhash.go+prefetch128 157µs ± 1% 159µs ± 1% ~ (p=0.095 n=5+5) neo/go/fs1-zhash.py 223µs ± 0% 221µs ± 1% -0.79% (p=0.016 n=5+5) neo/go/fs1-zhash.go 44.9µs ± 1% 45.2µs ± 2% ~ (p=0.357 n=5+5) neo/go/fs1-zhash.go+prefetch128 17.6µs ± 5% 17.6µs ± 2% ~ (p=1.000 n=5+5) neo/go/fs1(!sha1)-zhash.go(!sha1) 39.1µs ± 1% 39.1µs ± 2% ~ (p=0.714 n=5+5) neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1) 14.8µs ± 3% 14.6µs ± 4% ~ (p=0.302 n=5+5) neo/go/sqlite-zhash.py 269µs ± 3% 271µs ± 2% ~ (p=0.548 n=5+5) neo/go/sqlite-zhash.go 86.0µs ± 1% 86.4µs ± 0% ~ (p=0.206 n=5+5) neo/go/sqlite-zhash.go+prefetch128 36.4µs ± 6% 35.8µs ± 2% ~ (p=0.532 n=5+5) neo/go/sqlite-zhash.go(!sha1) 83.6µs ± 1% 84.0µs ± 1% ~ (p=0.516 n=5+5) neo/go/sqlite-zhash.go+prefetch128(!sha1) 35.9µs ± 5% 36.5µs ± 5% ~ (p=0.444 n=5+5) name old req/s new req/s delta cluster:deco dataset:wczblk1-8 fs1-zwrk.go·1 438k ± 1% 436k ± 0% ~ (p=0.222 n=5+5) fs1-zwrk.go·2 745k ± 1% 744k ± 1% ~ (p=0.548 n=5+5) fs1-zwrk.go·3 1.09M ± 0% 1.09M ± 0% ~ (p=0.095 n=5+5) fs1-zwrk.go·4 1.15M ± 1% 1.16M ± 1% ~ (p=0.095 n=5+5) fs1-zwrk.go·8 1.27M ± 1% 1.27M ± 1% ~ (p=0.841 n=5+5) fs1-zwrk.go·12 1.27M ± 1% 1.27M ± 1% ~ (p=0.690 n=5+5) fs1-zwrk.go·16 1.28M ± 1% 1.27M ± 1% ~ (p=0.841 n=5+5) zeo/py/fs1-zwrk.go·1 9.04k ± 1% 9.12k ± 0% +0.89% (p=0.008 n=5+5) zeo/py/fs1-zwrk.go·2 11.4k ± 1% 11.6k ± 1% +1.58% (p=0.008 n=5+5) zeo/py/fs1-zwrk.go·3 13.4k ± 1% 13.4k ± 1% ~ (p=0.310 n=5+5) zeo/py/fs1-zwrk.go·4 14.0k ± 1% 14.0k ± 1% ~ (p=0.595 n=5+5) zeo/py/fs1-zwrk.go·8 14.6k ± 4% 14.7k ± 1% ~ (p=0.690 n=5+5) zeo/py/fs1-zwrk.go·12 14.9k ± 1% 15.0k ± 1% ~ (p=0.421 n=5+5) zeo/py/fs1-zwrk.go·16 15.3k ± 1% 15.1k ± 0% -0.79% (p=0.016 n=5+5) neo/py(!log)/sqlite-zwrk.go·1 7.03k ± 3% 7.09k ± 1% ~ (p=0.310 n=5+5) neo/py(!log)/sqlite-zwrk.go·2 8.52k ± 1% 8.48k ± 1% ~ (p=0.151 n=5+5) neo/py(!log)/sqlite-zwrk.go·3 8.48k ± 1% 8.48k ± 1% ~ (p=0.690 n=5+5) neo/py(!log)/sqlite-zwrk.go·4 8.45k ± 1% 8.47k ± 1% ~ (p=0.841 n=5+5) neo/py(!log)/sqlite-zwrk.go·8 8.44k ± 1% 8.43k ± 1% ~ (p=0.690 n=5+5) neo/py(!log)/sqlite-zwrk.go·12 8.48k ± 1% 8.46k ± 1% ~ (p=0.841 n=5+5) neo/py(!log)/sqlite-zwrk.go·16 8.49k ± 1% 8.46k ± 1% ~ (p=0.310 n=5+5) neo/py(!log)/sql-zwrk.go·1 5.51k ± 1% 5.51k ± 1% ~ (p=1.000 n=5+5) neo/py(!log)/sql-zwrk.go·2 6.31k ± 1% 6.32k ± 1% ~ (p=0.841 n=5+5) neo/py(!log)/sql-zwrk.go·3 6.20k ± 1% 6.29k ± 1% +1.37% (p=0.008 n=5+5) neo/py(!log)/sql-zwrk.go·4 6.22k ± 1% 6.27k ± 1% +0.83% (p=0.008 n=5+5) neo/py(!log)/sql-zwrk.go·8 6.25k ± 1% 6.27k ± 1% ~ (p=0.548 n=5+5) neo/py(!log)/sql-zwrk.go·12 6.26k ± 1% 6.29k ± 0% ~ (p=0.841 n=5+5) neo/py(!log)/sql-zwrk.go·16 6.26k ± 1% 6.22k ± 1% ~ (p=0.421 n=5+5) neo/go/fs1-zwrk.go·1 18.4k ± 0% 18.4k ± 1% ~ (p=0.167 n=5+5) neo/go/fs1-zwrk.go·2 38.2k ± 1% 38.1k ± 1% ~ (p=0.841 n=5+5) neo/go/fs1-zwrk.go·3 45.8k ± 1% 46.0k ± 1% ~ (p=0.421 n=5+5) neo/go/fs1-zwrk.go·4 49.8k ± 0% 50.2k ± 1% +0.94% (p=0.008 n=5+5) neo/go/fs1-zwrk.go·8 60.3k ± 1% 61.0k ± 0% +1.16% (p=0.016 n=5+5) neo/go/fs1-zwrk.go·12 61.6k ± 1% 62.1k ± 1% ~ (p=0.222 n=5+5) neo/go/fs1-zwrk.go·16 61.4k ± 1% 62.5k ± 1% ~ (p=0.095 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 26.1k ± 1% 26.3k ± 1% ~ (p=0.222 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 55.3k ± 1% 55.3k ± 1% ~ (p=1.000 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 62.7k ± 1% 62.7k ± 1% ~ (p=0.841 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 69.1k ± 0% 69.3k ± 1% ~ (p=0.421 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 87.9k ± 0% 88.2k ± 0% ~ (p=0.310 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 92.2k ± 1% 93.4k ± 0% +1.32% (p=0.008 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 93.4k ± 1% 93.5k ± 2% ~ (p=0.690 n=5+5) neo/go/sqlite-zwrk.go·1 11.1k ± 0% 11.0k ± 1% ~ (p=0.421 n=5+5) neo/go/sqlite-zwrk.go·2 18.5k ± 0% 18.4k ± 1% -0.68% (p=0.016 n=5+5) neo/go/sqlite-zwrk.go·3 24.5k ± 0% 24.4k ± 1% ~ (p=0.151 n=5+5) neo/go/sqlite-zwrk.go·4 26.9k ± 1% 26.8k ± 0% ~ (p=0.151 n=5+5) neo/go/sqlite-zwrk.go·8 29.9k ± 2% 30.4k ± 2% ~ (p=0.310 n=5+5) neo/go/sqlite-zwrk.go·12 29.2k ± 2% 30.5k ± 1% +4.49% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go·16 28.4k ± 2% 29.9k ± 2% +5.53% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·1 11.8k ± 0% 11.9k ± 1% ~ (p=0.063 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·2 19.5k ± 0% 19.7k ± 0% +0.60% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·3 26.8k ± 1% 26.5k ± 1% -1.14% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·4 30.3k ± 1% 30.0k ± 0% -1.12% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·8 32.0k ± 2% 31.2k ± 2% -2.46% (p=0.032 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·12 30.2k ± 3% 28.9k ± 1% -4.20% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·16 29.7k ± 1% 28.4k ± 2% -4.27% (p=0.008 n=5+5) cluster:deco dataset:prod1-1024 fs1-zwrk.go·1 555k ± 0% 555k ± 0% ~ (p=1.000 n=5+5) fs1-zwrk.go·2 982k ± 2% 1008k ± 3% +2.66% (p=0.032 n=5+5) fs1-zwrk.go·3 1.32M ± 1% 1.32M ± 1% ~ (p=0.421 n=5+5) fs1-zwrk.go·4 1.51M ± 1% 1.55M ± 2% +2.80% (p=0.032 n=5+5) fs1-zwrk.go·8 1.58M ± 1% 1.59M ± 0% ~ (p=0.548 n=5+5) fs1-zwrk.go·12 1.59M ± 0% 1.59M ± 0% ~ (p=0.548 n=5+5) fs1-zwrk.go·16 1.59M ± 0% 1.59M ± 0% ~ (p=0.095 n=5+5) zeo/py/fs1-zwrk.go·1 9.70k ± 1% 9.70k ± 0% ~ (p=1.000 n=5+5) zeo/py/fs1-zwrk.go·2 12.2k ± 1% 12.4k ± 1% +1.67% (p=0.008 n=5+5) zeo/py/fs1-zwrk.go·3 14.2k ± 1% 14.2k ± 1% ~ (p=0.095 n=5+5) zeo/py/fs1-zwrk.go·4 14.9k ± 0% 14.9k ± 0% ~ (p=0.841 n=5+5) zeo/py/fs1-zwrk.go·8 15.6k ± 0% 15.6k ± 0% ~ (p=0.548 n=5+5) zeo/py/fs1-zwrk.go·12 15.9k ± 1% 15.2k ±11% ~ (p=0.310 n=5+5) zeo/py/fs1-zwrk.go·16 16.1k ± 0% 16.1k ± 1% ~ (p=0.421 n=5+5) neo/py(!log)/sqlite-zwrk.go·1 7.51k ± 1% 7.44k ± 1% -0.91% (p=0.016 n=5+5) neo/py(!log)/sqlite-zwrk.go·2 8.72k ± 1% 8.59k ± 1% -1.45% (p=0.008 n=5+5) neo/py(!log)/sqlite-zwrk.go·3 8.69k ± 1% 8.61k ± 1% ~ (p=0.095 n=5+5) neo/py(!log)/sqlite-zwrk.go·4 8.67k ± 1% 8.57k ± 1% ~ (p=0.095 n=5+5) neo/py(!log)/sqlite-zwrk.go·8 8.72k ± 0% 8.56k ± 1% -1.83% (p=0.008 n=5+5) neo/py(!log)/sqlite-zwrk.go·12 8.63k ± 1% 8.51k ± 1% ~ (p=0.056 n=5+5) neo/py(!log)/sqlite-zwrk.go·16 8.64k ± 1% 8.54k ± 1% ~ (p=0.095 n=5+5) neo/py(!log)/sql-zwrk.go·1 5.56k ± 2% 5.55k ± 2% ~ (p=1.000 n=5+5) neo/py(!log)/sql-zwrk.go·2 6.42k ± 0% 6.36k ± 1% -0.97% (p=0.032 n=5+5) neo/py(!log)/sql-zwrk.go·3 6.40k ± 0% 6.31k ± 0% -1.44% (p=0.008 n=5+5) neo/py(!log)/sql-zwrk.go·4 6.38k ± 1% 6.28k ± 0% -1.57% (p=0.008 n=5+5) neo/py(!log)/sql-zwrk.go·8 6.39k ± 1% 6.34k ± 1% ~ (p=0.056 n=5+5) neo/py(!log)/sql-zwrk.go·12 6.42k ± 1% 6.35k ± 1% -1.11% (p=0.016 n=5+5) neo/py(!log)/sql-zwrk.go·16 6.41k ± 2% 6.36k ± 0% ~ (p=0.151 n=5+5) neo/go/fs1-zwrk.go·1 23.8k ± 0% 23.7k ± 0% -0.33% (p=0.032 n=5+5) neo/go/fs1-zwrk.go·2 45.0k ± 1% 45.4k ± 0% +0.93% (p=0.032 n=5+5) neo/go/fs1-zwrk.go·3 55.1k ± 1% 55.2k ± 1% ~ (p=1.000 n=5+5) neo/go/fs1-zwrk.go·4 60.1k ± 0% 60.7k ± 2% ~ (p=0.151 n=5+5) neo/go/fs1-zwrk.go·8 68.3k ± 2% 70.9k ± 2% +3.72% (p=0.016 n=5+5) neo/go/fs1-zwrk.go·12 69.3k ± 5% 71.1k ± 3% ~ (p=0.310 n=5+5) neo/go/fs1-zwrk.go·16 68.8k ± 6% 71.0k ± 3% ~ (p=0.690 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 27.3k ± 0% 27.3k ± 0% ~ (p=0.095 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 54.9k ± 1% 55.4k ± 1% ~ (p=0.095 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 64.0k ± 0% 64.0k ± 1% ~ (p=0.841 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 68.7k ± 1% 69.0k ± 1% ~ (p=0.222 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 79.4k ± 2% 80.9k ± 2% ~ (p=0.222 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 77.9k ± 2% 78.3k ± 5% ~ (p=1.000 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 75.3k ± 6% 75.4k ± 3% ~ (p=1.000 n=5+5) neo/go/sqlite-zwrk.go·1 11.8k ± 0% 11.7k ± 1% ~ (p=0.095 n=5+5) neo/go/sqlite-zwrk.go·2 19.2k ± 0% 19.0k ± 0% -0.85% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go·3 24.5k ± 1% 24.5k ± 1% ~ (p=1.000 n=5+5) neo/go/sqlite-zwrk.go·4 26.6k ± 1% 26.3k ± 1% -1.38% (p=0.016 n=5+5) neo/go/sqlite-zwrk.go·8 25.1k ± 3% 24.9k ± 3% ~ (p=0.421 n=5+5) neo/go/sqlite-zwrk.go·12 23.8k ± 2% 24.0k ± 5% ~ (p=1.000 n=5+5) neo/go/sqlite-zwrk.go·16 24.3k ± 2% 25.4k ± 1% +4.53% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·1 12.1k ± 1% 12.2k ± 0% ~ (p=0.151 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·2 19.6k ± 0% 19.8k ± 0% +0.98% (p=0.016 n=4+5) neo/go/sqlite-zwrk.go(!sha1)·3 25.3k ± 1% 26.2k ± 1% +3.40% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·4 27.3k ± 1% 28.7k ± 1% +5.03% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·8 25.4k ± 3% 27.2k ± 3% +6.78% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·12 23.8k ± 2% 25.3k ± 2% +6.21% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·16 23.9k ± 2% 25.3k ± 1% +6.14% (p=0.008 n=5+5) name old latency-time/object new latency-time/object delta cluster:deco dataset:wczblk1-8 fs1-zwrk.go·1 2.29µs ± 1% 2.29µs ± 0% ~ (p=0.222 n=5+5) fs1-zwrk.go·2 2.68µs ± 1% 2.69µs ± 1% ~ (p=0.524 n=5+5) fs1-zwrk.go·3 2.76µs ± 0% 2.76µs ± 0% ~ (p=0.111 n=5+5) fs1-zwrk.go·4 3.46µs ± 1% 3.44µs ± 1% ~ (p=0.095 n=5+5) fs1-zwrk.go·8 6.28µs ± 1% 6.28µs ± 1% ~ (p=0.889 n=5+5) fs1-zwrk.go·12 9.42µs ± 1% 9.46µs ± 1% ~ (p=0.690 n=5+5) fs1-zwrk.go·16 12.5µs ± 1% 12.6µs ± 1% ~ (p=0.841 n=5+5) zeo/py/fs1-zwrk.go·1 111µs ± 1% 110µs ± 0% -0.88% (p=0.008 n=5+5) zeo/py/fs1-zwrk.go·2 176µs ± 1% 173µs ± 1% -1.56% (p=0.008 n=5+5) zeo/py/fs1-zwrk.go·3 224µs ± 1% 224µs ± 1% ~ (p=0.310 n=5+5) zeo/py/fs1-zwrk.go·4 285µs ± 1% 286µs ± 1% ~ (p=0.690 n=5+5) zeo/py/fs1-zwrk.go·8 549µs ± 4% 545µs ± 1% ~ (p=0.690 n=5+5) zeo/py/fs1-zwrk.go·12 805µs ± 1% 802µs ± 1% ~ (p=0.421 n=5+5) zeo/py/fs1-zwrk.go·16 1.05ms ± 1% 1.06ms ± 0% +0.80% (p=0.016 n=5+5) neo/py(!log)/sqlite-zwrk.go·1 142µs ± 3% 141µs ± 1% ~ (p=0.310 n=5+5) neo/py(!log)/sqlite-zwrk.go·2 235µs ± 1% 236µs ± 1% ~ (p=0.151 n=5+5) neo/py(!log)/sqlite-zwrk.go·3 354µs ± 1% 354µs ± 1% ~ (p=0.690 n=5+5) neo/py(!log)/sqlite-zwrk.go·4 473µs ± 1% 472µs ± 1% ~ (p=0.841 n=5+5) neo/py(!log)/sqlite-zwrk.go·8 948µs ± 1% 949µs ± 1% ~ (p=0.690 n=5+5) neo/py(!log)/sqlite-zwrk.go·12 1.42ms ± 1% 1.42ms ± 1% ~ (p=0.841 n=5+5) neo/py(!log)/sqlite-zwrk.go·16 1.88ms ± 1% 1.89ms ± 1% ~ (p=0.310 n=5+5) neo/py(!log)/sql-zwrk.go·1 181µs ± 1% 181µs ± 1% ~ (p=1.000 n=5+5) neo/py(!log)/sql-zwrk.go·2 317µs ± 1% 317µs ± 1% ~ (p=0.841 n=5+5) neo/py(!log)/sql-zwrk.go·3 484µs ± 1% 477µs ± 1% -1.36% (p=0.008 n=5+5) neo/py(!log)/sql-zwrk.go·4 643µs ± 1% 638µs ± 1% -0.82% (p=0.008 n=5+5) neo/py(!log)/sql-zwrk.go·8 1.28ms ± 1% 1.28ms ± 1% ~ (p=0.548 n=5+5) neo/py(!log)/sql-zwrk.go·12 1.92ms ± 1% 1.91ms ± 0% ~ (p=0.841 n=5+5) neo/py(!log)/sql-zwrk.go·16 2.56ms ± 1% 2.57ms ± 1% ~ (p=0.421 n=5+5) neo/go/fs1-zwrk.go·1 54.5µs ± 0% 54.2µs ± 1% ~ (p=0.167 n=5+5) neo/go/fs1-zwrk.go·2 52.4µs ± 1% 52.5µs ± 1% ~ (p=0.841 n=5+5) neo/go/fs1-zwrk.go·3 65.4µs ± 1% 65.3µs ± 1% ~ (p=0.421 n=5+5) neo/go/fs1-zwrk.go·4 80.4µs ± 0% 79.6µs ± 1% -0.93% (p=0.008 n=5+5) neo/go/fs1-zwrk.go·8 133µs ± 1% 131µs ± 0% -1.15% (p=0.016 n=5+5) neo/go/fs1-zwrk.go·12 195µs ± 1% 193µs ± 1% ~ (p=0.222 n=5+5) neo/go/fs1-zwrk.go·16 261µs ± 1% 256µs ± 1% ~ (p=0.095 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 38.3µs ± 1% 38.0µs ± 1% ~ (p=0.222 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 36.2µs ± 1% 36.1µs ± 1% ~ (p=1.000 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 47.8µs ± 1% 47.8µs ± 1% ~ (p=0.841 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 57.9µs ± 0% 57.7µs ± 1% ~ (p=0.421 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 91.0µs ± 0% 90.7µs ± 0% ~ (p=0.310 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 130µs ± 1% 129µs ± 0% -1.31% (p=0.008 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 171µs ± 1% 171µs ± 2% ~ (p=0.690 n=5+5) neo/go/sqlite-zwrk.go·1 90.4µs ± 0% 90.7µs ± 1% ~ (p=0.421 n=5+5) neo/go/sqlite-zwrk.go·2 108µs ± 0% 109µs ± 1% +0.69% (p=0.016 n=5+5) neo/go/sqlite-zwrk.go·3 123µs ± 0% 123µs ± 1% ~ (p=0.151 n=5+5) neo/go/sqlite-zwrk.go·4 148µs ± 1% 149µs ± 0% ~ (p=0.151 n=5+5) neo/go/sqlite-zwrk.go·8 267µs ± 2% 263µs ± 2% ~ (p=0.310 n=5+5) neo/go/sqlite-zwrk.go·12 411µs ± 2% 393µs ± 1% -4.31% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go·16 564µs ± 2% 534µs ± 2% -5.24% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·1 84.5µs ± 0% 84.0µs ± 1% ~ (p=0.063 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·2 102µs ± 0% 102µs ± 0% -0.60% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·3 112µs ± 1% 113µs ± 1% +1.16% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·4 132µs ± 1% 133µs ± 0% +1.13% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·8 250µs ± 2% 257µs ± 2% +2.52% (p=0.032 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·12 397µs ± 3% 415µs ± 1% +4.38% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·16 539µs ± 1% 563µs ± 2% +4.47% (p=0.008 n=5+5) cluster:deco dataset:prod1-1024 fs1-zwrk.go·1 1.80µs ± 0% 1.80µs ± 0% ~ (p=0.968 n=5+5) fs1-zwrk.go·2 2.04µs ± 2% 1.98µs ± 3% -2.55% (p=0.032 n=5+5) fs1-zwrk.go·3 2.28µs ± 1% 2.27µs ± 1% ~ (p=0.389 n=5+5) fs1-zwrk.go·4 2.65µs ± 1% 2.58µs ± 2% -2.71% (p=0.032 n=5+5) fs1-zwrk.go·8 5.05µs ± 1% 5.04µs ± 0% ~ (p=0.548 n=5+5) fs1-zwrk.go·12 7.54µs ± 0% 7.55µs ± 0% ~ (p=0.571 n=5+5) fs1-zwrk.go·16 10.1µs ± 0% 10.0µs ± 0% ~ (p=0.095 n=5+5) zeo/py/fs1-zwrk.go·1 103µs ± 1% 103µs ± 0% ~ (p=1.000 n=5+5) zeo/py/fs1-zwrk.go·2 164µs ± 1% 162µs ± 1% -1.64% (p=0.008 n=5+5) zeo/py/fs1-zwrk.go·3 211µs ± 1% 212µs ± 1% ~ (p=0.095 n=5+5) zeo/py/fs1-zwrk.go·4 269µs ± 0% 269µs ± 0% ~ (p=0.841 n=5+5) zeo/py/fs1-zwrk.go·8 512µs ± 0% 512µs ± 0% ~ (p=0.548 n=5+5) zeo/py/fs1-zwrk.go·12 755µs ± 1% 793µs ±12% ~ (p=0.310 n=5+5) zeo/py/fs1-zwrk.go·16 993µs ± 0% 991µs ± 1% ~ (p=0.421 n=5+5) neo/py(!log)/sqlite-zwrk.go·1 133µs ± 1% 134µs ± 1% +0.92% (p=0.016 n=5+5) neo/py(!log)/sqlite-zwrk.go·2 229µs ± 1% 233µs ± 1% +1.47% (p=0.008 n=5+5) neo/py(!log)/sqlite-zwrk.go·3 345µs ± 1% 348µs ± 1% ~ (p=0.095 n=5+5) neo/py(!log)/sqlite-zwrk.go·4 461µs ± 1% 467µs ± 1% ~ (p=0.095 n=5+5) neo/py(!log)/sqlite-zwrk.go·8 917µs ± 0% 935µs ± 1% +1.87% (p=0.008 n=5+5) neo/py(!log)/sqlite-zwrk.go·12 1.39ms ± 1% 1.41ms ± 1% ~ (p=0.056 n=5+5) neo/py(!log)/sqlite-zwrk.go·16 1.85ms ± 1% 1.87ms ± 1% ~ (p=0.095 n=5+5) neo/py(!log)/sql-zwrk.go·1 180µs ± 2% 180µs ± 2% ~ (p=1.000 n=5+5) neo/py(!log)/sql-zwrk.go·2 311µs ± 0% 315µs ± 1% +0.99% (p=0.032 n=5+5) neo/py(!log)/sql-zwrk.go·3 468µs ± 0% 475µs ± 0% +1.47% (p=0.008 n=5+5) neo/py(!log)/sql-zwrk.go·4 627µs ± 1% 637µs ± 0% +1.59% (p=0.008 n=5+5) neo/py(!log)/sql-zwrk.go·8 1.25ms ± 1% 1.26ms ± 1% ~ (p=0.056 n=5+5) neo/py(!log)/sql-zwrk.go·12 1.87ms ± 1% 1.89ms ± 1% +1.13% (p=0.016 n=5+5) neo/py(!log)/sql-zwrk.go·16 2.50ms ± 2% 2.52ms ± 0% ~ (p=0.151 n=5+5) neo/go/fs1-zwrk.go·1 42.0µs ± 0% 42.2µs ± 0% +0.33% (p=0.032 n=5+5) neo/go/fs1-zwrk.go·2 44.5µs ± 1% 44.1µs ± 0% -0.92% (p=0.032 n=5+5) neo/go/fs1-zwrk.go·3 54.5µs ± 1% 54.4µs ± 1% ~ (p=1.000 n=5+5) neo/go/fs1-zwrk.go·4 66.5µs ± 0% 65.9µs ± 2% ~ (p=0.151 n=5+5) neo/go/fs1-zwrk.go·8 117µs ± 2% 113µs ± 2% -3.59% (p=0.016 n=5+5) neo/go/fs1-zwrk.go·12 173µs ± 4% 169µs ± 4% ~ (p=0.310 n=5+5) neo/go/fs1-zwrk.go·16 233µs ± 6% 225µs ± 3% ~ (p=0.690 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·1 36.7µs ± 0% 36.6µs ± 0% ~ (p=0.095 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·2 36.4µs ± 1% 36.1µs ± 1% ~ (p=0.095 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·3 46.9µs ± 0% 46.9µs ± 1% ~ (p=0.841 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·4 58.2µs ± 1% 57.9µs ± 1% ~ (p=0.222 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·8 101µs ± 2% 99µs ± 2% ~ (p=0.222 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·12 154µs ± 2% 153µs ± 5% ~ (p=1.000 n=5+5) neo/go/fs1(!sha1)-zwrk.go(!sha1)·16 213µs ± 6% 212µs ± 3% ~ (p=1.000 n=5+5) neo/go/sqlite-zwrk.go·1 84.7µs ± 0% 85.1µs ± 1% ~ (p=0.095 n=5+5) neo/go/sqlite-zwrk.go·2 104µs ± 0% 105µs ± 0% +0.86% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go·3 123µs ± 1% 123µs ± 1% ~ (p=1.000 n=5+5) neo/go/sqlite-zwrk.go·4 150µs ± 1% 152µs ± 1% +1.40% (p=0.016 n=5+5) neo/go/sqlite-zwrk.go·8 319µs ± 3% 321µs ± 3% ~ (p=0.421 n=5+5) neo/go/sqlite-zwrk.go·12 504µs ± 2% 500µs ± 5% ~ (p=1.000 n=5+5) neo/go/sqlite-zwrk.go·16 659µs ± 2% 630µs ± 1% -4.34% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·1 82.5µs ± 1% 82.0µs ± 0% ~ (p=0.151 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·2 102µs ± 0% 101µs ± 0% -0.97% (p=0.016 n=4+5) neo/go/sqlite-zwrk.go(!sha1)·3 119µs ± 1% 115µs ± 1% -3.29% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·4 146µs ± 1% 139µs ± 1% -4.78% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·8 315µs ± 3% 295µs ± 3% -6.37% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·12 503µs ± 2% 474µs ± 2% -5.86% (p=0.008 n=5+5) neo/go/sqlite-zwrk.go(!sha1)·16 671µs ± 2% 632µs ± 1% -5.79% (p=0.008 n=5+5)
dabeb4b8