• Kirill Smelkov's avatar
    X neo1: localhost timings, C > C1 disabled · f40c8b4b
    Kirill Smelkov authored
    $ benchstat -split node,cluster,dataset 20180306-neo1-ffixed-c.txt 20180306-neo1-ffixed-noc_C1\(3µs\).txt
    
    Disabling C states helps serial cases for zeo/py and neo/py/sqlite and
    both serial and parallel cases for neo/py/sql. For neo/py/sql it also
    denoises the timing.
    
    ---- 8< ----
    cluster:neo1 dataset:wczblk1-8
    zeo/py/fs1-zhash.py                                         523µs ± 1%               465µs ± 4%  -11.04%  (p=0.008 n=5+5)
    zeo/py/fs1-zhash.go                                         194µs ± 4%               173µs ± 2%  -10.70%  (p=0.008 n=5+5)
    neo/py(!log)/sqlite-zhash.py                                684µs ± 3%               389µs ± 1%  -43.08%  (p=0.008 n=5+5)
    neo/py(!log)/sqlite-zhash.go                                236µs ± 2%               198µs ± 5%  -16.19%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zhash.py                                   942µs ±47%               448µs ± 3%  -52.47%  (p=0.016 n=5+4)
    neo/py(!log)/sql-zhash.go                                   300µs ±17%               251µs ± 2%  -16.37%  (p=0.008 n=5+5)
    
    zeo/py/fs1-zwrk.go·1                                        194µs ± 1%               171µs ± 1%  -11.93%  (p=0.008 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·1                               232µs ± 4%               198µs ± 3%  -14.97%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·1                                  323µs ± 6%               242µs ± 1%  -24.90%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·2                                  503µs ± 2%               421µs ± 5%  -16.28%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·3                                  742µs ± 3%               639µs ± 4%  -13.97%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·4                                  986µs ± 4%               838µs ± 2%  -15.02%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·8                                 2.11ms ± 8%              1.71ms ± 4%  -18.91%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·12                                3.02ms ± 3%              2.57ms ± 3%  -14.83%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·16                                4.06ms ± 1%              3.39ms ± 3%  -16.33%  (p=0.008 n=5+5)
    
    cluster:neo1 dataset:prod1-1024
    zeo/py/fs1-zhash.go                                         170µs ± 3%               148µs ± 3%  -13.05%  (p=0.008 n=5+5)
    neo/py(!log)/sqlite-zhash.py                                665µs ± 2%               382µs ± 3%  -42.60%  (p=0.008 n=5+5)
    neo/py(!log)/sqlite-zhash.go                                219µs ± 2%               181µs ± 1%  -17.27%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zhash.py                                   886µs ±56%               426µs ± 1%  -51.90%  (p=0.016 n=5+4)
    neo/py(!log)/sql-zhash.go                                   298µs ± 9%               234µs ± 2%  -21.22%  (p=0.008 n=5+5)
    
    zeo/py/fs1-zwrk.go·1                                        173µs ± 3%               146µs ± 2%  -15.31%  (p=0.008 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·1                               204µs ± 8%               182µs ± 3%  -11.14%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·1                                  287µs ± 8%               236µs ± 8%  -17.73%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·2                                  495µs ± 6%               406µs ± 1%  -17.95%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·3                                  740µs ± 8%               618µs ± 3%  -16.50%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·4                                 1.01ms ± 4%              0.82ms ± 2%  -18.75%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·8                                 1.93ms ± 3%              1.64ms ± 1%  -15.14%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·12                                3.01ms ± 4%              2.45ms ± 3%  -18.53%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·16                                4.05ms ±10%              3.33ms ± 8%  -17.74%  (p=0.008 n=5+5)
    ---- 8< ----
    
    It looks to be also helping to neo/go/* with python (thus slower)
    client:
    
    ---- 8< ----
    cluster:neo1 dataset:wczblk1-8
    neo/go/fs1-zhash.py                                         383µs ±20%               270µs ± 2%  -29.62%  (p=0.008 n=5+5)
    neo/go/sqlite-zhash.py                                      402µs ± 6%               323µs ± 1%  -19.66%  (p=0.008 n=5+5)
    
    cluster:neo1 dataset:prod1-1024
    neo/go/fs1-zhash.py                                         319µs ±11%               260µs ± 2%  -18.46%  (p=0.008 n=5+5)
    neo/go/sqlite-zhash.py                                      382µs ± 6%               310µs ± 2%  -19.04%  (p=0.008 n=5+5)
    ---- 8< ----
    
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
    
    $ benchstat -split node,cluster,dataset 20180306-neo1-ffixed-c.txt 20180306-neo1-ffixed-noc_C1\(3µs\).txt
    
    name                                           old pystone/s            new pystone/s            delta
    node:neo1
    pystone                                                      106k ± 1%                106k ± 1%     ~     (p=0.548 n=5+5)
    
    name                                           old time/op              new time/op              delta
    node:neo1
    crc32/py/4K                                                5.13µs ± 1%              5.13µs ± 1%     ~     (p=1.000 n=5+5)
    crc32/go/4K                                                2.79µs ± 0%              2.79µs ± 0%   -0.06%  (p=0.032 n=5+5)
    sha1/py/4K                                                 13.4µs ± 1%              13.5µs ± 1%     ~     (p=0.548 n=5+5)
    sha1/go/4K                                                 9.83µs ± 0%              9.85µs ± 1%     ~     (p=0.905 n=5+4)
    unzlib/py/wczdata                                          36.1µs ± 0%              36.1µs ± 1%     ~     (p=0.841 n=5+5)
    unzlib/go/wczdata                                          31.1µs ± 1%              30.9µs ± 1%     ~     (p=0.111 n=5+5)
    unzlib/py/prod1-avg                                        16.3µs ± 2%              16.8µs ±10%     ~     (p=0.548 n=5+5)
    unzlib/go/prod1-avg                                        9.42µs ± 0%              9.27µs ± 1%   -1.58%  (p=0.008 n=5+5)
    disk/randread/direct/4K-min                                 162µs ± 0%               162µs ± 0%     ~     (p=0.270 n=5+4)
    disk/randread/direct/4K-avg                                 187µs ± 2%               172µs ± 0%   -8.20%  (p=0.008 n=5+5)
    disk/randread/pagecache/4K-min                              389ns ± 1%               390ns ± 1%     ~     (p=0.548 n=5+5)
    disk/randread/pagecache/4K-avg                              804ns ± 0%               894ns ± 0%  +11.28%  (p=0.016 n=4+5)
    
    name                                           old time/object          new time/object          delta
    cluster:neo1 dataset:wczblk1-8
    fs1-zhash.py                                               34.7µs ± 2%              34.4µs ± 2%     ~     (p=0.119 n=5+5)
    fs1-zhash.go                                               6.00µs ± 2%              5.90µs ± 0%     ~     (p=0.095 n=5+4)
    fs1-zhash.go+prefetch128                                   6.52µs ± 4%              6.26µs ± 3%     ~     (p=0.079 n=5+5)
    zeo/py/fs1-zhash.py                                         523µs ± 1%               465µs ± 4%  -11.04%  (p=0.008 n=5+5)
    zeo/py/fs1-zhash.go                                         194µs ± 4%               173µs ± 2%  -10.70%  (p=0.008 n=5+5)
    zeo/py/fs1-zhash.go+prefetch128                            98.6µs ± 3%              98.8µs ± 1%     ~     (p=0.810 n=5+5)
    neo/py(!log)/sqlite-zhash.py                                684µs ± 3%               389µs ± 1%  -43.08%  (p=0.008 n=5+5)
    neo/py(!log)/sqlite-zhash.go                                236µs ± 2%               198µs ± 5%  -16.19%  (p=0.008 n=5+5)
    neo/py(!log)/sqlite-zhash.go+prefetch128                    162µs ± 2%               165µs ± 4%     ~     (p=0.310 n=5+5)
    neo/py(!log)/sql-zhash.py                                   942µs ±47%               448µs ± 3%  -52.47%  (p=0.016 n=5+4)
    neo/py(!log)/sql-zhash.go                                   300µs ±17%               251µs ± 2%  -16.37%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zhash.go+prefetch128                       240µs ± 6%               220µs ± 1%   -8.51%  (p=0.008 n=5+5)
    neo/go/fs1-zhash.py                                         383µs ±20%               270µs ± 2%  -29.62%  (p=0.008 n=5+5)
    neo/go/fs1-zhash.go                                        81.3µs ± 1%              81.0µs ± 4%     ~     (p=0.690 n=5+5)
    neo/go/fs1-zhash.go+prefetch128                            33.8µs ± 5%              34.9µs ± 6%     ~     (p=0.381 n=5+5)
    neo/go/fs1(!sha1)-zhash.go(!sha1)                          57.6µs ± 3%              56.0µs ± 3%   -2.71%  (p=0.024 n=5+5)
    neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              22.9µs ± 6%              22.7µs ± 7%     ~     (p=1.000 n=5+5)
    neo/go/sqlite-zhash.py                                      402µs ± 6%               323µs ± 1%  -19.66%  (p=0.008 n=5+5)
    neo/go/sqlite-zhash.go                                      125µs ± 1%               124µs ± 1%     ~     (p=0.056 n=5+5)
    neo/go/sqlite-zhash.go+prefetch128                         48.4µs ± 8%              46.9µs ± 2%     ~     (p=0.690 n=5+5)
    neo/go/sqlite-zhash.go(!sha1)                               116µs ± 2%               113µs ± 2%   -1.96%  (p=0.032 n=5+5)
    neo/go/sqlite-zhash.go+prefetch128(!sha1)                  45.9µs ± 5%              46.6µs ± 4%     ~     (p=0.341 n=5+5)
    cluster:neo1 dataset:prod1-1024
    fs1-zhash.py                                               28.9µs ± 1%              28.9µs ± 1%     ~     (p=0.746 n=5+5)
    fs1-zhash.go                                               3.76µs ± 4%              3.76µs ± 2%     ~     (p=1.000 n=5+5)
    fs1-zhash.go+prefetch128                                   3.86µs ± 2%              3.74µs ± 2%   -3.11%  (p=0.048 n=5+5)
    zeo/py/fs1-zhash.py                                         474µs ± 2%               442µs ± 9%     ~     (p=0.095 n=5+5)
    zeo/py/fs1-zhash.go                                         170µs ± 3%               148µs ± 3%  -13.05%  (p=0.008 n=5+5)
    zeo/py/fs1-zhash.go+prefetch128                            87.8µs ± 1%              87.9µs ± 2%     ~     (p=0.881 n=5+5)
    neo/py(!log)/sqlite-zhash.py                                665µs ± 2%               382µs ± 3%  -42.60%  (p=0.008 n=5+5)
    neo/py(!log)/sqlite-zhash.go                                219µs ± 2%               181µs ± 1%  -17.27%  (p=0.008 n=5+5)
    neo/py(!log)/sqlite-zhash.go+prefetch128                    151µs ± 1%               150µs ± 1%     ~     (p=0.206 n=5+4)
    neo/py(!log)/sql-zhash.py                                   886µs ±56%               426µs ± 1%  -51.90%  (p=0.016 n=5+4)
    neo/py(!log)/sql-zhash.go                                   298µs ± 9%               234µs ± 2%  -21.22%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zhash.go+prefetch128                       230µs ± 3%               210µs ± 6%   -8.71%  (p=0.008 n=5+5)
    neo/go/fs1-zhash.py                                         319µs ±11%               260µs ± 2%  -18.46%  (p=0.008 n=5+5)
    neo/go/fs1-zhash.go                                        61.3µs ± 3%              61.4µs ± 2%     ~     (p=0.802 n=5+5)
    neo/go/fs1-zhash.go+prefetch128                            22.5µs ± 3%              22.2µs ± 5%     ~     (p=0.595 n=5+5)
    neo/go/fs1(!sha1)-zhash.go(!sha1)                          52.0µs ± 3%              51.9µs ± 4%     ~     (p=1.000 n=5+5)
    neo/go/fs1(!sha1)-zhash.go+prefetch128(!sha1)              18.3µs ± 2%              18.3µs ± 3%     ~     (p=0.667 n=5+5)
    neo/go/sqlite-zhash.py                                      382µs ± 6%               310µs ± 2%  -19.04%  (p=0.008 n=5+5)
    neo/go/sqlite-zhash.go                                      113µs ± 1%               112µs ± 1%     ~     (p=0.063 n=5+5)
    neo/go/sqlite-zhash.go+prefetch128                         40.9µs ± 4%              41.9µs ± 4%     ~     (p=0.190 n=5+5)
    neo/go/sqlite-zhash.go(!sha1)                               108µs ± 1%               107µs ± 1%     ~     (p=0.056 n=5+5)
    neo/go/sqlite-zhash.go+prefetch128(!sha1)                  41.1µs ± 5%              41.1µs ± 2%     ~     (p=0.881 n=5+5)
    
    name                                           old req/s                new req/s                delta
    cluster:neo1 dataset:wczblk1-8
    fs1-zwrk.go·1                                                229k ± 0%                229k ± 0%     ~     (p=1.000 n=5+5)
    fs1-zwrk.go·2                                                443k ± 1%                439k ± 0%     ~     (p=0.111 n=5+4)
    fs1-zwrk.go·3                                                662k ± 1%                660k ± 1%     ~     (p=1.000 n=5+5)
    fs1-zwrk.go·4                                                867k ± 1%                865k ± 0%     ~     (p=1.000 n=5+5)
    fs1-zwrk.go·8                                                988k ± 0%                959k ±11%     ~     (p=0.548 n=5+5)
    fs1-zwrk.go·12                                              1.02M ± 0%               1.02M ± 0%     ~     (p=0.841 n=5+5)
    fs1-zwrk.go·16                                               976k ±12%               1015k ± 0%     ~     (p=1.000 n=5+5)
    zeo/py/fs1-zwrk.go·1                                        5.15k ± 1%               5.84k ± 1%  +13.54%  (p=0.008 n=5+5)
    zeo/py/fs1-zwrk.go·2                                        7.08k ± 1%               7.05k ± 5%     ~     (p=0.841 n=5+5)
    zeo/py/fs1-zwrk.go·3                                        7.73k ± 1%               7.82k ± 1%   +1.29%  (p=0.032 n=5+5)
    zeo/py/fs1-zwrk.go·4                                        7.97k ± 4%               8.07k ± 1%     ~     (p=0.421 n=5+5)
    zeo/py/fs1-zwrk.go·8                                        8.30k ± 2%               8.40k ± 2%     ~     (p=0.095 n=5+5)
    zeo/py/fs1-zwrk.go·12                                       8.15k ± 1%               8.40k ± 2%   +3.08%  (p=0.016 n=5+5)
    zeo/py/fs1-zwrk.go·16                                       8.25k ± 1%               8.48k ± 1%   +2.85%  (p=0.008 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·1                               4.31k ± 4%               5.06k ± 3%  +17.59%  (p=0.008 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·2                               6.28k ± 5%               6.39k ± 0%     ~     (p=0.730 n=5+4)
    neo/py(!log)/sqlite-zwrk.go·3                               6.38k ± 0%               6.28k ± 8%     ~     (p=0.730 n=4+5)
    neo/py(!log)/sqlite-zwrk.go·4                               6.15k ± 5%               6.10k ± 5%     ~     (p=1.000 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·8                               6.27k ± 4%               6.22k ± 9%     ~     (p=0.690 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·12                              6.33k ± 2%               6.28k ± 6%     ~     (p=0.421 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·16                              6.25k ± 4%               6.17k ± 6%     ~     (p=0.690 n=5+5)
    neo/py(!log)/sql-zwrk.go·1                                  3.10k ± 6%               4.12k ± 1%  +33.05%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·2                                  3.98k ± 1%               4.76k ± 5%  +19.62%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·3                                  4.04k ± 3%               4.70k ± 4%  +16.27%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·4                                  4.06k ± 4%               4.78k ± 2%  +17.62%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·8                                  3.79k ± 7%               4.67k ± 5%  +23.22%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·12                                 3.98k ± 3%               4.67k ± 3%  +17.40%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·16                                 3.94k ± 1%               4.72k ± 3%  +19.55%  (p=0.008 n=5+5)
    neo/go/fs1-zwrk.go·1                                        12.8k ± 0%               12.8k ± 1%     ~     (p=0.421 n=5+5)
    neo/go/fs1-zwrk.go·2                                        24.8k ± 0%               25.0k ± 1%     ~     (p=0.063 n=4+5)
    neo/go/fs1-zwrk.go·3                                        32.3k ± 0%               32.2k ± 2%     ~     (p=0.222 n=5+5)
    neo/go/fs1-zwrk.go·4                                        40.7k ± 0%               40.9k ± 0%   +0.47%  (p=0.008 n=5+5)
    neo/go/fs1-zwrk.go·8                                        54.5k ± 1%               54.9k ± 0%   +0.66%  (p=0.016 n=5+5)
    neo/go/fs1-zwrk.go·12                                       56.5k ± 1%               56.7k ± 1%     ~     (p=0.841 n=5+5)
    neo/go/fs1-zwrk.go·16                                       53.2k ±10%               54.4k ± 2%     ~     (p=1.000 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          19.0k ± 2%               19.3k ± 2%     ~     (p=0.056 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          37.8k ± 0%               37.8k ± 1%     ~     (p=0.841 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          48.0k ± 1%               48.2k ± 0%   +0.50%  (p=0.032 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          59.0k ± 0%               59.2k ± 0%   +0.39%  (p=0.008 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          78.0k ± 1%               78.3k ± 0%     ~     (p=0.095 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         82.2k ± 2%               82.5k ± 1%     ~     (p=0.690 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         80.4k ± 1%               80.3k ± 2%     ~     (p=0.841 n=5+5)
    neo/go/sqlite-zwrk.go·1                                     8.06k ± 4%               8.24k ± 1%   +2.17%  (p=0.016 n=5+5)
    neo/go/sqlite-zwrk.go·2                                     14.9k ± 0%               15.0k ± 0%     ~     (p=0.095 n=5+5)
    neo/go/sqlite-zwrk.go·3                                     20.7k ± 0%               20.8k ± 0%     ~     (p=0.151 n=5+5)
    neo/go/sqlite-zwrk.go·4                                     24.8k ± 0%               24.9k ± 0%   +0.39%  (p=0.016 n=5+5)
    neo/go/sqlite-zwrk.go·8                                     31.7k ± 1%               31.6k ± 1%     ~     (p=1.000 n=5+5)
    neo/go/sqlite-zwrk.go·12                                    30.8k ± 5%               31.4k ± 1%     ~     (p=0.310 n=5+5)
    neo/go/sqlite-zwrk.go·16                                    30.4k ± 2%               30.6k ± 3%     ~     (p=0.548 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·1                              8.95k ± 1%               9.05k ± 1%     ~     (p=0.056 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·2                              16.2k ± 1%               16.3k ± 1%   +0.88%  (p=0.016 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·3                              22.6k ± 0%               22.6k ± 0%     ~     (p=0.905 n=4+5)
    neo/go/sqlite-zwrk.go(!sha1)·4                              27.9k ± 0%               27.7k ± 0%   -0.83%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·8                              35.0k ± 1%               34.4k ± 1%   -1.78%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·12                             34.7k ± 1%               33.4k ± 2%   -3.68%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·16                             33.0k ±11%               32.9k ± 2%     ~     (p=0.151 n=5+5)
    cluster:neo1 dataset:prod1-1024
    fs1-zwrk.go·1                                                451k ± 0%                451k ± 1%     ~     (p=1.000 n=5+5)
    fs1-zwrk.go·2                                                893k ± 0%                871k ± 9%     ~     (p=0.690 n=5+5)
    fs1-zwrk.go·3                                               1.34M ± 1%               1.33M ± 0%     ~     (p=0.690 n=5+5)
    fs1-zwrk.go·4                                               1.77M ± 0%               1.76M ± 0%     ~     (p=0.310 n=5+5)
    fs1-zwrk.go·8                                               1.99M ± 1%               2.00M ± 2%     ~     (p=0.421 n=5+5)
    fs1-zwrk.go·12                                              2.03M ± 1%               2.03M ± 0%     ~     (p=0.556 n=4+5)
    fs1-zwrk.go·16                                              2.03M ± 0%               2.03M ± 0%     ~     (p=0.111 n=5+4)
    zeo/py/fs1-zwrk.go·1                                        5.79k ± 3%               6.83k ± 2%  +18.03%  (p=0.008 n=5+5)
    zeo/py/fs1-zwrk.go·2                                        8.55k ± 1%               8.70k ± 1%   +1.74%  (p=0.016 n=5+5)
    zeo/py/fs1-zwrk.go·3                                        9.28k ± 7%               9.54k ± 2%     ~     (p=0.151 n=5+5)
    zeo/py/fs1-zwrk.go·4                                        9.72k ± 1%               9.77k ± 1%     ~     (p=0.151 n=5+5)
    zeo/py/fs1-zwrk.go·8                                        10.4k ± 1%               10.5k ± 1%     ~     (p=0.421 n=5+5)
    zeo/py/fs1-zwrk.go·12                                       10.5k ± 1%               10.6k ± 1%     ~     (p=0.310 n=5+5)
    zeo/py/fs1-zwrk.go·16                                       10.4k ± 4%               10.7k ± 1%   +2.75%  (p=0.016 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·1                               4.90k ± 7%               5.51k ± 3%  +12.34%  (p=0.008 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·2                               6.28k ± 4%               6.38k ± 3%     ~     (p=0.690 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·3                               6.32k ± 5%               6.27k ± 5%     ~     (p=0.841 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·4                               6.45k ± 2%               6.54k ± 0%   +1.35%  (p=0.032 n=5+4)
    neo/py(!log)/sqlite-zwrk.go·8                               6.45k ± 2%               6.48k ± 2%     ~     (p=0.421 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·12                              6.31k ± 3%               6.43k ± 2%     ~     (p=0.151 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·16                              6.36k ± 5%               6.41k ± 3%     ~     (p=0.421 n=5+5)
    neo/py(!log)/sql-zwrk.go·1                                  3.50k ± 9%               4.25k ± 7%  +21.25%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·2                                  4.05k ± 6%               4.92k ± 1%  +21.64%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·3                                  4.06k ± 7%               4.85k ± 3%  +19.49%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·4                                  3.98k ± 4%               4.90k ± 2%  +22.98%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·8                                  4.15k ± 3%               4.89k ± 1%  +17.81%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·12                                 4.00k ± 5%               4.90k ± 3%  +22.72%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·16                                 3.96k ±11%               4.81k ± 7%  +21.32%  (p=0.008 n=5+5)
    neo/go/fs1-zwrk.go·1                                        17.1k ± 1%               17.4k ± 2%   +2.02%  (p=0.008 n=5+5)
    neo/go/fs1-zwrk.go·2                                        32.6k ± 0%               32.8k ± 1%     ~     (p=0.310 n=5+5)
    neo/go/fs1-zwrk.go·3                                        43.3k ± 0%               43.2k ± 0%     ~     (p=1.000 n=5+5)
    neo/go/fs1-zwrk.go·4                                        52.9k ± 0%               52.9k ± 0%     ~     (p=0.905 n=5+4)
    neo/go/fs1-zwrk.go·8                                        66.3k ± 1%               65.4k ± 1%     ~     (p=0.063 n=4+5)
    neo/go/fs1-zwrk.go·12                                       61.6k ± 1%               59.6k ± 4%   -3.20%  (p=0.016 n=5+5)
    neo/go/fs1-zwrk.go·16                                       55.6k ± 4%               53.9k ± 2%     ~     (p=0.056 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                          19.6k ± 5%               20.1k ± 2%     ~     (p=0.310 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                          40.3k ± 0%               39.9k ± 5%     ~     (p=0.690 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                          51.6k ± 0%               51.7k ± 0%     ~     (p=0.421 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                          62.0k ± 0%               62.5k ± 0%   +0.78%  (p=0.008 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          74.2k ± 4%               74.0k ± 3%     ~     (p=0.841 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         64.8k ± 7%               66.8k ± 3%     ~     (p=0.222 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         59.5k ± 4%               58.6k ± 2%     ~     (p=0.222 n=5+5)
    neo/go/sqlite-zwrk.go·1                                     9.02k ± 1%               9.16k ± 1%   +1.58%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·2                                     16.0k ± 0%               16.0k ± 1%     ~     (p=0.548 n=5+5)
    neo/go/sqlite-zwrk.go·3                                     21.8k ± 1%               21.8k ± 0%     ~     (p=0.730 n=4+5)
    neo/go/sqlite-zwrk.go·4                                     26.2k ± 0%               26.2k ± 1%     ~     (p=0.905 n=5+4)
    neo/go/sqlite-zwrk.go·8                                     30.0k ± 2%               29.9k ± 1%     ~     (p=1.000 n=5+5)
    neo/go/sqlite-zwrk.go·12                                    28.6k ± 2%               28.5k ± 2%     ~     (p=0.841 n=5+5)
    neo/go/sqlite-zwrk.go·16                                    28.7k ± 1%               28.9k ± 2%     ~     (p=0.730 n=4+5)
    neo/go/sqlite-zwrk.go(!sha1)·1                              9.45k ± 1%               9.51k ± 1%     ~     (p=0.222 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·2                              16.6k ± 1%               16.5k ± 1%     ~     (p=0.421 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·3                              23.0k ± 0%               22.7k ± 0%   -1.37%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·4                              28.0k ± 1%               27.4k ± 0%   -2.02%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·8                              32.3k ± 0%               30.4k ±12%   -5.86%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·12                             30.6k ± 2%               29.6k ± 2%   -3.24%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·16                             30.3k ± 2%               29.5k ± 2%   -2.73%  (p=0.008 n=5+5)
    
    name                                           old latency-time/object  new latency-time/object  delta
    cluster:neo1 dataset:wczblk1-8
    fs1-zwrk.go·1                                              4.36µs ± 0%              4.37µs ± 0%     ~     (p=1.000 n=5+5)
    fs1-zwrk.go·2                                              4.52µs ± 1%              4.56µs ± 0%     ~     (p=0.111 n=5+4)
    fs1-zwrk.go·3                                              4.53µs ± 1%              4.54µs ± 1%     ~     (p=0.881 n=5+5)
    fs1-zwrk.go·4                                              4.61µs ± 1%              4.62µs ± 0%     ~     (p=0.889 n=5+5)
    fs1-zwrk.go·8                                              8.10µs ± 0%              8.37µs ±12%     ~     (p=0.548 n=5+5)
    fs1-zwrk.go·12                                             11.8µs ± 0%              11.8µs ± 0%     ~     (p=0.841 n=5+5)
    fs1-zwrk.go·16                                             16.5µs ±13%              15.8µs ± 0%     ~     (p=1.000 n=5+5)
    zeo/py/fs1-zwrk.go·1                                        194µs ± 1%               171µs ± 1%  -11.93%  (p=0.008 n=5+5)
    zeo/py/fs1-zwrk.go·2                                        282µs ± 1%               284µs ± 5%     ~     (p=0.841 n=5+5)
    zeo/py/fs1-zwrk.go·3                                        388µs ± 1%               383µs ± 1%   -1.27%  (p=0.032 n=5+5)
    zeo/py/fs1-zwrk.go·4                                        502µs ± 5%               496µs ± 1%     ~     (p=0.421 n=5+5)
    zeo/py/fs1-zwrk.go·8                                        964µs ± 2%               952µs ± 2%     ~     (p=0.095 n=5+5)
    zeo/py/fs1-zwrk.go·12                                      1.47ms ± 1%              1.43ms ± 2%   -2.98%  (p=0.016 n=5+5)
    zeo/py/fs1-zwrk.go·16                                      1.94ms ± 1%              1.89ms ± 1%   -2.77%  (p=0.008 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·1                               232µs ± 4%               198µs ± 3%  -14.97%  (p=0.008 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·2                               319µs ± 5%               313µs ± 0%     ~     (p=0.730 n=5+4)
    neo/py(!log)/sqlite-zwrk.go·3                               470µs ± 0%               469µs ± 1%     ~     (p=0.343 n=4+4)
    neo/py(!log)/sqlite-zwrk.go·4                               651µs ± 5%               656µs ± 5%     ~     (p=1.000 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·8                              1.28ms ± 4%              1.29ms ±10%     ~     (p=0.690 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·12                             1.90ms ± 2%              1.91ms ± 6%     ~     (p=0.421 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·16                             2.56ms ± 4%              2.60ms ± 6%     ~     (p=0.690 n=5+5)
    neo/py(!log)/sql-zwrk.go·1                                  323µs ± 6%               242µs ± 1%  -24.90%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·2                                  503µs ± 2%               421µs ± 5%  -16.28%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·3                                  742µs ± 3%               639µs ± 4%  -13.97%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·4                                  986µs ± 4%               838µs ± 2%  -15.02%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·8                                 2.11ms ± 8%              1.71ms ± 4%  -18.91%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·12                                3.02ms ± 3%              2.57ms ± 3%  -14.83%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·16                                4.06ms ± 1%              3.39ms ± 3%  -16.33%  (p=0.008 n=5+5)
    neo/go/fs1-zwrk.go·1                                       77.8µs ± 0%              78.2µs ± 1%     ~     (p=0.421 n=5+5)
    neo/go/fs1-zwrk.go·2                                       80.6µs ± 0%              80.0µs ± 1%     ~     (p=0.063 n=4+5)
    neo/go/fs1-zwrk.go·3                                       92.8µs ± 0%              93.1µs ± 2%     ~     (p=0.222 n=5+5)
    neo/go/fs1-zwrk.go·4                                       98.2µs ± 0%              97.7µs ± 0%   -0.47%  (p=0.008 n=5+5)
    neo/go/fs1-zwrk.go·8                                        147µs ± 1%               146µs ± 0%   -0.66%  (p=0.016 n=5+5)
    neo/go/fs1-zwrk.go·12                                       212µs ± 1%               212µs ± 1%     ~     (p=0.841 n=5+5)
    neo/go/fs1-zwrk.go·16                                       293µs ± 1%               294µs ± 2%     ~     (p=0.556 n=4+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         52.7µs ± 2%              51.8µs ± 2%     ~     (p=0.056 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         53.0µs ± 0%              52.9µs ± 1%     ~     (p=0.841 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         62.5µs ± 1%              62.2µs ± 0%   -0.50%  (p=0.032 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         67.8µs ± 0%              67.6µs ± 0%   -0.39%  (p=0.008 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          103µs ± 1%               102µs ± 0%     ~     (p=0.095 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         146µs ± 2%               145µs ± 1%     ~     (p=0.690 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         199µs ± 1%               199µs ± 2%     ~     (p=0.794 n=5+5)
    neo/go/sqlite-zwrk.go·1                                     124µs ± 4%               121µs ± 1%   -2.17%  (p=0.016 n=5+5)
    neo/go/sqlite-zwrk.go·2                                     134µs ± 0%               134µs ± 0%     ~     (p=0.095 n=5+5)
    neo/go/sqlite-zwrk.go·3                                     145µs ± 0%               144µs ± 0%     ~     (p=0.151 n=5+5)
    neo/go/sqlite-zwrk.go·4                                     161µs ± 0%               161µs ± 0%   -0.38%  (p=0.016 n=5+5)
    neo/go/sqlite-zwrk.go·8                                     252µs ± 1%               253µs ± 1%     ~     (p=1.000 n=5+5)
    neo/go/sqlite-zwrk.go·12                                    390µs ± 5%               382µs ± 1%     ~     (p=0.310 n=5+5)
    neo/go/sqlite-zwrk.go·16                                    526µs ± 2%               524µs ± 3%     ~     (p=0.548 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·1                              112µs ± 1%               110µs ± 1%     ~     (p=0.056 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·2                              124µs ± 1%               123µs ± 1%   -0.87%  (p=0.016 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·3                              133µs ± 0%               133µs ± 0%     ~     (p=0.905 n=4+5)
    neo/go/sqlite-zwrk.go(!sha1)·4                              143µs ± 0%               145µs ± 0%   +0.83%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·8                              228µs ± 1%               232µs ± 1%   +1.81%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·12                             346µs ± 1%               359µs ± 2%   +3.82%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·16                             486µs ±11%               486µs ± 2%     ~     (p=0.151 n=5+5)
    cluster:neo1 dataset:prod1-1024
    fs1-zwrk.go·1                                              2.22µs ± 1%              2.22µs ± 1%     ~     (p=0.889 n=5+5)
    fs1-zwrk.go·2                                              2.24µs ± 0%              2.30µs ± 9%     ~     (p=0.690 n=5+5)
    fs1-zwrk.go·3                                              2.25µs ± 1%              2.25µs ± 0%     ~     (p=0.738 n=5+5)
    fs1-zwrk.go·4                                              2.26µs ± 0%              2.27µs ± 0%     ~     (p=0.286 n=5+5)
    fs1-zwrk.go·8                                              4.02µs ± 1%              4.00µs ± 2%     ~     (p=0.460 n=5+5)
    fs1-zwrk.go·12                                             5.92µs ± 1%              5.91µs ± 0%     ~     (p=0.619 n=4+5)
    fs1-zwrk.go·16                                             7.87µs ± 0%              7.88µs ± 0%     ~     (p=0.127 n=5+4)
    zeo/py/fs1-zwrk.go·1                                        173µs ± 3%               146µs ± 2%  -15.31%  (p=0.008 n=5+5)
    zeo/py/fs1-zwrk.go·2                                        234µs ± 1%               230µs ± 1%   -1.71%  (p=0.016 n=5+5)
    zeo/py/fs1-zwrk.go·3                                        324µs ± 7%               315µs ± 2%     ~     (p=0.151 n=5+5)
    zeo/py/fs1-zwrk.go·4                                        412µs ± 1%               409µs ± 1%     ~     (p=0.151 n=5+5)
    zeo/py/fs1-zwrk.go·8                                        768µs ± 1%               765µs ± 1%     ~     (p=0.421 n=5+5)
    zeo/py/fs1-zwrk.go·12                                      1.14ms ± 1%              1.13ms ± 1%     ~     (p=0.310 n=5+5)
    zeo/py/fs1-zwrk.go·16                                      1.54ms ± 4%              1.49ms ± 1%   -2.71%  (p=0.016 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·1                               204µs ± 8%               182µs ± 3%  -11.14%  (p=0.008 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·2                               319µs ± 4%               314µs ± 3%     ~     (p=0.690 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·3                               475µs ± 5%               479µs ± 5%     ~     (p=0.841 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·4                               620µs ± 2%               612µs ± 0%   -1.34%  (p=0.032 n=5+4)
    neo/py(!log)/sqlite-zwrk.go·8                              1.24ms ± 2%              1.23ms ± 2%     ~     (p=0.421 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·12                             1.90ms ± 3%              1.87ms ± 2%     ~     (p=0.151 n=5+5)
    neo/py(!log)/sqlite-zwrk.go·16                             2.52ms ± 5%              2.49ms ± 3%     ~     (p=0.421 n=5+5)
    neo/py(!log)/sql-zwrk.go·1                                  287µs ± 8%               236µs ± 8%  -17.73%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·2                                  495µs ± 6%               406µs ± 1%  -17.95%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·3                                  740µs ± 8%               618µs ± 3%  -16.50%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·4                                 1.01ms ± 4%              0.82ms ± 2%  -18.75%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·8                                 1.93ms ± 3%              1.64ms ± 1%  -15.14%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·12                                3.01ms ± 4%              2.45ms ± 3%  -18.53%  (p=0.008 n=5+5)
    neo/py(!log)/sql-zwrk.go·16                                4.05ms ±10%              3.33ms ± 8%  -17.74%  (p=0.008 n=5+5)
    neo/go/fs1-zwrk.go·1                                       58.5µs ± 1%              57.4µs ± 2%   -1.98%  (p=0.008 n=5+5)
    neo/go/fs1-zwrk.go·2                                       61.4µs ± 0%              61.1µs ± 1%     ~     (p=0.238 n=5+5)
    neo/go/fs1-zwrk.go·3                                       69.3µs ± 0%              69.4µs ± 0%     ~     (p=0.881 n=5+5)
    neo/go/fs1-zwrk.go·4                                       75.6µs ± 0%              75.6µs ± 0%     ~     (p=0.952 n=5+4)
    neo/go/fs1-zwrk.go·8                                        121µs ± 1%               122µs ± 1%     ~     (p=0.063 n=4+5)
    neo/go/fs1-zwrk.go·12                                       195µs ± 1%               201µs ± 4%   +3.35%  (p=0.016 n=5+5)
    neo/go/fs1-zwrk.go·16                                       288µs ± 4%               297µs ± 2%     ~     (p=0.056 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·1                         50.9µs ± 5%              49.8µs ± 2%     ~     (p=0.310 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·2                         49.7µs ± 0%              50.1µs ± 5%     ~     (p=0.690 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·3                         58.2µs ± 0%              58.0µs ± 0%     ~     (p=0.421 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·4                         64.5µs ± 0%              64.0µs ± 0%   -0.77%  (p=0.008 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·8                          108µs ± 4%               108µs ± 3%     ~     (p=0.841 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·12                         185µs ± 8%               180µs ± 3%     ~     (p=0.222 n=5+5)
    neo/go/fs1(!sha1)-zwrk.go(!sha1)·16                         269µs ± 4%               273µs ± 2%     ~     (p=0.222 n=5+5)
    neo/go/sqlite-zwrk.go·1                                     111µs ± 1%               109µs ± 1%   -1.55%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go·2                                     125µs ± 0%               125µs ± 1%     ~     (p=0.548 n=5+5)
    neo/go/sqlite-zwrk.go·3                                     137µs ± 1%               137µs ± 0%     ~     (p=0.730 n=4+5)
    neo/go/sqlite-zwrk.go·4                                     153µs ± 0%               153µs ± 1%     ~     (p=0.905 n=5+4)
    neo/go/sqlite-zwrk.go·8                                     267µs ± 1%               267µs ± 1%     ~     (p=1.000 n=5+5)
    neo/go/sqlite-zwrk.go·12                                    420µs ± 2%               421µs ± 2%     ~     (p=0.841 n=5+5)
    neo/go/sqlite-zwrk.go·16                                    558µs ± 1%               554µs ± 2%     ~     (p=0.730 n=4+5)
    neo/go/sqlite-zwrk.go(!sha1)·1                              106µs ± 1%               105µs ± 1%     ~     (p=0.222 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·2                              121µs ± 1%               121µs ± 1%     ~     (p=0.421 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·3                              130µs ± 0%               132µs ± 0%   +1.39%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·4                              143µs ± 1%               146µs ± 0%   +2.06%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·8                              248µs ± 0%               264µs ±13%   +6.65%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·12                             393µs ± 2%               406µs ± 2%   +3.34%  (p=0.008 n=5+5)
    neo/go/sqlite-zwrk.go(!sha1)·16                             528µs ± 2%               543µs ± 2%   +2.81%  (p=0.008 n=5+5)
    f40c8b4b
20180306-neo1-ffixed-noc_C1(3µs).txt 127 KB