Unblock CI #219

petrutlucian94 · 2025-01-09T13:03:39Z

bump Python version, k8s-snap tests now require Python 3.10
use self-hosted jammy runner
fix r installation
remove broken kine check
use composite action from k8s-snap to install LXD

Thank you for making K8s-dqlite better

Please reference the issue this PR is fixing, or provide a description of the problem addressed.

Also verify you have:

Read the contributions page.
Submitted the CLA form, if you are a first time contributor.

The integration tests use Python 3.8 / ubuntu 20.04. The problem is that k8s-snap tests use type specifiers that require Python 3.10. For this reason, we'll switch to Python 3.10 / ubuntu 22.04.

github-actions · 2025-01-09T13:55:35Z

Benchmark

Results

goos: linux
goarch: amd64
pkg: github.com/canonical/k8s-dqlite/test
cpu: AMD EPYC 7763 64-Core Processor                
                                        │     Before     │                  After                  │
                                        │     sec/op     │     sec/op       vs base                │
Compaction/sqlite-4                        18.11µ ±  46%    18.23µ ±   55%         ~ (p=0.710 n=7)
Compaction/dqlite-4                        57.74µ ±   6%    58.32µ ±    7%         ~ (p=0.383 n=7)
Create/sqlite/1-workers-4                  500.9µ ±   7%    553.6µ ±   16%         ~ (p=0.053 n=7)
Create/sqlite/4-workers-4                  500.5µ ±   7%    577.8µ ±   19%   +15.43% (p=0.038 n=7)
Create/sqlite/16-workers-4                 476.5µ ±  14%    515.0µ ±    6%    +8.09% (p=0.002 n=7)
Create/sqlite/64-workers-4                 505.0µ ±  18%    994.1µ ± 1469%   +96.84% (p=0.001 n=7)
Create/sqlite/128-workers-4                1.806m ±  80%    2.669m ±  104%         ~ (p=0.383 n=7)
Create/dqlite/1-workers-4                  1.089m ±  11%    1.304m ±   11%   +19.77% (p=0.001 n=7)
Create/dqlite/4-workers-4                  956.1µ ±  10%   1152.0µ ±    9%   +20.49% (p=0.001 n=7)
Create/dqlite/16-workers-4                 970.3µ ±   8%   1023.4µ ±   23%         ~ (p=0.535 n=7)
Create/dqlite/64-workers-4                 979.4µ ±  11%   1133.8µ ±   10%   +15.77% (p=0.011 n=7)
Create/dqlite/128-workers-4                940.0µ ±  15%   1168.2µ ±   12%   +24.28% (p=0.002 n=7)
Delete/sqlite/1-workers-4                  486.8µ ±   6%    487.0µ ±   16%         ~ (p=0.805 n=7)
Delete/sqlite/4-workers-4                  484.1µ ±  14%    564.0µ ±   19%   +16.49% (p=0.038 n=7)
Delete/sqlite/16-workers-4                 476.7µ ±  18%    565.2µ ±   20%         ~ (p=0.053 n=7)
Delete/sqlite/64-workers-4                 649.4µ ± 787%    789.3µ ±  510%         ~ (p=0.535 n=7)
Delete/sqlite/128-workers-4                894.1µ ± 390%   4408.9µ ±   79%  +393.09% (p=0.026 n=7)
Delete/dqlite/1-workers-4                  1.133m ±   9%    1.171m ±   10%         ~ (p=0.073 n=7)
Delete/dqlite/4-workers-4                  1.026m ±  13%    1.104m ±   14%         ~ (p=0.053 n=7)
Delete/dqlite/16-workers-4                 995.7µ ±  14%   1113.1µ ±   12%         ~ (p=0.053 n=7)
Delete/dqlite/64-workers-4                 966.8µ ±  12%   1104.4µ ±   12%   +14.24% (p=0.011 n=7)
Delete/dqlite/128-workers-4                1.005m ±  11%    1.129m ±   11%   +12.34% (p=0.007 n=7)
Get/sqlite-4                               215.1µ ±   2%    220.9µ ±    1%    +2.67% (p=0.001 n=7)
Get/dqlite-4                               331.2µ ±   1%    338.1µ ±    2%    +2.10% (p=0.001 n=7)
List/sqlite-tiny/all-4                     3.208µ ±   2%    3.232µ ±    5%         ~ (p=0.620 n=7)
List/sqlite-tiny/pagination-4              4.565µ ±   3%    4.636µ ±   16%         ~ (p=0.365 n=7)
List/sqlite-fits-in-page/all-4             6.304µ ±   7%    6.323µ ±    2%         ~ (p=0.805 n=7)
List/sqlite-fits-in-page/pagination-4      16.55µ ±  12%    16.32µ ±   10%         ~ (p=1.000 n=7)
List/sqlite-overflows-page/all-4           14.87µ ±   3%    14.90µ ±    5%         ~ (p=1.000 n=7)
List/sqlite-overflows-page/pagination-4    18.79µ ±   3%    18.51µ ±    3%         ~ (p=0.209 n=7)
List/dqlite-tiny/all-4                     2.024µ ±  12%    2.008µ ±    5%         ~ (p=0.805 n=7)
List/dqlite-tiny/pagination-4              3.157µ ±   2%    3.089µ ±   12%         ~ (p=0.318 n=7)
List/dqlite-fits-in-page/all-4             5.398µ ±   2%    5.430µ ±    2%         ~ (p=0.209 n=7)
List/dqlite-fits-in-page/pagination-4      11.54µ ±   5%    11.92µ ±    2%         ~ (p=0.259 n=7)
List/dqlite-overflows-page/all-4           18.63µ ±   5%    18.27µ ±    2%         ~ (p=0.165 n=7)
List/dqlite-overflows-page/pagination-4    22.67µ ±   4%    22.63µ ±    2%         ~ (p=0.383 n=7)
Update/sqlite/1-workers-4                  596.1µ ±  17%    581.0µ ±   12%         ~ (p=0.710 n=7)
Update/sqlite/4-workers-4                  555.1µ ±  34%    555.7µ ±   15%         ~ (p=0.535 n=7)
Update/sqlite/16-workers-4                 537.9µ ±  13%    448.2µ ±   25%   -16.69% (p=0.038 n=7)
Update/sqlite/64-workers-4                 740.3µ ± 435%    508.2µ ±  326%         ~ (p=0.209 n=7)
Update/sqlite/128-workers-4                1.442m ± 174%    1.727m ±  100%         ~ (p=0.710 n=7)
Update/dqlite/1-workers-4                  1.149m ±  20%    1.036m ±   25%         ~ (p=0.097 n=7)
Update/dqlite/4-workers-4                 1149.7µ ±   4%    977.4µ ±    8%   -14.98% (p=0.001 n=7)
Update/dqlite/16-workers-4                 1.067m ±   9%    1.012m ±   19%         ~ (p=0.097 n=7)
Update/dqlite/64-workers-4                1068.5µ ±  22%    938.8µ ±    8%         ~ (p=0.097 n=7)
Update/dqlite/128-workers-4                959.2µ ±  17%    935.9µ ±    6%    -2.43% (p=0.011 n=7)
geomean                                    201.9µ           219.9µ            +8.91%

                                        │        Before        │                    After                     │
                                        │ page-cache-misses/op │ page-cache-misses/op  vs base                │
Compaction/sqlite-4                               0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Compaction/dqlite-4                               0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/sqlite/1-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/sqlite/4-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/sqlite/16-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/sqlite/64-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/sqlite/128-workers-4                       0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/dqlite/1-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/dqlite/4-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/dqlite/16-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/dqlite/64-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/dqlite/128-workers-4                       0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/sqlite/1-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/sqlite/4-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/sqlite/16-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/sqlite/64-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/sqlite/128-workers-4                       0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/dqlite/1-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/dqlite/4-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/dqlite/16-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/dqlite/64-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/dqlite/128-workers-4                       0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Get/sqlite-4                                      0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Get/dqlite-4                                      0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-tiny/all-4                            0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-tiny/pagination-4                     0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-fits-in-page/all-4                    0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-fits-in-page/pagination-4             0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-overflows-page/all-4                  0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-overflows-page/pagination-4           0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-tiny/all-4                            0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-tiny/pagination-4                     0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-fits-in-page/all-4                    0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-fits-in-page/pagination-4             0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-overflows-page/all-4                  0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-overflows-page/pagination-4           0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/sqlite/1-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/sqlite/4-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/sqlite/16-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/sqlite/64-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/sqlite/128-workers-4                       0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/dqlite/1-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/dqlite/4-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/dqlite/16-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/dqlite/64-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/dqlite/128-workers-4                       0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
geomean                                                      ²                         +0.00%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean

                                        │        Before        │                    After                     │
                                        │ page-cache-spills/op │ page-cache-spills/op  vs base                │
Compaction/sqlite-4                               0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Compaction/dqlite-4                               0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/sqlite/1-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/sqlite/4-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/sqlite/16-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/sqlite/64-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/sqlite/128-workers-4                       0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/dqlite/1-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/dqlite/4-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/dqlite/16-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/dqlite/64-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/dqlite/128-workers-4                       0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/sqlite/1-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/sqlite/4-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/sqlite/16-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/sqlite/64-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/sqlite/128-workers-4                       0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/dqlite/1-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/dqlite/4-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/dqlite/16-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/dqlite/64-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/dqlite/128-workers-4                       0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Get/sqlite-4                                      0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Get/dqlite-4                                      0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-tiny/all-4                            0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-tiny/pagination-4                     0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-fits-in-page/all-4                    0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-fits-in-page/pagination-4             0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-overflows-page/all-4                  0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-overflows-page/pagination-4           0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-tiny/all-4                            0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-tiny/pagination-4                     0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-fits-in-page/all-4                    0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-fits-in-page/pagination-4             0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-overflows-page/all-4                  0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-overflows-page/pagination-4           0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/sqlite/1-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/sqlite/4-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/sqlite/16-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/sqlite/64-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/sqlite/128-workers-4                       0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/dqlite/1-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/dqlite/4-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/dqlite/16-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/dqlite/64-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/dqlite/128-workers-4                       0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
geomean                                                      ²                         +0.00%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean

                                        │    Before     │                After                 │
                                        │ page-reads/op │ page-reads/op  vs base               │
Compaction/sqlite-4                         12.24 ±  1%     12.21 ±  1%        ~ (p=0.688 n=7)
Compaction/dqlite-4                         12.19 ±  1%     12.18 ±  1%        ~ (p=0.790 n=7)
Create/sqlite/1-workers-4                   13.87 ±  0%     13.78 ±  1%        ~ (p=0.193 n=7)
Create/sqlite/4-workers-4                   12.81 ±  3%     12.98 ±  2%        ~ (p=0.334 n=7)
Create/sqlite/16-workers-4                  11.14 ±  4%     11.24 ±  4%        ~ (p=0.259 n=7)
Create/sqlite/64-workers-4                  9.297 ±  2%     9.479 ± 37%        ~ (p=0.318 n=7)
Create/sqlite/128-workers-4                 7.652 ± 23%     6.901 ± 32%        ~ (p=0.383 n=7)
Create/dqlite/1-workers-4                   13.07 ±  1%     13.01 ±  2%        ~ (p=0.477 n=7)
Create/dqlite/4-workers-4                   10.64 ±  1%     10.64 ±  4%        ~ (p=0.734 n=7)
Create/dqlite/16-workers-4                  10.72 ±  2%     10.91 ±  4%        ~ (p=0.079 n=7)
Create/dqlite/64-workers-4                  10.70 ±  2%     10.77 ±  2%        ~ (p=0.332 n=7)
Create/dqlite/128-workers-4                 10.75 ±  2%     10.82 ±  2%        ~ (p=0.518 n=7)
Delete/sqlite/1-workers-4                   16.23 ±  0%     16.24 ±  0%        ~ (p=0.373 n=7)
Delete/sqlite/4-workers-4                   15.24 ±  6%     15.23 ±  6%        ~ (p=0.805 n=7)
Delete/sqlite/16-workers-4                  12.75 ±  7%     12.89 ±  6%        ~ (p=0.620 n=7)
Delete/sqlite/64-workers-4                  10.75 ± 10%     10.53 ±  8%        ~ (p=0.535 n=7)
Delete/sqlite/128-workers-4                 9.646 ± 17%     7.830 ± 23%  -18.83% (p=0.038 n=7)
Delete/dqlite/1-workers-4                   15.49 ±  1%     15.79 ±  1%   +1.94% (p=0.001 n=7)
Delete/dqlite/4-workers-4                   13.12 ±  1%     13.33 ±  1%   +1.60% (p=0.001 n=7)
Delete/dqlite/16-workers-4                  13.17 ±  2%     13.35 ±  1%   +1.37% (p=0.010 n=7)
Delete/dqlite/64-workers-4                  12.98 ±  2%     13.20 ±  2%   +1.69% (p=0.048 n=7)
Delete/dqlite/128-workers-4                 12.98 ±  1%     13.20 ±  2%   +1.69% (p=0.017 n=7)
Get/sqlite-4                                14.96 ±  0%     14.96 ±  0%        ~ (p=0.837 n=7)
Get/dqlite-4                                11.97 ±  0%     11.97 ±  0%        ~ (p=0.497 n=7)
List/sqlite-tiny/all-4                     191.5m ±  0%    191.1m ±  0%        ~ (p=0.060 n=7)
List/sqlite-tiny/pagination-4               1.090 ±  3%     1.125 ±  0%   +3.21% (p=0.022 n=7)
List/sqlite-fits-in-page/all-4             163.7m ± 59%    258.3m ± 37%        ~ (p=0.795 n=7)
List/sqlite-fits-in-page/pagination-4      963.9m ±  1%    963.7m ±  1%        ~ (p=0.329 n=7)
List/sqlite-overflows-page/all-4           177.5m ±  0%    177.5m ±  0%        ~ (p=1.000 n=7)
List/sqlite-overflows-page/pagination-4     1.065 ±  0%     1.065 ±  3%        ~ (p=1.000 n=7)
List/dqlite-tiny/all-4                     190.4m ±  1%    190.4m ±  0%        ~ (p=1.000 n=7)
List/dqlite-tiny/pagination-4               1.124 ±  0%     1.124 ±  3%        ~ (p=0.290 n=7)
List/dqlite-fits-in-page/all-4             260.3m ± 37%    260.5m ± 37%        ~ (p=0.199 n=7)
List/dqlite-fits-in-page/pagination-4      954.3m ±  0%    955.8m ±  0%        ~ (p=0.683 n=7)
List/dqlite-overflows-page/all-4           184.9m ±  0%    184.7m ±  0%        ~ (p=0.071 n=7)
List/dqlite-overflows-page/pagination-4     1.073 ±  3%     1.073 ±  0%        ~ (p=1.000 n=7)
Update/sqlite/1-workers-4                   15.77 ±  1%     15.76 ±  1%        ~ (p=0.598 n=7)
Update/sqlite/4-workers-4                   14.96 ±  5%     14.94 ±  3%        ~ (p=0.402 n=7)
Update/sqlite/16-workers-4                  13.41 ±  8%     13.13 ±  6%        ~ (p=0.259 n=7)
Update/sqlite/64-workers-4                  11.28 ± 24%     11.01 ±  6%        ~ (p=0.335 n=7)
Update/sqlite/128-workers-4                 9.760 ± 38%     9.141 ± 21%        ~ (p=1.000 n=7)
Update/dqlite/1-workers-4                   14.94 ±  1%     15.22 ±  1%   +1.87% (p=0.002 n=7)
Update/dqlite/4-workers-4                   12.44 ±  1%     12.64 ±  1%   +1.61% (p=0.001 n=7)
Update/dqlite/16-workers-4                  12.50 ±  1%     12.61 ±  1%   +0.88% (p=0.002 n=7)
Update/dqlite/64-workers-4                  12.47 ±  1%     12.58 ±  1%   +0.88% (p=0.010 n=7)
Update/dqlite/128-workers-4                 12.40 ±  2%     12.53 ±  1%   +1.05% (p=0.016 n=7)
geomean                                     5.189           5.218         +0.55%

                                        │     Before     │                 After                  │
                                        │ page-writes/op │ page-writes/op  vs base                │
Compaction/sqlite-4                        190.7m ± 1%        190.1m ± 0%       ~ (p=0.057 n=7)
Compaction/dqlite-4                        188.1m ± 1%        187.1m ± 1%  -0.53% (p=0.017 n=7)
Create/sqlite/1-workers-4                   4.353 ± 0%         4.346 ± 0%       ~ (p=0.171 n=7)
Create/sqlite/4-workers-4                   4.319 ± 0%         4.306 ± 1%       ~ (p=0.136 n=7)
Create/sqlite/16-workers-4                  4.279 ± 1%         4.284 ± 1%       ~ (p=0.921 n=7)
Create/sqlite/64-workers-4                  4.262 ± 1%         4.144 ± 3%  -2.77% (p=0.005 n=7)
Create/sqlite/128-workers-4                 4.057 ± 2%         4.042 ± 2%       ~ (p=0.383 n=7)
Create/dqlite/1-workers-4                   4.219 ± 1%         4.134 ± 2%  -2.01% (p=0.003 n=7)
Create/dqlite/4-workers-4                   4.280 ± 1%         4.182 ± 2%  -2.29% (p=0.001 n=7)
Create/dqlite/16-workers-4                  4.283 ± 1%         4.293 ± 3%       ~ (p=0.473 n=7)
Create/dqlite/64-workers-4                  4.281 ± 1%         4.228 ± 2%       ~ (p=0.057 n=7)
Create/dqlite/128-workers-4                 4.286 ± 1%         4.221 ± 2%  -1.52% (p=0.001 n=7)
Delete/sqlite/1-workers-4                   4.388 ± 0%         4.388 ± 0%       ~ (p=0.986 n=7)
Delete/sqlite/4-workers-4                   4.399 ± 1%         4.405 ± 1%       ~ (p=1.000 n=7)
Delete/sqlite/16-workers-4                  4.370 ± 1%         4.348 ± 1%       ~ (p=0.259 n=7)
Delete/sqlite/64-workers-4                  4.325 ± 3%         4.339 ± 3%       ~ (p=0.383 n=7)
Delete/sqlite/128-workers-4                 4.332 ± 1%         4.292 ± 2%  -0.92% (p=0.016 n=7)
Delete/dqlite/1-workers-4                   4.378 ± 1%         4.326 ± 1%  -1.19% (p=0.018 n=7)
Delete/dqlite/4-workers-4                   4.374 ± 1%         4.357 ± 1%       ~ (p=0.333 n=7)
Delete/dqlite/16-workers-4                  4.373 ± 1%         4.366 ± 1%       ~ (p=0.902 n=7)
Delete/dqlite/64-workers-4                  4.359 ± 1%         4.350 ± 1%       ~ (p=0.154 n=7)
Delete/dqlite/128-workers-4                 4.357 ± 0%         4.339 ± 1%       ~ (p=0.073 n=7)
Get/sqlite-4                                0.000 ± 0%         0.000 ± 0%       ~ (p=1.000 n=7) ¹
Get/dqlite-4                                0.000 ± 0%         0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-tiny/all-4                      0.000 ± 0%         0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-tiny/pagination-4               0.000 ± 0%         0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-fits-in-page/all-4              0.000 ± 0%         0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-fits-in-page/pagination-4       0.000 ± 0%         0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-overflows-page/all-4            0.000 ± 0%         0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-overflows-page/pagination-4     0.000 ± 0%         0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-tiny/all-4                      0.000 ± 0%         0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-tiny/pagination-4               0.000 ± 0%         0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-fits-in-page/all-4              0.000 ± 0%         0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-fits-in-page/pagination-4       0.000 ± 0%         0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-overflows-page/all-4            0.000 ± 0%         0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-overflows-page/pagination-4     0.000 ± 0%         0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/sqlite/1-workers-4                   4.227 ± 0%         4.227 ± 0%       ~ (p=0.881 n=7)
Update/sqlite/4-workers-4                   4.324 ± 1%         4.312 ± 1%       ~ (p=0.176 n=7)
Update/sqlite/16-workers-4                  4.301 ± 1%         4.300 ± 1%       ~ (p=0.302 n=7)
Update/sqlite/64-workers-4                  4.278 ± 6%         4.285 ± 5%       ~ (p=0.383 n=7)
Update/sqlite/128-workers-4                 4.189 ± 4%         4.145 ± 3%       ~ (p=1.000 n=7)
Update/dqlite/1-workers-4                   4.190 ± 1%         4.197 ± 1%       ~ (p=0.473 n=7)
Update/dqlite/4-workers-4                   4.175 ± 0%         4.194 ± 1%  +0.46% (p=0.008 n=7)
Update/dqlite/16-workers-4                  4.213 ± 1%         4.201 ± 1%       ~ (p=0.535 n=7)
Update/dqlite/64-workers-4                  4.222 ± 1%         4.243 ± 0%       ~ (p=0.053 n=7)
Update/dqlite/128-workers-4                 4.248 ± 1%         4.241 ± 1%       ~ (p=0.456 n=7)
geomean                                                ²                   -0.33%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean

                                        │     Before     │                 After                 │
                                        │ sec-reading/op │ sec-reading/op  vs base               │
Compaction/sqlite-4                        24.00µ ±  67%     23.90µ ± 81%        ~ (p=0.971 n=7)
Compaction/dqlite-4                        34.90µ ±  10%     33.90µ ±  8%        ~ (p=0.805 n=7)
Create/sqlite/1-workers-4                  18.30µ ±  25%     19.50µ ± 35%        ~ (p=0.830 n=7)
Create/sqlite/4-workers-4                  18.60µ ±  26%     19.80µ ± 25%        ~ (p=0.245 n=7)
Create/sqlite/16-workers-4                 18.30µ ±  40%     21.80µ ± 23%        ~ (p=0.686 n=7)
Create/sqlite/64-workers-4                 20.30µ ±  28%     29.10µ ± 72%  +43.35% (p=0.017 n=7)
Create/sqlite/128-workers-4                22.50µ ±  60%     31.60µ ± 38%        ~ (p=0.259 n=7)
Create/dqlite/1-workers-4                  7.000µ ±  63%    10.300µ ± 44%        ~ (p=0.209 n=7)
Create/dqlite/4-workers-4                 11.400µ ±  40%     8.100µ ± 62%        ~ (p=0.594 n=7)
Create/dqlite/16-workers-4                 9.900µ ±  30%    10.100µ ± 56%        ~ (p=0.318 n=7)
Create/dqlite/64-workers-4                 12.30µ ±  45%     11.10µ ± 70%        ~ (p=0.779 n=7)
Create/dqlite/128-workers-4                8.700µ ±  36%     8.800µ ± 86%        ~ (p=0.559 n=7)
Delete/sqlite/1-workers-4                  29.50µ ±  19%     32.20µ ± 14%        ~ (p=0.172 n=7)
Delete/sqlite/4-workers-4                  29.50µ ±  27%     30.10µ ± 29%        ~ (p=0.403 n=7)
Delete/sqlite/16-workers-4                 35.20µ ±  29%     31.80µ ±  8%        ~ (p=0.175 n=7)
Delete/sqlite/64-workers-4                 35.00µ ±  21%     36.00µ ± 49%        ~ (p=0.710 n=7)
Delete/sqlite/128-workers-4                35.80µ ±  21%     44.20µ ± 38%        ~ (p=0.456 n=7)
Delete/dqlite/1-workers-4                  12.50µ ±  34%     11.60µ ± 46%        ~ (p=0.932 n=7)
Delete/dqlite/4-workers-4                  13.60µ ±  32%     14.80µ ± 20%        ~ (p=0.518 n=7)
Delete/dqlite/16-workers-4                 15.60µ ±  28%     13.50µ ± 36%        ~ (p=0.120 n=7)
Delete/dqlite/64-workers-4                 13.30µ ±  29%     10.10µ ± 67%  -24.06% (p=0.038 n=7)
Delete/dqlite/128-workers-4                12.60µ ±  52%     12.70µ ± 47%        ~ (p=0.902 n=7)
Get/sqlite-4                               57.30µ ±   6%     57.80µ ±  5%        ~ (p=0.830 n=7)
Get/dqlite-4                               34.70µ ±  12%     37.50µ ± 18%        ~ (p=0.104 n=7)
List/sqlite-tiny/all-4                     6.000µ ±   7%     5.900µ ± 12%        ~ (p=0.321 n=7)
List/sqlite-tiny/pagination-4              6.100µ ±  10%     6.300µ ± 62%        ~ (p=0.367 n=7)
List/sqlite-fits-in-page/all-4             11.10µ ±  11%     11.60µ ± 13%        ~ (p=0.640 n=7)
List/sqlite-fits-in-page/pagination-4      30.60µ ±  35%     30.20µ ± 32%        ~ (p=1.000 n=7)
List/sqlite-overflows-page/all-4           11.40µ ±   3%     11.20µ ±  6%        ~ (p=0.876 n=7)
List/sqlite-overflows-page/pagination-4    14.60µ ±   5%     14.50µ ± 19%        ~ (p=0.780 n=7)
List/dqlite-tiny/all-4                     2.500µ ±  28%     2.500µ ± 16%        ~ (p=0.869 n=7)
List/dqlite-tiny/pagination-4              3.500µ ±   9%     3.300µ ± 12%        ~ (p=0.116 n=7)
List/dqlite-fits-in-page/all-4             7.200µ ±  18%     8.300µ ± 16%        ~ (p=0.497 n=7)
List/dqlite-fits-in-page/pagination-4      16.00µ ±  26%     17.80µ ± 17%        ~ (p=0.274 n=7)
List/dqlite-overflows-page/all-4           30.10µ ±   3%     29.70µ ±  2%        ~ (p=0.245 n=7)
List/dqlite-overflows-page/pagination-4    37.40µ ±   3%     36.40µ ±  4%        ~ (p=0.240 n=7)
Update/sqlite/1-workers-4                  17.20µ ±  23%     17.40µ ± 36%        ~ (p=0.138 n=7)
Update/sqlite/4-workers-4                  19.30µ ±  53%     17.60µ ± 33%        ~ (p=0.207 n=7)
Update/sqlite/16-workers-4                 21.60µ ±  39%     20.30µ ± 22%        ~ (p=0.366 n=7)
Update/sqlite/64-workers-4                 22.60µ ±  71%     21.30µ ± 13%        ~ (p=0.878 n=7)
Update/sqlite/128-workers-4                25.20µ ±  95%     22.90µ ± 37%        ~ (p=0.383 n=7)
Update/dqlite/1-workers-4                 10.100µ ±  61%     9.200µ ± 73%        ~ (p=0.295 n=7)
Update/dqlite/4-workers-4                  9.900µ ± 112%    10.600µ ± 25%        ~ (p=0.976 n=7)
Update/dqlite/16-workers-4                 9.800µ ±  18%     9.800µ ± 28%        ~ (p=0.734 n=7)
Update/dqlite/64-workers-4                 9.300µ ±  22%     8.200µ ± 74%        ~ (p=0.645 n=7)
Update/dqlite/128-workers-4                10.10µ ±  38%     10.40µ ± 51%        ~ (p=0.475 n=7)
geomean                                    15.52µ            15.73µ         +1.36%

                                        │     Before      │                  After                  │
                                        │ sec-writing/op  │ sec-writing/op  vs base                 │
Compaction/sqlite-4                       9.400µ ±   5%      9.200µ ±   7%        ~ (p=0.427 n=7)
Compaction/dqlite-4                       7.700µ ±   8%      7.400µ ±  11%        ~ (p=0.136 n=7)
Create/sqlite/1-workers-4                 284.1µ ±  12%      331.7µ ±  29%        ~ (p=0.259 n=7)
Create/sqlite/4-workers-4                 1.569m ±  12%      1.689m ±  18%        ~ (p=0.097 n=7)
Create/sqlite/16-workers-4                5.576m ±  13%      6.148m ±   9%  +10.26% (p=0.007 n=7)
Create/sqlite/64-workers-4                18.83m ±  12%      26.21m ± 649%  +39.19% (p=0.002 n=7)
Create/sqlite/128-workers-4               57.15m ±  47%      80.15m ±  43%        ~ (p=0.209 n=7)
Create/dqlite/1-workers-4                 31.30µ ±  21%      27.30µ ±  60%        ~ (p=0.535 n=7)
Create/dqlite/4-workers-4                 32.10µ ±  30%      34.50µ ±  17%        ~ (p=0.710 n=7)
Create/dqlite/16-workers-4                34.40µ ±  32%      35.60µ ±  13%        ~ (p=1.000 n=7)
Create/dqlite/64-workers-4                34.50µ ±  17%      38.00µ ±  29%        ~ (p=0.245 n=7)
Create/dqlite/128-workers-4               33.80µ ±  15%      37.00µ ±  24%        ~ (p=0.710 n=7)
Delete/sqlite/1-workers-4                 280.0µ ±   8%      268.4µ ±  24%        ~ (p=0.710 n=7)
Delete/sqlite/4-workers-4                 1.450m ±  19%      1.658m ±  12%  +14.34% (p=0.007 n=7)
Delete/sqlite/16-workers-4                5.482m ±   9%      6.146m ±  10%  +12.11% (p=0.002 n=7)
Delete/sqlite/64-workers-4                18.78m ± 251%      23.60m ± 200%        ~ (p=0.209 n=7)
Delete/sqlite/128-workers-4               42.28m ± 133%      94.73m ±  58%        ~ (p=0.073 n=7)
Delete/dqlite/1-workers-4                 30.10µ ±  47%      35.00µ ±  38%        ~ (p=0.318 n=7)
Delete/dqlite/4-workers-4                 36.90µ ±   8%      41.40µ ±  19%  +12.20% (p=0.026 n=7)
Delete/dqlite/16-workers-4                36.30µ ±  15%      40.40µ ±  17%  +11.29% (p=0.029 n=7)
Delete/dqlite/64-workers-4                35.00µ ±  21%      36.30µ ±  25%        ~ (p=0.902 n=7)
Delete/dqlite/128-workers-4               36.90µ ±  12%      38.20µ ±  19%        ~ (p=0.591 n=7)
Get/sqlite-4                               0.000 ±   0%       0.000 ±   0%        ~ (p=1.000 n=7) ¹
Get/dqlite-4                               0.000 ±   0%       0.000 ±   0%        ~ (p=1.000 n=7) ¹
List/sqlite-tiny/all-4                     0.000 ±   0%       0.000 ±   0%        ~ (p=1.000 n=7) ¹
List/sqlite-tiny/pagination-4              0.000 ±   0%       0.000 ±   0%        ~ (p=1.000 n=7) ¹
List/sqlite-fits-in-page/all-4             0.000 ±   0%       0.000 ±   0%        ~ (p=1.000 n=7) ¹
List/sqlite-fits-in-page/pagination-4      0.000 ±   0%       0.000 ±   0%        ~ (p=1.000 n=7) ¹
List/sqlite-overflows-page/all-4           0.000 ±   0%       0.000 ±   0%        ~ (p=1.000 n=7) ¹
List/sqlite-overflows-page/pagination-4    0.000 ±   0%       0.000 ±   0%        ~ (p=1.000 n=7) ¹
List/dqlite-tiny/all-4                     0.000 ±   0%       0.000 ±   0%        ~ (p=1.000 n=7) ¹
List/dqlite-tiny/pagination-4              0.000 ±   0%       0.000 ±   0%        ~ (p=1.000 n=7) ¹
List/dqlite-fits-in-page/all-4             0.000 ±   0%       0.000 ±   0%        ~ (p=1.000 n=7) ¹
List/dqlite-fits-in-page/pagination-4      0.000 ±   0%       0.000 ±   0%        ~ (p=1.000 n=7) ¹
List/dqlite-overflows-page/all-4           0.000 ±   0%       0.000 ±   0%        ~ (p=1.000 n=7) ¹
List/dqlite-overflows-page/pagination-4    0.000 ±   0%       0.000 ±   0%        ~ (p=1.000 n=7) ¹
Update/sqlite/1-workers-4                 374.3µ ±  27%      361.3µ ±  21%        ~ (p=1.000 n=7)
Update/sqlite/4-workers-4                 1.642m ±  11%      1.573m ±  18%        ~ (p=0.318 n=7)
Update/sqlite/16-workers-4                6.167m ±   7%      5.327m ±   7%  -13.62% (p=0.001 n=7)
Update/sqlite/64-workers-4                21.04m ± 193%      18.44m ± 107%        ~ (p=0.053 n=7)
Update/sqlite/128-workers-4               52.14m ±  75%      61.20m ±  35%        ~ (p=0.805 n=7)
Update/dqlite/1-workers-4                 36.90µ ±  29%      30.60µ ±  31%        ~ (p=0.097 n=7)
Update/dqlite/4-workers-4                 44.60µ ±  36%      34.40µ ±  26%        ~ (p=0.053 n=7)
Update/dqlite/16-workers-4                40.90µ ±  41%      35.10µ ±  36%        ~ (p=0.209 n=7)
Update/dqlite/64-workers-4                38.00µ ±  37%      35.70µ ±  11%        ~ (p=0.477 n=7)
Update/dqlite/128-workers-4               36.50µ ±  32%      34.80µ ±  19%        ~ (p=0.620 n=7)
geomean                                                 ²                    +4.15%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean

                                        │    Before     │                After                │
                                        │     B/op      │     B/op       vs base              │
Compaction/sqlite-4                       2.210Ki ± 42%   2.198Ki ± 53%       ~ (p=0.805 n=7)
Compaction/dqlite-4                       11.17Ki ±  9%   10.97Ki ± 10%       ~ (p=0.935 n=7)
Create/sqlite/1-workers-4                 20.40Ki ±  0%   20.42Ki ±  0%       ~ (p=0.104 n=7)
Create/sqlite/4-workers-4                 20.40Ki ±  0%   20.42Ki ±  0%       ~ (p=0.104 n=7)
Create/sqlite/16-workers-4                20.41Ki ±  0%   20.41Ki ±  0%       ~ (p=0.332 n=7)
Create/sqlite/64-workers-4                20.44Ki ±  0%   20.60Ki ± 12%  +0.77% (p=0.002 n=7)
Create/sqlite/128-workers-4               20.88Ki ±  3%   21.20Ki ±  4%       ~ (p=0.456 n=7)
Create/dqlite/1-workers-4                 19.67Ki ±  0%   19.71Ki ±  0%  +0.25% (p=0.011 n=7)
Create/dqlite/4-workers-4                 19.64Ki ±  0%   19.68Ki ±  0%  +0.20% (p=0.023 n=7)
Create/dqlite/16-workers-4                19.70Ki ±  0%   19.65Ki ±  0%  -0.29% (p=0.010 n=7)
Create/dqlite/64-workers-4                19.66Ki ±  1%   19.68Ki ±  2%       ~ (p=0.709 n=7)
Create/dqlite/128-workers-4               19.69Ki ±  0%   19.74Ki ±  0%       ~ (p=0.073 n=7)
Delete/sqlite/1-workers-4                 22.83Ki ±  0%   22.82Ki ±  0%       ~ (p=0.730 n=7)
Delete/sqlite/4-workers-4                 22.83Ki ±  0%   22.84Ki ±  0%       ~ (p=0.383 n=7)
Delete/sqlite/16-workers-4                22.80Ki ±  0%   22.83Ki ±  0%  +0.12% (p=0.001 n=7)
Delete/sqlite/64-workers-4                22.87Ki ±  4%   22.96Ki ±  4%       ~ (p=0.535 n=7)
Delete/sqlite/128-workers-4               23.06Ki ±  4%   24.20Ki ±  5%       ~ (p=0.053 n=7)
Delete/dqlite/1-workers-4                 21.93Ki ±  0%   21.94Ki ±  0%       ~ (p=0.068 n=7)
Delete/dqlite/4-workers-4                 21.92Ki ±  0%   21.92Ki ±  0%       ~ (p=0.482 n=7)
Delete/dqlite/16-workers-4                21.93Ki ±  0%   21.91Ki ±  1%       ~ (p=0.274 n=7)
Delete/dqlite/64-workers-4                21.91Ki ±  0%   21.95Ki ±  7%       ~ (p=0.057 n=7)
Delete/dqlite/128-workers-4               21.96Ki ±  0%   22.00Ki ±  0%  +0.18% (p=0.001 n=7)
Get/sqlite-4                              23.00Ki ±  0%   23.02Ki ±  0%       ~ (p=0.136 n=7)
Get/dqlite-4                              21.96Ki ±  0%   21.96Ki ±  0%       ~ (p=0.075 n=7)
List/sqlite-tiny/all-4                    1.128Ki ±  7%   1.104Ki ±  9%       ~ (p=0.318 n=7)
List/sqlite-tiny/pagination-4               986.0 ±  8%    1035.0 ± 34%       ~ (p=0.318 n=7)
List/sqlite-fits-in-page/all-4            7.254Ki ±  7%   6.760Ki ± 10%       ~ (p=0.068 n=7)
List/sqlite-fits-in-page/pagination-4     10.39Ki ± 33%   10.24Ki ± 30%       ~ (p=0.318 n=7)
List/sqlite-overflows-page/all-4          20.49Ki ± 12%   20.49Ki ± 12%       ~ (p=0.831 n=7)
List/sqlite-overflows-page/pagination-4   18.03Ki ±  5%   18.03Ki ±  8%       ~ (p=0.804 n=7)
List/dqlite-tiny/all-4                      914.0 ± 13%     949.0 ±  6%       ~ (p=1.000 n=7)
List/dqlite-tiny/pagination-4               837.0 ±  5%     832.0 ± 12%       ~ (p=0.402 n=7)
List/dqlite-fits-in-page/all-4            5.951Ki ±  8%   5.994Ki ±  8%       ~ (p=0.318 n=7)
List/dqlite-fits-in-page/pagination-4     5.629Ki ± 11%   6.062Ki ±  5%       ~ (p=0.620 n=7)
List/dqlite-overflows-page/all-4          30.95Ki ±  2%   30.55Ki ±  2%       ~ (p=0.053 n=7)
List/dqlite-overflows-page/pagination-4   32.00Ki ±  3%   31.93Ki ±  2%       ~ (p=0.902 n=7)
Update/sqlite/1-workers-4                 21.56Ki ±  0%   21.57Ki ±  0%       ~ (p=0.644 n=7)
Update/sqlite/4-workers-4                 21.58Ki ±  0%   21.55Ki ±  0%       ~ (p=0.128 n=7)
Update/sqlite/16-workers-4                21.56Ki ±  0%   21.54Ki ±  0%       ~ (p=0.128 n=7)
Update/sqlite/64-workers-4                21.61Ki ±  3%   21.56Ki ±  2%       ~ (p=0.073 n=7)
Update/sqlite/128-workers-4               21.78Ki ±  2%   21.88Ki ±  1%       ~ (p=1.000 n=7)
Update/dqlite/1-workers-4                 20.80Ki ±  0%   20.76Ki ±  0%       ~ (p=0.176 n=7)
Update/dqlite/4-workers-4                 20.78Ki ±  0%   20.76Ki ±  0%  -0.11% (p=0.027 n=7)
Update/dqlite/16-workers-4                20.78Ki ±  0%   20.76Ki ±  1%       ~ (p=0.053 n=7)
Update/dqlite/64-workers-4                20.75Ki ±  0%   20.77Ki ±  0%       ~ (p=1.000 n=7)
Update/dqlite/128-workers-4               20.70Ki ±  0%   20.69Ki ±  0%       ~ (p=0.303 n=7)
geomean                                   14.02Ki         14.05Ki        +0.22%

                                        │   Before    │                After                │
                                        │  allocs/op  │  allocs/op   vs base                │
Compaction/sqlite-4                       47.00 ± 45%   47.00 ± 55%       ~ (p=0.917 n=7)
Compaction/dqlite-4                       267.0 ±  8%   263.0 ± 10%       ~ (p=0.837 n=7)
Create/sqlite/1-workers-4                 396.0 ±  0%   396.0 ±  0%       ~ (p=1.000 n=7) ¹
Create/sqlite/4-workers-4                 396.0 ±  0%   396.0 ±  0%       ~ (p=1.000 n=7) ¹
Create/sqlite/16-workers-4                396.0 ±  0%   396.0 ±  0%       ~ (p=1.000 n=7) ¹
Create/sqlite/64-workers-4                396.0 ±  0%   398.0 ±  6%  +0.51% (p=0.012 n=7)
Create/sqlite/128-workers-4               401.0 ±  1%   405.0 ±  2%       ~ (p=0.267 n=7)
Create/dqlite/1-workers-4                 366.0 ±  0%   366.0 ±  0%       ~ (p=1.000 n=7) ¹
Create/dqlite/4-workers-4                 366.0 ±  0%   366.0 ±  0%       ~ (p=1.000 n=7) ¹
Create/dqlite/16-workers-4                366.0 ±  0%   366.0 ±  0%       ~ (p=1.000 n=7) ¹
Create/dqlite/64-workers-4                365.0 ±  0%   365.0 ±  2%       ~ (p=1.000 n=7)
Create/dqlite/128-workers-4               365.0 ±  0%   365.0 ±  0%       ~ (p=1.000 n=7) ¹
Delete/sqlite/1-workers-4                 427.0 ±  0%   427.0 ±  0%       ~ (p=1.000 n=7)
Delete/sqlite/4-workers-4                 427.0 ±  0%   427.0 ±  0%       ~ (p=1.000 n=7)
Delete/sqlite/16-workers-4                427.0 ±  0%   427.0 ±  0%       ~ (p=1.000 n=7)
Delete/sqlite/64-workers-4                427.0 ±  0%   428.0 ±  1%       ~ (p=0.331 n=7)
Delete/sqlite/128-workers-4               429.0 ±  1%   431.0 ±  2%       ~ (p=0.252 n=7)
Delete/dqlite/1-workers-4                 395.0 ±  0%   395.0 ±  0%       ~ (p=1.000 n=7) ¹
Delete/dqlite/4-workers-4                 395.0 ±  0%   395.0 ±  0%       ~ (p=1.000 n=7)
Delete/dqlite/16-workers-4                395.0 ±  0%   395.0 ±  2%       ~ (p=1.000 n=7)
Delete/dqlite/64-workers-4                395.0 ±  0%   395.0 ± 10%       ~ (p=1.000 n=7)
Delete/dqlite/128-workers-4               395.0 ±  0%   394.0 ±  0%  -0.25% (p=0.005 n=7)
Get/sqlite-4                              414.0 ±  0%   414.0 ±  0%       ~ (p=1.000 n=7) ¹
Get/dqlite-4                              392.0 ±  0%   392.0 ±  0%       ~ (p=1.000 n=7) ¹
List/sqlite-tiny/all-4                    15.00 ±  7%   14.00 ±  7%       ~ (p=0.217 n=7)
List/sqlite-tiny/pagination-4             12.00 ±  8%   13.00 ± 54%       ~ (p=0.286 n=7)
List/sqlite-fits-in-page/all-4            19.00 ± 11%   19.00 ± 16%       ~ (p=0.898 n=7)
List/sqlite-fits-in-page/pagination-4     36.00 ± 44%   36.00 ± 42%       ~ (p=0.485 n=7)
List/sqlite-overflows-page/all-4          8.000 ±  0%   8.000 ±  0%       ~ (p=1.000 n=7) ¹
List/sqlite-overflows-page/pagination-4   7.000 ± 14%   8.000 ± 12%       ~ (p=0.694 n=7)
List/dqlite-tiny/all-4                    12.00 ± 25%   12.00 ± 17%       ~ (p=0.706 n=7)
List/dqlite-tiny/pagination-4             9.000 ± 11%   9.000 ± 11%   0.00% (p=0.041 n=7)
List/dqlite-fits-in-page/all-4            18.00 ±  0%   18.00 ±  0%       ~ (p=1.000 n=7) ¹
List/dqlite-fits-in-page/pagination-4     16.00 ± 25%   19.00 ±  5%       ~ (p=0.336 n=7)
List/dqlite-overflows-page/all-4          32.00 ±  3%   31.00 ±  3%       ~ (p=0.122 n=7)
List/dqlite-overflows-page/pagination-4   34.00 ±  3%   34.00 ±  3%       ~ (p=1.000 n=7)
Update/sqlite/1-workers-4                 403.0 ±  0%   403.0 ±  0%       ~ (p=1.000 n=7) ¹
Update/sqlite/4-workers-4                 403.0 ±  0%   403.0 ±  0%       ~ (p=1.000 n=7)
Update/sqlite/16-workers-4                403.0 ±  0%   403.0 ±  0%       ~ (p=1.000 n=7)
Update/sqlite/64-workers-4                403.0 ±  1%   403.0 ±  0%       ~ (p=0.534 n=7)
Update/sqlite/128-workers-4               406.0 ±  1%   407.0 ±  1%       ~ (p=0.900 n=7)
Update/dqlite/1-workers-4                 373.0 ±  0%   373.0 ±  0%       ~ (p=0.559 n=7)
Update/dqlite/4-workers-4                 372.0 ±  0%   373.0 ±  0%  +0.27% (p=0.021 n=7)
Update/dqlite/16-workers-4                372.0 ±  0%   372.0 ±  1%       ~ (p=1.000 n=7)
Update/dqlite/64-workers-4                371.0 ±  0%   372.0 ±  0%       ~ (p=0.103 n=7)
Update/dqlite/128-workers-4               371.0 ±  0%   371.0 ±  0%       ~ (p=1.000 n=7)
geomean                                   160.9         162.0        +0.65%
¹ all samples are equal

                                        │        Before         │                     After                     │
                                        │ network-bytes-read/op │ network-bytes-read/op  vs base                │
Compaction/dqlite-4                               4.108Ki ± 10%           4.025Ki ± 10%       ~ (p=0.776 n=7)
Create/dqlite/1-workers-4                           240.8 ±  0%             239.6 ±  0%  -0.50% (p=0.003 n=7)
Create/dqlite/4-workers-4                           241.6 ±  0%             240.4 ±  0%  -0.50% (p=0.001 n=7)
Create/dqlite/16-workers-4                          241.5 ±  0%             242.0 ±  1%       ~ (p=0.597 n=7)
Create/dqlite/64-workers-4                          241.6 ±  0%             240.9 ±  7%       ~ (p=0.053 n=7)
Create/dqlite/128-workers-4                         241.9 ±  0%             240.8 ±  0%  -0.45% (p=0.003 n=7)
Delete/dqlite/1-workers-4                           716.9 ±  0%             715.6 ±  0%       ~ (p=0.090 n=7)
Delete/dqlite/4-workers-4                           717.0 ±  0%             717.9 ±  0%       ~ (p=0.735 n=7)
Delete/dqlite/16-workers-4                          717.7 ±  0%             718.0 ±  1%       ~ (p=0.598 n=7)
Delete/dqlite/64-workers-4                          718.4 ±  0%             715.2 ±  9%  -0.45% (p=0.013 n=7)
Delete/dqlite/128-workers-4                         717.7 ±  0%             714.9 ±  0%  -0.39% (p=0.001 n=7)
Get/dqlite-4                                        996.2 ±  0%             996.2 ±  0%       ~ (p=1.000 n=7) ¹
List/dqlite-tiny/all-4                              167.5 ± 22%             166.7 ± 13%       ~ (p=0.511 n=7)
List/dqlite-tiny/pagination-4                       132.8 ±  8%             123.7 ± 15%       ~ (p=0.073 n=7)
List/dqlite-fits-in-page/all-4                    1.314Ki ±  3%           1.331Ki ±  3%       ~ (p=0.170 n=7)
List/dqlite-fits-in-page/pagination-4             1.206Ki ± 22%           1.409Ki ±  6%       ~ (p=0.558 n=7)
List/dqlite-overflows-page/all-4                  7.330Ki ±  3%           7.147Ki ±  4%       ~ (p=0.053 n=7)
List/dqlite-overflows-page/pagination-4           7.817Ki ±  4%           8.002Ki ±  6%       ~ (p=0.777 n=7)
Update/dqlite/1-workers-4                           262.9 ±  0%             262.9 ±  0%       ~ (p=0.617 n=7)
Update/dqlite/4-workers-4                           262.8 ±  0%             263.0 ±  0%  +0.08% (p=0.015 n=7)
Update/dqlite/16-workers-4                          262.7 ±  0%             262.7 ±  3%       ~ (p=0.280 n=7)
Update/dqlite/64-workers-4                          262.2 ±  0%             262.5 ±  0%       ~ (p=0.132 n=7)
Update/dqlite/128-workers-4                         261.6 ±  0%             261.6 ±  0%       ~ (p=0.714 n=7)
geomean                                             562.8                   564.0        +0.21%
¹ all samples are equal

                                        │          Before          │                      After                      │
                                        │ network-bytes-written/op │ network-bytes-written/op  vs base               │
Compaction/dqlite-4                                    5.467 ±  9%                5.453 ±  9%        ~ (p=0.902 n=7)
Create/dqlite/1-workers-4                              114.9 ±  2%                112.8 ±  2%   -1.83% (p=0.005 n=7)
Create/dqlite/4-workers-4                              116.3 ±  1%                114.2 ±  1%   -1.81% (p=0.001 n=7)
Create/dqlite/16-workers-4                             116.2 ±  1%                117.0 ±  2%        ~ (p=0.731 n=7)
Create/dqlite/64-workers-4                             116.3 ±  1%                115.0 ±  6%        ~ (p=0.068 n=7)
Create/dqlite/128-workers-4                            117.1 ±  1%                115.2 ±  2%   -1.62% (p=0.003 n=7)
Delete/dqlite/1-workers-4                              82.00 ±  1%                81.49 ±  1%        ~ (p=0.097 n=7)
Delete/dqlite/4-workers-4                              82.04 ±  1%                82.40 ±  1%        ~ (p=0.710 n=7)
Delete/dqlite/16-workers-4                             82.34 ±  1%                82.48 ±  4%        ~ (p=0.620 n=7)
Delete/dqlite/64-workers-4                             82.65 ±  1%                81.28 ± 26%   -1.66% (p=0.017 n=7)
Delete/dqlite/128-workers-4                            82.30 ±  1%                81.23 ±  1%   -1.30% (p=0.001 n=7)
Get/dqlite-4                                           88.53 ±  0%                88.54 ±  0%        ~ (p=0.070 n=7)
List/dqlite-tiny/all-4                               0.03582 ± 42%              0.03519 ± 24%        ~ (p=0.535 n=7)
List/dqlite-tiny/pagination-4                        0.02707 ± 22%              0.02137 ± 34%  -21.06% (p=0.038 n=7)
List/dqlite-fits-in-page/all-4                       0.06032 ±  6%              0.06136 ±  5%        ~ (p=0.245 n=7)
List/dqlite-fits-in-page/pagination-4                0.07092 ± 35%              0.07716 ± 10%        ~ (p=0.383 n=7)
List/dqlite-overflows-page/all-4                     0.08277 ±  3%              0.08092 ±  4%        ~ (p=0.259 n=7)
List/dqlite-overflows-page/pagination-4               0.1085 ±  4%               0.1064 ±  9%        ~ (p=0.301 n=7)
Update/dqlite/1-workers-4                              137.0 ±  0%                136.8 ±  0%   -0.15% (p=0.047 n=7)
Update/dqlite/4-workers-4                              136.9 ±  0%                136.9 ±  0%        ~ (p=0.620 n=7)
Update/dqlite/16-workers-4                             137.1 ±  0%                137.0 ±  2%        ~ (p=0.358 n=7)
Update/dqlite/64-workers-4                             136.8 ±  1%                137.1 ±  0%        ~ (p=0.648 n=7)
Update/dqlite/128-workers-4                            136.4 ±  0%                136.4 ±  0%        ~ (p=0.767 n=7)
geomean                                                13.29                      13.12         -1.23%

Current status

goos: linux
goarch: amd64
pkg: github.com/canonical/k8s-dqlite/test
cpu: AMD EPYC 7763 64-Core Processor                
                                        │     After      │
                                        │     sec/op     │
Compaction/sqlite-4                       18.23µ ±   55%
Compaction/dqlite-4                       58.32µ ±    7%
Create/sqlite/1-workers-4                 553.6µ ±   16%
Create/sqlite/4-workers-4                 577.8µ ±   19%
Create/sqlite/16-workers-4                515.0µ ±    6%
Create/sqlite/64-workers-4                994.1µ ± 1469%
Create/sqlite/128-workers-4               2.669m ±  104%
Create/dqlite/1-workers-4                 1.304m ±   11%
Create/dqlite/4-workers-4                 1.152m ±    9%
Create/dqlite/16-workers-4                1.023m ±   23%
Create/dqlite/64-workers-4                1.134m ±   10%
Create/dqlite/128-workers-4               1.168m ±   12%
Delete/sqlite/1-workers-4                 487.0µ ±   16%
Delete/sqlite/4-workers-4                 564.0µ ±   19%
Delete/sqlite/16-workers-4                565.2µ ±   20%
Delete/sqlite/64-workers-4                789.3µ ±  510%
Delete/sqlite/128-workers-4               4.409m ±   79%
Delete/dqlite/1-workers-4                 1.171m ±   10%
Delete/dqlite/4-workers-4                 1.104m ±   14%
Delete/dqlite/16-workers-4                1.113m ±   12%
Delete/dqlite/64-workers-4                1.104m ±   12%
Delete/dqlite/128-workers-4               1.129m ±   11%
Get/sqlite-4                              220.9µ ±    1%
Get/dqlite-4                              338.1µ ±    2%
List/sqlite-tiny/all-4                    3.232µ ±    5%
List/sqlite-tiny/pagination-4             4.636µ ±   16%
List/sqlite-fits-in-page/all-4            6.323µ ±    2%
List/sqlite-fits-in-page/pagination-4     16.32µ ±   10%
List/sqlite-overflows-page/all-4          14.90µ ±    5%
List/sqlite-overflows-page/pagination-4   18.51µ ±    3%
List/dqlite-tiny/all-4                    2.008µ ±    5%
List/dqlite-tiny/pagination-4             3.089µ ±   12%
List/dqlite-fits-in-page/all-4            5.430µ ±    2%
List/dqlite-fits-in-page/pagination-4     11.92µ ±    2%
List/dqlite-overflows-page/all-4          18.27µ ±    2%
List/dqlite-overflows-page/pagination-4   22.63µ ±    2%
Update/sqlite/1-workers-4                 581.0µ ±   12%
Update/sqlite/4-workers-4                 555.7µ ±   15%
Update/sqlite/16-workers-4                448.2µ ±   25%
Update/sqlite/64-workers-4                508.2µ ±  326%
Update/sqlite/128-workers-4               1.727m ±  100%
Update/dqlite/1-workers-4                 1.036m ±   25%
Update/dqlite/4-workers-4                 977.4µ ±    8%
Update/dqlite/16-workers-4                1.012m ±   19%
Update/dqlite/64-workers-4                938.8µ ±    8%
Update/dqlite/128-workers-4               935.9µ ±    6%
geomean                                   219.9µ

                                        │        After         │
                                        │ page-cache-misses/op │
Compaction/sqlite-4                               0.000 ± 0%
Compaction/dqlite-4                               0.000 ± 0%
Create/sqlite/1-workers-4                         0.000 ± 0%
Create/sqlite/4-workers-4                         0.000 ± 0%
Create/sqlite/16-workers-4                        0.000 ± 0%
Create/sqlite/64-workers-4                        0.000 ± 0%
Create/sqlite/128-workers-4                       0.000 ± 0%
Create/dqlite/1-workers-4                         0.000 ± 0%
Create/dqlite/4-workers-4                         0.000 ± 0%
Create/dqlite/16-workers-4                        0.000 ± 0%
Create/dqlite/64-workers-4                        0.000 ± 0%
Create/dqlite/128-workers-4                       0.000 ± 0%
Delete/sqlite/1-workers-4                         0.000 ± 0%
Delete/sqlite/4-workers-4                         0.000 ± 0%
Delete/sqlite/16-workers-4                        0.000 ± 0%
Delete/sqlite/64-workers-4                        0.000 ± 0%
Delete/sqlite/128-workers-4                       0.000 ± 0%
Delete/dqlite/1-workers-4                         0.000 ± 0%
Delete/dqlite/4-workers-4                         0.000 ± 0%
Delete/dqlite/16-workers-4                        0.000 ± 0%
Delete/dqlite/64-workers-4                        0.000 ± 0%
Delete/dqlite/128-workers-4                       0.000 ± 0%
Get/sqlite-4                                      0.000 ± 0%
Get/dqlite-4                                      0.000 ± 0%
List/sqlite-tiny/all-4                            0.000 ± 0%
List/sqlite-tiny/pagination-4                     0.000 ± 0%
List/sqlite-fits-in-page/all-4                    0.000 ± 0%
List/sqlite-fits-in-page/pagination-4             0.000 ± 0%
List/sqlite-overflows-page/all-4                  0.000 ± 0%
List/sqlite-overflows-page/pagination-4           0.000 ± 0%
List/dqlite-tiny/all-4                            0.000 ± 0%
List/dqlite-tiny/pagination-4                     0.000 ± 0%
List/dqlite-fits-in-page/all-4                    0.000 ± 0%
List/dqlite-fits-in-page/pagination-4             0.000 ± 0%
List/dqlite-overflows-page/all-4                  0.000 ± 0%
List/dqlite-overflows-page/pagination-4           0.000 ± 0%
Update/sqlite/1-workers-4                         0.000 ± 0%
Update/sqlite/4-workers-4                         0.000 ± 0%
Update/sqlite/16-workers-4                        0.000 ± 0%
Update/sqlite/64-workers-4                        0.000 ± 0%
Update/sqlite/128-workers-4                       0.000 ± 0%
Update/dqlite/1-workers-4                         0.000 ± 0%
Update/dqlite/4-workers-4                         0.000 ± 0%
Update/dqlite/16-workers-4                        0.000 ± 0%
Update/dqlite/64-workers-4                        0.000 ± 0%
Update/dqlite/128-workers-4                       0.000 ± 0%
geomean                                                      ¹
¹ summaries must be >0 to compute geomean

                                        │        After         │
                                        │ page-cache-spills/op │
Compaction/sqlite-4                               0.000 ± 0%
Compaction/dqlite-4                               0.000 ± 0%
Create/sqlite/1-workers-4                         0.000 ± 0%
Create/sqlite/4-workers-4                         0.000 ± 0%
Create/sqlite/16-workers-4                        0.000 ± 0%
Create/sqlite/64-workers-4                        0.000 ± 0%
Create/sqlite/128-workers-4                       0.000 ± 0%
Create/dqlite/1-workers-4                         0.000 ± 0%
Create/dqlite/4-workers-4                         0.000 ± 0%
Create/dqlite/16-workers-4                        0.000 ± 0%
Create/dqlite/64-workers-4                        0.000 ± 0%
Create/dqlite/128-workers-4                       0.000 ± 0%
Delete/sqlite/1-workers-4                         0.000 ± 0%
Delete/sqlite/4-workers-4                         0.000 ± 0%
Delete/sqlite/16-workers-4                        0.000 ± 0%
Delete/sqlite/64-workers-4                        0.000 ± 0%
Delete/sqlite/128-workers-4                       0.000 ± 0%
Delete/dqlite/1-workers-4                         0.000 ± 0%
Delete/dqlite/4-workers-4                         0.000 ± 0%
Delete/dqlite/16-workers-4                        0.000 ± 0%
Delete/dqlite/64-workers-4                        0.000 ± 0%
Delete/dqlite/128-workers-4                       0.000 ± 0%
Get/sqlite-4                                      0.000 ± 0%
Get/dqlite-4                                      0.000 ± 0%
List/sqlite-tiny/all-4                            0.000 ± 0%
List/sqlite-tiny/pagination-4                     0.000 ± 0%
List/sqlite-fits-in-page/all-4                    0.000 ± 0%
List/sqlite-fits-in-page/pagination-4             0.000 ± 0%
List/sqlite-overflows-page/all-4                  0.000 ± 0%
List/sqlite-overflows-page/pagination-4           0.000 ± 0%
List/dqlite-tiny/all-4                            0.000 ± 0%
List/dqlite-tiny/pagination-4                     0.000 ± 0%
List/dqlite-fits-in-page/all-4                    0.000 ± 0%
List/dqlite-fits-in-page/pagination-4             0.000 ± 0%
List/dqlite-overflows-page/all-4                  0.000 ± 0%
List/dqlite-overflows-page/pagination-4           0.000 ± 0%
Update/sqlite/1-workers-4                         0.000 ± 0%
Update/sqlite/4-workers-4                         0.000 ± 0%
Update/sqlite/16-workers-4                        0.000 ± 0%
Update/sqlite/64-workers-4                        0.000 ± 0%
Update/sqlite/128-workers-4                       0.000 ± 0%
Update/dqlite/1-workers-4                         0.000 ± 0%
Update/dqlite/4-workers-4                         0.000 ± 0%
Update/dqlite/16-workers-4                        0.000 ± 0%
Update/dqlite/64-workers-4                        0.000 ± 0%
Update/dqlite/128-workers-4                       0.000 ± 0%
geomean                                                      ¹
¹ summaries must be >0 to compute geomean

                                        │     After     │
                                        │ page-reads/op │
Compaction/sqlite-4                         12.21 ±  1%
Compaction/dqlite-4                         12.18 ±  1%
Create/sqlite/1-workers-4                   13.78 ±  1%
Create/sqlite/4-workers-4                   12.98 ±  2%
Create/sqlite/16-workers-4                  11.24 ±  4%
Create/sqlite/64-workers-4                  9.479 ± 37%
Create/sqlite/128-workers-4                 6.901 ± 32%
Create/dqlite/1-workers-4                   13.01 ±  2%
Create/dqlite/4-workers-4                   10.64 ±  4%
Create/dqlite/16-workers-4                  10.91 ±  4%
Create/dqlite/64-workers-4                  10.77 ±  2%
Create/dqlite/128-workers-4                 10.82 ±  2%
Delete/sqlite/1-workers-4                   16.24 ±  0%
Delete/sqlite/4-workers-4                   15.23 ±  6%
Delete/sqlite/16-workers-4                  12.89 ±  6%
Delete/sqlite/64-workers-4                  10.53 ±  8%
Delete/sqlite/128-workers-4                 7.830 ± 23%
Delete/dqlite/1-workers-4                   15.79 ±  1%
Delete/dqlite/4-workers-4                   13.33 ±  1%
Delete/dqlite/16-workers-4                  13.35 ±  1%
Delete/dqlite/64-workers-4                  13.20 ±  2%
Delete/dqlite/128-workers-4                 13.20 ±  2%
Get/sqlite-4                                14.96 ±  0%
Get/dqlite-4                                11.97 ±  0%
List/sqlite-tiny/all-4                     191.1m ±  0%
List/sqlite-tiny/pagination-4               1.125 ±  0%
List/sqlite-fits-in-page/all-4             258.3m ± 37%
List/sqlite-fits-in-page/pagination-4      963.7m ±  1%
List/sqlite-overflows-page/all-4           177.5m ±  0%
List/sqlite-overflows-page/pagination-4     1.065 ±  3%
List/dqlite-tiny/all-4                     190.4m ±  0%
List/dqlite-tiny/pagination-4               1.124 ±  3%
List/dqlite-fits-in-page/all-4             260.5m ± 37%
List/dqlite-fits-in-page/pagination-4      955.8m ±  0%
List/dqlite-overflows-page/all-4           184.7m ±  0%
List/dqlite-overflows-page/pagination-4     1.073 ±  0%
Update/sqlite/1-workers-4                   15.76 ±  1%
Update/sqlite/4-workers-4                   14.94 ±  3%
Update/sqlite/16-workers-4                  13.13 ±  6%
Update/sqlite/64-workers-4                  11.01 ±  6%
Update/sqlite/128-workers-4                 9.141 ± 21%
Update/dqlite/1-workers-4                   15.22 ±  1%
Update/dqlite/4-workers-4                   12.64 ±  1%
Update/dqlite/16-workers-4                  12.61 ±  1%
Update/dqlite/64-workers-4                  12.58 ±  1%
Update/dqlite/128-workers-4                 12.53 ±  1%
geomean                                     5.218

                                        │     After      │
                                        │ page-writes/op │
Compaction/sqlite-4                        190.1m ± 0%
Compaction/dqlite-4                        187.1m ± 1%
Create/sqlite/1-workers-4                   4.346 ± 0%
Create/sqlite/4-workers-4                   4.306 ± 1%
Create/sqlite/16-workers-4                  4.284 ± 1%
Create/sqlite/64-workers-4                  4.144 ± 3%
Create/sqlite/128-workers-4                 4.042 ± 2%
Create/dqlite/1-workers-4                   4.134 ± 2%
Create/dqlite/4-workers-4                   4.182 ± 2%
Create/dqlite/16-workers-4                  4.293 ± 3%
Create/dqlite/64-workers-4                  4.228 ± 2%
Create/dqlite/128-workers-4                 4.221 ± 2%
Delete/sqlite/1-workers-4                   4.388 ± 0%
Delete/sqlite/4-workers-4                   4.405 ± 1%
Delete/sqlite/16-workers-4                  4.348 ± 1%
Delete/sqlite/64-workers-4                  4.339 ± 3%
Delete/sqlite/128-workers-4                 4.292 ± 2%
Delete/dqlite/1-workers-4                   4.326 ± 1%
Delete/dqlite/4-workers-4                   4.357 ± 1%
Delete/dqlite/16-workers-4                  4.366 ± 1%
Delete/dqlite/64-workers-4                  4.350 ± 1%
Delete/dqlite/128-workers-4                 4.339 ± 1%
Get/sqlite-4                                0.000 ± 0%
Get/dqlite-4                                0.000 ± 0%
List/sqlite-tiny/all-4                      0.000 ± 0%
List/sqlite-tiny/pagination-4               0.000 ± 0%
List/sqlite-fits-in-page/all-4              0.000 ± 0%
List/sqlite-fits-in-page/pagination-4       0.000 ± 0%
List/sqlite-overflows-page/all-4            0.000 ± 0%
List/sqlite-overflows-page/pagination-4     0.000 ± 0%
List/dqlite-tiny/all-4                      0.000 ± 0%
List/dqlite-tiny/pagination-4               0.000 ± 0%
List/dqlite-fits-in-page/all-4              0.000 ± 0%
List/dqlite-fits-in-page/pagination-4       0.000 ± 0%
List/dqlite-overflows-page/all-4            0.000 ± 0%
List/dqlite-overflows-page/pagination-4     0.000 ± 0%
Update/sqlite/1-workers-4                   4.227 ± 0%
Update/sqlite/4-workers-4                   4.312 ± 1%
Update/sqlite/16-workers-4                  4.300 ± 1%
Update/sqlite/64-workers-4                  4.285 ± 5%
Update/sqlite/128-workers-4                 4.145 ± 3%
Update/dqlite/1-workers-4                   4.197 ± 1%
Update/dqlite/4-workers-4                   4.194 ± 1%
Update/dqlite/16-workers-4                  4.201 ± 1%
Update/dqlite/64-workers-4                  4.243 ± 0%
Update/dqlite/128-workers-4                 4.241 ± 1%
geomean                                                ¹
¹ summaries must be >0 to compute geomean

                                        │     After      │
                                        │ sec-reading/op │
Compaction/sqlite-4                         23.90µ ± 81%
Compaction/dqlite-4                         33.90µ ±  8%
Create/sqlite/1-workers-4                   19.50µ ± 35%
Create/sqlite/4-workers-4                   19.80µ ± 25%
Create/sqlite/16-workers-4                  21.80µ ± 23%
Create/sqlite/64-workers-4                  29.10µ ± 72%
Create/sqlite/128-workers-4                 31.60µ ± 38%
Create/dqlite/1-workers-4                   10.30µ ± 44%
Create/dqlite/4-workers-4                   8.100µ ± 62%
Create/dqlite/16-workers-4                  10.10µ ± 56%
Create/dqlite/64-workers-4                  11.10µ ± 70%
Create/dqlite/128-workers-4                 8.800µ ± 86%
Delete/sqlite/1-workers-4                   32.20µ ± 14%
Delete/sqlite/4-workers-4                   30.10µ ± 29%
Delete/sqlite/16-workers-4                  31.80µ ±  8%
Delete/sqlite/64-workers-4                  36.00µ ± 49%
Delete/sqlite/128-workers-4                 44.20µ ± 38%
Delete/dqlite/1-workers-4                   11.60µ ± 46%
Delete/dqlite/4-workers-4                   14.80µ ± 20%
Delete/dqlite/16-workers-4                  13.50µ ± 36%
Delete/dqlite/64-workers-4                  10.10µ ± 67%
Delete/dqlite/128-workers-4                 12.70µ ± 47%
Get/sqlite-4                                57.80µ ±  5%
Get/dqlite-4                                37.50µ ± 18%
List/sqlite-tiny/all-4                      5.900µ ± 12%
List/sqlite-tiny/pagination-4               6.300µ ± 62%
List/sqlite-fits-in-page/all-4              11.60µ ± 13%
List/sqlite-fits-in-page/pagination-4       30.20µ ± 32%
List/sqlite-overflows-page/all-4            11.20µ ±  6%
List/sqlite-overflows-page/pagination-4     14.50µ ± 19%
List/dqlite-tiny/all-4                      2.500µ ± 16%
List/dqlite-tiny/pagination-4               3.300µ ± 12%
List/dqlite-fits-in-page/all-4              8.300µ ± 16%
List/dqlite-fits-in-page/pagination-4       17.80µ ± 17%
List/dqlite-overflows-page/all-4            29.70µ ±  2%
List/dqlite-overflows-page/pagination-4     36.40µ ±  4%
Update/sqlite/1-workers-4                   17.40µ ± 36%
Update/sqlite/4-workers-4                   17.60µ ± 33%
Update/sqlite/16-workers-4                  20.30µ ± 22%
Update/sqlite/64-workers-4                  21.30µ ± 13%
Update/sqlite/128-workers-4                 22.90µ ± 37%
Update/dqlite/1-workers-4                   9.200µ ± 73%
Update/dqlite/4-workers-4                   10.60µ ± 25%
Update/dqlite/16-workers-4                  9.800µ ± 28%
Update/dqlite/64-workers-4                  8.200µ ± 74%
Update/dqlite/128-workers-4                 10.40µ ± 51%
geomean                                     15.73µ

                                        │      After      │
                                        │ sec-writing/op  │
Compaction/sqlite-4                       9.200µ ±   7%
Compaction/dqlite-4                       7.400µ ±  11%
Create/sqlite/1-workers-4                 331.7µ ±  29%
Create/sqlite/4-workers-4                 1.689m ±  18%
Create/sqlite/16-workers-4                6.148m ±   9%
Create/sqlite/64-workers-4                26.21m ± 649%
Create/sqlite/128-workers-4               80.15m ±  43%
Create/dqlite/1-workers-4                 27.30µ ±  60%
Create/dqlite/4-workers-4                 34.50µ ±  17%
Create/dqlite/16-workers-4                35.60µ ±  13%
Create/dqlite/64-workers-4                38.00µ ±  29%
Create/dqlite/128-workers-4               37.00µ ±  24%
Delete/sqlite/1-workers-4                 268.4µ ±  24%
Delete/sqlite/4-workers-4                 1.658m ±  12%
Delete/sqlite/16-workers-4                6.146m ±  10%
Delete/sqlite/64-workers-4                23.60m ± 200%
Delete/sqlite/128-workers-4               94.73m ±  58%
Delete/dqlite/1-workers-4                 35.00µ ±  38%
Delete/dqlite/4-workers-4                 41.40µ ±  19%
Delete/dqlite/16-workers-4                40.40µ ±  17%
Delete/dqlite/64-workers-4                36.30µ ±  25%
Delete/dqlite/128-workers-4               38.20µ ±  19%
Get/sqlite-4                               0.000 ±   0%
Get/dqlite-4                               0.000 ±   0%
List/sqlite-tiny/all-4                     0.000 ±   0%
List/sqlite-tiny/pagination-4              0.000 ±   0%
List/sqlite-fits-in-page/all-4             0.000 ±   0%
List/sqlite-fits-in-page/pagination-4      0.000 ±   0%
List/sqlite-overflows-page/all-4           0.000 ±   0%
List/sqlite-overflows-page/pagination-4    0.000 ±   0%
List/dqlite-tiny/all-4                     0.000 ±   0%
List/dqlite-tiny/pagination-4              0.000 ±   0%
List/dqlite-fits-in-page/all-4             0.000 ±   0%
List/dqlite-fits-in-page/pagination-4      0.000 ±   0%
List/dqlite-overflows-page/all-4           0.000 ±   0%
List/dqlite-overflows-page/pagination-4    0.000 ±   0%
Update/sqlite/1-workers-4                 361.3µ ±  21%
Update/sqlite/4-workers-4                 1.573m ±  18%
Update/sqlite/16-workers-4                5.327m ±   7%
Update/sqlite/64-workers-4                18.44m ± 107%
Update/sqlite/128-workers-4               61.20m ±  35%
Update/dqlite/1-workers-4                 30.60µ ±  31%
Update/dqlite/4-workers-4                 34.40µ ±  26%
Update/dqlite/16-workers-4                35.10µ ±  36%
Update/dqlite/64-workers-4                35.70µ ±  11%
Update/dqlite/128-workers-4               34.80µ ±  19%
geomean                                                 ¹
¹ summaries must be >0 to compute geomean

                                        │     After     │
                                        │     B/op      │
Compaction/sqlite-4                       2.198Ki ± 53%
Compaction/dqlite-4                       10.97Ki ± 10%
Create/sqlite/1-workers-4                 20.42Ki ±  0%
Create/sqlite/4-workers-4                 20.42Ki ±  0%
Create/sqlite/16-workers-4                20.41Ki ±  0%
Create/sqlite/64-workers-4                20.60Ki ± 12%
Create/sqlite/128-workers-4               21.20Ki ±  4%
Create/dqlite/1-workers-4                 19.71Ki ±  0%
Create/dqlite/4-workers-4                 19.68Ki ±  0%
Create/dqlite/16-workers-4                19.65Ki ±  0%
Create/dqlite/64-workers-4                19.68Ki ±  2%
Create/dqlite/128-workers-4               19.74Ki ±  0%
Delete/sqlite/1-workers-4                 22.82Ki ±  0%
Delete/sqlite/4-workers-4                 22.84Ki ±  0%
Delete/sqlite/16-workers-4                22.83Ki ±  0%
Delete/sqlite/64-workers-4                22.96Ki ±  4%
Delete/sqlite/128-workers-4               24.20Ki ±  5%
Delete/dqlite/1-workers-4                 21.94Ki ±  0%
Delete/dqlite/4-workers-4                 21.92Ki ±  0%
Delete/dqlite/16-workers-4                21.91Ki ±  1%
Delete/dqlite/64-workers-4                21.95Ki ±  7%
Delete/dqlite/128-workers-4               22.00Ki ±  0%
Get/sqlite-4                              23.02Ki ±  0%
Get/dqlite-4                              21.96Ki ±  0%
List/sqlite-tiny/all-4                    1.104Ki ±  9%
List/sqlite-tiny/pagination-4             1.011Ki ± 34%
List/sqlite-fits-in-page/all-4            6.760Ki ± 10%
List/sqlite-fits-in-page/pagination-4     10.24Ki ± 30%
List/sqlite-overflows-page/all-4          20.49Ki ± 12%
List/sqlite-overflows-page/pagination-4   18.03Ki ±  8%
List/dqlite-tiny/all-4                      949.0 ±  6%
List/dqlite-tiny/pagination-4               832.0 ± 12%
List/dqlite-fits-in-page/all-4            5.994Ki ±  8%
List/dqlite-fits-in-page/pagination-4     6.062Ki ±  5%
List/dqlite-overflows-page/all-4          30.55Ki ±  2%
List/dqlite-overflows-page/pagination-4   31.93Ki ±  2%
Update/sqlite/1-workers-4                 21.57Ki ±  0%
Update/sqlite/4-workers-4                 21.55Ki ±  0%
Update/sqlite/16-workers-4                21.54Ki ±  0%
Update/sqlite/64-workers-4                21.56Ki ±  2%
Update/sqlite/128-workers-4               21.88Ki ±  1%
Update/dqlite/1-workers-4                 20.76Ki ±  0%
Update/dqlite/4-workers-4                 20.76Ki ±  0%
Update/dqlite/16-workers-4                20.76Ki ±  1%
Update/dqlite/64-workers-4                20.77Ki ±  0%
Update/dqlite/128-workers-4               20.69Ki ±  0%
geomean                                   14.05Ki

                                        │    After    │
                                        │  allocs/op  │
Compaction/sqlite-4                       47.00 ± 55%
Compaction/dqlite-4                       263.0 ± 10%
Create/sqlite/1-workers-4                 396.0 ±  0%
Create/sqlite/4-workers-4                 396.0 ±  0%
Create/sqlite/16-workers-4                396.0 ±  0%
Create/sqlite/64-workers-4                398.0 ±  6%
Create/sqlite/128-workers-4               405.0 ±  2%
Create/dqlite/1-workers-4                 366.0 ±  0%
Create/dqlite/4-workers-4                 366.0 ±  0%
Create/dqlite/16-workers-4                366.0 ±  0%
Create/dqlite/64-workers-4                365.0 ±  2%
Create/dqlite/128-workers-4               365.0 ±  0%
Delete/sqlite/1-workers-4                 427.0 ±  0%
Delete/sqlite/4-workers-4                 427.0 ±  0%
Delete/sqlite/16-workers-4                427.0 ±  0%
Delete/sqlite/64-workers-4                428.0 ±  1%
Delete/sqlite/128-workers-4               431.0 ±  2%
Delete/dqlite/1-workers-4                 395.0 ±  0%
Delete/dqlite/4-workers-4                 395.0 ±  0%
Delete/dqlite/16-workers-4                395.0 ±  2%
Delete/dqlite/64-workers-4                395.0 ± 10%
Delete/dqlite/128-workers-4               394.0 ±  0%
Get/sqlite-4                              414.0 ±  0%
Get/dqlite-4                              392.0 ±  0%
List/sqlite-tiny/all-4                    14.00 ±  7%
List/sqlite-tiny/pagination-4             13.00 ± 54%
List/sqlite-fits-in-page/all-4            19.00 ± 16%
List/sqlite-fits-in-page/pagination-4     36.00 ± 42%
List/sqlite-overflows-page/all-4          8.000 ±  0%
List/sqlite-overflows-page/pagination-4   8.000 ± 12%
List/dqlite-tiny/all-4                    12.00 ± 17%
List/dqlite-tiny/pagination-4             9.000 ± 11%
List/dqlite-fits-in-page/all-4            18.00 ±  0%
List/dqlite-fits-in-page/pagination-4     19.00 ±  5%
List/dqlite-overflows-page/all-4          31.00 ±  3%
List/dqlite-overflows-page/pagination-4   34.00 ±  3%
Update/sqlite/1-workers-4                 403.0 ±  0%
Update/sqlite/4-workers-4                 403.0 ±  0%
Update/sqlite/16-workers-4                403.0 ±  0%
Update/sqlite/64-workers-4                403.0 ±  0%
Update/sqlite/128-workers-4               407.0 ±  1%
Update/dqlite/1-workers-4                 373.0 ±  0%
Update/dqlite/4-workers-4                 373.0 ±  0%
Update/dqlite/16-workers-4                372.0 ±  1%
Update/dqlite/64-workers-4                372.0 ±  0%
Update/dqlite/128-workers-4               371.0 ±  0%
geomean                                   162.0

                                        │         After         │
                                        │ network-bytes-read/op │
Compaction/dqlite-4                               4.025Ki ± 10%
Create/dqlite/1-workers-4                           239.6 ±  0%
Create/dqlite/4-workers-4                           240.4 ±  0%
Create/dqlite/16-workers-4                          242.0 ±  1%
Create/dqlite/64-workers-4                          240.9 ±  7%
Create/dqlite/128-workers-4                         240.8 ±  0%
Delete/dqlite/1-workers-4                           715.6 ±  0%
Delete/dqlite/4-workers-4                           717.9 ±  0%
Delete/dqlite/16-workers-4                          718.0 ±  1%
Delete/dqlite/64-workers-4                          715.2 ±  9%
Delete/dqlite/128-workers-4                         714.9 ±  0%
Get/dqlite-4                                        996.2 ±  0%
List/dqlite-tiny/all-4                              166.7 ± 13%
List/dqlite-tiny/pagination-4                       123.7 ± 15%
List/dqlite-fits-in-page/all-4                    1.331Ki ±  3%
List/dqlite-fits-in-page/pagination-4             1.409Ki ±  6%
List/dqlite-overflows-page/all-4                  7.147Ki ±  4%
List/dqlite-overflows-page/pagination-4           8.002Ki ±  6%
Update/dqlite/1-workers-4                           262.9 ±  0%
Update/dqlite/4-workers-4                           263.0 ±  0%
Update/dqlite/16-workers-4                          262.7 ±  3%
Update/dqlite/64-workers-4                          262.5 ±  0%
Update/dqlite/128-workers-4                         261.6 ±  0%
geomean                                             564.0

                                        │          After           │
                                        │ network-bytes-written/op │
Compaction/dqlite-4                                    5.453 ±  9%
Create/dqlite/1-workers-4                              112.8 ±  2%
Create/dqlite/4-workers-4                              114.2 ±  1%
Create/dqlite/16-workers-4                             117.0 ±  2%
Create/dqlite/64-workers-4                             115.0 ±  6%
Create/dqlite/128-workers-4                            115.2 ±  2%
Delete/dqlite/1-workers-4                              81.49 ±  1%
Delete/dqlite/4-workers-4                              82.40 ±  1%
Delete/dqlite/16-workers-4                             82.48 ±  4%
Delete/dqlite/64-workers-4                             81.28 ± 26%
Delete/dqlite/128-workers-4                            81.23 ±  1%
Get/dqlite-4                                           88.54 ±  0%
List/dqlite-tiny/all-4                               0.03519 ± 24%
List/dqlite-tiny/pagination-4                        0.02137 ± 34%
List/dqlite-fits-in-page/all-4                       0.06136 ±  5%
List/dqlite-fits-in-page/pagination-4                0.07716 ± 10%
List/dqlite-overflows-page/all-4                     0.08092 ±  4%
List/dqlite-overflows-page/pagination-4               0.1064 ±  9%
Update/dqlite/1-workers-4                              136.8 ±  0%
Update/dqlite/4-workers-4                              136.9 ±  0%
Update/dqlite/16-workers-4                             137.0 ±  2%
Update/dqlite/64-workers-4                             137.1 ±  0%
Update/dqlite/128-workers-4                            136.4 ±  0%
geomean                                                13.12

This simplifies the gh workflows and also applies the Docker iptables workaround.

k8s-snap switched to self-hosted CI runners as the default Github ones didn't have enough resources. We'll update the k8s-dqlite CI job to use self-hosted runners as well when running k8s-snap integration tests.

petrutlucian94 · 2025-01-09T15:41:18Z

The CI is hitting this error:

2025-01-09T15:00:21Z k8s.kube-apiserver[3309]: E0109 15:00:21.995542    3309 repair.go:119] "Unhandled Error" err="unable to refresh the port allocations: rpc error: code = Unknown desc = unexpected limit: want 0, got 1" logger="UnhandledError"
2025-01-09T15:00:21Z k8s.kube-apiserver[3309]: W0109 15:00:21.995624    3309 storage_scheduling.go:106] unable to get PriorityClass system-node-critical: rpc error: code = Unknown desc = unexpected limit: want 0, got 1. Retrying...
2025-01-09T15:00:22Z k8s.k8s-dqlite[1947]: time="2025-01-09T15:00:22Z" level=error msg="error while range on /registry/clusterroles/system:aggregate-to-view : unexpected limit: want 0, got 1"

We'll also need the following PR to unlock the tests: #212

LE: picked just the changes that remove the failing checks.

The e2e tests are currently failing because of this k8s-dqlite error: k8s.k8s-dqlite[1947]: time="2025-01-09T15:00:22Z" level=error msg="error while range on /registry/clusterroles/system:aggregate-to-view : unexpected limit: want 0, got 1" A separate PR is removing this check: #212 That being considered, we'll apply this change here to unblock the CI.

petrutlucian94 · 2025-01-10T07:59:04Z

Got a new error:

2025-01-10 07:15:58 (81.9 MB/s) - ‘kube-burner-1.2-Linux-x86_64.tar.gz’ saved [24847348/24847348]

--: line 1: /root/kube-burner: cannot execute binary file: Exec format error

berkayoz · 2025-01-10T09:22:28Z

Got a new error:

2025-01-10 07:15:58 (81.9 MB/s) - ‘kube-burner-1.2-Linux-x86_64.tar.gz’ saved [24847348/24847348]

--: line 1: /root/kube-burner: cannot execute binary file: Exec format error

I see self-hosted-linux-arm64-jammy-large as the runner, did you mean amd64?

petrutlucian94 · 2025-01-10T09:43:33Z

Got a new error:
2025-01-10 07:15:58 (81.9 MB/s) - ‘kube-burner-1.2-Linux-x86_64.tar.gz’ saved [24847348/24847348]

--: line 1: /root/kube-burner: cannot execute binary file: Exec format error
I see self-hosted-linux-arm64-jammy-large as the runner, did you mean amd64?

ohh, my bad. thanks!

petrutlucian94 · 2025-01-10T12:25:11Z

The perf test runs against the PR branch as well as the base (master) branch:

As expected, the test passed with this PR applied and failed on the base branch, which is currently broken.

I think we can go ahead and merge this PR, despite the expected CI failure.

louiseschmidtgen

LGTM, thanks so much Lucian!

Bump CI os and Python versions

490b457

The integration tests use Python 3.8 / ubuntu 20.04. The problem is that k8s-snap tests use type specifiers that require Python 3.10. For this reason, we'll switch to Python 3.10 / ubuntu 22.04.

petrutlucian94 requested a review from a team as a code owner January 9, 2025 13:03

Install lxd using k8s-snap composite action

b1cdfa7

This simplifies the gh workflows and also applies the Docker iptables workaround.

petrutlucian94 force-pushed the lpetrut/bump_versions branch from 76ad142 to b1cdfa7 Compare January 9, 2025 14:15

petrutlucian94 added 2 commits January 9, 2025 14:35

Use self-hosted runners

012127b

k8s-snap switched to self-hosted CI runners as the default Github ones didn't have enough resources. We'll update the k8s-dqlite CI job to use self-hosted runners as well when running k8s-snap integration tests.

Fix r install

32d9896

petrutlucian94 force-pushed the lpetrut/bump_versions branch from 7e18101 to 32d9896 Compare January 9, 2025 15:39

fix self-hosted runner tag

743443f

petrutlucian94 changed the title ~~Bump CI os and Python versions~~ Unblock CI Jan 10, 2025

petrutlucian94 mentioned this pull request Jan 10, 2025

CI: use k8s-snap composite action to install LXD #215

Closed

2 tasks

louiseschmidtgen approved these changes Jan 10, 2025

View reviewed changes

petrutlucian94 merged commit 1d267b0 into master Jan 10, 2025
7 of 8 checks passed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Unblock CI #219

Unblock CI #219

petrutlucian94 commented Jan 9, 2025 •

edited

Loading

github-actions bot commented Jan 9, 2025 •

edited

Loading

petrutlucian94 commented Jan 9, 2025 •

edited

Loading

petrutlucian94 commented Jan 10, 2025

berkayoz commented Jan 10, 2025

petrutlucian94 commented Jan 10, 2025

petrutlucian94 commented Jan 10, 2025

louiseschmidtgen left a comment

Unblock CI #219

Unblock CI #219

Conversation

petrutlucian94 commented Jan 9, 2025 • edited Loading

Thank you for making K8s-dqlite better

github-actions bot commented Jan 9, 2025 • edited Loading

Benchmark

petrutlucian94 commented Jan 9, 2025 • edited Loading

petrutlucian94 commented Jan 10, 2025

berkayoz commented Jan 10, 2025

petrutlucian94 commented Jan 10, 2025

petrutlucian94 commented Jan 10, 2025

louiseschmidtgen left a comment

Choose a reason for hiding this comment

petrutlucian94 commented Jan 9, 2025 •

edited

Loading

github-actions bot commented Jan 9, 2025 •

edited

Loading

petrutlucian94 commented Jan 9, 2025 •

edited

Loading