Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Update integration test #210

Closed
wants to merge 5 commits into from
Closed

Update integration test #210

wants to merge 5 commits into from

Conversation

louiseschmidtgen
Copy link
Contributor

Update integration test

This PR adjusts the integration test workflow in order to drastically reduce the time it takes to complete.

@louiseschmidtgen louiseschmidtgen requested a review from a team as a code owner November 28, 2024 15:42
@github-actions GitHub Actions
Copy link

github-actions bot commented Nov 28, 2024 •
edited
Loading

Benchmark

Results 
goos: linux
goarch: amd64
pkg: github.com/canonical/k8s-dqlite/test
cpu: AMD EPYC 7763 64-Core Processor                
                                        │    Before     │                After                │
                                        │    sec/op     │    sec/op      vs base              │
Compaction/sqlite-4                       19.92µ ±  19%   19.21µ ±  10%       ~ (p=0.209 n=7)
Compaction/dqlite-4                       40.35µ ±   8%   40.52µ ±   5%       ~ (p=0.710 n=7)
Create/sqlite/1-workers-4                 474.1µ ±   5%   474.6µ ±   2%       ~ (p=0.620 n=7)
Create/sqlite/4-workers-4                 451.4µ ±   2%   464.3µ ±   8%       ~ (p=0.383 n=7)
Create/sqlite/16-workers-4                423.4µ ±   6%   415.4µ ±   6%       ~ (p=0.710 n=7)
Create/sqlite/64-workers-4                448.7µ ± 133%   436.8µ ±  46%       ~ (p=0.902 n=7)
Create/sqlite/128-workers-4               644.7µ ± 116%   636.1µ ±  97%       ~ (p=0.902 n=7)
Create/dqlite/1-workers-4                 1.026m ±   3%   1.042m ±   5%  +1.49% (p=0.038 n=7)
Create/dqlite/4-workers-4                 931.6µ ±   4%   939.0µ ±   5%       ~ (p=0.383 n=7)
Create/dqlite/16-workers-4                916.9µ ±   2%   930.4µ ±   4%       ~ (p=0.318 n=7)
Create/dqlite/64-workers-4                929.8µ ±   3%   929.2µ ±   3%       ~ (p=0.805 n=7)
Create/dqlite/128-workers-4               906.8µ ±   5%   928.7µ ±   4%       ~ (p=0.318 n=7)
Delete/sqlite/1-workers-4                 466.9µ ±   3%   459.8µ ±   3%       ~ (p=0.902 n=7)
Delete/sqlite/4-workers-4                 443.8µ ±   4%   451.2µ ±   2%       ~ (p=0.165 n=7)
Delete/sqlite/16-workers-4                421.4µ ±   7%   439.8µ ±   7%       ~ (p=0.318 n=7)
Delete/sqlite/64-workers-4                425.5µ ±  20%   470.6µ ±  17%       ~ (p=0.165 n=7)
Delete/sqlite/128-workers-4               606.5µ ± 206%   490.4µ ±  48%       ~ (p=0.128 n=7)
Delete/dqlite/1-workers-4                 1.033m ±   2%   1.026m ±   3%       ~ (p=0.902 n=7)
Delete/dqlite/4-workers-4                 916.4µ ±   5%   917.8µ ±   5%       ~ (p=0.710 n=7)
Delete/dqlite/16-workers-4                911.8µ ±   3%   911.4µ ±   6%       ~ (p=1.000 n=7)
Delete/dqlite/64-workers-4                893.1µ ±   7%   903.0µ ±   7%       ~ (p=1.000 n=7)
Delete/dqlite/128-workers-4               918.5µ ±   2%   906.4µ ±   6%       ~ (p=0.097 n=7)
Get/sqlite-4                              222.7µ ±   1%   223.5µ ±   1%       ~ (p=0.209 n=7)
Get/dqlite-4                              336.2µ ±   1%   334.2µ ±   1%       ~ (p=0.073 n=7)
List/sqlite-tiny/all-4                    3.662µ ±   3%   3.685µ ±  10%       ~ (p=0.902 n=7)
List/sqlite-tiny/pagination-4             6.043µ ±   4%   6.006µ ±   3%       ~ (p=0.383 n=7)
List/sqlite-fits-in-page/all-4            6.716µ ±   6%   7.005µ ±   4%       ~ (p=0.128 n=7)
List/sqlite-fits-in-page/pagination-4     17.15µ ±   4%   17.14µ ±   4%       ~ (p=0.620 n=7)
List/sqlite-overflows-page/all-4          16.16µ ±   3%   15.99µ ±   3%       ~ (p=0.456 n=7)
List/sqlite-overflows-page/pagination-4   20.50µ ±   3%   20.57µ ±   3%       ~ (p=0.318 n=7)
List/dqlite-tiny/all-4                    2.478µ ±   2%   2.517µ ±   2%       ~ (p=0.209 n=7)
List/dqlite-tiny/pagination-4             4.686µ ±   7%   4.746µ ±   1%  +1.28% (p=0.012 n=7)
List/dqlite-fits-in-page/all-4            6.323µ ±   3%   6.333µ ±   3%       ~ (p=0.874 n=7)
List/dqlite-fits-in-page/pagination-4     13.42µ ±   6%   13.70µ ±   2%       ~ (p=0.128 n=7)
List/dqlite-overflows-page/all-4          21.10µ ±   3%   20.68µ ±   3%       ~ (p=0.209 n=7)
List/dqlite-overflows-page/pagination-4   25.22µ ±   3%   25.05µ ±   3%       ~ (p=0.383 n=7)
Update/sqlite/1-workers-4                 468.7µ ±   1%   473.6µ ±   3%       ~ (p=0.209 n=7)
Update/sqlite/4-workers-4                 451.0µ ±   4%   451.2µ ±   3%       ~ (p=0.710 n=7)
Update/sqlite/16-workers-4                423.2µ ±   6%   418.5µ ±   6%       ~ (p=0.805 n=7)
Update/sqlite/64-workers-4                438.6µ ±  10%   467.1µ ±  77%       ~ (p=0.805 n=7)
Update/sqlite/128-workers-4               832.4µ ± 175%   670.2µ ± 279%       ~ (p=1.000 n=7)
Update/dqlite/1-workers-4                 1.033m ±   2%   1.019m ±   2%       ~ (p=0.165 n=7)
Update/dqlite/4-workers-4                 922.0µ ±   4%   920.8µ ±   3%       ~ (p=0.902 n=7)
Update/dqlite/16-workers-4                909.3µ ±   4%   898.4µ ±   3%       ~ (p=0.620 n=7)
Update/dqlite/64-workers-4                925.4µ ±   2%   913.4µ ±   3%       ~ (p=0.097 n=7)
Update/dqlite/128-workers-4               922.8µ ±   4%   921.5µ ±   5%       ~ (p=0.620 n=7)
geomean                                   185.1µ          184.2µ         -0.47%

                                        │        Before        │                    After                     │
                                        │ page-cache-misses/op │ page-cache-misses/op  vs base                │
Compaction/sqlite-4                               0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Compaction/dqlite-4                               0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/sqlite/1-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/sqlite/4-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/sqlite/16-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/sqlite/64-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/sqlite/128-workers-4                       0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/dqlite/1-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/dqlite/4-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/dqlite/16-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/dqlite/64-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/dqlite/128-workers-4                       0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/sqlite/1-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/sqlite/4-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/sqlite/16-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/sqlite/64-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/sqlite/128-workers-4                       0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/dqlite/1-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/dqlite/4-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/dqlite/16-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/dqlite/64-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/dqlite/128-workers-4                       0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Get/sqlite-4                                      0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Get/dqlite-4                                      0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-tiny/all-4                            0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-tiny/pagination-4                     0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-fits-in-page/all-4                    0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-fits-in-page/pagination-4             0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-overflows-page/all-4                  0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-overflows-page/pagination-4           0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-tiny/all-4                            0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-tiny/pagination-4                     0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-fits-in-page/all-4                    0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-fits-in-page/pagination-4             0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-overflows-page/all-4                  0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-overflows-page/pagination-4           0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/sqlite/1-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/sqlite/4-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/sqlite/16-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/sqlite/64-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/sqlite/128-workers-4                       0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/dqlite/1-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/dqlite/4-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/dqlite/16-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/dqlite/64-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/dqlite/128-workers-4                       0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
geomean                                                      ²                         +0.00%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean

                                        │        Before        │                    After                     │
                                        │ page-cache-spills/op │ page-cache-spills/op  vs base                │
Compaction/sqlite-4                               0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Compaction/dqlite-4                               0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/sqlite/1-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/sqlite/4-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/sqlite/16-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/sqlite/64-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/sqlite/128-workers-4                       0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/dqlite/1-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/dqlite/4-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/dqlite/16-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/dqlite/64-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/dqlite/128-workers-4                       0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/sqlite/1-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/sqlite/4-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/sqlite/16-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/sqlite/64-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/sqlite/128-workers-4                       0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/dqlite/1-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/dqlite/4-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/dqlite/16-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/dqlite/64-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Delete/dqlite/128-workers-4                       0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Get/sqlite-4                                      0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Get/dqlite-4                                      0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-tiny/all-4                            0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-tiny/pagination-4                     0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-fits-in-page/all-4                    0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-fits-in-page/pagination-4             0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-overflows-page/all-4                  0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-overflows-page/pagination-4           0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-tiny/all-4                            0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-tiny/pagination-4                     0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-fits-in-page/all-4                    0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-fits-in-page/pagination-4             0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-overflows-page/all-4                  0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-overflows-page/pagination-4           0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/sqlite/1-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/sqlite/4-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/sqlite/16-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/sqlite/64-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/sqlite/128-workers-4                       0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/dqlite/1-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/dqlite/4-workers-4                         0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/dqlite/16-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/dqlite/64-workers-4                        0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/dqlite/128-workers-4                       0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
geomean                                                      ²                         +0.00%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean

                                        │    Before     │                After                │
                                        │ page-reads/op │ page-reads/op  vs base              │
Compaction/sqlite-4                         12.20 ±  1%     12.23 ±  1%       ~ (p=0.881 n=7)
Compaction/dqlite-4                         12.16 ±  1%     12.18 ±  2%       ~ (p=0.645 n=7)
Create/sqlite/1-workers-4                   13.91 ±  0%     13.91 ±  0%       ~ (p=1.000 n=7)
Create/sqlite/4-workers-4                   12.72 ±  2%     12.59 ±  3%       ~ (p=0.334 n=7)
Create/sqlite/16-workers-4                  10.72 ±  6%     10.34 ±  4%  -3.54% (p=0.016 n=7)
Create/sqlite/64-workers-4                  9.150 ±  6%     8.838 ±  5%       ~ (p=0.456 n=7)
Create/sqlite/128-workers-4                 8.359 ±  6%     8.165 ±  4%       ~ (p=0.805 n=7)
Create/dqlite/1-workers-4                   13.31 ±  1%     13.27 ±  2%       ~ (p=0.476 n=7)
Create/dqlite/4-workers-4                   10.90 ±  1%     10.94 ±  2%       ~ (p=0.365 n=7)
Create/dqlite/16-workers-4                  10.94 ±  1%     11.01 ±  1%       ~ (p=0.434 n=7)
Create/dqlite/64-workers-4                  10.93 ±  2%     10.90 ±  1%       ~ (p=0.244 n=7)
Create/dqlite/128-workers-4                 10.90 ±  1%     10.90 ±  1%       ~ (p=0.990 n=7)
Delete/sqlite/1-workers-4                   16.22 ±  0%     16.23 ±  0%       ~ (p=0.196 n=7)
Delete/sqlite/4-workers-4                   14.41 ±  5%     14.61 ±  2%       ~ (p=0.154 n=7)
Delete/sqlite/16-workers-4                  12.13 ±  3%     12.30 ±  4%       ~ (p=0.805 n=7)
Delete/sqlite/64-workers-4                  9.682 ±  4%    10.160 ±  8%  +4.94% (p=0.035 n=7)
Delete/sqlite/128-workers-4                 9.333 ±  5%     9.300 ±  2%       ~ (p=0.259 n=7)
Delete/dqlite/1-workers-4                   15.62 ±  1%     15.51 ±  2%       ~ (p=0.058 n=7)
Delete/dqlite/4-workers-4                   13.39 ±  1%     13.36 ±  1%       ~ (p=0.513 n=7)
Delete/dqlite/16-workers-4                  13.32 ±  1%     13.35 ±  4%       ~ (p=0.366 n=7)
Delete/dqlite/64-workers-4                  13.18 ±  2%     13.18 ±  3%       ~ (p=0.922 n=7)
Delete/dqlite/128-workers-4                 13.15 ±  1%     13.21 ±  4%       ~ (p=0.973 n=7)
Get/sqlite-4                                14.95 ±  0%     14.96 ±  0%       ~ (p=0.213 n=7)
Get/dqlite-4                                11.97 ±  0%     11.97 ±  0%       ~ (p=0.481 n=7)
List/sqlite-tiny/all-4                     191.9m ±  0%    192.0m ±  1%       ~ (p=0.193 n=7)
List/sqlite-tiny/pagination-4               1.126 ±  3%     1.126 ±  0%       ~ (p=1.000 n=7)
List/sqlite-fits-in-page/all-4             162.3m ± 59%    164.0m ± 57%       ~ (p=0.119 n=7)
List/sqlite-fits-in-page/pagination-4      959.8m ±  3%    959.0m ±  3%       ~ (p=0.902 n=7)
List/sqlite-overflows-page/all-4           177.2m ±  0%    177.2m ±  0%       ~ (p=1.000 n=7)
List/sqlite-overflows-page/pagination-4     1.065 ±  3%     1.065 ±  0%       ~ (p=1.000 n=7)
List/dqlite-tiny/all-4                     190.9m ±  0%    190.9m ±  0%       ~ (p=0.904 n=7)
List/dqlite-tiny/pagination-4               1.126 ±  0%     1.126 ±  3%       ~ (p=1.000 n=7)
List/dqlite-fits-in-page/all-4             164.1m ±  0%    164.2m ± 59%       ~ (p=0.226 n=7)
List/dqlite-fits-in-page/pagination-4      954.9m ±  0%    956.1m ±  3%       ~ (p=0.333 n=7)
List/dqlite-overflows-page/all-4           184.6m ±  0%    184.3m ±  2%       ~ (p=0.104 n=7)
List/dqlite-overflows-page/pagination-4     1.101 ±  5%     1.084 ±  5%       ~ (p=0.596 n=7)
Update/sqlite/1-workers-4                   15.84 ±  0%     15.83 ±  0%  -0.06% (p=0.021 n=7)
Update/sqlite/4-workers-4                   14.51 ±  4%     14.58 ±  2%       ~ (p=0.976 n=7)
Update/sqlite/16-workers-4                  12.45 ±  5%     12.57 ±  3%       ~ (p=0.710 n=7)
Update/sqlite/64-workers-4                  10.97 ±  5%     10.78 ±  5%       ~ (p=0.777 n=7)
Update/sqlite/128-workers-4                 10.56 ± 13%     10.36 ± 16%       ~ (p=0.318 n=7)
Update/dqlite/1-workers-4                   15.17 ±  1%     15.23 ±  1%       ~ (p=0.598 n=7)
Update/dqlite/4-workers-4                   12.78 ±  1%     12.84 ±  1%       ~ (p=0.686 n=7)
Update/dqlite/16-workers-4                  12.82 ±  2%     12.78 ±  1%       ~ (p=0.686 n=7)
Update/dqlite/64-workers-4                  12.73 ±  1%     12.74 ±  1%       ~ (p=0.971 n=7)
Update/dqlite/128-workers-4                 12.60 ±  2%     12.66 ±  1%       ~ (p=0.220 n=7)
geomean                                     5.143           5.138        -0.09%

                                        │     Before     │                 After                  │
                                        │ page-writes/op │ page-writes/op  vs base                │
Compaction/sqlite-4                        190.7m ± 0%        190.7m ± 0%       ~ (p=0.806 n=7)
Compaction/dqlite-4                        187.4m ± 1%        187.8m ± 1%       ~ (p=0.078 n=7)
Create/sqlite/1-workers-4                   4.362 ± 0%         4.363 ± 0%       ~ (p=0.469 n=7)
Create/sqlite/4-workers-4                   4.314 ± 1%         4.322 ± 1%       ~ (p=0.646 n=7)
Create/sqlite/16-workers-4                  4.288 ± 1%         4.309 ± 1%       ~ (p=0.435 n=7)
Create/sqlite/64-workers-4                  4.240 ± 2%         4.256 ± 1%       ~ (p=0.710 n=7)
Create/sqlite/128-workers-4                 4.212 ± 2%         4.220 ± 2%       ~ (p=0.805 n=7)
Create/dqlite/1-workers-4                   4.269 ± 1%         4.269 ± 1%       ~ (p=0.801 n=7)
Create/dqlite/4-workers-4                   4.300 ± 0%         4.299 ± 0%       ~ (p=0.374 n=7)
Create/dqlite/16-workers-4                  4.301 ± 0%         4.300 ± 0%       ~ (p=0.617 n=7)
Create/dqlite/64-workers-4                  4.309 ± 0%         4.302 ± 1%       ~ (p=0.333 n=7)
Create/dqlite/128-workers-4                 4.299 ± 0%         4.304 ± 1%       ~ (p=0.742 n=7)
Delete/sqlite/1-workers-4                   4.385 ± 0%         4.391 ± 0%       ~ (p=0.136 n=7)
Delete/sqlite/4-workers-4                   4.387 ± 2%         4.379 ± 1%       ~ (p=0.876 n=7)
Delete/sqlite/16-workers-4                  4.374 ± 0%         4.361 ± 1%       ~ (p=0.829 n=7)
Delete/sqlite/64-workers-4                  4.365 ± 1%         4.355 ± 1%       ~ (p=0.383 n=7)
Delete/sqlite/128-workers-4                 4.353 ± 1%         4.368 ± 1%       ~ (p=0.209 n=7)
Delete/dqlite/1-workers-4                   4.380 ± 0%         4.378 ± 1%       ~ (p=0.620 n=7)
Delete/dqlite/4-workers-4                   4.383 ± 1%         4.374 ± 0%  -0.21% (p=0.041 n=7)
Delete/dqlite/16-workers-4                  4.374 ± 1%         4.373 ± 0%       ~ (p=0.559 n=7)
Delete/dqlite/64-workers-4                  4.355 ± 1%         4.352 ± 1%       ~ (p=0.620 n=7)
Delete/dqlite/128-workers-4                 4.341 ± 0%         4.352 ± 1%       ~ (p=0.152 n=7)
Get/sqlite-4                                0.000 ± 0%         0.000 ± 0%       ~ (p=1.000 n=7) ¹
Get/dqlite-4                                0.000 ± 0%         0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-tiny/all-4                      0.000 ± 0%         0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-tiny/pagination-4               0.000 ± 0%         0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-fits-in-page/all-4              0.000 ± 0%         0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-fits-in-page/pagination-4       0.000 ± 0%         0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-overflows-page/all-4            0.000 ± 0%         0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-overflows-page/pagination-4     0.000 ± 0%         0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-tiny/all-4                      0.000 ± 0%         0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-tiny/pagination-4               0.000 ± 0%         0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-fits-in-page/all-4              0.000 ± 0%         0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-fits-in-page/pagination-4       0.000 ± 0%         0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-overflows-page/all-4            0.000 ± 0%         0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-overflows-page/pagination-4     0.000 ± 0%         0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/sqlite/1-workers-4                   4.233 ± 0%         4.233 ± 0%       ~ (p=0.582 n=7)
Update/sqlite/4-workers-4                   4.325 ± 1%         4.307 ± 1%       ~ (p=0.477 n=7)
Update/sqlite/16-workers-4                  4.318 ± 1%         4.305 ± 1%       ~ (p=0.648 n=7)
Update/sqlite/64-workers-4                  4.301 ± 1%         4.292 ± 1%       ~ (p=0.732 n=7)
Update/sqlite/128-workers-4                 4.285 ± 4%         4.270 ± 3%       ~ (p=0.535 n=7)
Update/dqlite/1-workers-4                   4.212 ± 0%         4.205 ± 0%       ~ (p=0.088 n=7)
Update/dqlite/4-workers-4                   4.203 ± 1%         4.224 ± 1%       ~ (p=0.245 n=7)
Update/dqlite/16-workers-4                  4.220 ± 1%         4.228 ± 0%       ~ (p=0.646 n=7)
Update/dqlite/64-workers-4                  4.242 ± 1%         4.239 ± 1%       ~ (p=0.596 n=7)
Update/dqlite/128-workers-4                 4.252 ± 1%         4.250 ± 1%       ~ (p=1.000 n=7)
geomean                                                ²                   +0.00%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean

                                        │     Before     │                 After                 │
                                        │ sec-reading/op │ sec-reading/op  vs base               │
Compaction/sqlite-4                         27.60µ ± 38%     26.90µ ± 37%        ~ (p=0.438 n=7)
Compaction/dqlite-4                         27.70µ ± 62%     30.80µ ± 74%        ~ (p=0.197 n=7)
Create/sqlite/1-workers-4                   19.70µ ± 17%     22.20µ ± 24%        ~ (p=0.318 n=7)
Create/sqlite/4-workers-4                   19.10µ ± 17%     23.80µ ± 21%  +24.61% (p=0.005 n=7)
Create/sqlite/16-workers-4                  21.20µ ± 29%     21.10µ ± 31%        ~ (p=0.688 n=7)
Create/sqlite/64-workers-4                  20.70µ ± 36%     21.30µ ± 95%        ~ (p=0.535 n=7)
Create/sqlite/128-workers-4                 25.40µ ± 35%     24.10µ ± 25%        ~ (p=0.535 n=7)
Create/dqlite/1-workers-4                   8.300µ ± 49%    11.600µ ± 38%        ~ (p=0.057 n=7)
Create/dqlite/4-workers-4                   12.10µ ± 56%     11.90µ ± 61%        ~ (p=0.533 n=7)
Create/dqlite/16-workers-4                  9.100µ ± 62%    12.300µ ± 31%        ~ (p=0.318 n=7)
Create/dqlite/64-workers-4                 13.100µ ± 66%     8.700µ ± 60%        ~ (p=0.383 n=7)
Create/dqlite/128-workers-4                11.000µ ± 82%     8.100µ ± 90%        ~ (p=0.558 n=7)
Delete/sqlite/1-workers-4                   31.40µ ± 16%     33.60µ ±  8%        ~ (p=0.193 n=7)
Delete/sqlite/4-workers-4                   32.60µ ± 21%     33.70µ ± 15%        ~ (p=0.596 n=7)
Delete/sqlite/16-workers-4                  35.10µ ± 11%     34.90µ ± 23%        ~ (p=0.209 n=7)
Delete/sqlite/64-workers-4                  34.70µ ± 32%     36.80µ ± 17%        ~ (p=0.118 n=7)
Delete/sqlite/128-workers-4                 41.30µ ± 21%     40.00µ ± 21%        ~ (p=0.783 n=7)
Delete/dqlite/1-workers-4                   14.70µ ± 39%     16.90µ ± 31%        ~ (p=0.535 n=7)
Delete/dqlite/4-workers-4                   17.10µ ± 22%     15.50µ ± 45%        ~ (p=0.620 n=7)
Delete/dqlite/16-workers-4                  14.40µ ± 43%     14.00µ ± 31%        ~ (p=0.456 n=7)
Delete/dqlite/64-workers-4                  18.90µ ± 60%     15.80µ ± 43%        ~ (p=0.206 n=7)
Delete/dqlite/128-workers-4                 15.90µ ± 23%     16.90µ ± 51%        ~ (p=0.686 n=7)
Get/sqlite-4                                61.60µ ±  8%     62.40µ ±  7%        ~ (p=0.738 n=7)
Get/dqlite-4                                35.30µ ± 12%     33.90µ ± 14%        ~ (p=0.513 n=7)
List/sqlite-tiny/all-4                      6.900µ ±  3%     6.900µ ± 29%        ~ (p=0.844 n=7)
List/sqlite-tiny/pagination-4               8.700µ ± 13%     8.700µ ± 10%        ~ (p=0.213 n=7)
List/sqlite-fits-in-page/all-4              10.30µ ± 26%     12.80µ ± 20%  +24.27% (p=0.049 n=7)
List/sqlite-fits-in-page/pagination-4       28.10µ ± 15%     28.70µ ± 17%        ~ (p=0.804 n=7)
List/sqlite-overflows-page/all-4            12.50µ ±  2%     12.20µ ±  4%        ~ (p=0.121 n=7)
List/sqlite-overflows-page/pagination-4     16.10µ ±  2%     16.30µ ±  3%        ~ (p=0.335 n=7)
List/dqlite-tiny/all-4                      3.200µ ±  6%     3.300µ ± 24%   +3.12% (p=0.018 n=7)
List/dqlite-tiny/pagination-4               7.400µ ± 34%     7.400µ ± 12%        ~ (p=0.881 n=7)
List/dqlite-fits-in-page/all-4             10.000µ ± 17%     9.900µ ± 15%        ~ (p=0.836 n=7)
List/dqlite-fits-in-page/pagination-4       18.10µ ± 34%     21.70µ ± 14%        ~ (p=0.259 n=7)
List/dqlite-overflows-page/all-4            33.90µ ± 10%     33.80µ ±  2%        ~ (p=0.887 n=7)
List/dqlite-overflows-page/pagination-4     39.90µ ± 12%     41.10µ ±  3%        ~ (p=0.119 n=7)
Update/sqlite/1-workers-4                   18.20µ ± 35%     20.80µ ± 27%        ~ (p=0.073 n=7)
Update/sqlite/4-workers-4                   19.80µ ± 26%     20.20µ ± 21%        ~ (p=0.972 n=7)
Update/sqlite/16-workers-4                  21.40µ ± 23%     24.10µ ± 18%  +12.62% (p=0.034 n=7)
Update/sqlite/64-workers-4                  22.90µ ± 14%     26.70µ ± 10%  +16.59% (p=0.016 n=7)
Update/sqlite/128-workers-4                 24.20µ ± 58%     24.20µ ± 50%        ~ (p=0.929 n=7)
Update/dqlite/1-workers-4                   9.100µ ± 62%    10.500µ ± 56%        ~ (p=0.902 n=7)
Update/dqlite/4-workers-4                   11.10µ ± 50%     10.80µ ± 34%        ~ (p=0.974 n=7)
Update/dqlite/16-workers-4                  9.500µ ± 55%    12.300µ ± 28%        ~ (p=0.165 n=7)
Update/dqlite/64-workers-4                  9.500µ ± 64%    11.300µ ± 47%        ~ (p=0.902 n=7)
Update/dqlite/128-workers-4                 12.10µ ± 67%     10.20µ ± 43%        ~ (p=0.710 n=7)
geomean                                     17.08µ           17.66µ         +3.41%

                                        │     Before     │                  After                  │
                                        │ sec-writing/op │ sec-writing/op  vs base                 │
Compaction/sqlite-4                       9.600µ ± 16%       9.200µ ± 21%        ~ (p=0.464 n=7)
Compaction/dqlite-4                       6.500µ ± 12%       7.000µ ± 10%        ~ (p=0.330 n=7)
Create/sqlite/1-workers-4                 252.6µ ±  9%       245.7µ ±  6%        ~ (p=0.710 n=7)
Create/sqlite/4-workers-4                 1.404m ±  4%       1.419m ±  8%        ~ (p=0.558 n=7)
Create/sqlite/16-workers-4                5.129m ±  8%       5.182m ±  4%        ~ (p=0.620 n=7)
Create/sqlite/64-workers-4                17.75m ± 22%       17.58m ±  4%        ~ (p=0.780 n=7)
Create/sqlite/128-workers-4               34.34m ± 41%       34.79m ± 32%        ~ (p=0.535 n=7)
Create/dqlite/1-workers-4                 42.90µ ± 46%       46.40µ ± 25%        ~ (p=0.334 n=7)
Create/dqlite/4-workers-4                 49.20µ ± 25%       42.30µ ± 30%        ~ (p=0.535 n=7)
Create/dqlite/16-workers-4                43.70µ ± 18%       44.90µ ± 34%        ~ (p=0.805 n=7)
Create/dqlite/64-workers-4                47.00µ ± 27%       40.90µ ± 27%        ~ (p=0.383 n=7)
Create/dqlite/128-workers-4               45.20µ ± 16%       45.50µ ± 13%        ~ (p=0.383 n=7)
Delete/sqlite/1-workers-4                 241.0µ ±  5%       234.6µ ±  5%   -2.66% (p=0.038 n=7)
Delete/sqlite/4-workers-4                 1.344m ±  6%       1.348m ±  9%        ~ (p=1.000 n=7)
Delete/sqlite/16-workers-4                5.046m ± 10%       5.228m ±  6%        ~ (p=0.456 n=7)
Delete/sqlite/64-workers-4                17.57m ±  5%       18.28m ±  9%        ~ (p=0.513 n=7)
Delete/sqlite/128-workers-4               32.89m ± 64%       32.48m ±  9%        ~ (p=0.128 n=7)
Delete/dqlite/1-workers-4                 39.40µ ± 24%       48.50µ ± 29%        ~ (p=0.097 n=7)
Delete/dqlite/4-workers-4                 45.60µ ± 20%       43.70µ ± 16%        ~ (p=0.902 n=7)
Delete/dqlite/16-workers-4                42.40µ ± 24%       42.80µ ± 12%        ~ (p=0.902 n=7)
Delete/dqlite/64-workers-4                45.30µ ± 28%       40.70µ ± 25%        ~ (p=0.334 n=7)
Delete/dqlite/128-workers-4               49.80µ ± 25%       42.70µ ± 11%        ~ (p=0.259 n=7)
Get/sqlite-4                               0.000 ±  0%        0.000 ±  0%        ~ (p=1.000 n=7) ¹
Get/dqlite-4                               0.000 ±  0%        0.000 ±  0%        ~ (p=1.000 n=7) ¹
List/sqlite-tiny/all-4                     0.000 ±  0%        0.000 ±  0%        ~ (p=1.000 n=7) ¹
List/sqlite-tiny/pagination-4              0.000 ±  0%        0.000 ±  0%        ~ (p=1.000 n=7) ¹
List/sqlite-fits-in-page/all-4             0.000 ±  0%        0.000 ±  0%        ~ (p=1.000 n=7) ¹
List/sqlite-fits-in-page/pagination-4      0.000 ±  0%        0.000 ±  0%        ~ (p=1.000 n=7) ¹
List/sqlite-overflows-page/all-4           0.000 ±  0%        0.000 ±  0%        ~ (p=1.000 n=7) ¹
List/sqlite-overflows-page/pagination-4    0.000 ±  0%        0.000 ±  0%        ~ (p=1.000 n=7) ¹
List/dqlite-tiny/all-4                     0.000 ±  0%        0.000 ±  0%        ~ (p=1.000 n=7) ¹
List/dqlite-tiny/pagination-4              0.000 ±  0%        0.000 ±  0%        ~ (p=1.000 n=7) ¹
List/dqlite-fits-in-page/all-4             0.000 ±  0%        0.000 ±  0%        ~ (p=1.000 n=7) ¹
List/dqlite-fits-in-page/pagination-4      0.000 ±  0%        0.000 ±  0%        ~ (p=1.000 n=7) ¹
List/dqlite-overflows-page/all-4           0.000 ±  0%        0.000 ±  0%        ~ (p=1.000 n=7) ¹
List/dqlite-overflows-page/pagination-4    0.000 ±  0%        0.000 ±  0%        ~ (p=1.000 n=7) ¹
Update/sqlite/1-workers-4                 245.1µ ± 10%       239.5µ ±  6%        ~ (p=0.511 n=7)
Update/sqlite/4-workers-4                 1.366m ± 14%       1.350m ± 10%        ~ (p=0.805 n=7)
Update/sqlite/16-workers-4                5.156m ±  7%       5.233m ±  9%        ~ (p=0.620 n=7)
Update/sqlite/64-workers-4                17.49m ±  3%       18.01m ± 14%   +2.97% (p=0.004 n=7)
Update/sqlite/128-workers-4               36.13m ± 69%       35.01m ± 63%        ~ (p=0.805 n=7)
Update/dqlite/1-workers-4                 34.80µ ± 32%       39.10µ ± 25%        ~ (p=1.000 n=7)
Update/dqlite/4-workers-4                 47.40µ ± 19%       42.30µ ± 17%  -10.76% (p=0.017 n=7)
Update/dqlite/16-workers-4                46.50µ ± 17%       41.00µ ± 53%        ~ (p=0.365 n=7)
Update/dqlite/64-workers-4                43.70µ ± 14%       41.30µ ± 16%        ~ (p=0.383 n=7)
Update/dqlite/128-workers-4               43.60µ ± 19%       40.80µ ± 25%        ~ (p=0.776 n=7)
geomean                                                ²                    -1.01%               ²
¹ all samples are equal
² summaries must be >0 to compute geomean

                                        │    Before     │                After                │
                                        │     B/op      │     B/op       vs base              │
Compaction/sqlite-4                       2.279Ki ± 45%   2.232Ki ± 46%       ~ (p=0.259 n=7)
Compaction/dqlite-4                       4.440Ki ± 83%   5.197Ki ± 89%       ~ (p=0.209 n=7)
Create/sqlite/1-workers-4                 20.39Ki ±  0%   20.39Ki ±  0%       ~ (p=0.689 n=7)
Create/sqlite/4-workers-4                 20.38Ki ±  0%   20.39Ki ±  0%       ~ (p=0.104 n=7)
Create/sqlite/16-workers-4                20.37Ki ±  0%   20.37Ki ±  0%       ~ (p=0.731 n=7)
Create/sqlite/64-workers-4                20.41Ki ±  1%   20.41Ki ±  0%       ~ (p=0.685 n=7)
Create/sqlite/128-workers-4               20.54Ki ±  1%   20.53Ki ±  1%       ~ (p=0.902 n=7)
Create/dqlite/1-workers-4                 19.66Ki ±  0%   19.65Ki ±  0%       ~ (p=0.215 n=7)
Create/dqlite/4-workers-4                 19.63Ki ±  0%   19.64Ki ±  0%       ~ (p=0.120 n=7)
Create/dqlite/16-workers-4                19.64Ki ±  0%   19.64Ki ±  0%       ~ (p=0.740 n=7)
Create/dqlite/64-workers-4                19.64Ki ±  0%   19.65Ki ± 10%       ~ (p=0.473 n=7)
Create/dqlite/128-workers-4               19.67Ki ± 11%   19.71Ki ±  5%       ~ (p=0.535 n=7)
Delete/sqlite/1-workers-4                 22.81Ki ±  0%   22.81Ki ±  0%       ~ (p=0.685 n=7)
Delete/sqlite/4-workers-4                 22.81Ki ±  0%   22.81Ki ±  0%       ~ (p=0.395 n=7)
Delete/sqlite/16-workers-4                22.78Ki ±  0%   22.79Ki ±  0%       ~ (p=0.220 n=7)
Delete/sqlite/64-workers-4                22.79Ki ±  0%   22.84Ki ±  0%  +0.19% (p=0.049 n=7)
Delete/sqlite/128-workers-4               22.93Ki ±  2%   22.86Ki ±  0%       ~ (p=0.097 n=7)
Delete/dqlite/1-workers-4                 21.91Ki ±  0%   21.90Ki ±  0%       ~ (p=0.476 n=7)
Delete/dqlite/4-workers-4                 21.88Ki ±  0%   21.87Ki ±  0%       ~ (p=0.776 n=7)
Delete/dqlite/16-workers-4                21.88Ki ±  2%   21.88Ki ± 10%       ~ (p=0.594 n=7)
Delete/dqlite/64-workers-4                21.89Ki ± 10%   21.89Ki ± 10%       ~ (p=0.832 n=7)
Delete/dqlite/128-workers-4               21.92Ki ±  0%   21.91Ki ± 10%       ~ (p=0.329 n=7)
Get/sqlite-4                              23.02Ki ±  0%   23.02Ki ±  0%       ~ (p=0.617 n=7)
Get/dqlite-4                              21.96Ki ±  0%   21.96Ki ±  0%       ~ (p=0.761 n=7)
List/sqlite-tiny/all-4                    1.178Ki ±  5%   1.189Ki ± 16%       ~ (p=0.336 n=7)
List/sqlite-tiny/pagination-4             1.104Ki ±  7%   1.096Ki ±  7%       ~ (p=0.435 n=7)
List/sqlite-fits-in-page/all-4            6.475Ki ± 18%   7.538Ki ± 15%       ~ (p=0.097 n=7)
List/sqlite-fits-in-page/pagination-4     9.183Ki ± 13%   9.130Ki ± 15%       ~ (p=0.620 n=7)
List/sqlite-overflows-page/all-4          20.49Ki ±  0%   20.49Ki ±  0%       ~ (p=0.738 n=7)
List/sqlite-overflows-page/pagination-4   18.51Ki ±  8%   18.51Ki ±  5%       ~ (p=0.646 n=7)
List/dqlite-tiny/all-4                      990.0 ±  4%     990.0 ±  3%       ~ (p=0.829 n=7)
List/dqlite-tiny/pagination-4               955.0 ± 20%     958.0 ±  2%       ~ (p=0.535 n=7)
List/dqlite-fits-in-page/all-4            6.008Ki ± 10%   5.991Ki ±  8%       ~ (p=1.000 n=7)
List/dqlite-fits-in-page/pagination-4     5.627Ki ± 15%   5.996Ki ±  3%       ~ (p=0.165 n=7)
List/dqlite-overflows-page/all-4          30.91Ki ± 10%   30.30Ki ±  9%       ~ (p=0.128 n=7)
List/dqlite-overflows-page/pagination-4   31.81Ki ±  4%   31.68Ki ±  2%       ~ (p=0.710 n=7)
Update/sqlite/1-workers-4                 21.54Ki ±  0%   21.55Ki ±  0%  +0.02% (p=0.049 n=7)
Update/sqlite/4-workers-4                 21.54Ki ±  0%   21.54Ki ±  0%  +0.03% (p=0.036 n=7)
Update/sqlite/16-workers-4                21.55Ki ±  0%   21.53Ki ±  0%       ~ (p=0.620 n=7)
Update/sqlite/64-workers-4                21.55Ki ±  0%   21.56Ki ±  0%       ~ (p=0.383 n=7)
Update/sqlite/128-workers-4               21.66Ki ±  1%   21.64Ki ±  1%       ~ (p=0.620 n=7)
Update/dqlite/1-workers-4                 20.76Ki ±  0%   20.76Ki ±  0%       ~ (p=0.607 n=7)
Update/dqlite/4-workers-4                 20.73Ki ±  0%   20.73Ki ±  0%       ~ (p=1.000 n=7)
Update/dqlite/16-workers-4                20.73Ki ±  3%   20.73Ki ±  0%       ~ (p=0.794 n=7)
Update/dqlite/64-workers-4                20.72Ki ±  0%   20.76Ki ±  0%       ~ (p=0.069 n=7)
Update/dqlite/128-workers-4               20.73Ki ±  0%   20.73Ki ±  0%       ~ (p=0.710 n=7)
geomean                                   13.79Ki         13.89Ki        +0.71%

                                        │   Before    │                After                │
                                        │  allocs/op  │  allocs/op   vs base                │
Compaction/sqlite-4                       49.00 ± 47%   48.00 ± 48%       ~ (p=0.394 n=7)
Compaction/dqlite-4                       106.0 ± 84%   125.0 ± 90%       ~ (p=0.178 n=7)
Create/sqlite/1-workers-4                 396.0 ±  0%   396.0 ±  0%       ~ (p=1.000 n=7) ¹
Create/sqlite/4-workers-4                 396.0 ±  0%   396.0 ±  0%       ~ (p=1.000 n=7) ¹
Create/sqlite/16-workers-4                396.0 ±  0%   396.0 ±  0%       ~ (p=1.000 n=7) ¹
Create/sqlite/64-workers-4                396.0 ±  1%   396.0 ±  1%       ~ (p=0.991 n=7)
Create/sqlite/128-workers-4               397.0 ±  1%   397.0 ±  1%       ~ (p=0.666 n=7)
Create/dqlite/1-workers-4                 366.0 ±  0%   366.0 ±  0%       ~ (p=1.000 n=7) ¹
Create/dqlite/4-workers-4                 366.0 ±  0%   366.0 ±  0%       ~ (p=1.000 n=7) ¹
Create/dqlite/16-workers-4                366.0 ±  0%   366.0 ±  0%       ~ (p=1.000 n=7) ¹
Create/dqlite/64-workers-4                366.0 ±  0%   366.0 ± 13%       ~ (p=0.462 n=7)
Create/dqlite/128-workers-4               365.0 ± 13%   365.0 ±  6%       ~ (p=1.000 n=7)
Delete/sqlite/1-workers-4                 427.0 ±  0%   427.0 ±  0%       ~ (p=1.000 n=7) ¹
Delete/sqlite/4-workers-4                 427.0 ±  0%   427.0 ±  0%       ~ (p=1.000 n=7) ¹
Delete/sqlite/16-workers-4                426.0 ±  0%   426.0 ±  0%       ~ (p=1.000 n=7)
Delete/sqlite/64-workers-4                426.0 ±  0%   427.0 ±  0%       ~ (p=0.184 n=7)
Delete/sqlite/128-workers-4               427.0 ±  0%   427.0 ±  1%       ~ (p=0.073 n=7)
Delete/dqlite/1-workers-4                 395.0 ±  0%   395.0 ±  0%       ~ (p=1.000 n=7) ¹
Delete/dqlite/4-workers-4                 395.0 ±  0%   395.0 ±  0%       ~ (p=1.000 n=7)
Delete/dqlite/16-workers-4                395.0 ±  3%   395.0 ± 12%       ~ (p=1.000 n=7)
Delete/dqlite/64-workers-4                395.0 ± 12%   395.0 ± 13%       ~ (p=0.462 n=7)
Delete/dqlite/128-workers-4               395.0 ±  0%   395.0 ± 12%       ~ (p=1.000 n=7)
Get/sqlite-4                              414.0 ±  0%   414.0 ±  0%       ~ (p=1.000 n=7) ¹
Get/dqlite-4                              392.0 ±  0%   392.0 ±  0%       ~ (p=1.000 n=7) ¹
List/sqlite-tiny/all-4                    16.00 ±  0%   16.00 ± 25%       ~ (p=1.000 n=7)
List/sqlite-tiny/pagination-4             15.00 ±  7%   14.00 ±  7%       ~ (p=0.302 n=7)
List/sqlite-fits-in-page/all-4            16.00 ± 31%   20.00 ± 20%       ~ (p=0.050 n=7)
List/sqlite-fits-in-page/pagination-4     29.00 ± 17%   30.00 ± 23%       ~ (p=0.825 n=7)
List/sqlite-overflows-page/all-4          8.000 ±  0%   8.000 ±  0%       ~ (p=1.000 n=7) ¹
List/sqlite-overflows-page/pagination-4   8.000 ± 12%   8.000 ± 12%       ~ (p=1.000 n=7)
List/dqlite-tiny/all-4                    12.00 ±  8%   12.00 ±  8%       ~ (p=1.000 n=7)
List/dqlite-tiny/pagination-4             12.00 ± 25%   12.00 ±  8%       ~ (p=0.538 n=7)
List/dqlite-fits-in-page/all-4            18.00 ±  6%   18.00 ±  6%       ~ (p=1.000 n=7)
List/dqlite-fits-in-page/pagination-4     17.00 ± 24%   19.00 ±  5%       ~ (p=0.144 n=7)
List/dqlite-overflows-page/all-4          32.00 ±  3%   31.00 ± 10%  -3.12% (p=0.027 n=7)
List/dqlite-overflows-page/pagination-4   34.00 ±  6%   34.00 ±  3%       ~ (p=1.000 n=7)
Update/sqlite/1-workers-4                 403.0 ±  0%   403.0 ±  0%       ~ (p=1.000 n=7) ¹
Update/sqlite/4-workers-4                 403.0 ±  0%   403.0 ±  0%       ~ (p=1.000 n=7) ¹
Update/sqlite/16-workers-4                403.0 ±  0%   403.0 ±  0%       ~ (p=0.462 n=7)
Update/sqlite/64-workers-4                403.0 ±  0%   403.0 ±  0%       ~ (p=1.000 n=7)
Update/sqlite/128-workers-4               404.0 ±  0%   404.0 ±  1%       ~ (p=0.741 n=7)
Update/dqlite/1-workers-4                 373.0 ±  0%   373.0 ±  0%       ~ (p=1.000 n=7) ¹
Update/dqlite/4-workers-4                 373.0 ±  0%   373.0 ±  0%       ~ (p=1.000 n=7)
Update/dqlite/16-workers-4                372.0 ±  4%   372.0 ±  0%       ~ (p=1.000 n=7)
Update/dqlite/64-workers-4                372.0 ±  0%   372.0 ±  0%       ~ (p=1.000 n=7) ¹
Update/dqlite/128-workers-4               371.0 ±  0%   371.0 ±  0%       ~ (p=1.000 n=7) ¹
geomean                                   159.1         160.6        +0.90%
¹ all samples are equal

                                        │        Before         │                    After                    │
                                        │ network-bytes-read/op │ network-bytes-read/op  vs base              │
Compaction/dqlite-4                               1.601Ki ± 85%           1.881Ki ± 91%       ~ (p=0.209 n=7)
Create/dqlite/1-workers-4                           241.3 ±  0%             241.4 ±  0%       ~ (p=0.888 n=7)
Create/dqlite/4-workers-4                           242.2 ±  0%             242.2 ±  0%       ~ (p=0.645 n=7)
Create/dqlite/16-workers-4                          242.4 ±  0%             242.3 ±  0%       ~ (p=0.783 n=7)
Create/dqlite/64-workers-4                          242.4 ±  0%             242.2 ± 33%  -0.08% (p=0.015 n=7)
Create/dqlite/128-workers-4                         242.3 ± 35%             242.2 ± 15%       ~ (p=0.696 n=7)
Delete/dqlite/1-workers-4                           718.1 ±  0%             718.3 ±  0%       ~ (p=0.548 n=7)
Delete/dqlite/4-workers-4                           719.6 ±  0%             719.8 ±  0%       ~ (p=0.727 n=7)
Delete/dqlite/16-workers-4                          719.5 ±  3%             719.4 ± 12%       ~ (p=1.000 n=7)
Delete/dqlite/64-workers-4                          719.3 ± 12%             719.3 ± 12%       ~ (p=0.841 n=7)
Delete/dqlite/128-workers-4                         719.5 ±  0%             719.5 ± 12%       ~ (p=0.600 n=7)
Get/dqlite-4                                        996.2 ±  0%             996.2 ±  0%       ~ (p=1.000 n=7)
List/dqlite-tiny/all-4                              179.6 ±  7%             178.5 ±  5%       ~ (p=0.779 n=7)
List/dqlite-tiny/pagination-4                       178.4 ± 30%             179.0 ±  1%       ~ (p=0.209 n=7)
List/dqlite-fits-in-page/all-4                    1.337Ki ±  3%           1.346Ki ±  2%       ~ (p=0.477 n=7)
List/dqlite-fits-in-page/pagination-4             1.252Ki ± 24%           1.418Ki ±  6%       ~ (p=0.104 n=7)
List/dqlite-overflows-page/all-4                  7.312Ki ±  4%           7.105Ki ±  8%       ~ (p=0.097 n=7)
List/dqlite-overflows-page/pagination-4           7.958Ki ±  8%           7.764Ki ±  8%       ~ (p=0.710 n=7)
Update/dqlite/1-workers-4                           263.0 ±  0%             263.0 ±  0%       ~ (p=0.204 n=7)
Update/dqlite/4-workers-4                           263.1 ±  0%             263.1 ±  0%       ~ (p=0.690 n=7)
Update/dqlite/16-workers-4                          263.0 ± 11%             263.0 ±  0%       ~ (p=0.392 n=7)
Update/dqlite/64-workers-4                          262.4 ±  0%             262.6 ±  0%  +0.08% (p=0.022 n=7)
Update/dqlite/128-workers-4                         261.9 ±  0%             261.8 ±  0%       ~ (p=0.302 n=7)
geomean                                             551.2                   556.9        +1.03%

                                        │          Before          │                     After                      │
                                        │ network-bytes-written/op │ network-bytes-written/op  vs base              │
Compaction/dqlite-4                                    4.441 ± 14%                4.559 ±  4%       ~ (p=0.072 n=7)
Create/dqlite/1-workers-4                              116.0 ±  0%                116.1 ±  1%       ~ (p=0.733 n=7)
Create/dqlite/4-workers-4                              117.4 ±  1%                117.3 ±  1%       ~ (p=0.645 n=7)
Create/dqlite/16-workers-4                             117.7 ±  1%                117.6 ±  0%       ~ (p=0.979 n=7)
Create/dqlite/64-workers-4                             117.9 ±  0%                117.3 ± 23%  -0.51% (p=0.015 n=7)
Create/dqlite/128-workers-4                            117.8 ± 24%                117.8 ± 10%       ~ (p=1.000 n=7)
Delete/dqlite/1-workers-4                              82.54 ±  0%                82.62 ±  0%       ~ (p=0.740 n=7)
Delete/dqlite/4-workers-4                              83.17 ±  0%                83.23 ±  1%       ~ (p=0.805 n=7)
Delete/dqlite/16-workers-4                             83.09 ±  8%                83.09 ± 34%       ~ (p=0.924 n=7)
Delete/dqlite/64-workers-4                             83.06 ± 34%                83.05 ± 34%       ~ (p=0.782 n=7)
Delete/dqlite/128-workers-4                            83.11 ±  0%                83.13 ± 34%       ~ (p=0.684 n=7)
Get/dqlite-4                                           88.54 ±  0%                88.54 ±  0%       ~ (p=0.538 n=7)
List/dqlite-tiny/all-4                               0.04068 ± 13%              0.04032 ±  9%       ~ (p=0.710 n=7)
List/dqlite-tiny/pagination-4                        0.04488 ± 47%              0.04600 ±  4%  +2.50% (p=0.011 n=7)
List/dqlite-fits-in-page/all-4                       0.06192 ±  6%              0.06330 ±  5%       ~ (p=0.209 n=7)
List/dqlite-fits-in-page/pagination-4                0.07080 ± 27%              0.08099 ±  7%       ~ (p=0.259 n=7)
List/dqlite-overflows-page/all-4                     0.08541 ±  9%              0.08228 ± 12%       ~ (p=0.209 n=7)
List/dqlite-overflows-page/pagination-4               0.1120 ±  8%               0.1109 ± 19%       ~ (p=0.644 n=7)
Update/dqlite/1-workers-4                              136.8 ±  0%                136.9 ±  0%       ~ (p=0.070 n=7)
Update/dqlite/4-workers-4                              136.7 ±  0%                137.0 ±  0%       ~ (p=0.200 n=7)
Update/dqlite/16-workers-4                             136.7 ±  7%                136.7 ±  0%       ~ (p=0.682 n=7)
Update/dqlite/64-workers-4                             136.7 ±  0%                136.8 ±  0%       ~ (p=0.113 n=7)
Update/dqlite/128-workers-4                            136.8 ±  0%                136.7 ±  0%       ~ (p=0.913 n=7)
geomean                                                13.64                      13.73        +0.65%
Current status 
goos: linux
goarch: amd64
pkg: github.com/canonical/k8s-dqlite/test
cpu: AMD EPYC 7763 64-Core Processor                
                                        │     After     │
                                        │    sec/op     │
Compaction/sqlite-4                       19.21µ ±  10%
Compaction/dqlite-4                       40.52µ ±   5%
Create/sqlite/1-workers-4                 474.6µ ±   2%
Create/sqlite/4-workers-4                 464.3µ ±   8%
Create/sqlite/16-workers-4                415.4µ ±   6%
Create/sqlite/64-workers-4                436.8µ ±  46%
Create/sqlite/128-workers-4               636.1µ ±  97%
Create/dqlite/1-workers-4                 1.042m ±   5%
Create/dqlite/4-workers-4                 939.0µ ±   5%
Create/dqlite/16-workers-4                930.4µ ±   4%
Create/dqlite/64-workers-4                929.2µ ±   3%
Create/dqlite/128-workers-4               928.7µ ±   4%
Delete/sqlite/1-workers-4                 459.8µ ±   3%
Delete/sqlite/4-workers-4                 451.2µ ±   2%
Delete/sqlite/16-workers-4                439.8µ ±   7%
Delete/sqlite/64-workers-4                470.6µ ±  17%
Delete/sqlite/128-workers-4               490.4µ ±  48%
Delete/dqlite/1-workers-4                 1.026m ±   3%
Delete/dqlite/4-workers-4                 917.8µ ±   5%
Delete/dqlite/16-workers-4                911.4µ ±   6%
Delete/dqlite/64-workers-4                903.0µ ±   7%
Delete/dqlite/128-workers-4               906.4µ ±   6%
Get/sqlite-4                              223.5µ ±   1%
Get/dqlite-4                              334.2µ ±   1%
List/sqlite-tiny/all-4                    3.685µ ±  10%
List/sqlite-tiny/pagination-4             6.006µ ±   3%
List/sqlite-fits-in-page/all-4            7.005µ ±   4%
List/sqlite-fits-in-page/pagination-4     17.14µ ±   4%
List/sqlite-overflows-page/all-4          15.99µ ±   3%
List/sqlite-overflows-page/pagination-4   20.57µ ±   3%
List/dqlite-tiny/all-4                    2.517µ ±   2%
List/dqlite-tiny/pagination-4             4.746µ ±   1%
List/dqlite-fits-in-page/all-4            6.333µ ±   3%
List/dqlite-fits-in-page/pagination-4     13.70µ ±   2%
List/dqlite-overflows-page/all-4          20.68µ ±   3%
List/dqlite-overflows-page/pagination-4   25.05µ ±   3%
Update/sqlite/1-workers-4                 473.6µ ±   3%
Update/sqlite/4-workers-4                 451.2µ ±   3%
Update/sqlite/16-workers-4                418.5µ ±   6%
Update/sqlite/64-workers-4                467.1µ ±  77%
Update/sqlite/128-workers-4               670.2µ ± 279%
Update/dqlite/1-workers-4                 1.019m ±   2%
Update/dqlite/4-workers-4                 920.8µ ±   3%
Update/dqlite/16-workers-4                898.4µ ±   3%
Update/dqlite/64-workers-4                913.4µ ±   3%
Update/dqlite/128-workers-4               921.5µ ±   5%
geomean                                   184.2µ

                                        │        After         │
                                        │ page-cache-misses/op │
Compaction/sqlite-4                               0.000 ± 0%
Compaction/dqlite-4                               0.000 ± 0%
Create/sqlite/1-workers-4                         0.000 ± 0%
Create/sqlite/4-workers-4                         0.000 ± 0%
Create/sqlite/16-workers-4                        0.000 ± 0%
Create/sqlite/64-workers-4                        0.000 ± 0%
Create/sqlite/128-workers-4                       0.000 ± 0%
Create/dqlite/1-workers-4                         0.000 ± 0%
Create/dqlite/4-workers-4                         0.000 ± 0%
Create/dqlite/16-workers-4                        0.000 ± 0%
Create/dqlite/64-workers-4                        0.000 ± 0%
Create/dqlite/128-workers-4                       0.000 ± 0%
Delete/sqlite/1-workers-4                         0.000 ± 0%
Delete/sqlite/4-workers-4                         0.000 ± 0%
Delete/sqlite/16-workers-4                        0.000 ± 0%
Delete/sqlite/64-workers-4                        0.000 ± 0%
Delete/sqlite/128-workers-4                       0.000 ± 0%
Delete/dqlite/1-workers-4                         0.000 ± 0%
Delete/dqlite/4-workers-4                         0.000 ± 0%
Delete/dqlite/16-workers-4                        0.000 ± 0%
Delete/dqlite/64-workers-4                        0.000 ± 0%
Delete/dqlite/128-workers-4                       0.000 ± 0%
Get/sqlite-4                                      0.000 ± 0%
Get/dqlite-4                                      0.000 ± 0%
List/sqlite-tiny/all-4                            0.000 ± 0%
List/sqlite-tiny/pagination-4                     0.000 ± 0%
List/sqlite-fits-in-page/all-4                    0.000 ± 0%
List/sqlite-fits-in-page/pagination-4             0.000 ± 0%
List/sqlite-overflows-page/all-4                  0.000 ± 0%
List/sqlite-overflows-page/pagination-4           0.000 ± 0%
List/dqlite-tiny/all-4                            0.000 ± 0%
List/dqlite-tiny/pagination-4                     0.000 ± 0%
List/dqlite-fits-in-page/all-4                    0.000 ± 0%
List/dqlite-fits-in-page/pagination-4             0.000 ± 0%
List/dqlite-overflows-page/all-4                  0.000 ± 0%
List/dqlite-overflows-page/pagination-4           0.000 ± 0%
Update/sqlite/1-workers-4                         0.000 ± 0%
Update/sqlite/4-workers-4                         0.000 ± 0%
Update/sqlite/16-workers-4                        0.000 ± 0%
Update/sqlite/64-workers-4                        0.000 ± 0%
Update/sqlite/128-workers-4                       0.000 ± 0%
Update/dqlite/1-workers-4                         0.000 ± 0%
Update/dqlite/4-workers-4                         0.000 ± 0%
Update/dqlite/16-workers-4                        0.000 ± 0%
Update/dqlite/64-workers-4                        0.000 ± 0%
Update/dqlite/128-workers-4                       0.000 ± 0%
geomean                                                      ¹
¹ summaries must be >0 to compute geomean

                                        │        After         │
                                        │ page-cache-spills/op │
Compaction/sqlite-4                               0.000 ± 0%
Compaction/dqlite-4                               0.000 ± 0%
Create/sqlite/1-workers-4                         0.000 ± 0%
Create/sqlite/4-workers-4                         0.000 ± 0%
Create/sqlite/16-workers-4                        0.000 ± 0%
Create/sqlite/64-workers-4                        0.000 ± 0%
Create/sqlite/128-workers-4                       0.000 ± 0%
Create/dqlite/1-workers-4                         0.000 ± 0%
Create/dqlite/4-workers-4                         0.000 ± 0%
Create/dqlite/16-workers-4                        0.000 ± 0%
Create/dqlite/64-workers-4                        0.000 ± 0%
Create/dqlite/128-workers-4                       0.000 ± 0%
Delete/sqlite/1-workers-4                         0.000 ± 0%
Delete/sqlite/4-workers-4                         0.000 ± 0%
Delete/sqlite/16-workers-4                        0.000 ± 0%
Delete/sqlite/64-workers-4                        0.000 ± 0%
Delete/sqlite/128-workers-4                       0.000 ± 0%
Delete/dqlite/1-workers-4                         0.000 ± 0%
Delete/dqlite/4-workers-4                         0.000 ± 0%
Delete/dqlite/16-workers-4                        0.000 ± 0%
Delete/dqlite/64-workers-4                        0.000 ± 0%
Delete/dqlite/128-workers-4                       0.000 ± 0%
Get/sqlite-4                                      0.000 ± 0%
Get/dqlite-4                                      0.000 ± 0%
List/sqlite-tiny/all-4                            0.000 ± 0%
List/sqlite-tiny/pagination-4                     0.000 ± 0%
List/sqlite-fits-in-page/all-4                    0.000 ± 0%
List/sqlite-fits-in-page/pagination-4             0.000 ± 0%
List/sqlite-overflows-page/all-4                  0.000 ± 0%
List/sqlite-overflows-page/pagination-4           0.000 ± 0%
List/dqlite-tiny/all-4                            0.000 ± 0%
List/dqlite-tiny/pagination-4                     0.000 ± 0%
List/dqlite-fits-in-page/all-4                    0.000 ± 0%
List/dqlite-fits-in-page/pagination-4             0.000 ± 0%
List/dqlite-overflows-page/all-4                  0.000 ± 0%
List/dqlite-overflows-page/pagination-4           0.000 ± 0%
Update/sqlite/1-workers-4                         0.000 ± 0%
Update/sqlite/4-workers-4                         0.000 ± 0%
Update/sqlite/16-workers-4                        0.000 ± 0%
Update/sqlite/64-workers-4                        0.000 ± 0%
Update/sqlite/128-workers-4                       0.000 ± 0%
Update/dqlite/1-workers-4                         0.000 ± 0%
Update/dqlite/4-workers-4                         0.000 ± 0%
Update/dqlite/16-workers-4                        0.000 ± 0%
Update/dqlite/64-workers-4                        0.000 ± 0%
Update/dqlite/128-workers-4                       0.000 ± 0%
geomean                                                      ¹
¹ summaries must be >0 to compute geomean

                                        │     After     │
                                        │ page-reads/op │
Compaction/sqlite-4                         12.23 ±  1%
Compaction/dqlite-4                         12.18 ±  2%
Create/sqlite/1-workers-4                   13.91 ±  0%
Create/sqlite/4-workers-4                   12.59 ±  3%
Create/sqlite/16-workers-4                  10.34 ±  4%
Create/sqlite/64-workers-4                  8.838 ±  5%
Create/sqlite/128-workers-4                 8.165 ±  4%
Create/dqlite/1-workers-4                   13.27 ±  2%
Create/dqlite/4-workers-4                   10.94 ±  2%
Create/dqlite/16-workers-4                  11.01 ±  1%
Create/dqlite/64-workers-4                  10.90 ±  1%
Create/dqlite/128-workers-4                 10.90 ±  1%
Delete/sqlite/1-workers-4                   16.23 ±  0%
Delete/sqlite/4-workers-4                   14.61 ±  2%
Delete/sqlite/16-workers-4                  12.30 ±  4%
Delete/sqlite/64-workers-4                  10.16 ±  8%
Delete/sqlite/128-workers-4                 9.300 ±  2%
Delete/dqlite/1-workers-4                   15.51 ±  2%
Delete/dqlite/4-workers-4                   13.36 ±  1%
Delete/dqlite/16-workers-4                  13.35 ±  4%
Delete/dqlite/64-workers-4                  13.18 ±  3%
Delete/dqlite/128-workers-4                 13.21 ±  4%
Get/sqlite-4                                14.96 ±  0%
Get/dqlite-4                                11.97 ±  0%
List/sqlite-tiny/all-4                     192.0m ±  1%
List/sqlite-tiny/pagination-4               1.126 ±  0%
List/sqlite-fits-in-page/all-4             164.0m ± 57%
List/sqlite-fits-in-page/pagination-4      959.0m ±  3%
List/sqlite-overflows-page/all-4           177.2m ±  0%
List/sqlite-overflows-page/pagination-4     1.065 ±  0%
List/dqlite-tiny/all-4                     190.9m ±  0%
List/dqlite-tiny/pagination-4               1.126 ±  3%
List/dqlite-fits-in-page/all-4             164.2m ± 59%
List/dqlite-fits-in-page/pagination-4      956.1m ±  3%
List/dqlite-overflows-page/all-4           184.3m ±  2%
List/dqlite-overflows-page/pagination-4     1.084 ±  5%
Update/sqlite/1-workers-4                   15.83 ±  0%
Update/sqlite/4-workers-4                   14.58 ±  2%
Update/sqlite/16-workers-4                  12.57 ±  3%
Update/sqlite/64-workers-4                  10.78 ±  5%
Update/sqlite/128-workers-4                 10.36 ± 16%
Update/dqlite/1-workers-4                   15.23 ±  1%
Update/dqlite/4-workers-4                   12.84 ±  1%
Update/dqlite/16-workers-4                  12.78 ±  1%
Update/dqlite/64-workers-4                  12.74 ±  1%
Update/dqlite/128-workers-4                 12.66 ±  1%
geomean                                     5.138

                                        │     After      │
                                        │ page-writes/op │
Compaction/sqlite-4                        190.7m ± 0%
Compaction/dqlite-4                        187.8m ± 1%
Create/sqlite/1-workers-4                   4.363 ± 0%
Create/sqlite/4-workers-4                   4.322 ± 1%
Create/sqlite/16-workers-4                  4.309 ± 1%
Create/sqlite/64-workers-4                  4.256 ± 1%
Create/sqlite/128-workers-4                 4.220 ± 2%
Create/dqlite/1-workers-4                   4.269 ± 1%
Create/dqlite/4-workers-4                   4.299 ± 0%
Create/dqlite/16-workers-4                  4.300 ± 0%
Create/dqlite/64-workers-4                  4.302 ± 1%
Create/dqlite/128-workers-4                 4.304 ± 1%
Delete/sqlite/1-workers-4                   4.391 ± 0%
Delete/sqlite/4-workers-4                   4.379 ± 1%
Delete/sqlite/16-workers-4                  4.361 ± 1%
Delete/sqlite/64-workers-4                  4.355 ± 1%
Delete/sqlite/128-workers-4                 4.368 ± 1%
Delete/dqlite/1-workers-4                   4.378 ± 1%
Delete/dqlite/4-workers-4                   4.374 ± 0%
Delete/dqlite/16-workers-4                  4.373 ± 0%
Delete/dqlite/64-workers-4                  4.352 ± 1%
Delete/dqlite/128-workers-4                 4.352 ± 1%
Get/sqlite-4                                0.000 ± 0%
Get/dqlite-4                                0.000 ± 0%
List/sqlite-tiny/all-4                      0.000 ± 0%
List/sqlite-tiny/pagination-4               0.000 ± 0%
List/sqlite-fits-in-page/all-4              0.000 ± 0%
List/sqlite-fits-in-page/pagination-4       0.000 ± 0%
List/sqlite-overflows-page/all-4            0.000 ± 0%
List/sqlite-overflows-page/pagination-4     0.000 ± 0%
List/dqlite-tiny/all-4                      0.000 ± 0%
List/dqlite-tiny/pagination-4               0.000 ± 0%
List/dqlite-fits-in-page/all-4              0.000 ± 0%
List/dqlite-fits-in-page/pagination-4       0.000 ± 0%
List/dqlite-overflows-page/all-4            0.000 ± 0%
List/dqlite-overflows-page/pagination-4     0.000 ± 0%
Update/sqlite/1-workers-4                   4.233 ± 0%
Update/sqlite/4-workers-4                   4.307 ± 1%
Update/sqlite/16-workers-4                  4.305 ± 1%
Update/sqlite/64-workers-4                  4.292 ± 1%
Update/sqlite/128-workers-4                 4.270 ± 3%
Update/dqlite/1-workers-4                   4.205 ± 0%
Update/dqlite/4-workers-4                   4.224 ± 1%
Update/dqlite/16-workers-4                  4.228 ± 0%
Update/dqlite/64-workers-4                  4.239 ± 1%
Update/dqlite/128-workers-4                 4.250 ± 1%
geomean                                                ¹
¹ summaries must be >0 to compute geomean

                                        │     After      │
                                        │ sec-reading/op │
Compaction/sqlite-4                         26.90µ ± 37%
Compaction/dqlite-4                         30.80µ ± 74%
Create/sqlite/1-workers-4                   22.20µ ± 24%
Create/sqlite/4-workers-4                   23.80µ ± 21%
Create/sqlite/16-workers-4                  21.10µ ± 31%
Create/sqlite/64-workers-4                  21.30µ ± 95%
Create/sqlite/128-workers-4                 24.10µ ± 25%
Create/dqlite/1-workers-4                   11.60µ ± 38%
Create/dqlite/4-workers-4                   11.90µ ± 61%
Create/dqlite/16-workers-4                  12.30µ ± 31%
Create/dqlite/64-workers-4                  8.700µ ± 60%
Create/dqlite/128-workers-4                 8.100µ ± 90%
Delete/sqlite/1-workers-4                   33.60µ ±  8%
Delete/sqlite/4-workers-4                   33.70µ ± 15%
Delete/sqlite/16-workers-4                  34.90µ ± 23%
Delete/sqlite/64-workers-4                  36.80µ ± 17%
Delete/sqlite/128-workers-4                 40.00µ ± 21%
Delete/dqlite/1-workers-4                   16.90µ ± 31%
Delete/dqlite/4-workers-4                   15.50µ ± 45%
Delete/dqlite/16-workers-4                  14.00µ ± 31%
Delete/dqlite/64-workers-4                  15.80µ ± 43%
Delete/dqlite/128-workers-4                 16.90µ ± 51%
Get/sqlite-4                                62.40µ ±  7%
Get/dqlite-4                                33.90µ ± 14%
List/sqlite-tiny/all-4                      6.900µ ± 29%
List/sqlite-tiny/pagination-4               8.700µ ± 10%
List/sqlite-fits-in-page/all-4              12.80µ ± 20%
List/sqlite-fits-in-page/pagination-4       28.70µ ± 17%
List/sqlite-overflows-page/all-4            12.20µ ±  4%
List/sqlite-overflows-page/pagination-4     16.30µ ±  3%
List/dqlite-tiny/all-4                      3.300µ ± 24%
List/dqlite-tiny/pagination-4               7.400µ ± 12%
List/dqlite-fits-in-page/all-4              9.900µ ± 15%
List/dqlite-fits-in-page/pagination-4       21.70µ ± 14%
List/dqlite-overflows-page/all-4            33.80µ ±  2%
List/dqlite-overflows-page/pagination-4     41.10µ ±  3%
Update/sqlite/1-workers-4                   20.80µ ± 27%
Update/sqlite/4-workers-4                   20.20µ ± 21%
Update/sqlite/16-workers-4                  24.10µ ± 18%
Update/sqlite/64-workers-4                  26.70µ ± 10%
Update/sqlite/128-workers-4                 24.20µ ± 50%
Update/dqlite/1-workers-4                   10.50µ ± 56%
Update/dqlite/4-workers-4                   10.80µ ± 34%
Update/dqlite/16-workers-4                  12.30µ ± 28%
Update/dqlite/64-workers-4                  11.30µ ± 47%
Update/dqlite/128-workers-4                 10.20µ ± 43%
geomean                                     17.66µ

                                        │     After      │
                                        │ sec-writing/op │
Compaction/sqlite-4                       9.200µ ± 21%
Compaction/dqlite-4                       7.000µ ± 10%
Create/sqlite/1-workers-4                 245.7µ ±  6%
Create/sqlite/4-workers-4                 1.419m ±  8%
Create/sqlite/16-workers-4                5.182m ±  4%
Create/sqlite/64-workers-4                17.58m ±  4%
Create/sqlite/128-workers-4               34.79m ± 32%
Create/dqlite/1-workers-4                 46.40µ ± 25%
Create/dqlite/4-workers-4                 42.30µ ± 30%
Create/dqlite/16-workers-4                44.90µ ± 34%
Create/dqlite/64-workers-4                40.90µ ± 27%
Create/dqlite/128-workers-4               45.50µ ± 13%
Delete/sqlite/1-workers-4                 234.6µ ±  5%
Delete/sqlite/4-workers-4                 1.348m ±  9%
Delete/sqlite/16-workers-4                5.228m ±  6%
Delete/sqlite/64-workers-4                18.28m ±  9%
Delete/sqlite/128-workers-4               32.48m ±  9%
Delete/dqlite/1-workers-4                 48.50µ ± 29%
Delete/dqlite/4-workers-4                 43.70µ ± 16%
Delete/dqlite/16-workers-4                42.80µ ± 12%
Delete/dqlite/64-workers-4                40.70µ ± 25%
Delete/dqlite/128-workers-4               42.70µ ± 11%
Get/sqlite-4                               0.000 ±  0%
Get/dqlite-4                               0.000 ±  0%
List/sqlite-tiny/all-4                     0.000 ±  0%
List/sqlite-tiny/pagination-4              0.000 ±  0%
List/sqlite-fits-in-page/all-4             0.000 ±  0%
List/sqlite-fits-in-page/pagination-4      0.000 ±  0%
List/sqlite-overflows-page/all-4           0.000 ±  0%
List/sqlite-overflows-page/pagination-4    0.000 ±  0%
List/dqlite-tiny/all-4                     0.000 ±  0%
List/dqlite-tiny/pagination-4              0.000 ±  0%
List/dqlite-fits-in-page/all-4             0.000 ±  0%
List/dqlite-fits-in-page/pagination-4      0.000 ±  0%
List/dqlite-overflows-page/all-4           0.000 ±  0%
List/dqlite-overflows-page/pagination-4    0.000 ±  0%
Update/sqlite/1-workers-4                 239.5µ ±  6%
Update/sqlite/4-workers-4                 1.350m ± 10%
Update/sqlite/16-workers-4                5.233m ±  9%
Update/sqlite/64-workers-4                18.01m ± 14%
Update/sqlite/128-workers-4               35.01m ± 63%
Update/dqlite/1-workers-4                 39.10µ ± 25%
Update/dqlite/4-workers-4                 42.30µ ± 17%
Update/dqlite/16-workers-4                41.00µ ± 53%
Update/dqlite/64-workers-4                41.30µ ± 16%
Update/dqlite/128-workers-4               40.80µ ± 25%
geomean                                                ¹
¹ summaries must be >0 to compute geomean

                                        │     After     │
                                        │     B/op      │
Compaction/sqlite-4                       2.232Ki ± 46%
Compaction/dqlite-4                       5.197Ki ± 89%
Create/sqlite/1-workers-4                 20.39Ki ±  0%
Create/sqlite/4-workers-4                 20.39Ki ±  0%
Create/sqlite/16-workers-4                20.37Ki ±  0%
Create/sqlite/64-workers-4                20.41Ki ±  0%
Create/sqlite/128-workers-4               20.53Ki ±  1%
Create/dqlite/1-workers-4                 19.65Ki ±  0%
Create/dqlite/4-workers-4                 19.64Ki ±  0%
Create/dqlite/16-workers-4                19.64Ki ±  0%
Create/dqlite/64-workers-4                19.65Ki ± 10%
Create/dqlite/128-workers-4               19.71Ki ±  5%
Delete/sqlite/1-workers-4                 22.81Ki ±  0%
Delete/sqlite/4-workers-4                 22.81Ki ±  0%
Delete/sqlite/16-workers-4                22.79Ki ±  0%
Delete/sqlite/64-workers-4                22.84Ki ±  0%
Delete/sqlite/128-workers-4               22.86Ki ±  0%
Delete/dqlite/1-workers-4                 21.90Ki ±  0%
Delete/dqlite/4-workers-4                 21.87Ki ±  0%
Delete/dqlite/16-workers-4                21.88Ki ± 10%
Delete/dqlite/64-workers-4                21.89Ki ± 10%
Delete/dqlite/128-workers-4               21.91Ki ± 10%
Get/sqlite-4                              23.02Ki ±  0%
Get/dqlite-4                              21.96Ki ±  0%
List/sqlite-tiny/all-4                    1.189Ki ± 16%
List/sqlite-tiny/pagination-4             1.096Ki ±  7%
List/sqlite-fits-in-page/all-4            7.538Ki ± 15%
List/sqlite-fits-in-page/pagination-4     9.130Ki ± 15%
List/sqlite-overflows-page/all-4          20.49Ki ±  0%
List/sqlite-overflows-page/pagination-4   18.51Ki ±  5%
List/dqlite-tiny/all-4                      990.0 ±  3%
List/dqlite-tiny/pagination-4               958.0 ±  2%
List/dqlite-fits-in-page/all-4            5.991Ki ±  8%
List/dqlite-fits-in-page/pagination-4     5.996Ki ±  3%
List/dqlite-overflows-page/all-4          30.30Ki ±  9%
List/dqlite-overflows-page/pagination-4   31.68Ki ±  2%
Update/sqlite/1-workers-4                 21.55Ki ±  0%
Update/sqlite/4-workers-4                 21.54Ki ±  0%
Update/sqlite/16-workers-4                21.53Ki ±  0%
Update/sqlite/64-workers-4                21.56Ki ±  0%
Update/sqlite/128-workers-4               21.64Ki ±  1%
Update/dqlite/1-workers-4                 20.76Ki ±  0%
Update/dqlite/4-workers-4                 20.73Ki ±  0%
Update/dqlite/16-workers-4                20.73Ki ±  0%
Update/dqlite/64-workers-4                20.76Ki ±  0%
Update/dqlite/128-workers-4               20.73Ki ±  0%
geomean                                   13.89Ki

                                        │    After    │
                                        │  allocs/op  │
Compaction/sqlite-4                       48.00 ± 48%
Compaction/dqlite-4                       125.0 ± 90%
Create/sqlite/1-workers-4                 396.0 ±  0%
Create/sqlite/4-workers-4                 396.0 ±  0%
Create/sqlite/16-workers-4                396.0 ±  0%
Create/sqlite/64-workers-4                396.0 ±  1%
Create/sqlite/128-workers-4               397.0 ±  1%
Create/dqlite/1-workers-4                 366.0 ±  0%
Create/dqlite/4-workers-4                 366.0 ±  0%
Create/dqlite/16-workers-4                366.0 ±  0%
Create/dqlite/64-workers-4                366.0 ± 13%
Create/dqlite/128-workers-4               365.0 ±  6%
Delete/sqlite/1-workers-4                 427.0 ±  0%
Delete/sqlite/4-workers-4                 427.0 ±  0%
Delete/sqlite/16-workers-4                426.0 ±  0%
Delete/sqlite/64-workers-4                427.0 ±  0%
Delete/sqlite/128-workers-4               427.0 ±  1%
Delete/dqlite/1-workers-4                 395.0 ±  0%
Delete/dqlite/4-workers-4                 395.0 ±  0%
Delete/dqlite/16-workers-4                395.0 ± 12%
Delete/dqlite/64-workers-4                395.0 ± 13%
Delete/dqlite/128-workers-4               395.0 ± 12%
Get/sqlite-4                              414.0 ±  0%
Get/dqlite-4                              392.0 ±  0%
List/sqlite-tiny/all-4                    16.00 ± 25%
List/sqlite-tiny/pagination-4             14.00 ±  7%
List/sqlite-fits-in-page/all-4            20.00 ± 20%
List/sqlite-fits-in-page/pagination-4     30.00 ± 23%
List/sqlite-overflows-page/all-4          8.000 ±  0%
List/sqlite-overflows-page/pagination-4   8.000 ± 12%
List/dqlite-tiny/all-4                    12.00 ±  8%
List/dqlite-tiny/pagination-4             12.00 ±  8%
List/dqlite-fits-in-page/all-4            18.00 ±  6%
List/dqlite-fits-in-page/pagination-4     19.00 ±  5%
List/dqlite-overflows-page/all-4          31.00 ± 10%
List/dqlite-overflows-page/pagination-4   34.00 ±  3%
Update/sqlite/1-workers-4                 403.0 ±  0%
Update/sqlite/4-workers-4                 403.0 ±  0%
Update/sqlite/16-workers-4                403.0 ±  0%
Update/sqlite/64-workers-4                403.0 ±  0%
Update/sqlite/128-workers-4               404.0 ±  1%
Update/dqlite/1-workers-4                 373.0 ±  0%
Update/dqlite/4-workers-4                 373.0 ±  0%
Update/dqlite/16-workers-4                372.0 ±  0%
Update/dqlite/64-workers-4                372.0 ±  0%
Update/dqlite/128-workers-4               371.0 ±  0%
geomean                                   160.6

                                        │         After         │
                                        │ network-bytes-read/op │
Compaction/dqlite-4                               1.881Ki ± 91%
Create/dqlite/1-workers-4                           241.4 ±  0%
Create/dqlite/4-workers-4                           242.2 ±  0%
Create/dqlite/16-workers-4                          242.3 ±  0%
Create/dqlite/64-workers-4                          242.2 ± 33%
Create/dqlite/128-workers-4                         242.2 ± 15%
Delete/dqlite/1-workers-4                           718.3 ±  0%
Delete/dqlite/4-workers-4                           719.8 ±  0%
Delete/dqlite/16-workers-4                          719.4 ± 12%
Delete/dqlite/64-workers-4                          719.3 ± 12%
Delete/dqlite/128-workers-4                         719.5 ± 12%
Get/dqlite-4                                        996.2 ±  0%
List/dqlite-tiny/all-4                              178.5 ±  5%
List/dqlite-tiny/pagination-4                       179.0 ±  1%
List/dqlite-fits-in-page/all-4                    1.346Ki ±  2%
List/dqlite-fits-in-page/pagination-4             1.418Ki ±  6%
List/dqlite-overflows-page/all-4                  7.105Ki ±  8%
List/dqlite-overflows-page/pagination-4           7.764Ki ±  8%
Update/dqlite/1-workers-4                           263.0 ±  0%
Update/dqlite/4-workers-4                           263.1 ±  0%
Update/dqlite/16-workers-4                          263.0 ±  0%
Update/dqlite/64-workers-4                          262.6 ±  0%
Update/dqlite/128-workers-4                         261.8 ±  0%
geomean                                             556.9

                                        │          After           │
                                        │ network-bytes-written/op │
Compaction/dqlite-4                                    4.559 ±  4%
Create/dqlite/1-workers-4                              116.1 ±  1%
Create/dqlite/4-workers-4                              117.3 ±  1%
Create/dqlite/16-workers-4                             117.6 ±  0%
Create/dqlite/64-workers-4                             117.3 ± 23%
Create/dqlite/128-workers-4                            117.8 ± 10%
Delete/dqlite/1-workers-4                              82.62 ±  0%
Delete/dqlite/4-workers-4                              83.23 ±  1%
Delete/dqlite/16-workers-4                             83.09 ± 34%
Delete/dqlite/64-workers-4                             83.05 ± 34%
Delete/dqlite/128-workers-4                            83.13 ± 34%
Get/dqlite-4                                           88.54 ±  0%
List/dqlite-tiny/all-4                               0.04032 ±  9%
List/dqlite-tiny/pagination-4                        0.04600 ±  4%
List/dqlite-fits-in-page/all-4                       0.06330 ±  5%
List/dqlite-fits-in-page/pagination-4                0.08099 ±  7%
List/dqlite-overflows-page/all-4                     0.08228 ± 12%
List/dqlite-overflows-page/pagination-4               0.1109 ± 19%
Update/dqlite/1-workers-4                              136.9 ±  0%
Update/dqlite/4-workers-4                              137.0 ±  0%
Update/dqlite/16-workers-4                             136.7 ±  0%
Update/dqlite/64-workers-4                             136.8 ±  0%
Update/dqlite/128-workers-4                            136.7 ±  0%
geomean                                                13.73

@louiseschmidtgen louiseschmidtgen marked this pull request as draft December 3, 2024 07:16
@louiseschmidtgen louiseschmidtgen deleted the integration-test-fix branch January 14, 2025 07:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@bschimke95 bschimke95 Awaiting requested review from bschimke95

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@louiseschmidtgen