Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Rename concurrent tests for create, delete and update #172

Merged
merged 1 commit into from
Sep 25, 2024

Conversation

marco6
Copy link
Collaborator

@marco6 marco6 commented Sep 20, 2024

This PR renames the subtests that use multiple workers so that they can be easily filtered by backend type.

As of now, doing `go test -run ^$ -branch "./dqlite" does not select those tests. This PR makes sure that they are all part of the same cathegory.

@marco6 marco6 requested a review from a team as a code owner September 20, 2024 08:05
Copy link

Benchmark Result

goos: linux
goarch: amd64
pkg: github.com/canonical/k8s-dqlite/test
cpu: AMD EPYC 7763 64-Core Processor                
                                        │    Before    │                After                 │
                                        │    sec/op    │    sec/op     vs base                │
Compaction/sqlite-4                       39.14µ ± 12%   37.63µ ±  9%       ~ (p=0.620 n=7)
Compaction/dqlite-4                       40.67µ ±  5%   40.28µ ± 11%       ~ (p=1.000 n=7)
Create/1-workers/sqlite-4                 1.204m ±  7%
Create/2-workers/sqlite-4                 1.225m ±  8%
Create/4-workers/sqlite-4                 1.262m ±  6%
Create/8-workers/sqlite-4                 1.305m ± 14%
Create/16-workers/sqlite-4                1.528m ± 29%
Create/1-workers/dqlite-4                 1.101m ±  6%
Create/2-workers/dqlite-4                 927.7µ ±  6%
Create/4-workers/dqlite-4                 939.1µ ±  9%
Create/8-workers/dqlite-4                 911.3µ ±  7%
Create/16-workers/dqlite-4                953.0µ ±  7%
Delete/1-workers/sqlite-4                 1.322m ±  6%
Delete/2-workers/sqlite-4                 1.475m ±  5%
Delete/4-workers/sqlite-4                 1.631m ± 10%
Delete/8-workers/sqlite-4                 1.844m ± 15%
Delete/16-workers/sqlite-4                2.513m ± 27%
Delete/1-workers/dqlite-4                 1.315m ±  4%
Delete/2-workers/dqlite-4                 1.181m ±  9%
Delete/4-workers/dqlite-4                 1.147m ±  5%
Delete/8-workers/dqlite-4                 1.144m ±  3%
Delete/16-workers/dqlite-4                1.124m ±  2%
Get/sqlite-4                              268.4µ ±  1%   266.8µ ±  1%  -0.59% (p=0.038 n=7)
Get/dqlite-4                              356.9µ ±  1%   356.1µ ±  1%       ~ (p=0.097 n=7)
List/sqlite-tiny/all-4                    4.463µ ±  2%   4.513µ ±  4%       ~ (p=0.902 n=7)
List/sqlite-tiny/pagination-4             8.839µ ±  2%   8.949µ ±  6%       ~ (p=0.456 n=7)
List/sqlite-fits-in-page/all-4            7.206µ ±  1%   7.038µ ±  3%  -2.33% (p=0.026 n=7)
List/sqlite-fits-in-page/pagination-4     21.47µ ±  4%   21.67µ ±  4%       ~ (p=0.535 n=7)
List/sqlite-overflows-page/all-4          16.83µ ±  4%   17.48µ ±  4%       ~ (p=0.053 n=7)
List/sqlite-overflows-page/pagination-4   44.54µ ±  4%   44.92µ ±  5%       ~ (p=0.620 n=7)
List/dqlite-tiny/all-4                    2.815µ ± 13%   2.790µ ± 13%       ~ (p=0.831 n=7)
List/dqlite-tiny/pagination-4             5.886µ ±  2%   5.874µ ±  1%       ~ (p=0.805 n=7)
List/dqlite-fits-in-page/all-4            5.861µ ±  2%   5.898µ ± 12%       ~ (p=0.175 n=7)
List/dqlite-fits-in-page/pagination-4     16.09µ ±  3%   15.79µ ±  3%       ~ (p=0.318 n=7)
List/dqlite-overflows-page/all-4          17.17µ ±  2%   17.36µ ±  2%  +1.12% (p=0.038 n=7)
List/dqlite-overflows-page/pagination-4   39.94µ ±  3%   39.07µ ±  2%       ~ (p=0.097 n=7)
Update/1-workers/sqlite-4                 1.142m ±  8%
Update/2-workers/sqlite-4                 1.266m ±  3%
Update/4-workers/sqlite-4                 1.291m ± 13%
Update/8-workers/sqlite-4                 1.327m ± 21%
Update/16-workers/sqlite-4                1.664m ± 15%
Update/1-workers/dqlite-4                 1.063m ±  4%
Update/2-workers/dqlite-4                 920.5µ ±  9%
Update/4-workers/dqlite-4                 912.8µ ±  7%
Update/8-workers/dqlite-4                 932.7µ ±  5%
Update/16-workers/dqlite-4                930.5µ ±  3%
Create/sqlite/1-workers-4                                1.195m ±  6%
Create/sqlite/2-workers-4                                1.195m ±  7%
Create/sqlite/4-workers-4                                1.258m ±  7%
Create/sqlite/8-workers-4                                1.423m ± 10%
Create/sqlite/16-workers-4                               1.598m ± 16%
Create/dqlite/1-workers-4                                1.060m ± 21%
Create/dqlite/2-workers-4                                898.6µ ±  9%
Create/dqlite/4-workers-4                                867.1µ ±  3%
Create/dqlite/8-workers-4                                868.0µ ±  8%
Create/dqlite/16-workers-4                               851.6µ ±  4%
Delete/sqlite/1-workers-4                                1.398m ± 12%
Delete/sqlite/2-workers-4                                1.470m ±  6%
Delete/sqlite/4-workers-4                                1.576m ±  6%
Delete/sqlite/8-workers-4                                1.905m ± 19%
Delete/sqlite/16-workers-4                               2.407m ± 17%
Delete/dqlite/1-workers-4                                1.301m ±  5%
Delete/dqlite/2-workers-4                                1.141m ±  3%
Delete/dqlite/4-workers-4                                1.103m ±  2%
Delete/dqlite/8-workers-4                                1.114m ±  3%
Delete/dqlite/16-workers-4                               1.098m ±  3%
Update/sqlite/1-workers-4                                1.140m ±  3%
Update/sqlite/2-workers-4                                1.187m ±  6%
Update/sqlite/4-workers-4                                1.267m ±  6%
Update/sqlite/8-workers-4                                1.327m ± 19%
Update/sqlite/16-workers-4                               1.593m ± 59%
Update/dqlite/1-workers-4                                1.040m ±  7%
Update/dqlite/2-workers-4                                899.7µ ±  3%
Update/dqlite/4-workers-4                                897.7µ ±  3%
Update/dqlite/8-workers-4                                896.8µ ±  4%
Update/dqlite/16-workers-4                               914.9µ ± 14%
geomean                                   291.8µ         287.9µ        -0.23%               ¹
¹ benchmark set differs from baseline; geomeans may not be comparable

                                        │        Before        │                     After                      │
                                        │ page-cache-misses/op │ page-cache-misses/op  vs base                  │
Compaction/sqlite-4                               0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Compaction/dqlite-4                               0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/1-workers/sqlite-4                         0.000 ± 0%
Create/2-workers/sqlite-4                         0.000 ± 0%
Create/4-workers/sqlite-4                         0.000 ± 0%
Create/8-workers/sqlite-4                         0.000 ± 0%
Create/16-workers/sqlite-4                        0.000 ± 0%
Create/1-workers/dqlite-4                         0.000 ± 0%
Create/2-workers/dqlite-4                         0.000 ± 0%
Create/4-workers/dqlite-4                         0.000 ± 0%
Create/8-workers/dqlite-4                         0.000 ± 0%
Create/16-workers/dqlite-4                        0.000 ± 0%
Delete/1-workers/sqlite-4                         0.000 ± 0%
Delete/2-workers/sqlite-4                         0.000 ± 0%
Delete/4-workers/sqlite-4                         0.000 ± 0%
Delete/8-workers/sqlite-4                         0.000 ± 0%
Delete/16-workers/sqlite-4                        0.000 ± 0%
Delete/1-workers/dqlite-4                         0.000 ± 0%
Delete/2-workers/dqlite-4                         0.000 ± 0%
Delete/4-workers/dqlite-4                         0.000 ± 0%
Delete/8-workers/dqlite-4                         0.000 ± 0%
Delete/16-workers/dqlite-4                        0.000 ± 0%
Get/sqlite-4                                      0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Get/dqlite-4                                      0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-tiny/all-4                            0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-tiny/pagination-4                     0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-fits-in-page/all-4                    0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-fits-in-page/pagination-4             0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-overflows-page/all-4                  0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-overflows-page/pagination-4           0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-tiny/all-4                            0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-tiny/pagination-4                     0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-fits-in-page/all-4                    0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-fits-in-page/pagination-4             0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-overflows-page/all-4                  0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-overflows-page/pagination-4           0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/1-workers/sqlite-4                         0.000 ± 0%
Update/2-workers/sqlite-4                         0.000 ± 0%
Update/4-workers/sqlite-4                         0.000 ± 0%
Update/8-workers/sqlite-4                         0.000 ± 0%
Update/16-workers/sqlite-4                        0.000 ± 0%
Update/1-workers/dqlite-4                         0.000 ± 0%
Update/2-workers/dqlite-4                         0.000 ± 0%
Update/4-workers/dqlite-4                         0.000 ± 0%
Update/8-workers/dqlite-4                         0.000 ± 0%
Update/16-workers/dqlite-4                        0.000 ± 0%
Create/sqlite/1-workers-4                                                  0.000 ± 0%
Create/sqlite/2-workers-4                                                  0.000 ± 0%
Create/sqlite/4-workers-4                                                  0.000 ± 0%
Create/sqlite/8-workers-4                                                  0.000 ± 0%
Create/sqlite/16-workers-4                                                 0.000 ± 0%
Create/dqlite/1-workers-4                                                  0.000 ± 0%
Create/dqlite/2-workers-4                                                  0.000 ± 0%
Create/dqlite/4-workers-4                                                  0.000 ± 0%
Create/dqlite/8-workers-4                                                  0.000 ± 0%
Create/dqlite/16-workers-4                                                 0.000 ± 0%
Delete/sqlite/1-workers-4                                                  0.000 ± 0%
Delete/sqlite/2-workers-4                                                  0.000 ± 0%
Delete/sqlite/4-workers-4                                                  0.000 ± 0%
Delete/sqlite/8-workers-4                                                  0.000 ± 0%
Delete/sqlite/16-workers-4                                                 0.000 ± 0%
Delete/dqlite/1-workers-4                                                  0.000 ± 0%
Delete/dqlite/2-workers-4                                                  0.000 ± 0%
Delete/dqlite/4-workers-4                                                  0.000 ± 0%
Delete/dqlite/8-workers-4                                                  0.000 ± 0%
Delete/dqlite/16-workers-4                                                 0.000 ± 0%
Update/sqlite/1-workers-4                                                  0.000 ± 0%
Update/sqlite/2-workers-4                                                  0.000 ± 0%
Update/sqlite/4-workers-4                                                  0.000 ± 0%
Update/sqlite/8-workers-4                                                  0.000 ± 0%
Update/sqlite/16-workers-4                                                 0.000 ± 0%
Update/dqlite/1-workers-4                                                  0.000 ± 0%
Update/dqlite/2-workers-4                                                  0.000 ± 0%
Update/dqlite/4-workers-4                                                  0.000 ± 0%
Update/dqlite/8-workers-4                                                  0.000 ± 0%
Update/dqlite/16-workers-4                                                 0.000 ± 0%
geomean                                                      ²                         +0.00%               ³ ²
¹ all samples are equal
² summaries must be >0 to compute geomean
³ benchmark set differs from baseline; geomeans may not be comparable

                                        │        Before        │                     After                      │
                                        │ page-cache-spills/op │ page-cache-spills/op  vs base                  │
Compaction/sqlite-4                               0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Compaction/dqlite-4                               0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Create/1-workers/sqlite-4                         0.000 ± 0%
Create/2-workers/sqlite-4                         0.000 ± 0%
Create/4-workers/sqlite-4                         0.000 ± 0%
Create/8-workers/sqlite-4                         0.000 ± 0%
Create/16-workers/sqlite-4                        0.000 ± 0%
Create/1-workers/dqlite-4                         0.000 ± 0%
Create/2-workers/dqlite-4                         0.000 ± 0%
Create/4-workers/dqlite-4                         0.000 ± 0%
Create/8-workers/dqlite-4                         0.000 ± 0%
Create/16-workers/dqlite-4                        0.000 ± 0%
Delete/1-workers/sqlite-4                         0.000 ± 0%
Delete/2-workers/sqlite-4                         0.000 ± 0%
Delete/4-workers/sqlite-4                         0.000 ± 0%
Delete/8-workers/sqlite-4                         0.000 ± 0%
Delete/16-workers/sqlite-4                        0.000 ± 0%
Delete/1-workers/dqlite-4                         0.000 ± 0%
Delete/2-workers/dqlite-4                         0.000 ± 0%
Delete/4-workers/dqlite-4                         0.000 ± 0%
Delete/8-workers/dqlite-4                         0.000 ± 0%
Delete/16-workers/dqlite-4                        0.000 ± 0%
Get/sqlite-4                                      0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Get/dqlite-4                                      0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-tiny/all-4                            0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-tiny/pagination-4                     0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-fits-in-page/all-4                    0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-fits-in-page/pagination-4             0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-overflows-page/all-4                  0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-overflows-page/pagination-4           0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-tiny/all-4                            0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-tiny/pagination-4                     0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-fits-in-page/all-4                    0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-fits-in-page/pagination-4             0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-overflows-page/all-4                  0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-overflows-page/pagination-4           0.000 ± 0%               0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/1-workers/sqlite-4                         0.000 ± 0%
Update/2-workers/sqlite-4                         0.000 ± 0%
Update/4-workers/sqlite-4                         0.000 ± 0%
Update/8-workers/sqlite-4                         0.000 ± 0%
Update/16-workers/sqlite-4                        0.000 ± 0%
Update/1-workers/dqlite-4                         0.000 ± 0%
Update/2-workers/dqlite-4                         0.000 ± 0%
Update/4-workers/dqlite-4                         0.000 ± 0%
Update/8-workers/dqlite-4                         0.000 ± 0%
Update/16-workers/dqlite-4                        0.000 ± 0%
Create/sqlite/1-workers-4                                                  0.000 ± 0%
Create/sqlite/2-workers-4                                                  0.000 ± 0%
Create/sqlite/4-workers-4                                                  0.000 ± 0%
Create/sqlite/8-workers-4                                                  0.000 ± 0%
Create/sqlite/16-workers-4                                                 0.000 ± 0%
Create/dqlite/1-workers-4                                                  0.000 ± 0%
Create/dqlite/2-workers-4                                                  0.000 ± 0%
Create/dqlite/4-workers-4                                                  0.000 ± 0%
Create/dqlite/8-workers-4                                                  0.000 ± 0%
Create/dqlite/16-workers-4                                                 0.000 ± 0%
Delete/sqlite/1-workers-4                                                  0.000 ± 0%
Delete/sqlite/2-workers-4                                                  0.000 ± 0%
Delete/sqlite/4-workers-4                                                  0.000 ± 0%
Delete/sqlite/8-workers-4                                                  0.000 ± 0%
Delete/sqlite/16-workers-4                                                 0.000 ± 0%
Delete/dqlite/1-workers-4                                                  0.000 ± 0%
Delete/dqlite/2-workers-4                                                  0.000 ± 0%
Delete/dqlite/4-workers-4                                                  0.000 ± 0%
Delete/dqlite/8-workers-4                                                  0.000 ± 0%
Delete/dqlite/16-workers-4                                                 0.000 ± 0%
Update/sqlite/1-workers-4                                                  0.000 ± 0%
Update/sqlite/2-workers-4                                                  0.000 ± 0%
Update/sqlite/4-workers-4                                                  0.000 ± 0%
Update/sqlite/8-workers-4                                                  0.000 ± 0%
Update/sqlite/16-workers-4                                                 0.000 ± 0%
Update/dqlite/1-workers-4                                                  0.000 ± 0%
Update/dqlite/2-workers-4                                                  0.000 ± 0%
Update/dqlite/4-workers-4                                                  0.000 ± 0%
Update/dqlite/8-workers-4                                                  0.000 ± 0%
Update/dqlite/16-workers-4                                                 0.000 ± 0%
geomean                                                      ²                         +0.00%               ³ ²
¹ all samples are equal
² summaries must be >0 to compute geomean
³ benchmark set differs from baseline; geomeans may not be comparable

                                        │    Before     │                 After                 │
                                        │ page-reads/op │ page-reads/op  vs base                │
Compaction/sqlite-4                         12.22 ±  1%     12.20 ±  1%       ~ (p=0.220 n=7)
Compaction/dqlite-4                         12.19 ±  1%     12.19 ±  1%       ~ (p=0.593 n=7)
Create/1-workers/sqlite-4                   14.13 ±  1%
Create/2-workers/sqlite-4                   13.94 ±  3%
Create/4-workers/sqlite-4                   13.56 ±  8%
Create/8-workers/sqlite-4                   13.37 ±  2%
Create/16-workers/sqlite-4                  12.70 ±  4%
Create/1-workers/dqlite-4                   13.10 ±  1%
Create/2-workers/dqlite-4                   10.90 ±  0%
Create/4-workers/dqlite-4                   10.98 ±  1%
Create/8-workers/dqlite-4                   10.90 ±  2%
Create/16-workers/dqlite-4                  10.90 ±  1%
Delete/1-workers/sqlite-4                   25.00 ± 11%
Delete/2-workers/sqlite-4                   24.49 ±  4%
Delete/4-workers/sqlite-4                   23.10 ±  6%
Delete/8-workers/sqlite-4                   22.47 ±  9%
Delete/16-workers/sqlite-4                  20.94 ±  6%
Delete/1-workers/dqlite-4                   23.89 ±  1%
Delete/2-workers/dqlite-4                   12.88 ±  3%
Delete/4-workers/dqlite-4                   10.48 ±  2%
Delete/8-workers/dqlite-4                   11.00 ±  2%
Delete/16-workers/dqlite-4                  10.99 ±  1%
Get/sqlite-4                                14.96 ±  0%     14.96 ±  0%       ~ (p=0.310 n=7)
Get/dqlite-4                                11.95 ±  0%     11.95 ±  0%       ~ (p=0.759 n=7)
List/sqlite-tiny/all-4                     192.4m ±  0%    192.2m ±  0%       ~ (p=0.308 n=7)
List/sqlite-tiny/pagination-4               1.132 ±  3%     1.132 ±  3%       ~ (p=1.000 n=7)
List/sqlite-fits-in-page/all-4             165.0m ±  0%    164.6m ±  0%       ~ (p=0.130 n=7)
List/sqlite-fits-in-page/pagination-4      965.6m ±  0%    965.5m ±  3%       ~ (p=0.294 n=7)
List/sqlite-overflows-page/all-4           293.5m ± 21%    300.5m ± 27%       ~ (p=0.805 n=7)
List/sqlite-overflows-page/pagination-4     2.080 ±  2%     2.080 ±  2%       ~ (p=0.674 n=7)
List/dqlite-tiny/all-4                     191.2m ±  1%    191.0m ±  1%       ~ (p=0.593 n=7)
List/dqlite-tiny/pagination-4               1.126 ±  0%     1.126 ±  0%       ~ (p=0.559 n=7)
List/dqlite-fits-in-page/all-4             163.2m ±  0%    163.2m ±  0%       ~ (p=0.710 n=7)
List/dqlite-fits-in-page/pagination-4      955.0m ±  0%    954.4m ±  3%       ~ (p=0.197 n=7)
List/dqlite-overflows-page/all-4           182.8m ±  0%    182.8m ±  0%       ~ (p=0.232 n=7)
List/dqlite-overflows-page/pagination-4     1.071 ±  3%     1.070 ±  3%       ~ (p=0.364 n=7)
Update/1-workers/sqlite-4                   16.33 ±  2%
Update/2-workers/sqlite-4                   16.02 ±  2%
Update/4-workers/sqlite-4                   15.92 ±  1%
Update/8-workers/sqlite-4                   15.44 ±  3%
Update/16-workers/sqlite-4                  15.09 ±  4%
Update/1-workers/dqlite-4                   15.28 ±  1%
Update/2-workers/dqlite-4                   12.92 ±  1%
Update/4-workers/dqlite-4                   12.79 ±  1%
Update/8-workers/dqlite-4                   12.75 ±  1%
Update/16-workers/dqlite-4                  12.78 ±  1%
Create/sqlite/1-workers-4                                   14.08 ±  4%
Create/sqlite/2-workers-4                                   13.90 ±  1%
Create/sqlite/4-workers-4                                   13.59 ±  2%
Create/sqlite/8-workers-4                                   13.13 ±  3%
Create/sqlite/16-workers-4                                  12.51 ±  6%
Create/dqlite/1-workers-4                                   12.99 ±  2%
Create/dqlite/2-workers-4                                   10.92 ±  2%
Create/dqlite/4-workers-4                                   10.98 ±  1%
Create/dqlite/8-workers-4                                   10.98 ±  1%
Create/dqlite/16-workers-4                                  10.98 ±  1%
Delete/sqlite/1-workers-4                                   25.13 ±  1%
Delete/sqlite/2-workers-4                                   24.05 ±  5%
Delete/sqlite/4-workers-4                                   23.07 ±  4%
Delete/sqlite/8-workers-4                                   22.00 ± 10%
Delete/sqlite/16-workers-4                                  20.04 ±  6%
Delete/dqlite/1-workers-4                                   23.74 ±  1%
Delete/dqlite/2-workers-4                                   13.16 ±  2%
Delete/dqlite/4-workers-4                                   10.25 ±  2%
Delete/dqlite/8-workers-4                                   11.02 ±  2%
Delete/dqlite/16-workers-4                                  10.99 ±  1%
Update/sqlite/1-workers-4                                   16.29 ±  1%
Update/sqlite/2-workers-4                                   16.13 ±  4%
Update/sqlite/4-workers-4                                   15.99 ±  3%
Update/sqlite/8-workers-4                                   15.73 ±  5%
Update/sqlite/16-workers-4                                  14.56 ±  8%
Update/dqlite/1-workers-4                                   15.19 ±  1%
Update/dqlite/2-workers-4                                   12.88 ±  1%
Update/dqlite/4-workers-4                                   12.85 ±  1%
Update/dqlite/8-workers-4                                   12.74 ±  1%
Update/dqlite/16-workers-4                                  12.77 ±  1%
geomean                                     5.915           5.901        +0.10%               ¹
¹ benchmark set differs from baseline; geomeans may not be comparable

                                        │     Before     │                  After                   │
                                        │ page-writes/op │ page-writes/op  vs base                  │
Compaction/sqlite-4                        208.0m ± 0%        207.8m ± 0%       ~ (p=0.830 n=7)
Compaction/dqlite-4                        187.8m ± 0%        187.6m ± 0%       ~ (p=0.452 n=7)
Create/1-workers/sqlite-4                   5.128 ± 1%
Create/2-workers/sqlite-4                   5.134 ± 1%
Create/4-workers/sqlite-4                   5.130 ± 1%
Create/8-workers/sqlite-4                   5.101 ± 1%
Create/16-workers/sqlite-4                  5.084 ± 1%
Create/1-workers/dqlite-4                   4.216 ± 1%
Create/2-workers/dqlite-4                   4.285 ± 0%
Create/4-workers/dqlite-4                   4.300 ± 0%
Create/8-workers/dqlite-4                   4.283 ± 1%
Create/16-workers/dqlite-4                  4.295 ± 1%
Delete/1-workers/sqlite-4                   5.334 ± 1%
Delete/2-workers/sqlite-4                   5.301 ± 1%
Delete/4-workers/sqlite-4                   5.289 ± 1%
Delete/8-workers/sqlite-4                   5.276 ± 2%
Delete/16-workers/sqlite-4                  5.315 ± 1%
Delete/1-workers/dqlite-4                   4.391 ± 1%
Delete/2-workers/dqlite-4                   4.382 ± 1%
Delete/4-workers/dqlite-4                   4.413 ± 1%
Delete/8-workers/dqlite-4                   4.396 ± 1%
Delete/16-workers/dqlite-4                  4.407 ± 1%
Get/sqlite-4                                0.000 ± 0%         0.000 ± 0%       ~ (p=1.000 n=7) ¹
Get/dqlite-4                                0.000 ± 0%         0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-tiny/all-4                      0.000 ± 0%         0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-tiny/pagination-4               0.000 ± 0%         0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-fits-in-page/all-4              0.000 ± 0%         0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-fits-in-page/pagination-4       0.000 ± 0%         0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-overflows-page/all-4            0.000 ± 0%         0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/sqlite-overflows-page/pagination-4     0.000 ± 0%         0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-tiny/all-4                      0.000 ± 0%         0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-tiny/pagination-4               0.000 ± 0%         0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-fits-in-page/all-4              0.000 ± 0%         0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-fits-in-page/pagination-4       0.000 ± 0%         0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-overflows-page/all-4            0.000 ± 0%         0.000 ± 0%       ~ (p=1.000 n=7) ¹
List/dqlite-overflows-page/pagination-4     0.000 ± 0%         0.000 ± 0%       ~ (p=1.000 n=7) ¹
Update/1-workers/sqlite-4                   5.184 ± 0%
Update/2-workers/sqlite-4                   5.174 ± 2%
Update/4-workers/sqlite-4                   5.215 ± 1%
Update/8-workers/sqlite-4                   5.217 ± 1%
Update/16-workers/sqlite-4                  5.269 ± 2%
Update/1-workers/dqlite-4                   4.206 ± 0%
Update/2-workers/dqlite-4                   4.255 ± 0%
Update/4-workers/dqlite-4                   4.202 ± 1%
Update/8-workers/dqlite-4                   4.208 ± 1%
Update/16-workers/dqlite-4                  4.229 ± 1%
Create/sqlite/1-workers-4                                      5.123 ± 0%
Create/sqlite/2-workers-4                                      5.123 ± 0%
Create/sqlite/4-workers-4                                      5.115 ± 1%
Create/sqlite/8-workers-4                                      5.089 ± 1%
Create/sqlite/16-workers-4                                     5.077 ± 1%
Create/dqlite/1-workers-4                                      4.217 ± 2%
Create/dqlite/2-workers-4                                      4.285 ± 1%
Create/dqlite/4-workers-4                                      4.301 ± 1%
Create/dqlite/8-workers-4                                      4.301 ± 0%
Create/dqlite/16-workers-4                                     4.299 ± 0%
Delete/sqlite/1-workers-4                                      5.327 ± 1%
Delete/sqlite/2-workers-4                                      5.302 ± 1%
Delete/sqlite/4-workers-4                                      5.290 ± 1%
Delete/sqlite/8-workers-4                                      5.288 ± 2%
Delete/sqlite/16-workers-4                                     5.312 ± 1%
Delete/dqlite/1-workers-4                                      4.389 ± 0%
Delete/dqlite/2-workers-4                                      4.411 ± 1%
Delete/dqlite/4-workers-4                                      4.405 ± 1%
Delete/dqlite/8-workers-4                                      4.401 ± 1%
Delete/dqlite/16-workers-4                                     4.391 ± 1%
Update/sqlite/1-workers-4                                      5.178 ± 0%
Update/sqlite/2-workers-4                                      5.197 ± 1%
Update/sqlite/4-workers-4                                      5.226 ± 1%
Update/sqlite/8-workers-4                                      5.250 ± 1%
Update/sqlite/16-workers-4                                     5.210 ± 2%
Update/dqlite/1-workers-4                                      4.205 ± 0%
Update/dqlite/2-workers-4                                      4.257 ± 0%
Update/dqlite/4-workers-4                                      4.215 ± 1%
Update/dqlite/8-workers-4                                      4.202 ± 1%
Update/dqlite/16-workers-4                                     4.218 ± 1%
geomean                                                ²                   -0.01%               ³ ²
¹ all samples are equal
² summaries must be >0 to compute geomean
³ benchmark set differs from baseline; geomeans may not be comparable

                                        │     Before      │                 After                  │
                                        │ sec-reading/op  │ sec-reading/op  vs base                │
Compaction/sqlite-4                        118.7µ ±   10%    118.1µ ±   6%       ~ (p=0.620 n=7)
Compaction/dqlite-4                        22.20µ ±   14%    23.20µ ±  55%       ~ (p=0.735 n=7)
Create/1-workers/sqlite-4                  64.20µ ±   38%
Create/2-workers/sqlite-4                  40.80µ ±  838%
Create/4-workers/sqlite-4                  25.60µ ± 2047%
Create/8-workers/sqlite-4                  32.20µ ±  122%
Create/16-workers/sqlite-4                 39.10µ ±  344%
Create/1-workers/dqlite-4                  15.20µ ±   45%
Create/2-workers/dqlite-4                  9.700µ ±   84%
Create/4-workers/dqlite-4                  13.60µ ±   32%
Create/8-workers/dqlite-4                  13.50µ ±   24%
Create/16-workers/dqlite-4                 10.20µ ±   26%
Delete/1-workers/sqlite-4                  189.5µ ±  125%
Delete/2-workers/sqlite-4                  569.7µ ±   84%
Delete/4-workers/sqlite-4                  2.225m ±   54%
Delete/8-workers/sqlite-4                  2.565m ±   79%
Delete/16-workers/sqlite-4                 8.257m ±   59%
Delete/1-workers/dqlite-4                  59.10µ ±   21%
Delete/2-workers/dqlite-4                  67.20µ ±   21%
Delete/4-workers/dqlite-4                  55.40µ ±    8%
Delete/8-workers/dqlite-4                  57.30µ ±   19%
Delete/16-workers/dqlite-4                 60.80µ ±   15%
Get/sqlite-4                               86.80µ ±    6%    85.60µ ±   6%       ~ (p=0.874 n=7)
Get/dqlite-4                               32.50µ ±   24%    35.00µ ±  24%       ~ (p=0.200 n=7)
List/sqlite-tiny/all-4                     14.30µ ±    1%    14.30µ ±   3%       ~ (p=0.979 n=7)
List/sqlite-tiny/pagination-4              19.00µ ±    5%    19.30µ ±   6%       ~ (p=0.680 n=7)
List/sqlite-fits-in-page/all-4             17.10µ ±    8%    17.00µ ±   9%       ~ (p=0.740 n=7)
List/sqlite-fits-in-page/pagination-4      58.70µ ±    5%    58.40µ ±   4%       ~ (p=0.333 n=7)
List/sqlite-overflows-page/all-4           57.20µ ±   15%    54.90µ ±  17%       ~ (p=0.710 n=7)
List/sqlite-overflows-page/pagination-4    164.6µ ±    3%    166.5µ ±   4%       ~ (p=0.073 n=7)
List/dqlite-tiny/all-4                     4.100µ ±   24%    4.000µ ±  25%       ~ (p=0.437 n=7)
List/dqlite-tiny/pagination-4              8.800µ ±    8%    9.000µ ±   8%       ~ (p=0.396 n=7)
List/dqlite-fits-in-page/all-4            10.000µ ±   17%    9.900µ ±  15%       ~ (p=0.728 n=7)
List/dqlite-fits-in-page/pagination-4      26.90µ ±   13%    26.00µ ±  12%       ~ (p=0.301 n=7)
List/dqlite-overflows-page/all-4           29.90µ ±    3%    30.30µ ±   2%       ~ (p=0.058 n=7)
List/dqlite-overflows-page/pagination-4    62.50µ ±   13%    60.10µ ±  16%       ~ (p=0.090 n=7)
Update/1-workers/sqlite-4                  63.70µ ±  200%
Update/2-workers/sqlite-4                  43.00µ ±  108%
Update/4-workers/sqlite-4                  46.60µ ±  509%
Update/8-workers/sqlite-4                  30.40µ ±  284%
Update/16-workers/sqlite-4                 58.40µ ±  373%
Update/1-workers/dqlite-4                  13.60µ ±   62%
Update/2-workers/dqlite-4                  15.00µ ±   21%
Update/4-workers/dqlite-4                  14.20µ ±   28%
Update/8-workers/dqlite-4                  12.50µ ±   23%
Update/16-workers/dqlite-4                 8.900µ ±   56%
Create/sqlite/1-workers-4                                    48.30µ ± 650%
Create/sqlite/2-workers-4                                    37.10µ ±  80%
Create/sqlite/4-workers-4                                    39.70µ ± 163%
Create/sqlite/8-workers-4                                    98.10µ ± 249%
Create/sqlite/16-workers-4                                   171.7µ ± 178%
Create/dqlite/1-workers-4                                    6.800µ ± 132%
Create/dqlite/2-workers-4                                    10.60µ ±  56%
Create/dqlite/4-workers-4                                    11.70µ ±  26%
Create/dqlite/8-workers-4                                    13.80µ ±  64%
Create/dqlite/16-workers-4                                   11.60µ ±  47%
Delete/sqlite/1-workers-4                                    179.7µ ±  36%
Delete/sqlite/2-workers-4                                    725.6µ ±  30%
Delete/sqlite/4-workers-4                                    1.295m ±  51%
Delete/sqlite/8-workers-4                                    3.843m ±  44%
Delete/sqlite/16-workers-4                                   9.257m ±  39%
Delete/dqlite/1-workers-4                                    46.30µ ±  32%
Delete/dqlite/2-workers-4                                    59.70µ ±  15%
Delete/dqlite/4-workers-4                                    57.70µ ±  19%
Delete/dqlite/8-workers-4                                    58.70µ ±  17%
Delete/dqlite/16-workers-4                                   58.10µ ±  30%
Update/sqlite/1-workers-4                                    40.90µ ± 101%
Update/sqlite/2-workers-4                                    101.8µ ± 307%
Update/sqlite/4-workers-4                                    44.10µ ± 236%
Update/sqlite/8-workers-4                                    37.40µ ± 399%
Update/sqlite/16-workers-4                                   96.50µ ± 905%
Update/dqlite/1-workers-4                                    8.700µ ±  44%
Update/dqlite/2-workers-4                                    10.30µ ±  45%
Update/dqlite/4-workers-4                                    9.700µ ±  56%
Update/dqlite/8-workers-4                                    13.00µ ±  42%
Update/dqlite/16-workers-4                                   12.20µ ±  30%
geomean                                    43.48µ            45.40µ         +0.01%               ¹
¹ benchmark set differs from baseline; geomeans may not be comparable

                                        │     Before     │                  After                   │
                                        │ sec-writing/op │ sec-writing/op  vs base                  │
Compaction/sqlite-4                       9.200µ ± 13%       8.700µ ± 21%       ~ (p=0.332 n=7)
Compaction/dqlite-4                       7.100µ ±  8%       6.900µ ±  6%       ~ (p=0.246 n=7)
Create/1-workers/sqlite-4                 961.6µ ±  6%
Create/2-workers/sqlite-4                 1.788m ± 14%
Create/4-workers/sqlite-4                 3.358m ±  7%
Create/8-workers/sqlite-4                 6.737m ± 46%
Create/16-workers/sqlite-4                14.10m ± 20%
Create/1-workers/dqlite-4                 47.60µ ± 74%
Create/2-workers/dqlite-4                 42.80µ ± 32%
Create/4-workers/dqlite-4                 43.90µ ± 32%
Create/8-workers/dqlite-4                 40.10µ ± 18%
Create/16-workers/dqlite-4                34.50µ ± 28%
Delete/1-workers/sqlite-4                 957.5µ ± 10%
Delete/2-workers/sqlite-4                 1.766m ± 17%
Delete/4-workers/sqlite-4                 2.887m ± 51%
Delete/8-workers/sqlite-4                 7.667m ± 57%
Delete/16-workers/sqlite-4                14.87m ± 26%
Delete/1-workers/dqlite-4                 15.70µ ± 59%
Delete/2-workers/dqlite-4                 25.60µ ± 30%
Delete/4-workers/dqlite-4                 29.60µ ± 39%
Delete/8-workers/dqlite-4                 23.20µ ± 48%
Delete/16-workers/dqlite-4                27.00µ ± 53%
Get/sqlite-4                               0.000 ±  0%        0.000 ±  0%       ~ (p=1.000 n=7) ¹
Get/dqlite-4                               0.000 ±  0%        0.000 ±  0%       ~ (p=1.000 n=7) ¹
List/sqlite-tiny/all-4                     0.000 ±  0%        0.000 ±  0%       ~ (p=1.000 n=7) ¹
List/sqlite-tiny/pagination-4              0.000 ±  0%        0.000 ±  0%       ~ (p=1.000 n=7) ¹
List/sqlite-fits-in-page/all-4             0.000 ±  0%        0.000 ±  0%       ~ (p=1.000 n=7) ¹
List/sqlite-fits-in-page/pagination-4      0.000 ±  0%        0.000 ±  0%       ~ (p=1.000 n=7) ¹
List/sqlite-overflows-page/all-4           0.000 ±  0%        0.000 ±  0%       ~ (p=1.000 n=7) ¹
List/sqlite-overflows-page/pagination-4    0.000 ±  0%        0.000 ±  0%       ~ (p=1.000 n=7) ¹
List/dqlite-tiny/all-4                     0.000 ±  0%        0.000 ±  0%       ~ (p=1.000 n=7) ¹
List/dqlite-tiny/pagination-4              0.000 ±  0%        0.000 ±  0%       ~ (p=1.000 n=7) ¹
List/dqlite-fits-in-page/all-4             0.000 ±  0%        0.000 ±  0%       ~ (p=1.000 n=7) ¹
List/dqlite-fits-in-page/pagination-4      0.000 ±  0%        0.000 ±  0%       ~ (p=1.000 n=7) ¹
List/dqlite-overflows-page/all-4           0.000 ±  0%        0.000 ±  0%       ~ (p=1.000 n=7) ¹
List/dqlite-overflows-page/pagination-4    0.000 ±  0%        0.000 ±  0%       ~ (p=1.000 n=7) ¹
Update/1-workers/sqlite-4                 813.6µ ± 10%
Update/2-workers/sqlite-4                 1.760m ± 29%
Update/4-workers/sqlite-4                 3.477m ± 39%
Update/8-workers/sqlite-4                 7.678m ± 23%
Update/16-workers/sqlite-4                14.51m ± 27%
Update/1-workers/dqlite-4                 73.90µ ± 33%
Update/2-workers/dqlite-4                 50.90µ ± 61%
Update/4-workers/dqlite-4                 45.00µ ± 19%
Update/8-workers/dqlite-4                 39.70µ ± 20%
Update/16-workers/dqlite-4                31.40µ ± 43%
Create/sqlite/1-workers-4                                    897.2µ ±  9%
Create/sqlite/2-workers-4                                    1.855m ± 18%
Create/sqlite/4-workers-4                                    3.763m ± 36%
Create/sqlite/8-workers-4                                    7.157m ± 25%
Create/sqlite/16-workers-4                                   13.71m ± 26%
Create/dqlite/1-workers-4                                    40.30µ ± 28%
Create/dqlite/2-workers-4                                    37.80µ ± 37%
Create/dqlite/4-workers-4                                    48.30µ ± 22%
Create/dqlite/8-workers-4                                    45.90µ ± 15%
Create/dqlite/16-workers-4                                   43.30µ ± 15%
Delete/sqlite/1-workers-4                                    1.027m ± 20%
Delete/sqlite/2-workers-4                                    1.769m ± 49%
Delete/sqlite/4-workers-4                                    3.527m ± 10%
Delete/sqlite/8-workers-4                                    7.860m ± 45%
Delete/sqlite/16-workers-4                                   16.14m ± 43%
Delete/dqlite/1-workers-4                                    23.60µ ± 49%
Delete/dqlite/2-workers-4                                    28.60µ ± 28%
Delete/dqlite/4-workers-4                                    27.20µ ± 32%
Delete/dqlite/8-workers-4                                    32.50µ ± 43%
Delete/dqlite/16-workers-4                                   35.10µ ± 47%
Update/sqlite/1-workers-4                                    834.8µ ±  5%
Update/sqlite/2-workers-4                                    1.560m ± 31%
Update/sqlite/4-workers-4                                    3.138m ± 35%
Update/sqlite/8-workers-4                                    6.533m ± 20%
Update/sqlite/16-workers-4                                   14.05m ± 40%
Update/dqlite/1-workers-4                                    23.80µ ± 39%
Update/dqlite/2-workers-4                                    33.70µ ± 27%
Update/dqlite/4-workers-4                                    32.80µ ± 41%
Update/dqlite/8-workers-4                                    34.50µ ± 32%
Update/dqlite/16-workers-4                                   49.50µ ± 27%
geomean                                                ²                   -0.53%               ³ ²
¹ all samples are equal
² summaries must be >0 to compute geomean
³ benchmark set differs from baseline; geomeans may not be comparable

                                        │    Before     │                 After                 │
                                        │     B/op      │     B/op       vs base                │
Compaction/sqlite-4                         988.0 ± 56%     836.0 ± 57%       ~ (p=0.456 n=7)
Compaction/dqlite-4                       3.761Ki ± 21%   4.039Ki ± 74%       ~ (p=0.535 n=7)
Create/1-workers/sqlite-4                 21.34Ki ±  1%
Create/2-workers/sqlite-4                 21.37Ki ±  0%
Create/4-workers/sqlite-4                 21.39Ki ±  7%
Create/8-workers/sqlite-4                 21.37Ki ±  1%
Create/16-workers/sqlite-4                21.44Ki ±  1%
Create/1-workers/dqlite-4                 20.08Ki ±  0%
Create/2-workers/dqlite-4                 20.05Ki ±  0%
Create/4-workers/dqlite-4                 20.04Ki ±  0%
Create/8-workers/dqlite-4                 20.05Ki ±  0%
Create/16-workers/dqlite-4                20.05Ki ±  0%
Delete/1-workers/sqlite-4                 32.47Ki ± 15%
Delete/2-workers/sqlite-4                 32.47Ki ±  3%
Delete/4-workers/sqlite-4                 32.26Ki ±  7%
Delete/8-workers/sqlite-4                 32.20Ki ±  6%
Delete/16-workers/sqlite-4                32.56Ki ±  8%
Delete/1-workers/dqlite-4                 29.47Ki ±  0%
Delete/2-workers/dqlite-4                 62.83Ki ±  2%
Delete/4-workers/dqlite-4                 84.35Ki ±  4%
Delete/8-workers/dqlite-4                 81.43Ki ±  1%
Delete/16-workers/dqlite-4                82.09Ki ±  2%
Get/sqlite-4                              25.08Ki ±  0%   25.08Ki ±  0%       ~ (p=0.927 n=7)
Get/dqlite-4                              22.88Ki ±  0%   22.88Ki ±  0%       ~ (p=0.730 n=7)
List/sqlite-tiny/all-4                    1.263Ki ±  2%   1.251Ki ±  2%       ~ (p=0.247 n=7)
List/sqlite-tiny/pagination-4             1.834Ki ±  6%   1.779Ki ±  5%       ~ (p=0.273 n=7)
List/sqlite-fits-in-page/all-4            5.135Ki ±  3%   5.021Ki ±  4%       ~ (p=0.165 n=7)
List/sqlite-fits-in-page/pagination-4     10.21Ki ±  1%   10.22Ki ±  1%       ~ (p=0.710 n=7)
List/sqlite-overflows-page/all-4          26.64Ki ±  5%   26.84Ki ±  6%       ~ (p=1.000 n=7)
List/sqlite-overflows-page/pagination-4   46.08Ki ±  0%   46.17Ki ±  1%  +0.18% (p=0.028 n=7)
List/dqlite-tiny/all-4                      874.0 ± 11%     865.0 ± 11%       ~ (p=0.594 n=7)
List/dqlite-tiny/pagination-4               845.0 ±  2%     846.0 ±  2%       ~ (p=0.925 n=7)
List/dqlite-fits-in-page/all-4            4.306Ki ±  1%   4.298Ki ±  1%       ~ (p=0.598 n=7)
List/dqlite-fits-in-page/pagination-4     4.475Ki ±  3%   4.444Ki ±  4%       ~ (p=0.456 n=7)
List/dqlite-overflows-page/all-4          21.14Ki ±  1%   21.28Ki ±  1%       ~ (p=0.097 n=7)
List/dqlite-overflows-page/pagination-4   22.74Ki ±  5%   22.40Ki ±  5%       ~ (p=0.209 n=7)
Update/1-workers/sqlite-4                 22.55Ki ±  2%
Update/2-workers/sqlite-4                 22.62Ki ±  1%
Update/4-workers/sqlite-4                 22.58Ki ±  1%
Update/8-workers/sqlite-4                 22.71Ki ±  1%
Update/16-workers/sqlite-4                22.81Ki ±  3%
Update/1-workers/dqlite-4                 21.21Ki ±  0%
Update/2-workers/dqlite-4                 21.21Ki ±  0%
Update/4-workers/dqlite-4                 21.20Ki ±  0%
Update/8-workers/dqlite-4                 21.22Ki ±  0%
Update/16-workers/dqlite-4                21.31Ki ±  1%
Create/sqlite/1-workers-4                                 21.36Ki ±  3%
Create/sqlite/2-workers-4                                 21.38Ki ±  0%
Create/sqlite/4-workers-4                                 21.36Ki ±  1%
Create/sqlite/8-workers-4                                 21.41Ki ±  3%
Create/sqlite/16-workers-4                                21.10Ki ±  3%
Create/dqlite/1-workers-4                                 20.07Ki ±  0%
Create/dqlite/2-workers-4                                 20.06Ki ±  0%
Create/dqlite/4-workers-4                                 20.05Ki ±  0%
Create/dqlite/8-workers-4                                 20.04Ki ±  6%
Create/dqlite/16-workers-4                                20.05Ki ±  0%
Delete/sqlite/1-workers-4                                 32.56Ki ±  1%
Delete/sqlite/2-workers-4                                 32.54Ki ±  5%
Delete/sqlite/4-workers-4                                 32.26Ki ±  2%
Delete/sqlite/8-workers-4                                 32.29Ki ±  7%
Delete/sqlite/16-workers-4                                31.35Ki ±  4%
Delete/dqlite/1-workers-4                                 29.46Ki ±  0%
Delete/dqlite/2-workers-4                                 64.11Ki ±  1%
Delete/dqlite/4-workers-4                                 85.41Ki ±  4%
Delete/dqlite/8-workers-4                                 80.82Ki ±  3%
Delete/dqlite/16-workers-4                                80.94Ki ±  2%
Update/sqlite/1-workers-4                                 22.55Ki ±  1%
Update/sqlite/2-workers-4                                 22.55Ki ±  3%
Update/sqlite/4-workers-4                                 22.62Ki ±  0%
Update/sqlite/8-workers-4                                 22.69Ki ±  1%
Update/sqlite/16-workers-4                                22.80Ki ± 10%
Update/dqlite/1-workers-4                                 21.20Ki ±  0%
Update/dqlite/2-workers-4                                 21.19Ki ±  0%
Update/dqlite/4-workers-4                                 21.18Ki ±  0%
Update/dqlite/8-workers-4                                 21.24Ki ±  0%
Update/dqlite/16-workers-4                                21.29Ki ±  0%
geomean                                   16.05Ki         15.97Ki        -1.08%               ¹
¹ benchmark set differs from baseline; geomeans may not be comparable

                                        │   Before    │                After                │
                                        │  allocs/op  │  allocs/op   vs base                │
Compaction/sqlite-4                       38.00 ± 61%   32.00 ± 59%       ~ (p=0.475 n=7)
Compaction/dqlite-4                       91.00 ± 22%   97.00 ± 75%       ~ (p=0.557 n=7)
Create/1-workers/sqlite-4                 455.0 ±  1%
Create/2-workers/sqlite-4                 455.0 ±  1%
Create/4-workers/sqlite-4                 455.0 ± 10%
Create/8-workers/sqlite-4                 455.0 ±  2%
Create/16-workers/sqlite-4                456.0 ±  2%
Create/1-workers/dqlite-4                 372.0 ±  0%
Create/2-workers/dqlite-4                 372.0 ±  0%
Create/4-workers/dqlite-4                 372.0 ±  0%
Create/8-workers/dqlite-4                 372.0 ±  0%
Create/16-workers/dqlite-4                372.0 ±  0%
Delete/1-workers/sqlite-4                 723.0 ± 23%
Delete/2-workers/sqlite-4                 723.0 ±  5%
Delete/4-workers/sqlite-4                 715.0 ±  9%
Delete/8-workers/sqlite-4                 713.0 ±  8%
Delete/16-workers/sqlite-4                721.0 ± 10%
Delete/1-workers/dqlite-4                 510.0 ±  0%
Delete/2-workers/dqlite-4                 553.0 ±  0%
Delete/4-workers/dqlite-4                 576.0 ±  1%
Delete/8-workers/dqlite-4                 561.0 ±  1%
Delete/16-workers/dqlite-4                562.0 ±  0%
Get/sqlite-4                              563.0 ±  0%   563.0 ±  0%       ~ (p=1.000 n=7) ¹
Get/dqlite-4                              407.0 ±  0%   407.0 ±  0%       ~ (p=1.000 n=7) ¹
List/sqlite-tiny/all-4                    41.00 ±  2%   41.00 ±  2%       ~ (p=0.494 n=7)
List/sqlite-tiny/pagination-4             63.00 ±  5%   61.00 ±  7%       ~ (p=0.228 n=7)
List/sqlite-fits-in-page/all-4            47.00 ±  4%   46.00 ±  4%       ~ (p=0.157 n=7)
List/sqlite-fits-in-page/pagination-4     93.00 ±  1%   93.00 ±  0%       ~ (p=1.000 n=7)
List/sqlite-overflows-page/all-4          57.00 ±  5%   57.00 ±  5%       ~ (p=0.935 n=7)
List/sqlite-overflows-page/pagination-4   93.00 ±  0%   93.00 ±  0%       ~ (p=1.000 n=7) ¹
List/dqlite-tiny/all-4                    14.00 ± 14%   14.00 ± 21%       ~ (p=1.000 n=7)
List/dqlite-tiny/pagination-4             13.00 ±  0%   13.00 ±  0%       ~ (p=1.000 n=7) ¹
List/dqlite-fits-in-page/all-4            18.00 ±  0%   18.00 ±  0%       ~ (p=1.000 n=7) ¹
List/dqlite-fits-in-page/pagination-4     19.00 ±  5%   18.00 ±  6%       ~ (p=0.302 n=7)
List/dqlite-overflows-page/all-4          29.00 ±  3%   29.00 ±  3%       ~ (p=1.000 n=7)
List/dqlite-overflows-page/pagination-4   32.00 ±  9%   31.00 ± 10%       ~ (p=0.331 n=7)
Update/1-workers/sqlite-4                 461.0 ±  3%
Update/2-workers/sqlite-4                 462.0 ±  1%
Update/4-workers/sqlite-4                 462.0 ±  2%
Update/8-workers/sqlite-4                 463.0 ±  1%
Update/16-workers/sqlite-4                464.0 ±  5%
Update/1-workers/dqlite-4                 375.0 ±  0%
Update/2-workers/dqlite-4                 375.0 ±  0%
Update/4-workers/dqlite-4                 376.0 ±  0%
Update/8-workers/dqlite-4                 376.0 ±  0%
Update/16-workers/dqlite-4                377.0 ±  1%
Create/sqlite/1-workers-4                               455.0 ±  5%
Create/sqlite/2-workers-4                               455.0 ±  0%
Create/sqlite/4-workers-4                               455.0 ±  2%
Create/sqlite/8-workers-4                               455.0 ±  5%
Create/sqlite/16-workers-4                              445.0 ±  4%
Create/dqlite/1-workers-4                               372.0 ±  0%
Create/dqlite/2-workers-4                               372.0 ±  0%
Create/dqlite/4-workers-4                               372.0 ±  0%
Create/dqlite/8-workers-4                               372.0 ±  8%
Create/dqlite/16-workers-4                              372.0 ±  0%
Delete/sqlite/1-workers-4                               726.0 ±  1%
Delete/sqlite/2-workers-4                               724.0 ±  6%
Delete/sqlite/4-workers-4                               716.0 ±  2%
Delete/sqlite/8-workers-4                               714.0 ±  9%
Delete/sqlite/16-workers-4                              686.0 ±  5%
Delete/dqlite/1-workers-4                               510.0 ±  0%
Delete/dqlite/2-workers-4                               554.0 ±  0%
Delete/dqlite/4-workers-4                               578.0 ±  0%
Delete/dqlite/8-workers-4                               560.0 ±  1%
Delete/dqlite/16-workers-4                              561.0 ±  0%
Update/sqlite/1-workers-4                               462.0 ±  1%
Update/sqlite/2-workers-4                               462.0 ±  5%
Update/sqlite/4-workers-4                               462.0 ±  0%
Update/sqlite/8-workers-4                               463.0 ±  1%
Update/sqlite/16-workers-4                              464.0 ± 15%
Update/dqlite/1-workers-4                               375.0 ±  0%
Update/dqlite/2-workers-4                               375.0 ±  0%
Update/dqlite/4-workers-4                               375.0 ±  0%
Update/dqlite/8-workers-4                               376.0 ±  0%
Update/dqlite/16-workers-4                              377.0 ±  1%
geomean                                   220.3         218.8        -1.54%               ²
¹ all samples are equal
² benchmark set differs from baseline; geomeans may not be comparable

                                        │        Before         │                     After                     │
                                        │ network-bytes-read/op │ network-bytes-read/op  vs base                │
Compaction/dqlite-4                               1.357Ki ± 22%           1.462Ki ± 76%       ~ (p=0.535 n=7)
Create/1-workers/dqlite-4                           240.4 ±  0%
Create/2-workers/dqlite-4                           241.7 ±  0%
Create/4-workers/dqlite-4                           241.8 ±  0%
Create/8-workers/dqlite-4                           241.5 ±  0%
Create/16-workers/dqlite-4                          241.8 ±  0%
Delete/1-workers/dqlite-4                         1.158Ki ±  0%
Delete/2-workers/dqlite-4                         1.258Ki ±  0%
Delete/4-workers/dqlite-4                         1.307Ki ±  0%
Delete/8-workers/dqlite-4                         1.297Ki ±  0%
Delete/16-workers/dqlite-4                        1.298Ki ±  0%
Get/dqlite-4                                      1.132Ki ±  0%           1.133Ki ±  0%       ~ (p=0.103 n=7)
List/dqlite-tiny/all-4                              203.3 ± 17%             199.9 ± 18%       ~ (p=0.710 n=7)
List/dqlite-tiny/pagination-4                       190.4 ±  2%             190.8 ±  1%       ~ (p=0.689 n=7)
List/dqlite-fits-in-page/all-4                    1.234Ki ±  1%           1.231Ki ±  1%       ~ (p=0.603 n=7)
List/dqlite-fits-in-page/pagination-4             1.292Ki ±  5%           1.278Ki ±  6%       ~ (p=0.456 n=7)
List/dqlite-overflows-page/all-4                  6.198Ki ±  2%           6.258Ki ±  1%       ~ (p=0.097 n=7)
List/dqlite-overflows-page/pagination-4           6.836Ki ±  8%           6.672Ki ±  7%       ~ (p=0.209 n=7)
Update/1-workers/dqlite-4                           262.8 ±  0%
Update/2-workers/dqlite-4                           263.0 ±  0%
Update/4-workers/dqlite-4                           263.3 ±  0%
Update/8-workers/dqlite-4                           263.1 ±  0%
Update/16-workers/dqlite-4                          263.8 ±  1%
Create/dqlite/1-workers-4                                                   240.7 ±  1%
Create/dqlite/2-workers-4                                                   241.5 ±  0%
Create/dqlite/4-workers-4                                                   242.2 ±  0%
Create/dqlite/8-workers-4                                                   242.0 ± 19%
Create/dqlite/16-workers-4                                                  242.0 ±  0%
Delete/dqlite/1-workers-4                                                 1.158Ki ±  0%
Delete/dqlite/2-workers-4                                                 1.263Ki ±  0%
Delete/dqlite/4-workers-4                                                 1.310Ki ±  0%
Delete/dqlite/8-workers-4                                                 1.298Ki ±  0%
Delete/dqlite/16-workers-4                                                1.299Ki ±  0%
Update/dqlite/1-workers-4                                                   262.8 ±  0%
Update/dqlite/2-workers-4                                                   263.1 ±  0%
Update/dqlite/4-workers-4                                                   262.9 ±  0%
Update/dqlite/8-workers-4                                                   263.6 ±  0%
Update/dqlite/16-workers-4                                                  263.6 ±  0%
geomean                                             620.8                   622.1        +0.41%               ¹
¹ benchmark set differs from baseline; geomeans may not be comparable

                                        │          Before          │                      After                       │
                                        │ network-bytes-written/op │ network-bytes-written/op  vs base                │
Compaction/dqlite-4                                    4.310 ±  3%                4.349 ± 11%       ~ (p=0.620 n=7)
Create/1-workers/dqlite-4                              114.0 ±  1%
Create/2-workers/dqlite-4                              116.5 ±  1%
Create/4-workers/dqlite-4                              116.8 ±  1%
Create/8-workers/dqlite-4                              116.2 ±  1%
Create/16-workers/dqlite-4                             116.7 ±  1%
Delete/1-workers/dqlite-4                              423.5 ±  0%
Delete/2-workers/dqlite-4                              800.4 ±  1%
Delete/4-workers/dqlite-4                              989.2 ±  2%
Delete/8-workers/dqlite-4                             1006.0 ±  2%
Delete/16-workers/dqlite-4                            1008.0 ±  1%
Get/dqlite-4                                           80.56 ±  0%                80.50 ±  0%       ~ (p=0.135 n=7)
List/dqlite-tiny/all-4                               0.04299 ± 32%              0.04172 ± 35%       ~ (p=0.710 n=7)
List/dqlite-tiny/pagination-4                        0.04636 ±  4%              0.04661 ±  4%       ~ (p=0.710 n=7)
List/dqlite-fits-in-page/all-4                       0.05277 ±  1%              0.05256 ±  2%       ~ (p=0.535 n=7)
List/dqlite-fits-in-page/pagination-4                0.07661 ± 12%              0.07598 ± 16%       ~ (p=0.535 n=7)
List/dqlite-overflows-page/all-4                     0.06368 ±  4%              0.06436 ±  3%       ~ (p=0.402 n=7)
List/dqlite-overflows-page/pagination-4               0.1137 ± 13%               0.1140 ± 15%       ~ (p=0.620 n=7)
Update/1-workers/dqlite-4                              136.6 ±  0%
Update/2-workers/dqlite-4                              136.5 ±  0%
Update/4-workers/dqlite-4                              136.6 ±  0%
Update/8-workers/dqlite-4                              136.5 ±  0%
Update/16-workers/dqlite-4                             137.1 ±  0%
Create/dqlite/1-workers-4                                                         114.5 ±  2%
Create/dqlite/2-workers-4                                                         116.1 ±  2%
Create/dqlite/4-workers-4                                                         117.5 ±  2%
Create/dqlite/8-workers-4                                                         117.1 ± 13%
Create/dqlite/16-workers-4                                                        116.8 ±  1%
Delete/dqlite/1-workers-4                                                         423.5 ±  0%
Delete/dqlite/2-workers-4                                                         812.5 ±  1%
Delete/dqlite/4-workers-4                                                         994.1 ±  2%
Delete/dqlite/8-workers-4                                                         996.3 ±  2%
Delete/dqlite/16-workers-4                                                       1007.0 ±  2%
Update/dqlite/1-workers-4                                                         136.5 ±  0%
Update/dqlite/2-workers-4                                                         136.5 ±  0%
Update/dqlite/4-workers-4                                                         136.5 ±  0%
Update/dqlite/8-workers-4                                                         136.7 ±  1%
Update/dqlite/16-workers-4                                                        137.3 ±  1%
geomean                                                21.92                      21.93        -0.19%               ¹
¹ benchmark set differs from baseline; geomeans may not be comparable
Current status
goos: linux
goarch: amd64
pkg: github.com/canonical/k8s-dqlite/test
cpu: AMD EPYC 7763 64-Core Processor                
                                        │    After     │
                                        │    sec/op    │
Compaction/sqlite-4                       37.63µ ±  9%
Compaction/dqlite-4                       40.28µ ± 11%
Create/sqlite/1-workers-4                 1.195m ±  6%
Create/sqlite/2-workers-4                 1.195m ±  7%
Create/sqlite/4-workers-4                 1.258m ±  7%
Create/sqlite/8-workers-4                 1.423m ± 10%
Create/sqlite/16-workers-4                1.598m ± 16%
Create/dqlite/1-workers-4                 1.060m ± 21%
Create/dqlite/2-workers-4                 898.6µ ±  9%
Create/dqlite/4-workers-4                 867.1µ ±  3%
Create/dqlite/8-workers-4                 868.0µ ±  8%
Create/dqlite/16-workers-4                851.6µ ±  4%
Delete/sqlite/1-workers-4                 1.398m ± 12%
Delete/sqlite/2-workers-4                 1.470m ±  6%
Delete/sqlite/4-workers-4                 1.576m ±  6%
Delete/sqlite/8-workers-4                 1.905m ± 19%
Delete/sqlite/16-workers-4                2.407m ± 17%
Delete/dqlite/1-workers-4                 1.301m ±  5%
Delete/dqlite/2-workers-4                 1.141m ±  3%
Delete/dqlite/4-workers-4                 1.103m ±  2%
Delete/dqlite/8-workers-4                 1.114m ±  3%
Delete/dqlite/16-workers-4                1.098m ±  3%
Get/sqlite-4                              266.8µ ±  1%
Get/dqlite-4                              356.1µ ±  1%
List/sqlite-tiny/all-4                    4.513µ ±  4%
List/sqlite-tiny/pagination-4             8.949µ ±  6%
List/sqlite-fits-in-page/all-4            7.038µ ±  3%
List/sqlite-fits-in-page/pagination-4     21.67µ ±  4%
List/sqlite-overflows-page/all-4          17.48µ ±  4%
List/sqlite-overflows-page/pagination-4   44.92µ ±  5%
List/dqlite-tiny/all-4                    2.790µ ± 13%
List/dqlite-tiny/pagination-4             5.874µ ±  1%
List/dqlite-fits-in-page/all-4            5.898µ ± 12%
List/dqlite-fits-in-page/pagination-4     15.79µ ±  3%
List/dqlite-overflows-page/all-4          17.36µ ±  2%
List/dqlite-overflows-page/pagination-4   39.07µ ±  2%
Update/sqlite/1-workers-4                 1.140m ±  3%
Update/sqlite/2-workers-4                 1.187m ±  6%
Update/sqlite/4-workers-4                 1.267m ±  6%
Update/sqlite/8-workers-4                 1.327m ± 19%
Update/sqlite/16-workers-4                1.593m ± 59%
Update/dqlite/1-workers-4                 1.040m ±  7%
Update/dqlite/2-workers-4                 899.7µ ±  3%
Update/dqlite/4-workers-4                 897.7µ ±  3%
Update/dqlite/8-workers-4                 896.8µ ±  4%
Update/dqlite/16-workers-4                914.9µ ± 14%
geomean                                   287.9µ

                                        │        After         │
                                        │ page-cache-misses/op │
Compaction/sqlite-4                               0.000 ± 0%
Compaction/dqlite-4                               0.000 ± 0%
Create/sqlite/1-workers-4                         0.000 ± 0%
Create/sqlite/2-workers-4                         0.000 ± 0%
Create/sqlite/4-workers-4                         0.000 ± 0%
Create/sqlite/8-workers-4                         0.000 ± 0%
Create/sqlite/16-workers-4                        0.000 ± 0%
Create/dqlite/1-workers-4                         0.000 ± 0%
Create/dqlite/2-workers-4                         0.000 ± 0%
Create/dqlite/4-workers-4                         0.000 ± 0%
Create/dqlite/8-workers-4                         0.000 ± 0%
Create/dqlite/16-workers-4                        0.000 ± 0%
Delete/sqlite/1-workers-4                         0.000 ± 0%
Delete/sqlite/2-workers-4                         0.000 ± 0%
Delete/sqlite/4-workers-4                         0.000 ± 0%
Delete/sqlite/8-workers-4                         0.000 ± 0%
Delete/sqlite/16-workers-4                        0.000 ± 0%
Delete/dqlite/1-workers-4                         0.000 ± 0%
Delete/dqlite/2-workers-4                         0.000 ± 0%
Delete/dqlite/4-workers-4                         0.000 ± 0%
Delete/dqlite/8-workers-4                         0.000 ± 0%
Delete/dqlite/16-workers-4                        0.000 ± 0%
Get/sqlite-4                                      0.000 ± 0%
Get/dqlite-4                                      0.000 ± 0%
List/sqlite-tiny/all-4                            0.000 ± 0%
List/sqlite-tiny/pagination-4                     0.000 ± 0%
List/sqlite-fits-in-page/all-4                    0.000 ± 0%
List/sqlite-fits-in-page/pagination-4             0.000 ± 0%
List/sqlite-overflows-page/all-4                  0.000 ± 0%
List/sqlite-overflows-page/pagination-4           0.000 ± 0%
List/dqlite-tiny/all-4                            0.000 ± 0%
List/dqlite-tiny/pagination-4                     0.000 ± 0%
List/dqlite-fits-in-page/all-4                    0.000 ± 0%
List/dqlite-fits-in-page/pagination-4             0.000 ± 0%
List/dqlite-overflows-page/all-4                  0.000 ± 0%
List/dqlite-overflows-page/pagination-4           0.000 ± 0%
Update/sqlite/1-workers-4                         0.000 ± 0%
Update/sqlite/2-workers-4                         0.000 ± 0%
Update/sqlite/4-workers-4                         0.000 ± 0%
Update/sqlite/8-workers-4                         0.000 ± 0%
Update/sqlite/16-workers-4                        0.000 ± 0%
Update/dqlite/1-workers-4                         0.000 ± 0%
Update/dqlite/2-workers-4                         0.000 ± 0%
Update/dqlite/4-workers-4                         0.000 ± 0%
Update/dqlite/8-workers-4                         0.000 ± 0%
Update/dqlite/16-workers-4                        0.000 ± 0%
geomean                                                      ¹
¹ summaries must be >0 to compute geomean

                                        │        After         │
                                        │ page-cache-spills/op │
Compaction/sqlite-4                               0.000 ± 0%
Compaction/dqlite-4                               0.000 ± 0%
Create/sqlite/1-workers-4                         0.000 ± 0%
Create/sqlite/2-workers-4                         0.000 ± 0%
Create/sqlite/4-workers-4                         0.000 ± 0%
Create/sqlite/8-workers-4                         0.000 ± 0%
Create/sqlite/16-workers-4                        0.000 ± 0%
Create/dqlite/1-workers-4                         0.000 ± 0%
Create/dqlite/2-workers-4                         0.000 ± 0%
Create/dqlite/4-workers-4                         0.000 ± 0%
Create/dqlite/8-workers-4                         0.000 ± 0%
Create/dqlite/16-workers-4                        0.000 ± 0%
Delete/sqlite/1-workers-4                         0.000 ± 0%
Delete/sqlite/2-workers-4                         0.000 ± 0%
Delete/sqlite/4-workers-4                         0.000 ± 0%
Delete/sqlite/8-workers-4                         0.000 ± 0%
Delete/sqlite/16-workers-4                        0.000 ± 0%
Delete/dqlite/1-workers-4                         0.000 ± 0%
Delete/dqlite/2-workers-4                         0.000 ± 0%
Delete/dqlite/4-workers-4                         0.000 ± 0%
Delete/dqlite/8-workers-4                         0.000 ± 0%
Delete/dqlite/16-workers-4                        0.000 ± 0%
Get/sqlite-4                                      0.000 ± 0%
Get/dqlite-4                                      0.000 ± 0%
List/sqlite-tiny/all-4                            0.000 ± 0%
List/sqlite-tiny/pagination-4                     0.000 ± 0%
List/sqlite-fits-in-page/all-4                    0.000 ± 0%
List/sqlite-fits-in-page/pagination-4             0.000 ± 0%
List/sqlite-overflows-page/all-4                  0.000 ± 0%
List/sqlite-overflows-page/pagination-4           0.000 ± 0%
List/dqlite-tiny/all-4                            0.000 ± 0%
List/dqlite-tiny/pagination-4                     0.000 ± 0%
List/dqlite-fits-in-page/all-4                    0.000 ± 0%
List/dqlite-fits-in-page/pagination-4             0.000 ± 0%
List/dqlite-overflows-page/all-4                  0.000 ± 0%
List/dqlite-overflows-page/pagination-4           0.000 ± 0%
Update/sqlite/1-workers-4                         0.000 ± 0%
Update/sqlite/2-workers-4                         0.000 ± 0%
Update/sqlite/4-workers-4                         0.000 ± 0%
Update/sqlite/8-workers-4                         0.000 ± 0%
Update/sqlite/16-workers-4                        0.000 ± 0%
Update/dqlite/1-workers-4                         0.000 ± 0%
Update/dqlite/2-workers-4                         0.000 ± 0%
Update/dqlite/4-workers-4                         0.000 ± 0%
Update/dqlite/8-workers-4                         0.000 ± 0%
Update/dqlite/16-workers-4                        0.000 ± 0%
geomean                                                      ¹
¹ summaries must be >0 to compute geomean

                                        │     After     │
                                        │ page-reads/op │
Compaction/sqlite-4                         12.20 ±  1%
Compaction/dqlite-4                         12.19 ±  1%
Create/sqlite/1-workers-4                   14.08 ±  4%
Create/sqlite/2-workers-4                   13.90 ±  1%
Create/sqlite/4-workers-4                   13.59 ±  2%
Create/sqlite/8-workers-4                   13.13 ±  3%
Create/sqlite/16-workers-4                  12.51 ±  6%
Create/dqlite/1-workers-4                   12.99 ±  2%
Create/dqlite/2-workers-4                   10.92 ±  2%
Create/dqlite/4-workers-4                   10.98 ±  1%
Create/dqlite/8-workers-4                   10.98 ±  1%
Create/dqlite/16-workers-4                  10.98 ±  1%
Delete/sqlite/1-workers-4                   25.13 ±  1%
Delete/sqlite/2-workers-4                   24.05 ±  5%
Delete/sqlite/4-workers-4                   23.07 ±  4%
Delete/sqlite/8-workers-4                   22.00 ± 10%
Delete/sqlite/16-workers-4                  20.04 ±  6%
Delete/dqlite/1-workers-4                   23.74 ±  1%
Delete/dqlite/2-workers-4                   13.16 ±  2%
Delete/dqlite/4-workers-4                   10.25 ±  2%
Delete/dqlite/8-workers-4                   11.02 ±  2%
Delete/dqlite/16-workers-4                  10.99 ±  1%
Get/sqlite-4                                14.96 ±  0%
Get/dqlite-4                                11.95 ±  0%
List/sqlite-tiny/all-4                     192.2m ±  0%
List/sqlite-tiny/pagination-4               1.132 ±  3%
List/sqlite-fits-in-page/all-4             164.6m ±  0%
List/sqlite-fits-in-page/pagination-4      965.5m ±  3%
List/sqlite-overflows-page/all-4           300.5m ± 27%
List/sqlite-overflows-page/pagination-4     2.080 ±  2%
List/dqlite-tiny/all-4                     191.0m ±  1%
List/dqlite-tiny/pagination-4               1.126 ±  0%
List/dqlite-fits-in-page/all-4             163.2m ±  0%
List/dqlite-fits-in-page/pagination-4      954.4m ±  3%
List/dqlite-overflows-page/all-4           182.8m ±  0%
List/dqlite-overflows-page/pagination-4     1.070 ±  3%
Update/sqlite/1-workers-4                   16.29 ±  1%
Update/sqlite/2-workers-4                   16.13 ±  4%
Update/sqlite/4-workers-4                   15.99 ±  3%
Update/sqlite/8-workers-4                   15.73 ±  5%
Update/sqlite/16-workers-4                  14.56 ±  8%
Update/dqlite/1-workers-4                   15.19 ±  1%
Update/dqlite/2-workers-4                   12.88 ±  1%
Update/dqlite/4-workers-4                   12.85 ±  1%
Update/dqlite/8-workers-4                   12.74 ±  1%
Update/dqlite/16-workers-4                  12.77 ±  1%
geomean                                     5.901

                                        │     After      │
                                        │ page-writes/op │
Compaction/sqlite-4                        207.8m ± 0%
Compaction/dqlite-4                        187.6m ± 0%
Create/sqlite/1-workers-4                   5.123 ± 0%
Create/sqlite/2-workers-4                   5.123 ± 0%
Create/sqlite/4-workers-4                   5.115 ± 1%
Create/sqlite/8-workers-4                   5.089 ± 1%
Create/sqlite/16-workers-4                  5.077 ± 1%
Create/dqlite/1-workers-4                   4.217 ± 2%
Create/dqlite/2-workers-4                   4.285 ± 1%
Create/dqlite/4-workers-4                   4.301 ± 1%
Create/dqlite/8-workers-4                   4.301 ± 0%
Create/dqlite/16-workers-4                  4.299 ± 0%
Delete/sqlite/1-workers-4                   5.327 ± 1%
Delete/sqlite/2-workers-4                   5.302 ± 1%
Delete/sqlite/4-workers-4                   5.290 ± 1%
Delete/sqlite/8-workers-4                   5.288 ± 2%
Delete/sqlite/16-workers-4                  5.312 ± 1%
Delete/dqlite/1-workers-4                   4.389 ± 0%
Delete/dqlite/2-workers-4                   4.411 ± 1%
Delete/dqlite/4-workers-4                   4.405 ± 1%
Delete/dqlite/8-workers-4                   4.401 ± 1%
Delete/dqlite/16-workers-4                  4.391 ± 1%
Get/sqlite-4                                0.000 ± 0%
Get/dqlite-4                                0.000 ± 0%
List/sqlite-tiny/all-4                      0.000 ± 0%
List/sqlite-tiny/pagination-4               0.000 ± 0%
List/sqlite-fits-in-page/all-4              0.000 ± 0%
List/sqlite-fits-in-page/pagination-4       0.000 ± 0%
List/sqlite-overflows-page/all-4            0.000 ± 0%
List/sqlite-overflows-page/pagination-4     0.000 ± 0%
List/dqlite-tiny/all-4                      0.000 ± 0%
List/dqlite-tiny/pagination-4               0.000 ± 0%
List/dqlite-fits-in-page/all-4              0.000 ± 0%
List/dqlite-fits-in-page/pagination-4       0.000 ± 0%
List/dqlite-overflows-page/all-4            0.000 ± 0%
List/dqlite-overflows-page/pagination-4     0.000 ± 0%
Update/sqlite/1-workers-4                   5.178 ± 0%
Update/sqlite/2-workers-4                   5.197 ± 1%
Update/sqlite/4-workers-4                   5.226 ± 1%
Update/sqlite/8-workers-4                   5.250 ± 1%
Update/sqlite/16-workers-4                  5.210 ± 2%
Update/dqlite/1-workers-4                   4.205 ± 0%
Update/dqlite/2-workers-4                   4.257 ± 0%
Update/dqlite/4-workers-4                   4.215 ± 1%
Update/dqlite/8-workers-4                   4.202 ± 1%
Update/dqlite/16-workers-4                  4.218 ± 1%
geomean                                                ¹
¹ summaries must be >0 to compute geomean

                                        │     After      │
                                        │ sec-reading/op │
Compaction/sqlite-4                        118.1µ ±   6%
Compaction/dqlite-4                        23.20µ ±  55%
Create/sqlite/1-workers-4                  48.30µ ± 650%
Create/sqlite/2-workers-4                  37.10µ ±  80%
Create/sqlite/4-workers-4                  39.70µ ± 163%
Create/sqlite/8-workers-4                  98.10µ ± 249%
Create/sqlite/16-workers-4                 171.7µ ± 178%
Create/dqlite/1-workers-4                  6.800µ ± 132%
Create/dqlite/2-workers-4                  10.60µ ±  56%
Create/dqlite/4-workers-4                  11.70µ ±  26%
Create/dqlite/8-workers-4                  13.80µ ±  64%
Create/dqlite/16-workers-4                 11.60µ ±  47%
Delete/sqlite/1-workers-4                  179.7µ ±  36%
Delete/sqlite/2-workers-4                  725.6µ ±  30%
Delete/sqlite/4-workers-4                  1.295m ±  51%
Delete/sqlite/8-workers-4                  3.843m ±  44%
Delete/sqlite/16-workers-4                 9.257m ±  39%
Delete/dqlite/1-workers-4                  46.30µ ±  32%
Delete/dqlite/2-workers-4                  59.70µ ±  15%
Delete/dqlite/4-workers-4                  57.70µ ±  19%
Delete/dqlite/8-workers-4                  58.70µ ±  17%
Delete/dqlite/16-workers-4                 58.10µ ±  30%
Get/sqlite-4                               85.60µ ±   6%
Get/dqlite-4                               35.00µ ±  24%
List/sqlite-tiny/all-4                     14.30µ ±   3%
List/sqlite-tiny/pagination-4              19.30µ ±   6%
List/sqlite-fits-in-page/all-4             17.00µ ±   9%
List/sqlite-fits-in-page/pagination-4      58.40µ ±   4%
List/sqlite-overflows-page/all-4           54.90µ ±  17%
List/sqlite-overflows-page/pagination-4    166.5µ ±   4%
List/dqlite-tiny/all-4                     4.000µ ±  25%
List/dqlite-tiny/pagination-4              9.000µ ±   8%
List/dqlite-fits-in-page/all-4             9.900µ ±  15%
List/dqlite-fits-in-page/pagination-4      26.00µ ±  12%
List/dqlite-overflows-page/all-4           30.30µ ±   2%
List/dqlite-overflows-page/pagination-4    60.10µ ±  16%
Update/sqlite/1-workers-4                  40.90µ ± 101%
Update/sqlite/2-workers-4                  101.8µ ± 307%
Update/sqlite/4-workers-4                  44.10µ ± 236%
Update/sqlite/8-workers-4                  37.40µ ± 399%
Update/sqlite/16-workers-4                 96.50µ ± 905%
Update/dqlite/1-workers-4                  8.700µ ±  44%
Update/dqlite/2-workers-4                  10.30µ ±  45%
Update/dqlite/4-workers-4                  9.700µ ±  56%
Update/dqlite/8-workers-4                  13.00µ ±  42%
Update/dqlite/16-workers-4                 12.20µ ±  30%
geomean                                    45.40µ

                                        │     After      │
                                        │ sec-writing/op │
Compaction/sqlite-4                       8.700µ ± 21%
Compaction/dqlite-4                       6.900µ ±  6%
Create/sqlite/1-workers-4                 897.2µ ±  9%
Create/sqlite/2-workers-4                 1.855m ± 18%
Create/sqlite/4-workers-4                 3.763m ± 36%
Create/sqlite/8-workers-4                 7.157m ± 25%
Create/sqlite/16-workers-4                13.71m ± 26%
Create/dqlite/1-workers-4                 40.30µ ± 28%
Create/dqlite/2-workers-4                 37.80µ ± 37%
Create/dqlite/4-workers-4                 48.30µ ± 22%
Create/dqlite/8-workers-4                 45.90µ ± 15%
Create/dqlite/16-workers-4                43.30µ ± 15%
Delete/sqlite/1-workers-4                 1.027m ± 20%
Delete/sqlite/2-workers-4                 1.769m ± 49%
Delete/sqlite/4-workers-4                 3.527m ± 10%
Delete/sqlite/8-workers-4                 7.860m ± 45%
Delete/sqlite/16-workers-4                16.14m ± 43%
Delete/dqlite/1-workers-4                 23.60µ ± 49%
Delete/dqlite/2-workers-4                 28.60µ ± 28%
Delete/dqlite/4-workers-4                 27.20µ ± 32%
Delete/dqlite/8-workers-4                 32.50µ ± 43%
Delete/dqlite/16-workers-4                35.10µ ± 47%
Get/sqlite-4                               0.000 ±  0%
Get/dqlite-4                               0.000 ±  0%
List/sqlite-tiny/all-4                     0.000 ±  0%
List/sqlite-tiny/pagination-4              0.000 ±  0%
List/sqlite-fits-in-page/all-4             0.000 ±  0%
List/sqlite-fits-in-page/pagination-4      0.000 ±  0%
List/sqlite-overflows-page/all-4           0.000 ±  0%
List/sqlite-overflows-page/pagination-4    0.000 ±  0%
List/dqlite-tiny/all-4                     0.000 ±  0%
List/dqlite-tiny/pagination-4              0.000 ±  0%
List/dqlite-fits-in-page/all-4             0.000 ±  0%
List/dqlite-fits-in-page/pagination-4      0.000 ±  0%
List/dqlite-overflows-page/all-4           0.000 ±  0%
List/dqlite-overflows-page/pagination-4    0.000 ±  0%
Update/sqlite/1-workers-4                 834.8µ ±  5%
Update/sqlite/2-workers-4                 1.560m ± 31%
Update/sqlite/4-workers-4                 3.138m ± 35%
Update/sqlite/8-workers-4                 6.533m ± 20%
Update/sqlite/16-workers-4                14.05m ± 40%
Update/dqlite/1-workers-4                 23.80µ ± 39%
Update/dqlite/2-workers-4                 33.70µ ± 27%
Update/dqlite/4-workers-4                 32.80µ ± 41%
Update/dqlite/8-workers-4                 34.50µ ± 32%
Update/dqlite/16-workers-4                49.50µ ± 27%
geomean                                                ¹
¹ summaries must be >0 to compute geomean

                                        │     After     │
                                        │     B/op      │
Compaction/sqlite-4                         836.0 ± 57%
Compaction/dqlite-4                       4.039Ki ± 74%
Create/sqlite/1-workers-4                 21.36Ki ±  3%
Create/sqlite/2-workers-4                 21.38Ki ±  0%
Create/sqlite/4-workers-4                 21.36Ki ±  1%
Create/sqlite/8-workers-4                 21.41Ki ±  3%
Create/sqlite/16-workers-4                21.10Ki ±  3%
Create/dqlite/1-workers-4                 20.07Ki ±  0%
Create/dqlite/2-workers-4                 20.06Ki ±  0%
Create/dqlite/4-workers-4                 20.05Ki ±  0%
Create/dqlite/8-workers-4                 20.04Ki ±  6%
Create/dqlite/16-workers-4                20.05Ki ±  0%
Delete/sqlite/1-workers-4                 32.56Ki ±  1%
Delete/sqlite/2-workers-4                 32.54Ki ±  5%
Delete/sqlite/4-workers-4                 32.26Ki ±  2%
Delete/sqlite/8-workers-4                 32.29Ki ±  7%
Delete/sqlite/16-workers-4                31.35Ki ±  4%
Delete/dqlite/1-workers-4                 29.46Ki ±  0%
Delete/dqlite/2-workers-4                 64.11Ki ±  1%
Delete/dqlite/4-workers-4                 85.41Ki ±  4%
Delete/dqlite/8-workers-4                 80.82Ki ±  3%
Delete/dqlite/16-workers-4                80.94Ki ±  2%
Get/sqlite-4                              25.08Ki ±  0%
Get/dqlite-4                              22.88Ki ±  0%
List/sqlite-tiny/all-4                    1.251Ki ±  2%
List/sqlite-tiny/pagination-4             1.779Ki ±  5%
List/sqlite-fits-in-page/all-4            5.021Ki ±  4%
List/sqlite-fits-in-page/pagination-4     10.22Ki ±  1%
List/sqlite-overflows-page/all-4          26.84Ki ±  6%
List/sqlite-overflows-page/pagination-4   46.17Ki ±  1%
List/dqlite-tiny/all-4                      865.0 ± 11%
List/dqlite-tiny/pagination-4               846.0 ±  2%
List/dqlite-fits-in-page/all-4            4.298Ki ±  1%
List/dqlite-fits-in-page/pagination-4     4.444Ki ±  4%
List/dqlite-overflows-page/all-4          21.28Ki ±  1%
List/dqlite-overflows-page/pagination-4   22.40Ki ±  5%
Update/sqlite/1-workers-4                 22.55Ki ±  1%
Update/sqlite/2-workers-4                 22.55Ki ±  3%
Update/sqlite/4-workers-4                 22.62Ki ±  0%
Update/sqlite/8-workers-4                 22.69Ki ±  1%
Update/sqlite/16-workers-4                22.80Ki ± 10%
Update/dqlite/1-workers-4                 21.20Ki ±  0%
Update/dqlite/2-workers-4                 21.19Ki ±  0%
Update/dqlite/4-workers-4                 21.18Ki ±  0%
Update/dqlite/8-workers-4                 21.24Ki ±  0%
Update/dqlite/16-workers-4                21.29Ki ±  0%
geomean                                   15.97Ki

                                        │    After    │
                                        │  allocs/op  │
Compaction/sqlite-4                       32.00 ± 59%
Compaction/dqlite-4                       97.00 ± 75%
Create/sqlite/1-workers-4                 455.0 ±  5%
Create/sqlite/2-workers-4                 455.0 ±  0%
Create/sqlite/4-workers-4                 455.0 ±  2%
Create/sqlite/8-workers-4                 455.0 ±  5%
Create/sqlite/16-workers-4                445.0 ±  4%
Create/dqlite/1-workers-4                 372.0 ±  0%
Create/dqlite/2-workers-4                 372.0 ±  0%
Create/dqlite/4-workers-4                 372.0 ±  0%
Create/dqlite/8-workers-4                 372.0 ±  8%
Create/dqlite/16-workers-4                372.0 ±  0%
Delete/sqlite/1-workers-4                 726.0 ±  1%
Delete/sqlite/2-workers-4                 724.0 ±  6%
Delete/sqlite/4-workers-4                 716.0 ±  2%
Delete/sqlite/8-workers-4                 714.0 ±  9%
Delete/sqlite/16-workers-4                686.0 ±  5%
Delete/dqlite/1-workers-4                 510.0 ±  0%
Delete/dqlite/2-workers-4                 554.0 ±  0%
Delete/dqlite/4-workers-4                 578.0 ±  0%
Delete/dqlite/8-workers-4                 560.0 ±  1%
Delete/dqlite/16-workers-4                561.0 ±  0%
Get/sqlite-4                              563.0 ±  0%
Get/dqlite-4                              407.0 ±  0%
List/sqlite-tiny/all-4                    41.00 ±  2%
List/sqlite-tiny/pagination-4             61.00 ±  7%
List/sqlite-fits-in-page/all-4            46.00 ±  4%
List/sqlite-fits-in-page/pagination-4     93.00 ±  0%
List/sqlite-overflows-page/all-4          57.00 ±  5%
List/sqlite-overflows-page/pagination-4   93.00 ±  0%
List/dqlite-tiny/all-4                    14.00 ± 21%
List/dqlite-tiny/pagination-4             13.00 ±  0%
List/dqlite-fits-in-page/all-4            18.00 ±  0%
List/dqlite-fits-in-page/pagination-4     18.00 ±  6%
List/dqlite-overflows-page/all-4          29.00 ±  3%
List/dqlite-overflows-page/pagination-4   31.00 ± 10%
Update/sqlite/1-workers-4                 462.0 ±  1%
Update/sqlite/2-workers-4                 462.0 ±  5%
Update/sqlite/4-workers-4                 462.0 ±  0%
Update/sqlite/8-workers-4                 463.0 ±  1%
Update/sqlite/16-workers-4                464.0 ± 15%
Update/dqlite/1-workers-4                 375.0 ±  0%
Update/dqlite/2-workers-4                 375.0 ±  0%
Update/dqlite/4-workers-4                 375.0 ±  0%
Update/dqlite/8-workers-4                 376.0 ±  0%
Update/dqlite/16-workers-4                377.0 ±  1%
geomean                                   218.8

                                        │         After         │
                                        │ network-bytes-read/op │
Compaction/dqlite-4                               1.462Ki ± 76%
Create/dqlite/1-workers-4                           240.7 ±  1%
Create/dqlite/2-workers-4                           241.5 ±  0%
Create/dqlite/4-workers-4                           242.2 ±  0%
Create/dqlite/8-workers-4                           242.0 ± 19%
Create/dqlite/16-workers-4                          242.0 ±  0%
Delete/dqlite/1-workers-4                         1.158Ki ±  0%
Delete/dqlite/2-workers-4                         1.263Ki ±  0%
Delete/dqlite/4-workers-4                         1.310Ki ±  0%
Delete/dqlite/8-workers-4                         1.298Ki ±  0%
Delete/dqlite/16-workers-4                        1.299Ki ±  0%
Get/dqlite-4                                      1.133Ki ±  0%
List/dqlite-tiny/all-4                              199.9 ± 18%
List/dqlite-tiny/pagination-4                       190.8 ±  1%
List/dqlite-fits-in-page/all-4                    1.231Ki ±  1%
List/dqlite-fits-in-page/pagination-4             1.278Ki ±  6%
List/dqlite-overflows-page/all-4                  6.258Ki ±  1%
List/dqlite-overflows-page/pagination-4           6.672Ki ±  7%
Update/dqlite/1-workers-4                           262.8 ±  0%
Update/dqlite/2-workers-4                           263.1 ±  0%
Update/dqlite/4-workers-4                           262.9 ±  0%
Update/dqlite/8-workers-4                           263.6 ±  0%
Update/dqlite/16-workers-4                          263.6 ±  0%
geomean                                             622.1

                                        │          After           │
                                        │ network-bytes-written/op │
Compaction/dqlite-4                                    4.349 ± 11%
Create/dqlite/1-workers-4                              114.5 ±  2%
Create/dqlite/2-workers-4                              116.1 ±  2%
Create/dqlite/4-workers-4                              117.5 ±  2%
Create/dqlite/8-workers-4                              117.1 ± 13%
Create/dqlite/16-workers-4                             116.8 ±  1%
Delete/dqlite/1-workers-4                              423.5 ±  0%
Delete/dqlite/2-workers-4                              812.5 ±  1%
Delete/dqlite/4-workers-4                              994.1 ±  2%
Delete/dqlite/8-workers-4                              996.3 ±  2%
Delete/dqlite/16-workers-4                            1007.0 ±  2%
Get/dqlite-4                                           80.50 ±  0%
List/dqlite-tiny/all-4                               0.04172 ± 35%
List/dqlite-tiny/pagination-4                        0.04661 ±  4%
List/dqlite-fits-in-page/all-4                       0.05256 ±  2%
List/dqlite-fits-in-page/pagination-4                0.07598 ± 16%
List/dqlite-overflows-page/all-4                     0.06436 ±  3%
List/dqlite-overflows-page/pagination-4               0.1140 ± 15%
Update/dqlite/1-workers-4                              136.5 ±  0%
Update/dqlite/2-workers-4                              136.5 ±  0%
Update/dqlite/4-workers-4                              136.5 ±  0%
Update/dqlite/8-workers-4                              136.7 ±  1%
Update/dqlite/16-workers-4                             137.3 ±  1%
geomean                                                21.93

Copy link
Contributor

@louiseschmidtgen louiseschmidtgen left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, thanks!

@louiseschmidtgen louiseschmidtgen merged commit 0520ad5 into master Sep 25, 2024
7 checks passed
@marco6 marco6 deleted the marco6/rename-concurrent-tests branch September 26, 2024 06:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants