dockerd.json not updated #3

hirenshah · 2020-06-11T11:09:55Z

Just did the full update process and found that my containers wouldn't start due to the "db" log driver not being found.

After a little digging, I noticed that the:
/var/packages/Docker/etc/dockerd.json

Still contains:

{
   "data-root" : "/var/packages/Docker/target/docker",
   "log-driver" : "db",
   "registry-mirrors" : [],
   "storage-driver" : "aufs"
}

The last time this file was changed was a month ago... guess that is when I installed a DSM update.

The text was updated successfully, but these errors were encountered:

markdumay · 2020-06-11T11:19:19Z

Thanks for catching this issue, it confirms my suspicion for issue #1. The log driver should be "json-file" instead of "db", as the db driver is specific to Synology's Docker package. It looks like "execute_update_log()" in the script does not work as expected, I'll look into it.

hirenshah · 2020-06-11T11:40:52Z

@markdumay

Line 394:

if [ ! -f "$SYNO_DOCKER_JSON" ] || grep "json-file" "$SYNO_DOCKER_JSON" -q ; then

Is the second half right? If it found a match, it would return 0, which is true. The return code you are looking for should be anything other than 0 right?

if [ ! -f "$SYNO_DOCKER_JSON" ] || [ ! grep "json-file" "$SYNO_DOCKER_JSON" -q] ; then

markdumay · 2020-06-11T12:20:16Z

You're right, the second half is incorrect. I updated the function as follows:

# Configure log driver
execute_update_log() {
    print_status "Configuring log driver"
    if [ "$STAGE" == 'false' ] ; then
        LOG_DRIVER=$(grep "json-file" "$SYNO_DOCKER_JSON")
        if [ ! -f "$SYNO_DOCKER_JSON" ] || [ -z "$LOG_DRIVER" ] ; then
            mkdir -p "$SYNO_DOCKER_JSON_PATH"
            printf "$SYNO_DOCKER_JSON_CONFIG" > "$SYNO_DOCKER_JSON"
        fi
    else
        echo "Skipping configuration in STAGE mode"
    fi
}

A new branch 'logdriver' is available, care to try it?

hirenshah · 2020-06-11T12:25:08Z

Sure :)

I'm just restoring everything and then will attempt the update again :)

hirenshah · 2020-06-11T12:35:57Z

/Edit: Ignore Me :p

markdumay · 2020-06-11T12:46:09Z

OK, I did a rerun on my NAS too, and it looks like $SYNO_DOCKER_JSON_CONFIG is not parsed correctly yet... I'll update the variable and will push it to the branch

hirenshah · 2020-06-11T12:52:12Z

So, I couldn't restore the backup... I got this:

root@DiskStation:/volume1/docker/synology-docker# sudo ./syno_docker_update.sh -b /volume1/docker/synology-docker/docker_backup_200611115000.tgz restore
Update Docker Engine and Docker Compose on Synology to target version

Current DSM version: 6.2.3
Current Docker version: 19.03.11
Current Docker Compose version: 1.26.0
Step 1 from 5: Stopping Docker service
pkgctl-Docker stoped.
Step 2 from 5: Extracting Docker backup (/volume1/docker/synology-docker//volume1/docker/synology-docker/docker_backup_200611115000.tgz)
bin/
bin/containerd
bin/auplink
bin/runc
bin/containerd-shim
bin/ctr
bin/dockerd
bin/docker-init
bin/docker
bin/docker-compose
bin/docker-proxy
dockerd.json
ERROR: Docker compose binary could not be extracted from archive

So I extracted it myself and restored the files manually.

Just noticed the "Step 2 from 5" path... guessing the two variables shouldn't be put together?

hirenshah · 2020-06-11T12:53:35Z

OK, I did a rerun on my NAS too, and it looks like $SYNO_DOCKER_JSON_CONFIG is not parsed correctly yet... I'll update the variable and will push it to the branch

Ahh yes, I just noticed that :)

At least it is a step in the right direction :)

markdumay · 2020-06-11T12:57:51Z

ok, $SYNO_DOCKER_JSON_CONFIG is working on my NAS now. I had to manually delete /var/packages/Docker/etc/dockerd.json first, because the script detected the json-file driver, whilst the file itself had an incorrect syntax. :-/

markdumay · 2020-06-11T12:59:21Z

/volume1/docker/synology-docker//volume1/docker/synology-docker/docker_backup_200611115000.tgz looks like another bug indeed, the -b flag should in theory override the working directory. I'll create a new issue.

hirenshah · 2020-06-11T13:04:54Z

Weird... the restore process worked perfectly this time round. I ran the same command as the one I mentioned here:
#3 (comment)

markdumay · 2020-06-11T13:14:28Z

That's weird indeed. I checked the code and noticed an issue here:

execute_extract_backup() {
    print_status "Extracting Docker backup ($WORKING_DIR/$DOCKER_BACKUP_FILENAME)"
    BASEPATH=$(dirname "$DOCKER_BACKUP_FILENAME")
    FILENAME=$(basename "$DOCKER_BACKUP_FILENAME") 
    cd "$BASEPATH"
    tar -zxvf "$FILENAME"

    [ ... ]
}

Print_status incorrectly prepends $WORKING_DIR/ as this is already present in $DOCKER_BACKUP_FILENAME. However, that should not have impact on the tar command as it uses $FILENAME instead.

maxbec · 2020-08-24T10:35:14Z

Hey guys,
i still get the error on my influxdb docker file when i try to start it after the update:
Create container InfluxDB failed: {"message":"logger: no log driver named 'db' is registered"}.

markdumay · 2020-08-24T16:36:52Z

Hi Max, To better understand potential causes, can you share the following? - Your Dockerfile and/or Docker command for running influxdb - The syno_docker_update.sh command and console output - Your Docker path (should be /var/packages/Docker) Thanks, Mark.

…

On 24 Aug 2020, at 12:35, Max Beckenbauer ***@***.***> wrote: Hey guys, i still get the error on my influxdb docker file when i try to start it after the update: Create container InfluxDB failed: {"message":"logger: no log driver named 'db' is registered"}. — You are receiving this because you modified the open/close state. Reply to this email directly, view it on GitHub, or unsubscribe.

maxbec · 2020-08-25T06:36:32Z

Hi @markdumay ,

Dockerfile command:
$ docker run -p 8086:8086 \ -v $PWD:/var/lib/influxdb \ influxdb
Syno_docker_update command:
sudo ./syno_docker_update.sh update (Console output was uneventful)
Docker is in /var/packages/Docker

markdumay · 2020-08-25T17:09:42Z

Ok, so the syno_docker_update command didn’t show any messages at all? Are you sure the script output is directed to your terminal then?

…

On 25 Aug 2020, at 08:36, Max Beckenbauer ***@***.***> wrote: Hi @markdumay , Dockerfile command: $ docker run -p 8086:8086 \ -v $PWD:/var/lib/influxdb \ influxdb Syno_docker_update command: sudo ./syno_docker_update.sh update (Console output was uneventful) Docker is in /var/packages/Docker — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub, or unsubscribe.

maxbec · 2020-08-27T15:38:46Z

There were a lot of messages. But no fail messages. And i didn't save them, sorry :/

markdumay · 2020-08-27T16:06:17Z

Ok, then it’s going to be difficult to understand to what point the script actually ran... if you’re up for it, would you mind rerunning the script and sharing the exact console output?

…

On 27 Aug 2020, at 17:39, Max Beckenbauer ***@***.***> wrote: There were a lot of messages. But no fail messages. And i didn't save them, sorry :/ — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub, or unsubscribe.

rui-nar · 2020-11-14T20:20:38Z

Hey there
I'm having the same issue.
Output :

Update Docker Engine and Docker Compose on Synology to target version

Current DSM version: 6.2.3
Current Docker version: 18.09.8
Current Docker Compose version: 1.24.0
Target Docker version: 19.03.13
Target Docker Compose version: 1.27.4

WARNING! This will replace:
  - Docker Engine
  - Docker Compose
  - Docker daemon log driver

Are you sure you want to continue? [y/N] y
Step 1 from 9: Downloading target Docker binary (https://download.docker.com/linux/static/stable/x86_64/docker-19.03.13.tgz)
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 59.3M  100 59.3M    0     0  1014k      0  0:00:59  0:00:59 --:--:-- 1066k
Step 2 from 9: Downloading target Docker Compose binary (https://github.com/docker/compose/releases/download/1.27.4/docker-compose-Linux-x86_64)
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100   651  100   651    0     0   2883      0 --:--:-- --:--:-- --:--:--  2906
100 11.6M  100 11.6M    0     0   916k      0  0:00:13  0:00:13 --:--:-- 1019k
Step 3 from 9: Stopping Docker service
pkgctl-Docker stoped.
Step 4 from 9: Backing up current Docker binaries (/volume1/homes/Rui/synology-docker/docker_backup_20201114_205835.tgz)
bin/
bin/containerd-shim
bin/ctr
bin/runc
bin/docker-compose
bin/docker-init
bin/docker-proxy
bin/auplink
bin/containerd
bin/dockerd
bin/docker
dockerd.json
Step 5 from 9: Extracting target Docker binary (/tmp/docker_update/docker-19.03.13.tgz)
docker/
docker/ctr
docker/runc
docker/containerd-shim
docker/docker-init
docker/docker-proxy
docker/docker
docker/dockerd
docker/containerd
Step 6 from 9: Installing binaries
Step 7 from 9: Configuring log driver
Step 8 from 9: Starting Docker service

pkgctl-Docker started.
Step 9 from 9: Cleaning the temp folder
Done.

then I try to run my portainer container with:
docker start portainer
and I get:
Error response from daemon: failed to initialize logging driver: failed to get logging factory: logger: no log driver named 'db' is registered: error looking up logging plugin db: plugin "db" not found Error: failed to start containers: portainer

Anything else I should look for ?

Rui

rui-nar · 2020-11-14T22:19:22Z

and maybe this helps as well:

Rui@DiskStation:~/synology-docker$ more /var/packages/Docker/etc/dockerd.json 
{
    "data-root" : "/var/packages/Docker/target/docker",
    "log-driver" : "json-file",
    "registry-mirrors" : [],
    "group": "administrators"
}`

CardcaptorRLH85 · 2021-01-18T06:17:47Z

As a note, after clearing my issue in #48, I also ran into this problem. Here's my post-update dockerd.json.

{
    "data-root" : "/var/packages/Docker/target/docker",
    "log-driver" : "json-file",
    "registry-mirrors" : [],
    "group": "administrators"
}

ypkdani00 · 2021-03-06T11:58:16Z

Hello,

same problem as @rui-nar, i have ths error message:

Create container eclipse-mosquitto1 failed: {"message":"error looking up logging plugin db: plugin "db" not found"}.

i have this dockerd.json file:
{ "registry-mirrors": [], "data-root": "/var/packages/Docker/target/docker",\ "log-driver": "json-file",\ "group" : "administrator"\ }

someone have solve this problem? The hard drive on Docker is working is an ext4

qm3ster · 2021-11-28T23:43:25Z

What's wrong with db driver? What are the properties of it?
Why do we then prefer json-file and not local?

markdumay · 2021-11-29T04:30:10Z

It seems db is a proprietary driver from Synology. It is not available with a default Docker installation. I have not tried local instead of json-file myself - care to try it and share your experience?

qm3ster · 2021-11-29T09:54:51Z

I'll probably be trying it now. Allegedly it's the same thing (with log rotation support and stuff) as json-file but with less overhead than a json encoding.
The reason I am thinking of deviating from db is it seems to completely give up after a certain amount of spam. A running docker logs -f just stops yielding lines, the UI keeps only displaying logs up until that moment, and new docker --log-level=debug logs <container> just sit there, regardless of any --since or -f, not yielding any preexisting or new lines.
(My spammy container is eclipse/mosquitto with log_type all, but I do need those logs. Maybe I'll move its logs to tmpfs idk. Ideally, I need to process those logs and not store them.)

qm3ster · 2021-11-29T13:23:15Z

It seems that local works fine.
"No logs available." in the UI, but copes with the spam.
Fun side effect: in docker logs -t the db driver gave timestamp prefixes like
2021-11-28T20:32:08.859717886Z (RFC3339Nano Z, two spaces) while local gives
2021-11-29T16:22:01.465997093+03:00 (RFC3339Nano Local, one space)

markdumay added the bug Something isn't working label Jun 11, 2020

markdumay self-assigned this Jun 11, 2020

markdumay mentioned this issue Jun 11, 2020

Verify default logging driver on Synology #1

Closed

markdumay mentioned this issue Jun 12, 2020

Logdriver #7

Merged

markdumay closed this as completed in #7 Jun 12, 2020

markdumay reopened this Aug 24, 2020

markdumay closed this as completed Sep 11, 2020

rui-nar mentioned this issue Nov 14, 2020

still issues with "db" logging #29

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

dockerd.json not updated #3

dockerd.json not updated #3

hirenshah commented Jun 11, 2020

markdumay commented Jun 11, 2020

hirenshah commented Jun 11, 2020 •

edited

Loading

markdumay commented Jun 11, 2020

hirenshah commented Jun 11, 2020

hirenshah commented Jun 11, 2020 •

edited

Loading

markdumay commented Jun 11, 2020

hirenshah commented Jun 11, 2020

hirenshah commented Jun 11, 2020

markdumay commented Jun 11, 2020

markdumay commented Jun 11, 2020 •

edited

Loading

hirenshah commented Jun 11, 2020

markdumay commented Jun 11, 2020

maxbec commented Aug 24, 2020

markdumay commented Aug 24, 2020 via email •

edited

Loading

maxbec commented Aug 25, 2020

markdumay commented Aug 25, 2020 via email

maxbec commented Aug 27, 2020

markdumay commented Aug 27, 2020 via email

rui-nar commented Nov 14, 2020 •

edited

Loading

rui-nar commented Nov 14, 2020 •

edited

Loading

CardcaptorRLH85 commented Jan 18, 2021

ypkdani00 commented Mar 6, 2021 •

edited

Loading

qm3ster commented Nov 28, 2021

markdumay commented Nov 29, 2021

qm3ster commented Nov 29, 2021

qm3ster commented Nov 29, 2021

dockerd.json not updated #3

dockerd.json not updated #3

Comments

hirenshah commented Jun 11, 2020

markdumay commented Jun 11, 2020

hirenshah commented Jun 11, 2020 • edited Loading

markdumay commented Jun 11, 2020

hirenshah commented Jun 11, 2020

hirenshah commented Jun 11, 2020 • edited Loading

markdumay commented Jun 11, 2020

hirenshah commented Jun 11, 2020

hirenshah commented Jun 11, 2020

markdumay commented Jun 11, 2020

markdumay commented Jun 11, 2020 • edited Loading

hirenshah commented Jun 11, 2020

markdumay commented Jun 11, 2020

maxbec commented Aug 24, 2020

markdumay commented Aug 24, 2020 via email • edited Loading

maxbec commented Aug 25, 2020

markdumay commented Aug 25, 2020 via email

maxbec commented Aug 27, 2020

markdumay commented Aug 27, 2020 via email

rui-nar commented Nov 14, 2020 • edited Loading

rui-nar commented Nov 14, 2020 • edited Loading

CardcaptorRLH85 commented Jan 18, 2021

ypkdani00 commented Mar 6, 2021 • edited Loading

qm3ster commented Nov 28, 2021

markdumay commented Nov 29, 2021

qm3ster commented Nov 29, 2021

qm3ster commented Nov 29, 2021

hirenshah commented Jun 11, 2020 •

edited

Loading

hirenshah commented Jun 11, 2020 •

edited

Loading

markdumay commented Jun 11, 2020 •

edited

Loading

markdumay commented Aug 24, 2020 via email •

edited

Loading

rui-nar commented Nov 14, 2020 •

edited

Loading

rui-nar commented Nov 14, 2020 •

edited

Loading

ypkdani00 commented Mar 6, 2021 •

edited

Loading