Updating Traefik 2.2.3 -> 2.2.5 gives error

Support
1

NethServer Version: NS8 core 2.9.5
Module: Traefik

Goodday to all,

While updating core, with Traefik updating from version 2.2.3 to 2.2.5 an error appeared and the update was not succeeding. The core update to 2.9.4 and just now 2.9.5 went well, as far as I can see.

I rebooted the server (you never know) and tried again but no succes.

I gather that this is the problem: podman-pull-missing ghcr.io/nethserver/traefik:2.2.5 What can I do to solve this?

_acontrol_task request attempt failed (Connection closed by server.). Retrying...
_acontrol_task request attempt failed (Connection closed by server.). Retrying...
_acontrol_task request recovered successfully at attempt 2
_acontrol_task request recovered successfully at attempt 2
<7>run-scriptdir /var/lib/nethserver/cluster/update-core-pre-modules.d/
Running /var/lib/nethserver/cluster/update-core-pre-modules.d/50update_grants...
Task cluster/update-module run failed: {'output': '', 'error': '<7>podman-pull-missing ghcr.io/nethserver/traefik:2.2.5\n<3>Module instance "traefik1" update failed with code 1\nAssertion failed\n  File "/var/lib/nethserver/cluster/actions/update-module/50update", line 141, in <module>\n    agent.assert_exp(errors == 0)\n', 'exit_code': 2}
<7>run-scriptdir /var/lib/nethserver/cluster/update-core-post-modules.d/
update-core failed in some core modules
  File "/var/lib/nethserver/cluster/actions/update-core/70update_modules", line 57, in <module>
    agent.assert_exp(update_module_errors == 0, 'update-core failed in some core modules')
2

To gather more information, please go to the Logs page and select the app traefik1. You can refine the search to the time interval around the update.

3

Goodmorning Davide, thanks for responding.

This is the relevant abstract of the Traefik1 log, I see some chown errors:

2024-09-27T10:47:58+02:00 [1:traefik1:agent@traefik1] task/module/traefik1/38ffd8d4-eb02-4aed-bf7e-2c1a34873582: update-module/05pullimages is starting
2024-09-27T10:47:58+02:00 [1:traefik1:agent@traefik1] podman-pull-missing ghcr.io/nethserver/traefik:2.2.5
2024-09-27T10:47:58+02:00 [1:traefik1:agent@traefik1] podman-pull-missing docker.io/traefik:v2.11.5
2024-09-27T10:47:59+02:00 [1:traefik1:agent@traefik1] Trying to pull docker.io/library/traefik:v2.11.5...
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] Getting image source signatures
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] Copying blob sha256:ac997659cb617a0d21f2f57e709bf8ac22649fd15a3636c0d1cfd785495478df
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] Copying blob sha256:8168e2be9d205d7f8b76990ad5a6d495782753c0a87dd78d23354d85a5429be1
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] Copying blob sha256:ec99f8b99825a742d50fb3ce173d291378a46ab54b8ef7dd75e5654e2a296e99
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] Copying blob sha256:dd96e192718f89b7fb933ba0ea5d44233e4241c88f28a540aae672e6702b0626
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] Copying config sha256:16d3db58883574ac724b41c966bbb976c762f4395fcdadbf49aadb72a314401a
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] Writing manifest to image destination
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] 16d3db58883574ac724b41c966bbb976c762f4395fcdadbf49aadb72a314401a
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] extract-image ghcr.io/nethserver/traefik:2.2.5
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] '.imageroot.lst' -> '.imageroot.lst~'
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] Extracting container filesystem imageroot to /home/traefik1/.config
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] Total bytes read: 143360 (140KiB, 4.3MiB/s)
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/actions/create-module/20certificate
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/actions/create-module/30grants
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/actions/create-module/50create
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/actions/create-module/51waitsync
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/actions/delete-certificate/
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/actions/delete-certificate/20writeconfig
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/actions/delete-certificate/21waitsync
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/actions/delete-certificate/validate-input.json
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/actions/delete-certificate/validate-output.json
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/actions/delete-route/
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/actions/get-route/validate-output.json
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/actions/delete-route/21sync_hosts
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/actions/delete-route/29waitsync
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/actions/create-module/10expandconfig
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/actions/set-certificate/20writeconfig
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/actions/set-certificate/
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/actions/set-acme-server/validate-input.json
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/actions/set-acme-server/30restart_service
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/actions/set-acme-server/30expandconfig
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/actions/set-acme-server/20writeconfig
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/actions/set-acme-server/
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/actions/list-routes/validate-output.json
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/actions/list-routes/validate-input.json
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/actions/list-routes/20readconfig
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/actions/create-module/05set_env
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/actions/list-certificates/validate-output.json
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/actions/list-certificates/validate-input.json
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/actions/list-certificates/20readconfig
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/actions/delete-route/validate-input.json
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/actions/create-module/
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/actions/dump-custom-config/
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/actions/dump-custom-config/20readconfig
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/actions/get-acme-server/
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/actions/get-acme-server/20readconfig
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/actions/get-acme-server/validate-output.json
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/actions/get-certificate/
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/actions/get-certificate/20readconfig
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/actions/get-certificate/validate-input.json
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/actions/
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/actions/list-certificates/
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/actions/get-certificate/validate-output.json
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/actions/get-route/
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/actions/get-route/20readconfig
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/actions/get-route/validate-input.json
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/actions/delete-route/20file
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/actions/list-routes/
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/update-module.d/30upgrade_to_beta2
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/update-module.d/20restart
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/update-module.d/11dir_structure
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/update-module.d/10grants
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/update-module.d/
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/systemd/user/traefik.service
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/systemd/user/certificate-exporter.service
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/systemd/user/certificate-exporter.path
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/systemd/user/
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/systemd/
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/pypkg/get_certificate.py
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/pypkg/custom_certificate_manager.py
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/pypkg/
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/bin/write-hosts
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/actions/set-certificate/21waitsync
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/actions/set-certificate/validate-input.json
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/actions/set-certificate/validate-output.json
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/actions/set-route/
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/actions/set-route/10validate_headers_name
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/actions/set-route/11validate_host
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/actions/set-route/20writeconfig
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/actions/set-route/21sync_hosts
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/actions/set-route/29waitsync
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/actions/set-route/validate-input.json
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/actions/upload-certificate/
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/bin/redis2yml
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/actions/upload-certificate/20decode_upload
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/actions/upload-certificate/21validate_certificates
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/actions/upload-certificate/22save_certificates
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/actions/upload-certificate/23export_certificates
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/actions/upload-certificate/validate-input.json
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/bin/
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/bin/export-certificate
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/bin/module-cleanup-state
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] imageroot/pypkg/get_route.py
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] chown: changing ownership of './systemd/user/default.target.wants/traefik.service': Operation not permitted
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] chown: changing ownership of './systemd/user/default.target.wants/agent.service': Operation not permitted
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] chown: changing ownership of './systemd/user/transfer-state.target.wants/agent.service': Operation not permitted
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] a956bba5d24b5213540836f0c92cca5ff0c9aa286696f59443bc553a99487dde
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] Traceback (most recent call last):
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1]   File "/usr/local/agent/actions/update-module/05pullimages", line 81, in <module>
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1]     ).check_returncode()
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1]       ^^^^^^^^^^^^^^^^^^
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1]   File "/usr/lib64/python3.11/subprocess.py", line 502, in check_returncode
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1]     raise CalledProcessError(self.returncode, self.args, self.stdout,
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] subprocess.CalledProcessError: Command '('extract-image', 'ghcr.io/nethserver/traefik:2.2.5')' returned non-zero exit status 1.
2024-09-27T10:48:00+02:00 [1:traefik1:agent@traefik1] task/module/traefik1/38ffd8d4-eb02-4aed-bf7e-2c1a34873582: action "update-module" status is "aborted" (1) at step 05pullimages
4

Did you ever manually changed its permissions?

Try to run this command, then update again

chown -c -R traefik1:traefik1 ~traefik1/.config/systemd

Please attach here the command output.

5

I cannot recall whether I changed these permissions, and I cannot think of a reason to do that anyway. But the command resetted the permissions and I could perform the update now without any errors. Thank you for your help Davide!

[root@server2 ~]# chown -c -R traefik1:traefik1 ~traefik1/.config/systemd
changed ownership of '/home/traefik1/.config/systemd/user/default.target.wants/agent.service' from root:root to traefik1:traefik1
changed ownership of '/home/traefik1/.config/systemd/user/default.target.wants/traefik.service' from root:root to traefik1:traefik1
changed ownership of '/home/traefik1/.config/systemd/user/transfer-state.target.wants/agent.service' from root:root to traefik1:traefik1
1 Like