Problems with AD users and groups - Nethserver 8

[jorgef (Jorge Forte)]

Good day,

In NetServer 8, it’s not possible to list Active Directory users and groups. It produces the following error. How can this be resolved?
Regards

         Jorge Forte

Traceback (most recent call last):File “/var/lib/nethserver/cluster/actions/list-domain-users/50list_users”, line 33, in users = Ldapclient.factory(**domain).list_users(extra_info=True)^^^^^^^^^^^^^^^^^^^^^^^^^^^^File “/usr/local/agent/pypkg/agent/ldapclient/init.py”, line 29, in factoryreturn LdapclientAd(**kwargs)^^^^^^^^^^^^^^^^^^^^^^File “/usr/local/agent/pypkg/agent/ldapclient/base.py”, line 37, in initself.ldapconn = ldap3.Connection(self.ldapsrv,^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^File “/usr/local/agent/pyenv/lib64/python3.11/site-packages/ldap3/core/connection.py”, line 363, in initself._do_auto_bind()File “/usr/local/agent/pyenv/lib64/python3.11/site-packages/ldap3/core/connection.py”, line 387, in _do_auto_bindself.open(read_server_info=False)File “/usr/local/agent/pyenv/lib64/python3.11/site-packages/ldap3/strategy/sync.py”, line 57, in openBaseStrategy.open(self, reset_usage, read_server_info)File “/usr/local/agent/pyenv/lib64/python3.11/site-packages/ldap3/strategy/base.py”, line 146, in openraise exception_history[0][0]ldap3.core.exceptions.LDAPSocketOpenError: socket connection error while opening: [Errno 111] Connection refused

[mrmarkuz (Markus Neuberger)]

@jorgef

[Errno 111] Connection refused

Could it be that the Windows firewall is blocking?
Can you ping the Windows server from the NS8?

[jorgef (Jorge Forte)]

I didn’t explain myself well, we’re using a local Samba Active Directory as account provider module
on the Nethserver

[mrmarkuz (Markus Neuberger)]

Sorry I thought it’s an external AD…

Is the samba-dc container running? (you may need to adapt samba1 to your samba instance name when using the following commands)

runagent -m samba1 podman ps

Please try to restart it:

runagent -m samba1 systemctl --user restart samba-dc

[jorgef (Jorge Forte)]

I did it, but the problem continues

[mrmarkuz (Markus Neuberger)]

Let’s try to list the users from CLI:

runagent -m samba1 podman exec samba-dc samba-tool user list

[jorgef (Jorge Forte)]

The user list is correct

[mrmarkuz (Markus Neuberger)]

Is the ldapproxy running?

runagent -m ldapproxy1 podman ps

Are the samba sockets there?

ss | grep samba

[jorgef (Jorge Forte)]

[mrmarkuz (Markus Neuberger)]

There seems to be an issue with the ldapproxy.

Please try to restart it and recheck if it’s running:

runagent -m ldapproxy1 systemctl --user restart ldapproxy
runagent -m ldapproxy1 podman ps

If it’s not running please check the logs for errors.

EDIT:

Is it a fresh installation of NS8 or did it work before?

[jorgef (Jorge Forte)]

It was working properly for more than 4 months
Where are the logs located?

[mrmarkuz (Markus Neuberger)]

@jorgef

Where are the logs located?

On the system logs page, see System logs — NS8 documentation
You can specify the ldapproxy1 app to just get the logs of ldapproxy.

On CLI for all logs:

journalctl

Just ldapproxy:

journalctl _UID=$(id -u ldapproxy1)

Is maybe the disk full?

df -h

[jorgef (Jorge Forte)]

The containers.json file is corrupted, that’s why the LDAP proxy isn’t working, how do I fix it?

[mrmarkuz (Markus Neuberger)]

You can move away the containers.json file, it gets recreated when you restart the ldapproxy service.

[jorgef (Jorge Forte)]

No, it does not regenerate the file.

file “/home/ldapproxy1/.local/share/containers/storage/overlay-containers/containers.json”
/home/ldapproxy1/.local/share/containers/storage/overlay-containers/containers.json: cannot open `/home/ldapproxy1/.local/share/containers/storage/overlay-containers/containers.json’ (No such file or directory)

[root@servidor1 ~]# runagent -m ldapproxy1 systemctl --user restart ldapproxy
Job for ldapproxy.service failed because the control process exited with error code.
See “systemctl --user status ldapproxy.service” and “journalctl --user -xeu ldapproxy.service” for details.
[root@servidor1 ~]# runagent -m ldapproxy1 systemctl --user status ldapproxy.service
× ldapproxy.service - ldapproxy1 LDAP account provider local proxy
Loaded: loaded (/home/ldapproxy1/.config/systemd/user/ldapproxy.service; enabled; preset: disabled)
Active: failed (Result: exit-code) since Fri 2025-11-07 11:33:45 -03; 17s ago
Docs: man:podman-generate-systemd(1)
Process: 4642 ExecStartPre=/bin/rm -f /run/user/1001/ldapproxy.pid /run/user/1001/ldapproxy.ctr-id (code=exited, status=>
Process: 4643 ExecStartPre=/usr/local/bin/runagent update-conf (code=exited, status=0/SUCCESS)
Process: 4650 ExecStart=/usr/bin/podman run --detach --env=NGINX_ENTRYPOINT_QUIET_LOGS=1 --conmon-pidfile=/run/user/1001>
Process: 4658 ExecStopPost=/usr/bin/podman rm --ignore -f --cidfile /run/user/1001/ldapproxy.ctr-id (code=exited, status>
CPU: 527ms

[mrmarkuz (Markus Neuberger)]

Here it worked so I think there’s another reason why ldapproxy isn’t starting.

Today an update for ldapproxy was released, you could try to update it and check if it fixes the issue.

Did you check the disk space?

@mrmarkuz

Is maybe the disk full?

df -h

[jorgef (Jorge Forte)]

No, there’s plenty of free space.

[mrmarkuz (Markus Neuberger)]

Did you try if the update fixes the issue?

[jorgef (Jorge Forte)]

No, the update fails with this error. I have several Nethserver installations where the core cannot be updated.

{“context”:{“action”:“update-core”,“data”:{“nodes”:[1]},“extra”:{“description”:“Procesando”,“eventId”:“d5ed47b8-ec99-49ca-ab18-a875e089154f”,“title”:“Actualizar núcleo”},“id”:“1b062291-ea53-4ee1-924f-f9685551a246”,“parent”:“”,“queue”:“cluster/tasks”,“timestamp”:“2025-11-14T18:31:04.442796752Z”,“user”:“admin”},“status”:“aborted”,“progress”:61,“subTasks”:[{“context”:{“action”:“list-actions”,“data”:{},“extra”:{},“id”:“c069a197-d52a-4baa-b902-58635a939bb6”,“parent”:“1b062291-ea53-4ee1-924f-f9685551a246”},“status”:“completed”,“progress”:100,“subTasks”:,“result”:{“error”:“”,“exit_code”:0,“file”:“task/node/1/c069a197-d52a-4baa-b902-58635a939bb6”,“output”:[“start-support-session”,“update-os”,“add-public-service”,“deallocate-ports”,“get-facts”,“get-info”,“get-support-session”,“remove-custom-zone”,“remove-module”,“set-fqdn”,“remove-public-service”,“remove-tun”,“restart-module”,“stop-support-session”,“update-core”,“validate-leader-fqdn”,“add-module”,“add-tun”,“get-fqdn”,“add-custom-zone”,“allocate-ports”,“get-firewall-status”,“get-name”,“get-node-status”,“set-name”,“list-actions”,“cancel-task”]}},{“context”:{“action”:“update-core”,“data”:{“core_url”:“ghcr.io/nethserver/core:3.13.1",“force”:false},“extra”:{},“id”:“11cd5d81-27ea-47fd-932b-16fc4b5c8de2”,“parent”:“1b062291-ea53-4ee1-924f-f9685551a246”},“status”:“completed”,“progress”:100,“subTasks”:[],“result”:{“error”:"The new core image does not update the current one. Nothing to do.\nRunning /var/lib/nethserver/node/update-core.d/05set_agentenv_path…\nRunning /var/lib/nethserver/node/update-core.d/10reload_agents…\nRunning /var/lib/nethserver/node/update-core.d/10upgrade_ports…\nRunning /var/lib/nethserver/node/update-core.d/20restart_apiserver…\nRunning /var/lib/nethserver/node/update-core.d/20restart_webdav…\nRunning /var/lib/nethserver/node/update-core.d/30restart_redis…\nRunning /var/lib/nethserver/node/update-core.d/30restart_subscription…\nRunning /var/lib/nethserver/node/update-core.d/50python_updates…\nInstalling Python virtual environment deps from /etc/nethserver/pyreq3_11.txt\nRequirement already satisfied: aiodns==3.5.0 in /usr/local/agent/pyenv/lib64/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 5)) (3.5.0)\nRequirement already satisfied: aiohttp==3.12.15 in /usr/local/agent/pyenv/lib64/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 6)) (3.12.15)\nRequirement already satisfied: ansible-core==2.19.1 in /usr/local/agent/pyenv/lib64/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 7)) (2.19.1)\nRequirement already satisfied: ansible-runner==2.4.1 in /usr/local/agent/pyenv/lib64/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 8)) (2.4.1)\nRequirement already satisfied: async-timeout==5.0.1 in /usr/local/agent/pyenv/lib64/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 9)) (5.0.1)\nRequirement already satisfied: attrs==25.3.0 in /usr/local/agent/pyenv/lib64/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 10)) (25.3.0)\nRequirement already satisfied: brotlipy==0.7.0 in /usr/local/agent/pyenv/lib64/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 11)) (0.7.0)\nRequirement already satisfied: certifi==2025.8.3 in /usr/local/agent/pyenv/lib64/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 12)) (2025.8.3)\nRequirement already satisfied: cffi==1.17.1 in /usr/local/agent/pyenv/lib64/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 13)) (1.17.1)\nRequirement already satisfied: chardet==5.2.0 in /usr/local/agent/pyenv/lib64/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 14)) (5.2.0)\nRequirement already satisfied: cryptography==45.0.7 in /usr/local/agent/pyenv/lib64/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 15)) (45.0.7)\nRequirement already satisfied: dnspython==2.7.0 in /usr/local/agent/pyenv/lib64/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 16)) (2.7.0)\nRequirement already satisfied: docutils==0.22 in /usr/local/agent/pyenv/lib64/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 17)) (0.22)\nRequirement already satisfied: hiredis==3.2.1 in /usr/local/agent/pyenv/lib64/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 18)) (3.2.1)\nRequirement already satisfied: idna==3.10 in /usr/local/agent/pyenv/lib64/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 19)) (3.10)\nRequirement already satisfied: Jinja2==3.1.6 in /usr/local/agent/pyenv/lib64/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 20)) (3.1.6)\nRequirement already satisfied: jsonschema==4.25.1 in /usr/local/agent/pyenv/lib64/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 21)) (4.25.1)\nRequirement already satisfied: ldap3==2.9.1 in /usr/local/agent/pyenv/lib64/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 22)) (2.9.1)\nRequirement already satisfied: lockfile==0.12.2 in /usr/local/agent/pyenv/lib64/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 23)) (0.12.2)\nRequirement already satisfied: MarkupSafe==3.0.2 in /usr/local/agent/pyenv/lib64/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 24)) (3.0.2)\nRequirement already satisfied: multidict==6.6.4 in /usr/local/agent/pyenv/lib64/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 25)) (6.6.4)\nRequirement already satisfied: packaging==25.0 in /usr/local/agent/pyenv/lib64/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 26)) (25.0)\nRequirement already satisfied: pexpect==4.9.0 in /usr/local/agent/pyenv/lib64/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 27)) (4.9.0)\nRequirement already satisfied: psutil==7.0.0 in /usr/local/agent/pyenv/lib64/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 28)) (7.0.0)\nRequirement already satisfied: ptyprocess==0.7.0 in /usr/local/agent/pyenv/lib64/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 29)) (0.7.0)\nRequirement already satisfied: pyasn1==0.6.1 in /usr/local/agent/pyenv/lib64/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 30)) (0.6.1)\nRequirement already satisfied: pycares==4.10.0 in /usr/local/agent/pyenv/lib64/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 31)) (4.10.0)\nRequirement already satisfied: pycparser==2.22 in /usr/local/agent/pyenv/lib64/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 32)) (2.22)\nRequirement already satisfied: pyrsistent==0.20.0 in /usr/local/agent/pyenv/lib64/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 33)) (0.20.0)\nRequirement already satisfied: python-daemon==3.1.2 in /usr/local/agent/pyenv/lib64/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 34)) (3.1.2)\nRequirement already satisfied: PyYAML==6.0.2 in /usr/local/agent/pyenv/lib64/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 35)) (6.0.2)\nRequirement already satisfied: redis==6.4.0 in /usr/local/agent/pyenv/lib64/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 36)) (6.4.0)\nRequirement already satisfied: regex-engine==1.1.0 in /usr/local/agent/pyenv/lib64/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 37)) (1.1.0)\nRequirement already satisfied: requests==2.32.5 in /usr/local/agent/pyenv/lib64/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 38)) (2.32.5)\nRequirement already satisfied: resolvelib==1.2.0 in /usr/local/agent/pyenv/lib64/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 39)) (1.2.0)\nRequirement already satisfied: semver==3.0.4 in /usr/local/agent/pyenv/lib64/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 40)) (3.0.4)\nRequirement already satisfied: six==1.17.0 in /usr/local/agent/pyenv/lib64/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 41)) (1.17.0)\nRequirement already satisfied: typing-extensions==4.15.0 in /usr/local/agent/pyenv/lib64/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 42)) (4.15.0)\nRequirement already satisfied: urllib3==2.5.0 in /usr/local/agent/pyenv/lib64/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 43)) (2.5.0)\nRequirement already satisfied: yarl==1.20.1 in /usr/local/agent/pyenv/lib64/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 44)) (1.20.1)\nRequirement already satisfied: aiohappyeyeballs>=2.5.0 in /usr/local/agent/pyenv/lib64/python3.11/site-packages (from aiohttp==3.12.15->-r /etc/nethserver/pyreq3_11.txt (line 6)) (2.6.1)\nRequirement already satisfied: aiosignal>=1.4.0 in /usr/local/agent/pyenv/lib64/python3.11/site-packages (from aiohttp==3.12.15->-r /etc/nethserver/pyreq3_11.txt (line 6)) (1.4.0)\nRequirement already satisfied: frozenlist>=1.1.1 in /usr/local/agent/pyenv/lib64/python3.11/site-packages (from aiohttp==3.12.15->-r /etc/nethserver/pyreq3_11.txt (line 6)) (1.7.0)\nRequirement already satisfied: propcache>=0.2.0 in /usr/local/agent/pyenv/lib64/python3.11/site-packages (from aiohttp==3.12.15->-r /etc/nethserver/pyreq3_11.txt (line 6)) (0.4.1)\nRequirement already satisfied: jsonschema-specifications>=2023.03.6 in /usr/local/agent/pyenv/lib64/python3.11/site-packages (from jsonschema==4.25.1->-r /etc/nethserver/pyreq3_11.txt (line 21)) (2025.9.1)\nRequirement already satisfied: referencing>=0.28.4 in /usr/local/agent/pyenv/lib64/python3.11/site-packages (from jsonschema==4.25.1->-r /etc/nethserver/pyreq3_11.txt (line 21)) (0.37.0)\nRequirement already satisfied: rpds-py>=0.7.1 in /usr/local/agent/pyenv/lib64/python3.11/site-packages (from jsonschema==4.25.1->-r /etc/nethserver/pyreq3_11.txt (line 21)) (0.28.0)\nRequirement already satisfied: charset_normalizer<4,>=2 in /usr/local/agent/pyenv/lib64/python3.11/site-packages (from requests==2.32.5->-r /etc/nethserver/pyreq3_11.txt (line 38)) (3.4.2)\n\n[notice] A new release of pip is available: 25.1.1 → 25.3\n[notice] To update, run: pip install --upgrade pip\nRunning /var/lib/nethserver/node/update-core.d/50start_node_exporter…\nRunning /var/lib/nethserver/node/update-core.d/50start_promtail…\nRunning /var/lib/nethserver/node/update-core.d/50update_grants…\nRunning /var/lib/nethserver/node/update-core.d/80node_monitor…\nRunning /var/lib/nethserver/node/update-core.d/95cleanup_images…\njq: error (at :1): split input and separator must be strings\nError: no such object: “aaa8fd8439427ccc46a304b98e4292ffd14eed3d75d8f2b45fea7a382529babe”\nRunning /var/lib/nethserver/node/update-core.d/96cleanup_restic_images…\nError: loading primary layer store data: loading “/home/loki1/.local/share/containers/storage/overlay-layers/layers.json”: *storage.Layer: decode slice: expect [ or n, but found \u0000, error found in #1 byte of …|\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000|…, bigger context …|\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000|…\nError: loading primary layer store data: loading “/home/ldapproxy1/.local/share/containers/storage/overlay-layers/layers.json”: *storage.Layer: decode slice: expect [ or n, but found \u0000, error found in #1 byte of …|\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000|…, bigger context …|\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000|…\nError: configure storage: loading “/home/metrics1/.local/share/containers/storage/overlay-containers/containers.json”: *storage.Container: decode slice: expect [ or n, but found \u0000, error found in #1 byte of …|\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000|…, bigger context …|\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000|…\n”,“exit_code”:0,“file”:“task/node/1/11cd5d81-27ea-47fd-932b-16fc4b5c8de2”,“output”:“”}},{“context”:{“action”:“update-module”,“data”:{“force”:false,“instances”:[“ldapproxy1”],“module_url”:“ghcr.io/nethserver/ldapproxy:1.2.0"},“extra”:{},“id”:“73b7b571-72c0-4a31-953e-340a308c6ce7”,“parent”:“1b062291-ea53-4ee1-924f-f9685551a246”},“status”:“aborted”,“progress”:42,“subTasks”:[{“context”:{“action”:“list-actions”,“data”:{},“extra”:{},“id”:“a83b58a1-f8cc-4fb5-8152-0f5ccdac4f65”,“parent”:“73b7b571-72c0-4a31-953e-340a308c6ce7”},“status”:“completed”,“progress”:100,“subTasks”:[],“result”:{“error”:“”,“exit_code”:0,“file”:“task/module/ldapproxy1/a83b58a1-f8cc-4fb5-8152-0f5ccdac4f65”,“output”:[“clone-module”,“configure-backup”,“create-module”,“list-service-providers”,“list-volumes”,“get-name”,“get-status”,“list-backup-repositories”,“transfer-state”,“update-module”,“destroy-module”,“import-module”,“restore-module”,“run-backup”,“set-name”,“list-actions”,“cancel-task”]}},{“context”:{“action”:“update-module”,“data”:{“force”:false,“module_url”:“ghcr.io/nethserver/ldapproxy:1.2.0”},“extra”:{},“id”:“51f39971-3574-42c0-bbe6-776aca230eea”,“parent”:“73b7b571-72c0-4a31-953e-340a308c6ce7”},“status”:“aborted”,“progress”:18,“subTasks”:[],“result”:{“error”:"<7>podman-pull-missing Package ldapproxy · GitHub\nError: loading primary layer store data: loading “/home/ldapproxy1/.local/share/containers/storage/overlay-layers/layers.json”: *storage.Layer: decode slice: expect [ or n, but found \u0000, error found in #1 byte of …|\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000|…, bigger context …|\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000|…\nTrying to pull ghcr.io/nethserver/ldapproxy:1.2.0…\nGetting image source signatures\nCopying blob sha256:33a8972ed9dc993c38027bf65875393802dd7e322922e7d408bf4f64fb133847\nError: trying to reuse blob sha256:33a8972ed9dc993c38027bf65875393802dd7e322922e7d408bf4f64fb133847 at destination: looking for layers with digest “sha256:33a8972ed9dc993c38027bf65875393802dd7e322922e7d408bf4f64fb133847”: loading primary layer store data: loading “/home/ldapproxy1/.local/share/containers/storage/overlay-layers/layers.json”: *storage.Layer: decode slice: expect [ or n, but found \u0000, error found in #1 byte of …|\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000|…, bigger context …|\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000|…\nTraceback (most recent call last):\n File “/usr/local/agent/bin/podman-pull-missing”, line 35, in \n subprocess.run([‘podman’, ‘pull’, image_url]).check_returncode()\n File “/usr/lib64/python3.11/subprocess.py”, line 502, in check_returncode\n raise CalledProcessError(self.returncode, self.args, self.stdout,\nsubprocess.CalledProcessError: Command '[‘podman’, ‘pull’, 'ghcr.io/nethserver/ldapproxy:1.2.0’]’ returned non-zero exit status 125.\nTraceback (most recent call last):\n File “/usr/local/agent/actions/update-module/05pullimages”, line 48, in \n ).check_returncode()\n ^^^^^^^^^^^^^^^^^^\n File “/usr/lib64/python3.11/subprocess.py”, line 502, in check_returncode\n raise CalledProcessError(self.returncode, self.args, self.stdout,\nsubprocess.CalledProcessError: Command '(‘podman-pull-missing’, 'ghcr.io/nethserver/ldapproxy:1.2.0’)’ returned non-zero exit status 1.\n”,“exit_code”:1,“file”:“task/module/ldapproxy1/51f39971-3574-42c0-bbe6-776aca230eea”,“output”:“”}}],“result”:{“error”:“<7>podman-pull-missing Package ldapproxy · GitHub\n<3>Module instance “ldapproxy1” update failed with code 1\nAssertion failed\n File “/var/lib/nethserver/cluster/actions/update-module/50update”, line 158, in \n agent.assert_exp(errors == 0)\n”,“exit_code”:2,“file”:“task/cluster/73b7b571-72c0-4a31-953e-340a308c6ce7”,“output”:“”}},{“context”:{“action”:“update-module”,“data”:{“force”:false,“instances”:[“metrics1”],“module_url”:“ghcr.io/nethserver/metrics:1.2.0"},“extra”:{},“id”:“90d4e261-0e49-463d-af48-db1bab07dc85”,“parent”:“1b062291-ea53-4ee1-924f-f9685551a246”},“status”:“aborted”,“progress”:42,“subTasks”:[{“context”:{“action”:“list-actions”,“data”:{},“extra”:{},“id”:“c40d4724-c38a-4c20-92fa-6d0df6b3f432”,“parent”:“90d4e261-0e49-463d-af48-db1bab07dc85”},“status”:“completed”,“progress”:100,“subTasks”:[],“result”:{“error”:“”,“exit_code”:0,“file”:“task/module/metrics1/c40d4724-c38a-4c20-92fa-6d0df6b3f432”,“output”:[“configure-module”,“restore-configuration”,“clone-module”,“configure-backup”,“destroy-module”,“get-status”,“set-name”,“restore-module”,“run-backup”,“transfer-state”,“update-module”,“get-configuration”,“create-module”,“get-name”,“import-module”,“list-backup-repositories”,“list-volumes”,“list-service-providers”,“list-actions”,“cancel-task”]}},{“context”:{“action”:“update-module”,“data”:{“force”:false,“module_url”:“ghcr.io/nethserver/metrics:1.2.0”},“extra”:{},“id”:“d8776d01-4802-488d-86ec-0c01814e4d32”,“parent”:“90d4e261-0e49-463d-af48-db1bab07dc85”},“status”:“aborted”,“progress”:18,“subTasks”:[],“result”:{“error”:"<7>podman-pull-missing Package metrics · GitHub\nError: configure storage: loading “/home/metrics1/.local/share/containers/storage/overlay-containers/containers.json”: *storage.Container: decode slice: expect [ or n, but found \u0000, error found in #1 byte of …|\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000|…, bigger context …|\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000|…\nError: configure storage: loading “/home/metrics1/.local/share/containers/storage/overlay-containers/containers.json”: *storage.Container: decode slice: expect [ or n, but found \u0000, error found in #1 byte of …|\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000|…, bigger context …|\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000|…\nTraceback (most recent call last):\n File “/usr/local/agent/bin/podman-pull-missing”, line 35, in \n subprocess.run([‘podman’, ‘pull’, image_url]).check_returncode()\n File “/usr/lib64/python3.11/subprocess.py”, line 502, in check_returncode\n raise CalledProcessError(self.returncode, self.args, self.stdout,\nsubprocess.CalledProcessError: Command '[‘podman’, ‘pull’, 'ghcr.io/nethserver/metrics:1.2.0’]’ returned non-zero exit status 125.\nTraceback (most recent call last):\n File “/usr/local/agent/actions/update-module/05pullimages”, line 48, in \n ).check_returncode()\n ^^^^^^^^^^^^^^^^^^\n File “/usr/lib64/python3.11/subprocess.py”, line 502, in check_returncode\n raise CalledProcessError(self.returncode, self.args, self.stdout,\nsubprocess.CalledProcessError: Command '(‘podman-pull-missing’, 'ghcr.io/nethserver/metrics:1.2.0’)’ returned non-zero exit status 1.\n”,“exit_code”:1,“file”:“task/module/metrics1/d8776d01-4802-488d-86ec-0c01814e4d32”,“output”:“”}}],“result”:{“error”:“<7>podman-pull-missing Package metrics · GitHub\n<3>Module instance “metrics1” update failed with code 1\nAssertion failed\n File “/var/lib/nethserver/cluster/actions/update-module/50update”, line 158, in \n agent.assert_exp(errors == 0)\n”,“exit_code”:2,“file”:“task/cluster/90d4e261-0e49-463d-af48-db1bab07dc85”,“output”:“”}},{“context”:{“action”:“update-module”,“data”:{“force”:false,“instances”:[“loki1”],“module_url”:“ghcr.io/nethserver/loki:1.3.2"},“extra”:{},“id”:“45dfc16c-fa3d-4974-b03a-daa9e5de1efc”,“parent”:“1b062291-ea53-4ee1-924f-f9685551a246”},“status”:“aborted”,“progress”:42,“subTasks”:[{“context”:{“action”:“list-actions”,“data”:{},“extra”:{},“id”:“67f4fb49-3915-469b-8d93-407e6a0d1c85”,“parent”:“45dfc16c-fa3d-4974-b03a-daa9e5de1efc”},“status”:“completed”,“progress”:100,“subTasks”:[],“result”:{“error”:“”,“exit_code”:0,“file”:“task/module/loki1/67f4fb49-3915-469b-8d93-407e6a0d1c85”,“output”:[“destroy-module”,“get-status”,“list-backup-repositories”,“restore-module”,“transfer-state”,“get-facts”,“clone-module”,“create-module”,“get-name”,“import-module”,“list-volumes”,“get-configuration”,“set-syslog-forwarder”,“list-service-providers”,“run-backup”,“set-name”,“update-module”,“configure-backup”,“configure-module”,“set-clm-forwarder”,“list-actions”,“cancel-task”]}},{“context”:{“action”:“update-module”,“data”:{“force”:false,“module_url”:“ghcr.io/nethserver/loki:1.3.2”},“extra”:{},“id”:“28da4e4f-3425-494d-acf1-c71c1beb3ac2”,“parent”:“45dfc16c-fa3d-4974-b03a-daa9e5de1efc”},“status”:“aborted”,“progress”:18,“subTasks”:[],“result”:{“error”:"<7>podman-pull-missing Package loki · GitHub\nError: loading primary layer store data: loading “/home/loki1/.local/share/containers/storage/overlay-layers/layers.json”: *storage.Layer: decode slice: expect [ or n, but found \u0000, error found in #1 byte of …|\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000|…, bigger context …|\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000|…\nTrying to pull ghcr.io/nethserver/loki:1.3.2…\nGetting image source signatures\nCopying blob sha256:6713cdb2e07055b3d6fac16f950f98540de2706673df7045f2cccad2d60ac90f\nError: trying to reuse blob sha256:6713cdb2e07055b3d6fac16f950f98540de2706673df7045f2cccad2d60ac90f at destination: looking for layers with digest “sha256:6713cdb2e07055b3d6fac16f950f98540de2706673df7045f2cccad2d60ac90f”: loading primary layer store data: loading “/home/loki1/.local/share/containers/storage/overlay-layers/layers.json”: *storage.Layer: decode slice: expect [ or n, but found \u0000, error found in #1 byte of …|\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000|…, bigger context …|\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000\u0000|…\nTraceback (most recent call last):\n File “/usr/local/agent/bin/podman-pull-missing”, line 35, in \n subprocess.run([‘podman’, ‘pull’, image_url]).check_returncode()\n File “/usr/lib64/python3.11/subprocess.py”, line 502, in check_returncode\n raise CalledProcessError(self.returncode, self.args, self.stdout,\nsubprocess.CalledProcessError: Command '[‘podman’, ‘pull’, 'ghcr.io/nethserver/loki:1.3.2’]’ returned non-zero exit status 125.\nTraceback (most recent call last):\n File “/usr/local/agent/actions/update-module/05pullimages”, line 48, in \n ).check_returncode()\n ^^^^^^^^^^^^^^^^^^\n File “/usr/lib64/python3.11/subprocess.py”, line 502, in check_returncode\n raise CalledProcessError(self.returncode, self.args, self.stdout,\nsubprocess.CalledProcessError: Command '(‘podman-pull-missing’, 'ghcr.io/nethserver/loki:1.3.2’)’ returned non-zero exit status 1.\n”,“exit_code”:1,“file”:“task/module/loki1/28da4e4f-3425-494d-acf1-c71c1beb3ac2”,“output”:“”}}],“result”:{“error”:“<7>podman-pull-missing Package loki · GitHub\n<3>Module instance “loki1” update failed with code 1\nAssertion failed\n File “/var/lib/nethserver/cluster/actions/update-module/50update”, line 158, in \n agent.assert_exp(errors == 0)\n”,“exit_code”:2,“file”:“task/cluster/45dfc16c-fa3d-4974-b03a-daa9e5de1efc”,“output”:“”}}],“validated”:true,“result”:{“error”:“_acontrol_task request attempt failed (Error 111 connecting to cluster-leader:6379. Connect call failed (‘127.0.0.1’, 6379).). Retrying…\n_acontrol_task request recovered successfully at attempt 2\n<7>run-scriptdir /var/lib/nethserver/cluster/update-core-pre-modules.d/\nRunning /var/lib/nethserver/cluster/update-core-pre-modules.d/50update_grants…\nTask cluster/update-module run failed: {‘output’: ‘’, ‘error’: ‘<7>podman-pull-missing Package ldapproxy · GitHub\n<3>Module instance “ldapproxy1” update failed with code 1\nAssertion failed\n File “/var/lib/nethserver/cluster/actions/update-module/50update”, line 158, in \n agent.assert_exp(errors == 0)\n’, ‘exit_code’: 2}\nTask cluster/update-module run failed: {‘output’: ‘’, ‘error’: ‘<7>podman-pull-missing Package loki · GitHub\n<3>Module instance “loki1” update failed with code 1\nAssertion failed\n File “/var/lib/nethserver/cluster/actions/update-module/50update”, line 158, in \n agent.assert_exp(errors == 0)\n’, ‘exit_code’: 2}\nTask cluster/update-module run failed: {‘output’: ‘’, ‘error’: ‘<7>podman-pull-missing Package metrics · GitHub\n<3>Module instance “metrics1” update failed with code 1\nAssertion failed\n File “/var/lib/nethserver/cluster/actions/update-module/50update”, line 158, in \n agent.assert_exp(errors == 0)\n’, ‘exit_code’: 2}\n<7>run-scriptdir /var/lib/nethserver/cluster/update-core-post-modules.d/\nRunning /var/lib/nethserver/cluster/update-core-post-modules.d/70domain_notification…\nRunning /var/lib/nethserver/cluster/update-core-post-modules.d/70metrics…\nRunning /var/lib/nethserver/cluster/update-core-post-modules.d/90disable_testing…\nupdate-core failed in some core modules\n File “/var/lib/nethserver/cluster/actions/update-core/70update_modules”, line 48, in \n agent.assert_exp(update_module_errors == 0, ‘update-core failed in some core modules’)\n”,“exit_code”:2,“file”:“task/cluster/1b062291-ea53-4ee1-924f-f9685551a246”,“output”:“”}}

[mrmarkuz (Markus Neuberger)]

@jorgef

No, the update fails with this error. I have several Nethserver installations where the core cannot be updated.

I cannot reproduce or find anything about those errors in the forum…

Which Linux distro is used?
Which filesystem is used?
Are you using some network storage like NFS?