Completly remove netdata from ALL nodes

Andy_Wismer · May 30, 2024, 2:11pm

NethServer Version: NS8
Module: Netdata

Hi

Netdata is not working on a 2-Node NS8 install.
Everything else is working (so far).

I tried to uninstall netdata from node one, it fails.
Netdata is still there, unchanged.
I can clone that netdata to node 2, that works, netdata works.
I can clone netdata on node 2 (netdata2) back to node 1, which gives me netdata 3 on node 1, also working.
But I still can’t remove netdata1 on node1.

I would like to remove netdata completly. Maybe reinstall afterwards.

Web GUI did not work, so I thought CLI might work, but no:

remove-module --no-preserve netdata1
Assertion failed
  File "/var/lib/nethserver/cluster/actions/remove-module/50update", line 66, in <module>
    agent.assert_exp(destroy_module_result['exit_code'] == 0)

So what are my options now?

I would like to completly remove netdata from ALL nodes.

My 2 cents
Andy

davidep · May 30, 2024, 4:55pm

There’s a --force option, but you must ensure that files under /etc/systemd are removed: it’s a rootful module. For example

find /etc/systemd | grep netdata1

Also search in logs why the destroy failed.

Andy_Wismer · May 30, 2024, 5:29pm

Hi @davidep

I tried removing with the --force option.
No luck. The command, run by root on the Debian VM brought the same error.

The App netdata1 on node 1 is still shown under instances.

I did run the command

find /etc/systemd | grep netdata1

and was able to remove that with a rm.

Here are the logs:

2024-05-29T02:28:38+02:00 [1:netdata1:agent@netdata1] Signal "user defined signal 1" caught: shutdown started.
2024-05-29T02:28:39+02:00 [1:netdata1:agent@netdata1] redis: 2024/05/29 02:28:39 pubsub.go:159: redis: discarding bad PubSub connection: EOF
2024-05-30T15:39:13+02:00 [1:netdata1:agent@netdata1] task/module/netdata1/8650fe40-71dc-4e25-90d9-33d3eb05b36d: destroy-module/20remove_http_route is starting
2024-05-30T15:39:14+02:00 [1:netdata1:agent@netdata1] _acontrol_task request attempt failed (WS reached EOF while waiting for module/traefik1/task/8a917c2e-e70a-4b5f-946f-fde1360a89ed). Retrying...
2024-05-30T15:39:18+02:00 [1:netdata1:agent@netdata1] task/module/netdata1/8650fe40-71dc-4e25-90d9-33d3eb05b36d: destroy-module/30remove_service is starting
2024-05-30T15:39:18+02:00 [1:netdata1:agent@netdata1] Failed to disable unit: Unit file netdata1.service does not exist.
2024-05-30T15:39:18+02:00 [1:netdata1:agent@netdata1] task/module/netdata1/8650fe40-71dc-4e25-90d9-33d3eb05b36d: action "destroy-module" status is "aborted" (1) at step 30remove_service
2024-05-30T15:39:42+02:00 [1:netdata1:agent@netdata1] task/module/netdata1/50935d50-65d5-4ef3-be44-8ffed02bbe7a: destroy-module/20remove_http_route is starting
2024-05-30T15:39:43+02:00 [1:netdata1:agent@netdata1] task/module/netdata1/50935d50-65d5-4ef3-be44-8ffed02bbe7a: destroy-module/30remove_service is starting
2024-05-30T15:39:43+02:00 [1:netdata1:agent@netdata1] Failed to disable unit: Unit file netdata1.service does not exist.
2024-05-30T15:39:43+02:00 [1:netdata1:agent@netdata1] task/module/netdata1/50935d50-65d5-4ef3-be44-8ffed02bbe7a: action "destroy-module" status is "aborted" (1) at step 30remove_service
2024-05-30T15:40:03+02:00 [1:netdata1:agent@netdata1] task/module/netdata1/1aba1e2e-8bbe-4050-a699-5ecdb6286fbb: list-volumes/20list_volumes is starting
2024-05-30T15:40:03+02:00 [1:netdata1:agent@netdata1] task/module/netdata1/1aba1e2e-8bbe-4050-a699-5ecdb6286fbb: action "list-volumes" status is "completed" (0) at step validate-output.json
2024-05-30T15:40:49+02:00 [1:netdata1:agent@netdata1] task/module/netdata1/6a2e9cff-c008-4464-bd85-12cb46456008: transfer-state/01set_weight is starting
2024-05-30T15:40:49+02:00 [1:netdata1:agent@netdata1] task/module/netdata1/6a2e9cff-c008-4464-bd85-12cb46456008: transfer-state/02pullrsync is starting
2024-05-30T15:40:49+02:00 [1:netdata1:agent@netdata1] podman-pull-missing ghcr.io/nethserver/rsync:2.8.1-dev.5
2024-05-30T15:40:49+02:00 [1:netdata1:agent@netdata1] task/module/netdata1/6a2e9cff-c008-4464-bd85-12cb46456008: transfer-state/05waitserver is starting
2024-05-30T15:40:50+02:00 [1:netdata1:agent@netdata1] Dialling 10.98.33.3:20011...
2024-05-30T15:40:50+02:00 [1:netdata1:agent@netdata1] [Errno 111] Connection refused
2024-05-30T15:40:55+02:00 [1:netdata1:agent@netdata1] Connection with 10.98.33.3:20011 established: the server is ready.
2024-05-30T15:40:55+02:00 [1:netdata1:agent@netdata1] task/module/netdata1/6a2e9cff-c008-4464-bd85-12cb46456008: transfer-state/10sendpayload is starting
2024-05-30T15:40:55+02:00 [1:netdata1:agent@netdata1] cp -v environment environment.clone-module
2024-05-30T15:40:55+02:00 [1:netdata1:agent@netdata1] 'environment' -> 'environment.clone-module'
2024-05-30T15:40:55+02:00 [1:netdata1:agent@netdata1] podman run -i --workdir=/srv --rm --network=host --privileged --name=transfer-state-payload --env=RSYNC_PASSWORD --volume=/var/lib/nethserver/netdata1/state:/srv/state ghcr.io/nethserver/rsync:2.8.1-dev.5 rsync -a --info=progress2 --exclude=/state/agent.env --exclude=/state/environment --exclude=/state/apitoken.cache ./ rsync://netdata1@10.98.33.3:20011/data/
2024-05-30T15:40:55+02:00 [1:netdata1:podman] 2024-05-30 15:40:55.378971385 +0200 CEST m=+0.020936434 image pull  ghcr.io/nethserver/rsync:2.8.1-dev.5
2024-05-30T15:40:55+02:00 [1:netdata1:podman]
2024-05-30T15:40:55+02:00 [1:netdata1:podman] 2024-05-30 15:40:55.659356716 +0200 CEST m=+0.301321837 container create f3bc0d63ba2c24aa91e5d03427fdb0f37f7a295f2190f2e11f18f2cf0b0163fd (image=ghcr.io/nethserver/rsync:2.8.1-dev.5, name=transfer-state-payload, io.buildah.version=1.23.1)
2024-05-30T15:40:55+02:00 [1:netdata1:podman] 2024-05-30 15:40:55.845882387 +0200 CEST m=+0.487847429 container init f3bc0d63ba2c24aa91e5d03427fdb0f37f7a295f2190f2e11f18f2cf0b0163fd (image=ghcr.io/nethserver/rsync:2.8.1-dev.5, name=transfer-state-payload, io.buildah.version=1.23.1)
2024-05-30T15:40:55+02:00 [1:netdata1:podman] 2024-05-30 15:40:55.90325978 +0200 CEST m=+0.545224823 container start f3bc0d63ba2c24aa91e5d03427fdb0f37f7a295f2190f2e11f18f2cf0b0163fd (image=ghcr.io/nethserver/rsync:2.8.1-dev.5, name=transfer-state-payload, io.buildah.version=1.23.1)
2024-05-30T15:40:55+02:00 [1:netdata1:podman] 2024-05-30 15:40:55.90352256 +0200 CEST m=+0.545487621 container attach f3bc0d63ba2c24aa91e5d03427fdb0f37f7a295f2190f2e11f18f2cf0b0163fd (image=ghcr.io/nethserver/rsync:2.8.1-dev.5, name=transfer-state-payload, io.buildah.version=1.23.1)
2024-05-30T15:40:56+02:00 [1:netdata1:transfer-state-payload] 
            530 100%    0.00kB/s    0:00:00  
            530 100%    0.00kB/s    0:00:00 (xfr#1, to-chk=0/3)
            530 100%    0.00kB/s    0:00:00 (xfr#1, to-chk=0/3)
            530 100%    0.00kB/s    0:00:00 (xfr#1, to-chk=0/3)
2024-05-30T15:40:56+02:00 [1:netdata1:podman] 2024-05-30 15:40:56.073688106 +0200 CEST m=+0.715653151 container died f3bc0d63ba2c24aa91e5d03427fdb0f37f7a295f2190f2e11f18f2cf0b0163fd (image=ghcr.io/nethserver/rsync:2.8.1-dev.5, name=transfer-state-payload, io.buildah.version=1.23.1)
2024-05-30T15:40:56+02:00 [1:netdata1:podman] 2024-05-30 15:40:56.857688424 +0200 CEST m=+0.761590788 container remove f3bc0d63ba2c24aa91e5d03427fdb0f37f7a295f2190f2e11f18f2cf0b0163fd (image=ghcr.io/nethserver/rsync:2.8.1-dev.5, name=transfer-state-payload, io.buildah.version=1.23.1)
2024-05-30T15:40:56+02:00 [1:netdata1:agent@netdata1] task/module/netdata1/6a2e9cff-c008-4464-bd85-12cb46456008: transfer-state/50sendstate is starting
2024-05-30T15:40:57+02:00 [1:netdata1:agent@netdata1] podman run -i --workdir=/srv --rm --network=host --privileged --name=transfer-state-send --env=RSYNC_PASSWORD --volume=/var/lib/nethserver/netdata1/state:/srv/state ghcr.io/nethserver/rsync:2.8.1-dev.5 rsync -a --info=progress2 --delete-after --exclude=/state/agent.env --exclude=/state/environment --exclude=/state/apitoken.cache ./ rsync://netdata1@10.98.33.3:20011/data/
2024-05-30T15:40:57+02:00 [1:netdata1:podman] 2024-05-30 15:40:57.153643997 +0200 CEST m=+0.021803565 image pull  ghcr.io/nethserver/rsync:2.8.1-dev.5
2024-05-30T15:40:57+02:00 [1:netdata1:podman]
2024-05-30T15:40:57+02:00 [1:netdata1:podman] 2024-05-30 15:40:57.38996009 +0200 CEST m=+0.258119659 container create 67f9af5a6e854dbb14515af45154b07122c1f6fc977af643fb3f16cde9f8212a (image=ghcr.io/nethserver/rsync:2.8.1-dev.5, name=transfer-state-send, io.buildah.version=1.23.1)
2024-05-30T15:40:57+02:00 [1:netdata1:podman] 2024-05-30 15:40:57.563264754 +0200 CEST m=+0.431424308 container init 67f9af5a6e854dbb14515af45154b07122c1f6fc977af643fb3f16cde9f8212a (image=ghcr.io/nethserver/rsync:2.8.1-dev.5, name=transfer-state-send, io.buildah.version=1.23.1)
2024-05-30T15:40:57+02:00 [1:netdata1:transfer-state-send] 
              0   0%    0.00kB/s    0:00:00 (xfr#0, to-chk=0/3)
              0   0%    0.00kB/s    0:00:00 (xfr#0, to-chk=0/3)
              0   0%    0.00kB/s    0:00:00 (xfr#0, to-chk=0/3)cannot delete non-empty directory: volumes
2024-05-30T15:40:57+02:00 [1:netdata1:transfer-state-send]
2024-05-30T15:40:57+02:00 [1:netdata1:transfer-state-send] rsync: [generator] delete_file: rmdir(volumes/lib) failed: Resource busy (16)
2024-05-30T15:40:57+02:00 [1:netdata1:transfer-state-send] rsync: [generator] delete_file: rmdir(volumes/config) failed: Resource busy (16)
2024-05-30T15:40:57+02:00 [1:netdata1:transfer-state-send] rsync: [generator] delete_file: rmdir(volumes/cache) failed: Resource busy (16)
2024-05-30T15:40:57+02:00 [1:netdata1:transfer-state-send] rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1336) [sender=3.2.7]
2024-05-30T15:40:57+02:00 [1:netdata1:podman] 2024-05-30 15:40:57.635559856 +0200 CEST m=+0.503719428 container start 67f9af5a6e854dbb14515af45154b07122c1f6fc977af643fb3f16cde9f8212a (image=ghcr.io/nethserver/rsync:2.8.1-dev.5, name=transfer-state-send, io.buildah.version=1.23.1)
2024-05-30T15:40:57+02:00 [1:netdata1:podman] 2024-05-30 15:40:57.635744597 +0200 CEST m=+0.503904173 container attach 67f9af5a6e854dbb14515af45154b07122c1f6fc977af643fb3f16cde9f8212a (image=ghcr.io/nethserver/rsync:2.8.1-dev.5, name=transfer-state-send, io.buildah.version=1.23.1)
2024-05-30T15:40:57+02:00 [1:netdata1:agent@netdata1] rsync: [generator] delete_file: rmdir(volumes/cache) failed: Resource busy (16)
2024-05-30T15:40:57+02:00 [1:netdata1:agent@netdata1] rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1336) [sender=3.2.7]
2024-05-30T15:40:57+02:00 [1:netdata1:agent@netdata1] rsync: [generator] delete_file: rmdir(volumes/lib) failed: Resource busy (16)
2024-05-30T15:40:57+02:00 [1:netdata1:agent@netdata1] rsync: [generator] delete_file: rmdir(volumes/config) failed: Resource busy (16)
2024-05-30T15:40:57+02:00 [1:netdata1:podman] 2024-05-30 15:40:57.638054664 +0200 CEST m=+0.506214246 container died 67f9af5a6e854dbb14515af45154b07122c1f6fc977af643fb3f16cde9f8212a (image=ghcr.io/nethserver/rsync:2.8.1-dev.5, name=transfer-state-send, io.buildah.version=1.23.1)
2024-05-30T15:40:58+02:00 [1:netdata1:podman] 2024-05-30 15:40:58.332022668 +0200 CEST m=+0.676531449 container remove 67f9af5a6e854dbb14515af45154b07122c1f6fc977af643fb3f16cde9f8212a (image=ghcr.io/nethserver/rsync:2.8.1-dev.5, name=transfer-state-send, io.buildah.version=1.23.1)
2024-05-30T15:40:58+02:00 [1:netdata1:agent@netdata1] podman run -i --workdir=/srv --rm --network=host --privileged --name=transfer-state-send --env=RSYNC_PASSWORD ghcr.io/nethserver/rsync:2.8.1-dev.5 rsync -q rsync://netdata1@10.98.33.3:20011/terminate
2024-05-30T15:40:58+02:00 [1:netdata1:agent@netdata1] [ERROR] rsync transfer error 23
2024-05-30T15:40:58+02:00 [1:netdata1:podman] 2024-05-30 15:40:58.366661437 +0200 CEST m=+0.024129921 image pull  ghcr.io/nethserver/rsync:2.8.1-dev.5
2024-05-30T15:40:58+02:00 [1:netdata1:podman]
2024-05-30T15:40:58+02:00 [1:netdata1:podman] 2024-05-30 15:40:58.549775076 +0200 CEST m=+0.207243657 container create 6f30a3538a8a40f5ff5730d2c15102339d4b1e484e153886e727c78451c9bfbb (image=ghcr.io/nethserver/rsync:2.8.1-dev.5, name=transfer-state-send, io.buildah.version=1.23.1)
2024-05-30T15:40:58+02:00 [1:netdata1:podman] 2024-05-30 15:40:58.747887379 +0200 CEST m=+0.405355852 container init 6f30a3538a8a40f5ff5730d2c15102339d4b1e484e153886e727c78451c9bfbb (image=ghcr.io/nethserver/rsync:2.8.1-dev.5, name=transfer-state-send, io.buildah.version=1.23.1)
2024-05-30T15:40:58+02:00 [1:netdata1:podman] 2024-05-30 15:40:58.832110757 +0200 CEST m=+0.489579229 container start 6f30a3538a8a40f5ff5730d2c15102339d4b1e484e153886e727c78451c9bfbb (image=ghcr.io/nethserver/rsync:2.8.1-dev.5, name=transfer-state-send, io.buildah.version=1.23.1)
2024-05-30T15:40:58+02:00 [1:netdata1:podman] 2024-05-30 15:40:58.832295761 +0200 CEST m=+0.489764242 container attach 6f30a3538a8a40f5ff5730d2c15102339d4b1e484e153886e727c78451c9bfbb (image=ghcr.io/nethserver/rsync:2.8.1-dev.5, name=transfer-state-send, io.buildah.version=1.23.1)
2024-05-30T15:40:58+02:00 [1:netdata1:podman] 2024-05-30 15:40:58.903983143 +0200 CEST m=+0.561451619 container died 6f30a3538a8a40f5ff5730d2c15102339d4b1e484e153886e727c78451c9bfbb (image=ghcr.io/nethserver/rsync:2.8.1-dev.5, name=transfer-state-send, io.buildah.version=1.23.1)
2024-05-30T15:40:59+02:00 [1:netdata1:podman] 2024-05-30 15:40:59.659363725 +0200 CEST m=+0.750498199 container remove 6f30a3538a8a40f5ff5730d2c15102339d4b1e484e153886e727c78451c9bfbb (image=ghcr.io/nethserver/rsync:2.8.1-dev.5, name=transfer-state-send, io.buildah.version=1.23.1)
2024-05-30T15:40:59+02:00 [1:netdata1:agent@netdata1] task/module/netdata1/6a2e9cff-c008-4464-bd85-12cb46456008: action "transfer-state" status is "aborted" (1) at step 50sendstate
2024-05-30T15:47:06+02:00 [1:netdata1:agent@netdata1] task/module/netdata1/2ef79a2c-d919-4ed6-a9bc-606c14d8789e: destroy-module/20remove_http_route is starting
2024-05-30T15:47:07+02:00 [1:netdata1:agent@netdata1] task/module/netdata1/2ef79a2c-d919-4ed6-a9bc-606c14d8789e: destroy-module/30remove_service is starting
2024-05-30T15:47:07+02:00 [1:netdata1:agent@netdata1] Failed to disable unit: Unit file netdata1.service does not exist.
2024-05-30T15:47:07+02:00 [1:netdata1:agent@netdata1] task/module/netdata1/2ef79a2c-d919-4ed6-a9bc-606c14d8789e: action "destroy-module" status is "aborted" (1) at step 30remove_service
2024-05-30T15:50:52+02:00 [1:netdata1:agent@netdata1] task/module/netdata1/d555e472-03b7-4319-97d2-47c30c6c372e: destroy-module/20remove_http_route is starting
2024-05-30T15:50:52+02:00 [1:netdata1:agent@netdata1] task/module/netdata1/d555e472-03b7-4319-97d2-47c30c6c372e: destroy-module/30remove_service is starting
2024-05-30T15:50:52+02:00 [1:netdata1:agent@netdata1] Failed to disable unit: Unit file netdata1.service does not exist.
2024-05-30T15:50:52+02:00 [1:netdata1:agent@netdata1] task/module/netdata1/d555e472-03b7-4319-97d2-47c30c6c372e: action "destroy-module" status is "aborted" (1) at step 30remove_service
2024-05-30T15:53:37+02:00 [1:netdata1:agent@netdata1] task/module/netdata1/7effcaed-0179-4578-861e-c9a831232021: destroy-module/20remove_http_route is starting
2024-05-30T15:53:37+02:00 [1:netdata1:agent@netdata1] task/module/netdata1/7effcaed-0179-4578-861e-c9a831232021: destroy-module/30remove_service is starting
2024-05-30T15:53:37+02:00 [1:netdata1:agent@netdata1] Failed to disable unit: Unit file netdata1.service does not exist.
2024-05-30T15:53:37+02:00 [1:netdata1:agent@netdata1] task/module/netdata1/7effcaed-0179-4578-861e-c9a831232021: action "destroy-module" status is "aborted" (1) at step 30remove_service
2024-05-30T15:54:46+02:00 [1:netdata1:agent@netdata1] task/module/netdata1/d393b711-9927-47ba-b87c-7221a218684b: destroy-module/20remove_http_route is starting
2024-05-30T15:54:47+02:00 [1:netdata1:agent@netdata1] task/module/netdata1/d393b711-9927-47ba-b87c-7221a218684b: destroy-module/30remove_service is starting
2024-05-30T15:54:47+02:00 [1:netdata1:agent@netdata1] Failed to disable unit: Unit file netdata1.service does not exist.
2024-05-30T15:54:47+02:00 [1:netdata1:agent@netdata1] task/module/netdata1/d393b711-9927-47ba-b87c-7221a218684b: action "destroy-module" status is "aborted" (1) at step 30remove_service
2024-05-30T18:05:13+02:00 [1:netdata1:agent@netdata1] task/module/netdata1/0871738f-77d4-43eb-958a-e682ce61c3ea: destroy-module/20remove_http_route is starting
2024-05-30T18:05:14+02:00 [1:netdata1:agent@netdata1] task/module/netdata1/0871738f-77d4-43eb-958a-e682ce61c3ea: destroy-module/30remove_service is starting
2024-05-30T18:05:14+02:00 [1:netdata1:agent@netdata1] Failed to disable unit: Unit file netdata1.service does not exist.
2024-05-30T18:05:14+02:00 [1:netdata1:agent@netdata1] task/module/netdata1/0871738f-77d4-43eb-958a-e682ce61c3ea: action "destroy-module" status is "aborted" (1) at step 30remove_service
2024-05-30T18:58:31+02:00 [1:netdata1:agent@netdata1] task/module/netdata1/598464d7-07bf-4504-af24-b83094bde5aa: destroy-module/20remove_http_route is starting
2024-05-30T18:58:32+02:00 [1:netdata1:agent@netdata1] task/module/netdata1/598464d7-07bf-4504-af24-b83094bde5aa: destroy-module/30remove_service is starting
2024-05-30T18:58:32+02:00 [1:netdata1:agent@netdata1] Failed to disable unit: Unit file netdata1.service does not exist.
2024-05-30T18:58:32+02:00 [1:netdata1:agent@netdata1] task/module/netdata1/598464d7-07bf-4504-af24-b83094bde5aa: action "destroy-module" status is "aborted" (1) at step 30remove_service

I don’t quite understand what exactly barfed, even after reading the logs…

The other 2 instances seem to be running.

My 2 cents
Andy

davidep · May 30, 2024, 5:54pm

Lookup this file under /var/lib/nethserver/netdata1.

github.com

NethServer/ns8-netdata/blob/main/imageroot/actions/destroy-module/30remove_service

#!/bin/bash

#
# Copyright (C) 2024 Nethesis S.r.l.
# SPDX-License-Identifier: GPL-3.0-or-later
#

exec 1>&2 # Send any output to stderr, to not alter the action response protocol
set -e

#
# We must stop and clean up what we installed in the "create-module" action
#
systemctl disable --now "${MODULE_ID}.service"
rm -vf "/etc/systemd/system/${MODULE_ID}.service"
systemctl daemon-reload

# Clean up volumes
podman volume rm --force "${MODULE_ID}-cache" "${MODULE_ID}-config" "${MODULE_ID}-data" || :

Do a chmod 644 to disable it, then rerun the remove-module --force …

Clean up residual volumes

 podman volume ls | grep netdata1

Andy_Wismer · May 30, 2024, 5:57pm

I don’t find any such file:

ls -la /var/lib/nethserver/netdata1/
insgesamt 8
drwxr-xr-x 1 root root  112 20. Mai 02:19 .
drwxr-xr-x 1 root root   76 30. Mai 19:35 ..
drwxr-xr-x 1 root root   88 17. Apr 18:07 actions
-rw-r--r-- 1 root root  510 20. Mai 02:19 .imageroot.lst
-rw-r--r-- 1 root root 1746 17. Apr 18:07 netdata.service
drwx------ 1 root root  116 30. Mai 15:40 state
drwxr-xr-x 1 root root   18 17. Apr 18:07 update-module.d

Found it in a subfolder…

ls -la /var/lib/nethserver/netdata1/actions/destroy-module/
insgesamt 8
drwxr-xr-x 1 root root  70 17. Apr 18:07 .
drwxr-xr-x 1 root root  88 17. Apr 18:07 ..
-rwxr-xr-x 1 root root 643 17. Apr 18:07 20remove_http_route
-rw-r--r-- 1 root root 502 17. Apr 18:07 30remove_service

And bingo, it worked:

netdata1 is gone from the node.

Can I safely remove the folder /var/lib/nethserver/netdata1/ including all contained elements / subfolders?

davidep · May 30, 2024, 6:33pm

Yes, and don’t forget to check also rootful Podman volumes, as said before.

Andy_Wismer · May 30, 2024, 6:39pm

OK, seems to have worked…

podman volume ls                
DRIVER      VOLUME NAME
local       crowdsec1-data
local       promtail-position
local       rclone-webdav
local       redis-data

Thanks

My 2 cents
Andy

Andy_Wismer · May 30, 2024, 7:03pm

@davidep

I have another one.

This is a NS8 before the last steps of a migration. I think Croudsec is blocking, but I can’t see the app showing anything - it looks good.

However: I can’t remove the App, neither via Software Center / Croudsec / Instances → three dots / Uninstall - The Button is greyed out…

Nor from the console:

remove-module --force croudsec1
<3>Cannot retrieve the NODE_ID of croudsec1

Any ideas here?

NS7 is showing this:

echo '{"app":"account-provider","action":"sync"}' | /usr/bin/setsid /usr/bin/sudo /usr/libexec/nethserver/api/nethserver-ns8-migration/migration/update | jq
{
  "progress": "0.00",
  "time": "0.0",
  "exit": 0,
  "event": "migration-sync",
  "state": "running",
  "step": 0,
  "pid": 0,
  "action": ""
}
rsync: failed to connect to 10.98.237.1 (10.98.237.1): Connection refused (111)
rsync error: error in socket IO (code 10) at clientserver.c(126) [sender=3.1.2]
/usr/sbin/ns8-check-import: line 47: /usr/share/nethesis/nethserver-ns8-migration/apps/account-provider/bind.env: No such file or directory
{
  "pid": 0,
  "status": "failed",
  "event": "migration-sync"
}
{
  "id": "1717094572",
  "type": "ApiFailed",
  "message": "sync account-provider failed"
}

As I read it: rsync is not available on NS8.

As you can see, NS7 is in the last sync / finish migration process. Yesterday it worked without issues…

Any ideas?

My 2 cents
Andy

davidep · May 30, 2024, 7:12pm

It’s just a typo: crowdsec1

Andy_Wismer · May 30, 2024, 7:40pm

@davidep

Thanks for seeing that! (Pollen issues at the moment).

Croudsec is removed, NS8 rebooted.

Now to see if NS7 will connect…

Andy_Wismer · May 30, 2024, 7:42pm

Not good, still getting this on NS7:

[root@wpd-nethserver ~]# echo '{"app":"account-provider","action":"sync"}' | /usr/bin/setsid /usr/bin/sudo /usr/libexec/nethserver/api/nethserver-ns8-migration/migration/update | jq
{
  "progress": "0.00",
  "time": "0.0",
  "exit": 0,
  "event": "migration-sync",
  "state": "running",
  "step": 0,
  "pid": 0,
  "action": ""
}
rsync: failed to connect to 10.98.237.1 (10.98.237.1): Connection refused (111)
rsync error: error in socket IO (code 10) at clientserver.c(126) [sender=3.1.2]
/usr/sbin/ns8-check-import: line 47: /usr/share/nethesis/nethserver-ns8-migration/apps/account-provider/bind.env: No such file or directory
{
  "pid": 0,
  "status": "failed",
  "event": "migration-sync"
}
{
  "id": "1717098078",
  "type": "ApiFailed",
  "message": "sync account-provider failed"
}
[root@wpd-nethserver ~]#

davidep · May 30, 2024, 7:48pm

Andy we’re going off topic here!

Andy_Wismer · May 30, 2024, 7:49pm

Migrate to a new Post?

The other one is solved…