NS7 -> NS8 Migration stuck at last step

Support
1

NethServer Version: NethServer 7.9.2009 / NS8

Module: NS8 migration

Hi

In the last steps of a migration from NS7 → NS8.

Both are VMs in a adequate Proxmox Hypervisor.

Proxmox Hypervisor:

Bildschirmfoto 2024-05-30 um 21.50.20
Bildschirmfoto 2024-05-30 um 21.50.202502×692 112 KB

Storage is all NVMEs, total 2 TB in ZFS mirror.

NS7 VM:

Bildschirmfoto 2024-05-30 um 21.47.28
Bildschirmfoto 2024-05-30 um 21.47.281724×862 154 KB

NS8 VM:

Bildschirmfoto 2024-05-30 um 22.01.43
Bildschirmfoto 2024-05-30 um 22.01.431684×836 151 KB

Both VMs freshly rebooted:

Bildschirmfoto 2024-05-30 um 22.05.57
Bildschirmfoto 2024-05-30 um 22.05.571920×961 54.5 KB

Bildschirmfoto 2024-05-30 um 22.06.06
Bildschirmfoto 2024-05-30 um 22.06.061920×952 50.1 KB

NS8 does see NS7 querying:

Bildschirmfoto 2024-05-30 um 22.06.20
Bildschirmfoto 2024-05-30 um 22.06.201920×962 60.8 KB

Clicking Sync on NS7 produces this error immediately:

Bildschirmfoto 2024-05-30 um 22.07.57
Bildschirmfoto 2024-05-30 um 22.07.571920×961 83.3 KB

[root@wpd-nethserver ~]# echo '{"app":"account-provider","action":"sync"}' | /usr/bin/setsid /usr/bin/sudo /usr/libexec/nethserver/api/nethserver-ns8-migration/migration/update | jq
{
  "progress": "0.00",
  "time": "0.0",
  "exit": 0,
  "event": "migration-sync",
  "state": "running",
  "step": 0,
  "pid": 0,
  "action": ""
}
rsync: failed to connect to 10.98.237.1 (10.98.237.1): Connection refused (111)
rsync error: error in socket IO (code 10) at clientserver.c(126) [sender=3.1.2]
/usr/sbin/ns8-check-import: line 47: /usr/share/nethesis/nethserver-ns8-migration/apps/account-provider/bind.env: No such file or directory
{
  "pid": 0,
  "status": "failed",
  "event": "migration-sync"
}
{
  "id": "1717098078",
  "type": "ApiFailed",
  "message": "sync account-provider failed"
}
[root@wpd-nethserver ~]#

Logs from NS8:

2024-05-30T22:04:48+02:00 [1:samba1:agent@samba1] task/module/samba1/14c206b6-a198-4427-a1eb-65ed06fc3581: get-defaults/50read is starting
2024-05-30T22:04:48+02:00 [1::redis] 1:M 30 May 2024 20:04:48.333 * 1 changes in 5 seconds. Saving...
2024-05-30T22:04:48+02:00 [1::redis] 1:M 30 May 2024 20:04:48.333 * Background saving started by pid 21
2024-05-30T22:04:48+02:00 [1::redis] 21:C 30 May 2024 20:04:48.379 * DB saved on disk
2024-05-30T22:04:48+02:00 [1::redis] 21:C 30 May 2024 20:04:48.379 * Fork CoW for RDB: current 0 MB, peak 0 MB, average 0 MB
2024-05-30T22:04:48+02:00 [1:traefik1:traefik] 192.168.237.220 - - [30/May/2024:20:04:48 +0000] "GET /cluster-admin/api/module/samba1/task/14c206b6-a198-4427-a1eb-65ed06fc3581/context HTTP/2.0" 200 300 "-" "-" 198 "ApiServer-https@file" "http://127.0.0.1:9311" 37ms
2024-05-30T22:04:48+02:00 [1:traefik1:traefik] 192.168.237.220 - - [30/May/2024:20:04:48 +0000] "GET /cluster-admin/api/module/samba1/task/14c206b6-a198-4427-a1eb-65ed06fc3581/context HTTP/2.0" 200 300 "-" "-" 197 "ApiServer-https@file" "http://127.0.0.1:9311" 74ms
2024-05-30T22:04:48+02:00 [1::redis] 1:M 30 May 2024 20:04:48.434 * Background saving terminated with success
2024-05-30T22:04:48+02:00 [1:samba1:agent@samba1] task/module/samba1/14c206b6-a198-4427-a1eb-65ed06fc3581: action "get-defaults" status is "completed" (0) at step validate-output.json
2024-05-30T22:04:48+02:00 [1:traefik1:traefik] 192.168.237.220 - - [30/May/2024:20:04:48 +0000] "GET /cluster-admin/api/module/samba1/task/14c206b6-a198-4427-a1eb-65ed06fc3581/context HTTP/2.0" 200 300 "-" "-" 199 "ApiServer-https@file" "http://127.0.0.1:9311" 21ms
2024-05-30T22:04:48+02:00 [1:traefik1:traefik] 192.168.237.220 - - [30/May/2024:20:04:48 +0000] "GET /cluster-admin/api/module/samba1/task/14c206b6-a198-4427-a1eb-65ed06fc3581/context HTTP/2.0" 200 300 "-" "-" 200 "ApiServer-https@file" "http://127.0.0.1:9311" 54ms
2024-05-30T22:04:48+02:00 [1:traefik1:traefik] 192.168.237.220 - - [30/May/2024:20:04:48 +0000] "GET /cluster-admin/api/module/samba1/task/14c206b6-a198-4427-a1eb-65ed06fc3581/status HTTP/2.0" 200 276 "-" "-" 201 "ApiServer-https@file" "http://127.0.0.1:9311" 21ms
2024-05-30T22:04:49+02:00 [1::agent@cluster] task/cluster/984bc8bc-7819-4df9-8125-2dd1c2623bde: list-user-domains/50read is starting
2024-05-30T22:04:49+02:00 [1:traefik1:traefik] 192.168.237.220 - - [30/May/2024:20:04:49 +0000] "GET /cluster-admin/api/cluster/task/984bc8bc-7819-4df9-8125-2dd1c2623bde/context HTTP/2.0" 200 285 "-" "-" 202 "ApiServer-https@file" "http://127.0.0.1:9311" 39ms
2024-05-30T22:04:49+02:00 [1:traefik1:traefik] 192.168.237.220 - - [30/May/2024:20:04:49 +0000] "GET /cluster-admin/api/cluster/task/984bc8bc-7819-4df9-8125-2dd1c2623bde/context HTTP/2.0" 200 285 "-" "-" 203 "ApiServer-https@file" "http://127.0.0.1:9311" 74ms
2024-05-30T22:04:49+02:00 [1::agent@cluster] task/cluster/984bc8bc-7819-4df9-8125-2dd1c2623bde: action "list-user-domains" status is "completed" (0) at step validate-output.json
2024-05-30T22:04:49+02:00 [1:traefik1:traefik] 192.168.237.220 - - [30/May/2024:20:04:49 +0000] "GET /cluster-admin/api/cluster/task/984bc8bc-7819-4df9-8125-2dd1c2623bde/context HTTP/2.0" 200 285 "-" "-" 204 "ApiServer-https@file" "http://127.0.0.1:9311" 20ms
2024-05-30T22:04:49+02:00 [1:traefik1:traefik] 192.168.237.220 - - [30/May/2024:20:04:49 +0000] "GET /cluster-admin/api/cluster/task/984bc8bc-7819-4df9-8125-2dd1c2623bde/context HTTP/2.0" 200 285 "-" "-" 205 "ApiServer-https@file" "http://127.0.0.1:9311" 39ms
2024-05-30T22:04:49+02:00 [1:traefik1:traefik] 192.168.237.220 - - [30/May/2024:20:04:49 +0000] "GET /cluster-admin/api/cluster/task/984bc8bc-7819-4df9-8125-2dd1c2623bde/status HTTP/2.0" 200 382 "-" "-" 206 "ApiServer-https@file" "http://127.0.0.1:9311" 21ms
2024-05-30T22:04:50+02:00 [1:mail1:rspamd] #34(controller) <k4k3se>; monitored; rspamd_monitored_propagate_error: servfail on resolving bl.score.senderscore.com, disable object
2024-05-30T22:04:50+02:00 [1:mail1:rspamd] #34(controller) <mohyk5>; cfg; rspamd_worker_monitored_on_change: broadcast monitored update for k4k3seyr7s6brg5nwxd8cuwfokax64x: dead
2024-05-30T22:04:50+02:00 [1:mail1:rspamd] #26(normal) <mohyk5>; cfg; rspamd_worker_monitored_handler: updated monitored status for k4k3seyr7s6brg5nwxd8cuwfokax64x: dead
2024-05-30T22:04:50+02:00 [1:mail1:rspamd] #29(normal) <mohyk5>; cfg; rspamd_worker_monitored_handler: updated monitored status for k4k3seyr7s6brg5nwxd8cuwfokax64x: dead
2024-05-30T22:04:50+02:00 [1:mail1:rspamd] #28(normal) <mohyk5>; cfg; rspamd_worker_monitored_handler: updated monitored status for k4k3seyr7s6brg5nwxd8cuwfokax64x: dead
2024-05-30T22:04:50+02:00 [1:mail1:rspamd] #27(normal) <mohyk5>; cfg; rspamd_worker_monitored_handler: updated monitored status for k4k3seyr7s6brg5nwxd8cuwfokax64x: dead
2024-05-30T22:04:54+02:00 [1::redis] 1:M 30 May 2024 20:04:54.060 * 1 changes in 5 seconds. Saving...
2024-05-30T22:04:54+02:00 [1::redis] 1:M 30 May 2024 20:04:54.061 * Background saving started by pid 22
2024-05-30T22:04:54+02:00 [1::redis] 22:C 30 May 2024 20:04:54.089 * DB saved on disk
2024-05-30T22:04:54+02:00 [1::redis] 22:C 30 May 2024 20:04:54.090 * Fork CoW for RDB: current 0 MB, peak 0 MB, average 0 MB
2024-05-30T22:04:54+02:00 [1::redis] 1:M 30 May 2024 20:04:54.161 * Background saving terminated with success
2024-05-30T22:05:00+02:00 [1:nextcloud1:nextcloud-app] crond: USER www-data pid  68 cmd php -f /var/www/html/cron.php
2024-05-30T22:06:55+02:00 [1:nextcloud1:nextcloud-redis] 1:M 30 May 2024 20:06:55.069 * 100 changes in 300 seconds. Saving...
2024-05-30T22:06:55+02:00 [1:nextcloud1:nextcloud-redis] 1:M 30 May 2024 20:06:55.070 * Background saving started by pid 11
2024-05-30T22:06:55+02:00 [1:nextcloud1:nextcloud-redis] 11:C 30 May 2024 20:06:55.084 * DB saved on disk
2024-05-30T22:06:55+02:00 [1:nextcloud1:nextcloud-redis] 11:C 30 May 2024 20:06:55.085 * RDB: 0 MB of memory used by copy-on-write
2024-05-30T22:06:55+02:00 [1:nextcloud1:nextcloud-redis] 1:M 30 May 2024 20:06:55.171 * Background saving terminated with success
2024-05-30T22:10:00+02:00 [1:nextcloud1:nextcloud-app] crond: USER www-data pid  69 cmd php -f /var/www/html/cron.php
2024-05-30T22:11:52+02:00 [1:traefik1:traefik] time="2024-05-30T20:11:52Z" level=warning msg="A new release has been found: 3.0.1. Please consider updating."
2024-05-30T22:12:20+02:00 [1:netdata1:netdata1] time=2024-05-30T22:12:20.812+02:00 comm=netdata source=health level=info tid=1601 thread=HEALTH msg_id=9ce0cb58ab8b44df82c4bf1ad9ee22de node=wpd-ns8 instance=cgroup_dc9dd75b3125.cpu_limit context=cgroup.cpu_limit code=0 alert_id=1716937144 alert_unique_id=1716939997 alert_event_id=2 alert_transition_id=5f7120a6a85d48dc80d6f084515326f3 alert_config=fa0dc3ccdd444d4e9182db205a15f477 alert=cgroup_10min_cpu_usage alert_class=Utilization alert_component=CPU alert_type=Cgroups alert_exec=/usr/libexec/netdata/plugins.d/alarm-notify.sh alert_recipient=silent alert_duration=600 alert_value=0.604186 alert_value_old=null alert_status=CLEAR alert_value_old=UNINITIALIZED alert_units=% alert_summary="Cgroup dc9dd75b3125 CPU utilization" alert_info="Cgroup dc9dd75b3125 average CPU utilization over the last 10 minutes" alert_notification_timestamp=2024-05-30T22:12:20+02:00 msg="ALERT 'cgroup_10min_cpu_usage' of instance 'cgroup_dc9dd75b3125.cpu_limit' on node 'wpd-ns8', transitioned from UNINITIALIZED to CLEAR"
2024-05-30T22:12:20+02:00 [1:netdata1:netdata1] time=2024-05-30T22:12:20.841+02:00 comm=netdata source=health level=info tid=1601 thread=HEALTH msg_id=9ce0cb58ab8b44df82c4bf1ad9ee22de node=wpd-ns8 instance=cgroup_6927e42bf3c4.cpu_limit context=cgroup.cpu_limit code=0 alert_id=1716937145 alert_unique_id=1716939998 alert_event_id=2 alert_transition_id=dfe56dcc228148a0bf11d7e53617217a alert_config=fa0dc3ccdd444d4e9182db205a15f477 alert=cgroup_10min_cpu_usage alert_class=Utilization alert_component=CPU alert_type=Cgroups alert_exec=/usr/libexec/netdata/plugins.d/alarm-notify.sh alert_recipient=silent alert_duration=600 alert_value=0.1145202 alert_value_old=null alert_status=CLEAR alert_value_old=UNINITIALIZED alert_units=% alert_summary="Cgroup 6927e42bf3c4 CPU utilization" alert_info="Cgroup 6927e42bf3c4 average CPU utilization over the last 10 minutes" alert_notification_timestamp=2024-05-30T22:12:20+02:00 msg="ALERT 'cgroup_10min_cpu_usage' of instance 'cgroup_6927e42bf3c4.cpu_limit' on node 'wpd-ns8', transitioned from UNINITIALIZED to CLEAR"
2024-05-30T22:12:20+02:00 [1:netdata1:netdata1] time=2024-05-30T22:12:20.841+02:00 comm=netdata source=health level=info tid=1601 thread=HEALTH msg_id=9ce0cb58ab8b44df82c4bf1ad9ee22de node=wpd-ns8 instance=cgroup_02adfce6c20d.cpu_limit context=cgroup.cpu_limit code=0 alert_id=1716937146 alert_unique_id=1716939999 alert_event_id=2 alert_transition_id=4eb6296bc12b4663a38367939733d50f alert_config=fa0dc3ccdd444d4e9182db205a15f477 alert=cgroup_10min_cpu_usage alert_class=Utilization alert_component=CPU alert_type=Cgroups alert_exec=/usr/libexec/netdata/plugins.d/alarm-notify.sh alert_recipient=silent alert_duration=600 alert_value=0.0006992 alert_value_old=null alert_status=CLEAR alert_value_old=UNINITIALIZED alert_units=% alert_summary="Cgroup 02adfce6c20d CPU utilization" alert_info="Cgroup 02adfce6c20d average CPU utilization over the last 10 minutes" alert_notification_timestamp=2024-05-30T22:12:20+02:00 msg="ALERT 'cgroup_10min_cpu_usage' of instance 'cgroup_02adfce6c20d.cpu_limit' on node 'wpd-ns8', transitioned from UNINITIALIZED to CLEAR"
2024-05-30T22:12:20+02:00 [1:netdata1:netdata1] time=2024-05-30T22:12:20.841+02:00 comm=netdata source=health level=info tid=1601 thread=HEALTH msg_id=9ce0cb58ab8b44df82c4bf1ad9ee22de node=wpd-ns8 instance=cgroup_ae7d720b0943.cpu_limit context=cgroup.cpu_limit code=0 alert_id=1716937147 alert_unique_id=1716940000 alert_event_id=2 alert_transition_id=48cb5cb2989146b3ba0fab8244e05f10 alert_config=fa0dc3ccdd444d4e9182db205a15f477 alert=cgroup_10min_cpu_usage alert_class=Utilization alert_component=CPU alert_type=Cgroups alert_exec=/usr/libexec/netdata/plugins.d/alarm-notify.sh alert_recipient=silent alert_duration=600 alert_value=0.0387569 alert_value_old=null alert_status=CLEAR alert_value_old=UNINITIALIZED alert_units=% alert_summary="Cgroup ae7d720b0943 CPU utilization" alert_info="Cgroup ae7d720b0943 average CPU utilization over the last 10 minutes" alert_notification_timestamp=2024-05-30T22:12:20+02:00 msg="ALERT 'cgroup_10min_cpu_usage' of instance 'cgroup_ae7d720b0943.cpu_limit' on node 'wpd-ns8', transitioned from UNINITIALIZED to CLEAR"
2024-05-30T22:12:25+02:00 [1:mail1:clamav] SelfCheck: Database status OK.
2024-05-30T22:14:04+02:00 [1::agent@cluster] task/cluster/c08c05c9-3482-4ef4-bcec-428eff9d6329: list-installed-modules/50list is starting
2024-05-30T22:14:04+02:00 [1::redis] 1:M 30 May 2024 20:14:04.368 * 1 changes in 5 seconds. Saving...
2024-05-30T22:14:04+02:00 [1::redis] 1:M 30 May 2024 20:14:04.369 * Background saving started by pid 23
2024-05-30T22:14:04+02:00 [1:traefik1:traefik] 192.168.237.220 - - [30/May/2024:20:14:04 +0000] "POST /cluster-admin/api/cluster/tasks HTTP/2.0" 201 251 "-" "-" 207 "ApiServer-https@file" "http://127.0.0.1:9311" 426ms
2024-05-30T22:14:04+02:00 [1::redis] 23:C 30 May 2024 20:14:04.607 * DB saved on disk
2024-05-30T22:14:04+02:00 [1::agent@cluster] task/cluster/c08c05c9-3482-4ef4-bcec-428eff9d6329: action "list-installed-modules" status is "completed" (0) at step validate-output.json
2024-05-30T22:14:04+02:00 [1::redis] 23:C 30 May 2024 20:14:04.608 * Fork CoW for RDB: current 1 MB, peak 1 MB, average 0 MB
2024-05-30T22:14:04+02:00 [1::redis] 1:M 30 May 2024 20:14:04.670 * Background saving terminated with success
2024-05-30T22:14:04+02:00 [1::agent@cluster] task/cluster/bfcdec9f-2e42-418b-b73d-8c4c983aa0df: list-loki-instances/10get is starting
2024-05-30T22:14:04+02:00 [1:traefik1:traefik] 192.168.237.220 - - [30/May/2024:20:14:04 +0000] "POST /cluster-admin/api/cluster/tasks HTTP/2.0" 201 230 "-" "-" 208 "ApiServer-https@file" "http://127.0.0.1:9311" 752ms
2024-05-30T22:14:05+02:00 [1:loki1:agent@loki1] task/module/loki1/717e36d2-4687-4d96-b49e-ace75fa8ba07: get-configuration/10get is starting
2024-05-30T22:14:05+02:00 [1:loki1:agent@loki1] task/module/loki1/717e36d2-4687-4d96-b49e-ace75fa8ba07: action "get-configuration" status is "completed" (0) at step validate-output.json
2024-05-30T22:14:05+02:00 [1:traefik1:traefik] 192.168.237.220 - - [30/May/2024:20:14:04 +0000] "GET /cluster-admin/api/cluster/task/bfcdec9f-2e42-418b-b73d-8c4c983aa0df/context HTTP/2.0" 200 237 "-" "-" 213 "ApiServer-https@file" "http://127.0.0.1:9311" 303ms
2024-05-30T22:14:05+02:00 [1::agent@cluster] task/cluster/bfcdec9f-2e42-418b-b73d-8c4c983aa0df: action "list-loki-instances" status is "completed" (0) at step validate-output.json
2024-05-30T22:14:05+02:00 [1:traefik1:traefik] 192.168.237.220 - - [30/May/2024:20:14:04 +0000] "GET /cluster-admin/api/cluster/task/c08c05c9-3482-4ef4-bcec-428eff9d6329/context HTTP/2.0" 200 260 "-" "-" 209 "ApiServer-https@file" "http://127.0.0.1:9311" 945ms
2024-05-30T22:14:05+02:00 [1:traefik1:traefik] 192.168.237.220 - - [30/May/2024:20:14:05 +0000] "GET /cluster-admin/api/module/loki1/task/717e36d2-4687-4d96-b49e-ace75fa8ba07/context HTTP/2.0" 200 189 "-" "-" 216 "ApiServer-https@file" "http://127.0.0.1:9311" 305ms
2024-05-30T22:14:05+02:00 [1:traefik1:traefik] 192.168.237.220 - - [30/May/2024:20:14:05 +0000] "GET /cluster-admin/api/cluster/task/bfcdec9f-2e42-418b-b73d-8c4c983aa0df/context HTTP/2.0" 200 237 "-" "-" 219 "ApiServer-https@file" "http://127.0.0.1:9311" 309ms
2024-05-30T22:14:05+02:00 [1:traefik1:traefik] 192.168.237.220 - - [30/May/2024:20:14:04 +0000] "GET /cluster-admin/api/cluster/task/c08c05c9-3482-4ef4-bcec-428eff9d6329/context HTTP/2.0" 200 260 "-" "-" 210 "ApiServer-https@file" "http://127.0.0.1:9311" 1293ms
2024-05-30T22:14:05+02:00 [1:traefik1:traefik] 192.168.237.220 - - [30/May/2024:20:14:05 +0000] "GET /cluster-admin/api/cluster/task/bfcdec9f-2e42-418b-b73d-8c4c983aa0df/context HTTP/2.0" 200 237 "-" "-" 220 "ApiServer-https@file" "http://127.0.0.1:9311" 617ms
2024-05-30T22:14:05+02:00 [1:traefik1:traefik] 192.168.237.220 - - [30/May/2024:20:14:05 +0000] "GET /cluster-admin/api/cluster/task/bfcdec9f-2e42-418b-b73d-8c4c983aa0df/status HTTP/2.0" 200 243 "-" "-" 221 "ApiServer-https@file" "http://127.0.0.1:9311" 90ms
2024-05-30T22:14:05+02:00 [1:traefik1:traefik] 192.168.237.220 - - [30/May/2024:20:14:05 +0000] "GET /cluster-admin/api/module/loki1/task/717e36d2-4687-4d96-b49e-ace75fa8ba07/context HTTP/2.0" 200 189 "-" "-" 215 "ApiServer-https@file" "http://127.0.0.1:9311" 902ms
2024-05-30T22:14:06+02:00 [1:traefik1:traefik] 192.168.237.220 - - [30/May/2024:20:14:04 +0000] "GET /cluster-admin/api/cluster/task/bfcdec9f-2e42-418b-b73d-8c4c983aa0df/context HTTP/2.0" 200 237 "-" "-" 214 "ApiServer-https@file" "http://127.0.0.1:9311" 1312ms
2024-05-30T22:14:06+02:00 [1:traefik1:traefik] 192.168.237.220 - - [30/May/2024:20:14:04 +0000] "GET /cluster-admin/api/cluster/task/c08c05c9-3482-4ef4-bcec-428eff9d6329/context HTTP/2.0" 200 260 "-" "-" 211 "ApiServer-https@file" "http://127.0.0.1:9311" 1509ms
2024-05-30T22:14:06+02:00 [1:traefik1:traefik] 192.168.237.220 - - [30/May/2024:20:14:04 +0000] "GET /cluster-admin/api/cluster/task/c08c05c9-3482-4ef4-bcec-428eff9d6329/context HTTP/2.0" 200 260 "-" "-" 212 "ApiServer-https@file" "http://127.0.0.1:9311" 1611ms
2024-05-30T22:14:06+02:00 [1:traefik1:traefik] 192.168.237.220 - - [30/May/2024:20:14:06 +0000] "GET /cluster-admin/api/cluster/task/c08c05c9-3482-4ef4-bcec-428eff9d6329/status HTTP/2.0" 200 1088 "-" "-" 222 "ApiServer-https@file" "http://127.0.0.1:9311" 76ms
2024-05-30T22:14:06+02:00 [1:traefik1:traefik] 192.168.237.220 - - [30/May/2024:20:14:05 +0000] "GET /cluster-admin/api/module/loki1/task/717e36d2-4687-4d96-b49e-ace75fa8ba07/context HTTP/2.0" 200 189 "-" "-" 217 "ApiServer-https@file" "http://127.0.0.1:9311" 1461ms
2024-05-30T22:14:06+02:00 [1:traefik1:traefik] 192.168.237.220 - - [30/May/2024:20:14:05 +0000] "GET /cluster-admin/api/module/loki1/task/717e36d2-4687-4d96-b49e-ace75fa8ba07/context HTTP/2.0" 200 189 "-" "-" 218 "ApiServer-https@file" "http://127.0.0.1:9311" 1664ms
2024-05-30T22:14:06+02:00 [1:traefik1:traefik] 192.168.237.220 - - [30/May/2024:20:14:06 +0000] "GET /cluster-admin/api/module/loki1/task/717e36d2-4687-4d96-b49e-ace75fa8ba07/status HTTP/2.0" 200 191 "-" "-" 223 "ApiServer-https@file" "http://127.0.0.1:9311" 106ms

Any ideas, suggestions? @davidep ?

My 2 cents
Andy

2

Maybe I didn’t test, but the reboot of NS8 might have broken the account provider migration: abort it, and retry.

3

I have rebooted 1 or even both in the past - at least on other projects.
As long as it’s not directly in sync process, it doesn’t seem to matter…

But I’ll test this early evening. (People are still working…).

A quick PBS backup, then test.

:slight_smile:

4

Hi

As suggested, I aborted the AD / FileServer Migration:

Bildschirmfoto 2024-05-31 um 20.18.43
Bildschirmfoto 2024-05-31 um 20.18.431920×955 45.4 KB

NS8 is showing the connection:

Bildschirmfoto 2024-05-31 um 20.19.16
Bildschirmfoto 2024-05-31 um 20.19.161920×962 78.2 KB

So far, things look good, NS8 is allowing communication.

Bildschirmfoto 2024-05-31 um 20.19.32
Bildschirmfoto 2024-05-31 um 20.19.321920×956 55.9 KB

Next step is to sync data… (Around 450 GB)…

Will report.

5

The data has synchronized…

NS7 looks good so far.

Bildschirmfoto 2024-06-01 um 08.57.19
Bildschirmfoto 2024-06-01 um 08.57.191920×958 55.5 KB

and so does NS8.

Bildschirmfoto 2024-06-01 um 08.57.38
Bildschirmfoto 2024-06-01 um 08.57.381920×955 60.6 KB

Disk usage as expected, total close to 380 GB in use on NS8 (NS7 uses 375 GB).

Load on Proxmox for this specific task:

Bildschirmfoto 2024-06-01 um 09.19.39
Bildschirmfoto 2024-06-01 um 09.19.392498×702 99.3 KB

A lot of IO delays - the source and target are both running on the same 2 TB NVME based ZFS mirror.

Last step now…

Report coming.

My 2 cents
Andy

6

I would like to report this migration as sucessful!

Bildschirmfoto 2024-06-03 um 23.46.42
Bildschirmfoto 2024-06-03 um 23.46.421920×1017 50.1 KB

Bildschirmfoto 2024-06-01 um 22.01.03
Bildschirmfoto 2024-06-01 um 22.01.033456×1826 340 KB

THX

My 2 cents
Andy

1 Like
7

Filed a bug

2 Likes