Ns8 fail to start

france · April 16, 2024, 2:34pm

Hello everyone in my test ns8 , I noticed that the cluster server no longer starts .

The only error found is this

[root@ns8 ~]# systemctl status dnsmasq1
× dnsmasq1.service - DNSmasq podman container
     Loaded: loaded (/etc/systemd/system/dnsmasq1.service; enabled; preset: disabled)
     Active: failed (Result: exit-code) since Tue 2024-04-16 16:31:50 CEST; 34s ago
   Duration: 119ms
       Docs: man:podman-generate-systemd(1)
    Process: 8361 ExecStartPre=/bin/rm -f /run/dnsmasq1.service.ctr-id (code=exited, status=0/SUCCESS)
    Process: 8362 ExecStartPre=runagent -m dnsmasq1 reload_hosts (code=exited, status=0/SUCCESS)
    Process: 8376 ExecStart=/usr/bin/podman run --cidfile=/run/dnsmasq1.service.ctr-id --cgroups=no-conmon --rm --sdnotify=conmon -d --repl>
    Process: 8391 ExecStopPost=/usr/bin/podman rm -f --ignore -t 10 --cidfile=/run/dnsmasq1.service.ctr-id (code=exited, status=0/SUCCESS)
   Main PID: 8376 (code=exited, status=1/FAILURE)
        CPU: 599ms

Apr 16 16:31:50 ns8 systemd[1]: dnsmasq1.service: Scheduled restart job, restart counter is at 5.
Apr 16 16:31:50 ns8 systemd[1]: Stopped DNSmasq podman container.
Apr 16 16:31:50 ns8 systemd[1]: dnsmasq1.service: Start request repeated too quickly.
Apr 16 16:31:50 ns8 systemd[1]: dnsmasq1.service: Failed with result 'exit-code'.
Apr 16 16:31:50 ns8 systemd[1]: Failed to start DNSmasq podman container.

In ssh the server goes but the cluster and its servers do not .

mrmarkuz · April 16, 2024, 2:40pm

Do you have installed Samba AD and dnsmasq on one node? That could be an issue as both want to bind to port 53 UDP.

france · April 16, 2024, 2:42pm

Yes I have the ad.internal.lan domino and after that I installed the new dnsmasq .

pr 16 16:40:01 ns8 ldapproxy[4140]: 2024/04/16 14:40:01 [info] 26#26: *3 client 127.0.0.1:43746 connected to 127.0.0.1:20002
Apr 16 16:40:01 ns8 ldapproxy[4140]: 2024/04/16 14:40:01 [info] 26#26: *3 proxy 192.168.3.76:53310 connected to 192.168.3.76:636
Apr 16 16:40:01 ns8 samba-dc[3511]: Auth: [LDAP,simple bind/TLS] user [INTERNAL]\[ldapservice@ad.internal.lan] at [Tue, 16 Apr 2024 14:40:01.148725 UTC] with [Plaintext] status [NT_STATUS_OK] workstation [DC1] remote host [ipv4:192.168.3.76:53310] became [INTERNAL]\[ldapservice] [S-1-5-21-3365072379-4206708201-1288866243-1103]. local host [ipv4:192.168.3.76:636] 
Apr 16 16:40:01 ns8 nextcloud-redis[2778]: 1:M 16 Apr 2024 14:40:01.357 * 100 changes in 300 seconds. Saving...
Apr 16 16:40:01 ns8 nextcloud-redis[2778]: 1:M 16 Apr 2024 14:40:01.358 * Background saving started by pid 12
Apr 16 16:40:01 ns8 nextcloud-redis[2778]: 12:C 16 Apr 2024 14:40:01.363 * DB saved on disk
Apr 16 16:40:01 ns8 nextcloud-redis[2778]: 12:C 16 Apr 2024 14:40:01.364 * RDB: 0 MB of memory used by copy-on-write
Apr 16 16:40:01 ns8 nextcloud-redis[2778]: 1:M 16 Apr 2024 14:40:01.458 * Background saving terminated with success
Apr 16 16:40:01 ns8 ldapproxy[4140]: 2024/04/16 14:40:01 [info] 26#26: *3 client disconnected, bytes from/to client:3046/2108, bytes from/to upstream:2108/3046
Apr 16 16:40:18 ns8 systemd[1628]: ClamAV anti-virus is inactive.
Apr 16 16:40:18 ns8 systemd[1628]: Dependency failed for ClamAV unofficial signatures download.
Apr 16 16:40:18 ns8 systemd[1628]: clamav-unofficial-sigs.service: Job clamav-unofficial-sigs.service/start failed with result 'dependency'.
Apr 16 16:40:24 ns8 promtail[2081]: level=warn ts=2024-04-16T14:40:24.01755757Z caller=client.go:419 component=client host=10.5.4.1:20001 msg="error sending batch, will retry" status=-1 tenant= error="Post \"http://10.5.4.1:20001/loki/api/v1/push\": dial tcp 10.5.4.1:20001: connect: connection refused"
Apr 16 16:40:24 ns8 promtail[2081]: level=error ts=2024-04-16T14:40:24.0175983Z caller=client.go:430 component=client host=10.5.4.1:20001 msg="final error sending batch" status=-1 tenant= error="Post \"http://10.5.4.1:20001/loki/api/v1/push\": dial tcp 10.5.4.1:20001: connect: connection refused"
Apr 16 16:40:24 ns8 promtail[2081]: level=warn ts=2024-04-16T14:40:24.057578626Z caller=client.go:419 component=client host=10.5.4.1:20001 msg="error sending batch, will retry" status=-1 tenant= error="Post \"http://10.5.4.1:20001/loki/api/v1/push\": dial tcp 10.5.4.1:20001: connect: connection refused"
Apr 16 16:40:24 ns8 promtail[2081]: level=warn ts=2024-04-16T14:40:24.805404941Z caller=client.go:419 component=client host=10.5.4.1:20001 msg="error sending batch, will retry" status=-1 tenant= error="Post \"http://10.5.4.1:20001/loki/api/v1/push\": dial tcp 10.5.4.1:20001: connect: connection refused"
Apr 16 16:40:26 ns8 promtail[2081]: level=warn ts=2024-04-16T14:40:25.989968315Z caller=client.go:419 component=client host=10.5.4.1:20001 msg="error sending batch, will retry" status=-1 tenant= error="Post \"http://10.5.4.1:20001/loki/api/v1/push\": dial tcp 10.5.4.1:20001: connect: connection refused"
Apr 16 16:40:29 ns8 promtail[2081]: level=warn ts=2024-04-16T14:40:29.821429681Z caller=client.go:419 component=client host=10.5.4.1:20001 msg="error sending batch, will retry" status=-1 tenant= error="Post \"http://10.5.4.1:20001/loki/api/v1/push\": dial tcp 10.5.4.1:20001: connect: connection refused"
Apr 16 16:40:34 ns8 promtail[2081]: level=warn ts=2024-04-16T14:40:34.857129638Z caller=client.go:419 component=client host=10.5.4.1:20001 msg="error sending batch, will retry" status=-1 tenant= error="Post \"http://10.5.4.1:20001/loki/api/v1/push\": dial tcp 10.5.4.1:20001: connect: connection refused"
Apr 16 16:40:44 ns8 promtail[2081]: level=warn ts=2024-04-16T14:40:44.854424744Z caller=client.go:419 component=client host=10.5.4.1:20001 msg="error sending batch, will retry" status=-1 tenant= error="Post \"http://10.5.4.1:20001/loki/api/v1/push\": dial tcp 10.5.4.1:20001: connect: connection refused"
Apr 16 16:40:53 ns8 rspamd[3509]: #30(controller) <7n3qic>; map; http_map_finish: data is not modified for server maps.rspamd.com, next check at Tue, 16 Apr 2024 18:37:39 GMT (http cache based: Tue, 16 Apr 2024 18:37:39 GMT)
Apr 16 16:40:53 ns8 rspamd[3509]: #30(controller) <fdp86m>; map; http_map_finish: data is not modified for server maps.rspamd.com, next check at Tue, 16 Apr 2024 18:40:54 GMT (http cache based: Tue, 16 Apr 2024 18:40:54 GMT)
Apr 16 16:41:16 ns8 promtail[2081]: level=warn ts=2024-04-16T14:41:16.491700988Z caller=client.go:419 component=client host=10.5.4.1:20001 msg="error sending batch, will retry" status=-1 tenant= error="Post \"http://10.5.4.1:20001/loki/api/v1/push\": dial tcp 10.5.4.1:20001: connect: connection refused"
Apr 16 16:41:54 ns8 promtail[2081]: level=warn ts=2024-04-16T14:41:54.286082869Z caller=client.go:419 component=client host=10.5.4.1:20001 msg="error sending batch, will retry" status=-1 tenant= error="Post \"http://10.5.4.1:20001/loki/api/v1/push\": dial tcp 10.5.4.1:20001: connect: connection refused"
A

mrmarkuz · April 16, 2024, 2:49pm

You could try uninstalling dnsmasq.

france · April 16, 2024, 2:51pm

Apr 16 16:50:01 ns8 ldapproxy[4003]: 2024/04/16 14:50:01 [info] 27#27: *1 client 127.0.0.1:34624 connected to 127.0.0.1:20002
Apr 16 16:50:01 ns8 ldapproxy[4003]: 2024/04/16 14:50:01 [info] 27#27: *1 proxy 192.168.3.76:51176 connected to 192.168.3.76:636
Apr 16 16:50:01 ns8 samba-dc[3141]: Auth: [LDAP,simple bind/TLS] user [INTERNAL]\[ldapservice@ad.internal.lan] at [Tue, 16 Apr 2024 14:50:01.484654 UTC] with [Plaintext] status [NT_STATUS_OK] workstation [DC1] remote host [ipv4:192.168.3.76:51176] became [INTERNAL]\[ldapservice] [S-1-5-21-3365072379-4206708201-1288866243-1103]. local host [ipv4:192.168.3.76:636] 
Apr 16 16:50:04 ns8 ldapproxy[4003]: 2024/04/16 14:50:04 [info] 27#27: *1 client disconnected, bytes from/to client:316/531, bytes from/to upstream:531/316

france · April 16, 2024, 2:52pm

With the classic remove syntax dnsmasq can’t find it or maybe you’re referring to another method? The cluster starts absolutely no service .

mrmarkuz · April 16, 2024, 2:55pm

This command doesn’t work? It needs to be executed on the cluster leader.

remove-module --no-preserve dnsmasq1

france · April 16, 2024, 2:56pm

remove-module --no-preserve dnsmasq1
<7>podman rmi --ignore 0d33cf28cf89ce69fdfa28603c27d489af8b14a213b9102dd76c8813cd5e28d3
{}

france · April 16, 2024, 2:59pm

Full of mistakes …```
Apr 16 16:57:06 ns8 mariadb-app[3587]: 2024-04-16 14:57:06 0 [Note] InnoDB: 128 rollback segments are active.
Apr 16 16:57:06 ns8 mariadb-app[3587]: 2024-04-16 14:57:06 0 [Note] InnoDB: Setting file ‘./ibtmp1’ size to 12.000MiB. Physically writing the file full; Please wait …
Apr 16 16:57:06 ns8 mariadb-app[3587]: 2024-04-16 14:57:06 0 [Note] InnoDB: File ‘./ibtmp1’ size is now 12.000MiB.
Apr 16 16:57:06 ns8 mariadb-app[3587]: 2024-04-16 14:57:06 0 [Note] InnoDB: log sequence number 113385; transaction id 192
Apr 16 16:57:06 ns8 mariadb-app[3587]: 2024-04-16 14:57:06 0 [Note] InnoDB: Loading buffer pool(s) from /var/lib/mysql/ib_buffer_pool
Apr 16 16:57:06 ns8 sftpgo[3928]: {“level”:“info”,“time”:“2024-04-16T14:57:06.637”,“sender”:“httpd”,“message”:“server listener registered, address: [::]:8080 TLS enabled: false”}
Apr 16 16:57:06 ns8 mariadb-app[3587]: 2024-04-16 14:57:06 0 [Note] Plugin ‘FEEDBACK’ is disabled.
Apr 16 16:57:06 ns8 mariadb-app[3587]: 2024-04-16 14:57:06 0 [Warning] You need to use --log-bin to make --expire-logs-days or --binlog-expire-logs-seconds work.
Apr 16 16:57:06 ns8 rspamd[3371]: #23(main) <3nfnin>; lua; lua_redis.lua:581: use default Redis settings for neural
Apr 16 16:57:06 ns8 mariadb-app[3587]: 2024-04-16 14:57:06 0 [Note] Server socket created on IP: ‘0.0.0.0’.
Apr 16 16:57:06 ns8 mariadb-app[3587]: 2024-04-16 14:57:06 0 [Note] Server socket created on IP: ‘::’.
Apr 16 16:57:06 ns8 systemd[1493]: Started libcrun container.
Apr 16 16:57:06 ns8 rspamd[3371]: #23(main) <3nfnin>; lua; init.lua:58: controller plugin selectors; register webui path check_selector
Apr 16 16:57:06 ns8 rspamd[3371]: #23(main) <3nfnin>; lua; init.lua:58: controller plugin selectors; register webui path list_transforms
Apr 16 16:57:06 ns8 rspamd[3371]: #23(main) <3nfnin>; lua; init.lua:58: controller plugin selectors; register webui path check_message
Apr 16 16:57:06 ns8 rspamd[3371]: #23(main) <3nfnin>; lua; init.lua:58: controller plugin selectors; register webui path list_extractors
Apr 16 16:57:06 ns8 rspamd[3371]: #23(main) <3nfnin>; lua; init.lua:58: controller plugin neural; register webui path learn
Apr 16 16:57:06 ns8 rspamd[3371]: #23(main) <3nfnin>; lua; init.lua:58: controller plugin maps; register webui path query_specific
Apr 16 16:57:06 ns8 rspamd[3371]: #23(main) <3nfnin>; lua; init.lua:58: controller plugin maps; register webui path query
Apr 16 16:57:06 ns8 rspamd[3371]: #23(main) <3nfnin>; lua; init.lua:58: controller plugin maps; register webui path query_json
Apr 16 16:57:06 ns8 rspamd[3371]: #23(main) <3nfnin>; lua; init.lua:58: controller plugin maps; register webui path list
Apr 16 16:57:06 ns8 systemd[1486]: Created slice cgroup user-libpod_pod_086cf887357d70ea44953af405f9ccdebb9307e87f24a24e2c98b7f11b1f1a0c.slice.
Apr 16 16:57:06 ns8 bash[4640]: % Total % Received % Xferd Average Speed Time Time Time Current
Apr 16 16:57:06 ns8 bash[4640]: Dload Upload Total Spent Left Speed
Apr 16 16:57:06 ns8 sftpgo[3928]: {“level”:“debug”,“time”:“2024-04-16T14:57:06.732”,“sender”:“httpd”,“local_addr”:“10.0.2.100:8080”,“method”:“GET”,“proto”:“HTTP/1.1”,“remote_addr”:“10.0.2.100:58198”,“request_id”:“webserver/YlVjTgmcYT-000001”,“uri”:“http://localhost:20015/healthz",“user_agent”:“curl/7.76.1”,“resp_status”:200,“resp_size”:2,"elapsed_ms”:0}
Apr 16 16:57:06 ns8 bash[4640]: [158B blob data]
Apr 16 16:57:06 ns8 systemd[1497]: Started Podman sftpgo.service.
Apr 16 16:57:06 ns8 systemd[1497]: Reached target Main User Target.
Apr 16 16:57:06 ns8 systemd[1497]: Startup finished in 13.078s.
Apr 16 16:57:06 ns8 roundcubemail1[4274]: 3dcc8a5c58f21c720b73fb8e9c0db9496bf833029b04e3e84b66833a80319303
Apr 16 16:57:06 ns8 systemd[1493]: Started Podman roundcubemail-app.service.
Apr 16 16:57:06 ns8 systemd[1493]: Startup finished in 13.367s.
Apr 16 16:57:06 ns8 mariadb-app[3587]: 2024-04-16 14:57:06 0 [Note] InnoDB: Buffer pool(s) load completed at 240416 14:57:06
Apr 16 16:57:06 ns8 mariadb-app[3587]: 2024-04-16 14:57:06 0 [Note] mariadbd: ready for connections.
Apr 16 16:57:06 ns8 mariadb-app[3587]: Version: ‘10.11.7-MariaDB-1:10.11.7+maria~ubu2204’ socket: ‘/run/mysqld/mysqld.sock’ port: 3306 mariadb.org binary distribution
Apr 16 16:57:06 ns8 podman[4614]: 086cf887357d70ea44953af405f9ccdebb9307e87f24a24e2c98b7f11b1f1a0c
Apr 16 16:57:06 ns8 roundcubemail-app[4636]: roundcubemail found in /var/www/html - installing update…
Apr 16 16:57:06 ns8 rspamd[3417]: /usr/bin/bash: connect: Connection refused
Apr 16 16:57:06 ns8 rspamd[3417]: /usr/bin/bash: line 1: /dev/tcp/127.0.0.1/11334: Connection refused
Apr 16 16:57:06 ns8 glpi-app[4341]: Enabling module rewrite.
Apr 16 16:57:06 ns8 systemd[1486]: Started libcrun container.
Apr 16 16:57:07 ns8 podman[4643]: 086cf887357d70ea44953af405f9ccdebb9307e87f24a24e2c98b7f11b1f1a0c
Apr 16 16:57:07 ns8 systemd[1486]: Started Loki pod service.
Apr 16 16:57:07 ns8 systemd[1486]: Starting Loki server…
Apr 16 16:57:07 ns8 glpi-app[4341]: To activate the new configuration, you need to run:
Apr 16 16:57:07 ns8 glpi-app[4341]: service apache2 restart
Apr 16 16:57:07 ns8 systemd[1486]: Starting Loki frontend HTTP proxy…
Apr 16 16:57:07 ns8 systemd[1499]: Started libcrun container.
Apr 16 16:57:07 ns8 podman[4697]: time=“2024-04-16T16:57:07+02:00” level=warning msg=“Unmounting container "loki-server" while attempting to delete storage: unmounting "/home/loki1/.local/share/containers/storage/overlay/9556245079aefabd2cbf96bfea6f1706fea6801d4a5babb0966f26eeedf2514a/merged": invalid argument”
Apr 16 16:57:07 ns8 podman[4697]: Error: removing storage for container “loki-server”: unmounting “/home/loki1/.local/share/containers/storage/overlay/9556245079aefabd2cbf96bfea6f1706fea6801d4a5babb0966f26eeedf2514a/merged”: invalid argument
Apr 16 16:57:07 ns8 systemd[1486]: loki-server.service: Control process exited, code=exited, status=125/n/a
Apr 16 16:57:07 ns8 podman[4712]: time=“2024-04-16T16:57:07+02:00” level=warning msg=“Unmounting container "traefik" while attempting to delete storage: unmounting "/home/loki1/.local/share/containers/storage/overlay/d4be46d7ea4a9f890a2598c8e40f48f1bffb82dc755dca31ed7a2d8f30871f0a/merged": invalid argument”
Apr 16 16:57:07 ns8 podman[4712]: Error: removing storage for container “traefik”: unmounting “/home/loki1/.local/share/containers/storage/overlay/d4be46d7ea4a9f890a2598c8e40f48f1bffb82dc755dca31ed7a2d8f30871f0a/merged”: invalid argument
Apr 16 16:57:07 ns8 systemd[1486]: traefik.service: Control process exited, code=exited, status=125/n/a
Apr 16 16:57:07 ns8 systemd[1486]: loki-server.service: Failed with result ‘exit-code’.
Apr 16 16:57:07 ns8 systemd[1486]: Failed to start Loki server.
Apr 16 16:57:07 ns8 wordpress2[4499]: 00c47e5a3598fd0d64cb0cd665ab4c5d2817cb2bc01474c0ea3a4da439849122

mrmarkuz · April 16, 2024, 2:59pm

Usually it looks like that:

[root@rocky1 ~]# remove-module --no-preserve onlyoffice6
<7>podman rmi --ignore d7173e1e750964346c28aeee1dc78efd752f792d9ef25828adc0791873d9a632
Untagged: ghcr.io/mrmarkuz/onlyoffice:latest
Deleted: d7173e1e750964346c28aeee1dc78efd752f792d9ef25828adc0791873d9a632
{}

france · April 16, 2024, 3:01pm

Before I restore, do you want to do any tests? The only thing I did is a backup. I use ns8 as vm on rocky linux .

mrmarkuz · April 16, 2024, 3:02pm

I think it’s this one again, this time the app loki1 is affected.

france · April 16, 2024, 3:03pm

rmdir: failed to remove '../../.local/share/containers/storage/overlay/*/merged': No such file or directory

mrmarkuz · April 16, 2024, 3:09pm

Please use it like this:

And please change webserver1 to loki1.

rmdir /home/loki1/.local/share/containers/storage/overlay/*/merged

france · April 16, 2024, 3:11pm

It has been removed . now I’m trying to show you the first mistakes via journal .

france · April 16, 2024, 3:15pm

In my opinion, they are errors of the APPs that fail to start they do not find the dnn hostname. I think the cluster is blocked.
So these errors make you understand relatively … the problem in my opinion is the departure of the cluster 192.168.3.76/cluster-admin no answer .
Here is a portion of the :sleepy app errors:

Apr 16 17:13:02 ns8 phpmyadmin-app[6813]: AH00558: apache2: Could not reliably determine the server's fully qualified domain name, using 10.0.2.100. Set the 'ServerName' directive globally to suppress this message
Apr 16 17:13:02 ns8 phpmyadmin-app[6813]: [Tue Apr 16 15:13:02.546786 2024] [mpm_prefork:notice] [pid 1] AH00163: Apache/2.4.57 (Debian) PHP/8.2.8 configured -- resuming normal operations
Apr 16 17:13:02 ns8 phpmyadmin-app[6813]: [Tue Apr 16 15:13:02.547183 2024] [core:notice] [pid 1] AH00094: Command line: 'apache2 -D FOREGROUND'
Apr 16 17:13:02 ns8 podman[6824]: Enabling site phpmyadmin.
Apr 16 17:13:02 ns8 podman[6824]: To activate the new configuration, you need to run:
Apr 16 17:13:02 ns8 podman[6824]:   service apache2 reload
Apr 16 17:13:02 ns8 phpmyadmin-app[6813]: [Tue Apr 16 15:13:02.697553 2024] [mpm_prefork:notice] [pid 1] AH00171: Graceful restart requested, doing restart
Apr 16 17:13:02 ns8 phpmyadmin-app[6813]: AH00558: apache2: Could not reliably determine the server's fully qualified domain name, using 10.0.2.100. Set the 'ServerName' directive globally to suppress this message
Apr 16 17:13:02 ns8 podman[6824]: Reloading Apache httpd web server: apache2.
Apr 16 17:13:02 ns8 phpmyadmin-app[6813]: [Tue Apr 16 15:13:02.715176 2024] [mpm_prefork:notice] [pid 1] AH00163: Apache/2.4.57 (Debian) PHP/8.2.8 configured -- resuming normal operations
Apr 16 17:13:02 ns8 phpmyadmin-app[6813]: [Tue Apr 16 15:13:02.715188 2024] [core:notice] [pid 1] AH00094: Command line: 'apache2 -D FOREGROUND'
Apr 16 17:13:02 ns8 systemd[1418]: Started Podman phpmyadmin-app.service.
Apr 16 17:13:02 ns8 systemd[1418]: Starting Podman mariadb-app.service...
Apr 16 17:13:02 ns8 systemd[1418]: Started libcrun container.
Apr 16 17:13:02 ns8 podman[6899]: b7c119bc4eda5ea134023e0db47f7ad012ac76ec674eead90e985b0e23a49e94
Apr 16 17:13:02 ns8 mariadb-app[6911]: 2024-04-16 15:13:02+00:00 [Note] [Entrypoint]: Entrypoint script for MariaDB Server 1:10.11.7+maria~ubu2204 started.
Apr 16 17:13:03 ns8 systemd[1418]: Started Podman mariadb-app.service.
Apr 16 17:13:03 ns8 systemd[1418]: Startup finished in 1min 19.223s.
Apr 16 17:13:03 ns8 mariadb-app[6911]: 2024-04-16 15:13:03+00:00 [Warn] [Entrypoint]: /sys/fs/cgroup///memory.pressure not writable, functionality unavailable to MariaDB
Apr 16 17:13:03 ns8 mariadb-app[6911]: 2024-04-16 15:13:03+00:00 [Note] [Entrypoint]: Switching to dedicated user 'mysql'
Apr 16 17:13:03 ns8 mariadb-app[6911]: 2024-04-16 15:13:03+00:00 [Note] [Entrypoint]: Entrypoint script for MariaDB Server 1:10.11.7+maria~ubu2204 started.
Apr 16 17:13:03 ns8 mariadb-app[6911]: 2024-04-16 15:13:03+00:00 [Note] [Entrypoint]: MariaDB upgrade not required
Apr 16 17:13:03 ns8 mariadb-app[6911]: 2024-04-16 15:13:03 0 [Note] Starting MariaDB 10.11.7-MariaDB-1:10.11.7+maria~ubu2204 source revision 87e13722a95af5d9378d990caf48cb6874439347 as process 1
Apr 16 17:13:03 ns8 mariadb-app[6911]: 2024-04-16 15:13:03 0 [Note] InnoDB: Compressed tables use zlib 1.2.11
Apr 16 17:13:03 ns8 mariadb-app[6911]: 2024-04-16 15:13:03 0 [Note] InnoDB: Number of transaction pools: 1
Apr 16 17:13:03 ns8 mariadb-app[6911]: 2024-04-16 15:13:03 0 [Note] InnoDB: Using SSE4.2 crc32 instructions
Apr 16 17:13:03 ns8 mariadb-app[6911]: 2024-04-16 15:13:03 0 [Note] mariadbd: O_TMPFILE is not supported on /tmp (disabling future attempts)
Apr 16 17:13:03 ns8 mariadb-app[6911]: 2024-04-16 15:13:03 0 [Note] InnoDB: Initializing buffer pool, total size = 128.000MiB, chunk size = 2.000MiB
Apr 16 17:13:03 ns8 mariadb-app[6911]: 2024-04-16 15:13:03 0 [Note] InnoDB: Completed initialization of buffer pool
Apr 16 17:13:03 ns8 mariadb-app[6911]: 2024-04-16 15:13:03 0 [Note] InnoDB: Buffered log writes (block size=512 bytes)
Apr 16 17:13:03 ns8 mariadb-app[6911]: 2024-04-16 15:13:03 0 [Note] InnoDB: End of log at LSN=113385
Apr 16 17:13:04 ns8 mariadb-app[6911]: 2024-04-16 15:13:04 0 [Note] InnoDB: 128 rollback segments are active.
Apr 16 17:13:04 ns8 mariadb-app[6911]: 2024-04-16 15:13:04 0 [Note] InnoDB: Setting file './ibtmp1' size to 12.000MiB. Physically writing the file full; Please wait ...
Apr 16 17:13:04 ns8 mariadb-app[6911]: 2024-04-16 15:13:04 0 [Note] InnoDB: File './ibtmp1' size is now 12.000MiB.
Apr 16 17:13:04 ns8 mariadb-app[6911]: 2024-04-16 15:13:04 0 [Note] InnoDB: log sequence number 113385; transaction id 192
Apr 16 17:13:04 ns8 mariadb-app[6911]: 2024-04-16 15:13:04 0 [Note] InnoDB: Loading buffer pool(s) from /var/lib/mysql/ib_buffer_pool
Apr 16 17:13:04 ns8 mariadb-app[6911]: 2024-04-16 15:13:04 0 [Note] Plugin 'FEEDBACK' is disabled.
Apr 16 17:13:04 ns8 mariadb-app[6911]: 2024-04-16 15:13:04 0 [Warning] You need to use --log-bin to make --expire-logs-days or --binlog-expire-logs-seconds work.
Apr 16 17:13:04 ns8 mariadb-app[6911]: 2024-04-16 15:13:04 0 [Note] Server socket created on IP: '0.0.0.0'.
Apr 16 17:13:04 ns8 mariadb-app[6911]: 2024-04-16 15:13:04 0 [Note] Server socket created on IP: '::'.
Apr 16 17:13:04 ns8 mariadb-app[6911]: 2024-04-16 15:13:04 0 [Note] InnoDB: Buffer pool(s) load completed at 240416 15:13:04
Apr 16 17:13:04 ns8 mariadb-app[6911]: 2024-04-16 15:13:04 0 [Note] mariadbd: ready for connections.

france · April 16, 2024, 3:16pm

Before it happened I just made a backup of the server with proxmox nothing special , a backup with snapshot .

mrmarkuz · April 16, 2024, 3:17pm

As it is a test cluster, maybe it’s easier to just restore from the snapshot…

france · April 16, 2024, 3:20pm

Ok I’ll proceed, but it would be appropriate to know what happened.

mrmarkuz · April 16, 2024, 3:21pm

I think loki was messed up.

Maybe it helps to restart it?

runagent -m loki1 systemctl --user restart loki