we decided to let nextcloud in maintenance to investigate what it occured, could you check in /var/log/messages what it happened. We adjust the correct setting only if the migration to mariadb105 was fine, else we stop and put nextcloud in a blocked state (still on the mariadb55 databse).
So now we need to understand what were the errors, go to /messages logs and paste the errors, try to use a Github GIST
Unfortunately I am not familiar with using Github GIST, and I’m not sure what I’m looking for in the log file. I’m not getting errors currently. I can search through it during the time of the upgrade, which was Friday afternoon/night. It is currently in use, so I can’t shut it down or restart it until this evening (Pacific Time, US West Coast). I’ll see what I can find in the logs.
it is a way to share text, logs, script and better to display it…no worries about it.
I believe this is the relevant log entries, I’ve x’d out the server name
Jun 25 21:45:09 xxxxxxxxxx systemd: rh-mariadb105-mariadb@nextcloud.service: main process exited, code=killed, status=6/ABRT
Jun 25 21:45:09 xxxxxxxxxx systemd: Unit rh-mariadb105-mariadb@nextcloud.service entered failed state.
Jun 25 21:45:09 xxxxxxxxxx systemd: rh-mariadb105-mariadb@nextcloud.service failed.
Jun 25 21:45:09 xxxxxxxxxx systemd: Removed slice User Slice of apache.
Jun 25 21:45:14 xxxxxxxxxx systemd: rh-mariadb105-mariadb@nextcloud.service holdoff time over, scheduling restart.
Jun 25 21:45:15 xxxxxxxxxx systemd: Stopped MariaDB 10.5 database server.
Jun 25 21:45:15 xxxxxxxxxx systemd: Starting MariaDB 10.5 database server…
Jun 25 21:45:17 xxxxxxxxxx esmith::event[10701]: ERROR 2013 (HY000) at line 5977: Lost connection to MySQL server during query
Jun 25 21:45:17 xxxxxxxxxx esmith::event[10701]: [ERROR] Error while restoring nextcloud database to SCL mariadb105
Jun 25 21:45:36 xxxxxxxxxx scl: Socket file /run/rh-mariadb105-mariadb/nextcloud-mysql.sock exists.
Jun 25 21:45:42 xxxxxxxxxx scl: No process is using /run/rh-mariadb105-mariadb/nextcloud-mysql.sock, which means it is a garbage, so it will be removed automatically.
Jun 25 21:45:42 xxxxxxxxxx esmith::event[10701]: Nextcloud or one of the apps require upgrade - only a limited number of commands are available
Jun 25 21:45:42 xxxxxxxxxx esmith::event[10701]: You may use your browser or the occ upgrade command to do the upgrade
Jun 25 21:45:43 xxxxxxxxxx scl: Database MariaDB is probably initialized in /var/opt/rh/rh-mariadb105/lib/mysql-nextcloud already, nothing is done.
Jun 25 21:45:43 xxxxxxxxxx scl: If this is not the case, make sure the /var/opt/rh/rh-mariadb105/lib/mysql-nextcloud is empty before running mysql-prepare-db-dir.
Jun 25 21:45:43 xxxxxxxxxx mysqld-scl-helper: 2021-06-25 21:45:43 0 [Note] /opt/rh/rh-mariadb105/root/usr/libexec/mysqld (mysqld 10.5.8-MariaDB) starting as process 1339 …
Jun 25 21:45:59 xxxxxxxxxx esmith::event[10701]: accessibility 1.7.0 enabled
Jun 25 21:46:00 xxxxxxxxxx esmith::event[10701]: Action: /etc/e-smith/events/nethserver-nextcloud-update/S20nethserver-nextcloud-conf FAILED: 1 [14872.391839]
Jun 25 21:46:03 xxxxxxxxxx systemd: Created slice User Slice of apache.
Jun 25 21:46:03 xxxxxxxxxx systemd: Started Session 10615 of user apache.
Jun 25 21:46:04 xxxxxxxxxx systemd: Removed slice User Slice of apache.
Jun 25 21:46:16 xxxxxxxxxx su: (to apache) root on none
Jun 25 21:46:23 xxxxxxxxxx esmith::event[10701]: Nextcloud or one of the apps require upgrade - only a limited number of commands are available
Jun 25 21:46:23 xxxxxxxxxx esmith::event[10701]: You may use your browser or the occ upgrade command to do the upgrade
Jun 25 21:46:23 xxxxxxxxxx esmith::event[10701]: System config value trusted_domains deleted
Jun 25 21:46:24 xxxxxxxxxx su: (to apache) root on none
Jun 25 21:46:24 xxxxxxxxxx esmith::event[10701]: Nextcloud or one of the apps require upgrade - only a limited number of commands are available
Jun 25 21:46:24 xxxxxxxxxx esmith::event[10701]: You may use your browser or the occ upgrade command to do the upgrade
Jun 25 21:46:24 xxxxxxxxxx esmith::event[10701]: System config value trusted_domains => 0 set to string localhost
Jun 25 21:46:24 xxxxxxxxxx su: (to apache) root on none
Jun 25 21:46:25 xxxxxxxxxx esmith::event[10701]: Nextcloud or one of the apps require upgrade - only a limited number of commands are available
Jun 25 21:46:25 xxxxxxxxxx esmith::event[10701]: You may use your browser or the occ upgrade command to do the upgrade
Jun 25 21:46:25 xxxxxxxxxx esmith::event[10701]: System config value trusted_domains => 1 set to string xxxxxxxxxx.scbec.org
Jun 25 21:46:25 xxxxxxxxxx su: (to apache) root on none
Jun 25 21:46:25 xxxxxxxxxx esmith::event[10701]: Nextcloud or one of the apps require upgrade - only a limited number of commands are available
Jun 25 21:46:25 xxxxxxxxxx esmith::event[10701]: You may use your browser or the occ upgrade command to do the upgrade
Jun 25 21:46:25 xxxxxxxxxx esmith::event[10701]: System config value memcache.local set to string \OC\Memcache\APCu
Jun 25 21:46:25 xxxxxxxxxx su: (to apache) root on none
Jun 25 21:46:26 xxxxxxxxxx esmith::event[10701]: Nextcloud or one of the apps require upgrade - only a limited number of commands are available
Jun 25 21:46:26 xxxxxxxxxx esmith::event[10701]: You may use your browser or the occ upgrade command to do the upgrade
Jun 25 21:46:26 xxxxxxxxxx esmith::event[10701]: System config value logfile set to string /var/lib/nethserver/nextcloud/nextcloud.log
Jun 25 21:46:26 xxxxxxxxxx su: (to apache) root on none
Jun 25 21:46:26 xxxxxxxxxx esmith::event[10701]: Nextcloud or one of the apps require upgrade - only a limited number of commands are available
Jun 25 21:46:26 xxxxxxxxxx esmith::event[10701]: You may use your browser or the occ upgrade command to do the upgrade
Jun 25 21:46:26 xxxxxxxxxx esmith::event[10701]: System config value mail_smtpmode set to string smtp
Jun 25 21:46:26 xxxxxxxxxx su: (to apache) root on none
Jun 25 21:46:26 xxxxxxxxxx esmith::event[10701]: Nextcloud or one of the apps require upgrade - only a limited number of commands are available
Jun 25 21:46:26 xxxxxxxxxx esmith::event[10701]: You may use your browser or the occ upgrade command to do the upgrade
Jun 25 21:46:27 xxxxxxxxxx esmith::event[10701]: System config value mail_smtpsecure set to empty string
Jun 25 21:46:27 xxxxxxxxxx su: (to apache) root on none
Jun 25 21:46:27 xxxxxxxxxx esmith::event[10701]: Nextcloud or one of the apps require upgrade - only a limited number of commands are available
Jun 25 21:46:27 xxxxxxxxxx esmith::event[10701]: You may use your browser or the occ upgrade command to do the upgrade
Jun 25 21:46:27 xxxxxxxxxx esmith::event[10701]: System config value mail_smtpauthtype set to string LOGIN
Jun 25 21:46:27 xxxxxxxxxx su: (to apache) root on none
Jun 25 21:46:29 xxxxxxxxxx esmith::event[10701]: Nextcloud or one of the apps require upgrade - only a limited number of commands are available
Jun 25 21:46:29 xxxxxxxxxx esmith::event[10701]: You may use your browser or the occ upgrade command to do the upgrade
Jun 25 21:46:29 xxxxxxxxxx esmith::event[10701]: System config value mail_from_address set to string no-reply
Jun 25 21:46:29 xxxxxxxxxx su: (to apache) root on none
Jun 25 21:46:30 xxxxxxxxxx esmith::event[10701]: Nextcloud or one of the apps require upgrade - only a limited number of commands are available
Jun 25 21:46:30 xxxxxxxxxx esmith::event[10701]: You may use your browser or the occ upgrade command to do the upgrade
Jun 25 21:46:30 xxxxxxxxxx esmith::event[10701]: System config value mail_domain set to string scbec.org
Jun 25 21:46:30 xxxxxxxxxx su: (to apache) root on none
Jun 25 21:46:30 xxxxxxxxxx esmith::event[10701]: Nextcloud or one of the apps require upgrade - only a limited number of commands are available
Jun 25 21:46:30 xxxxxxxxxx esmith::event[10701]: You may use your browser or the occ upgrade command to do the upgrade
Jun 25 21:46:30 xxxxxxxxxx esmith::event[10701]: System config value mail_smtphost set to string localhost
Jun 25 21:46:30 xxxxxxxxxx su: (to apache) root on none
Jun 25 21:46:31 xxxxxxxxxx esmith::event[10701]: Nextcloud or one of the apps require upgrade - only a limited number of commands are available
Jun 25 21:46:31 xxxxxxxxxx esmith::event[10701]: You may use your browser or the occ upgrade command to do the upgrade
Jun 25 21:46:31 xxxxxxxxxx esmith::event[10701]: System config value mail_smtpport set to string 25
Jun 25 21:46:31 xxxxxxxxxx su: (to apache) root on none
Jun 25 21:46:31 xxxxxxxxxx esmith::event[10701]: Nextcloud or one of the apps require upgrade - only a limited number of commands are available
Jun 25 21:46:31 xxxxxxxxxx esmith::event[10701]: You may use your browser or the occ upgrade command to do the upgrade
Jun 25 21:46:32 xxxxxxxxxx esmith::event[10701]: Set mode for background jobs to ‘cron’
Jun 25 21:46:32 xxxxxxxxxx su: (to apache) root on none
Jun 25 21:46:32 xxxxxxxxxx esmith::event[10701]: Nextcloud or one of the apps require upgrade - only a limited number of commands are available
Jun 25 21:46:32 xxxxxxxxxx esmith::event[10701]: You may use your browser or the occ upgrade command to do the upgrade
Jun 25 21:46:49 xxxxxxxxxx esmith::event[32083]: Action: /etc/e-smith/events/pre-backup-data/S50mysql-dump-tables SUCCESS [975.548832]
Jun 25 21:47:01 xxxxxxxxxx systemd: Created slice User Slice of apache.
Jun 25 21:47:01 xxxxxxxxxx systemd: Started Session 10616 of user apache.
Jun 25 21:47:04 xxxxxxxxxx systemd: Removed slice User Slice of apache.
Jun 25 21:47:04 xxxxxxxxxx esmith::event[10701]: All tables already up to date!
Jun 25 21:47:04 xxxxxxxxxx su: (to apache) root on none
Jun 25 21:47:05 xxxxxxxxxx esmith::event[10701]: Nextcloud or one of the apps require upgrade - only a limited number of commands are available
Jun 25 21:47:05 xxxxxxxxxx esmith::event[10701]: You may use your browser or the occ upgrade command to do the upgrade
Jun 25 21:47:05 xxxxxxxxxx esmith::event[10701]: System config value trusted_domains => 2 set to string 192.168.51.18
Jun 25 21:47:05 xxxxxxxxxx su: (to apache) root on none
Jun 25 21:47:05 xxxxxxxxxx esmith::event[10701]: Nextcloud or one of the apps require upgrade - only a limited number of commands are available
Jun 25 21:47:05 xxxxxxxxxx esmith::event[10701]: You may use your browser or the occ upgrade command to do the upgrade
Jun 25 21:47:05 xxxxxxxxxx esmith::event[10701]: System config value trusted_domains => 3 set to string files.scbec.org
Jun 25 21:47:06 xxxxxxxxxx esmith::event[10701]: (82) GSSAPI Error (init): Unspecified GSS failure. Minor code may provide more information
Jun 25 21:47:06 xxxxxxxxxx esmith::event[10701]: Server not found in Kerberos database
Jun 25 21:47:06 xxxxxxxxxx esmith::event[10701]: Action: /etc/e-smith/events/nethserver-nextcloud-update/S30nethserver-nextcloud-occ-conf FAILED: 82 [58.0007]
Jun 25 21:47:06 xxxxxxxxxx esmith::event[10701]: Previous value found in config file: “false”
Jun 25 21:47:06 xxxxxxxxxx esmith::event[10701]: Changing value to: “false”
Jun 25 21:47:06 xxxxxxxxxx esmith::event[10701]: Saving configuration to : /etc/loolwsd/loolwsd.xml …
Jun 25 21:47:06 xxxxxxxxxx esmith::event[10701]: Saved
Jun 25 21:47:06 xxxxxxxxxx esmith::event[10701]: Previous value found in config file: “true”
Jun 25 21:47:06 xxxxxxxxxx esmith::event[10701]: Changing value to: “true”
Jun 25 21:47:06 xxxxxxxxxx esmith::event[10701]: Saving configuration to : /etc/loolwsd/loolwsd.xml …
Jun 25 21:47:06 xxxxxxxxxx esmith::event[10701]: Saved
Jun 25 21:47:06 xxxxxxxxxx esmith::event[10701]: Previous value found in config file: “loopback”
Jun 25 21:47:06 xxxxxxxxxx esmith::event[10701]: Changing value to: “loopback”
Jun 25 21:47:06 xxxxxxxxxx esmith::event[10701]: Saving configuration to : /etc/loolwsd/loolwsd.xml …
Jun 25 21:47:06 xxxxxxxxxx esmith::event[10701]: Saved
Jun 25 21:47:06 xxxxxxxxxx esmith::event[10701]: Previous value found in config file: “IPv4”
Jun 25 21:47:06 xxxxxxxxxx esmith::event[10701]: Changing value to: “IPv4”
Jun 25 21:47:06 xxxxxxxxxx esmith::event[10701]: Saving configuration to : /etc/loolwsd/loolwsd.xml …
Jun 25 21:47:06 xxxxxxxxxx esmith::event[10701]: Saved
Jun 25 21:47:07 xxxxxxxxxx esmith::event[10701]: Previous value found in config file: “xxxxxxxxxx.scbec.org”
Jun 25 21:47:07 xxxxxxxxxx esmith::event[10701]: Changing value to: “xxxxxxxxxx.scbec.org”
Jun 25 21:47:07 xxxxxxxxxx esmith::event[10701]: Saving configuration to : /etc/loolwsd/loolwsd.xml …
Jun 25 21:47:07 xxxxxxxxxx esmith::event[10701]: Saved
Jun 25 21:47:07 xxxxxxxxxx esmith::event[10701]: Nextcloud or one of the apps require upgrade - only a limited number of commands are available
Jun 25 21:47:07 xxxxxxxxxx esmith::event[10701]: You may use your browser or the occ upgrade command to do the upgrade
Jun 25 21:47:07 xxxxxxxxxx esmith::event[10701]: richdocuments already installed
Jun 25 21:47:07 xxxxxxxxxx esmith::event[10701]: Nextcloud or one of the apps require upgrade - only a limited number of commands are available
Jun 25 21:47:07 xxxxxxxxxx esmith::event[10701]: You may use your browser or the occ upgrade command to do the upgrade
Jun 25 21:47:08 xxxxxxxxxx esmith::event[10701]: Config value wopi_url for app richdocuments set to https://docker.scbec.org
Jun 25 21:47:08 xxxxxxxxxx esmith::event[10701]: Nextcloud or one of the apps require upgrade - only a limited number of commands are available
Jun 25 21:47:08 xxxxxxxxxx esmith::event[10701]: You may use your browser or the occ upgrade command to do the upgrade
Jun 25 21:47:08 xxxxxxxxxx esmith::event[10701]: richdocuments already enabled
Jun 25 21:47:08 xxxxxxxxxx esmith::event[10701]: Action: /etc/e-smith/events/nethserver-nextcloud-update/S70nethserver-collabora-conf SUCCESS [1.941129]
Jun 25 21:47:09 xxxxxxxxxx systemd: Reloading.
Jun 25 21:47:15 xxxxxxxxxx systemd: [/usr/lib/systemd/system/netdata.service:72] Unknown lvalue ‘ProtectControlGroups’ in section ‘Service’
Jun 25 21:47:20 xxxxxxxxxx esmith::event[10701]: [INFO] service httpd restart
Jun 25 21:47:20 xxxxxxxxxx systemd: Stopping The Apache HTTP Server…
Jun 25 21:47:22 xxxxxxxxxx systemd: Started MariaDB 10.5 database server.
Jun 25 21:47:26 xxxxxxxxxx systemd: httpd.service stop-sigterm timed out. Killing.
Jun 25 21:47:27 xxxxxxxxxx systemd: httpd.service: main process exited, code=killed, status=9/KILL
Jun 25 21:47:27 xxxxxxxxxx systemd: Stopped The Apache HTTP Server.
Jun 25 21:47:27 xxxxxxxxxx systemd: Unit httpd.service entered failed state.
Jun 25 21:47:27 xxxxxxxxxx systemd: httpd.service failed.
Jun 25 21:47:27 xxxxxxxxxx systemd: Starting The Apache HTTP Server…
Jun 25 21:47:27 xxxxxxxxxx bash: resource(s) deleted
Jun 25 21:47:31 xxxxxxxxxx systemd: Started The Apache HTTP Server.
Jun 25 21:47:31 xxxxxxxxxx systemd: Reloading.
Jun 25 21:47:31 xxxxxxxxxx systemd: [/usr/lib/systemd/system/netdata.service:72] Unknown lvalue ‘ProtectControlGroups’ in section ‘Service’
Jun 25 21:47:31 xxxxxxxxxx esmith::event[10701]: [INFO] service rh-php73-php-fpm restart
Jun 25 21:47:32 xxxxxxxxxx systemd: Stopping The PHP FastCGI Process Manager…
Jun 25 21:48:00 xxxxxxxxxx systemd: Stopped The PHP FastCGI Process Manager.
Jun 25 21:48:00 xxxxxxxxxx systemd: Starting The PHP FastCGI Process Manager…
Jun 25 21:48:01 xxxxxxxxxx systemd: Created slice User Slice of apache.
Jun 25 21:48:01 xxxxxxxxxx systemd: Started Session 10617 of user apache.
Jun 25 21:48:03 xxxxxxxxxx systemd: Started The PHP FastCGI Process Manager.
Jun 25 21:48:03 xxxxxxxxxx systemd: Removed slice User Slice of apache.
Jun 25 21:48:03 xxxxxxxxxx systemd: Reloading.
Jun 25 21:48:03 xxxxxxxxxx systemd: [/usr/lib/systemd/system/netdata.service:72] Unknown lvalue ‘ProtectControlGroups’ in section ‘Service’
Jun 25 21:48:04 xxxxxxxxxx esmith::event[10701]: [INFO] service rh-mariadb105-mariadb@nextcloud restart
Jun 25 21:48:04 xxxxxxxxxx systemd: Stopping MariaDB 10.5 database server…
Jun 25 21:48:32 xxxxxxxxxx systemd: Stopped MariaDB 10.5 database server.
Jun 25 21:48:32 xxxxxxxxxx systemd: Starting MariaDB 10.5 database server…
Jun 25 21:48:32 xxxxxxxxxx scl: Database MariaDB is probably initialized in /var/opt/rh/rh-mariadb105/lib/mysql-nextcloud already, nothing is done.
Jun 25 21:48:32 xxxxxxxxxx scl: If this is not the case, make sure the /var/opt/rh/rh-mariadb105/lib/mysql-nextcloud is empty before running mysql-prepare-db-dir.
Jun 25 21:48:33 xxxxxxxxxx mysqld-scl-helper: 2021-06-25 21:48:33 0 [Note] /opt/rh/rh-mariadb105/root/usr/libexec/mysqld (mysqld 10.5.8-MariaDB) starting as process 2354 …
Jun 25 21:48:33 xxxxxxxxxx systemd: Started MariaDB 10.5 database server.
Jun 25 21:48:33 xxxxxxxxxx esmith::event[10701]: Action: /etc/e-smith/events/actions/adjust-services SUCCESS [85.170279]
Jun 25 21:48:33 xxxxxxxxxx esmith::event[10701]: Event: nethserver-nextcloud-update FAILED
Jun 25 21:48:43 xxxxxxxxxx esmith::event[2419]: Event: runlevel-adjust
Jun 25 21:48:43 xxxxxxxxxx esmith::event[2419]: expanding /etc/sudoers.d/55_nsapi_perms
Jun 25 21:48:44 xxxxxxxxxx esmith::event[2419]: Action: /etc/e-smith/events/actions/generic_template_expand SUCCESS [0.775046]
We miss the start of the yum transaction
Sorry this took a bit, had to run to an appointment:
Jun 25 17:33:09 xxxxxxxxxx yum[6613]: Installed: rh-mariadb105-runtime-3.7-1.el7.x86_64
Jun 25 17:33:09 xxxxxxxxxx yum[6613]: Installed: 3:rh-mariadb105-mariadb-config-10.5.8-1.el7.x86_64
Jun 25 17:33:10 xxxxxxxxxx yum[6613]: Installed: 3:rh-mariadb105-mariadb-common-10.5.8-1.el7.x86_64
Jun 25 17:33:10 xxxxxxxxxx yum[6613]: Installed: 3:rh-mariadb105-mariadb-errmsg-10.5.8-1.el7.x86_64
Jun 25 17:33:11 xxxxxxxxxx yum[6613]: Installed: 3:rh-mariadb105-mariadb-libs-10.5.8-1.el7.x86_64
Jun 25 17:33:14 xxxxxxxxxx yum[6613]: Installed: 3:rh-mariadb105-mariadb-10.5.8-1.el7.x86_64
Jun 25 17:33:40 xxxxxxxxxx systemd: Reloading.
Jun 25 17:33:41 xxxxxxxxxx systemd: [/usr/lib/systemd/system/netdata.service:72] Unknown lvalue ‘ProtectControlGroups’ in section ‘Service’
Jun 25 17:33:42 xxxxxxxxxx yum[6613]: Installed: 3:rh-mariadb105-mariadb-server-10.5.8-1.el7.x86_64
Jun 25 17:33:43 xxxxxxxxxx yum[6613]: Installed: 3:rh-mariadb105-mariadb-server-utils-10.5.8-1.el7.x86_64
Jun 25 17:33:43 xxxxxxxxxx yum[6613]: Installed: rh-mariadb105-3.7-1.el7.x86_64
Jun 25 17:33:44 xxxxxxxxxx yum[6613]: Installed: nethserver-rh-mariadb105-1.0.0-1.ns7.noarch
Jun 25 17:33:52 xxxxxxxxxx cockpit-ws: WebSocket from 192.168.106.157 for session closed
Jun 25 17:34:01 xxxxxxxxxx systemd: Created slice User Slice of apache.
Jun 25 17:34:01 xxxxxxxxxx systemd: Started Session 10307 of user apache.
Jun 25 17:34:02 xxxxxxxxxx systemd: Removed slice User Slice of apache.
Jun 25 17:35:01 xxxxxxxxxx systemd: Created slice User Slice of apache.
Jun 25 17:35:01 xxxxxxxxxx systemd: Started Session 10309 of user apache.
Jun 25 17:35:01 xxxxxxxxxx systemd: Started Session 10308 of user apache.
Jun 25 17:37:01 xxxxxxxxxx collectd[25442]: Not sleeping because the next interval is 33.379 seconds in the past!
Jun 25 17:37:03 xxxxxxxxxx collectd[25442]: plugin_read_thread: read-function of theprocesses' plugin took 62.989 seconds, which is above its read interval (10.000 seconds). You might want to adjust theInterval’ orReadThreads' settings. Jun 25 17:37:03 xxxxxxxxxx collectd[25442]: plugin_read_thread: read-function of theuptime’ plugin took 45.609 seconds, which is above its read interval (10.000 seconds). You might want to adjust theInterval' orReadThreads’ settings.
Jun 25 17:37:03 xxxxxxxxxx collectd[25442]: plugin_read_thread: read-function of themd' plugin took 52.998 seconds, which is above its read interval (10.000 seconds). You might want to adjust theInterval’ orReadThreads' settings. Jun 25 17:37:03 xxxxxxxxxx collectd[25442]: plugin_read_thread: read-function of thecpu’ plugin took 53.604 seconds, which is above its read interval (10.000 seconds). You might want to adjust theInterval' orReadThreads’ settings.
Jun 25 17:37:03 xxxxxxxxxx collectd[25442]: plugin_read_thread: read-function of theload' plugin took 49.359 seconds, which is above its read interval (10.000 seconds). You might want to adjust theInterval’ or `ReadThreads’ settings.
Jun 25 17:37:04 xxxxxxxxxx dbus[592]: [system] Activating via systemd: service name=‘org.freedesktop.timedate1’ unit=‘dbus-org.freedesktop.timedate1.service’
Jun 25 17:37:04 xxxxxxxxxx systemd: Starting Time & Date Service…
Jun 25 17:37:05 xxxxxxxxxx systemd: Started Session 10310 of user apache.
Jun 25 17:37:05 xxxxxxxxxx systemd: Started Session 10311 of user apache.
Jun 25 17:37:05 xxxxxxxxxx dbus[592]: [system] Successfully activated service ‘org.freedesktop.timedate1’
Jun 25 17:37:05 xxxxxxxxxx systemd: Started Time & Date Service.
Next line occurs many times
Jun 25 17:37:05 xxxxxxxxxx collectd[25442]: rrdtool plugin: rrd_update_r (/var/lib/collectd/rrd/xxxxxxxxxx.xxxxxxxxxx.org/swap/swap_io-out.rrd) failed: /var/lib/collectd/rrd/xxxxxxxxxx.xxxxxxxxxx.org/swap/swap_io-out.rrd: illegal attempt to update using time 1624667821 when last update time is 1624667821 (minimum one second step)
Jun 25 17:37:05 xxxxxxxxxx collectd[25442]: Not sleeping because the next interval is 60.235 seconds in the past!
Jun 25 17:37:08 xxxxxxxxxx smbd[10235]: [2021/06/25 17:37:08.065742, 0] …/…/lib/param/loadparm.c:1861(lpcfg_do_service_parameter)
Jun 25 17:37:08 xxxxxxxxxx smbd[10235]: Global parameter printcap name found in service section!
Jun 25 17:37:09 xxxxxxxxxx systemd: Started Session c76651 of user administrator@xxxxxxxxxx.org.
Jun 25 17:37:09 xxxxxxxxxx systemd-logind: New session c76651 of user administrator@xxxxxxxxxx.org.
Jun 25 17:37:09 xxxxxxxxxx systemd-logind: Removed session c53021.
Jun 25 17:37:09 xxxxxxxxxx systemd: Removed slice User Slice of tgodinez@xxxxxxxxxx.org.
Jun 25 17:37:10 xxxxxxxxxx systemd-logind: Removed session c32.
Jun 25 17:37:11 xxxxxxxxxx systemd: Removed slice User Slice of apache.
Jun 25 17:37:11 xxxxxxxxxx smbd[10186]: [2021/06/25 17:37:11.087040, 0] …/…/lib/param/loadparm.c:1861(lpcfg_do_service_parameter)
Jun 25 17:37:11 xxxxxxxxxx smbd[10186]: Global parameter printcap name found in service section!
Jun 25 17:37:11 xxxxxxxxxx systemd: Created slice User Slice of tgodinez@xxxxxxxxxx.org.
Jun 25 17:37:11 xxxxxxxxxx systemd: Started Session c76652 of user tgodinez@xxxxxxxxxx.org.
Jun 25 17:37:11 xxxxxxxxxx systemd-logind: New session c76652 of user tgodinez@xxxxxxxxxx.org.
Jun 25 17:37:11 xxxxxxxxxx yum[6613]: Updated: nethserver-nextcloud-1.17.0-1.ns7.noarch
Jun 25 17:37:12 xxxxxxxxxx yum[6613]: Updated: nethserver-netdata-2.0.2-1.ns7.noarch
Jun 25 17:37:30 xxxxxxxxxx esmith::event[10289]: Event: nethserver-netdata-update
Jun 25 17:37:30 xxxxxxxxxx esmith::event[10289]: Migrating existing database configuration
Jun 25 17:37:31 xxxxxxxxxx /etc/e-smith/events/nethserver-netdata-update/S00initialize-default-databases[10290]: /var/lib/nethserver/db/configuration: OLD rh-mariadb105-mariadb@nextcloud=(undefined)
Jun 25 17:37:31 xxxxxxxxxx /etc/e-smith/events/nethserver-netdata-update/S00initialize-default-databases[10290]: /var/lib/nethserver/db/configuration: NEW rh-mariadb105-mariadb@nextcloud=service|access||status|enabled
Jun 25 17:37:31 xxxxxxxxxx esmith::event[10289]: Migrating existing database certificates
Jun 25 17:37:31 xxxxxxxxxx esmith::event[10289]: Migrating existing database networks
Jun 25 17:37:31 xxxxxxxxxx esmith::event[10289]: Migrating existing database routes
Jun 25 17:37:31 xxxxxxxxxx esmith::event[10289]: Migrating existing database accounts
Jun 25 17:37:31 xxxxxxxxxx esmith::event[10289]: Migrating existing database proxypass
Jun 25 17:37:31 xxxxxxxxxx esmith::event[10289]: Migrating existing database dhcp
Jun 25 17:37:31 xxxxxxxxxx esmith::event[10289]: Migrating existing database hosts
Jun 25 17:37:31 xxxxxxxxxx esmith::event[10289]: Migrating existing database backups
Jun 25 17:37:31 xxxxxxxxxx esmith::event[10289]: Migrating existing database fwrules
Jun 25 17:37:31 xxxxxxxxxx esmith::event[10289]: Migrating existing database fwservices
Jun 25 17:37:31 xxxxxxxxxx esmith::event[10289]: Migrating existing database fwtimes
Jun 25 17:37:31 xxxxxxxxxx esmith::event[10289]: Migrating existing database portforward
Jun 25 17:37:31 xxxxxxxxxx esmith::event[10289]: Migrating existing database tc
Jun 25 17:37:31 xxxxxxxxxx esmith::event[10289]: Migrating existing database smarthosts
Jun 25 17:37:31 xxxxxxxxxx esmith::event[10289]: Migrating existing database ips
Jun 25 17:37:31 xxxxxxxxxx esmith::event[10289]: Migrating existing database macs
Jun 25 17:37:31 xxxxxxxxxx esmith::event[10289]: Action: /etc/e-smith/events/nethserver-netdata-update/S00initialize-default-databases SUCCESS [1.446881]
Jun 25 17:37:31 xxxxxxxxxx esmith::event[10289]: expanding /etc/netdata/netdata.conf
Jun 25 17:37:31 xxxxxxxxxx esmith::event[10289]: expanding /etc/netdata/python.d.conf
Jun 25 17:37:31 xxxxxxxxxx esmith::event[10289]: Action: /etc/e-smith/events/actions/generic_template_expand SUCCESS [0.139413]
Jun 25 17:37:31 xxxxxxxxxx systemd: Reloading.
Jun 25 17:37:32 xxxxxxxxxx systemd: [/usr/lib/systemd/system/netdata.service:72] Unknown lvalue ‘ProtectControlGroups’ in section ‘Service’
Jun 25 17:37:32 xxxxxxxxxx esmith::event[10289]: [INFO] service netdata restart
Jun 25 17:37:32 xxxxxxxxxx systemd: Stopping Real time performance monitoring…
Jun 25 17:38:01 xxxxxxxxxx systemd: Created slice User Slice of apache.
Jun 25 17:38:01 xxxxxxxxxx systemd: Started Session 10312 of user apache.
Jun 25 17:38:02 xxxxxxxxxx systemd: Stopped Real time performance monitoring.
Jun 25 17:38:02 xxxxxxxxxx systemd: Starting Real time performance monitoring…
Jun 25 17:38:04 xxxxxxxxxx systemd: Removed slice User Slice of apache.
Jun 25 17:38:05 xxxxxxxxxx systemd: Started Real time performance monitoring.
Jun 25 17:38:05 xxxxxxxxxx esmith::event[10289]: Action: /etc/e-smith/events/actions/adjust-services SUCCESS [33.315853]
Jun 25 17:38:05 xxxxxxxxxx esmith::event[10289]: Event: nethserver-netdata-update SUCCESS
Jun 25 17:38:05 xxxxxxxxxx netdata: CONFIG: cannot load cloud config ‘/var/lib/netdata/cloud.d/cloud.conf’. Running with internal defaults.
Jun 25 17:38:05 xxxxxxxxxx netdata: 2021-06-25 17:38:05: netdata INFO : MAIN : CONFIG: cannot load cloud config ‘/var/lib/netdata/cloud.d/cloud.conf’. Running with internal defaults.
Jun 25 17:38:05 xxxxxxxxxx netdata: TIMEZONE: using the link of /etc/localtime: ‘America/Los_Angeles’
Jun 25 17:38:05 xxxxxxxxxx netdata: 2021-06-25 17:38:05: netdata INFO : MAIN : TIMEZONE: using the link of /etc/localtime: ‘America/Los_Angeles’
Jun 25 17:38:05 xxxxxxxxxx netdata: TIMEZONE: fixed as ‘America/Los_Angeles’
Jun 25 17:38:05 xxxxxxxxxx netdata: 2021-06-25 17:38:05: netdata INFO : MAIN : TIMEZONE: fixed as 'America/Los_Angeles’Jun 25 17:38:05 xxxxxxxxxx netdata: SIGNAL: Not enabling reaper
Jun 25 17:38:05 xxxxxxxxxx netdata: 2021-06-25 17:38:05: netdata INFO : MAIN : SIGNAL: Not enabling reaper
Jun 25 17:38:05 xxxxxxxxxx esmith::event[10682]: Event: nethserver-rh-mariadb105-update
Jun 25 17:38:05 xxxxxxxxxx esmith::event[10682]: expanding /etc/opt/rh/rh-mariadb105/my.cnf.d/mariadb-server.cnf
Jun 25 17:38:05 xxxxxxxxxx esmith::event[10682]: Action: /etc/e-smith/events/actions/generic_template_expand SUCCESS [0.120244]
Jun 25 17:38:05 xxxxxxxxxx esmith::event[10682]: Event: nethserver-rh-mariadb105-update SUCCESS
Jun 25 17:38:05 xxxxxxxxxx esmith::event[10701]: Event: nethserver-nextcloud-update
Jun 25 17:38:05 xxxxxxxxxx esmith::event[10701]: Migrating existing database configuration
Jun 25 17:38:07 xxxxxxxxxx esmith::event[10701]: Migrating existing database certificates
Jun 25 17:38:07 xxxxxxxxxx esmith::event[10701]: Migrating existing database networks
Jun 25 17:38:07 xxxxxxxxxx esmith::event[10701]: Migrating existing database routes
Jun 25 17:38:07 xxxxxxxxxx esmith::event[10701]: Migrating existing database accounts
Jun 25 17:38:07 xxxxxxxxxx esmith::event[10701]: Migrating existing database proxypass
Jun 25 17:38:07 xxxxxxxxxx esmith::event[10701]: Migrating existing database dhcp
Jun 25 17:38:07 xxxxxxxxxx esmith::event[10701]: Migrating existing database hosts
Jun 25 17:38:07 xxxxxxxxxx esmith::event[10701]: Migrating existing database backups
Jun 25 17:38:07 xxxxxxxxxx esmith::event[10701]: Migrating existing database fwrules
Jun 25 17:38:07 xxxxxxxxxx esmith::event[10701]: Migrating existing database fwservices
Jun 25 17:38:07 xxxxxxxxxx esmith::event[10701]: Migrating existing database fwtimes
Jun 25 17:38:07 xxxxxxxxxx esmith::event[10701]: Migrating existing database portforward
Jun 25 17:38:07 xxxxxxxxxx esmith::event[10701]: Migrating existing database tc
Jun 25 17:38:07 xxxxxxxxxx esmith::event[10701]: Migrating existing database smarthosts
Jun 25 17:38:07 xxxxxxxxxx esmith::event[10701]: Migrating existing database ips
Jun 25 17:38:07 xxxxxxxxxx esmith::event[10701]: Migrating existing database macs
Jun 25 17:38:07 xxxxxxxxxx esmith::event[10701]: Action: /etc/e-smith/events/nethserver-nextcloud-update/S00initialize-default-databases SUCCESS [2.574879]
Jun 25 17:38:07 xxxxxxxxxx esmith::event[10701]: expanding /etc/httpd/conf.d/default-virtualhost.inc
Jun 25 17:38:08 xxxxxxxxxx esmith::event[10701]: expanding /etc/httpd/conf.d/nethserver.conf
Jun 25 17:38:08 xxxxxxxxxx esmith::event[10701]: expanding /etc/httpd/conf.d/nextcloud.conf
Jun 25 17:38:08 xxxxxxxxxx esmith::event[10701]: expanding /etc/httpd/conf.d/zz_nextcloud.conf
Jun 25 17:38:08 xxxxxxxxxx esmith::event[10701]: expanding /etc/opt/rh/rh-mariadb105/my.cnf.d/mariadb-server.cnf
Jun 25 17:38:08 xxxxxxxxxx esmith::event[10701]: Action: /etc/e-smith/events/actions/generic_template_expand SUCCESS [0.340595]
Jun 25 17:38:08 xxxxxxxxxx systemd: Created slice system-rh\x2dmariadb105\x2dmariadb.slice.
Jun 25 17:38:08 xxxxxxxxxx systemd: Starting MariaDB 10.5 database server…
Jun 25 17:38:08 xxxxxxxxxx scl: Initializing MariaDB database
Jun 25 17:38:14 xxxxxxxxxx scl: Two all-privilege accounts were created.
Jun 25 17:38:14 xxxxxxxxxx scl: One is root@localhost, it has no password, but you need to
Jun 25 17:38:14 xxxxxxxxxx scl: be system ‘root’ user to connect. Use, for example, sudo mysql
Jun 25 17:38:14 xxxxxxxxxx scl: The second is mysql@localhost, it has no password either, but
Jun 25 17:38:14 xxxxxxxxxx scl: you need to be the system ‘mysql’ user to connect.
Jun 25 17:38:14 xxxxxxxxxx scl: After connecting you can set the password, if you would need to be
Jun 25 17:38:14 xxxxxxxxxx scl: able to connect as any of these users with a password and without sudo
Jun 25 17:38:14 xxxxxxxxxx scl: See the MariaDB Knowledgebase at MariaDB Knowledge Base or the
Jun 25 17:38:14 xxxxxxxxxx scl: MySQL manual for more instructions.
Jun 25 17:38:14 xxxxxxxxxx scl: Please report any problems at https://mariadb.org/jira
Jun 25 17:38:14 xxxxxxxxxx scl: The latest information about MariaDB is available at https://mariadb.org/.
Jun 25 17:38:14 xxxxxxxxxx scl: You can find additional information about the MySQL part at:
Jun 25 17:38:14 xxxxxxxxxx scl: https://dev.mysql.com
Jun 25 17:38:14 xxxxxxxxxx scl: Consider joining MariaDB’s strong and vibrant community:
Jun 25 17:38:14 xxxxxxxxxx scl: Contribute - MariaDB.org
Jun 25 17:38:14 xxxxxxxxxx mysqld-scl-helper: 2021-06-25 17:38:14 0 [Note] /opt/rh/rh-mariadb105/root/usr/libexec/mysqld (mysqld 10.5.8-MariaDB) starting as process 11129 …
Jun 25 17:38:15 xxxxxxxxxx systemd: Started MariaDB 10.5 database server.
Jun 25 17:38:15 xxxxxxxxxx esmith::event[10701]: Database
Jun 25 17:38:15 xxxxxxxxxx esmith::event[10701]: information_schema
Jun 25 17:38:15 xxxxxxxxxx esmith::event[10701]: mysql
Jun 25 17:38:15 xxxxxxxxxx esmith::event[10701]: performance_schema
Jun 25 17:38:15 xxxxxxxxxx esmith::event[10701]: Nextcloud or one of the apps require upgrade - only a limited number of commands are available
Jun 25 17:38:15 xxxxxxxxxx esmith::event[10701]: You may use your browser or the occ upgrade command to do the upgrade
Jun 25 17:38:15 xxxxxxxxxx esmith::event[10701]: System config value loglevel set to integer 2
Jun 25 17:38:16 xxxxxxxxxx esmith::event[10701]: Nextcloud or one of the apps require upgrade - only a limited number of commands are available
Jun 25 17:38:16 xxxxxxxxxx esmith::event[10701]: You may use your browser or the occ upgrade command to do the upgrade
Jun 25 17:38:16 xxxxxxxxxx esmith::event[10701]: Maintenance mode enabled
Jun 25 17:38:16 xxxxxxxxxx esmith::event[10701]: Nextcloud or one of the apps require upgrade - only a limited number of commands are available
Jun 25 17:38:16 xxxxxxxxxx esmith::event[10701]: You may use your browser or the occ upgrade command to do the upgrade
Jun 25 17:38:16 xxxxxxxxxx esmith::event[10701]: Maintenance mode enabled
Jun 25 17:38:16 xxxxxxxxxx esmith::event[10701]: Nextcloud or one of the apps require upgrade - only a limited number of commands are available
Jun 25 17:38:16 xxxxxxxxxx esmith::event[10701]: You may use your browser or the occ upgrade command to do the upgrade
Jun 25 17:38:16 xxxxxxxxxx esmith::event[10701]: accessibility 1.7.0 disabled
Jun 25 17:39:02 xxxxxxxxxx collectd[25442]: rrdtool plugin: rrd_update_r (/var/lib/collectd/rrd/xxxxxxxxxx.xxxxxxxxxx.org/uptime/uptime.rrd) failed: /var/lib/collectd/rrd/xxxxxxxxxx.xxxxxxxxxx.org/uptime/uptime.rrd: illegal attempt to update using time 1624667821 when last update time is 1624667821 (minimum one second step)
Jun 25 17:39:02 xxxxxxxxxx collectd[25442]: rrdtool plugin: rrd_update_r (/var/lib/collectd/rrd/xxxxxxxxxx.xxxxxxxxxx.org/load/load.rrd) failed: /var/lib/collectd/rrd/xxxxxxxxxx.xxxxxxxxxx.org/load/load.rrd: illegal attempt to update using time 1624667821 when last update time is 1624667821 (minimum one second step)
Jun 25 17:39:02 xxxxxxxxxx systemd: Created slice User Slice of apache.
Jun 25 17:39:02 xxxxxxxxxx systemd: Started Session 10313 of user apache.
Jun 25 17:39:10 xxxxxxxxxx systemd: Removed slice User Slice of apache.
Jun 25 17:39:11 xxxxxxxxxx collectd[25442]: rrdtool plugin: rrd_update_r (/var/lib/collectd/rrd/xxxxxxxxxx.xxxxxxxxxx.org/disk-vda2/disk_octets.rrd) failed: /var/lib/collectd/rrd/xxxxxxxxxx.xxxxxxxxxx.org/disk-vda2/disk_octets.rrd: illegal attempt to update using time 1624667821 when last update time is 1624667821 (minimum one second step)
Jun 25 17:39:11 xxxxxxxxxx collectd[25442]: rrdtool plugin: rrd_update_r (/var/lib/collectd/rrd/xxxxxxxxxx.xxxxxxxxxx.org/df-boot/df_complex-free.rrd) failed: /var/lib/collectd/rrd/xxxxxxxxxx.xxxxxxxxxx.org/df-boot/df_complex-free.rrd: illegal attempt to update using time 1624667821 when last update time is 1624667821 (minimum one second step)
Jun 25 17:40:02 xxxxxxxxxx systemd: Created slice User Slice of apache.
Jun 25 17:40:02 xxxxxxxxxx systemd: Started Session 10314 of user apache.
Jun 25 17:40:02 xxxxxxxxxx systemd: Started Session 10315 of user apache.
Jun 25 17:41:02 xxxxxxxxxx systemd: Started Session 10316 of user apache.
Jun 25 17:42:02 xxxxxxxxxx systemd: Started Session 10317 of user apache.
Jun 25 17:42:06 xxxxxxxxxx nms: Services will be checked every 300 seconds…
Jun 25 17:42:06 xxxxxxxxxx nms: PUTNOTIF host=xxxxxxxxxx.xxxxxxxxxx.org plugin=service plugin_instance=rsyslog type=stopped severity=okay time=1624161804 message=“rsyslog is running”
Jun 25 17:42:06 xxxxxxxxxx nms: PUTNOTIF host=xxxxxxxxxx.xxxxxxxxxx.org plugin=service plugin_instance=smartd type=stopped severity=okay time=1624161804 message=“smartd is running”
Jun 25 17:42:06 xxxxxxxxxx nms: PUTNOTIF host=xxxxxxxxxx.xxxxxxxxxx.org plugin=service plugin_instance=loolwsd type=stopped severity=okay time=1624161804 message=“loolwsd is running”
Jun 25 17:42:06 xxxxxxxxxx nms: PUTNOTIF host=xxxxxxxxxx.xxxxxxxxxx.org plugin=service plugin_instance=cups type=stopped severity=okay time=1624161804 message=“cups is running”
Jun 25 17:42:06 xxxxxxxxxx nms: PUTNOTIF host=xxxxxxxxxx.xxxxxxxxxx.org plugin=service plugin_instance=httpd-admin type=stopped severity=okay time=1624161804 message=“httpd-admin is running”
Jun 25 17:42:06 xxxxxxxxxx nms: PUTNOTIF host=xxxxxxxxxx.xxxxxxxxxx.org plugin=service plugin_instance=virgilio type=stopped severity=okay time=1624161804 message=“virgilio is running”
Jun 25 17:42:06 xxxxxxxxxx nms: PUTNOTIF host=xxxxxxxxxx.xxxxxxxxxx.org plugin=service plugin_instance=httpd type=stopped severity=okay time=1624161804 message=“httpd is running”
Jun 25 17:42:06 xxxxxxxxxx nms: PUTNOTIF host=xxxxxxxxxx.xxxxxxxxxx.org plugin=service plugin_instance=rh-php73-php-fpm type=stopped severity=okay time=1624161804 message=“rh-php73-php-fpm is running”
Jun 25 17:42:06 xxxxxxxxxx nms: PUTNOTIF host=xxxxxxxxxx.xxxxxxxxxx.org plugin=service plugin_instance=avahi-daemon type=stopped severity=okay time=1624161804 message=“avahi-daemon is running”
Jun 25 17:42:06 xxxxxxxxxx nms: PUTNOTIF host=xxxxxxxxxx.xxxxxxxxxx.org plugin=service plugin_instance=nms type=stopped severity=okay time=1624161804 message=“nms is running”
Jun 25 17:42:06 xxxxxxxxxx nms: PUTNOTIF host=xxxxxxxxxx.xxxxxxxxxx.org plugin=service plugin_instance=chronyd type=stopped severity=okay time=1624161804 message=“chronyd is running”
Jun 25 17:42:06 xxxxxxxxxx nms: PUTNOTIF host=xxxxxxxxxx.xxxxxxxxxx.org plugin=service plugin_instance=sssd type=stopped severity=okay time=1624161804 message=“sssd is running”
Jun 25 17:42:06 xxxxxxxxxx nms: PUTNOTIF host=xxxxxxxxxx.xxxxxxxxxx.org plugin=service plugin_instance=winbind type=stopped severity=okay time=1624161804 message=“winbind is running”
Jun 25 17:42:06 xxxxxxxxxx nms: PUTNOTIF host=xxxxxxxxxx.xxxxxxxxxx.org plugin=service plugin_instance=nmb type=stopped severity=okay time=1624161804 message=“nmb is running”
Jun 25 17:42:06 xxxxxxxxxx nms: PUTNOTIF host=xxxxxxxxxx.xxxxxxxxxx.org plugin=service plugin_instance=collectd type=stopped severity=okay time=1624161804 message=“collectd is running”
Jun 25 17:42:06 xxxxxxxxxx nms: PUTNOTIF host=xxxxxxxxxx.xxxxxxxxxx.org plugin=service plugin_instance=sshd type=stopped severity=okay time=1624161804 message=“sshd is running”
Jun 25 17:42:06 xxxxxxxxxx nms: PUTNOTIF host=xxxxxxxxxx.xxxxxxxxxx.org plugin=service plugin_instance=rh-php72-php-fpm type=stopped severity=okay time=1624161804 message=“rh-php72-php-fpm is running”
Jun 25 17:42:06 xxxxxxxxxx nms: PUTNOTIF host=xxxxxxxxxx.xxxxxxxxxx.org plugin=service plugin_instance=dnsmasq type=stopped severity=okay time=1624161804 message=“dnsmasq is running”
Jun 25 17:42:06 xxxxxxxxxx nms: PUTNOTIF host=xxxxxxxxxx.xxxxxxxxxx.org plugin=service plugin_instance=yum-cron type=stopped severity=okay time=1624161804 message=“yum-cron is running”
Jun 25 17:42:06 xxxxxxxxxx nms: PUTNOTIF host=xxxxxxxxxx.xxxxxxxxxx.org plugin=service plugin_instance=evebox type=stopped severity=okay time=1624161804 message=“evebox is running”
Jun 25 17:42:06 xxxxxxxxxx nms: PUTNOTIF host=xxxxxxxxxx.xxxxxxxxxx.org plugin=service plugin_instance=fail2ban type=stopped severity=okay time=1624162105 message=“fail2ban is running”
Jun 25 17:42:06 xxxxxxxxxx nms: PUTNOTIF host=xxxxxxxxxx.xxxxxxxxxx.org plugin=service plugin_instance=netdata type=stopped severity=okay time=1624162105 message=“netdata is running”
Jun 25 17:42:06 xxxxxxxxxx nms: PUTNOTIF host=xxxxxxxxxx.xxxxxxxxxx.org plugin=service plugin_instance=shorewall type=stopped severity=okay time=1624162105 message=“shorewall is running”
Jun 25 17:42:06 xxxxxxxxxx nms: PUTNOTIF host=xxxxxxxxxx.xxxxxxxxxx.org plugin=service plugin_instance=mysqld type=stopped severity=okay time=1624162105 message=“mysqld is running”
Jun 25 17:42:06 xxxxxxxxxx nms: PUTNOTIF host=xxxxxxxxxx.xxxxxxxxxx.org plugin=service plugin_instance=smb type=stopped severity=okay time=1624162105 message=“smb is running”
Jun 25 17:42:06 xxxxxxxxxx nms: PUTNOTIF host=xxxxxxxxxx.xxxxxxxxxx.org plugin=service plugin_instance=rh-postgresql94-postgresql type=stopped severity=okay time=1624162105 message=“rh-postgresql94-postgresql is running”
Jun 25 17:42:06 xxxxxxxxxx nms: PUTNOTIF host=xxxxxxxxxx.xxxxxxxxxx.org plugin=service plugin_instance=postfix type=stopped severity=okay time=1624162105 message=“postfix is running”
I think you should send me your log file, we have a gap between 5h30 pm and 9h45 pm the 25 june.
I just sent you a link to the file… I was trying to not post too much.
Blind shot: maybe related to memory consumption.
Will check tomorrow, the TZ is to go to bed here
I got the log, let me dive inside
the error happened at 21h45, this is the code in the action
# Create the database in rh-mariadb105 and import the dump from mariadb55 or exit on error
mysql --socket=/run/rh-mariadb105-mariadb/nextcloud-mysql.sock -e "CREATE DATABASE IF NOT EXISTS nextcloud;"
mysql --socket=/run/rh-mariadb105-mariadb/nextcloud-mysql.sock --database nextcloud < $tmp_sql
if [[ $? -ne 0 ]]; then
exitOnError "[ERROR] Error while restoring nextcloud database to SCL mariadb105"
fi
we succeed to create the database and dumping the old DB, but we failed to restore the database mariadb55 to mariadb105, so mariadb105 is completely empty and you run on the mariadb55.
However between 17h38 and 21h45 your server was just waiting and did nothing. (at least in logs).
do we have more interesting things in (25 june 5h30PM-9h45PM)
/var/log/rh-mariadb105/*nextcloud.log*
please @Socs28 can you share with us about the server, its story and its hardware
The machine is running on a Proxmox VM with 2CPU’s 2cores each and 2G of RAM dedicated to this VM. I’ve raised the RAM to 4G, but didn’t take the chance to shut it down so that could activate before doing the upgrade.
/var/log/rh-mariadb105/nextcloud.log
I will send you a link to that file upload.
How many users you have on your VM, 2gb is a minimum
5 to 10 at a time
got the nextcloud.log file, need to dive inside, but indeed the mysql server instance got an unattended issue. The good new is that you have the old database safe and running, we could think to try to upgrade again, also because you run a VM and you can do a snapshot if you want to go back. However I would like you make also a mysqldump of the mariadb55 before to migrate.
2021-06-25 17:38:15 0 [Note] /opt/rh/rh-mariadb105/root/usr/libexec/mysqld: ready for connections.
Version: '10.5.8-MariaDB' socket: '/run/rh-mariadb105-mariadb/nextcloud-mysql.sock' port: 0 MariaDB Server
2021-06-25 20:09:53 0 [Warning] InnoDB: A long semaphore wait:
--Thread 140303167837952 has waited at btr0cur.cc line 1480 for 241.00 seconds the semaphore:
SX-lock on RW-latch at 0x7f9aa421be90 created in file dict0dict.cc line 2161
a writer (thread id 140303193323264) has reserved it in mode SX
number of readers 0, waiters flag 1, lock_word: 10000000
Last time write locked in file dict0stats.cc line 1969
2021-06-25 20:09:53 0 [Note] InnoDB: A semaphore wait:
--Thread 140303167837952 has waited at btr0cur.cc line 1480 for 241.00 seconds the semaphore:
SX-lock on RW-latch at 0x7f9aa421be90 created in file dict0dict.cc line 2161
a writer (thread id 140303193323264) has reserved it in mode SX
number of readers 0, waiters flag 1, lock_word: 10000000
Last time write locked in file dict0stats.cc line 1969
InnoDB: ###### Starts InnoDB Monitor for 30 secs to print diagnostic info:
InnoDB: Pending reads 0, writes 0
InnoDB: ###### Diagnostic info printed to the standard error streamYes, I will do a snapshot and a mysqldump first. What command will I run to get the database to migrate? In order to get Nextcloud out of the locked state, I ran the manual upgrade from occ so Nextcloud is already 21.0.2, but running on the 5.5 database.
we need to investigate why it failed before to going on
this is the resources we gave to innodb, maybe in some cases we need more
/etc/opt/rh/rh-mariadb105/my.cnf.d/mariadb-server.cnf:30:innodb_large_prefix=on
/etc/opt/rh/rh-mariadb105/my.cnf.d/mariadb-server.cnf:31:innodb_file_format=barracuda
/etc/opt/rh/rh-mariadb105/my.cnf.d/mariadb-server.cnf:32:innodb_file_per_table=1
/etc/opt/rh/rh-mariadb105/my.cnf.d/mariadb-server.cnf:36:innodb_buffer_pool_size = 128M
/etc/opt/rh/rh-mariadb105/my.cnf.d/mariadb-server.cnf:37:innodb_buffer_pool_instances = 1
/etc/opt/rh/rh-mariadb105/my.cnf.d/mariadb-server.cnf:38:innodb_flush_log_at_trx_commit = 2
/etc/opt/rh/rh-mariadb105/my.cnf.d/mariadb-server.cnf:39:innodb_log_buffer_size = 32M
/etc/opt/rh/rh-mariadb105/my.cnf.d/mariadb-server.cnf:40:innodb_max_dirty_pages_pct = 90
in fact we introduced a lof of steps with tests before to go to the next migration step. We decided to let the nextcloud locked because it forces sysadmin to react and say hey there is something wrong.