Slow VM networks/storage?


(Indra) #1

We have a virtual machine running Ubuntu(14.04) with an Alfresco 4.2 installation as our document server. Every few days I backup it’s contents to our NAS by ftp, usually this took about 1 and a half upto 2 hours for backing up some 300Gb. But recently this changed to more than 7 hours and I’m suspecting this to be due to some upgrades. Although I can’t exactly pinpoint which one, since we got 2 major upgrades to the VM system but strangely enough it actually seemd to start after a smaller upgrade in between.

Last time we had a “fast backup” was on 6 Dec from 6:50 till 8:20, next backup on 11 Dec took from 6:30 till 14:00. Every backup afterwards took more than 7 hours.

These are the updates from about that time.

Dec 06 06:24:52 Updated: 10:qemu-img-1.5.3-141.el7_4.4.x86_64
Dec 06 06:24:55 Updated: libvirt-libs-3.2.0-14.el7_4.4.x86_64
Dec 06 06:24:55 Updated: libvirt-daemon-3.2.0-14.el7_4.4.x86_64
Dec 06 06:24:55 Updated: libvirt-daemon-driver-storage-core-3.2.0-14.el7_4.4.x86_64
Dec 06 06:24:55 Updated: libvirt-daemon-driver-network-3.2.0-14.el7_4.4.x86_64
Dec 06 06:24:55 Updated: libvirt-daemon-driver-nwfilter-3.2.0-14.el7_4.4.x86_64
Dec 06 06:24:56 Updated: libvirt-daemon-config-nwfilter-3.2.0-14.el7_4.4.x86_64
Dec 06 06:24:56 Updated: libvirt-daemon-driver-lxc-3.2.0-14.el7_4.4.x86_64
Dec 06 06:24:56 Updated: libvirt-daemon-driver-qemu-3.2.0-14.el7_4.4.x86_64
Dec 06 06:24:56 Updated: libvirt-daemon-config-network-3.2.0-14.el7_4.4.x86_64
Dec 06 06:24:57 Updated: libvirt-daemon-driver-storage-gluster-3.2.0-14.el7_4.4.x86_64
Dec 06 06:24:57 Updated: libvirt-daemon-driver-storage-rbd-3.2.0-14.el7_4.4.x86_64
Dec 06 06:24:57 Updated: libvirt-daemon-driver-storage-mpath-3.2.0-14.el7_4.4.x86_64
Dec 06 06:24:57 Updated: libvirt-daemon-driver-storage-scsi-3.2.0-14.el7_4.4.x86_64
Dec 06 06:24:57 Updated: libvirt-daemon-driver-storage-logical-3.2.0-14.el7_4.4.x86_64
Dec 06 06:24:58 Updated: libvirt-daemon-driver-storage-disk-3.2.0-14.el7_4.4.x86_64
Dec 06 06:24:58 Updated: libvirt-daemon-driver-storage-iscsi-3.2.0-14.el7_4.4.x86_64
Dec 06 06:24:58 Updated: libvirt-daemon-driver-storage-3.2.0-14.el7_4.4.x86_64
Dec 06 06:24:58 Updated: libvirt-daemon-driver-secret-3.2.0-14.el7_4.4.x86_64
Dec 06 06:24:58 Updated: libvirt-daemon-driver-interface-3.2.0-14.el7_4.4.x86_64
Dec 06 06:24:58 Updated: libvirt-daemon-driver-nodedev-3.2.0-14.el7_4.4.x86_64
Dec 06 06:24:59 Updated: libvirt-client-3.2.0-14.el7_4.4.x86_64
Dec 06 06:24:59 Updated: 10:qemu-kvm-common-1.5.3-141.el7_4.4.x86_64
Dec 06 06:25:00 Updated: 10:qemu-kvm-1.5.3-141.el7_4.4.x86_64
Dec 06 06:25:00 Updated: libvirt-3.2.0-14.el7_4.4.x86_64
Dec 06 06:25:00 Updated: nethserver-hosts-1.2.2-1.ns7.noarch
Dec 06 06:25:07 Installed: kernel-3.10.0-693.11.1.el7.x86_64
Dec 06 06:45:21 Updated: glibc-common-2.17-196.el7_4.2.x86_64
Dec 06 06:45:22 Updated: glibc-2.17-196.el7_4.2.x86_64
Dec 06 06:45:22 Updated: libuuid-2.23.2-43.el7_4.2.x86_64
Dec 06 06:45:22 Updated: libblkid-2.23.2-43.el7_4.2.x86_64
Dec 06 06:45:22 Updated: 32:bind-license-9.9.4-51.el7_4.1.noarch
Dec 06 06:45:23 Updated: 32:bind-libs-9.9.4-51.el7_4.1.x86_64
Dec 06 06:45:23 Updated: libmount-2.23.2-43.el7_4.2.x86_64
Dec 06 06:45:23 Updated: glibc-headers-2.17-196.el7_4.2.x86_64
Dec 06 06:45:25 Updated: kernel-tools-libs-3.10.0-693.11.1.el7.x86_64
Dec 06 06:45:25 Updated: selinux-policy-3.13.1-166.el7_4.7.noarch
Dec 06 06:45:36 Updated: selinux-policy-targeted-3.13.1-166.el7_4.7.noarch
Dec 06 06:45:38 Updated: kernel-tools-3.10.0-693.11.1.el7.x86_64
Dec 06 06:45:39 Updated: glibc-devel-2.17-196.el7_4.2.x86_64
Dec 06 06:45:39 Updated: util-linux-2.23.2-43.el7_4.2.x86_64
Dec 06 06:45:39 Updated: 32:bind-utils-9.9.4-51.el7_4.1.x86_64
Dec 06 06:45:39 Updated: 32:bind-libs-lite-9.9.4-51.el7_4.1.x86_64
Dec 06 06:45:40 Updated: cryptsetup-libs-1.7.4-3.el7_4.1.x86_64
Dec 06 06:45:40 Updated: libpciaccess-0.13.4-3.1.el7_4.x86_64
Dec 06 06:45:40 Updated: kmod-libs-20-15.el7_4.6.x86_64
Dec 06 06:45:40 Updated: libstdc++-4.8.5-16.el7_4.1.x86_64
Dec 06 06:45:40 Updated: systemtap-sdt-devel-3.1-4.el7_4.x86_64
Dec 06 06:45:40 Updated: copy-jdk-configs-2.2-5.el7_4.noarch
Dec 06 06:49:16 Updated: libgcc-4.8.5-16.el7_4.1.x86_64
Dec 06 06:49:16 Updated: kmod-20-15.el7_4.6.x86_64
Dec 06 06:49:17 Updated: kernel-headers-3.10.0-693.11.1.el7.x86_64
Dec 06 06:54:47 Updated: libsss_idmap-1.15.2-50.el7_4.8.x86_64
Dec 06 06:54:47 Updated: sssd-client-1.15.2-50.el7_4.8.x86_64
Dec 06 06:54:47 Updated: libsss_sudo-1.15.2-50.el7_4.8.x86_64
Dec 06 06:54:47 Updated: python-sssdconfig-1.15.2-50.el7_4.8.noarch
Dec 06 06:54:47 Updated: libipa_hbac-1.15.2-50.el7_4.8.x86_64
Dec 06 06:54:47 Updated: libsss_autofs-1.15.2-50.el7_4.8.x86_64
Dec 06 06:54:48 Updated: sssd-common-1.15.2-50.el7_4.8.x86_64
Dec 06 06:54:48 Updated: sssd-krb5-common-1.15.2-50.el7_4.8.x86_64
Dec 06 06:54:48 Updated: sssd-common-pac-1.15.2-50.el7_4.8.x86_64
Dec 06 06:54:48 Updated: sssd-ipa-1.15.2-50.el7_4.8.x86_64
Dec 06 06:54:48 Updated: sssd-ad-1.15.2-50.el7_4.8.x86_64
Dec 06 06:54:48 Updated: sssd-ldap-1.15.2-50.el7_4.8.x86_64
Dec 06 06:54:48 Updated: sssd-krb5-1.15.2-50.el7_4.8.x86_64
Dec 06 06:54:48 Updated: sssd-proxy-1.15.2-50.el7_4.8.x86_64
Dec 06 06:54:48 Updated: sssd-1.15.2-50.el7_4.8.x86_64
Dec 06 06:59:48 Updated: python-perf-3.10.0-693.11.1.el7.x86_64
Dec 06 06:59:48 Updated: libobjc-4.8.5-16.el7_4.1.x86_64
Dec 06 10:41:48 Updated: libsss_nss_idmap-1.15.2-50.el7_4.8.x86_64
Dec 06 10:41:48 Updated: sssd-libwbclient-1.15.2-50.el7_4.8.x86_64
Dec 06 10:41:48 Updated: nethserver-sogo-1.6.15-1.ns7.sdl.noarch
Dec 06 10:41:48 Updated: nethserver-dnsmasq-1.6.6-1.ns7.noarch
Dec 06 10:41:48 Updated: libgomp-4.8.5-16.el7_4.1.x86_64
Dec 06 10:41:48 Updated: libsss_certmap-1.15.2-50.el7_4.8.x86_64
Dec 06 10:41:49 Updated: nethserver-dc-1.3.3-1.ns7.x86_64
Dec 06 10:43:14 Updated: nethserver-sogo-1.6.16-1.ns7.sdl.noarch
Dec 12 07:24:15 Updated: libvirt-libs-3.2.0-14.el7_4.5.x86_64
Dec 12 07:24:16 Updated: libvirt-daemon-3.2.0-14.el7_4.5.x86_64
Dec 12 07:24:16 Updated: libvirt-daemon-driver-storage-core-3.2.0-14.el7_4.5.x86_64
Dec 12 07:24:16 Updated: libvirt-daemon-driver-network-3.2.0-14.el7_4.5.x86_64
Dec 12 07:24:16 Updated: libvirt-daemon-driver-nwfilter-3.2.0-14.el7_4.5.x86_64
Dec 12 07:24:16 Updated: postgresql-libs-9.2.23-3.el7_4.x86_64
Dec 12 07:24:18 Updated: postgresql-9.2.23-3.el7_4.x86_64
Dec 12 07:24:18 Updated: libvirt-daemon-config-nwfilter-3.2.0-14.el7_4.5.x86_64
Dec 12 07:24:18 Updated: libvirt-daemon-config-network-3.2.0-14.el7_4.5.x86_64
Dec 12 07:24:18 Updated: libvirt-daemon-driver-qemu-3.2.0-14.el7_4.5.x86_64
Dec 12 07:24:18 Updated: libvirt-daemon-driver-lxc-3.2.0-14.el7_4.5.x86_64
Dec 12 07:24:19 Updated: libvirt-daemon-driver-storage-disk-3.2.0-14.el7_4.5.x86_64
Dec 12 07:24:19 Updated: libvirt-daemon-driver-storage-iscsi-3.2.0-14.el7_4.5.x86_64
Dec 12 07:24:19 Updated: libvirt-daemon-driver-storage-rbd-3.2.0-14.el7_4.5.x86_64
Dec 12 07:24:19 Updated: libvirt-daemon-driver-storage-mpath-3.2.0-14.el7_4.5.x86_64
Dec 12 07:24:19 Updated: libvirt-daemon-driver-storage-gluster-3.2.0-14.el7_4.5.x86_64
Dec 12 07:24:19 Updated: libvirt-daemon-driver-storage-scsi-3.2.0-14.el7_4.5.x86_64
Dec 12 07:24:19 Updated: libvirt-daemon-driver-storage-logical-3.2.0-14.el7_4.5.x86_64
Dec 12 07:24:19 Updated: libvirt-daemon-driver-storage-3.2.0-14.el7_4.5.x86_64
Dec 12 07:24:19 Updated: libvirt-daemon-driver-interface-3.2.0-14.el7_4.5.x86_64
Dec 12 07:24:19 Updated: libvirt-daemon-driver-nodedev-3.2.0-14.el7_4.5.x86_64
Dec 12 07:24:19 Updated: libvirt-daemon-driver-secret-3.2.0-14.el7_4.5.x86_64
Dec 12 07:24:20 Updated: libvirt-client-3.2.0-14.el7_4.5.x86_64
Dec 12 07:24:20 Updated: nethserver-firewall-base-3.2.10-1.ns7.noarch
Dec 12 07:24:20 Updated: nethserver-firewall-base-ui-3.2.10-1.ns7.noarch
Dec 12 07:24:20 Updated: libvirt-3.2.0-14.el7_4.5.x86_64
Dec 12 07:24:21 Updated: postgresql-server-9.2.23-3.el7_4.x86_64
Dec 12 07:24:21 Updated: nethserver-lang-en-1.2.4-1.ns7.noarch
Dec 12 07:24:21 Updated: nethserver-lang-nl-1.2.4-1.ns7.noarch
Dec 12 07:24:21 Updated: nethserver-sogo-1.6.18-1.ns7.sdl.noarch
Dec 12 07:24:22 Updated: php-pear-Mail-Mime-1.10.2-1.el7.noarch

It looks like the first upgrade of the VM drivers happened before the last “fast backup” and the second one after the first “slow backup”. After each update I did reboot the server.


(Michael Kicks) #2

Could you please explicitate the configuration for NethServer host and Ubuntu 14.04 Guest?


(Indra) #3

Sure, what do you need to know, although I doubt it has anything to do with the configuration as nothing changed except for the updates.


(Stefano Zamboni) #4

well… cpu, ram, disk layout…


(Indra) #5

Found the solution, fiddled a bit with the VM configuration and replugged the NAS to the same switch as the server. Now the backup speed is back to what it was before, my fault, thank you for your patience :angel: