Backup (data): [ERROR] missing backup-config .md5 file

NethServer Version: 7.4.1708 (beta1)
Module: Backup (data); Samba 4.7.0

Hi guys,

Please help me with the following issue.
I have two NS Servers.
One is DC-AD/FS server and the other is BKP server.
On BKP server I have created a NFS shared folder in which I want to make the backup of the DC-AD/FS server. On BKP server I have installed NFS by @stephdl .
On DC-AD/FS server I have configured Backup (data) to the NFS Share.

During the back-up process, there are some errors, even the archives are created on NFS shared folder.

TIA,
Gabriel

EDIT:
BKP is joined to DC-AD.

Oct  9 15:22:05 pdc-ad /sbin/e-smith/db[3014]: /var/lib/nethserver/db/configuration: OLD backup-data=configuration|BackupTime|15:20|CleanupOlderThan|never|FullDay|6|LogFile|/var/log/last-backup.log|Mount|/mnt/backup|NFSHost|192.168.1.4|NFSShare|/var/lib/nethserver/ibay/bkp-ad|Program|duplicity|SMBHost||SMBLogin||SMBPassword||SMBShare||Type|full|USBLabel||VFSType|nfs|VolSize|250|WebDAVLogin||WebDAVPassword||WebDAVUrl||notify|always|notifyFrom|gabriel.gheorghiu@abt.ro|notifyTo|gabriel.gheorghiu@abt.ro|status|enabled
Oct  9 15:22:05 pdc-ad /sbin/e-smith/db[3014]: /var/lib/nethserver/db/configuration: NEW backup-data=configuration|BackupTime|15:23|CleanupOlderThan|never|FullDay|6|LogFile|/var/log/last-backup.log|Mount|/mnt/backup|NFSHost|192.168.1.4|NFSShare|/var/lib/nethserver/ibay/bkp-ad|Program|duplicity|SMBHost||SMBLogin||SMBPassword||SMBShare||Type|full|USBLabel||VFSType|nfs|VolSize|250|WebDAVLogin||WebDAVPassword||WebDAVUrl||notify|always|notifyFrom|gabriel.gheorghiu@abt.ro|notifyTo|gabriel.gheorghiu@abt.ro|status|enabled
Oct  9 15:22:05 pdc-ad dbus[649]: [system] Activating via systemd: service name='org.freedesktop.timedate1' unit='dbus-org.freedesktop.timedate1.service'
Oct  9 15:22:05 pdc-ad dbus-daemon: dbus[649]: [system] Activating via systemd: service name='org.freedesktop.timedate1' unit='dbus-org.freedesktop.timedate1.service'
Oct  9 15:22:05 pdc-ad systemd: Starting Time & Date Service...
Oct  9 15:22:05 pdc-ad dbus[649]: [system] Successfully activated service 'org.freedesktop.timedate1'
Oct  9 15:22:05 pdc-ad dbus-daemon: dbus[649]: [system] Successfully activated service 'org.freedesktop.timedate1'
Oct  9 15:22:05 pdc-ad systemd: Started Time & Date Service.
Oct  9 15:22:05 pdc-ad esmith::event[3019]: Event: nethserver-backup-data-save
Oct  9 15:22:05 pdc-ad esmith::event[3019]: expanding /etc/cron.d/backup-data
Oct  9 15:22:06 pdc-ad esmith::event[3019]: expanding /etc/davfs2/davfs2.conf
Oct  9 15:22:06 pdc-ad esmith::event[3019]: expanding /etc/davfs2/secrets
Oct  9 15:22:06 pdc-ad esmith::event[3019]: Action: /etc/e-smith/events/actions/generic_template_expand SUCCESS [0.461568]
Oct  9 15:22:06 pdc-ad esmith::event[3019]: Event: nethserver-backup-data-save SUCCESS
Oct  9 15:23:01 pdc-ad systemd: Started Session 3 of user root.
Oct  9 15:23:01 pdc-ad systemd: Starting Session 3 of user root.
Oct  9 15:23:01 pdc-ad esmith::event[3133]: Event: pre-backup-data
Oct  9 15:23:02 pdc-ad esmith::event[3139]: Event: pre-backup-config
Oct  9 15:23:02 pdc-ad esmith::event[3139]: expanding /etc/backup-config.d/nethserver-sssd.include
Oct  9 15:23:02 pdc-ad dbus[649]: [system] Activating via systemd: service name='org.freedesktop.timedate1' unit='dbus-org.freedesktop.timedate1.service'
Oct  9 15:23:02 pdc-ad dbus-daemon: dbus[649]: [system] Activating via systemd: service name='org.freedesktop.timedate1' unit='dbus-org.freedesktop.timedate1.service'
Oct  9 15:23:02 pdc-ad systemd: Starting Time & Date Service...
Oct  9 15:23:02 pdc-ad dbus[649]: [system] Successfully activated service 'org.freedesktop.timedate1'
Oct  9 15:23:02 pdc-ad dbus-daemon: dbus[649]: [system] Successfully activated service 'org.freedesktop.timedate1'
Oct  9 15:23:02 pdc-ad systemd: Started Time & Date Service.
Oct  9 15:23:02 pdc-ad esmith::event[3139]: Action: /etc/e-smith/events/actions/generic_template_expand SUCCESS [0.474077]
Oct  9 15:23:04 pdc-ad esmith::event[3139]: Error while backing up /var/lib/machines/nsdc/var/lib/samba/private/netlogon_creds_cli.tdb!
Oct  9 15:23:04 pdc-ad esmith::event[3139]: Action: /etc/e-smith/events/pre-backup-config/S40nethserver-dc-pre-backup FAILED: 1 [1.527538]
Oct  9 15:23:04 pdc-ad esmith::event[3139]: Action: /etc/e-smith/events/pre-backup-config/S40nethserver-sssd-backup-tdb SUCCESS [0.023979]
Oct  9 15:23:05 pdc-ad esmith::event[3139]: Action: /etc/e-smith/events/pre-backup-config/S50nethserver-backup-config-list-packages SUCCESS [1.464923]
Oct  9 15:23:05 pdc-ad esmith::event[3139]: Event: pre-backup-config FAILED
Oct  9 15:23:05 pdc-ad esmith::event[3133]: Action: /etc/e-smith/events/pre-backup-data/S20nethserver-backup-config-predatabackup SUCCESS [4.265605]
Oct  9 15:23:07 pdc-ad esmith::event[3133]: Action: /etc/e-smith/events/pre-backup-data/S20nethserver-restore-data-duc-index SUCCESS [1.270188]
Oct  9 15:23:07 pdc-ad esmith::event[3133]: Action: /etc/e-smith/events/pre-backup-data/S50mysql-dump-tables SUCCESS [0.640723]
Oct  9 15:23:07 pdc-ad esmith::event[3133]: Action: /etc/e-smith/events/pre-backup-data/S50nethserver-ibays-dump-acls SUCCESS [0.017535]
Oct  9 15:23:08 pdc-ad esmith::event[3133]: Action: /etc/e-smith/events/pre-backup-data/S70mount-cifs SUCCESS [0.315935]
Oct  9 15:23:08 pdc-ad esmith::event[3133]: Action: /etc/e-smith/events/pre-backup-data/S70mount-nfs SUCCESS [0.792152]
Oct  9 15:23:09 pdc-ad esmith::event[3133]: Action: /etc/e-smith/events/pre-backup-data/S70mount-usb SUCCESS [0.303848]
Oct  9 15:23:09 pdc-ad esmith::event[3133]: Action: /etc/e-smith/events/pre-backup-data/S70mount-webdav SUCCESS [0.315459]
Oct  9 15:23:09 pdc-ad esmith::event[3133]: Event: pre-backup-data SUCCESS
Oct  9 15:23:10 pdc-ad esmith::event[3452]: Event: post-backup-data
Oct  9 15:23:10 pdc-ad esmith::event[3452]: [ERROR] missing backup-config .md5 file
Oct  9 15:23:10 pdc-ad esmith::event[3452]: Action: /etc/e-smith/events/post-backup-data/S20nethserver-backup-config-push2history FAILED: 1 [0.013108]
Oct  9 15:23:11 pdc-ad esmith::event[3452]: cp: cannot stat ‘/var/lib/nethserver/backup/backup-config.tar.xz’: No such file or directory
Oct  9 15:23:11 pdc-ad esmith::event[3452]: Action: /etc/e-smith/events/post-backup-data/S20nethserver-backup-config-push2mount FAILED: 1 [0.593363]
Oct  9 15:23:11 pdc-ad esmith::event[3452]: Action: /etc/e-smith/events/post-backup-data/S50mysql-delete-dumped-tables SUCCESS [0.015533]
Oct  9 15:23:11 pdc-ad esmith::event[3452]: Action: /etc/e-smith/events/post-backup-data/S70cleanup-data-duplicity SUCCESS [0.318847]
Oct  9 15:23:11 pdc-ad esmith::event[3452]: Action: /etc/e-smith/events/post-backup-data/S70cleanup-restore-index SUCCESS [0.296258]
Oct  9 15:23:12 pdc-ad esmith::event[3452]: Action: /etc/e-smith/events/post-backup-data/S70disk-usage SUCCESS [0.640295]
Oct  9 15:23:12 pdc-ad esmith::event[3452]: Action: /etc/e-smith/events/post-backup-data/S80umount-cifs SUCCESS [0.315798]
Oct  9 15:23:13 pdc-ad esmith::event[3452]: Action: /etc/e-smith/events/post-backup-data/S80umount-nfs SUCCESS [0.455212]
Oct  9 15:23:13 pdc-ad esmith::event[3452]: Action: /etc/e-smith/events/post-backup-data/S80umount-usb SUCCESS [0.291651]
Oct  9 15:23:13 pdc-ad esmith::event[3452]: Action: /etc/e-smith/events/post-backup-data/S80umount-webdav SUCCESS [0.291269]
Oct  9 15:23:13 pdc-ad esmith::event[3452]: Event: post-backup-data FAILED

This seems the first error. Did you try to run backup-config from console? Does it fail again?

Hi Davide,

Thank you for your help!

You are right.
I have run backup-config from console and …

Please, will you change the subject of this topic as you think?

This NS is installed from scratch with NS 7.4 beta1 ISO and updated to Samba DC 4.7.0.

The previously NS as DC-AD was updated to 7.4 beta1 and then updated to Samba DC 4.7.0. from 7.3 final and I didn’t have this issue.

Oct 9 18:34:38 pdc-ad esmith::event[17576]: Event: pre-backup-config
Oct 9 18:34:38 pdc-ad esmith::event[17576]: expanding /etc/backup-config.d/nethserver-sssd.include
Oct 9 18:34:38 pdc-ad dbus[649]: [system] Activating via systemd: service name='org.freedesktop.timedate1' unit='dbus-org.freedesktop.timedate1.service' 
Oct 9 18:34:38 pdc-ad dbus-daemon: dbus[649]: [system] Activating via systemd: service name='org.freedesktop.timedate1' unit='dbus-org.freedesktop.timedate1.service' 
Oct 9 18:34:38 pdc-ad systemd: Starting Time & Date Service... 
Oct 9 18:34:38 pdc-ad dbus[649]: [system] Successfully activated service 'org.freedesktop.timedate1' Oct 9 18:34:38 pdc-ad dbus-daemon: dbus[649]: [system] Successfully activated service 'org.freedesktop.timedate1' 
Oct 9 18:34:38 pdc-ad systemd: Started Time & Date Service. 
Oct 9 18:34:38 pdc-ad esmith::event[17576]: Action: /etc/e-smith/events/actions/generic_template_expand SUCCESS [0.457827] 
Oct 9 18:34:39 pdc-ad esmith::event[17576]: Error while backing up /var/lib/machines/nsdc/var/lib/samba/private/netlogon_creds_cli.tdb! 
Oct 9 18:34:40 pdc-ad esmith::event[17576]: Action: /etc/e-smith/events/pre-backup-config/S40nethserver-dc-pre-backup FAILED: 1 [1.245892] 
Oct 9 18:34:40 pdc-ad esmith::event[17576]: Action: /etc/e-smith/events/pre-backup-config/S40nethserver-sssd-backup-tdb SUCCESS [0.025067] 
Oct 9 18:34:41 pdc-ad esmith::event[17576]: Action: /etc/e-smith/events/pre-backup-config/S50nethserver-backup-config-list-packages SUCCESS [1.336321] 
Oct 9 18:34:41 pdc-ad esmith::event[17576]: Event: pre-backup-config FAILED

Try the following commands, to grab more info

# /usr/bin/systemd-run -M nsdc -t /bin/bash
# /usr/bin/tdbbackup /var/lib/samba/private/netlogon_creds_cli.tdb
# ls -l /var/lib/samba/private/netlogon_creds_cli.tdb.*
[root@pdc-ad ~]#
[root@pdc-ad ~]#
[root@pdc-ad ~]# /usr/bin/systemd-run -M nsdc -t /bin/bash
Running as unit run-20011.service.
Press ^] three times within 1s to disconnect TTY.
bash-4.2# /usr/bin/tdbbackup /var/lib/samba/private/netlogon_creds_cli.tdb
tdb_mutex_open_ok[/var/lib/samba/private/netlogon_creds_cli.tdb]: Can use mutexes only with MUTEX_LOCKING or NOLOCK
Failed to open /var/lib/samba/private/netlogon_creds_cli.tdb
bash-4.2#
[root@pdc-ad ~]#
[root@pdc-ad ~]#
1 Like

[root@pdc-ad ~]#
[root@pdc-ad ~]# ls -l /var/lib/samba/private/netlogon_creds_cli.tdb.*
-rw------- 1 root root 24576 Oct 9 19:17 /var/lib/samba/private/netlogon_creds_cli.tdb.bak
[root@pdc-ad ~]#
[root@pdc-ad ~]#

I don’t know if you want from here or from bash.

[root@pdc-ad ~]#
[root@pdc-ad ~]# /usr/bin/systemd-run -M nsdc -t /bin/bash
Running as unit run-20301.service.
Press ^] three times within 1s to disconnect TTY.
bash-4.2# /usr/bin/tdbbackup /var/lib/samba/private/netlogon_creds_cli.tdb
tdb_mutex_open_ok[/var/lib/samba/private/netlogon_creds_cli.tdb]: Can use mutexes only with MUTEX_LOCKING or NOLOCK
Failed to open /var/lib/samba/private/netlogon_creds_cli.tdb
bash-4.2# ls -l /var/lib/samba/private/netlogon_creds_cli.tdb.*
ls: cannot access /var/lib/samba/private/netlogon_creds_cli.tdb.*: No such file or directory
bash-4.2#
[root@pdc-ad ~]#
[root@pdc-ad ~]#
[root@pdc-ad ~]# ls -l /var/lib/samba/private/netlogon_creds_cli.tdb.*
-rw------- 1 root root 24576 Oct  9 19:17 /var/lib/samba/private/netlogon_creds_cli.tdb.bak
[root@pdc-ad ~]#
[root@pdc-ad ~]#

@GG_jr, are you running on a VM snapshot?

@mrmarkuz did you run backup-config against a Samba 4.7.0 DC? Can you reproduce the problem?

Hi Davide,

VM on Proxmox, without snapshots.

No, I’ll try it in the evening…

Hi Davide,

I just made an “experiment”.
Because I didn’t erase the previous DC-AD NS VM Server (updated to 7.4 beta1 and then updated to Samba DC 4.7.0. from 7.3 final), I have run backup-config on it and I have the same error but all backups were OK.

@davidep

Last update on previous DC-AD:

Oct 7 01:00:01 pdc-ad systemd: Created slice User Slice of root. 
Oct 7 01:00:01 pdc-ad systemd: Starting User Slice of root. 
Oct 7 01:00:01 pdc-ad systemd: Started Session 2 of user root. 
Oct 7 01:00:01 pdc-ad systemd: Starting Session 2 of user root. 
Oct 7 01:00:03 pdc-ad esmith::event[5162]: Event: pre-backup-data 
Oct 7 01:00:04 pdc-ad esmith::event[5168]: Event: pre-backup-config 
Oct 7 01:00:05 pdc-ad esmith::event[5168]: expanding /etc/backup-config.d/nethserver-sssd.include 
Oct 7 01:00:05 pdc-ad dbus[602]: [system] Activating via systemd: service name='org.freedesktop.timedate1' unit='dbus-org.freedesktop.timedate1.service' 
Oct 7 01:00:05 pdc-ad dbus-daemon: dbus[602]: [system] Activating via systemd: service name='org.freedesktop.timedate1' unit='dbus-org.freedesktop.timedate1.service' 
Oct 7 01:00:05 pdc-ad systemd: Starting Time & Date Service... 
Oct 7 01:00:05 pdc-ad dbus[602]: [system] Successfully activated service 'org.freedesktop.timedate1' 
Oct 7 01:00:05 pdc-ad dbus-daemon: dbus[602]: [system] Successfully activated service 'org.freedesktop.timedate1' 
Oct 7 01:00:05 pdc-ad systemd: Started Time & Date Service. 
Oct 7 01:00:05 pdc-ad esmith::event[5168]: Action: /etc/e-smith/events/actions/generic_template_expand SUCCESS [0.566844] 
Oct 7 01:00:10 pdc-ad esmith::event[5168]: Error while backing up /var/lib/machines/nsdc/var/lib/samba/private/netlogon_creds_cli.tdb! 
Oct 7 01:00:10 pdc-ad esmith::event[5168]: Action: /etc/e-smith/events/pre-backup-config/S40nethserver-dc-pre-backup FAILED: 1 [5.037842] 
Oct 7 01:00:10 pdc-ad esmith::event[5168]: Action: /etc/e-smith/events/pre-backup-config/S40nethserver-sssd-backup-tdb SUCCESS [0.067966] 
Oct 7 01:00:36 pdc-ad esmith::event[5168]: Action: /etc/e-smith/events/pre-backup-config/S50nethserver-backup-config-list-packages SUCCESS [26.05613] 
Oct 7 01:00:36 pdc-ad esmith::event[5168]: Event: pre-backup-config FAILED 
Oct 7 01:00:36 pdc-ad esmith::event[5162]: Action: /etc/e-smith/events/pre-backup-data/S20nethserver-backup-config-predatabackup SUCCESS [32.944164] 
Oct 7 01:00:59 pdc-ad esmith::event[5162]: Error statting 5138: No such file or directory Oct 7 01:01:01 pdc-ad systemd: Started Session 3 of user root. 
Oct 7 01:01:01 pdc-ad systemd: Starting Session 3 of user root. 
Oct 7 01:01:32 pdc-ad esmith::event[5162]: Action: /etc/e-smith/events/pre-backup-data/S20nethserver-restore-data-duc-index SUCCESS [55.724225] 
Oct 7 01:01:35 pdc-ad esmith::event[5162]: Action: /etc/e-smith/events/pre-backup-data/S50mysql-dump-tables SUCCESS [2.87434] 
Oct 7 01:01:35 pdc-ad esmith::event[5162]: Action: /etc/e-smith/events/pre-backup-data/S50nethserver-ibays-dump-acls SUCCESS [0.287774] 
Oct 7 01:01:35 pdc-ad esmith::event[5162]: Action: /etc/e-smith/events/pre-backup-data/S70mount-cifs SUCCESS [0.344539] 
Oct 7 01:01:36 pdc-ad kernel: FS-Cache: Loaded 
Oct 7 01:01:36 pdc-ad kernel: FS-Cache: Netfs 'nfs' registered for caching 
Oct 7 01:01:36 pdc-ad kernel: Key type dns_resolver registered 
Oct 7 01:01:36 pdc-ad kernel: NFS: Registering the id_resolver key type 
Oct 7 01:01:36 pdc-ad kernel: Key type id_resolver registered 
Oct 7 01:01:36 pdc-ad kernel: Key type id_legacy registered 
Oct 7 01:01:37 pdc-ad esmith::event[5162]: Action: /etc/e-smith/events/pre-backup-data/S70mount-nfs SUCCESS [1.347497] 
Oct 7 01:01:37 pdc-ad esmith::event[5162]: Action: /etc/e-smith/events/pre-backup-data/S70mount-usb SUCCESS [0.292429] 
Oct 7 01:01:37 pdc-ad esmith::event[5162]: Action: /etc/e-smith/events/pre-backup-data/S70mount-webdav SUCCESS [0.313479] 
Oct 7 01:01:37 pdc-ad esmith::event[5162]: Event: pre-backup-data SUCCESS 
Oct 7 01:01:51 pdc-ad esmith::event[5615]: Event: post-backup-data 
Oct 7 01:01:51 pdc-ad esmith::event[5615]: Action: /etc/e-smith/events/post-backup-data/S20nethserver-backup-config-push2history SUCCESS [0.13369] 
Oct 7 01:01:52 pdc-ad esmith::event[5615]: Action: /etc/e-smith/events/post-backup-data/S20nethserver-backup-config-push2mount SUCCESS [0.661154] 
Oct 7 01:01:52 pdc-ad esmith::event[5615]: Action: /etc/e-smith/events/post-backup-data/S50mysql-delete-dumped-tables SUCCESS [0.045988] 
Oct 7 01:01:52 pdc-ad esmith::event[5615]: Action: /etc/e-smith/events/post-backup-data/S70cleanup-data-duplicity SUCCESS [0.31712] 
Oct 7 01:01:53 pdc-ad esmith::event[5615]: Action: /etc/e-smith/events/post-backup-data/S70cleanup-restore-index SUCCESS [0.305662] 
Oct 7 01:01:53 pdc-ad esmith::event[5615]: Action: /etc/e-smith/events/post-backup-data/S70disk-usage SUCCESS [0.347121] 
Oct 7 01:01:53 pdc-ad esmith::event[5615]: Action: /etc/e-smith/events/post-backup-data/S80umount-cifs SUCCESS [0.283973] 
Oct 7 01:01:54 pdc-ad esmith::event[5615]: Action: /etc/e-smith/events/post-backup-data/S80umount-nfs SUCCESS [0.431979] 
Oct 7 01:01:54 pdc-ad esmith::event[5615]: Action: /etc/e-smith/events/post-backup-data/S80umount-usb SUCCESS [0.283584] 
Oct 7 01:01:54 pdc-ad esmith::event[5615]: Action: /etc/e-smith/events/post-backup-data/S80umount-webdav SUCCESS [0.285801] 
Oct 7 01:01:54 pdc-ad esmith::event[5615]: Event: post-backup-data SUCCESS 
Oct 7 01:01:55 pdc-ad systemd: Removed slice User Slice of root. 
Oct 7 01:01:55 pdc-ad systemd: Stopping User Slice of root.

@davidep
cc: @giacomo

I don’t know if matter but now, on the previous NS DC-AD, I saw there is available an update to nethserver-backup-config made by Giacomo on Oct 6 15:00 2017.

I will try the following:

  • I will make a backup on BKP Server (unfortunately I did not keep previous version) without this update to see if it works.
  • I will make the update.
  • I will make another backup on BKP Server with this update to see if it works.

What do you think?

It should not impact on this case.

I cant’ reproduce it here, however let’s wait for Markus…

It works in both cases even if this error is still present:

Oct 10 12:49:04 pdc-ad esmith::event[11718]: Error while backing up /var/lib/machines/nsdc/var/lib/samba/private/netlogon_creds_cli.tdb!

@davidep

I noticed something different in the Samba AD configuration on the two PDC-AD servers.
I configured the two servers in the same way.
FQDN is pdc-ad.abt.ro, the NS Server IP is 192.168.1.2, the AD container’s IP is 192.168.1.3, the same server name, the same Organization contacts, the same passwords, etc.
But:

  • on the server that was installed with NS 7.3 Final ISO, updated to NS 7.4 beta1 and then updated with Samba 4.7.0, Realm is ABT.RO
  • on the server that was installed with NS 7.4 beta1 ISO and updated with Samba 4.7.0, the Realm is AD.ABT.RO

Please see the attached photos.
What is your opinion?

1 Like

The default realm value changed. The UI proposes AD.<domain> as default realm name.

I will try another thing. The easiest way. I will power up another VM.
Maybe something was wrong at installation, updates, …
I will keep you informed. It takes about one hour.

1 Like

Ok but why?

It’s explained here:

http://docs.nethserver.org/en/v7/accounts.html#dns-and-ad-domain

1 Like

Thank you!

This is from NS 7.4 beta 1 or from Samba 4.7.0?
Was not on NS 7.3.

It has been implemented during the Accounts provider page rework, in spring '17.

2 Likes