NS7 restic Backup reporting false errors

I still have a NS7 running that suddenly started to report restic backups errors (locks) by email while actually the log shows that everything is ok.

The email :

Backup: ecowez-mattlabs
Backup started at 2025-12-18 03:05:02
Pre backup scripts status: SUCCESS
using parent snapshot a1cb7b35

Files:           1 new,   102 changed, 169215 unmodified
Dirs:            1 new,    42 changed, 70459 unmodified
Added to the repo: 97.519 MiB

processed 169318 files, 147.849 GiB in 0:27
snapshot 536659de saved
unable to create lock in backend: repository is already locked by PID 20946 on cloud.ecowez.be by root (UID 0, GID 0)
lock was created at 2025-12-18 03:05:13 (34.529228111s ago)
storage ID 34be9d2b
the `unlock` command can be used to remove stale locks
Cleanup failed
Action 'backup-data-restic ecowez-mattlabs': FAIL
Backup status: FAIL

Log file: /var/log/backup/backup-ecowez-mattlabs-202512180305.log

The log file :

[root@cloud ~]# cat /var/log/backup/backup-ecowez-mattlabs-202512180305.log
Backup: ecowez-mattlabs
Backup started at 2025-12-18 03:05:01
Pre backup scripts status: SUCCESS
using parent snapshot 536659de

Files:        7556 new, 165321 changed,     0 unmodified
Dirs:         1934 new, 70197 changed,     0 unmodified
Added to the repo: 592.576 MiB

processed 172877 files, 150.462 GiB in 8:58
snapshot f269e350 saved
Applying Policy: all snapshots within 7d of the newest
keep 17 snapshots:
ID        Time                 Host             Tags             Reasons    Paths
------------------------------------------------------------------------------------------------------------------
ad67a036  2025-12-12 03:05:17  cloud.ecowez.be  ecowez-mattlabs  within 7d  /opt/mattermost/config/config.json
                                                                            /root
                                                                            /usr/share/nextcloud/config/config.php
                                                                            /var/lib/collectd
                                                                            /var/lib/nethserver
                                                                            /var/lib/redis/rspamd
                                                                            /var/lib/rspamd
                                                                            /var/lib/sogo/backups
                                                                            /var/www/html

eb5909a2  2025-12-12 03:05:21  cloud.ecowez.be  ecowez-mattlabs  within 7d  /opt/mattermost/config/config.json
                                                                            /root
                                                                            /usr/share/nextcloud/config/config.php
                                                                            /var/lib/collectd
                                                                            /var/lib/nethserver
                                                                            /var/lib/redis/rspamd
                                                                            /var/lib/rspamd
                                                                            /var/lib/sogo/backups
                                                                            /var/www/html

ffa1480a  2025-12-13 03:05:15  cloud.ecowez.be  ecowez-mattlabs  within 7d  /opt/mattermost/config/config.json
                                                                            /root
                                                                            /usr/share/nextcloud/config/config.php
                                                                            /var/lib/collectd
                                                                            /var/lib/rspamd
                                                                            /var/lib/sogo/backups
                                                                            /var/www/html
------------------------------------------------------------------------------------------------------------------
17 snapshots

remove 3 snapshots:
ID        Time                 Host             Tags             Paths
-------------------------------------------------------------------------------------------------------
1996068c  2025-12-10 13:03:28  cloud.ecowez.be  ecowez-mattlabs  /opt/mattermost/config/config.json
                                                                 /root
                                                                 /usr/share/nextcloud/config/config.php
                                                                 /var/lib/collectd
                                                                 /var/lib/nethserver
                                                                 /var/lib/redis/rspamd
                                                                 /var/lib/rspamd
                                                                 /var/lib/sogo/backups
                                                                 /var/www/html

d6c56419  2025-12-11 03:05:13  cloud.ecowez.be  ecowez-mattlabs  /opt/mattermost/config/config.json
                                                                 /root
                                                                 /usr/share/nextcloud/config/config.php
                                                                 /var/lib/collectd
                                                                 /var/lib/nethserver
                                                                 /var/lib/redis/rspamd
                                                                 /var/lib/rspamd
                                                                 /var/lib/sogo/backups
                                                                 /var/www/html

8e5d2842  2025-12-11 03:05:18  cloud.ecowez.be  ecowez-mattlabs  /opt/mattermost/config/config.json
                                                                 /root
                                                                 /usr/share/nextcloud/config/config.php
                                                                 /var/lib/collectd
                                                                 /var/lib/nethserver
                                                                 /var/lib/redis/rspamd
                                                                 /var/lib/rspamd
                                                                 /var/lib/sogo/backups
                                                                 /var/www/html
-------------------------------------------------------------------------------------------------------
3 snapshots

[0:00] 100.00%  3 / 3 files deleted

Action 'backup-data-restic ecowez-mattlabs': SUCCESS
Post backup scripts status: SUCCESS
Backup status: SUCCESS
Backup ended at 2025-12-18 03:15:06
Time elapsed: 0 hours, 10 minutes, 5 seconds

Strange, isn’t it ? :slight_smile: It took me a while to figure out that nothing was wrong beside the email :wink:

Does it ring a bell to anybody?

The start times from log and mail are different.

Are there more backups running?

db backups show

I noticed it too :thinking:

Yes but not at the same time and different target

[root@cloud ~]# db backups show
ecowez-mattlabs=restic
    B2AccountId=
    B2AccountKey=
    B2Bucket=
    BackupTime=5 3 * * *
    CleanupOlderThan=7D
    FullDay=0
    NFSHost=
    NFSShare=
    Notify=error
    NotifyTo=xxx
    Prune=0
    S3AccessKey=
    S3Bucket=
    S3Host=
    S3SecretKey=
    SMBHost=
    SMBLogin=
    SMBPassword=
    SMBShare=
    SftpDirectory=/mnt/backups/cloud.ecowez.be.backups
    SftpHost=xxx
    SftpPort=22
    SftpUser=root
    Type=full
    USBLabel=
    VFSType=sftp
    VolSize=200
    WebDAVLogin=
    WebDAVPassword=
    WebDAVUrl=
    status=enabled
restic_ecowez=restic
    B2AccountId=
    B2AccountKey=
    B2Bucket=
    BackupTime=0 0 * * *
    CleanupOlderThan=7D
    FullDay=0
    NFSHost=
    NFSShare=
    Notify=error
    NotifyTo=xxx
    Prune=0
    S3AccessKey=
    S3Bucket=
    S3Host=
    S3SecretKey=
    SMBHost=u280704.your-storagebox.de
    SMBLogin=u280704
    SMBPassword=xxx
    SMBShare=backup
    SftpDirectory=
    SftpHost=
    SftpPassword=
    SftpPort=22
    SftpUser=
    Type=incremental
    USBLabel=
    VFSType=webdav
    VolSize=99
    WebDAVLogin=u280704
    WebDAVPassword=xxx
    WebDAVUrl=https://u280704.your-storagebox.de
    status=enabled

1 Like