Custom data backup

I can’t set an IP address in network settings because the Configuration button is gray.

Here is end of /var/log/masseges file. It started when connaction lost and finish when I can connect with temporary IP:

Feb 4 20:35:48 nethserver sshd[6270]: Timeout, client not responding.
Feb 4 20:35:48 nethserver systemd-logind: Removed session 9.
Feb 4 20:38:23 nethserver systemd-logind: New session 19 of user root.
Feb 4 20:38:54 nethserver systemd: Stopping LSB: Bring up/down networking…
Feb 4 20:38:54 nethserver kernel: br0: port 1(ens33) entered disabled state
Feb 4 20:38:54 nethserver network: A(z) br0 csatoló leállítása: [ OK ]
Feb 4 20:38:54 nethserver kernel: br1: port 2(vb-nsdc) entered disabled state
Feb 4 20:38:54 nethserver kernel: br1: port 1(dummy0) entered disabled state
Feb 4 20:38:54 nethserver network: A(z) br1 csatoló leállítása: [ OK ]
Feb 4 20:38:54 nethserver kernel: device dummy0 left promiscuous mode
Feb 4 20:38:54 nethserver kernel: br1: port 1(dummy0) entered disabled state
Feb 4 20:38:54 nethserver network: A(z) dummy0 csatoló leállítása: [ OK ]
Feb 4 20:38:54 nethserver kernel: device ens33 left promiscuous mode
Feb 4 20:38:54 nethserver kernel: br0: port 1(ens33) entered disabled state
Feb 4 20:38:54 nethserver network: A(z) ens33 csatoló leállítása: [ OK ]
Feb 4 20:38:54 nethserver network: A visszacsatolási eszköz leállítása: [ OK ]
Feb 4 20:38:54 nethserver systemd: Stopped LSB: Bring up/down networking.
Feb 4 20:38:55 nethserver root: Shorewall Stopped
Feb 4 20:38:55 nethserver root: Shorewall Cleared
Feb 4 20:38:55 nethserver kernel: IPv6: ADDRCONF(NETDEV_UP): ens33: link is not ready
Feb 4 20:38:55 nethserver kernel: e1000: ens33 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: None
Feb 4 20:38:55 nethserver kernel: IPv6: ADDRCONF(NETDEV_UP): ens33: link is not ready
Feb 4 20:38:55 nethserver kernel: brtmp: port 1(ens33) entered blocking state
Feb 4 20:38:55 nethserver kernel: brtmp: port 1(ens33) entered disabled state
Feb 4 20:38:55 nethserver kernel: device ens33 entered promiscuous mode
Feb 4 20:38:55 nethserver kernel: e1000: ens33 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: None
Feb 4 20:38:55 nethserver kernel: IPv6: ADDRCONF(NETDEV_CHANGE): ens33: link becomes ready
Feb 4 20:38:55 nethserver kernel: brtmp: port 1(ens33) entered blocking state
Feb 4 20:38:55 nethserver kernel: brtmp: port 1(ens33) entered forwarding state
Feb 4 20:39:20 nethserver cockpit-session: pam_ssh_add: Failed adding some keys
Feb 4 20:39:20 nethserver systemd-logind: New session 21 of user root.
Feb 4 20:39:21 nethserver cockpit-ws: logged in user session
Feb 4 20:39:21 nethserver cockpit-ws: New connection to session from 192.168.1.2
Feb 4 20:39:21 nethserver dbus[802]: [system] Activating via systemd: service name=‘org.freedesktop.hostname1’ unit=‘dbus-org.freedesktop.hostname1.service’
Feb 4 20:39:21 nethserver systemd: Starting Hostname Service…
Feb 4 20:39:21 nethserver dbus[802]: [system] Successfully activated service ‘org.freedesktop.hostname1’
Feb 4 20:39:21 nethserver systemd: Started Hostname Service.
Feb 4 20:39:21 nethserver dbus[802]: [system] Activating via systemd: service name=‘org.freedesktop.timedate1’ unit=‘dbus-org.freedesktop.timedate1.service’
Feb 4 20:39:21 nethserver systemd: Starting Time & Date Service…
Feb 4 20:39:21 nethserver dbus[802]: [system] Successfully activated service ‘org.freedesktop.timedate1’
Feb 4 20:39:21 nethserver systemd: Started Time & Date Service.
Feb 4 20:39:22 nethserver cockpit-bridge: No entry for terminal type “unknown”;
Feb 4 20:39:22 nethserver cockpit-bridge: using dumb terminal settings.
Feb 4 20:39:22 nethserver cockpit-bridge: (A hálózat elérhetetlen): IO::Socket::INET6: connect: A hálózat elérhetetlen
Feb 4 20:39:22 nethserver cockpit-bridge: (A hálózat elérhetetlen): IO::Socket::INET6: connect: A hálózat elérhetetlen
Feb 4 20:39:32 nethserver cockpit-bridge: No entry for terminal type “unknown”;
Feb 4 20:39:32 nethserver cockpit-bridge: using dumb terminal settings.
Feb 4 20:39:32 nethserver cockpit-bridge: No entry for terminal type “unknown”;
Feb 4 20:39:32 nethserver cockpit-bridge: using dumb terminal settings.
Feb 4 20:39:41 nethserver cockpit-bridge: No entry for terminal type “unknown”;
Feb 4 20:39:41 nethserver cockpit-bridge: using dumb terminal settings.
Feb 4 20:39:42 nethserver cockpit-bridge: (A hálózat elérhetetlen): IO::Socket::INET6: connect: A hálózat elérhetetlen
Feb 4 20:39:42 nethserver cockpit-bridge: (A hálózat elérhetetlen): IO::Socket::INET6: connect: A hálózat elérhetetlen
Feb 4 20:41:22 nethserver nmbd[1265]: [2022/02/04 20:41:22.445553, 0] …/…/source3/libsmb/nmblib.c:924(send_udp)
Feb 4 20:41:22 nethserver nmbd[1265]: Packet send failed to 192.168.10.255(138) ERRNO=A hálózat elérhetetlen
Feb 4 20:41:22 nethserver nmbd[1265]: [2022/02/04 20:41:22.446283, 0] …/…/source3/libsmb/nmblib.c:924(send_udp)
Feb 4 20:41:22 nethserver nmbd[1265]: Packet send failed to 192.168.10.255(138) ERRNO=A hálózat elérhetetlen
Feb 4 20:41:31 nethserver systemd: Starting Cleanup of Temporary Directories…
Feb 4 20:41:31 nethserver systemd-tmpfiles: [/etc/tmpfiles.d/opendkim.conf:1] Duplicate line for path “/var/run/opendkim”, ignoring.
Feb 4 20:41:31 nethserver systemd: Started Cleanup of Temporary Directories.
Feb 4 20:42:29 nethserver nmbd[1265]: [2022/02/04 20:42:29.006694, 0] …/…/source3/nmbd/nmbd_become_lmb.c:397(become_local_master_stage2)
Feb 4 20:42:29 nethserver nmbd[1265]: *****
Feb 4 20:42:29 nethserver nmbd[1265]:
Feb 4 20:42:29 nethserver nmbd[1265]: Samba name server NETHSERVER is now a local master browser for workgroup WORKGROUP on subnet 192.168.1.140
Feb 4 20:42:29 nethserver nmbd[1265]:
Feb 4 20:42:29 nethserver nmbd[1265]: *****
Feb 4 20:42:57 nethserver sssd[be[diakont.eu]]: Backend is offline
Feb 4 20:45:46 nethserver cockpit-ws: New connection to session from 192.168.1.2
Feb 4 20:47:27 nethserver nmbd[1265]: [2022/02/04 20:47:27.137985, 0] …/…/source3/libsmb/nmblib.c:924(send_udp)
Feb 4 20:47:27 nethserver nmbd[1265]: Packet send failed to 192.168.10.255(138) ERRNO=A hálózat elérhetetlen
Feb 4 20:47:27 nethserver nmbd[1265]: [2022/02/04 20:47:27.138048, 0] …/…/source3/libsmb/nmblib.c:924(send_udp)
Feb 4 20:47:27 nethserver nmbd[1265]: Packet send failed to 192.168.10.255(138) ERRNO=A hálózat elérhetetlen
Feb 4 20:47:39 nethserver chronyd[808]: Source 193.225.118.163 replaced with 162.159.200.1
Feb 4 20:48:10 nethserver cockpit-ws: Error receiving data: Network is unreachable
Feb 4 20:48:10 nethserver cockpit-ws: error closing web socket stream: Error sending data: Broken pipe
Feb 4 20:48:10 nethserver cockpit-ws: WebSocket from 192.168.1.2 for session closed
Feb 4 20:48:25 nethserver cockpit-ws: session timed out
Feb 4 20:48:26 nethserver systemd-logind: Removed session 2.
Feb 4 20:48:45 nethserver chronyd[808]: Can’t synchronise: no selectable sources
Feb 4 20:49:03 nethserver sshd[10678]: Accepted keyboard-interactive/pam for root from 192.168.1.2 port 53358 ssh2
Feb 4 20:49:03 nethserver systemd-logind: New session 36 of user root.

Could you share a screenshot of the network settings page? I think there should be other interfaces to configure.

Here is a documentation of the network-recovery tool:

You could try to remove the bridge and recreate it.

There’s a warning, maybe you should start over with “Restore network config” enabled:

Restoring a local Samba Active Directory without the Restore network configuration option enabled is highly discouraged. Read carefully this section.

EDIT:

Here are instructions for resetting the network configuration on command line.

1 Like

I made a new Nethserver to test the backups. To do this, I installed CentOS minimal under VMware Player and created a dummy interface as the Green interface. This simulates the VPS service. To do this, I wanted to upload the data and config saved from a working Nethserver.

I would like to install Nethserver on a VPS for a service provider later. For this, however, I need to be able to upload the config and data backups without the network settings because they will definitely change.
I ran the Samba Active Directory reconfiguration again according to the documentation. I can connect for now and everything seems to be working and users have reappeared. Now I’m waiting to see if the problem occurs again … If it’s ok, I’ll upload the data backup.

It would be good to have a scenario on how to migrate Nethserver to VPS …

Usually Disaster recovery should work to migrate to another server.

Another way is rsync.

1 Like

I read and used this to move the server but I ran into the above problems …
Rsync is a good solution for uploading data, but it works fine if I create the config manually on the new server with users, shares, etc together before that.

Hi

I do have to migrate a NethServer this weekend from a Home Installation to a cloud this weekend. As the Home Server contains an extensive media collection which we do not intend to move to the cloud, we need to resize the disk and other considerations…

So I’ll once again use the rsync method, actually glad @mrmarkuz provided a convienient link back to that post so I don’t have only my old notes to rely on… :slight_smile:

A main intention is to reduce the NethServer size from >700 GB down to 3-400 GB for online use. The Home NethServer will remain in situ.

My 2 cents
Andy

1 Like

Hello,
that would interest me too. Would you describe the whole process step by step so that it can be reproduced if necessary?
It would help a lot and maybe it will be revealed why there is a problem with my relocation …
Thanks for your help.

Hi @steve

Sure! I’ll post the steps here when I start (Sunday), and add on to it.
At the end, it will become a howto… :slight_smile:

As I do have quite a few new clients / setups to migrate, it’ll come handy for myself.

Afterthought: I’ll probably create a new Post with rsync in the title and post the link here…

My 2 cents
Andy

@Andy_Wismer
I also wonder below how to you choose the right VPS for your home server. The number of vcpu, the size of RAM would be important. I’m looking for a VPS instead of an Xeon e3-1240 cpu and 32GB of RAM but the RAM is probably too much because my current server uses up to 12GB.
Thank you.

@steve

I run my own hosting environment using Proxmox for my clients… :slight_smile:

:slight_smile:

For your use-case, I’d suggest an 4-8 core CPU - or 4-8 vCPUs, depending on the counting method / Interface. 16 GB RAM would be fine, as 12 GB is not a common value for hosters, and gives you a little reserve for any applications / databases, etc…

This size / dimension, covers almost all common uses for SME clients, even on Proxmox as a VM!
Should cover up to 25-50 users…

My 2 cents
Andy

@Andy_Wismer
I use the server with FreePBX, ZoneMinder and a Windows virtual host but these are not required if I install Nethserver on a VPS from a service provider. I think this will reduce the server load and require less RAM.

If all services are running, the CPU load averages 2 and does not reach 4 on backup. The maximum RAM used is 12 GB. If I stop the unwanted services and the Windows virtual host, the amount of RAM used is approx. It drops to 4-6 GB and the average CPU load drops to 1.

I use Nagios to monitor the server and if I shut these services and virtual host down it will be clear after a while how much resources the server is using this way. The vCPU and RAM requirements may then be determined.

1 Like

@mrmarkuz
I set the backup path on the new Nethserver so that the backup from the working Nethserver is available. Sorry, but restoring the data backup doesn’t work. Clicking Restore will tell me almost immediately that the Data restore was successful. However, no data will be restoreed.

What can I do wrong?

Did you check if the new Nethserver can reach the backup?
Where’s your backup? On a NAS? Which backup engine? duplicity, restic or rsync?

Are there errors in logfile about the not working restore?

@mrmarkuz
I made the backup with rsync on my OwnCloud server which is on a third server. I checked to access OwnCloud and it was a success. I can’t find anything in the messages or other logs.

You may try to restore from command line to maybe get some error output.

You could try to restore a config backup to set the backup path.

I tried to restore data backup from command line but it showed this messages:

[root@nethserver ~]# restore-data -b backuptoowncloud
Restore started at 2022-02-05 17:29:58
Event pre-restore-data: SUCCESS
/sbin/mount.davfs: Warning: can’t write entry into mtab, but will mount the file system anyway at /etc/e-smith/events/actions/mount-webdav line 76.
rsync: change_dir “/mnt/backup-backuptoowncloud/nethserver/latest” failed: No such file or directory (2)

Number of files: 0
Number of created files: 0
Number of deleted files: 0
Number of regular files transferred: 0
Total file size: 0 bytes
Total transferred file size: 0 bytes
Literal data: 0 bytes
Matched data: 0 bytes
File list size: 0
File list generation time: 0.305 seconds
File list transfer time: 0.000 seconds
Total bytes sent: 20
Total bytes received: 12

sent 20 bytes received 12 bytes 21.33 bytes/sec
total size is 0 speedup is 0.00
rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1179) [sender=3.1.2]
Restore failed
Restore: FAIL

What it mean? Can’t connect or doesn’t find backup?

I tried latest config backup restore but it happened yesteday. I recovery Samba active directory and I can connect to Nethserver but I can’t start shorewall…

When restoring data backup, the same thing happens as before.

Do you have a possibility to use another backup engine like duplicity or restic?

There’s a warning about rsync to webdav in the docs:

When using rsync engine, make sure the storage backend supports symbolic and hard links. Please note that NethServer doesn’t support links on Samba shares due to security implications. Also symlinks are not supported on WebDAV.

I don’t understand the backup because I think it only backup data (files) and there can be no soft or hard link between them.

However, I changed the backup engine to duplicity and created a new data backup on the running server. I started the data recovery on the new server and it seems to be working to restore the data but it is not finished yet. When the data restore is complete I will check if everything has been restored.

@mrmarkuz thank you for your help and patience. You have helped a lot with your advice to solve the problem.

Unfortunately, config restore still doesn’t work. Can you even help with that?