S20nethserver-duc-index #1 (exit status 256)


(Marko Dargel) #1

NethServer Version: 7.4
Hello,
I got this Error, if try to use Disk Usage–>Update.

These articles couldn’t help me:

Any hints vor me?
Regards, Marko

Ps.:

[root@nethserver /]# df -h
Dateisystem                        Größe Benutzt Verf. Verw% Eingehängt auf
devtmpfs                            3,9G       0  3,9G    0% /dev
tmpfs                               3,9G    153M  3,7G    4% /run
tmpfs                               3,9G       0  3,9G    0% /sys/fs/cgroup
/dev/mapper/centos_nethserver-root   50G    4,0G   47G    8% /
/dev/sda1                          1014M    252M  763M   25% /boot
/dev/mapper/centos_nethserver-home   35G     33M   35G    1% /home
192.168.2.2:/volume1/Daten          7,0T    4,0T  3,1T   57% /mnt/nfs/Synology-Daten
/dev/sdb1                           3,8G     16M  3,6G    1% /mnt/backup


[root@nethserver /]# lsblk
NAME                       MAJ:MIN RM  SIZE RO TYPE MOUNTPOINT
sdb                          8:16   1  3,9G  0 disk
└─sdb1                       8:17   1  3,9G  0 part /mnt/backup
sda                          8:0    0 93,2G  0 disk
├─sda2                       8:2    0 92,2G  0 part
│ ├─centos_nethserver-swap 253:1    0  7,8G  0 lvm  [SWAP]
│ ├─centos_nethserver-home 253:2    0 34,4G  0 lvm  /home
│ └─centos_nethserver-root 253:0    0   50G  0 lvm  /
└─sda1                       8:1    0    1G  0 part /boot

(Michael Träumner) #2

What do you see at

/var/log/messages
after you tried to update?


(Marko Dargel) #3

Hi Michael,
the updates was finished 13:53:31

After this point came such messages:

Mar 12 10:55:54 nethserver dracut: dracut module ‘modsign’ will not be installed, because command ‘keyctl’ could not be found!
Mar 12 10:55:54 nethserver dracut: dracut module ‘busybox’ will not be installed, because command ‘busybox’ could not be found!
Mar 12 10:55:55 nethserver dracut: dracut module ‘ifcfg’ will not be installed, because it’s in the list to be omitted!
Mar 12 10:55:55 nethserver dracut: dracut module ‘plymouth’ will not be installed, because it’s in the list to be omitted!
Mar 12 10:55:55 nethserver dracut: dracut module ‘crypt’ will not be installed, because command ‘cryptsetup’ could not be found!
Mar 12 10:55:55 nethserver dracut: dracut module ‘dmraid’ will not be installed, because command ‘dmraid’ could not be found!
Mar 12 10:55:55 nethserver dracut: dracut module ‘mdraid’ will not be installed, because command ‘mdadm’ could not be found!
Mar 12 10:55:55 nethserver dracut: dracut module ‘multipath’ will not be installed, because command ‘multipath’ could not be found!
Mar 12 10:55:55 nethserver dracut: dracut module ‘cifs’ will not be installed, because command ‘mount.cifs’ could not be found!
Mar 12 10:55:55 nethserver dracut: dracut module ‘iscsi’ will not be installed, because command ‘iscsistart’ could not be found!
Mar 12 10:55:55 nethserver dracut: dracut module ‘iscsi’ will not be installed, because command ‘iscsi-iname’ could not be found!
Mar 12 10:55:55 nethserver dracut: 95nfs: Could not find any command of ‘rpcbind portmap’!
Mar 12 10:55:55 nethserver dracut: dracut module ‘resume’ will not be installed, because it’s in the list to be omitted!
Mar 12 10:55:56 nethserver dracut: dracut module ‘modsign’ will not be installed, because command ‘keyctl’ could not be found!
Mar 12 10:55:56 nethserver dracut: dracut module ‘busybox’ will not be installed, because command ‘busybox’ could not be found!
Mar 12 10:55:57 nethserver dracut: dracut module ‘crypt’ will not be installed, because command ‘cryptsetup’ could not be found!
Mar 12 10:55:57 nethserver dracut: dracut module ‘dmraid’ will not be installed, because command ‘dmraid’ could not be found!
Mar 12 10:55:57 nethserver dracut: dracut module ‘mdraid’ will not be installed, because command ‘mdadm’ could not be found!
Mar 12 10:55:57 nethserver dracut: dracut module ‘multipath’ will not be installed, because command ‘multipath’ could not be found!
Mar 12 10:55:58 nethserver dracut: dracut module ‘cifs’ will not be installed, because command ‘mount.cifs’ could not be found!
Mar 12 10:55:59 nethserver dracut: dracut module ‘iscsi’ will not be installed, because command ‘iscsistart’ could not be found!
Mar 12 10:55:59 nethserver dracut: dracut module ‘iscsi’ will not be installed, because command ‘iscsi-iname’ could not be found!
Mar 12 10:56:01 nethserver dracut: 95nfs: Could not find any command of ‘rpcbind portmap’!

The message block repeats every 5 minutes.

Hope it helps to find the failure.

best regards, Marko


(Filippo Carletti) #4

These messages from dracut can be found on every system, they are “normal”.
But they appear when you update the kernel, not every 5 minutes. You can double check in /var/log/yum.log, you should find kernel at the same time.


(Michael Träumner) #5

@filippo_carletti
If I update the disk usage it looks like this:

Mar 20 09:13:50 groupware esmith::event[29983]: Event: nethserver-duc-save 
Mar 20 09:13:56 groupware esmith::event[29983]: Action: /etc/e-smith/events/nethserver-duc-save/S20nethserver-duc-index SUCCESS [6.5072]
Mar 20 09:13:56 groupware esmith::event[29983]: Event: nethserver-duc-save SUCCESS

I don’t get the messages from dracut, but don’t know why.

@capote
Did you get some other errors before or after the dracat messages?


(Marko Dargel) #6

is that more relevant?

Mar 20 13:55:30 nethserver esmith::event[2647]: Event: nethserver-duc-save
Mar 20 13:55:32 nethserver esmith::event[2647]: fatal error: out of memory
Mar 20 13:55:33 nethserver esmith::event[2647]: Traceback (most recent call last):
Mar 20 13:55:33 nethserver esmith::event[2647]:  File "/usr/share/duc/xml2json.py", line 190, in <module>
Mar 20 13:55:33 nethserver esmith::event[2647]:    main()
Mar 20 13:55:33 nethserver esmith::event[2647]:  File "/usr/share/duc/xml2json.py", line 185, in main
Mar 20 13:55:33 nethserver esmith::event[2647]:    out = xml2json(input, options, strip_ns, strip)
Mar 20 13:55:33 nethserver esmith::event[2647]:  File "/usr/share/duc/xml2json.py", line 154, in xml2json
Mar 20 13:55:33 nethserver esmith::event[2647]:    return elem2json(elem, options, strip_ns=strip_ns, strip=strip)
Mar 20 13:55:33 nethserver esmith::event[2647]:  File "/usr/share/duc/xml2json.py", line 130, in elem2json
Mar 20 13:55:33 nethserver esmith::event[2647]:    child.attrib['size_actual'] = str(int(child.attrib['size_actual']) - size)
Mar 20 13:55:33 nethserver esmith::event[2647]: TypeError: unsupported operand type(s) for -: 'int' and 'NoneType'
Mar 20 13:55:33 nethserver esmith::event[2647]: Action: /etc/e-smith/events/nethserver-duc-save/S20nethserver-duc-index FAILED: 1 [2.481558]
Mar 20 13:55:33 nethserver esmith::event[2647]: Event: nethserver-duc-save FAILED


(Filippo Carletti) #7

Yes! :slight_smile:
Do you have trillions of files?
Could you post the output of df -i ?


(Marko Dargel) #8

You’re funny…:rofl:

This is a pure NethServer installation without any productive data or parallel frameworks like group ware or office communication.

root@nethserver ~]# df -i
Dateisystem                          Inodes IBenutzt    IFrei IUse% Eingehängt auf
devtmpfs                             998296      444   997852    1% /dev
tmpfs                               1001599        1  1001598    1% /dev/shm
tmpfs                               1001599      560  1001039    1% /run
tmpfs                               1001599       17  1001582    1% /sys/fs/cgroup
/dev/mapper/centos_nethserver-root 26214400    91597 26122803    1% /
/dev/sda1                            524288      350   523938    1% /boot
/dev/mapper/centos_nethserver-home 18036736        7 18036729    1% /home
192.168.2.2:/volume1/Daten                0        0        0     - /mnt/nfs/Synology-Daten
tmpfs                               1001599        1  1001598    1% /run/user/0
/dev/sdb1                            253952       28   253924    1% /mnt/backup

    [root@nethserver ~]# lsblk
NAME                       MAJ:MIN RM  SIZE RO TYPE MOUNTPOINT
sdb                          8:16   1  3,9G  0 disk
└─sdb1                       8:17   1  3,9G  0 part /mnt/backup
sda                          8:0    0 93,2G  0 disk
├─sda2                       8:2    0 92,2G  0 part
│ ├─centos_nethserver-swap 253:1    0  7,8G  0 lvm  [SWAP]
│ ├─centos_nethserver-home 253:2    0 34,4G  0 lvm  /home
│ └─centos_nethserver-root 253:0    0   50G  0 lvm  /
└─sda1                       8:1    0    1G  0 part /boot

(Filippo Carletti) #9

I never experienced out of memory problems with duc, it was a shot in the dark.
Now I will focus on that NFS mount. Maybe duc has problems with it. Could you temporarily umount it and run duc?
Run it as below:

bash -x /etc/e-smith/events/actions/nethserver-restore-data-duc-index


(Marko Dargel) #10

Thank you for this try. But it doesn’t change anything, same again.

Mar 20 17:36:41 nethserver esmith::event[15166]: Traceback (most recent call last):
Mar 20 17:36:41 nethserver esmith::event[15166]:  File "/usr/share/duc/xml2json.py", line 190, in <module>
Mar 20 17:36:41 nethserver esmith::event[15166]:    main()
Mar 20 17:36:41 nethserver esmith::event[15166]:  File "/usr/share/duc/xml2json.py", line 185, in main
Mar 20 17:36:41 nethserver esmith::event[15166]:    out = xml2json(input, options, strip_ns, strip)
Mar 20 17:36:41 nethserver esmith::event[15166]:  File "/usr/share/duc/xml2json.py", line 154, in xml2json
Mar 20 17:36:41 nethserver esmith::event[15166]:    return elem2json(elem, options, strip_ns=strip_ns, strip=strip)
Mar 20 17:36:41 nethserver esmith::event[15166]:  File "/usr/share/duc/xml2json.py", line 130, in elem2json
Mar 20 17:36:41 nethserver esmith::event[15166]:    child.attrib['size_actual'] = str(int(child.attrib['size_actual']) - size)
Mar 20 17:36:41 nethserver esmith::event[15166]: TypeError: unsupported operand type(s) for -: 'int' and 'NoneType'
Mar 20 17:36:41 nethserver esmith::event[15166]: Action: /etc/e-smith/events/nethserver-duc-save/S20nethserver-duc-index FAILED: 1 [0.576666]

(Marko Dargel) #11

@filippo_carletti: This massiv increasing of memory using is related with starting the backup process.
today again…

best regards, Marko


(Filippo Carletti) #12

Unfortunately, the problem is not reproducible, it seems to be something related to your system.
With the right expertise, I think it can be discovered, but, as I said, I have no past experience (duc just works).
Could you upload the content of /var/cache/restore/ in an archive somewhere?


(Marko Dargel) #13

Thank you for your commitment.
There you can download the file: https://whisp.ly/r/1lyHBWv#Owhtjt9sDPQ0i

best regards, Marko