S20nethserver-duc-index #1 (exit status 256)

[capote (Marko)]

NethServer Version: 7.4
Hello,
I got this Error, if try to use Disk Usage–>Update.

These articles couldn’t help me:

How to configure the Disk Usage module?

I have mouted some volumes from /etc/fstab ( see below ) Because of this the DUC Index did not work, a white screen and an error "Task completed with errors: S20nethserver-duc-index #1 (exit status 256) apeared in red above a white screen. To solve the problem i removed the block "# remove backup dir elem" from the file //usr/share/duc/xml2json.py This is the part that seems to stop the DUC Index from working. '# remove backup dir elem if(child.attrib[‘name’] == a[0]): size = recToDelete…

Diskusage-module ends in error

Hi all, when updating the ‘disk-usage’ module, this ends in an error: Task completed with errors S20nethserver-duc-index #1 (exit status 256) (that’s on the still white web-page). /var/log/messages tells me: Nov 13 13:56:58 helium esmith::event[6192]: Event: nethserver-duc-save Nov 13 13:56:59 helium esmith::event[6192]: Traceback (most recent call last): Nov 13 13:56:59 helium esmith::event[6192]: File “/usr/share/duc/xml2json.py”, line 184, in Nov 13 13:56:59 helium esmith::event[6…

Any hints vor me?
Regards, Marko

Ps.:

[root@nethserver /]# df -h
Dateisystem                        Größe Benutzt Verf. Verw% Eingehängt auf
devtmpfs                            3,9G       0  3,9G    0% /dev
tmpfs                               3,9G    153M  3,7G    4% /run
tmpfs                               3,9G       0  3,9G    0% /sys/fs/cgroup
/dev/mapper/centos_nethserver-root   50G    4,0G   47G    8% /
/dev/sda1                          1014M    252M  763M   25% /boot
/dev/mapper/centos_nethserver-home   35G     33M   35G    1% /home
192.168.2.2:/volume1/Daten          7,0T    4,0T  3,1T   57% /mnt/nfs/Synology-Daten
/dev/sdb1                           3,8G     16M  3,6G    1% /mnt/backup


[root@nethserver /]# lsblk
NAME                       MAJ:MIN RM  SIZE RO TYPE MOUNTPOINT
sdb                          8:16   1  3,9G  0 disk
└─sdb1                       8:17   1  3,9G  0 part /mnt/backup
sda                          8:0    0 93,2G  0 disk
├─sda2                       8:2    0 92,2G  0 part
│ ├─centos_nethserver-swap 253:1    0  7,8G  0 lvm  [SWAP]
│ ├─centos_nethserver-home 253:2    0 34,4G  0 lvm  /home
│ └─centos_nethserver-root 253:0    0   50G  0 lvm  /
└─sda1                       8:1    0    1G  0 part /boot

[m.traeumner (Michael Träumner)]

What do you see at

/var/log/messages
after you tried to update?

[capote (Marko)]

Hi Michael,
the updates was finished 13:53:31

After this point came such messages:

Mar 12 10:55:54 nethserver dracut: dracut module ‘modsign’ will not be installed, because command ‘keyctl’ could not be found!
Mar 12 10:55:54 nethserver dracut: dracut module ‘busybox’ will not be installed, because command ‘busybox’ could not be found!
Mar 12 10:55:55 nethserver dracut: dracut module ‘ifcfg’ will not be installed, because it’s in the list to be omitted!
Mar 12 10:55:55 nethserver dracut: dracut module ‘plymouth’ will not be installed, because it’s in the list to be omitted!
Mar 12 10:55:55 nethserver dracut: dracut module ‘crypt’ will not be installed, because command ‘cryptsetup’ could not be found!
Mar 12 10:55:55 nethserver dracut: dracut module ‘dmraid’ will not be installed, because command ‘dmraid’ could not be found!
Mar 12 10:55:55 nethserver dracut: dracut module ‘mdraid’ will not be installed, because command ‘mdadm’ could not be found!
Mar 12 10:55:55 nethserver dracut: dracut module ‘multipath’ will not be installed, because command ‘multipath’ could not be found!
Mar 12 10:55:55 nethserver dracut: dracut module ‘cifs’ will not be installed, because command ‘mount.cifs’ could not be found!
Mar 12 10:55:55 nethserver dracut: dracut module ‘iscsi’ will not be installed, because command ‘iscsistart’ could not be found!
Mar 12 10:55:55 nethserver dracut: dracut module ‘iscsi’ will not be installed, because command ‘iscsi-iname’ could not be found!
Mar 12 10:55:55 nethserver dracut: 95nfs: Could not find any command of ‘rpcbind portmap’!
Mar 12 10:55:55 nethserver dracut: dracut module ‘resume’ will not be installed, because it’s in the list to be omitted!
Mar 12 10:55:56 nethserver dracut: dracut module ‘modsign’ will not be installed, because command ‘keyctl’ could not be found!
Mar 12 10:55:56 nethserver dracut: dracut module ‘busybox’ will not be installed, because command ‘busybox’ could not be found!
Mar 12 10:55:57 nethserver dracut: dracut module ‘crypt’ will not be installed, because command ‘cryptsetup’ could not be found!
Mar 12 10:55:57 nethserver dracut: dracut module ‘dmraid’ will not be installed, because command ‘dmraid’ could not be found!
Mar 12 10:55:57 nethserver dracut: dracut module ‘mdraid’ will not be installed, because command ‘mdadm’ could not be found!
Mar 12 10:55:57 nethserver dracut: dracut module ‘multipath’ will not be installed, because command ‘multipath’ could not be found!
Mar 12 10:55:58 nethserver dracut: dracut module ‘cifs’ will not be installed, because command ‘mount.cifs’ could not be found!
Mar 12 10:55:59 nethserver dracut: dracut module ‘iscsi’ will not be installed, because command ‘iscsistart’ could not be found!
Mar 12 10:55:59 nethserver dracut: dracut module ‘iscsi’ will not be installed, because command ‘iscsi-iname’ could not be found!
Mar 12 10:56:01 nethserver dracut: 95nfs: Could not find any command of ‘rpcbind portmap’!

The message block repeats every 5 minutes.

Hope it helps to find the failure.

best regards, Marko

[filippo_carletti]

These messages from dracut can be found on every system, they are “normal”.
But they appear when you update the kernel, not every 5 minutes. You can double check in /var/log/yum.log, you should find kernel at the same time.

[m.traeumner (Michael Träumner)]

@filippo_carletti
If I update the disk usage it looks like this:

Mar 20 09:13:50 groupware esmith::event[29983]: Event: nethserver-duc-save 
Mar 20 09:13:56 groupware esmith::event[29983]: Action: /etc/e-smith/events/nethserver-duc-save/S20nethserver-duc-index SUCCESS [6.5072]
Mar 20 09:13:56 groupware esmith::event[29983]: Event: nethserver-duc-save SUCCESS

I don’t get the messages from dracut, but don’t know why.

@capote
Did you get some other errors before or after the dracat messages?

[capote (Marko)]

is that more relevant?

Mar 20 13:55:30 nethserver esmith::event[2647]: Event: nethserver-duc-save
Mar 20 13:55:32 nethserver esmith::event[2647]: fatal error: out of memory
Mar 20 13:55:33 nethserver esmith::event[2647]: Traceback (most recent call last):
Mar 20 13:55:33 nethserver esmith::event[2647]:  File "/usr/share/duc/xml2json.py", line 190, in <module>
Mar 20 13:55:33 nethserver esmith::event[2647]:    main()
Mar 20 13:55:33 nethserver esmith::event[2647]:  File "/usr/share/duc/xml2json.py", line 185, in main
Mar 20 13:55:33 nethserver esmith::event[2647]:    out = xml2json(input, options, strip_ns, strip)
Mar 20 13:55:33 nethserver esmith::event[2647]:  File "/usr/share/duc/xml2json.py", line 154, in xml2json
Mar 20 13:55:33 nethserver esmith::event[2647]:    return elem2json(elem, options, strip_ns=strip_ns, strip=strip)
Mar 20 13:55:33 nethserver esmith::event[2647]:  File "/usr/share/duc/xml2json.py", line 130, in elem2json
Mar 20 13:55:33 nethserver esmith::event[2647]:    child.attrib['size_actual'] = str(int(child.attrib['size_actual']) - size)
Mar 20 13:55:33 nethserver esmith::event[2647]: TypeError: unsupported operand type(s) for -: 'int' and 'NoneType'
Mar 20 13:55:33 nethserver esmith::event[2647]: Action: /etc/e-smith/events/nethserver-duc-save/S20nethserver-duc-index FAILED: 1 [2.481558]
Mar 20 13:55:33 nethserver esmith::event[2647]: Event: nethserver-duc-save FAILED

[filippo_carletti]

@capote

is that more relevant?

Yes!
Do you have trillions of files?
Could you post the output of df -i ?

[capote (Marko)]

You’re funny…

This is a pure NethServer installation without any productive data or parallel frameworks like group ware or office communication.

root@nethserver ~]# df -i
Dateisystem                          Inodes IBenutzt    IFrei IUse% Eingehängt auf
devtmpfs                             998296      444   997852    1% /dev
tmpfs                               1001599        1  1001598    1% /dev/shm
tmpfs                               1001599      560  1001039    1% /run
tmpfs                               1001599       17  1001582    1% /sys/fs/cgroup
/dev/mapper/centos_nethserver-root 26214400    91597 26122803    1% /
/dev/sda1                            524288      350   523938    1% /boot
/dev/mapper/centos_nethserver-home 18036736        7 18036729    1% /home
192.168.2.2:/volume1/Daten                0        0        0     - /mnt/nfs/Synology-Daten
tmpfs                               1001599        1  1001598    1% /run/user/0
/dev/sdb1                            253952       28   253924    1% /mnt/backup

    [root@nethserver ~]# lsblk
NAME                       MAJ:MIN RM  SIZE RO TYPE MOUNTPOINT
sdb                          8:16   1  3,9G  0 disk
└─sdb1                       8:17   1  3,9G  0 part /mnt/backup
sda                          8:0    0 93,2G  0 disk
├─sda2                       8:2    0 92,2G  0 part
│ ├─centos_nethserver-swap 253:1    0  7,8G  0 lvm  [SWAP]
│ ├─centos_nethserver-home 253:2    0 34,4G  0 lvm  /home
│ └─centos_nethserver-root 253:0    0   50G  0 lvm  /
└─sda1                       8:1    0    1G  0 part /boot

[filippo_carletti]

I never experienced out of memory problems with duc, it was a shot in the dark.
Now I will focus on that NFS mount. Maybe duc has problems with it. Could you temporarily umount it and run duc?
Run it as below:

bash -x /etc/e-smith/events/actions/nethserver-restore-data-duc-index

[capote (Marko)]

@filippo_carletti

bash -x /etc/e-smith/events/actions/nethserver-restore-data-duc-index

Thank you for this try. But it doesn’t change anything, same again.

Mar 20 17:36:41 nethserver esmith::event[15166]: Traceback (most recent call last):
Mar 20 17:36:41 nethserver esmith::event[15166]:  File "/usr/share/duc/xml2json.py", line 190, in <module>
Mar 20 17:36:41 nethserver esmith::event[15166]:    main()
Mar 20 17:36:41 nethserver esmith::event[15166]:  File "/usr/share/duc/xml2json.py", line 185, in main
Mar 20 17:36:41 nethserver esmith::event[15166]:    out = xml2json(input, options, strip_ns, strip)
Mar 20 17:36:41 nethserver esmith::event[15166]:  File "/usr/share/duc/xml2json.py", line 154, in xml2json
Mar 20 17:36:41 nethserver esmith::event[15166]:    return elem2json(elem, options, strip_ns=strip_ns, strip=strip)
Mar 20 17:36:41 nethserver esmith::event[15166]:  File "/usr/share/duc/xml2json.py", line 130, in elem2json
Mar 20 17:36:41 nethserver esmith::event[15166]:    child.attrib['size_actual'] = str(int(child.attrib['size_actual']) - size)
Mar 20 17:36:41 nethserver esmith::event[15166]: TypeError: unsupported operand type(s) for -: 'int' and 'NoneType'
Mar 20 17:36:41 nethserver esmith::event[15166]: Action: /etc/e-smith/events/nethserver-duc-save/S20nethserver-duc-index FAILED: 1 [0.576666]

[capote (Marko)]

@filippo_carletti

Do you have trillions of files?

@filippo_carletti: This massiv increasing of memory using is related with starting the backup process.
today again…

best regards, Marko

[filippo_carletti]

Unfortunately, the problem is not reproducible, it seems to be something related to your system.
With the right expertise, I think it can be discovered, but, as I said, I have no past experience (duc just works).
Could you upload the content of /var/cache/restore/ in an archive somewhere?

[capote (Marko)]

Thank you for your commitment.
There you can download the file: https://whisp.ly/r/1lyHBWv#Owhtjt9sDPQ0i

best regards, Marko