My Locked 7.5's have or are updating to 7.6

fasttech · December 16, 2018, 1:54am

NethServer Version: your_version 7.5
Module: your_module

What am I not understanding?

One of my mail servers ‘got screwed up’ tonight, fixing it caused me to realize it updated to 7.6… it was locked, just like another server I checked that says it’s locked to 7.5 yet is offering

nethserver-release-7-11.ns7.noarch nethserver-base

Thu Dec 13 05:00:00 2018 Giacomo Sanchietti giacomo.sanchietti@nethesis.it - 7-11

NethServer 7.6.1810 final

It’s also offering in the same batch…

nethserver-base-3.6.1-1.ns7.noarch nethserver-base

Fri Dec 7 05:00:00 2018 Giacomo Sanchietti giacomo.sanchietti@nethesis.it - 3.6.1-1

Repository metadata GPG signature - NethServer/dev#5664
Installing packages from “software center” doesn’t create proper yum lock - Bug NethServer/dev#5667
Unexpected automatic update to 7.6 - Bug NethServer/dev#5665

I must have missed something… but now I don’t dare update any production servers because I don’t have time to deal with this right now since fixing the mail server I did update entailed reinstalling half the packages.

It’s starting to appear that it’s getting to the point with Nethserver where updating at the gui is fraught with peril and every update should just be done at the cli with a clean and makecache before every update, that’s not really what I had in mind when I first got involved here.

dnutan · December 16, 2018, 10:18am

Here is the relevant info about the bug:

fasttech · December 16, 2018, 5:37pm

So, for giggles, I was going to install nethserver-base for the yum lock fix and then run an update… but when I ran update after a clean all to get the exact pkg, I have only epel available, when last night it was about 8 nethserver pkgs alone… best guess is the nethserver repos are locked or something.

fasttech · December 16, 2018, 10:01pm

Or is this because 7.6 is released and now 7.5 is locked?

LayLow · December 16, 2018, 10:11pm

An issue like this should not happen at all…

davidep · December 16, 2018, 11:16pm

Hi @fasttech to understand what happened we have to look at the log files.

 grep -E '(Event|NsRelease)' /var/log/messages*

Also the current repository config might be helpful:

config show subscription
config show sysconfig
yum repolist -v

fasttech · December 16, 2018, 11:31pm

@davidep The server I tried that offered both the 7.6 release and the yum lock fix that hasn’t updated, I ran yum clean all and yum update… the only repo in the cache now is epel I guess, I did not run make cache on this server… I backed away, it’s a production server.

/var/log/messages-20181216:Dec 15 19:30:13 server2c esmith::event[9303]: Event: pre-backup-data SUCCESS
/var/log/messages-20181216:Dec 15 19:30:19 server2c esmith::event[9513]: Event: post-backup-data
/var/log/messages-20181216:Dec 15 19:30:24 server2c esmith::event[9513]: Event: post-backup-data SUCCESS
[root@server2c ~]# config show subscription
[root@server2c ~]# config show sysconfig
sysconfig=configuration
    Copyright=
    DefaultLanguage=en_US.utf8
    NsReleaseLock=enabled
    ProductName=NethServer
    Release=final
    Version=7.5.1804
    ZeroConf=enabled
[root@server2c ~]# yum repolist -v
Loading "changelog" plugin
Loading "fastestmirror" plugin
Loading "nethserver_events" plugin
Config time: 0.012
Yum version: 3.4.3
Loading mirror speeds from cached hostfile
 * epel: sjc.edge.kernel.org
Setting up Package Sacks
pkgsack time: 0.011
Repo-id      : ce-base/7/x86_64
Repo-name    : CE-Base-7.5.1804
Repo-revision: 1525378614
Repo-updated : Thu May  3 13:17:37 2018
Repo-pkgs    : 9,911
Repo-size    : 8.2 G
Repo-mirrors : http://mirrorlist.nethserver.org/?release=7&repo=ce-base&arch=x86_64&nsrelease=7.5.1804
Repo-baseurl : http://vault.centos.org/7.5.1804/os/x86_64/
Repo-expire  : 21,600 second(s) (last: Sun Dec 16 14:54:47 2018)
  Filter     : read-only:present
Repo-filename: /etc/yum.repos.d/NsReleaseLock.repo

Repo-id      : ce-extras/7/x86_64
Repo-name    : CE-Extras-7.5.1804
Repo-revision: 1541683984
Repo-updated : Thu Nov  8 06:36:55 2018
Repo-pkgs    : 434
Repo-size    : 806 M
Repo-mirrors : http://mirrorlist.nethserver.org/?release=7&repo=ce-extras&arch=x86_64&nsrelease=7.5.1804
Repo-baseurl : http://vault.centos.org/7.5.1804/extras/x86_64/
Repo-expire  : 21,600 second(s) (last: Sun Dec 16 14:54:47 2018)
  Filter     : read-only:present
Repo-filename: /etc/yum.repos.d/NsReleaseLock.repo

Repo-id      : ce-updates/7/x86_64
Repo-name    : CE-Updates-7.5.1804
Repo-revision: 1540837319
Repo-updated : Mon Oct 29 11:33:45 2018
Repo-pkgs    : 1,613
Repo-size    : 5.7 G
Repo-mirrors : http://mirrorlist.nethserver.org/?release=7&repo=ce-updates&arch=x86_64&nsrelease=7.5.1804
Repo-baseurl : http://vault.centos.org/7.5.1804/updates/x86_64/
Repo-expire  : 21,600 second(s) (last: Sun Dec 16 14:54:47 2018)
  Filter     : read-only:present
Repo-excluded: 1
Repo-filename: /etc/yum.repos.d/NsReleaseLock.repo

Repo-id      : centos-sclo-rh/x86_64
Repo-name    : CentOS-7 - SCLo rh
Repo-revision: 1544056569
Repo-updated : Wed Dec  5 17:38:08 2018
Repo-pkgs    : 7,857
Repo-size    : 6.5 G
Repo-baseurl : http://mirror.centos.org/centos/7/sclo/x86_64/rh/
Repo-expire  : 21,600 second(s) (last: Sun Dec 16 14:54:48 2018)
  Filter     : read-only:present
Repo-filename: /etc/yum.repos.d/CentOS-SCLo-scl-rh.repo

Repo-id      : centos-sclo-sclo/x86_64
Repo-name    : CentOS-7 - SCLo sclo
Repo-revision: 1543512024
Repo-updated : Thu Nov 29 10:20:28 2018
Repo-pkgs    : 682
Repo-size    : 228 M
Repo-baseurl : http://mirror.centos.org/centos/7/sclo/x86_64/sclo/
Repo-expire  : 21,600 second(s) (last: Sun Dec 16 14:54:48 2018)
  Filter     : read-only:present
Repo-filename: /etc/yum.repos.d/CentOS-SCLo-scl.repo

Repo-id      : epel/x86_64
Repo-name    : Extra Packages for Enterprise Linux 7 - x86_64
Repo-revision: 1544919780
Repo-updated : Sat Dec 15 17:34:11 2018
Repo-pkgs    : 12,744
Repo-size    : 14 G
Repo-metalink: https://mirrors.fedoraproject.org/metalink?repo=epel-7&arch=x86_64
  Updated    : Sat Dec 15 17:34:11 2018
Repo-baseurl : https://sjc.edge.kernel.org/fedora-buffet/epel/7/x86_64/ (56 more)
Repo-expire  : 21,600 second(s) (last: Sun Dec 16 14:54:48 2018)
  Filter     : read-only:present
Repo-filename: /etc/yum.repos.d/epel.repo

Repo-id      : nethforge/7/x86_64
Repo-name    : NethForge 7
Repo-revision: 1541262563
Repo-updated : Sat Nov  3 09:29:24 2018
Repo-pkgs    : 63
Repo-size    : 175 M
Repo-mirrors : http://mirrorlist.nethserver.org/?release=7&repo=nethforge&arch=x86_64&nsrelease=7.5.1804
Repo-baseurl : http://packages.nethserver.org/nethserver/7.5.1804/nethforge/x86_64/
Repo-expire  : 21,600 second(s) (last: Sun Dec 16 14:54:48 2018)
  Filter     : read-only:present
Repo-filename: /etc/yum.repos.d/NethForge.repo

Repo-id      : nethserver-base/7/x86_64
Repo-name    : NethServer-7 - Base
Repo-revision: 1528711431
Repo-updated : Mon Jun 11 03:03:55 2018
Repo-pkgs    : 283
Repo-size    : 1.0 G
Repo-mirrors : http://mirrorlist.nethserver.org/?release=7&repo=base&arch=x86_64&nsrelease=7.5.1804
Repo-baseurl : http://packages.nethserver.org/nethserver/7.5.1804/base/x86_64/
Repo-expire  : 21,600 second(s) (last: Sun Dec 16 14:54:48 2018)
  Filter     : read-only:present
Repo-filename: /etc/yum.repos.d/NethServer.repo

Repo-id      : nethserver-updates/7/x86_64
Repo-name    : NethServer-7 - Updates
Repo-revision: 1543341016
Repo-updated : Tue Nov 27 10:50:30 2018
Repo-pkgs    : 348
Repo-size    : 1.2 G
Repo-mirrors : http://mirrorlist.nethserver.org/?release=7&repo=updates&arch=x86_64&nsrelease=7.5.1804
Repo-baseurl : http://packages.nethserver.org/nethserver/7.5.1804/updates/x86_64/
Repo-expire  : 21,600 second(s) (last: Sun Dec 16 14:54:49 2018)
  Filter     : read-only:present
Repo-filename: /etc/yum.repos.d/NethServer.repo

repolist: 33,935
[root@server2c ~]#
    indent preformatted text by 4 spaces

fasttech · December 16, 2018, 11:36pm

@davidep This is the server that caught me off guard… a production mail server that had imap failures as the issue posted here on the forums already I didn’t pay close enough attention to realize it was going to update to 7.6 and had the yum lock fix.

This one I did run yum clean all & makecache… it updated to 7.6 successfully afterwards. Surprise.

/var/log/messages-20181216:Dec 14 19:15:11 server5 esmith::event[16321]: Event: post-backup-data SUCCESS
/var/log/messages-20181216:Dec 15 17:40:38 server5 esmith::event[21825]: Event: nethserver-release-update
/var/log/messages-20181216:Dec 15 17:40:39 server5 /etc/e-smith/events/nethserver-release-update/S00initialize-default-databases[21826]: /var/lib/nethserver/db/configuration: OLD sysconfig=configuration|Copyright||DefaultLanguage|en_US.utf8|NsReleaseLock|enabled|ProductName|NethServer|Release|final|Version|7.5.1804|ZeroConf|enabled
/var/log/messages-20181216:Dec 15 17:40:39 server5 /etc/e-smith/events/nethserver-release-update/S00initialize-default-databases[21826]: /var/lib/nethserver/db/configuration: NEW sysconfig=configuration|Copyright||DefaultLanguage|en_US.utf8|NsReleaseLock|enabled|ProductName|NethServer|Release|final|Version|7.6.1810|ZeroConf|enabled
/var/log/messages-20181216:Dec 15 17:40:39 server5 esmith::event[21825]: Event: nethserver-release-update SUCCESS
/var/log/messages-20181216:Dec 15 17:40:39 server5 esmith::event[21892]: Event: nethserver-base-update
/var/log/messages-20181216:Dec 15 17:40:41 server5 esmith::event[21892]: Event: nethserver-base-update SUCCESS
/var/log/messages-20181216:Dec 15 17:40:41 server5 esmith::event[21910]: Event: nethserver-backup-config-update
/var/log/messages-20181216:Dec 15 17:40:41 server5 esmith::event[21910]: Event: nethserver-backup-config-update SUCCESS
/var/log/messages-20181216:Dec 15 17:40:41 server5 esmith::event[21913]: Event: nethserver-firewall-base-update
/var/log/messages-20181216:Dec 15 17:40:42 server5 esmith::event[21928]: Event: static-routes-save
/var/log/messages-20181216:Dec 15 17:40:43 server5 esmith::event[21928]: Event: static-routes-save SUCCESS
/var/log/messages-20181216:Dec 15 17:40:44 server5 esmith::event[21913]: Event: nethserver-firewall-base-update SUCCESS
/var/log/messages-20181216:Dec 15 17:40:44 server5 esmith::event[22266]: Event: nethserver-mail-smarthost-update
/var/log/messages-20181216:Dec 15 17:40:46 server5 esmith::event[22266]: Event: nethserver-mail-smarthost-update SUCCESS
/var/log/messages-20181216:Dec 15 17:40:46 server5 esmith::event[22395]: Event: nethserver-sssd-update
/var/log/messages-20181216:Dec 15 17:41:02 server5 esmith::event[23160]: Event: runlevel-adjust
/var/log/messages-20181216:Dec 15 17:41:04 server5 esmith::event[23160]: Event: runlevel-adjust SUCCESS
/var/log/messages-20181216:Dec 15 17:41:04 server5 esmith::event[23682]: Event: firewall-adjust
/var/log/messages-20181216:Dec 15 17:41:04 server5 esmith::event[23683]: Event: nethserver-firewall-base-save firewall-adjust
/var/log/messages-20181216:Dec 15 17:41:05 server5 esmith::event[23683]: Event: nethserver-firewall-base-save SUCCESS
/var/log/messages-20181216:Dec 15 17:41:05 server5 esmith::event[23682]: Event: firewall-adjust SUCCESS
/var/log/messages-20181216:Dec 15 18:27:02 server5 esmith::event[7707]: Event: system-shutdown reboot
/var/log/messages-20181216:Dec 15 18:27:22 server5 kernel: Performance Events: unsupported p6 CPU model 60 no PMU driver, software events only.
/var/log/messages-20181216:Dec 15 19:15:02 server5 esmith::event[7146]: Event: pre-backup-data
/var/log/messages-20181216:Dec 15 19:15:26 server5 esmith::event[7438]: Event: post-backup-data SUCCESS
[root@server5 ~]# config show subscription
[root@server5 ~]# config show sysconfig
sysconfig=configuration
    Copyright=
    DefaultLanguage=en_US.utf8
    NsReleaseLock=enabled
    ProductName=NethServer
    Release=final
    Version=7.6.1810
    ZeroConf=enabled
[root@server5 ~]# yum repolist -v
Loading "changelog" plugin
Loading "fastestmirror" plugin
Loading "nethserver_events" plugin
Config time: 0.025
Yum version: 3.4.3
Loading mirror speeds from cached hostfile
 * ce-base: mirror.centos.org
 * ce-extras: mirror.centos.org
 * ce-updates: mirror.centos.org
 * epel: mirror.sjc02.svwh.net
 * nethforge: mirror.nethserver.org
 * nethserver-base: mirror.nethserver.org
 * nethserver-updates: mirror.nethserver.org
Setting up Package Sacks
pkgsack time: 0.011
Repo-id      : ce-base/7/x86_64
Repo-name    : CE-Base-7.6.1810
Repo-revision: 1543161601
Repo-updated : Sun Nov 25 09:00:34 2018
Repo-pkgs    : 10,019
Repo-size    : 9.4 G
Repo-mirrors : http://mirrorlist.nethserver.org/?release=7&repo=ce-base&arch=x86_64&nsrelease=7.6.1810
Repo-baseurl : http://mirror.centos.org/centos/7.6.1810/os/x86_64/ (8 more)
Repo-expire  : 21,600 second(s) (last: Sun Dec 16 16:23:26 2018)
  Filter     : read-only:present
Repo-filename: /etc/yum.repos.d/NsReleaseLock.repo

Repo-id      : ce-extras/7/x86_64
Repo-name    : CE-Extras-7.6.1810
Repo-revision: 1544457521
Repo-updated : Mon Dec 10 09:00:03 2018
Repo-pkgs    : 321
Repo-size    : 392 M
Repo-mirrors : http://mirrorlist.nethserver.org/?release=7&repo=ce-extras&arch=x86_64&nsrelease=7.6.1810
Repo-baseurl : http://mirror.centos.org/centos/7.6.1810/extras/x86_64/ (8 more)
Repo-expire  : 21,600 second(s) (last: Sun Dec 16 16:23:27 2018)
  Filter     : read-only:present
Repo-filename: /etc/yum.repos.d/NsReleaseLock.repo

Repo-id      : ce-updates/7/x86_64
Repo-name    : CE-Updates-7.6.1810
Repo-revision: 1544455884
Repo-updated : Mon Dec 10 08:34:27 2018
Repo-pkgs    : 599
Repo-size    : 3.3 G
Repo-mirrors : http://mirrorlist.nethserver.org/?release=7&repo=ce-updates&arch=x86_64&nsrelease=7.6.1810
Repo-baseurl : http://mirror.centos.org/centos/7.6.1810/updates/x86_64/ (8 more)
Repo-expire  : 21,600 second(s) (last: Sun Dec 16 16:23:27 2018)
  Filter     : read-only:present
Repo-filename: /etc/yum.repos.d/NsReleaseLock.repo

Repo-id      : centos-sclo-rh/x86_64
Repo-name    : CentOS-7 - SCLo rh
Repo-revision: 1544056569
Repo-updated : Wed Dec  5 17:38:08 2018
Repo-pkgs    : 7,857
Repo-size    : 6.5 G
Repo-baseurl : http://mirror.centos.org/centos/7/sclo/x86_64/rh/
Repo-expire  : 21,600 second(s) (last: Sun Dec 16 16:23:27 2018)
  Filter     : read-only:present
Repo-filename: /etc/yum.repos.d/CentOS-SCLo-scl-rh.repo

Repo-id      : centos-sclo-sclo/x86_64
Repo-name    : CentOS-7 - SCLo sclo
Repo-revision: 1543512024
Repo-updated : Thu Nov 29 10:20:28 2018
Repo-pkgs    : 682
Repo-size    : 228 M
Repo-baseurl : http://mirror.centos.org/centos/7/sclo/x86_64/sclo/
Repo-expire  : 21,600 second(s) (last: Sun Dec 16 16:23:27 2018)
  Filter     : read-only:present
Repo-filename: /etc/yum.repos.d/CentOS-SCLo-scl.repo

Repo-id      : epel/x86_64
Repo-name    : Extra Packages for Enterprise Linux 7 - x86_64
Repo-revision: 1544919780
Repo-updated : Sat Dec 15 17:34:11 2018
Repo-pkgs    : 12,744
Repo-size    : 14 G
Repo-metalink: https://mirrors.fedoraproject.org/metalink?repo=epel-7&arch=x86_64
  Updated    : Sat Dec 15 17:34:11 2018
Repo-baseurl : http://mirror.sjc02.svwh.net/fedora-epel/7/x86_64/ (55 more)
Repo-expire  : 21,600 second(s) (last: Sun Dec 16 16:23:28 2018)
  Filter     : read-only:present
Repo-filename: /etc/yum.repos.d/epel.repo

Repo-id      : nethforge/7/x86_64
Repo-name    : NethForge 7
Repo-revision: 1543853504
Repo-updated : Mon Dec  3 09:11:45 2018
Repo-pkgs    : 25
Repo-size    : 129 M
Repo-mirrors : http://mirrorlist.nethserver.org/?release=7&repo=nethforge&arch=x86_64&nsrelease=7.6.1810
Repo-baseurl : http://mirror.nethserver.org/nethserver/7.6.1810/nethforge/x86_64/ (17 more)
Repo-expire  : 21,600 second(s) (last: Sun Dec 16 16:23:29 2018)
  Filter     : read-only:present
Repo-filename: /etc/yum.repos.d/NethForge.repo

Repo-id      : nethserver-base/7/x86_64
Repo-name    : NethServer-7 - Base
Repo-revision: 1544698988
Repo-updated : Thu Dec 13 04:03:18 2018
Repo-pkgs    : 322
Repo-size    : 1.0 G
Repo-mirrors : http://mirrorlist.nethserver.org/?release=7&repo=base&arch=x86_64&nsrelease=7.6.1810
Repo-baseurl : http://mirror.nethserver.org/nethserver/7.6.1810/base/x86_64/ (17 more)
Repo-expire  : 21,600 second(s) (last: Sun Dec 16 16:23:29 2018)
  Filter     : read-only:present
Repo-filename: /etc/yum.repos.d/NethServer.repo

Repo-id      : nethserver-updates/7/x86_64
Repo-name    : NethServer-7 - Updates
Repo-revision: 1544698988
Repo-updated : Thu Dec 13 04:03:08 2018
Repo-pkgs    : 0
Repo-size    : 0
Repo-mirrors : http://mirrorlist.nethserver.org/?release=7&repo=updates&arch=x86_64&nsrelease=7.6.1810
Repo-baseurl : http://mirror.nethserver.org/nethserver/7.6.1810/updates/x86_64/ (17 more)
Repo-expire  : 21,600 second(s) (last: Sun Dec 16 16:23:29 2018)
  Filter     : read-only:present
Repo-filename: /etc/yum.repos.d/NethServer.repo

repolist: 32,569
[root@server5 ~]#

davidep · December 17, 2018, 8:38am

I have a possible explanation of this, just an hypothesis because I can’t figure out what happened on that server with the provided information.

From about Wed Dec 12 18:02:44 2018 +0100 to Thu Dec 13 11:07:50 2018 +0100 I applied a bad configuration to mirrorlist.nethserver.org, as registered here: https://github.com/NethServer/mirrorlist/commit/5aefb2f1b445db16f68f12f83cfe2662c86e919b

If your server software source wasn’t locked in that timeframe it could have installed the new nethserver-subscription package and started the upgrade to 7.6 on the next YUM run.

As 7.6 is now “stable” and the announce is imminent I’d suggest to remove the release lock and upgrade to 7.6…

davidep · December 17, 2018, 11:16am

2 posts were split to a new topic: Issues with 7.6 and HyperV 16

fasttech · December 17, 2018, 5:29pm

I assume you’re referring to the server I posted the info you requested on, it’s only offering epel at the cli with yum update, as of last night… but this morning, I got the email about upgrades from it and it’s offering all the same updates it’s had available for about a week now… which is the release upgrade and the yum lock fix… this is the same as 8 other locked servers, they’re all offering the release upgrade and the yum lock fix… and they’re all production. I’m not messing with this today regardless, I don’t dare since I’m leaving town for a couple of days.

Also, the one mail server I was forced to upgrade… it’s offering a single update… nethserver-release. I’m just a little concerned here.

fasttech · December 18, 2018, 12:54am

Awww… c’mon, really?!?

Upgrade  1 Package

Total download size: 247 k
Is this ok [y/d/N]: y
Downloading packages:
No Presto metadata available for nethserver-base
nethserver-base-3.6.1-1.ns7.no FAILED
http://packages.nethserver.org/nethserver/7.5.1804/base/x86_64/Packages/nethserver-base-3.6.1-1.ns7.noarch.rpm: [Errno 14] HTTP Error 404 - Not Found
Trying other mirror.

LayLow · December 18, 2018, 1:30am

I am following this thread for I believe updates on production servers should be done in a very controlled manner. Total control is mandatory for (business) production servers.

davidep · December 18, 2018, 7:34am

That package is not in that repository! Do you have any web proxy between the server and the repositories?

fasttech · December 19, 2018, 10:04pm

No. plus the remaining three characters.