NethServer 6.7 rc1 ready for testing

jgjimenezs · October 3, 2015, 6:31pm

@davidep the help file is created in spanish.

Regards

Jim · October 5, 2015, 9:25pm

The comunication on Distrowatch is done:

Edit: Last week I was sad to see ClearOS news without seeing anything about Nethserver
Today I was sad… to see news about Koozali SME Server without seeing anything about Nethserver.

But now you save my day @alefattorini , you rock

alefattorini · October 6, 2015, 7:29am

Thanks mate and twitter is talking about us!
https://twitter.com/search?f=tweets&vertical=default&q=nethserver&src=typd

dz00te · October 8, 2015, 11:38am

I’m sorry but for a few days I was a little bit away from the NS tests …
but to quickly recap :

unattended install → @davidep
interactive ISO installer → me, @mabeleira, @jgjimenezs
nethserver-vpn and nethserver-monitoring modules from Server Manager → me
changes on 6.7 branch12
installation on CentOS 6.7 minimal, following the updated Admin’s guide3 → ?
upgrade of 6.6 to 6.7, following the NethServer 6.7 rc1 release notes15 → @Adam, @GG_jr

various problem/bug/translation discovered until now has been fixed (if i read correctly the thread)

we miss installation on centos 6.7 minimal, i’ll do after this post…

do you think we should we some more accurate tests on installation or we could start to test the packages in software center?

apart nethserver-vpn and nethserver-monitoring, does anyone have tested others modules on 6.7rc1? if yes please report here, it could save a lot of time to other testers
tnx

giacomo · October 8, 2015, 12:42pm

I think almost everything is covered, I’m planning to put a couple of server in production on Monday.

dz00te · October 8, 2015, 3:49pm

great, this means that we are we are approaching to final release…

in the meanwhile i had some problem with installation on centos.

VM KVM (proxmox, virtio drv, 1 eth)

install minimal centos
during install setup of eth0 with static ip. At the end of install i have:

$ cat /etc/sysconfig/network-scripts/ifcfg-eth0
DEVICE=eth0
TYPE=Ethernet
UUID=03d1f445-5b8d-4ba1-afde-ef0dfdeee874
ONBOOT=yes
NM_CONTROLLED=yes
BOOTPROTO=none
IPADDR=192.168.100.89
PREFIX=24
GATEWAY=192.168.100.1
DNS1=192.168.100.1
DEFROUTE=yes
IPV4_FAILURE_FATAL=yes
IPV6INIT=no
NAME=“System eth0”
HWADDR=52:0A:FD:A0:E8:9F
upgrade centos
install nethserver as per manual
at the end of install i have:

$ cat /etc/sysconfig/network-scripts/ifcfg-eth0
DEVICE=eth0
BOOTPROTO=none
DEVICE=eth0
GATEWAY=192.168.100.1
HWADDR=52:0A:FD:A0:E8:9F
IPADDR=192.168.100.89
NETMASK=
NM_CONTROLLED=no
ONBOOT=yes
TYPE=Ethernet
USERCTL=no

and this error on log (after nethserver-install):

Oct 8 15:16:14 c67test esmith::event[15567]: expanding /etc/shorewall/hosts
Oct 8 15:16:14 c67test esmith::event[15567]: ERROR in /etc/e-smith/templates//etc/shorewall/hosts/20green: Program fragment delivered error <<Net::IPv4Addr: invalid netmask specification:
Oct 8 15:16:14 c67test esmith::event[15567]: at /usr/share/perl5/vendor_perl/esmith/util.pm line 355>> at template line 1
Oct 8 15:16:14 c67test esmith::event[15567]: ERROR: Template processing failed for //etc/shorewall/hosts: 1 fragment generated errors
Oct 8 15:16:14 c67test esmith::event[15567]: at /etc/e-smith/events/actions/generic_template_expand line 64
Oct 8 15:16:14 c67test esmith::event[15567]: [WARNING] expansion of /etc/shorewall/hosts failed
Oct 8 15:16:14 c67test esmith::event[15567]: Action: /etc/e-smith/events/actions/generic_template_expand FAILED: 1 [0.273516]

(and of course a lot of other error if i try to install something else)

in webUI → network → eth > netmask is empty
if i set the correct netmask, as expected, all start to works correctly
no error with dhcp.

honestly i haven’t never used this kind of install, i’m doing something wrong?

alefattorini · October 8, 2015, 3:59pm

I’m sure that @nas @Longhair @frankar and @Lincee have a proxmox environment, maybe they could help us!

davidep · October 8, 2015, 4:04pm

It seems the original ifcfg-eth0 file lacks the NETMASK too… How to deal with it?

Edit: uh there’s PREFIX=24 !

dz00te · October 8, 2015, 4:12pm

yes, it seems that (from i don’t know which version of centos) they use prefix= instead of netmask=
if you set static ip from gui during installer

dz00te · October 9, 2015, 8:11am

i’ve tested with a quick and dirty workaround…
added in nethserver-install:

NM=$(ipcalc --netmask `hostname -I`) && sed -i "s/^PREFIX=.*/$NM/" /etc/sysconfig/network-scripts/ifcfg-eth0

all seems to work… but i don’t know if it’s better change “prefix” in “netmask” before the installation or during the installation (i imagine it should be changed some script in nethserver-base)…

davidep · October 9, 2015, 8:43am

To summarize,

PREFIX is"officially supported" by upstream
it is used by provisioning tools, such as the one we found in Proxmox
The lack of support for PREFIX is not a problem for the ISO because Anaconda uses NETMASK

This limitation is not properly a blocker for the ISO release, as we could release an update after it… But in the meantime Proxmox users will have problems, so…?

@dz00te could you file a new bug/enhancement?

I guess we’ll patch this file starting from the line below

github.com

NethServer/nethserver-base/blob/master/root/etc/e-smith/events/actions/nethserver-base-initialize-db#L165


#!/usr/bin/perl -w


#
# Copyright (C) 2015 Nethesis S.r.l.
# http://www.nethesis.it - support@nethesis.it
#
# This script is part of NethServer.
#
# NethServer is free software: you can redistribute it and/or modify
# it under the terms of the GNU General Public License as published by
# the Free Software Foundation, either version 3 of the License,
# or any later version.
#
# NethServer is distributed in the hope that it will be useful,
# but WITHOUT ANY WARRANTY; without even the implied warranty of
# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
# GNU General Public License for more details.
#
# You should have received a copy of the GNU General Public License
# along with NethServer.  If not, see <http://www.gnu.org/licenses/>.
#


#
# This script initializes NethServer e-smith db accordingly to system
# configuration
#


use strict;
use File::Basename;
use esmith::NetworksDB;
use esmith::ConfigDB;
use Encode qw(encode decode);
use Net::IPv4Addr;




my $cdb = esmith::ConfigDB->open() || die("Could not open ConifgDB");
my $idb = esmith::NetworksDB->open() || die("Could not open NetworksDB");


#
# Create ethernet entries in networks DB
# (replaces update-networks-db script)
#
sub initialize_networks_db
{
my @fields = qw(name type model driver speed link);
my @records = ();
my $cableid = undef;
open(LH, '/usr/libexec/nethserver/nic-info |');
while(my $line = decode('UTF-8', <LH>)) {
	chomp $line;
	my %H = ();
	@H{@fields} = split(/,/, $line);
	push @records, [
        $H{'name'},
        {
            'type' => 'ethernet',
            'role' => '',
            fetch_ifcfg_props($H{'name'})
        }
    ];


    # Find the first interface with cable-connected:
    if( ! defined $cableid && $H{'link'}) {
        $cableid = $#records;
    }
}
close(LH);


# No cable connected? Fallback to first interface:
if( ! defined $cableid) {
    $cableid = 0;
}


if( @records && ! grep { ($_->[1]->{'role'} || '') eq 'green' } @records ) {
    warn("[WARNING] green role not found. Using default IP configuration on $records[$cableid]->[0].\n");
    $records[$cableid]->[1]->{'ipaddr'} = '192.168.1.1';
    $records[$cableid]->[1]->{'netmask'} = '255.255.255.0';
    $records[$cableid]->[1]->{'gateway'} = '';
    $records[$cableid]->[1]->{'role'} = 'green';
}


foreach (@records) {
    $idb->new_record(@{$_});
}
}


sub fetch_ifcfg_props
{
my $ifname = shift;
my %props = ();


# Note: command returns empty output if interface is DOWN:
open(ADDR, '-|', "ip -o -4 address show dev $ifname");
while(<ADDR>) {
    chomp;
    my($id, $dev, $family, $cidr, $brd_family, $brd_address, $scope_lbl, $scope, $dynamic, $end) = split(/\s+/, $_, 10);
    my $dhclient_running = (system("ps -A -o cmd | grep -E '(/| )dhclient .' | grep -q $ifname") == 0);


    if ($dhclient_running || $dynamic =~ 'dynamic') {
        $props{'bootproto'} = 'dhcp';
        $props{'gateway'} = '';
    } else {
        $props{'bootproto'} = 'none';
    }


    my($addr, $bitmask) = split(m|/|, $cidr, 2);


    if($addr) {
        $props{'ipaddr'} = $addr;
        $props{'netmask'} = Net::IPv4Addr::ipv4_cidr2msk($bitmask);
        last;
    }
}
close(ADDR);


open(ROUTE, '-|', 'ip -o route | grep ^default');
while(<ROUTE>) {
    chomp;
    my($p1, $via, $gateway, $p2, $dev) = split(/\s+/, $_);


    if($dev eq $ifname && $props{'bootproto'} ne 'dhcp') {
        $props{'gateway'} = $gateway;
    }
}
close(ROUTE);


if($props{'ipaddr'} && $props{'netmask'}) {
    $props{'role'} = 'green';
}


return %props;
}


sub fetch_dns
{
my @dns = ();


# Read DNS configuration
open RESOLV, '/etc/resolv.conf';
while (<RESOLV>) {
    chomp;
    if ( $_ =~ /^nameserver/ ) {
        my ($i, $j) = split(/ /);
        push(@dns,$j);
    }
}
close RESOLV;
return @dns;
}


my $dns=join(',', fetch_dns());
if($dns) {
$cdb->set_prop('dns', 'NameServers', $dns);
}


# Grab all ethernet interfaces
initialize_networks_db();

dz00te · October 9, 2015, 9:36am

just to be clear (maybe i am not understanding well, or I explained myself bad)

i don’t think the problem is with iso install (tested with proxmox and work well), and not related to proxmox or kvm vm, i think the problem is only when you install nethserver on a centos 6.7 minimal (and you have configuried a static ip during the installation of centos )

in the afternoon I’ll try to do some other tests (also with other hypervisor… just to be sure), fill the bug and try to find a solution. tnx for the link you saved me lot of time

dz00te · October 9, 2015, 2:34pm

tested also on vmware, same problem
fill the bug: Bug #3282: error in parsing ifcfg-eth0 when installing ns6.7rc1 on a centos 6.7 minimal - NethServer 6 - NethServer.org

i’ll try to make a PR, correct/change/trash it , and please think twice before add my code to nethserver-base
but hey i follow the path of my mentor: learning by doing (tnx @stephdl )
and to be honest the book “Learnig Perl 6th ed.” is just arrived yesterday (and i haven’t read a line) so, be patient or trash the PR without problem
tnx

giacomo · October 12, 2015, 4:39pm

The fix works! Just released the new rpm (available since tomorrow).

dz00te · October 13, 2015, 7:58am

yes, it seems to work. i’ve retested installation on centos 6.7 minimal (both dhcp and fixed ip)
back to rc1 testing: i think we have tested all the different installation type, so we can start testing the packages, and i’ll ask again:

apart nethserver-vpn and nethserver-monitoring, does anyone have tested others modules on 6.7rc1? if yes please report here, it could save a lot of time to other testers. tnx

giacomo · October 13, 2015, 8:08am

Already tested:

nethserver-antivirus
nethserver-samba
nethserver-firewall-base
nethserver-ntopng with nethserver-redis
nethserver-squid with content filter
nethserver-snort with nethserver-pulledpork
nethserver-p3scan

I’m going to test:

mail-server withmail-filter
rounducube
sogo
ibays
tomcat
iaxmodem
cups
owncloud
ejabberd
faxserver

Maybe the last package which needs testing is webvirtmgr. Am I missing something?

alefattorini · October 15, 2015, 10:30am

A post was split to a new topic: Which way do you prefer for the upgrade to 6.7?

islipfd19 · October 15, 2015, 11:02am

Quick question, though I believe I already know the answer to it.

Will modified templates be required to be “touched” again after upgrading to 6.7? I made small modifications to the shorewall.conf templates. In 20logging, I set LOG_MARTIAN=No and in 60options I added “ESTABLISHED” to the BLACKLIST option. Will I have to make the same changes after the upgrade?

giacomo · October 15, 2015, 11:55am

The answer is no if you created a template-custom.
All template-custom are always preserved

islipfd19 · October 15, 2015, 12:56pm

Good to hear that, obviously I’ll be checking to see if they were reverted.