YUM update repository problems (from Russia)

kelevra · May 11, 2018, 10:32am

curl -v -H ‘Host: mirrorlist.nethserver.org’ ‘http://packages.nethesis.it/7/nethserver?release=7&repo=nethforge&arch=x86_64’

About to connect() to packages.nethesis.it port 80 (#0)
Trying 46.101.114.111…
Connected to packages.nethesis.it (46.101.114.111) port 80 (#0)

GET /7/nethserver?release=7&repo=nethforge&arch=x86_64 HTTP/1.1
User-Agent: curl/7.29.0
Accept: /
Host: mirrorlist.nethserver.org

Connection #0 to host packages.nethesis.it left intact
13:31:23 root@ms jobs:0 cmd:187 /root

ping 46.101.114.111

PING 46.101.114.111 (46.101.114.111) 56(84) bytes of data.
64 bytes from 46.101.114.111: icmp_seq=1 ttl=57 time=46.6 ms
64 bytes from 46.101.114.111: icmp_seq=2 ttl=57 time=49.7 ms
64 bytes from 46.101.114.111: icmp_seq=3 ttl=57 time=46.7 ms
^C
— 46.101.114.111 ping statistics —
3 packets transmitted, 3 received, 0% packet loss, time 2003ms
rtt min/avg/max/mdev = 46.605/47.693/49.766/1.477 ms

kelevra · May 11, 2018, 10:43am

yum clean all && rm -rf /var/cache/yum && yum -y update
Loaded plugins: changelog, fastestmirror, nethserver_events
Cleaning repos: base centos-sclo-rh centos-sclo-sclo collaboraoffice.com_repos_CollaboraOnline_CODE-centos7 epel
: extras nethforge nethserver-base nethserver-updates remi-php56 remi-safe updates veeam
Cleaning up everything
Maybe you want: rm -rf /var/cache/yum, to also free up space taken by orphaned data from disabled or removed repos
Cleaning up list of fastest mirrors
Loaded plugins: changelog, fastestmirror, nethserver_events
Determining fastest mirrors
epel/x86_64/metalink | 13 kB 00:00:00
Could not retrieve mirrorlist http://mirrorlist.nethserver.org/7/nethserver?release=7&repo=nethforge&arch=x86_64 error was
12: Timeout on http://mirrorlist.nethserver.org/7/nethserver?release=7&repo=nethforge&arch=x86_64: (28, ‘Connection timed out after 30001 milliseconds’)

One of the configured repositories failed (Unknown),
and yum doesn’t have enough cached data to continue. At this point the only
safe thing yum can do is fail. There are a few ways to work “fix” this:

 1. Contact the upstream for the repository and get them to fix the problem.

 2. Reconfigure the baseurl/etc. for the repository, to point to a working
    upstream. This is most often useful if you are using a newer
    distribution release than is supported by the repository (and the
    packages for the previous distribution release still work).

 3. Run the command with the repository temporarily disabled
        yum --disablerepo=<repoid> ...

 4. Disable the repository permanently, so yum won't use it by default. Yum
    will then just ignore the repository until you permanently enable it
    again or use --enablerepo for temporary usage:

        yum-config-manager --disable <repoid>
    or
        subscription-manager repos --disable=<repoid>

 5. Configure the failing repository to be skipped, if it is unavailable.
    Note that yum will try to contact the repo. when it runs most commands,
    so will have to try and fail each time (and thus. yum will be be much
    slower). If it is a very temporary problem though, this is often a nice
    compromise:

        yum-config-manager --save --setopt=<repoid>.skip_if_unavailable=true

Cannot find a valid baseurl for repo: nethforge/7/x86_64

But it does not find non-package updates

davidep · May 11, 2018, 10:46am

Did you set it?

kelevra · May 11, 2018, 10:52am

Yes.

yum clean all && rm -rf /var/cache/yum && yum -y update
Loaded plugins: changelog, fastestmirror, nethserver_events
Cleaning repos: base centos-sclo-rh centos-sclo-sclo collaboraoffice.com_repos_CollaboraOnline_CODE-centos7 epel extras
: nethforge nethserver-base nethserver-updates remi-php56 remi-safe updates veeam
Cleaning up everything
Maybe you want: rm -rf /var/cache/yum, to also free up space taken by orphaned data from disabled or removed repos
Cleaning up list of fastest mirrors
Loaded plugins: changelog, fastestmirror, nethserver_events
Determining fastest mirrors
epel/x86_64/metalink | 13 kB 00:00:00

base: mirror.corbina.net
epel: ftp.colocall.net
extras: mirror.reconn.ru
nethforge: mirror.alpix.eu
remi-php56: mirror.reconn.ru
remi-safe: mirror.reconn.ru
updates: mirror.reconn.ru
base | 3.6 kB 00:00:00
centos-sclo-rh | 3.0 kB 00:00:00
centos-sclo-sclo | 2.9 kB 00:00:00
collaboraoffice.com_repos_CollaboraOnline_CODE-centos7 | 2.9 kB 00:00:00
epel | 4.7 kB 00:00:00
extras | 3.4 kB 00:00:00
nethforge | 4.1 kB 00:00:00
http://docs.readthedocs.org/en/latest/canonical.html/repodata/repomd.xml: [Errno 14] HTTP Error 404 - Not Found
Trying other mirror.
To address this issue please refer to the below wiki article

https://wiki.centos.org/yum-errors

If above article doesn’t help to resolve this issue please use https://bugs.centos.org/.

One of the configured repositories failed (NethServer-7 - Base),
and yum doesn’t have enough cached data to continue. At this point the only
safe thing yum can do is fail. There are a few ways to work “fix” this:

 1. Contact the upstream for the repository and get them to fix the problem.

 2. Reconfigure the baseurl/etc. for the repository, to point to a working
    upstream. This is most often useful if you are using a newer
    distribution release than is supported by the repository (and the
    packages for the previous distribution release still work).

 3. Run the command with the repository temporarily disabled
        yum --disablerepo=nethserver-base ...

 4. Disable the repository permanently, so yum won't use it by default. Yum
    will then just ignore the repository until you permanently enable it
    again or use --enablerepo for temporary usage:

        yum-config-manager --disable nethserver-base
    or
        subscription-manager repos --disable=nethserver-base

 5. Configure the failing repository to be skipped, if it is unavailable.
    Note that yum will try to contact the repo. when it runs most commands,
    so will have to try and fail each time (and thus. yum will be be much
    slower). If it is a very temporary problem though, this is often a nice
    compromise:

        yum-config-manager --save --setopt=nethserver-base.skip_if_unavailable=true

failure: repodata/repomd.xml from nethserver-base: [Errno 256] No more mirrors to try.
http://docs.readthedocs.org/en/latest/canonical.html/repodata/repomd.xml: [Errno 14] HTTP Error 404 - Not Found

saitobenkei · May 11, 2018, 10:56am

Maybe some repositories IP are in Russian block list too?

kelevra · May 11, 2018, 10:57am

ping mirrorlist.nethserver.org
PING mirrorlist.nethserver.org (46.101.114.111) 56(84) bytes of data.
64 bytes from mirrorlist.nethserver.org (46.101.114.111): icmp_seq=1 ttl=57 time=47.3 ms
64 bytes from mirrorlist.nethserver.org (46.101.114.111): icmp_seq=2 ttl=57 time=49.3 ms
64 bytes from mirrorlist.nethserver.org (46.101.114.111): icmp_seq=3 ttl=57 time=46.8 ms
64 bytes from mirrorlist.nethserver.org (46.101.114.111): icmp_seq=4 ttl=57 time=49.5 ms
64 bytes from mirrorlist.nethserver.org (46.101.114.111): icmp_seq=5 ttl=57 time=47.8 ms
64 bytes from mirrorlist.nethserver.org (46.101.114.111): icmp_seq=6 ttl=57 time=47.6 ms
64 bytes from mirrorlist.nethserver.org (46.101.114.111): icmp_seq=7 ttl=57 time=52.3 ms
64 bytes from mirrorlist.nethserver.org (46.101.114.111): icmp_seq=8 ttl=57 time=46.4 ms
64 bytes from mirrorlist.nethserver.org (46.101.114.111): icmp_seq=9 ttl=57 time=47.5 ms
64 bytes from mirrorlist.nethserver.org (46.101.114.111): icmp_seq=10 ttl=57 time=49.5 ms
^C

ping packages.nethserver.org
PING packages.nethserver.org (159.89.233.254) 56(84) bytes of data.
^C
— packages.nethserver.org ping statistics —
7 packets transmitted, 0 received, 100% packet loss, time 5999ms

In the inside network http://packages.nethserver.org/ open, the server is not pingback

robb · May 11, 2018, 11:05am

Do you use your NethServer as DNS server on your local network?
And if so, is it listed as first or second DNS server? (I remember a glitch in NethSevrer DNS settings that the secondary listed DNS server was used prior to the 1st DNS server listed… see Nethserver DNS primary and secondary server entries have mixed priorities in dnsmasq?

It looks like the DNS setting is not (yet) propagated to your clients.

kelevra · May 11, 2018, 11:08am

Yes use

Primary DNS 77.88.8.8

Inside the network everything open, from the NS open not go!!!

ping packages.nethserver.org
PING packages.nethserver.org (159.89.233.254) 56(84) bytes of data.
^C
— packages.nethserver.org ping statistics —
17 packets transmitted, 0 received, 100% packet loss, time 15999ms

saitobenkei · May 11, 2018, 11:35am

It seems that IP of packages.nethserver.org is the same as mirrorlist.nethserver.org

@davidep: can you confirm that this should work?:

* go to DNS page and set an override for packages.nethserver.org pointing to 46.101.114.111 too

davidep · May 11, 2018, 11:39am

No, it can’t work. I think @kelevra must comment out mirrorlist= lines in *.repo files and configure the corresponding baseurl= to reachable mirrors.

kelevra · May 11, 2018, 11:44am

Do not prompt, what I need to adjust the mirror?
It’s amazing that the mirrors were working yesterday before the update and suddenly blocked after the update. As we have seen, the IPS does not block the server. Therefore it is not in the lock, then locks himself NethServer.

davidep · May 11, 2018, 12:13pm

Look at the .repo files in /etc/yum.repos.d directory. You can comment out the mirrorlist= line and have your own baseurl= line with the mirror site of your choice. You can list multiple sites if you wish.

https://www.centos.org/forums/viewtopic.php?t=11668

Nicholas · May 24, 2018, 2:25pm

Заблокировано в России

Добрый всем день!
IP зеркала заблокированы провайдерами интернета в России. Попали под раздачу наверно при блокировки Telegram. Есть другие варианты или иные зеркала для стабильной установки и обновления?

Good day everyone!
IP mirrors are blocked by Internet providers in Russia. Got under the hand, probably at a blocking Telegram. Are there other options or other mirrors for a stable installation and upgrade?

davidep · May 24, 2018, 4:03pm

Let’s write an #howto! The idea is to create a local override of mirrorlist.nethserver.org

install the “Web server” module,
git clone https://github.com/nethserver/mirrorlist
create a virtualhost + DNS alias “mirrorlist.nethserver.org”
customize “mirrors” (and “ce-mirrors” when Lock to “current release” enabled by default from 7.5 is implemented)

With a local override, no modification of YUM config is required. It’s like not having IP blocks…

pm00 · June 23, 2018, 9:11pm

I started process of unbloking IP 159.89.233.254 (http://mirrorlist.nethserver.org/). Maybe it will be successful.

Harry_Gleb · August 18, 2018, 7:17pm

Now in Russia again blocked mirrorlist.nethserver.org and partly community.nethserver.org.

You may publish other ip addresses for mirrorlist.nethserver.org ?

giacomo · August 20, 2018, 2:36pm

Sorry, but we don’t have another machine running the mirrorlist service.

I suggest you to disable the mirrorlist from the Nethserver.repo configuration file, then enable the baseurl option selecting a mirror from this list http://mirror-status.nethserver.org/

Harry_Gleb · August 20, 2018, 6:04pm

Thank you!

Bulat · April 7, 2019, 10:48am

For reference
you can configure the proxy on the server with one command
it works for me
through a proxy updated server

Use the following syntax to configure traffic types such as http, https, and ftp from the command line:
export ftp_proxy=»http://proxy-server:port»
export http_proxy=»http://proxy-server:port»
export https_proxy=»https://proxy-server:port»

Use the following syntax if the proxy server requires authentication:
export http_proxy=»http://user:pass@proxy-server:port»
export https_proxy=»https://user:pass@proxy-server:port»
export ftp_proxy=»http://user:pass@proxy-server:port»

http://www.itworkroom.com/setting-proxy-linux/