Document 2.5.1 RC8 -> 2.6.x latest

NethServer Version: 2.5.1
Module: Core upgrade to the release

Hey, I’m running into issues with a smooth upgrade and thought I’d document my process. this is effectively as I go, so, hopefully all goes well. Doing this in the hopes it will assist someone else in a similar situation.

this is my network layout - I edited out the client name, added a couple notes. It’s an exceedingly simple network imho, and so I’m not worried about this upgrade. even if it goes south, I will have little concern.

The wireguard in the above picture is setup by me, for remote administration of the various services. this is not the wireguard setup by NS8. I’ve made sure to stay out of the network range of that setup.

image
So, I have the update image. Ran my first attempt, received this error. (I formatted this with a JSON online formatter)

{
  "context": {
    "action": "update-core",
    "data": {
      "nodes": [
        1,
        2
      ]
    },
    "extra": {
      "description": "Processing",
      "eventId": "82543064-eedb-4033-a493-fe128f4f0f00",
      "title": "Update core"
    },
    "id": "f3e41d91-0569-4064-a077-10f687e609dd",
    "parent": "",
    "queue": "cluster/tasks",
    "timestamp": "2024-02-21T03:20:33.84272123Z",
    "user": "admin"
  },
  "status": "aborted",
  "progress": 100,
  "subTasks": [
    {
      "context": {
        "action": "list-actions",
        "data": {},
        "extra": {},
        "id": "2bffb7b3-d4b1-4ace-813d-c36c14b34f02",
        "parent": "f3e41d91-0569-4064-a077-10f687e609dd"
      },
      "status": "completed",
      "progress": 100,
      "subTasks": [],
      "result": {
        "error": "",
        "exit_code": 0,
        "file": "task/node/1/2bffb7b3-d4b1-4ace-813d-c36c14b34f02",
        "output": [
          "get-node-status",
          "start-support-session",
          "update-core",
          "update-os",
          "add-custom-zone",
          "get-facts",
          "get-fqdn",
          "remove-custom-zone",
          "remove-public-service",
          "set-name",
          "get-firewall-status",
          "get-info",
          "get-support-session",
          "add-tun",
          "remove-module",
          "set-fqdn",
          "remove-tun",
          "stop-support-session",
          "add-module",
          "add-public-service",
          "get-name",
          "list-actions",
          "cancel-task"
        ]
      }
    },
    {
      "context": {
        "action": "list-actions",
        "data": {},
        "extra": {},
        "id": "b2326a76-d2ea-44ec-9def-8b00cbab9b6e",
        "parent": "f3e41d91-0569-4064-a077-10f687e609dd"
      },
      "status": "completed",
      "progress": 100,
      "subTasks": [],
      "result": {
        "error": "",
        "exit_code": 0,
        "file": "task/node/2/b2326a76-d2ea-44ec-9def-8b00cbab9b6e",
        "output": [
          "get-firewall-status",
          "set-name",
          "start-support-session",
          "update-os",
          "get-info",
          "get-support-session",
          "remove-module",
          "update-core",
          "add-custom-zone",
          "add-module",
          "get-name",
          "remove-custom-zone",
          "remove-tun",
          "stop-support-session",
          "set-fqdn",
          "add-public-service",
          "add-tun",
          "get-facts",
          "get-fqdn",
          "get-node-status",
          "remove-public-service",
          "list-actions",
          "cancel-task"
        ]
      }
    },
    {
      "context": {
        "action": "update-core",
        "data": {
          "core_url": "ghcr.io/nethserver/core:2.5.1",
          "force": false
        },
        "extra": {},
        "id": "feebf93a-d04e-4d43-9f6c-a5edd79f992c",
        "parent": "f3e41d91-0569-4064-a077-10f687e609dd"
      },
      "status": "running",
      "progress": 40,
      "subTasks": []
    },
    {
      "context": {
        "action": "update-core",
        "data": {
          "core_url": "ghcr.io/nethserver/core:2.5.1",
          "force": false
        },
        "extra": {},
        "id": "cf4bd993-ccd2-4cae-a5ec-b3abc388aa34",
        "parent": "f3e41d91-0569-4064-a077-10f687e609dd"
      },
      "status": "running",
      "progress": 0,
      "subTasks": []
    }
  ],
  "validated": true,
  "result": {
    "error": "_acontrol_task request attempt failed (Connection closed by server.). Retrying...\n_acontrol_task request attempt failed (Connection closed by server.). Retrying...\nsubscribe request attempt failed (Error 111 connecting to cluster-leader:6379. 111.). Retrying...\nsubscribe request recovered successfully at attempt 2\nsubscribe request attempt failed (Error 111 connecting to cluster-leader:6379. 111.). Retrying...\nsubscribe request recovered successfully at attempt 2\n_acontrol_task request recovered successfully at attempt 2\n_acontrol_task request recovered successfully at attempt 2\n<7>run-scriptdir /var/lib/nethserver/cluster/update-core-pre-modules.d/\nTraceback (most recent call last):\n  File \"/var/lib/nethserver/cluster/actions/update-core/70update_modules\", line 18, in <module>\n    agent.run_helper(\"run-scriptdir\", f\"{agent_install_dir}/update-core-pre-modules.d/\")\n  File \"/usr/local/agent/pypkg/agent/__init__.py\", line 175, in run_helper\n    proc = subprocess.Popen(args, stdout=outstream, pass_fds=(*pass_fds, fdw), env=child_env, **kwargs)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n  File \"/usr/lib/python3.11/subprocess.py\", line 1024, in __init__\n    self._execute_child(args, executable, preexec_fn, close_fds,\n  File \"/usr/lib/python3.11/subprocess.py\", line 1901, in _execute_child\n    raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: 'run-scriptdir'\n",
    "exit_code": 1,
    "file": "task/cluster/f3e41d91-0569-4064-a077-10f687e609dd",
    "output": ""
  }
}

For this part, all I did was attempt the upgrade again, it doesn’t look like a serious error.

So after hitting the ‘upgrade’ button a second time, I get this error, (again formatted via online JSON formatter)

{
  "context": {
    "action": "update-core",
    "data": {
      "nodes": [
        1,
        2
      ]
    },
    "extra": {
      "description": "Processing",
      "eventId": "dcb4a917-2570-4d44-86f0-023993a3b6ed",
      "title": "Update core"
    },
    "id": "3d2233a7-9b22-4f1e-be18-acab9cb4286e",
    "parent": "",
    "queue": "cluster/tasks",
    "timestamp": "2024-02-21T03:29:42.713902601Z",
    "user": "admin"
  },
  "status": "aborted",
  "progress": 100,
  "subTasks": [
    {
      "context": {
        "action": "update-core",
        "data": {
          "core_url": "ghcr.io/nethserver/core:2.5.1",
          "force": false
        },
        "extra": {},
        "id": "94fd5f82-daa1-4494-83b9-2584a238ad27",
        "parent": "3d2233a7-9b22-4f1e-be18-acab9cb4286e"
      },
      "status": "completed",
      "progress": 100,
      "subTasks": [],
      "result": {
        "error": "The new core image does not update the current one. Nothing to do.\nRunning /var/lib/nethserver/node/update-core.d/05set_agentenv_path...\nRunning /var/lib/nethserver/node/update-core.d/10init_udpseq...\nRunning /var/lib/nethserver/node/update-core.d/10reload_agents...\nRunning /var/lib/nethserver/node/update-core.d/20restart_apiserver...\nRunning /var/lib/nethserver/node/update-core.d/30restart_redis...\nRunning /var/lib/nethserver/node/update-core.d/50python_updates...\nInstalling Python virtual environment deps from /etc/nethserver/pyreq3_11.txt\nRequirement already satisfied: aiodns==3.0.0 in /usr/local/agent/pyenv/lib/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 5)) (3.0.0)\nRequirement already satisfied: aiohttp==3.8.4 in /usr/local/agent/pyenv/lib/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 6)) (3.8.4)\nRequirement already satisfied: ansible-core==2.15.1 in /usr/local/agent/pyenv/lib/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 7)) (2.15.1)\nRequirement already satisfied: ansible-runner==2.3.1 in /usr/local/agent/pyenv/lib/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 8)) (2.3.1)\nRequirement already satisfied: async-timeout==4.0.2 in /usr/local/agent/pyenv/lib/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 9)) (4.0.2)\nRequirement already satisfied: attrs==22.2.0 in /usr/lib/python3/dist-packages (from -r /etc/nethserver/pyreq3_11.txt (line 10)) (22.2.0)\nRequirement already satisfied: brotlipy==0.7.0 in /usr/local/agent/pyenv/lib/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 11)) (0.7.0)\nRequirement already satisfied: certifi==2022.9.24 in /usr/lib/python3/dist-packages (from -r /etc/nethserver/pyreq3_11.txt (line 12)) (2022.9.24)\nRequirement already satisfied: cffi==1.15.1 in /usr/local/agent/pyenv/lib/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 13)) (1.15.1)\nRequirement already satisfied: chardet==5.1.0 in /usr/lib/python3/dist-packages (from -r /etc/nethserver/pyreq3_11.txt (line 14)) (5.1.0)\nRequirement already satisfied: cryptography==41.0.1 in /usr/local/agent/pyenv/lib/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 15)) (41.0.1)\nRequirement already satisfied: dnspython==2.3.0 in /usr/local/agent/pyenv/lib/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 16)) (2.3.0)\nRequirement already satisfied: docutils==0.20 in /usr/local/agent/pyenv/lib/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 17)) (0.20)\nRequirement already satisfied: hiredis==2.2.3 in /usr/local/agent/pyenv/lib/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 18)) (2.2.3)\nRequirement already satisfied: idna==3.3 in /usr/lib/python3/dist-packages (from -r /etc/nethserver/pyreq3_11.txt (line 19)) (3.3)\nRequirement already satisfied: Jinja2==3.1.2 in /usr/local/agent/pyenv/lib/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 20)) (3.1.2)\nRequirement already satisfied: jsonschema==4.10.3 in /usr/lib/python3/dist-packages (from -r /etc/nethserver/pyreq3_11.txt (line 21)) (4.10.3)\nRequirement already satisfied: ldap3==2.9.1 in /usr/local/agent/pyenv/lib/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 22)) (2.9.1)\nRequirement already satisfied: lockfile==0.12.2 in /usr/local/agent/pyenv/lib/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 23)) (0.12.2)\nRequirement already satisfied: MarkupSafe==2.1.3 in /usr/local/agent/pyenv/lib/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 24)) (2.1.3)\nRequirement already satisfied: multidict==6.0.4 in /usr/local/agent/pyenv/lib/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 25)) (6.0.4)\nRequirement already satisfied: packaging==23.0 in /usr/local/agent/pyenv/lib/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 26)) (23.0)\nRequirement already satisfied: pexpect==4.8.0 in /usr/local/agent/pyenv/lib/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 27)) (4.8.0)\nRequirement already satisfied: psutil==5.9.4 in /usr/local/agent/pyenv/lib/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 28)) (5.9.4)\nRequirement already satisfied: ptyprocess==0.7.0 in /usr/local/agent/pyenv/lib/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 29)) (0.7.0)\nRequirement already satisfied: pyasn1==0.4.8 in /usr/local/agent/pyenv/lib/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 30)) (0.4.8)\nRequirement already satisfied: pycares==4.3.0 in /usr/local/agent/pyenv/lib/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 31)) (4.3.0)\nRequirement already satisfied: pycparser==2.21 in /usr/local/agent/pyenv/lib/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 32)) (2.21)\nRequirement already satisfied: pyrsistent==0.18.1 in /usr/lib/python3/dist-packages (from -r /etc/nethserver/pyreq3_11.txt (line 33)) (0.18.1)\nRequirement already satisfied: python-daemon==3.0.1 in /usr/local/agent/pyenv/lib/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 34)) (3.0.1)\nRequirement already satisfied: PyYAML==6.0 in /usr/local/agent/pyenv/lib/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 35)) (6.0)\nRequirement already satisfied: redis==5.0.1 in /usr/local/agent/pyenv/lib/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 36)) (5.0.1)\nRequirement already satisfied: regex-engine==1.1.0 in /usr/local/agent/pyenv/lib/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 37)) (1.1.0)\nRequirement already satisfied: requests==2.31.0 in /usr/local/agent/pyenv/lib/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 38)) (2.31.0)\nRequirement already satisfied: resolvelib==1.0.1 in /usr/local/agent/pyenv/lib/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 39)) (1.0.1)\nRequirement already satisfied: semver==3.0.1 in /usr/local/agent/pyenv/lib/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 40)) (3.0.1)\nRequirement already satisfied: six==1.16.0 in /usr/lib/python3/dist-packages (from -r /etc/nethserver/pyreq3_11.txt (line 41)) (1.16.0)\nRequirement already satisfied: typing-extensions==4.6.3 in /usr/local/agent/pyenv/lib/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 42)) (4.6.3)\nRequirement already satisfied: urllib3==1.26.12 in /usr/lib/python3/dist-packages (from -r /etc/nethserver/pyreq3_11.txt (line 43)) (1.26.12)\nRequirement already satisfied: yarl==1.9.2 in /usr/local/agent/pyenv/lib/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 44)) (1.9.2)\nRequirement already satisfied: charset-normalizer<4.0,>=2.0 in /usr/lib/python3/dist-packages (from aiohttp==3.8.4->-r /etc/nethserver/pyreq3_11.txt (line 6)) (3.0.1)\nRequirement already satisfied: frozenlist>=1.1.1 in /usr/local/agent/pyenv/lib/python3.11/site-packages (from aiohttp==3.8.4->-r /etc/nethserver/pyreq3_11.txt (line 6)) (1.4.1)\nRequirement already satisfied: aiosignal>=1.1.2 in /usr/local/agent/pyenv/lib/python3.11/site-packages (from aiohttp==3.8.4->-r /etc/nethserver/pyreq3_11.txt (line 6)) (1.3.1)\nRequirement already satisfied: setuptools>=62.4.0 in /usr/local/agent/pyenv/lib/python3.11/site-packages (from python-daemon==3.0.1->-r /etc/nethserver/pyreq3_11.txt (line 34)) (69.0.3)\n\n[notice] A new release of pip is available: 23.3.2 -> 24.0\n[notice] To update, run: pip install --upgrade pip\nRunning /var/lib/nethserver/node/update-core.d/50start_promtail...\nRunning /var/lib/nethserver/node/update-core.d/50update_grants...\nRunning /var/lib/nethserver/node/update-core.d/95cleanup_images...\nError: inspecting object: no such object: \"b'5f241e0a355c715986256de13200f48105e54295f4e36fcf4817633aee735c86'\"\njq: error (at <stdin>:1): split input and separator must be strings\n",
        "exit_code": 0,
        "file": "task/node/1/94fd5f82-daa1-4494-83b9-2584a238ad27",
        "output": ""
      }
    },
    {
      "context": {
        "action": "update-core",
        "data": {
          "core_url": "ghcr.io/nethserver/core:2.5.1",
          "force": false
        },
        "extra": {},
        "id": "202110ae-05a4-47e8-8dbb-9df1cf1b5294",
        "parent": "3d2233a7-9b22-4f1e-be18-acab9cb4286e"
      },
      "status": "running",
      "progress": 100,
      "subTasks": [],
      "result": {
        "error": "The new core image does not update the current one. Nothing to do.\nRunning /var/lib/nethserver/node/update-core.d/05set_agentenv_path...\nRunning /var/lib/nethserver/node/update-core.d/10init_udpseq...\nRunning /var/lib/nethserver/node/update-core.d/10reload_agents...\nRunning /var/lib/nethserver/node/update-core.d/20restart_apiserver...\nRunning /var/lib/nethserver/node/update-core.d/30restart_redis...\nRunning /var/lib/nethserver/node/update-core.d/50python_updates...\nInstalling Python virtual environment deps from /etc/nethserver/pyreq3_11.txt\nRequirement already satisfied: aiodns==3.0.0 in /usr/local/agent/pyenv/lib/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 5)) (3.0.0)\nRequirement already satisfied: aiohttp==3.8.4 in /usr/local/agent/pyenv/lib/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 6)) (3.8.4)\nRequirement already satisfied: ansible-core==2.15.1 in /usr/local/agent/pyenv/lib/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 7)) (2.15.1)\nRequirement already satisfied: ansible-runner==2.3.1 in /usr/local/agent/pyenv/lib/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 8)) (2.3.1)\nRequirement already satisfied: async-timeout==4.0.2 in /usr/local/agent/pyenv/lib/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 9)) (4.0.2)\nRequirement already satisfied: attrs==22.2.0 in /usr/lib/python3/dist-packages (from -r /etc/nethserver/pyreq3_11.txt (line 10)) (22.2.0)\nRequirement already satisfied: brotlipy==0.7.0 in /usr/local/agent/pyenv/lib/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 11)) (0.7.0)\nRequirement already satisfied: certifi==2022.9.24 in /usr/lib/python3/dist-packages (from -r /etc/nethserver/pyreq3_11.txt (line 12)) (2022.9.24)\nRequirement already satisfied: cffi==1.15.1 in /usr/local/agent/pyenv/lib/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 13)) (1.15.1)\nRequirement already satisfied: chardet==5.1.0 in /usr/lib/python3/dist-packages (from -r /etc/nethserver/pyreq3_11.txt (line 14)) (5.1.0)\nRequirement already satisfied: cryptography==41.0.1 in /usr/local/agent/pyenv/lib/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 15)) (41.0.1)\nRequirement already satisfied: dnspython==2.3.0 in /usr/local/agent/pyenv/lib/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 16)) (2.3.0)\nRequirement already satisfied: docutils==0.20 in /usr/local/agent/pyenv/lib/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 17)) (0.20)\nRequirement already satisfied: hiredis==2.2.3 in /usr/local/agent/pyenv/lib/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 18)) (2.2.3)\nRequirement already satisfied: idna==3.3 in /usr/lib/python3/dist-packages (from -r /etc/nethserver/pyreq3_11.txt (line 19)) (3.3)\nRequirement already satisfied: Jinja2==3.1.2 in /usr/local/agent/pyenv/lib/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 20)) (3.1.2)\nRequirement already satisfied: jsonschema==4.10.3 in /usr/lib/python3/dist-packages (from -r /etc/nethserver/pyreq3_11.txt (line 21)) (4.10.3)\nRequirement already satisfied: ldap3==2.9.1 in /usr/local/agent/pyenv/lib/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 22)) (2.9.1)\nRequirement already satisfied: lockfile==0.12.2 in /usr/local/agent/pyenv/lib/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 23)) (0.12.2)\nRequirement already satisfied: MarkupSafe==2.1.3 in /usr/local/agent/pyenv/lib/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 24)) (2.1.3)\nRequirement already satisfied: multidict==6.0.4 in /usr/local/agent/pyenv/lib/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 25)) (6.0.4)\nRequirement already satisfied: packaging==23.0 in /usr/local/agent/pyenv/lib/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 26)) (23.0)\nRequirement already satisfied: pexpect==4.8.0 in /usr/local/agent/pyenv/lib/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 27)) (4.8.0)\nRequirement already satisfied: psutil==5.9.4 in /usr/local/agent/pyenv/lib/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 28)) (5.9.4)\nRequirement already satisfied: ptyprocess==0.7.0 in /usr/local/agent/pyenv/lib/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 29)) (0.7.0)\nRequirement already satisfied: pyasn1==0.4.8 in /usr/local/agent/pyenv/lib/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 30)) (0.4.8)\nRequirement already satisfied: pycares==4.3.0 in /usr/local/agent/pyenv/lib/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 31)) (4.3.0)\nRequirement already satisfied: pycparser==2.21 in /usr/local/agent/pyenv/lib/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 32)) (2.21)\nRequirement already satisfied: pyrsistent==0.18.1 in /usr/lib/python3/dist-packages (from -r /etc/nethserver/pyreq3_11.txt (line 33)) (0.18.1)\nRequirement already satisfied: python-daemon==3.0.1 in /usr/local/agent/pyenv/lib/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 34)) (3.0.1)\nRequirement already satisfied: PyYAML==6.0 in /usr/local/agent/pyenv/lib/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 35)) (6.0)\nRequirement already satisfied: redis==5.0.1 in /usr/local/agent/pyenv/lib/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 36)) (5.0.1)\nRequirement already satisfied: regex-engine==1.1.0 in /usr/local/agent/pyenv/lib/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 37)) (1.1.0)\nRequirement already satisfied: requests==2.31.0 in /usr/local/agent/pyenv/lib/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 38)) (2.31.0)\nRequirement already satisfied: resolvelib==1.0.1 in /usr/local/agent/pyenv/lib/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 39)) (1.0.1)\nRequirement already satisfied: semver==3.0.1 in /usr/local/agent/pyenv/lib/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 40)) (3.0.1)\nRequirement already satisfied: six==1.16.0 in /usr/lib/python3/dist-packages (from -r /etc/nethserver/pyreq3_11.txt (line 41)) (1.16.0)\nRequirement already satisfied: typing-extensions==4.6.3 in /usr/local/agent/pyenv/lib/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 42)) (4.6.3)\nRequirement already satisfied: urllib3==1.26.12 in /usr/lib/python3/dist-packages (from -r /etc/nethserver/pyreq3_11.txt (line 43)) (1.26.12)\nRequirement already satisfied: yarl==1.9.2 in /usr/local/agent/pyenv/lib/python3.11/site-packages (from -r /etc/nethserver/pyreq3_11.txt (line 44)) (1.9.2)\nRequirement already satisfied: charset-normalizer<4.0,>=2.0 in /usr/lib/python3/dist-packages (from aiohttp==3.8.4->-r /etc/nethserver/pyreq3_11.txt (line 6)) (3.0.1)\nRequirement already satisfied: frozenlist>=1.1.1 in /usr/local/agent/pyenv/lib/python3.11/site-packages (from aiohttp==3.8.4->-r /etc/nethserver/pyreq3_11.txt (line 6)) (1.4.1)\nRequirement already satisfied: aiosignal>=1.1.2 in /usr/local/agent/pyenv/lib/python3.11/site-packages (from aiohttp==3.8.4->-r /etc/nethserver/pyreq3_11.txt (line 6)) (1.3.1)\nRequirement already satisfied: setuptools>=62.4.0 in /usr/local/agent/pyenv/lib/python3.11/site-packages (from python-daemon==3.0.1->-r /etc/nethserver/pyreq3_11.txt (line 34)) (69.0.3)\n\n[notice] A new release of pip is available: 23.3.2 -> 24.0\n[notice] To update, run: pip install --upgrade pip\nRunning /var/lib/nethserver/node/update-core.d/50start_promtail...\nRunning /var/lib/nethserver/node/update-core.d/50update_grants...\nRunning /var/lib/nethserver/node/update-core.d/95cleanup_images...\nError: inspecting object: no such object: \"b'5f241e0a355c715986256de13200f48105e54295f4e36fcf4817633aee735c86'\"\njq: error (at <stdin>:1): split input and separator must be strings\n",
        "exit_code": 0,
        "file": "task/node/2/202110ae-05a4-47e8-8dbb-9df1cf1b5294",
        "output": ""
      }
    }
  ],
  "validated": true,
  "result": {
    "error": "_acontrol_task request attempt failed (Connection closed by server.). Retrying...\n_acontrol_task request attempt failed (Connection closed by server.). Retrying...\nsubscribe request attempt failed (Error 111 connecting to cluster-leader:6379. 111.). Retrying...\nsubscribe request recovered successfully at attempt 2\nsubscribe request attempt failed (Error 111 connecting to cluster-leader:6379. 111.). Retrying...\nsubscribe request recovered successfully at attempt 2\n_acontrol_task request recovered successfully at attempt 2\n_acontrol_task request recovered successfully at attempt 2\n<7>run-scriptdir /var/lib/nethserver/cluster/update-core-pre-modules.d/\nTraceback (most recent call last):\n  File \"/var/lib/nethserver/cluster/actions/update-core/70update_modules\", line 18, in <module>\n    agent.run_helper(\"run-scriptdir\", f\"{agent_install_dir}/update-core-pre-modules.d/\")\n  File \"/usr/local/agent/pypkg/agent/__init__.py\", line 175, in run_helper\n    proc = subprocess.Popen(args, stdout=outstream, pass_fds=(*pass_fds, fdw), env=child_env, **kwargs)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n  File \"/usr/lib/python3.11/subprocess.py\", line 1024, in __init__\n    self._execute_child(args, executable, preexec_fn, close_fds,\n  File \"/usr/lib/python3.11/subprocess.py\", line 1901, in _execute_child\n    raise child_exception_type(errno_num, err_msg, err_filename)\nFileNotFoundError: [Errno 2] No such file or directory: 'run-scriptdir'\n",
    "exit_code": 1,
    "file": "task/cluster/3d2233a7-9b22-4f1e-be18-acab9cb4286e",
    "output": ""
  }
}

Okay, this looks more fun. So, it’s bombing out on a file not found or dir not found.

FileNotFoundError: [Errno 2] No such file or directory: 'run-scriptdir'\n",

no idea what that is.

1 Like

okay, so search for that file:

root@ns8-1:/etc# locate run-scriptdir
/var/lib/nethserver/cluster/bin/run-scriptdir

it’s there… okay, lets see about a potentially simple solution:

root@ns8-1:/etc# reboot
1 Like

and that worked fine. I have the rocket with “your cluster is up to date” and the following good pic…

moral of the story in my case: try a reboot! might just work.

I don’t consider this a problem of NS8 whatsoever, very like I ran some system updates and forgot to deal restart the services when python was updated or something similar.

anyway, this is most likely just a waste of space, but hey… it was fun for me!
have a good day!

1 Like