buildbot/docker, branch v24

docker,worker: install python3-cryptography

2024-11-25T10:12:20Z

Addition of OPTEE support along with STM32 added a requirment on python3-cryptography and without it buildbots for STM32 will fail with: Checking 'python3-cryptography'... failed. Checking 'python3-pyelftools'... ok. optee-os: Please install the Python3 cryptography module make[3]: *** [/builder/shared-workdir/build/include/prereq.mk:9: prereq] Error 1 So install python3-cryptography to satisfy it. Signed-off-by: Robert Marko Link: https://github.com/openwrt/buildbot/pull/61 Signed-off-by: Petr Štetiar

Allow signing of artifacts with key provided by GPG agent

2024-11-05T05:07:59Z

In our case the GPG agent serves 0x1D53D1877742E911 key stored on Nitrokey3 USB dongle. GPG key is bind mounted from the host. References: https://lists.openwrt.org/pipermail/openwrt-devel/2023-May/041044.html Signed-off-by: Petr Štetiar

docker,worker: install pyelftools

2024-11-04T06:35:02Z

Without it, errors may appear: WARNING: Makefile 'package/feeds/telephony/freeswitch/Makefile' has a dependency on 'libpcre', which does not exist make[2]: Entering directory '/builder/shared-workdir/build/scripts/config' make[2]: 'conf' is up to date. make[2]: Leaving directory '/builder/shared-workdir/build/scripts/config' Checking 'python3-pyelftools'... failed. Checking 'python3-dev'... ok. Checking 'python3-setuptools'... ok. Checking 'swig'... ok. u-boot: Please install the Python3 elftools module Fixes: 3ac7d39bd4c3 ("buildworker,buildmaster: bump Debian to version 12") Signed-off-by: Paul Spooren

Revert "buildworker,buildmaster: bump Debian to version 12"

2024-11-04T06:12:05Z

This reverts commit 3ac7d39bd4c364d76e78b3ba50c23a68e0b05c0f as it was decided to stay on Debian 11 for 24.10 release as well. Signed-off-by: Petr Štetiar

buildworker: start: fix broken non TLS setups

2024-11-04T06:12:04Z

Changes in commit 3812ff7bb296 ("buildworker: start: fix worker startup failure after update") broke non TLS setups. So lets fix it by setting SSL: only if BUILDWORKER_TLS is set. Fixes: 3812ff7bb296 ("buildworker: start: fix worker startup failure after update") Reported-by: Paul Spooren Signed-off-by: Petr Štetiar

buildworker: start: fix leaking BUILDWORKER_TLS env variable

2024-09-28T17:17:50Z

I've noticed leakage of BUILDWORKER_TLS environment variable in build logs, so lets fix it in a generic way via new `cleanup_buildworker_env_variables()` by using Bash's parameter expansion and unset all environment variables starting with BUILDWORKER_ prefix. Signed-off-by: Petr Štetiar

docker: buildworker: add missing file package

2024-09-27T07:39:12Z

In Debian 11 (Bullseye), the `file` package was installed indirectly because the `man-db` package recommended it. The `man-db` package is often installed as a dependency of other packages, such as `build-essential` and tools like `gcc` and `make`. By default, `apt-get` installs recommended packages, so `file` was installed automatically. Starting from Debian 12 (Bookworm), the `man-db` package no longer recommends the `file` package. This change was made to reduce the size of minimal container images and installations where `file` is not essential. So lets install this package explicitly. Signed-off-by: Petr Štetiar

buildworker: start: fix worker startup failure after update

2024-09-26T21:21:09Z

Workers are currently refusing to work: Unhandled Error Traceback (most recent call last): File "/opt/venv/lib/python3.11/site-packages/twisted/application/app.py", line 673, in run runApp(config) File "/opt/venv/lib/python3.11/site-packages/twisted/scripts/twistd.py", line 29, in runApp runner.run() File "/opt/venv/lib/python3.11/site-packages/twisted/application/app.py", line 370, in run self.application = self.createOrGetApplication() File "/opt/venv/lib/python3.11/site-packages/twisted/application/app.py", line 437, in createOrGetApplication application = getApplication(self.config, passphrase) --- --- File "/opt/venv/lib/python3.11/site-packages/twisted/application/app.py", line 446, in getApplication application = service.loadApplication(filename, style, passphrase) File "/opt/venv/lib/python3.11/site-packages/twisted/application/service.py", line 404, in loadApplication application = sob.loadValueFromFile(filename, "application") File "/opt/venv/lib/python3.11/site-packages/twisted/persisted/sob.py", line 174, in loadValueFromFile codeObj = compile(data, filename, "exec") builtins.SyntaxError: keyword argument repeated: connection_string (buildbot.tac, line 49) as the buildbot.tac template changed in commit 4ba1dcb66155 ("worker: Add option --connection-string for create-worker") and in version v3.10.0. So lets use this new `--connection-string` feature and get rid of the sed-fu. Fixes: efbddc90d8e6 ("Bump buildbot to v3.11.1 release") Signed-off-by: Petr Štetiar

buildworker: Drop installation of Python 2

2024-09-26T11:19:17Z

Old releases of OpenWrt would require it but that's something of the past - time is running. Signed-off-by: Paul Spooren

buildworker,buildmaster: Use venv for Pip

2024-09-26T11:19:16Z

Debian 12 complains if using Pip without a virtualenv since it could break the system. Signed-off-by: Paul Spooren