buildbot/phase1, branch v3

ci: add basic config checking with ruff

2023-05-16T14:52:33Z

Signed-off-by: Petr Štetiar

phase1: actually make rsync -4 configurable

2023-05-16T14:52:33Z

54e80d5ce introduced an interpolate bug that would evaluate an empty string as being part of the arguments passed to rsync, resulting in a failure as rsync interprets that empty string as a source. This commit fixes this by instead appending '4' to regular shortopts when necessary. Fixes: 54e80d5ce Signed-off-by: Thibaut VARÈNE Signed-off-by: Petr Štetiar

phase1: perform kmodupload only when needed

2023-05-16T14:52:33Z

Fixes: 909e899 Signed-off-by: Thibaut VARÈNE Signed-off-by: Petr Štetiar

phase1: fix crash on exception during Git update

2023-05-15T15:36:01Z

Fixes following exception: 2023-05-15 14:08:56+0000 [-] build got exception when running step Git(name='git', repourl='https://git.openwrt.org/openwrt/openwrt.git', mode='full', method='fresh', locks=renderer(), haltOnFailure=True) 2023-05-15 14:08:56+0000 [-] Unhandled Error Traceback (most recent call last): File "/usr/local/lib/python3.9/dist-packages/twisted/internet/defer.py", line 1792, in gotResult _inlineCallbacks(r, gen, status, context) File "/usr/local/lib/python3.9/dist-packages/twisted/internet/defer.py", line 1693, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.9/dist-packages/twisted/python/failure.py", line 518, in throwExceptionIntoGenerator return g.throw(self.type, self.value, self.tb) File "/usr/local/lib/python3.9/dist-packages/buildbot/process/build.py", line 576, in _start_next_step_impl log.err(e) --- --- File "/usr/local/lib/python3.9/dist-packages/buildbot/process/build.py", line 562, in _start_next_step_impl results = yield step.startStep(self.conn) builtins.KeyError: None as None is valid property value, but cant be used as dict index. Signed-off-by: Petr Štetiar

phase1: make 'rsync -4' worker-configurable

2023-05-15T15:36:01Z

We set '-4' in rsync_defopts, asking rsync to "prefer" ipv4 whenever possible on _all_ workers. This was historically done because some workers had flaky ipv6 connectivity, however in the future the reverse may be true, with worker having worse networking over ipv4 than ipv6. This change introduces an 'rsync_ipv4' worker configuration option: when set to a true value, the old rsync behavior (adding '-4') is used, when unset or set to false, the extra rsync argument is not used. Signed-off-by: Thibaut VARÈNE

phase1: call host ccache in stats

2023-05-15T15:36:01Z

We do not use the staging_dir ccache on buildbots (config seed contains CONFIG_CCACHE=n), only the host tool if present. Also only execute this step if 'ccache_command' is set. Signed-off-by: Thibaut VARÈNE

phase1: tag builders with their intended branch name

2023-05-15T15:36:01Z

This helps sorting them in waterfall and builders views. Signed-off-by: Thibaut VARÈNE

phase1: documentation update

2023-05-15T15:36:01Z

Signed-off-by: Thibaut VARÈNE

phase1: allow restricting builders to tag builds only

2023-05-15T15:36:01Z

Signed-off-by: Thibaut VARÈNE

phase1: refactor worker parsing

2023-05-15T15:36:01Z

Signed-off-by: Thibaut VARÈNE