buildbot/phase1, branch v2

phase1: fix crash on exception during Git update

2023-05-15T15:36:01Z

Fixes following exception: 2023-05-15 14:08:56+0000 [-] build got exception when running step Git(name='git', repourl='https://git.openwrt.org/openwrt/openwrt.git', mode='full', method='fresh', locks=renderer(), haltOnFailure=True) 2023-05-15 14:08:56+0000 [-] Unhandled Error Traceback (most recent call last): File "/usr/local/lib/python3.9/dist-packages/twisted/internet/defer.py", line 1792, in gotResult _inlineCallbacks(r, gen, status, context) File "/usr/local/lib/python3.9/dist-packages/twisted/internet/defer.py", line 1693, in _inlineCallbacks result = context.run( File "/usr/local/lib/python3.9/dist-packages/twisted/python/failure.py", line 518, in throwExceptionIntoGenerator return g.throw(self.type, self.value, self.tb) File "/usr/local/lib/python3.9/dist-packages/buildbot/process/build.py", line 576, in _start_next_step_impl log.err(e) --- --- File "/usr/local/lib/python3.9/dist-packages/buildbot/process/build.py", line 562, in _start_next_step_impl results = yield step.startStep(self.conn) builtins.KeyError: None as None is valid property value, but cant be used as dict index. Signed-off-by: Petr Štetiar

phase1: make 'rsync -4' worker-configurable

2023-05-15T15:36:01Z

We set '-4' in rsync_defopts, asking rsync to "prefer" ipv4 whenever possible on _all_ workers. This was historically done because some workers had flaky ipv6 connectivity, however in the future the reverse may be true, with worker having worse networking over ipv4 than ipv6. This change introduces an 'rsync_ipv4' worker configuration option: when set to a true value, the old rsync behavior (adding '-4') is used, when unset or set to false, the extra rsync argument is not used. Signed-off-by: Thibaut VARÈNE

phase1: call host ccache in stats

2023-05-15T15:36:01Z

We do not use the staging_dir ccache on buildbots (config seed contains CONFIG_CCACHE=n), only the host tool if present. Also only execute this step if 'ccache_command' is set. Signed-off-by: Thibaut VARÈNE

phase1: tag builders with their intended branch name

2023-05-15T15:36:01Z

This helps sorting them in waterfall and builders views. Signed-off-by: Thibaut VARÈNE

phase1: documentation update

2023-05-15T15:36:01Z

Signed-off-by: Thibaut VARÈNE

phase1: allow restricting builders to tag builds only

2023-05-15T15:36:01Z

Signed-off-by: Thibaut VARÈNE

phase1: refactor worker parsing

2023-05-15T15:36:01Z

Signed-off-by: Thibaut VARÈNE

phase1: disable debug messages

2023-05-15T15:36:01Z

Signed-off-by: Thibaut VARÈNE

phase1: prioritize builders by branch order

2023-05-15T15:36:01Z

Signed-off-by: Thibaut VARÈNE

phase1: switch to separate builders per branch per target

2023-05-15T15:36:01Z

This will simplify reporting and ensure consistent build statistics. It will also simplify prioritizing builders by branch. This also introduces a single "trigger" scheduler that will handle all trigger requests for each branch/target combination, speeding up the forcing of builds. Signed-off-by: Thibaut VARÈNE