zuul/zuul-jobs
Code Issues Proposed changes
zuul-jobs/roles
History
melanie witt b892aad548 Run sphinx-build in parallel for releasenotes 
Since the recent releases and upper-constraints bumps for
openstackdocstheme 2.1.0 and reno 3.1.0, both sphinx extensions now
support safe parallel reading.

This adds the '-j auto' option to the sphinx-build command for building
release notes to parallelize the build over multiple CPUs.

This effort was inspired by the nova build-openstack-releasenotes job
which typically takes 52m to 1h to run. The job timeout is 1h, so we
are occasionally seeing TIMED_OUT job failures.

With parallel sphinx-build, the job run time is reduced down to 15m.

Change-Id: If3c615119b1a72ce294e22685ddc2dcd6b63f4a0
2020-05-15 00:35:29 +00:00
..
add-authorized-keys
Check for loop_control in with_ type loops
2020-05-01 13:45:34 +02:00
add-build-sshkey
Use main.yaml, not .yml
2020-04-20 17:44:49 +02:00
add-fileserver
Document upload-logs reliance on add-fileserver
2019-01-22 14:41:11 -08:00
add-gpgkey
Add roles to add/remove a GPG key
2017-10-19 13:26:16 -07:00
add-launchpad-credentials
fix the template instruction for writing launchpadlib/creds
2017-10-16 16:41:05 -04:00
add-sshkey
add-sshkey: make the private key owner-writable
2017-10-19 14:23:28 -07:00
ansible-galaxy-import
Fix typo with ansible_galaxy_info.token
2018-10-12 16:59:20 -04:00
ara-report
Made sequence indent consistent
2020-05-07 14:13:55 +01:00
bazel-build
Add Bazel build and ensure roles
2020-04-30 18:05:41 +01:00
bindep
Be consistent about spaces before and after vars
2019-08-07 20:17:41 +01:00
build-container-image
Set up siblings dirs for each build in the loop
2020-05-05 17:52:50 -05:00
build-docker-image
Made sequence indent consistent
2020-05-07 14:13:55 +01:00
build-puppet-module
Rename install-pdk-dependencies to ensure-pdk-dependencies for consistency
2020-04-04 15:41:29 -04:00
build-python-release
Be consistent about spaces before and after vars
2019-08-07 20:17:41 +01:00
build-releasenotes
Run sphinx-build in parallel for releasenotes
2020-05-15 00:35:29 +00:00
buildset-artifacts-location
Fix RST formatting
2018-10-13 10:36:36 +02:00
cabal-test
cabal-test: add build target job variable
2020-05-08 13:38:17 +00:00
chart-testing
Move chart-testing to a role and disable version check
2020-01-09 11:46:41 -08:00
clear-firewall
Add note to clear-firewall docs
2019-07-25 14:29:52 -07:00
collect-container-logs
Revert "Revert "Do not set buildset_fact if it's not present in results.json""
2020-04-28 21:26:16 +02:00
collect-kubernetes-logs
Add loop var policy to ansible-lint
2020-04-29 17:20:59 +02:00
configure-mirrors
Made sequence indent consistent
2020-05-07 14:13:55 +01:00
copy-build-sshkey
Use main.yaml, not .yml
2020-04-20 17:44:49 +02:00
create-afs-token
Be consistent about spaces before and after vars
2019-08-07 20:17:41 +01:00
deploy-openshift
install-openshift: bump version to 3.11.0
2019-08-15 16:54:26 +00:00
destroy-afs-token
Add create / destory roles for AFS tokens
2017-08-28 13:53:10 -04:00
download-artifact
Add loop var policy to ansible-lint
2020-04-29 17:20:59 +02:00
dstat-graph
Add dstat graph roles
2019-07-17 15:45:24 +00:00
emit-job-header
Add loop var policy to ansible-lint
2020-04-29 17:20:59 +02:00
enable-netconsole
Add a netconsole role
2019-09-09 18:14:00 +10:00
ensure-babel
Fix deprecation warning of ansible-2.5
2018-06-04 00:17:18 +00:00
ensure-bazel
ansible-lint: use matchplay instead of matchtask
2020-05-05 20:42:38 +02:00
ensure-bazelisk
Document output variables
2020-04-17 10:45:15 +02:00
ensure-cabal
cabal-test: add build target job variable
2020-05-08 13:38:17 +00:00
ensure-chart-testing
Add loop var policy to ansible-lint
2020-04-29 17:20:59 +02:00
ensure-devstack
Rename install-devstack to ensure-devstack for consistency
2020-04-04 15:41:29 -04:00
ensure-dhall
Remove some temporary files
2020-05-06 07:54:30 +02:00
ensure-docker
Merge "Check for loop_control in with_ type loops"
2020-05-01 16:06:16 +00:00
ensure-dstat-graph
Add dstat graph roles
2019-07-17 15:45:24 +00:00
ensure-ghc
cabal-test: add initial haskell job
2020-04-24 13:12:13 +00:00
ensure-go
Enable yamllint
2020-05-04 17:47:11 +01:00
ensure-golangci-lint
golangci-lint: add job
2020-04-01 17:30:55 -04:00
ensure-haskell-stack
haskell-stack-test: add haskell tool stack test
2020-05-01 15:35:33 +00:00
ensure-helm
Add basic Helm jobs
2020-01-07 17:12:15 +00:00
ensure-hlint
hlint: add haskell source code suggestions job
2020-04-26 12:05:12 +00:00
ensure-if-python
Rename install-if-python to ensure-if-python for consistency
2020-04-04 15:41:29 -04:00
ensure-java
Add ensure-java role
2020-02-21 06:55:47 -06:00
ensure-javascript-build-tool
Extract ensure-javascript-build-tool role
2020-05-12 07:53:14 +02:00
ensure-javascript-packages
Add new non-npm specific javascript jobs
2020-05-12 07:50:19 +02:00
ensure-kubernetes
ensure-kubernetes: refactor to use ensure-package-repositories
2020-05-01 15:49:30 +02:00
ensure-markdownlint
Add a markdownlint job and role
2020-01-27 12:23:24 +00:00
ensure-nodejs
ensure-nodejs: refactor to use ensure-package-repositories
2020-05-01 15:49:30 +02:00
ensure-openshift
Check for loop_control in with_ type loops
2020-05-01 13:45:34 +02:00
ensure-output-dirs
Check for loop_control in with_ type loops
2020-05-01 13:45:34 +02:00
ensure-package-repositories
Remove some temporary files
2020-05-06 07:54:30 +02:00
ensure-packer
Adds roles to install and run hashicorp packer
2020-04-13 16:44:32 +02:00
ensure-pdk-dependencies
Rename install-pdk-dependencies to ensure-pdk-dependencies for consistency
2020-04-04 15:41:29 -04:00
ensure-phoronix-test-suite
Add phoronix-test-suite job
2020-04-03 13:03:07 +00:00
ensure-pip
ensure-pip: use full python3 path
2020-05-11 13:40:18 +10:00
ensure-podman
ansible-lint: use matchplay instead of matchtask
2020-05-05 20:42:38 +02:00
ensure-python
pyenv: install libffi-dev
2020-05-09 14:03:51 -05:00
ensure-sphinx
ensure-sphinx: use failed_when: false instead of ignore_errors: true
2020-04-28 16:20:20 +02:00
ensure-tox
Revert "Revert "ensure-tox: use venv to install""
2020-05-11 11:10:09 +10:00
ensure-twine
Revert "Add environment debugging to ensure-twine role"
2019-04-26 10:35:22 -05:00
ensure-virtualenv
ansible-lint: use matchplay instead of matchtask
2020-05-05 20:42:38 +02:00
ensure-yarn
ensure-yarn: run ensure-nodejs before
2020-05-01 17:07:48 +02:00
fetch-coverage-output
Fix coverage post_failure stat
2018-07-22 09:46:01 -04:00
fetch-javascript-content-tarball
Add loop var policy to ansible-lint
2020-04-29 17:20:59 +02:00
fetch-javascript-output
fetch-javascript-output: add metadata.type
2020-04-07 12:09:26 -04:00
fetch-javascript-tarball
fetch-javascript-tarball: introduce zuul_use_fetch_output
2020-01-24 21:11:07 +00:00
fetch-markdownlint
Add a markdownlint job and role
2020-01-27 12:23:24 +00:00
fetch-output
Do not keep owner when pulling zuul-output
2020-05-01 16:50:54 +02:00
fetch-output-openshift
fetch-logs-openshift: fix miss when replacing item with loop_var: zj_
2020-05-04 23:08:29 +02:00
fetch-phoronix-results
Add phoronix-test-suite job
2020-04-03 13:03:07 +00:00
fetch-puppet-module-output
Check for loop_control in with_ type loops
2020-05-01 13:45:34 +02:00
fetch-python-sdist-output
Check for loop_control in with_ type loops
2020-05-01 13:45:34 +02:00
fetch-sphinx-output
Remove sphinx_output_dir
2019-08-16 15:39:59 +02:00
fetch-sphinx-tarball
Merge "Enable yamllint"
2020-05-05 08:46:58 +00:00
fetch-subunit-output
Made sequence indent consistent
2020-05-07 14:13:55 +01:00
fetch-tox-output
Check for loop_control in with_ type loops
2020-05-01 13:45:34 +02:00
fetch-translation-output
translations: Check for translation-source first
2017-12-16 15:45:36 +00:00
fetch-zuul-cloner
fetch-zuul-cloner: use ensure-pip
2020-04-15 15:34:21 -07:00
find-constraints
Fix deprecation warning of ansible-2.5
2018-06-04 00:17:18 +00:00
generate-zuul-manifest
Fix cleanup of symlink fixtures
2020-02-24 17:17:17 +00:00
git-prepare-nodecache
Check for loop_control in with_ type loops
2020-05-01 13:45:34 +02:00
go
Adds go jobs and roles.
2019-11-20 20:27:21 +01:00
golangci-lint
go: Use 'block: ... always: ...' and failed_when instead of ignore_errors
2020-04-28 16:20:20 +02:00
haskell-stack-test
haskell-stack-test: add build target job variable
2020-05-08 14:11:11 +00:00
helm-template
Fix the checking helm_values_file definition
2020-04-23 14:35:44 -07:00
hlint
hlint: add haskell source code suggestions job
2020-04-26 12:05:12 +00:00
htmlify-logs
Set ignore_basepython_conflict to true
2020-05-09 20:43:52 +00:00
install-devstack
Fail and direct user to use ensure-* version of roles
2020-05-08 19:03:06 +00:00
install-docker
Fail and direct user to use ensure-* version of roles
2020-05-08 19:03:06 +00:00
install-go
Fail and direct user to use ensure-* version of roles
2020-05-08 19:03:06 +00:00
install-if-python
Fail and direct user to use ensure-* version of roles
2020-05-08 19:03:06 +00:00
install-javascript-packages
Fail and direct user to use ensure-* version of roles
2020-05-08 19:03:06 +00:00
install-kubernetes
Fail and direct user to use ensure-* version of roles
2020-05-08 19:03:06 +00:00
install-nodejs
Fail and direct user to use ensure-* version of roles
2020-05-08 19:03:06 +00:00
install-openshift
Fail and direct user to use ensure-* version of roles
2020-05-08 19:03:06 +00:00
install-pdk-dependencies
Fail and direct user to use ensure-* version of roles
2020-05-08 19:03:06 +00:00
install-podman
Fail and direct user to use ensure-* version of roles
2020-05-08 19:03:06 +00:00
install-yarn
Fail and direct user to use ensure-* version of roles
2020-05-08 19:03:06 +00:00
js-package-manager
Extract ensure-javascript-build-tool role
2020-05-12 07:53:14 +02:00
local-log-download
Improve 404 error message on download-logs.sh
2020-04-15 09:51:57 +01:00
log-inventory
log-inventory: remove inventory_file usage
2018-06-27 00:48:24 +00:00
markdownlint
Check for loop_control in with_ type loops
2020-05-01 13:45:34 +02:00
merge-output-to-logs
Add loop var policy to ansible-lint
2020-04-29 17:20:59 +02:00
mirror-workspace-git-repos
Check for loop_control in with_ type loops
2020-05-01 13:45:34 +02:00
multi-node-bridge
Check for loop_control in with_ type loops
2020-05-01 13:45:34 +02:00
multi-node-firewall
Check for loop_control in with_ type loops
2020-05-01 13:45:34 +02:00
multi-node-hosts-file
Check for loop_control in with_ type loops
2020-05-01 13:45:34 +02:00
multi-node-known-hosts
Check for loop_control in with_ type loops
2020-05-01 13:45:34 +02:00
nodejs-test-dependencies
Fix npm-run-test
2017-11-14 13:19:08 +00:00
npm
Add new non-npm specific javascript jobs
2020-05-12 07:50:19 +02:00
packer
Enable yamllint
2020-05-04 17:47:11 +01:00
pause-buildset-registry
Add pause-buildset-registry role
2020-02-24 17:17:12 +00:00
persistent-firewall
Made sequence indent consistent
2020-05-07 14:13:55 +01:00
phoronix-combine-results
ansible-lint: use matchplay instead of matchtask
2020-05-05 20:42:38 +02:00
phoronix-test-suite
Add phoronix-test-suite job
2020-04-03 13:03:07 +00:00
prepare-workspace
Delete files in dest that don't exist
2019-04-01 09:18:26 -04:00
prepare-workspace-git
Check for loop_control in with_ type loops
2020-05-01 13:45:34 +02:00
prepare-workspace-openshift
ansible-lint: use matchplay instead of matchtask
2020-05-05 20:42:38 +02:00
promote-docker-image
ansible-lint: use matchplay instead of matchtask
2020-05-05 20:42:38 +02:00
publish-artifacts-to-fileserver
Document and update fileserver roles
2017-08-18 18:21:50 -05:00
pull-from-intermediate-registry
Add --all to skopeo copy from insecure registry
2020-05-08 15:25:12 -05:00
push-to-intermediate-registry
Add --all to skopeo copy from insecure registry
2020-05-08 15:25:12 -05:00
release-afs-volume
Add role to do a vos release on an AFS volume
2017-09-01 16:40:40 -05:00
remove-build-sshkey
Use main.yaml, not .yml
2020-04-20 17:44:49 +02:00
remove-gpgkey
Fix exec quoting in release remove-gpgkey role
2019-03-15 14:36:14 +01:00
remove-launchpad-credentials
Add roles for adding and removing launchpadlib credentials
2017-08-30 18:53:21 -05:00
remove-sshkey
Add a role to remove an ssh private key
2017-08-29 15:56:45 -07:00
render-diff
dhall-diff: add new job
2020-05-03 19:06:37 +00:00
revoke-sudo
revoke-sudo: only revoke when zuul is sudoer
2017-12-05 08:36:26 +00:00
run-buildset-registry
Support multi-arch image builds with docker buildx
2020-05-04 14:02:13 -05:00
run-dstat
Add dstat graph roles
2019-07-17 15:45:24 +00:00
set-zuul-log-path-fact
Add option for object store friendly log paths
2019-09-04 09:52:38 -07:00
sign-artifacts
Check for loop_control in with_ type loops
2020-05-01 13:45:34 +02:00
sphinx
Check for loop_control in with_ type loops
2020-05-01 13:45:34 +02:00
stage-output
Made sequence indent consistent
2020-05-07 14:13:55 +01:00
start-zuul-console
Update ANSIBLE_LIBRARY to use envsitepackagesdir
2018-10-18 09:23:25 -05:00
test-mirror-workspace-git-repos
Check for loop_control in with_ type loops
2020-05-01 13:45:34 +02:00
test-setup
Skip test-setup.sh in pep8 jobs
2019-07-10 19:02:57 +02:00
test-upload-logs-swift
test-upload-logs-swift: revert download script
2020-03-30 12:32:02 +11:00
tox
Add explanatory comment to tox siblings
2020-05-11 15:32:09 +02:00
trigger-readthedocs
Revert "Debugging for readthedoc web ping"
2018-08-02 19:18:40 +10:00
upload-afs-roots
upload-afs: rename to upload-afs-roots; add afs-upload-synchronize
2020-02-04 07:41:00 +11:00
upload-afs-synchronize
Precreate AFS target directory in upload
2020-02-24 19:40:04 +00:00
upload-docker-image
Don't upload to the tag with buildx - only to the change tag
2020-05-07 18:17:59 -05:00
upload-forge
Rework upload-forge role to use module
2019-02-09 10:32:34 +01:00
upload-git-mirror
Add parameter to upload-git-mirror to specify ssh host key
2019-04-01 16:34:59 -04:00
upload-logs
Check for loop_control in with_ type loops
2020-05-01 13:45:34 +02:00
upload-logs-gcs
Fix cleanup of symlink fixtures
2020-02-24 17:17:17 +00:00
upload-logs-swift
Revert "upload-logs-swift: Create a download script"
2020-03-27 14:59:49 +01:00
upload-npm
Change to the executor workdir during npm upload
2017-12-09 17:27:56 +00:00
upload-pypi
Check for loop_control in with_ type loops
2020-05-01 13:45:34 +02:00
use-buildset-registry
Merge "use-buildset-registry: do not update ca when not necessary"
2020-05-05 20:22:57 +00:00
use-docker-mirror
Rename install-docker to ensure-docker for consistency
2020-04-04 15:41:29 -04:00
validate-dco-license
Add validate-dco-license role
2019-01-09 11:39:02 -05:00
validate-host
Enable yamllint
2020-05-04 17:47:11 +01:00
validate-zone-db
Use unique loop vars to avoid conflicts
2020-02-04 12:23:36 -08:00
version-from-git
Fix condition in version-from-git
2018-03-07 08:25:18 +00:00
wait-for-pods
Add loop var policy to ansible-lint
2020-04-29 17:20:59 +02:00
write-inventory
write-inventory: Add groups to created inventory
2018-08-28 19:54:21 +10:00
yarn
Add new non-npm specific javascript jobs
2020-05-12 07:50:19 +02:00
__init__.py
Enable Python 2.7 unit tests
2018-08-17 10:23:20 +10:00