system-config/playbooks/roles/mirror-update/files/yum-puppetlabs-mirror-update
Ian Wienand b85282c046 Move rsync mirror updates to new opendev.org mirror-update host
This move was prompted by wishing to expose the mirror update logs for
the rsync updates so that debugging problems does not require a root
user (note: not actually done in this change; will be a follow-on).

Rather than start hacking at puppet, the rsync mirror scripts make a
nice delination point for starting an Ansible-first/Bionic update.

Most magic is included in the scripts, so there is not much more to do
than copy them.  The host uses the existing kerberos and openafs roles
and copies the key material into place (to be added before merge).

Note the scripts are removed from the extant puppet so we don't have
two updates happening simultaneously.  This will also require a manual
clean to remove the cron jobs as a once-off when merging.

The other part of mirror-update is the reprepro based scripts for the
various debuntu repositories.  They are left as future work for now.

Testing is added to ensure dependencies and scripts are all in place.

Change-Id: I525ac18b55f0e11b0a541b51fa97ee5d6512bf70
2019-07-02 16:42:33 +10:00

65 lines
1.8 KiB
Bash
Executable File

#!/bin/bash -xe
# Copyright 2018 Red Hat, Inc.
#
# Licensed under the Apache License, Version 2.0 (the "License"); you may
# not use this file except in compliance with the License. You may obtain
# a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS, WITHOUT
# WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the
# License for the specific language governing permissions and limitations
# under the License.
MIRROR_VOLUME=$1
if [[ ${NO_TIMEOUT:-0} -eq 1 ]]; then
echo "Running interactively"
TIMEOUT=""
else
TIMEOUT="timeout -k 2m 30m"
fi
BASE="/afs/.openstack.org/mirror/yum-puppetlabs"
MIRROR="rsync://rsync.puppet.com/packages"
K5START="k5start -t -f /etc/yum-puppetlabs.keytab service/yum-puppetlabs-mirror -- $TIMEOUT"
if ! [ -f $BASE ]; then
$K5START mkdir -p $BASE
fi
date --iso-8601=ns
echo "Running rsync..."
# We don't need cisco-wrlinux arch in OpenStack Infra.
$K5START rsync -rlptDvz \
--delete \
--delete-excluded \
--exclude="cisco-wrlinux" \
--exclude="el/5" \
--exclude="el/6" \
--exclude="fedora/24" \
--exclude="fedora/25" \
--exclude="fedora/26" \
--exclude="fedora/27" \
--exclude="fedora/f20" \
--exclude="fedora/f21" \
--exclude="fedora/f22" \
--exclude="fedora/f23" \
--exclude="fedora/f24" \
--exclude="fedora/f25" \
--exclude="fedora/f26" \
--exclude="fedora/f27" \
$MIRROR/yum/ $BASE
# TODO(pabelanger): Validate rsync process
date --iso-8601=ns | $K5START tee $BASE/timestamp.txt
echo "rsync completed successfully, running vos release."
k5start -t -f /etc/afsadmin.keytab service/afsadmin -- vos release -v $MIRROR_VOLUME
date --iso-8601=ns
echo "Done."