zuul-registry/zuul_registry
Clark Boylan 1105d2bada Implement paging in swift object listing
Swift by default only returns a maximum of 10k objects per object
listing. This is problematic when pruning (and potentially otherwise) as
we may not list valid manifests resulting in us never marking the blobs
belonging to those manfiests as valid. These blobs would then get
erroneously deleted.

Address this by paging through object listings using swift's marker
parameter.

Change-Id: Ida85076b716a7718a8ca5fe50e4fbb90b3a41cbf
2024-11-15 15:25:41 -08:00
..
__init__.py Fix container image build 2019-10-02 13:50:42 -04:00
filesystem.py Add logging to filesystem driver 2024-01-03 11:00:51 -08:00
hasher.py Replace rehash with sha256 2024-01-03 11:00:51 -08:00
main.py Add dry-run option 2024-11-06 15:30:50 -08:00
s3.py Add s3 support 2024-01-03 11:00:51 -08:00
storage.py Add dry-run option 2024-11-06 15:30:50 -08:00
storageutils.py Rework the stream_blob/stream_object API 2019-10-07 19:41:07 +00:00
swift.py Implement paging in swift object listing 2024-11-15 15:25:41 -08:00