opendev/system-config
Code Issues Proposed changes

Increase PyPI substitute line length limit to 20m

Browse Source 
The earlier problems identified with using mod_substitute have been
narrowed down to the new PEP 691 JSON simple API responses from
Warehouse, which are returned as a single line of data. The
currently largest known project index response we've been diagnosing
this problem with is only 1524169 characters in length, but there
are undoubtedly others and they will only continue to grow with
time. The main index is also already over the new 5m limit we set
(nearly double it), and while we don't currently process it with
mod_substitute, we shouldn't make it harder to do so if we need to
later.

Change-Id: Ib32acd48e5166780841695784c55793d014b3580
This commit is contained in:
Jeremy Stanley 2022-07-21 20:26:23 +00:00
parent 8ec36dd685
commit 0f1063963e
1 changed files with 2 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

4
playbooks/roles/mirror/templates/mirror.vhost.j2
View File

@ -100,7 +100,7 @@ ErrorLogFormat "[%{cu}t] [%-m:%l] [pid %P:tid %T] %7F: %E: [client\ %a] %M% , \
# Rewrite the locations of the actual files
<Location /pypi>
SetOutputFilter INFLATE;SUBSTITUTE;DEFLATE
SubstituteMaxLineLength 5m
SubstituteMaxLineLength 20m
Substitute "s|https://files.pythonhosted.org/|/pypifiles/|ni"
</Location>
@ -252,7 +252,7 @@ ErrorLogFormat "[%{cu}t] [%-m:%l] [pid %P:tid %T] %7F: %E: [client\ %a] %M% , \
# Rewrite the locations of the actual files
<Location /pypi>
SetOutputFilter INFLATE;SUBSTITUTE;DEFLATE
SubstituteMaxLineLength 5m
SubstituteMaxLineLength 20m
Substitute "s|https://files.pythonhosted.org/|/pypifiles/|ni"
</Location>