bd54b99132
Even though Kolla services are configured to log output to file rather than stdout, some stdout still occurs when for example the container re(starts). Since the Docker logs are not constrained in size, they can fill up the docker volumes drive and bring down the host. One example of when this is particularly problematic is when Fluentd cannot parse a log message. The warning output is written to the Docker log and in production we have seen it eat 100GB of disk space in less than a day. We could configure Fluentd not to do this, but the problem may still occur via another mechanism. Change-Id: Ia6d3935263a5909c71750b34eb69e72e6e558b7a Closes-Bug: #1794249
9 lines
355 B
YAML
9 lines
355 B
YAML
---
|
|
features:
|
|
- Docker logs are no longer allowed to grow unbounded and have
|
|
been limited to a fixed size per container. Two new variables
|
|
have been added, `docker_log_max_file` and `docker_log_max_size`
|
|
which default to 5 and 50MB respectively. This means that for
|
|
each container, there should be no more than 250MB of Docker
|
|
logs.
|