openstack/oslo.messaging
Code Issues Proposed changes
8e3c523fd7
oslo.messaging/releasenotes/notes
History
Arnaud Morin 8e3c523fd7 Auto-delete the failed quorum rabbit queues 
When rabbit is failing for a specific quorum queue, the only thing to
do is to delete the queue (as per rabbit doc, see [1]).

So, to avoid the RPC service to be broken until an operator eventually
do a manual fix on it, catch any INTERNAL ERROR (code 541) and trigger
the deletion of the failed queues under those conditions.
So on next queue declare (triggered from various retries), the queue
will be created again and the service will recover by itself.

Closes-Bug: #2028384
Related-bug: #2031497

[1] https://www.rabbitmq.com/quorum-queues.html#availability

Signed-off-by: Arnaud Morin <arnaud.morin@ovhcloud.com>
Change-Id: Ib8dba833542973091a4e0bf23bb593aca89c5905
2023-11-12 00:08:20 +01:00
..
add_reno-3b4ae0789e9c45b4.yaml Add reno for releasenotes management 2016-05-19 17:14:31 +03:00
add-enable_cancel_on_failover-22ac472b93dd3a23.yaml Cancel consumer if queue down 2020-07-31 06:05:16 +08:00
add-ping-endpoint.yaml Add a ping endpoint to RPC dispatcher 2020-08-18 15:09:29 +02:00
add-quorum-control-configurations-beed79811ff97ba2.yaml Add quorum queue control configurations 2022-04-06 19:46:40 +00:00
add-ssl-support-for-kafka.yaml Add support for kafka SSL autentication 2020-01-16 23:26:53 +01:00
adding_support_for_quorum_queues-3101d055b492289e.yaml Adding support for rabbitmq quorum queues 2022-02-05 07:12:49 +00:00
allow-transient-no-expire-ce7ae9d8c9d15751.yaml Allow creating transient queues with no expire 2023-11-12 00:08:20 +01:00
auto-deleted-failed-quorum-ca6a3923c3ed999a.yaml Auto-delete the failed quorum rabbit queues 2023-11-12 00:08:20 +01:00
blocking-executor-deprecated-895146c1c3bf2f51.yaml Add note for blocking executor deprecation 2017-06-08 14:26:10 +02:00
blocking-executor-support-dropped-a3bc74c6825863f0.yaml Remove the deprecated blocking executor 2020-02-18 15:49:27 +01:00
bug-1917645-rabbit-use-retry-parameter-for-notifications-3f7c508ab4437579.yaml [rabbit] use retry parameters during notification sending 2022-01-12 12:22:55 +01:00
bug-1981093-kafka-dont-log-in-tpool-execute-fa50ceee2d55ebae.yaml Remove logging from ProducerConnection._produce_message 2022-08-03 17:35:16 +02:00
bug-1993149-e8b231791b65e938.yaml Increase ACK_REQUEUE_EVERY_SECONDS_MAX to exceed default kombu_reconnect_delay 2023-04-20 15:27:58 -05:00
bump-amqp-version-due-to-tls-issue-e877b152eb101c15.yaml Bump amqp requirement version to >=2.4.1 2019-02-18 18:29:26 +01:00
connection_ttl-2cf0fe6e1ab8c73c.yaml Introduce TTL for idle connections 2016-07-22 13:03:04 +03:00
declare_fallback_durable_exchange-0db677de4fdf1e78.yaml Force creating non durable control exchange when a precondition failed 2021-12-15 13:56:12 +01:00
deprecate-ZeroMQ-driver-a8af25aaba867c5b.yaml Add ZeroMQ deprecation release note 2018-06-15 15:27:49 -04:00
deprecated-amqp1-driver-4bf57449bc2b7aad.yaml Deprecate the amqp1 driver and Remove qpid functional tests 2022-10-18 11:27:46 +02:00
disable-mandatory-flag-a6210a534f3853f0.yaml Deprecate the mandatory flag 2021-02-01 10:31:16 +01:00
do-not-run-heartbeat-in-pthread-by-default-42e1299f59b841f8.yaml Change default value of "heartbeat_in_pthread" to False 2022-08-16 14:14:29 +00:00
drop-python27-support-5ef2f365d8930483.yaml reword releasenote for py27 support dropping 2020-02-06 11:03:41 +01:00
enforce_fips_mode-07dd259eb8a73c2b.yaml Add a new option to enforce the OpenSSL FIPS mode 2021-11-08 15:05:30 +01:00
fix-access_policy-deafult-a6954a147cb002b0.yaml Fix default value of RPC dispatcher access_policy 2017-09-24 20:25:38 -07:00
get_rpc_transport-4aa3511ad9754a60.yaml Add get_rpc_transport call 2017-05-12 12:30:41 -04:00
get-rpc-client-0b4aa62160864b29.yaml Implement get_rpc_client function 2022-10-25 11:42:40 +00:00
get-rpc-helpers-cls-8911826ac08aef2a.yaml Support overriding class for get_rpc_* helper functions 2023-01-23 08:40:37 +00:00
handle-missing-queue-553a803f94976be7.yaml Correctly handle missing RabbitMQ queues 2021-02-04 09:47:08 +00:00
heartbeat-rate-3-7ada9edbccc11a3f.yaml Set default heartbeat_rate to 3 2023-08-08 15:23:59 +02:00
kafka-client-library-change-fe16d5a34550db7f.yaml Switch driver to confluent-kafka client library 2018-12-04 11:25:07 -05:00
no-log-if-ignore-errors-e2223b8a646b4c40.yaml Don't log NoSuchMethod for special non-existing methods 2020-01-23 15:37:31 +04:00
option-rabbitmq-max_retries-has-been-deprecated-471f66a9e6d672a2.yaml Add deprecated relnote for max_retries rabbit configuration option 2016-07-12 17:40:01 -07:00
oslo-metrics-support-fe16343a637cc14b.yaml Add Support For oslo.metrics 2021-06-08 22:22:37 +08:00
pika-driver-has-been-deprecated-e2407fa53c91fe5c.yaml Mark the Pika driver as deprecated 2017-05-30 13:21:23 -04:00
rabbit_quorum_typo-9c06a9fd8d767f53.yaml Fix typo in quorum-related variables for RabbitMQ 2023-02-14 15:20:00 +00:00
rabbit-no-wait-for-ack-9e5de3e1320d7660.yaml Modify grammatical errors 2018-02-08 09:16:03 +08:00
removal-deprecated-options-6d4c5db90525c52d.yaml Add release note about deprecated option removals 2018-09-14 11:48:28 -06:00
remove-pika-1bae204ced2521a3.yaml Remove the deprecated Pika driver 2018-03-21 10:58:23 -04:00
remove-RequestContextSerializer-234c0496a7e0376b.yaml serializer: remove deprecated RequestContextSerializer 2017-03-29 16:21:17 +08:00
remove-ZeroMQ-driver-e9e0bbbb7bd4f5e6.yaml Remove the deprecated ZeroMQ driver 2018-08-28 16:00:50 -04:00
retry-support-07996ef04dda9482.yaml Retry support for oslo_messaging_notifications driver 2017-04-18 11:53:19 -07:00
RPC-call-monitoring-7977f047d069769a.yaml Enable RPC call monitoring in AMQP 1.0 driver 2018-06-13 11:01:38 -04:00
run-heartbeat-in-pthread-by-default-28637b41ebf500dc.yaml Run rabbitmq heartbeat in python thread by default 2020-08-27 12:22:41 +02:00
undeprecate_heartbeat_in_pthread-48e2c1fc008cf208.yaml Remove deprecation of heartbeat_in_pthread 2021-10-14 15:20:42 +02:00
use-extras-for-optional-deps-2a00e8007ef7a629.yaml Move requirements for the optional drivers (amqp1, kafka) 2018-04-16 10:38:07 -04:00