运行 2 天后 aio_pika 的随机连接错误

Question

我有一个 asyncio 脚本，它每 40 秒通过 aio_pika 库连接到 rabbitmq，并检查是否有任何消息并将它们打印出来，然后永远重复。然而，通常，在运行的 2 天左右后，我将开始收到无穷无尽的连接异常错误，这只能通过重新启动脚本来解决。也许我的 asyncio 脚本的逻辑中存在一些明显的错误，我遗漏了什么？

#!/usr/bin/python3
import time
import async_timeout
import asyncio
import aio_pika

async def got_message(message: aio_pika.IncomingMessage):
    with message.process():
        print(message.body.decode())

async def main(loop):
    try:
        with async_timeout.timeout(10):
            connection = await aio_pika.connect_robust(
                host='#', 
                virtualhost='#', 
                login='#', 
                password='#',
                port=5671,
                loop=loop, 
                ssl=True
            )

            channel = await connection.channel()

            await channel.set_qos(prefetch_count=100)

            queue_name='mm_message'
            queue = await channel.declare_queue(auto_delete=False, name=queue_name)

            routing_key='mm_msg'
            await queue.bind("amq.topic", routing_key)
            que_len = queue.declaration_result.message_count
            if(que_len > 0):
                await queue.consume(got_message)
    except:
        print("connection problems..")

if __name__ == "__main__":
    loop = asyncio.get_event_loop()
    while(True):
        time.sleep(40)
        loop.run_until_complete(main(loop))

这是一段时间后我不断收到的错误：

Traceback (most recent call last):
  File "/usr/lib/python3.5/asyncio/events.py", line 125, in _run
    self._callback(*self._args)
  File "/usr/local/lib/python3.5/dist-packages/aio_pika/pika/adapters/base_connection.py", line 364, in _handle_events
    self._handle_read()
  File "/usr/local/lib/python3.5/dist-packages/aio_pika/pika/adapters/base_connection.py", line 415, in _handle_read
    self._on_data_available(data)
  File "/usr/local/lib/python3.5/dist-packages/aio_pika/pika/connection.py", line 1347, in _on_data_available
    self._process_frame(frame_value)
  File "/usr/local/lib/python3.5/dist-packages/aio_pika/pika/connection.py", line 1414, in _process_frame
    if self._process_callbacks(frame_value):
  File "/usr/local/lib/python3.5/dist-packages/aio_pika/pika/connection.py", line 1384, in _process_callbacks
    frame_value)  # Args
  File "/usr/local/lib/python3.5/dist-packages/aio_pika/pika/callback.py", line 60, in wrapper
    return function(*tuple(args), **kwargs)
  File "/usr/local/lib/python3.5/dist-packages/aio_pika/pika/callback.py", line 92, in wrapper
    return function(*args, **kwargs)
  File "/usr/local/lib/python3.5/dist-packages/aio_pika/pika/callback.py", line 236, in process
    callback(*args, **keywords)
  File "/usr/local/lib/python3.5/dist-packages/aio_pika/pika/connection.py", line 1332, in _on_connection_tune
    self._send_connection_open()
  File "/usr/local/lib/python3.5/dist-packages/aio_pika/pika/connection.py", line 1517, in _send_connection_open
    self._on_connection_open, [spec.Connection.OpenOk])
  File "/usr/local/lib/python3.5/dist-packages/aio_pika/pika/connection.py", line 1501, in _rpc
    self._send_method(channel_number, method_frame)
  File "/usr/local/lib/python3.5/dist-packages/aio_pika/pika/connection.py", line 1569, in _send_method
    self._send_frame(frame.Method(channel_number, method_frame))
  File "/usr/local/lib/python3.5/dist-packages/aio_pika/pika/connection.py", line 1548, in _send_frame
    raise exceptions.ConnectionClosed
aio_pika.pika.exceptions.ConnectionClosed

Answer 1

except:
    print("connection problems..")

这将捕获 KeyboardInterrupt、SystemExit 等服务异常。如果你不打算重新引发异常，你应该 never do 这样的事情。至少你应该写：

except Exception:
    print("connection problems..")

但是，在 asyncio 的上下文中，上面的代码片段会破坏 cancellation. To avoid it as explained here 的机制，您应该这样写：

try:
    await operation
except asyncio.CancelledError:
    raise
except Exception:
    log.log('an error has occurred')

同样重要的是要了解连接不仅应该打开，还应该关闭（无论打开和关闭之间发生了什么）。为了实现这一点，人们通常使用（在 asyncio 中 - 异步上下文管理器）。

aio_pika 似乎也不例外。正如 example 所示，在处理连接时应使用 async with：

connection = await aio_pika.connect_robust(
    "amqp://guest:guest@127.0.0.1/", loop=loop
)

async with connection:
    # ...

运行 2 天后 aio_pika 的随机连接错误

Random connection errors with aio_pika after 2 days of running

aio

python-3.x

pika

python-asyncio