Python 并发 ThreadPoolExecutor - 如果满足条件则停止执行

Question

我坚持尝试使用 ThreadPoolExecutor 进行多线程处理，如果其中一个进程满足条件，执行将被安全地停止，这样剩余的线程就不必结束。

我有以下概念，但它不起作用，它只保留运行:

import time, sys
from concurrent.futures import ThreadPoolExecutor

data = {"future1": 'blank', "future2": 'blank', "future3": 'blank'}

def function1(n):
   global data #not sure if this is necessary, as it seems to be able to access this anyway?
   print(n)
   time.sleep(1)
   data['future1'] = n

def function2(n):
   global data
   print(n)
   time.sleep(2)
   data['future2'] = n

def function3(n):
   global data
   print(n)
   time.sleep(3)
   data['future3'] = n

with ThreadPoolExecutor(max_workers=4) as executor:
  while True:
    future1=executor.submit(function1, 'test1')
    future2=executor.submit(function2, 'test2')
    future3=executor.submit(function3, 'test3')

    if data['future2']!='blank':
      executor.shutdown(wait=False)
      sys.exit()

不确定我在这里做错了什么，我们将不胜感激。

Answer 1

您是 while True: 循环中的运行个线程，它一次又一次地启动调用。

with ThreadPoolExecutor(max_workers=4) as executor:

    future1=executor.submit(function1, 'test1')
    future2=executor.submit(function2, 'test2')
    future3=executor.submit(function3, 'test3')

    while True:
        if data['future2']!='blank':
            executor.shutdown(wait=False)
            sys.exit()

仍然executor.shutdown(wait=False)将等待其子进程完成

Answer 2

这是完整的答案，事实证明 executor.shutdown(wait=False) 不是 Sachin 提到的方法。完全归功于 https://gist.github.com/clchiou/f2608cbe54403edb0b13

import time, sys
from concurrent.futures import ThreadPoolExecutor
import concurrent.futures.thread

data = {"future1": None, "future2": None, "future3": None}

def function1(n):
   time.sleep(1)
   data['future1'] = n
   print(n)

def function2(n):
   time.sleep(2)
   data['future2'] = n
   print(n)

def function3(n):
   time.sleep(3)
   data['future3'] = n
   print(n)

with ThreadPoolExecutor(max_workers=4) as executor:
  executor.submit(function1, 'test1')
  executor.submit(function2, 'test2')
  executor.submit(function3, 'test3')

  while True:
    if any(v is not None for v in data.values()):
      executor._threads.clear()
      concurrent.futures.thread._threads_queues.clear()
      break

print(data)

Python 并发 ThreadPoolExecutor - 如果满足条件则停止执行

Python Concurrency ThreadPoolExecutor - stop execution if condition is met

python

multithreading

concurrency

threadpoolexecutor