python如何异步执行同步调用？

Answer 1

def req(url):
    resq = queue.Queue()
    q.put((url, resq))
    res = resq.get()
    # ...

def run():
    while True:
        url, resq = q.get()
        res = requests.get(url)
        resq.put(res)

另一种方法是用 multiprocessing.pool.ThreadPool，这个接口和 multiprocessing.Pool 一样，但是用的是 threading：

from multiprocessing.pool import ThreadPool

pool = ThreadPool(num_workers)

def req(url):
    res = pool.apply(requests.get, args=(url,))
    # ...

Answer 2

协程
生产者消费者模式