从 stackoverflow 上找到的几篇文章中,我创建了这段代码。
Scenario
我想要一个 multiprocessing.queue ,几个工人“听”
如果发生键盘中断,主进程不应再将新项目放入队列中,并且在哨兵对象的帮助下,工作人员应优雅地停止。
Problem
我使用的当前版本的问题
signal.signal(signal.SIGINT, signal.SIG_IGN)
忽略Ctrl+C就是它也被主进程忽略。
有任何想法吗 ?
我需要使用多处理工作池吗?一些例子表明我可能必须这样做。那么我还可以使用队列吗?
from multiprocessing import Pool, Process,Queue
import time
import signal
# http://docs.python.org/3.1/library/multiprocessing.html#multiprocessing.Queue
# http://docs.python.org/3.1/library/multiprocessing.html#multiprocessing.Process
class Worker(Process):
def __init__(self, queue,ident):
super(Worker, self).__init__()
# Ignore Signals
signal.signal(signal.SIGINT, signal.SIG_IGN)
self.queue= queue
self.idstr= str(ident)
print "Ident" + self.idstr
def run(self):
print 'Worker started'
# do some initialization here
print 'Computing things!'
for data in iter( self.queue.get, None ):
print "#" + self.idstr + " : " + str(data)
time.sleep(5)
print "#" + self.idstr + "Queue Size: " + str(self.queue.qsize())
print "Worker Done"
#### Main ####
request_queue = Queue(10)
for i in range(4):
Worker( request_queue,i ).start()
try:
for data in range(1000000):
request_queue.put( data )
#print "Queue Size: " + str(request_queue.qsize())
# Sentinel objects to allow clean shutdown: 1 per worker.
for i in range(4):
request_queue.put( None )
except KeyboardInterrupt:
print "Caught KeyboardInterrupt, terminating workers"
while request_queue.empty()==False:
request_queue.get()
request_queue.put( None )