Skip to main content
 首页 » 编程设计

Python 多处理 : cPickle. PicklingError:无法腌制 type 'instancemethod' >

2025年05月04日8kuangbin

<分区>

我正在尝试使用 python multiprocessing 模块来处理大量 url,我正在使用 multiprocessing.Pool 对象为其创建工作进程,如下所示。

from multiprocessing import Pool, TimeoutError, cpu_count 
 
class MyClass: 
    def square(self, x): 
        return x*x 
 
    @staticmethod 
    def getNumbers(): 
        return range(10) 
 
    def calculate(self): 
        pool = Pool(processes=min(cpu_count(),8)) 
        results = [pool.apply(self.square,(i,)) for i in self.getNumbers()] 
        pool.close() 
        pool.join() 
        for result in results: 
            print result 
 
 
if __name__ == '__main__': 
    instance = MyClass() 
    instance.calculate() 

然而,上面的代码片段导致如下酸洗错误:

Traceback (most recent call last): 
  File "multi.py", line 24, in <module> 
    instance.calculate() 
  File "multi.py", line 15, in calculate 
    results = [pool.apply(self.square,(i,)) for i in self.getNumbers()] 
  File "/usr/lib/python2.7/multiprocessing/pool.py", line 244, in apply 
    return self.apply_async(func, args, kwds).get() 
  File "/usr/lib/python2.7/multiprocessing/pool.py", line 558, in get 
    raise self._value 
cPickle.PicklingError: Can't pickle <type 'instancemethod'>: attribute lookup __builtin__.instancemethod failed 

注意 之前有人在 SO 上提出过类似的问题,但仍未得到答复:cPickle.PicklingError: Can't pickle <type 'instancemethod'>: attribute lookup __builtin__.instancemethod failed

编辑 给出了更好的示例代码示例