2016-03-01 30 views
5

如何轻松创建一个不能被腌制的对象来测试我的rpc代码中的边缘案例?创建不能被腌制的对象

它需要:

  1. 简单
  2. 可靠的(没有预想中Python或泡菜的未来版本打破)
  3. 跨平台

编辑:用途外观像这样:

class TestRPCServer: 
    def foo(self): 
     return MagicalUnpicklableObject() 

def test(): 
    with run_rpc_server_and_connect_to_it() as proxy: 
     with nose.assert_raises(pickle.PickleError): 
      proxy.foo() 
+0

你在构建?我们可以有问题的对象的示例代码? – GLaDOS

回答

6

如果你所需要的只是一个物体,当你腌它时会抛出异常,对于测试的目的,你可以炸掉__getstate__ method

>>> class C: 
...  def __getstate__(self): 
...   raise Exception 
... 
>>> pickle.dumps(C()) 
Traceback (most recent call last): 
    File "<stdin>", line 1, in <module> 
    File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/pickle.py", line 1374, in dumps 
    Pickler(file, protocol).dump(obj) 
    File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/pickle.py", line 224, in dump 
    self.save(obj) 
    File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/pickle.py", line 286, in save 
    f(self, obj) # Call unbound method with explicit self 
    File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/pickle.py", line 723, in save_inst 
    stuff = getstate() 
    File "<stdin>", line 3, in __getstate__ 
Exception 

几乎没有那么简单!


如果你想有一个人工少的情况下,想使用OS资源,如文件句柄,或者套接字或线程对象等

>>> with open('spam.txt', 'w') as f: 
...  pickle.dumps(f) 
... 
Traceback (most recent call last): 
    File "<stdin>", line 2, in <module> 
    File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/pickle.py", line 1374, in dumps 
    Pickler(file, protocol).dump(obj) 
    File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/pickle.py", line 224, in dump 
    self.save(obj) 
    File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/pickle.py", line 306, in save 
    rv = reduce(self.proto) 
    File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/copy_reg.py", line 70, in _reduce_ex 
    raise TypeError, "can't pickle %s objects" % base.__name__ 
TypeError: can't pickle file objects 
+0

第一种方式似乎正是我所需要的,谢谢。我被卡住了,因为我试图让它抛出PickleError,这实际上是不必要的。制作一个自定义的异常类并投掷就足够了。 – cube

2

如果你想对象的明确列表可以使用pickle以及更高级的序列化器(如dill)对不能被酸洗的对象进行酸洗,该文件包含标准库对象的一个​​比较全面的列表。它提供了一种简单的方法来构建每个对象(通常是一行代码),并显示不同版本的Python的变体(如果适用)。

https://github.com/uqfoundation/dill/blob/cccbea9b715e16b742288e1e5a21a687a4d4081b/dill/_objects.py#L255

例如,pickle将下列对象上失败了,而像dill先进的串行器将不会:

>>> import dill 
>>> dill.dumps(Ellipsis) 
b'\x80\x03cdill.dill\n_eval_repr\nq\x00X\x08\x00\x00\x00Ellipsisq\x01\x85q\x02Rq\x03.' 

高级串行还可以在文件对象之类的工作,顺便说一句:

>>> dill.dumps(open('foo.pkl', 'w')) 
b'\x80\x03cdill.dill\n_create_filehandle\nq\x00(X\x07\x00\x00\x00foo.pklq\x01X\x01\x00\x00\x00wq\x02K\x00\x89cdill.dill\n_get_attr\nq\x03cdill.dill\n_import_module\nq\x04X\x02\x00\x00\x00ioq\x05\x85q\x06Rq\x07X\x04\x00\x00\x00openq\x08\x86q\tRq\n\x89K\x00X\x00\x00\x00\x00q\x0btq\x0cRq\r.' 

但是,pickledill (和其他先进的串行化)将无法在任何类型的直接依赖于蟒蛇FrameType,就像一台发电机:

>>> dill.dumps((i for i in [])) 
Traceback (most recent call last): 
    File "<stdin>", line 1, in <module> 
    File "/Users/mmckerns/lib/python3.4/site-packages/dill-0.2.6.dev0-py3.4.egg/dill/dill.py", line 243, in dumps 
    dump(obj, file, protocol, byref, fmode, recurse)#, strictio) 
    File "/Users/mmckerns/lib/python3.4/site-packages/dill-0.2.6.dev0-py3.4.egg/dill/dill.py", line 236, in dump 
    pik.dump(obj) 
    File "/opt/local/Library/Frameworks/Python.framework/Versions/3.4/lib/python3.4/pickle.py", line 412, in dump 
    self.save(obj) 
    File "/opt/local/Library/Frameworks/Python.framework/Versions/3.4/lib/python3.4/pickle.py", line 499, in save 
    rv = reduce(self.proto) 
TypeError: can't pickle generator objects