[GitHub] Feywell opened a new issue #10562: IOError: [Errno 32] Broken pipe in Windows version

[GitBox]

Feywell opened a new issue #10562: IOError: [Errno 32] Broken pipe in Windows 
version
URL: https://github.com/apache/incubator-mxnet/issues/10562
 
 
   ## Description
   I use mx.gluon.data.DataLoader will meet this trouble:
   
   >  File "E:\Anaconda2\lib\site-packages\spyder\utils\site\sitecustomize.py", 
line 705, in runfile
       execfile(filename, namespace)
   
   > 
   >   File 
"E:\Anaconda2\lib\site-packages\spyder\utils\site\sitecustomize.py", line 87, 
in execfile
   >     exec(compile(scripttext, filename, 'exec'), glob, loc)
   > 
   >   File "stn_gluon.py", line 147, in <module>
   >     train(epoch)
   > 
   >   File "stn_gluon.py", line 108, in train
   >     for data, label in train_data:
   > 
   >   File "E:\Anaconda2\lib\site-packages\mxnet\gluon\data\dataloader.py", 
line 284, in __iter__
   >     self._batchify_fn, self._batch_sampler)
   > 
   >   File "E:\Anaconda2\lib\site-packages\mxnet\gluon\data\dataloader.py", 
line 144, in __init__
   >     worker.start()
   > 
   >   File "E:\Anaconda2\lib\multiprocessing\process.py", line 130, in start
   >     self._popen = Popen(self)
   > 
   >   File "E:\Anaconda2\lib\multiprocessing\forking.py", line 277, in __init__
   >     dump(process_obj, to_child, HIGHEST_PROTOCOL)
   > 
   >   File "E:\Anaconda2\lib\multiprocessing\forking.py", line 199, in dump
   >     ForkingPickler(file, protocol).dump(obj)
   > 
   >   File "E:\Anaconda2\lib\pickle.py", line 224, in dump
   >     self.save(obj)
   > 
   >   File "E:\Anaconda2\lib\pickle.py", line 331, in save
   >     self.save_reduce(obj=obj, *rv)
   > 
   >   File "E:\Anaconda2\lib\pickle.py", line 425, in save_reduce
   >     save(state)
   > 
   >   File "E:\Anaconda2\lib\pickle.py", line 286, in save
   >     f(self, obj) # Call unbound method with explicit self
   > 
   >   File "E:\Anaconda2\lib\pickle.py", line 655, in save_dict
   >     self._batch_setitems(obj.iteritems())
   > 
   >   File "E:\Anaconda2\lib\pickle.py", line 687, in _batch_setitems
   >     save(v)
   > 
   >   File "E:\Anaconda2\lib\pickle.py", line 286, in save
   >     f(self, obj) # Call unbound method with explicit self
   > 
   >   File "E:\Anaconda2\lib\pickle.py", line 568, in save_tuple
   >     save(element)
   > 
   >   File "E:\Anaconda2\lib\pickle.py", line 331, in save
   >     self.save_reduce(obj=obj, *rv)
   > 
   >   File "E:\Anaconda2\lib\pickle.py", line 425, in save_reduce
   >     save(state)
   > 
   >   File "E:\Anaconda2\lib\pickle.py", line 286, in save
   >     f(self, obj) # Call unbound method with explicit self
   > 
   >   File "E:\Anaconda2\lib\pickle.py", line 655, in save_dict
   >     self._batch_setitems(obj.iteritems())
   > 
   >   File "E:\Anaconda2\lib\pickle.py", line 687, in _batch_setitems
   >     save(v)
   > 
   >   File "E:\Anaconda2\lib\pickle.py", line 331, in save
   >     self.save_reduce(obj=obj, *rv)
   > 
   >   File "E:\Anaconda2\lib\pickle.py", line 425, in save_reduce
   >     save(state)
   > 
   >   File "E:\Anaconda2\lib\pickle.py", line 286, in save
   >     f(self, obj) # Call unbound method with explicit self
   > 
   >   File "E:\Anaconda2\lib\pickle.py", line 568, in save_tuple
   >     save(element)
   > 
   >   File "E:\Anaconda2\lib\pickle.py", line 286, in save
   >     f(self, obj) # Call unbound method with explicit self
   > 
   >   File "E:\Anaconda2\lib\pickle.py", line 492, in save_string
   >     self.write(BINSTRING + pack("<i", n) + obj)
   > 
   > **IOError: [Errno 32] Broken pipe**
   
   Code is here:
   ```
   `train_data = DataLoader(
           vision.datasets.MNIST(train=True, 
                      transform=transforms.Compose([
                          transforms.ToTensor(),
                          transforms.Normalize((0.1307,), (0.3081,))
                      ])),batch_size=2, shuffle=True, num_workers=1
                 )
   
   test_data = DataLoader(
           vision.datasets.MNIST(train=False,
                      transform=transforms.Compose([
                          transforms.ToTensor(),
                          transforms.Normalize((0.1307,), (0.3081,))
                      ])),batch_size=2, shuffle=False, num_workers=1
                 )`
   
   ```
   throw a trouble at 
   
   >  for data, label in train_data:
   
   ## Environment info (Required)
   ----------Python Info----------
   ('Version      :', '2.7.13')
   ('Compiler     :', 'MSC v.1500 64 bit (AMD64)')
   ('Build        :', ('default', 'May 11 2017 13:17:26'))
   ('Arch         :', ('64bit', 'WindowsPE'))
   ------------Pip Info-----------
   ('Version      :', '9.0.1')
   ('Directory    :', 'E:\\Anaconda2\\lib\\site-packages\\pip')
   
   > ----------MXNet Info-----------
   > E:\Anaconda2\lib\site-packages\h5py\__init__.py:34: FutureWarning: 
Conversion of the second argument of issubdtype from `float` to `np.floating` 
is deprecated. In future, it will be treated as `np.float64 == 
np.dtype(float).type`.
   >   from ._conv import register_converters as _register_converters
   > E:\Anaconda2\lib\site-packages\mxnet\optimizer.py:136: UserWarning: 
WARNING: New optimizer mxnet.optimizer.NAG is overriding existing optimizer 
mxnet.optimizer.NAG
   >   Optimizer.opt_registry[name].__name__))
   > ('Version      :', '1.1.0')
   > ('Directory    :', 'E:\\Anaconda2\\lib\\site-packages\\mxnet')
   
   Package used (Python/R/Scala/Julia):
   Python 2.7
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services