TccccD opened a new issue #12460: Dynamic size will appear out of memory URL: https://github.com/apache/incubator-mxnet/issues/12460 I use dynamic size as `[[(3, x ,x), 256*8] for x in range(160, 225, 8)]` and I got "out of memory" when change the size every three epoch: ``` terminate called after throwing an instance of 'dmlc::Error' what(): [11:37:28] src/engine/./threaded_engine.h:359: [11:37:28] src/storage/./pooled_storage_manager.h:107: cudaMalloc failed: out of memory ``` my dataiter is like: ``` class data_iter(object): def __init__(self, istrain=0, num_round=3): self.data = get_data() self.iter = 0 self.istrain = 1 self.numepoch = 0 self.num_round = num_round def next(self): return self.data[self.iter][self.istrain].next() def __iter__(self): return self @property def provide_data(self): return self.data[self.iter][self.istrain].provide_data @property def provide_label(self): return self.data[self.iter][self.istrain].provide_label def __next__(self): return self.next() def reset(self): self.data[self.iter][self.istrain].reset() self.numepoch += 1 if self.numepoch % self.num_round == 0 and self.iter != -1: self.iter += 1 if self.iter >= len(self.data): self.iter = -1 ``` Where get_data() is the list of multiple data_iter.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
