Looks like serialization issue (in SpatialPooler), ask @scottpurdy for help. Just to verify, you can try with "py" implementation of the SP. Btw, I'm curious, what speeds/mem usage are you getting for such a huge HTM network?
Cheers, Mark PS: are you running the latest nupic/nupic.bindings code? I suggest opening an isse at nupic.core github repo. Maybe search some "large file serialization problem" on the capnp project. On Fri, Oct 16, 2015 at 5:19 AM, [email protected] < [email protected]> wrote: > Hello nupic, > I have a trouble about the testing of nupic.vision project,when i use > the parameters as the following : > > "columnCount": 12288, > "spatialImp": "cpp", > "inputWidth": 1024, > "spVerbosity": 1, > "synPermConnected": 0.4, > "synPermActiveInc": 0.001, > "synPermInactiveDec": 0.0005, > "seed": 1956, > "numActiveColumnsPerInhArea": 2400, > "globalInhibition": 1, > "potentialPct": 0.4, > "maxBoost": 1.0 > > > > the result is good . when i wanted to increase the parameters :” > inputWidth” and “ columnCount”. such as , > using the parameters : > > "columnCount": 122880, > "spatialImp": "cpp", > "inputWidth": 27600, > "spVerbosity": 1, > "synPermConnected": 0.4, > "synPermActiveInc": 0.001, > "synPermInactiveDec": 0.0005, > "seed": 1956, > "numActiveColumnsPerInhArea": 2400, > "globalInhibition": 1, > "potentialPct": 0.4, > "maxBoost": 1.0 > > After i trained the network with the testing data , when i tried to > save the networkFile named xxx.nta using the function “ > net.save(networkFile)", i got the error as the following: > > ======================================================== > Process: Python [1803] > Path: > > /System/Library/Frameworks/Python.framework/Versions/2.7/Resources/Python.app/Contents/MacOS/Python > Identifier: Python > Version: 2.7.10 (2.7.10) > Code Type: X86-64 (Native) > Parent Process: pycharm [431] > Responsible: pycharm [431] > User ID: 501 > > PlugIn Path: > /Library/Python/2.7/site-packages/nupic/bindings/_algorithms.so > PlugIn Identifier: _algorithms.so > PlugIn Version: ??? (0) > > Date/Time: 2015-10-15 21:32:07.155 +0800 > OS Version: Mac OS X 10.10.5 (14F27) > Report Version: 11 > Anonymous UUID: 8C41832F-F133-F816-7D86-706CF07F57BA > > Sleep/Wake UUID: C0B7C0E0-6AE5-44B4-9000-AA5D4E664D52 > > Time Awake Since Boot: 25000 seconds > Time Since Wake: 1200 seconds > > Crashed Thread: 0 Dispatch queue: com.apple.main-thread > > Exception Type: EXC_BAD_ACCESS (SIGSEGV) > Exception Codes: KERN_INVALID_ADDRESS at 0x000000024814ffff > > VM Regions Near 0x24814ffff: > MALLOC_LARGE 0000000108750000-0000000114150000 [186.0M] > rw-/rwx SM=PRV > --> > MALLOC_LARGE 0000000288150000-0000000408150000 [ 6.0G] > rw-/rwx SM=PRV > > Thread 0 Crashed:: Dispatch queue: com.apple.main-thread > 0 _algorithms.so 0x0000000105cdf3b2 > std::__1::basic_stringbuf<char, std::__1::char_traits<char>, > std::__1::allocator<char> >::overflow(int) + 274 > 1 libc++.1.dylib 0x00007fff8769a91d > std::__1::basic_streambuf<char, std::__1::char_traits<char> >::xsputn(char > const*, long) + 73 > 2 libc++.1.dylib 0x00007fff876badb1 > std::__1::ostreambuf_iterator<char, std::__1::char_traits<char> > > std::__1::__pad_and_output<char, std::__1::char_traits<char> > >(std::__1::ostreambuf_iterator<char, std::__1::char_traits<char> >, char > const*, char const*, char const*, std::__1::ios_base&, char) + 236 > 3 libc++.1.dylib 0x00007fff876bb4d0 > std::__1::num_put<char, std::__1::ostreambuf_iterator<char, > std::__1::char_traits<char> > >::do_put(std::__1::ostreambuf_iterator<char, > std::__1::char_traits<char> >, std::__1::ios_base&, char, double) const + > 620 > 4 libc++.1.dylib 0x00007fff876a110a > std::__1::basic_ostream<char, std::__1::char_traits<char> > >::operator<<(float) + 226 > 5 _algorithms.so 0x0000000105e1b6f7 > nupic::algorithms::spatial_pooler::SpatialPooler::save(std::__1::basic_ostream<char, > std::__1::char_traits<char> >&) const + 3735 > 6 _algorithms.so 0x0000000105e1a716 > nupic::algorithms::spatial_pooler::SpatialPooler::persistentSize() const + > 342 > 7 _algorithms.so 0x0000000105d69cc0 > _wrap_SpatialPooler_getCState(_object*, _object*) + 96 > 8 org.python.python 0x0000000101fd62ea PyEval_EvalFrameEx > + 15716 > 9 org.python.python 0x0000000101fd8c82 0x101f4e000 + 568450 > 10 org.python.python 0x0000000101fd59a6 PyEval_EvalFrameEx > + 13344 > 11 org.python.python 0x0000000101fd2352 PyEval_EvalCodeEx + > 1409 > 12 org.python.python 0x0000000101f765de 0x101f4e000 + 165342 > 13 org.python.python 0x0000000101f5850a PyObject_Call + 99 > 14 org.python.python 0x0000000101f632f7 0x101f4e000 + 86775 > 15 org.python.python 0x0000000101f5850a PyObject_Call + 99 > 16 org.python.python 0x0000000101fd83df > PyEval_CallObjectWithKeywords + 93 > 17 org.python.python 0x0000000101fa332c 0x101f4e000 + 348972 > 18 org.python.python 0x0000000101fa300b 0x101f4e000 + 348171 > 19 org.python.python 0x0000000101f5850a PyObject_Call + 99 > 20 cPickle.so 0x00000001027b2d51 0x1027ad000 + 23889 > 21 cPickle.so 0x00000001027b3db8 0x1027ad000 + 28088 > 22 cPickle.so 0x00000001027b4360 0x1027ad000 + 29536 > 23 cPickle.so 0x00000001027b2928 0x1027ad000 + 22824 > 24 cPickle.so 0x00000001027ae77b 0x1027ad000 + 6011 > 25 org.python.python 0x0000000101f5850a PyObject_Call + 99 > 26 _engine_internal.so 0x000000010573a5f5 > nupic::py::Module::invoke(std::__1::basic_string<char, > std::__1::char_traits<char>, std::__1::allocator<char> >, _object*, > _object*) + 133 > 27 _engine_internal.so 0x000000010574570f > nupic::PyRegion::serialize(nupic::BundleIO&) + 559 > 28 _engine_internal.so 0x000000010571ff07 > nupic::Network::saveToBundle(std::__1::basic_string<char, > std::__1::char_traits<char>, std::__1::allocator<char> > const&) + 3687 > 29 _engine_internal.so 0x000000010571edf1 > nupic::Network::save(std::__1::basic_string<char, > std::__1::char_traits<char>, std::__1::allocator<char> > const&) + 145 > 30 _engine_internal.so 0x000000010569b071 > _wrap_Network_save(_object*, _object*, _object*) + 209 > 31 org.python.python 0x0000000101fd575f PyEval_EvalFrameEx > + 12761 > 32 org.python.python 0x0000000101fd2352 PyEval_EvalCodeEx + > 1409 > 33 org.python.python 0x0000000101f765de 0x101f4e000 + 165342 > 34 org.python.python 0x0000000101f5850a PyObject_Call + 99 > 35 org.python.python 0x0000000101f632f7 0x101f4e000 + 86775 > 36 org.python.python 0x0000000101f5850a PyObject_Call + 99 > 37 org.python.python 0x0000000101fd4f82 PyEval_EvalFrameEx > + 10748 > 38 org.python.python 0x0000000101fd2352 PyEval_EvalCodeEx + > 1409 > 39 org.python.python 0x0000000101fd8bf1 0x101f4e000 + 568305 > 40 org.python.python 0x0000000101fd59a6 PyEval_EvalFrameEx > + 13344 > 41 org.python.python 0x0000000101fd2352 PyEval_EvalCodeEx + > 1409 > 42 org.python.python 0x0000000101fd8bf1 0x101f4e000 + 568305 > 43 org.python.python 0x0000000101fd59a6 PyEval_EvalFrameEx > + 13344 > 44 org.python.python 0x0000000101fd2352 PyEval_EvalCodeEx + > 1409 > 45 org.python.python 0x0000000101fd1dcb PyEval_EvalCode + 54 > 46 org.python.python 0x0000000101ff200e 0x101f4e000 + 671758 > 47 org.python.python 0x0000000101ff20b1 PyRun_FileExFlags + > 133 > 48 org.python.python 0x0000000101ff1c4e > PyRun_SimpleFileExFlags + 769 > 49 org.python.python 0x0000000102003437 Py_Main + 3051 > 50 libdyld.dylib 0x00007fff88d085c9 start + 1 > > Thread 0 crashed with X86 Thread State (64-bit): > rax: 0x000000040814ffff rbx: 0x00007fff5dcb2780 rcx: > 0x0000000248150000 rdx: 0x0000000288150000 > rdi: 0x000000040814ffff rsi: 0x0000000000000030 rbp: > 0x00007fff5dcb2400 rsp: 0x00007fff5dcb23c0 > r8: 0x0000000000000153 r9: 0x00000000000000df r10: > 0x0000000000000000 r11: 0x0000000000000246 > r12: 0x00000000ffffffff r13: 0x000000024814ffff r14: > 0x0000000288150000 r15: 0x00000002e8150000 > rip: 0x0000000105cdf3b2 rfl: 0x0000000000010287 cr2: 0x000000024814ffff > > Logical CPU: 2 > Error Code: 0x00000006 > Trap Number: 14 > ========================================================= > My computer : > OS X Yosemite 10.10.5 > MacBook Pro > CPU: 2.7GHz Intel Core i5 > Memery : 8G > > Is anyone have any explanation or the method about fixing this error ? > thank you for your help > -- Marek Otahal :o)
