Hi Devon. Yes, it was the case until r4386. Bad design as we haven't expected such large dumps.
You have a bad luck because you are using r4381 and from r4386 on SQLite is used for storing "resuming" queries - no more MemoryError(s) on resume and far better memory management. Only problem is that you would need to update to the latest revision and redo the whole process including --flush-session to have that mechanism incorporated. So, please, do the updates as frequently as you can Kind regards, Miroslav Stampar On Wed, Nov 9, 2011 at 3:43 PM, Devon <devon.mitch...@aol.com> wrote: > Hello, > I've been dumping a fairly large database with sqlmap over the past week, > and I have ran into a problem trying to resume the dump. It's running out > of memory and killing the process. The output/xxxxxxxx/session file is > 1.1GB, and the system I'm duping it with has 4GB of ram. From what I can > tell, the python code is loading the entire file into memory, rather than > reading it line-by-line which is why it's dying. I looked in > /var/log/kern.log (I'm running Ubuntu) and it shows that it's simply running > out of memory. > This is 100% reproducable now, and happens every time I run it. > > [19:14:58] [CRITICAL] unhandled exception in sqlmap/1.0-dev (r4381), retry > your run with the latest development version from the Subversion repository. > If the exception persists, please send by e-mail to > sqlmap-users@lists.sourceforge.net the following text and any information > required to reproduce the bug. The developers will try to reproduce the bug, > fix it accordingly and get back to you. > sqlmap version: 1.0-dev (r4381) > Python version: 2.7.1+ > Operating system: posix > Command line: ./sqlmap.py --random-agent -u > *********************************** > --data=txtUserName=pKza&txtPassword=FYwn&Login=Login -p txtUserName -D > ****** --threads=5 --dump > Technique: None > Back-end DBMS: None (identified) > Traceback (most recent call last): > File "/opt/sqlmap/_sqlmap.py", line 86, in main > start() > File "/opt/sqlmap/lib/controller/controller.py", line 325, in start > setupTargetEnv() > File "/opt/sqlmap/lib/core/target.py", line 355, in setupTargetEnv > __setOutputResume() > File "/opt/sqlmap/lib/core/target.py", line 185, in __setOutputResume > for line in readSessionFP.readlines(): # xreadlines doesn't return > unicode strings when codec.open() is used > File "/usr/lib/python2.7/codecs.py", line 679, in readlines > return self.reader.readlines(sizehint) > File "/usr/lib/python2.7/codecs.py", line 588, in readlines > data = self.read() > File "/usr/lib/python2.7/codecs.py", line 477, in read > newchars, decodedbytes = self.decode(data, self.errors) > MemoryError > [*] shutting down at 19:14:58 > > ------------------------------------------------------------------------------ > RSA(R) Conference 2012 > Save $700 by Nov 18 > Register now > http://p.sf.net/sfu/rsa-sfdev2dev1 > _______________________________________________ > sqlmap-users mailing list > sqlmap-users@lists.sourceforge.net > https://lists.sourceforge.net/lists/listinfo/sqlmap-users > > -- Miroslav Stampar http://about.me/stamparm ------------------------------------------------------------------------------ RSA(R) Conference 2012 Save $700 by Nov 18 Register now http://p.sf.net/sfu/rsa-sfdev2dev1 _______________________________________________ sqlmap-users mailing list sqlmap-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/sqlmap-users
