On 22.12.2013 14:07, Mike Dupont wrote:
Here is the code,
http://sourceforge.net/p/wb2pdf/git/ci/master/tree/src/mediawiki2latex-server.hs
Well I wrote that code. It is much more easy for me to keep the images
in memory in terms of code maintainability. I don't think its a memory
leak since the amount of memory is roughly the amount needed by the
plain image files. Furthermore the memory is also deallocated after each
ruh. If I reduced memory usage I could just rent a virtual server for 8
EUR a month, so running it on the labs would not be needed. The main
idea why I am asking to run it on labs is that I don't want to buy a
power efficient micro server for 600 EUR and run it at home, which will
run approximately 5 times a day and take one minute per run. If it
becomes clear that labs won't accept a program that needs so much ram. I
could still reopen the grant to ask for the money the micro server or
the rent for a normal one. But I need a clear answer that the program
can not be run on labs if it have to have a memory limit of 8 Gbyte.
Yours Dirk
note: haskell often has resource problems, I am wondering if we can
reduce its memory usage.
I have done a lot of code optimizations in the past, one thing would
be to move out the image processing into another batch utility and
dont load them all into memory at once.
mike
On Sun, Dec 22, 2013 at 5:25 AM, Dirk Hünniger
<[email protected]> wrote:
Hello,
I wrote a Mediawiki to LaTeX Compiler. It is part of the current version of
Ubuntu. A binary for Windows is also available. I also put up a private
server running it http://mediawiki2latex.mooo.com/ . Now I would like to
shut down my private server and run it on labs instead. Since it loads full
article into memory including high resolution images I would like it to
access 8 GByte of RAM. Most of the it should need much less but for a few
articles this is required. The Idea to run it on labs came up in this
discussion http://meta.wikimedia.org/wiki/Grants_talk:IEG/LaTeX_Export .
There is also a project disciption page with more info
http://de.wikibooks.org/wiki/Benutzer:Dirk_Huenniger/wb2pdf . I already got
the ssh access to tools-login.wmflabs.org . Currently I don't really
understand the next steps I need to do. In particular since I need quite a
high ram limit and I need a job that runs permanently.
Yours Dirk
_______________________________________________
Labs-l mailing list
[email protected]
https://lists.wikimedia.org/mailman/listinfo/labs-l
_______________________________________________
Labs-l mailing list
[email protected]
https://lists.wikimedia.org/mailman/listinfo/labs-l
