the slowness is because this is all running on a samba share. i was hoping to minimize the network disk IO by not copying the downloadable file unnecessarily.
On Friday, September 6, 2013 11:52:30 AM UTC-4, gsavix wrote: > > your images are in your intranet network or extenal (uncontrolled > speed)? make sure of kind slow process is going on input/output or is > related about memory processing. > > if possivel use terminal command htop for monitoring what is going on > and what are task id process (use F5 for details of tasks/thread) and > cpu numbers and percents that are used. > > After this you could know what "pieces" of running is sloowing your > sphinx running. > > 2013/9/6 <[email protected] <javascript:>>: > > the volume of data is about 10 MB per experiment (mostly image data). > and > > there are ~100 experiments. im not sure what details you are asking for. > the > > rst-writing and index.rst generation are all done through scripts. then > i > > call make html. i think the problem stems from the fact that i am > re-writing > > the index.rst everytime, and sphinx then re-copies all downloadable > files > > (files references with :download:), which are referenced in the pages > listed > > on index. > > > > i am trying to create a single index page which links to all > experiments' > > sub-pages, but i dont want to have *all* :download:'able files copied > every > > time a single experiment is added to the index toctree . > > > > > > that page is interesting. i gather its a web application that calls > sphinx > > to produce the formated output? > > > > i hope this is clear, please let me know if its not. > > > > > > On Wednesday, September 4, 2013 1:26:32 AM UTC-4, gsavix wrote: > >> > >> please could you post details of how you make these steps, volume and > >> size of files, images these will help all of us better understand what > >> is going on. > >> > >> 2013/9/3 <[email protected]>: > >> > I am using sphinx to present a front-end to a set of scientific > >> > experiments. > >> > here is how it is working: > >> > > >> > * each experiment produces .rst file (containing images/:downloads:/ > >> > etc) > >> > * a script searches the file system for all rst files, and writes an > >> > index.rst > >> > * sphinx is called to make the html. > >> > > >> > > >> > this all is working well, except for the build speed. when a single > >> > experiment is added, the index.rst file changes, and sphinx takes a > long > >> > time `copying downloadable files` for *every* page. > >> > > >> > is there a way to prevent this behavior, either by changing the > >> > configuration, or re-structuring the process? > >> > > >> > -- > >> > You received this message because you are subscribed to the Google > >> > Groups > >> > "sphinx-users" group. > >> > To unsubscribe from this group and stop receiving emails from it, > send > >> > an > >> > email to [email protected]. > >> > To post to this group, send email to [email protected]. > >> > Visit this group at http://groups.google.com/group/sphinx-users. > >> > For more options, visit https://groups.google.com/groups/opt_out. > >> > >> > >> > >> -- > >> gilberto dos santos alves > >> +55.11.98646-5049 > >> sao paulo - sp - brasil > > > > -- > > You received this message because you are subscribed to the Google > Groups > > "sphinx-users" group. > > To unsubscribe from this group and stop receiving emails from it, send > an > > email to [email protected] <javascript:>. > > To post to this group, send email to > > [email protected]<javascript:>. > > > Visit this group at http://groups.google.com/group/sphinx-users. > > For more options, visit https://groups.google.com/groups/opt_out. > > > > -- > gilberto dos santos alves > +55.11.98646-5049 > sao paulo - sp - brasil > -- You received this message because you are subscribed to the Google Groups "sphinx-users" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. Visit this group at http://groups.google.com/group/sphinx-users. For more options, visit https://groups.google.com/groups/opt_out.
