Hey Shailey,
We have slightly over 200 projects.  We got our install of OpenGrok working
by hacking the JSP's to forward POSTs instead of GETs because I didn't see
the thread on modifying tomcat to handle large query strings.

Fortunately I've been collecting data about how long our indexing takes.
 After a quick script to process my logs you can review my data and the
results.  The first array are the timings in seconds with projects, and the
second array is without projects:
[623, 487, 229, 234, 462, 396, 429, 394, 377, 355, 358, 393, 506, 511, 455,
423, 463, 448, 412, 408, 555, 495, 395, 650, 516, 503, 385, 421, 631, 511,
212, 192, 449, 526, 389, 365, 395, 369, 393, 483, 515, 463, 357, 400, 479,
458, 230, 209, 464, 521, 362, 381, 476, 442, 393, 477, 618, 486, 206, 340,
449, 388, 409, 426, 385, 365, 356, 529, 491, 350, 393, 351, 507, 477, 376,
427, 479, 520, 198, 442, 500, 443, 396, 561, 636, 489, 237, 195, 453, 459,
420, 346, 381, 348, 360, 439, 488, 474, 372, 462, 492, 480, 383, 394, 500]
[514, 701, 430, 491, 503, 494, 500, 622, 520, 225, 269, 449, 395, 403, 389,
397, 412, 510, 452, 359, 532, 477, 466, 358, 434, 481, 499, 404, 522, 516,
470, 504, 437, 640, 483, 365, 383, 470, 395, 524, 409, 397, 375, 405, 444,
502, 856, 443, 498, 503, 459, 539, 434, 530, 431, 407, 437, 497]
423.819047619 before
464.844827586 after


Not a huge drop in speed of indexing, but the queries feel like they run
faster.  Also you don't lose any functionality in filtering down projects
to search from because you can just use the "file path" field to narrow
your results.


On Fri, Aug 3, 2012 at 3:58 AM, Gandhi, Shailey <
shailey.gan...@morganstanley.com> wrote:

>   Conrad****
>
> ** **
>
> Could you please tell me how many projects do you have in your code base?*
> ***
>
> Also, were you using projects earlier and have now disabled it?    ****
>
> ** **
>
> I am trying to find out if this will help in our setup. So please let me
> know if disabling projects made any difference to the indexing time or the
> memory usage. ****
>
> ** **
>
> Thanks****
>
> Shailey
>    ****
>
> *From:* Conrad Dean [mailto:conrad.p.d...@gmail.com]
> *Sent:* Friday, July 20, 2012 11:12 PM
> *To:* Bruce Furber
> *Cc:* Gandhi, Shailey (GWMG Technology); opengrok-discuss@opensolaris.org
> *Subject:* Re: [opengrok] 1600 projects in the list- several issues.****
>
> ** **
>
> Bruce:****
>
> This is great!  Not only is our search easier to use (because the default
> case is that you want to search everywhere at once), but it seems that the
> searches themselves are also faster.****
>
> ** **
>
> In case anyone else comes across this issue:
>
> From following the current documentation, you use the
> opengrok-0.*/bin/OpenGrok script for updating indexes/deploying/etc (
> http://hub.opensolaris.org/bin/view/Project+opengrok/installdescription ).
> ****
>
> ** **
>
> Take this script, and comment out this line:
> ENABLE_PROJECTS="-P"****
>
> so that opengrok no longer distinguishes between projects:
> #ENABLE_PROJECTS="-P"
>
> re-index your code with `opengrok-0.*/bin/OpenGrok update`****
>
> ** **
>
> -Conrad****
>
> ** **
>
> On Tue, Jul 17, 2012 at 6:21 PM, Bruce Furber <bfur...@comcast.net> wrote:
> ****
>
> I think just remove the P and p options. Never used projects. It may
> rebuild entire index.****
>
>
> Conrad Dean <conrad.p.d...@gmail.com> wrote:
>
> Hey Bruce,
> How do you turn off projects?  I have a bunch of disparate svn repos and
> keep the root of each right under the src folder that opengrok is
> configured to index.
>
> Thanks,
> Conrad
>
> On Tue, Jul 17, 2012 at 4:56 PM, Bruce Furber <bfur...@comcast.net>
> wrote:
>
> > I setup Opengrok to index a very large system that is not organized by
> > projects. So I turned off projects (default is now search all) and
> > optionally enter subdirectory (project) names in the Path field to
> limit
> > search to a subset. I added fields to the search and some Java Script
> to****
>
> > help fill in the path field with the correct syntax.****
> >
> > ** **
> >
> > ** ******
>
> >
> > We have a huge database of 1600 projects in our list of projects on****
>
> > opengrok  0.11 rc 1 .********
>
> >
> > Our source code repository is not integrated with Opengrok, we copy
> the****
>
> > data and index it incrementally. ********
>
> >
> > Several issues have cropped up in these past few months since the time
> we****
>
> > went into production. ********
>
> >
> > _______________________________________________
> > opengrok-discuss mailing list
> > opengrok-discuss@opensolaris.org
> > http://mail.opensolaris.org/mailman/listinfo/opengrok-discuss
> >
> >****
>
> --
> Bruce****
>
> ** **
>   ------------------------------
>  NOTICE: Morgan Stanley is not acting as a municipal advisor and the
> opinions or views contained herein are not intended to be, and do not
> constitute, advice within the meaning of Section 975 of the Dodd-Frank Wall
> Street Reform and Consumer Protection Act. If you have received this
> communication in error, please destroy all electronic and paper copies and
> notify the sender immediately. Mistransmission is not intended to waive
> confidentiality or privilege. Morgan Stanley reserves the right, to the
> extent permitted under applicable law, to monitor electronic
> communications. This message is subject to terms available at the following
> link: http://www.morganstanley.com/disclaimers. If you cannot access
> these links, please notify us by reply message and we will send the
> contents to you. By messaging with Morgan Stanley you consent to the
> foregoing.
>
_______________________________________________
opengrok-discuss mailing list
opengrok-discuss@opensolaris.org
http://mail.opensolaris.org/mailman/listinfo/opengrok-discuss

Reply via email to