Re: Solr Errors

2011-05-13 Thread Mary Jo Sminkey

 Just checking in Mary. Were you able to get past this? Have you
 considering contacting Adobe for official support?
 
 No, we had to drop the use of Solr at this time, 


Just FYI, I did submit a bug report on this, if anyone wants to comment or vote 
on it. 

http://cfbugs.adobe.com/cfbugreport/flexbugui/cfbugtracker/main.html?#bugId=86807

While I can batch up the data a single users add and run a single cfindex 
function to update all of it at once, I can't find a way to prevent issues with 
other types of concurrent cfindexes happening, such as multiple users or my 
unit tests. Cflock doesn't seem to lock the entire Solr indexing process so 
wasn't any help. 

http://cfbugs.adobe.com/cfbugreport/flexbugui/cfbugtracker/main.html?#bugId=86807


--- Mary Jo


 




~|
Order the Adobe Coldfusion Anthology now!
http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion
Archive: 
http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:344507
Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm
Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm


Re: Solr Errors

2011-05-10 Thread Mary Jo Sminkey

Just checking in Mary. Were you able to get past this? Have you
considering contacting Adobe for official support?

No, we had to drop the use of Solr at this time, it wasn't critical enough for 
this application to pay for a support ticket (and that involves a heck of red 
tape here and takes forever...this was a case of get it working asap). We're 
still using Solr for a lot of our data (documents, PDFs, etc.), but only the 
stuff that gets updated every night, and not the data that users are adding 
frequently. Unfortunately there just did not seem to be a way to index those at 
runtime as soon as they are added without having issues, and the users were not 
willing to wait for them to be indexed at specific time intervals (say run the 
indexing every x minutes) which would have been the best workaround. 


--- Mary Jo





~|
Order the Adobe Coldfusion Anthology now!
http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion
Archive: 
http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:344402
Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm
Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm


Re: Solr Errors

2011-05-09 Thread Raymond Camden

Just checking in Mary. Were you able to get past this? Have you
considering contacting Adobe for official support?


On Mon, Apr 11, 2011 at 2:41 PM, Mary Jo Sminkey mary...@cfwebstore.com wrote:

 What are you loading into your index (queries or documents)?  Can you

 provide a code snippet of your process?


 Just results of a query, so nothing real earth-shattering. Just wanted to use 
 Solr to search all my long text fields that hold a considerable amount of 
 data (users have a search interface to select which tables to search, I'm 
 using categories to handle that). The majority of the data gets updated and 
 reindexed nightly, this is the one type of data that users can add and so 
 needs to be updated at runtime. My cfindex tag looks like this:

 cfindex collection=#docCollection# action=update body=thedata 
 category=IMPACT custom1=grant_id custom2=fy key=key 
 query=local.qryImpacts /


 --- Mary Jo



 

~|
Order the Adobe Coldfusion Anthology now!
http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion
Archive: 
http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:344361
Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm
Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm


Re: Solr Errors

2011-04-11 Thread Mary Jo Sminkey

 To be clear - is this only for your unit tests? Could you possibly 
 use
 sleep() to slow things down a bit? That's a hack - but would allow 
 you
 to keep testing.

Currently it's only showing up on my unit tests, but that's only because I'm 
the only one using the application. If multiple people add data at the same 
time, I would expect to see it then as well. And I'm also just finishing up a 
process for adding a batch of these data objects at once, that as well will 
cause it to bomb. So yeah, I can throw a long sleep in there to get my tests to 
pass (I'm having to sleep for at least a minute for each cfindex right now for 
it to get by this), but that's not going to fix the problem for production use. 

--- Mary Jo


~|
Order the Adobe Coldfusion Anthology now!
http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion
Archive: 
http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:343644
Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm
Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm


Re: Solr Errors

2011-04-11 Thread Mary Jo Sminkey

According to this you should be able to comment out caching altogether in
the solrconfig.xml file.

Cool, thanks I'll try that. The info I had from the Solr folks was to set 
autowarmCount=0 for all the caching, but that didn't seem to have any effect. 
Maybe removing caching completely will do it. 


--- Mary Jo


~|
Order the Adobe Coldfusion Anthology now!
http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion
Archive: 
http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:343646
Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm
Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm


Re: Solr Errors

2011-04-11 Thread Dominic Watson

As an aside, it may be worth looking at the native Solr data import
modules. Can have massive performance benefits over using cfindex.

Dominic

On 11 April 2011 15:33, Mary Jo Sminkey mary...@cfwebstore.com wrote:

According to this you should be able to comment out caching altogether in
the solrconfig.xml file.

 Cool, thanks I'll try that. The info I had from the Solr folks was to set 
 autowarmCount=0 for all the caching, but that didn't seem to have any effect. 
 Maybe removing caching completely will do it.


 --- Mary Jo


 

~|
Order the Adobe Coldfusion Anthology now!
http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion
Archive: 
http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:343647
Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm
Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm


Re: Solr Errors

2011-04-11 Thread Mary Jo Sminkey

 Cool, thanks I'll try that. The info I had from the Solr folks was to 
 set autowarmCount=0 for all the caching, but that didn't seem to have 
 any effect. Maybe removing caching completely will do it. 

Sigh, nope I commented out the three types of caches in the config file and 
still get the error. Tried lowering the size on them as well, but even with 
sleeping for a minute after every cfindex, I still get the error. The only 
thing that prevents it is upping the setting for maxWarmingSearchers to 
something like 10, then I don't hit the limit. But not sure this is going to be 
a valid solution, since if a user tries to add a batch of say, 20 items, I can 
expect to still crash on this. It's looking like I won't be able to use Solr 
for the data at this point, at least, not if I want it immediately available in 
a search. I'm not sure I have enough time late in this project to build some 
kind of other module for Solr to do this, it's more important right now to just 
get it working, so that looks like just doing a plain SQL search of the data 
(yuck). 


--- Mary Jo



~|
Order the Adobe Coldfusion Anthology now!
http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion
Archive: 
http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:343651
Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm
Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm


RE: Solr Errors

2011-04-11 Thread Mark A. Kruger

Mary Jo,

I have a hard time believing this cant be done (not that I doubt your
thoroughness).  It seems like a batch of 10 items is pretty small
potatoes.

-Mark


Mark A. Kruger, MCSE, CFG
(402) 408-3733 ext 105
www.cfwebtools.com
www.coldfusionmuse.com
www.necfug.com


-Original Message-
From: Mary Jo Sminkey [mailto:mary...@cfwebstore.com] 
Sent: Monday, April 11, 2011 10:27 AM
To: cf-talk
Subject: Re: Solr Errors


 Cool, thanks I'll try that. The info I had from the Solr folks was to 
 set autowarmCount=0 for all the caching, but that didn't seem to have 
 any effect. Maybe removing caching completely will do it. 

Sigh, nope I commented out the three types of caches in the config file and
still get the error. Tried lowering the size on them as well, but even with
sleeping for a minute after every cfindex, I still get the error. The only
thing that prevents it is upping the setting for maxWarmingSearchers to
something like 10, then I don't hit the limit. But not sure this is going to
be a valid solution, since if a user tries to add a batch of say, 20 items,
I can expect to still crash on this. It's looking like I won't be able to
use Solr for the data at this point, at least, not if I want it immediately
available in a search. I'm not sure I have enough time late in this project
to build some kind of other module for Solr to do this, it's more important
right now to just get it working, so that looks like just doing a plain SQL
search of the data (yuck). 


--- Mary Jo





~|
Order the Adobe Coldfusion Anthology now!
http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion
Archive: 
http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:343652
Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm
Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm


Re: Solr Errors

2011-04-11 Thread Aaron Rouse

Same here and that is basically what we are doing today with Verity.  This
whole thread though is making me want to get started on Solr testing since
the plan was eventually to migrate from our Verity solution to Solr.

On Mon, Apr 11, 2011 at 10:51 AM, Mark A. Kruger mkru...@cfwebtools.comwrote:


 Mary Jo,

 I have a hard time believing this cant be done (not that I doubt your
 thoroughness).  It seems like a batch of 10 items is pretty small
 potatoes.

 -Mark


 Mark A. Kruger, MCSE, CFG
 (402) 408-3733 ext 105
 www.cfwebtools.com
 www.coldfusionmuse.com
 www.necfug.com


 -Original Message-
 From: Mary Jo Sminkey [mailto:mary...@cfwebstore.com]
 Sent: Monday, April 11, 2011 10:27 AM
 To: cf-talk
 Subject: Re: Solr Errors


   Cool, thanks I'll try that. The info I had from the Solr folks was to
  set autowarmCount=0 for all the caching, but that didn't seem to have
  any effect. Maybe removing caching completely will do it.

 Sigh, nope I commented out the three types of caches in the config file and
 still get the error. Tried lowering the size on them as well, but even with
 sleeping for a minute after every cfindex, I still get the error. The only
 thing that prevents it is upping the setting for maxWarmingSearchers to
 something like 10, then I don't hit the limit. But not sure this is going
 to
 be a valid solution, since if a user tries to add a batch of say, 20 items,
 I can expect to still crash on this. It's looking like I won't be able to
 use Solr for the data at this point, at least, not if I want it immediately
 available in a search. I'm not sure I have enough time late in this project
 to build some kind of other module for Solr to do this, it's more important
 right now to just get it working, so that looks like just doing a plain SQL
 search of the data (yuck).


 --- Mary Jo





 

~|
Order the Adobe Coldfusion Anthology now!
http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion
Archive: 
http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:343654
Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm
Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm


Re: Solr Errors

2011-04-11 Thread Mary Jo Sminkey

Same here and that is basically what we are doing today with Verity.  This
whole thread though is making me want to get started on Solr testing since
the plan was eventually to migrate from our Verity solution to Solr.


Hhm, I wonder if I just need to switch over the Verity then? Didn't really want 
to redo all the syntax for my searches, but if it works
Yeah, I agree it seems like there should be *some* way around this! It's fairly 
easy to test this, by putting some cfindex code into a loop. But it appears to 
have a lot to do as well with the size of the collection, so you have to be 
sure to load it with enough records to see the problem. My collection has a lot 
of data, which is why I didn't see this earlier in testing when I had a small 
sub-set of data loaded, the Solr searches would do their work quickly and move 
on. It was only when I started loaded my entire set of data that I started 
seeing the problem, as Solr then was taking a lot longer to create a new 
searcher, run the index code, and then destroy the searcher after it was done. 
So they pile up very quickly if you are running a bunch of cfindex tags in one 
request. I could probably figure out a way to bulk load my batch functions, but 
that still leaves me with problems if multiple users are adding data at once. 


--- Mary Jo







~|
Order the Adobe Coldfusion Anthology now!
http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion
Archive: 
http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:343655
Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm
Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm


Re: Solr Errors

2011-04-11 Thread Aaron Rouse

We are planning to test switching off it since the rumor mill is that the
next version of CF will no longer have Verity.

On Mon, Apr 11, 2011 at 11:34 AM, Mary Jo Sminkey mary...@cfwebstore.comwrote:


 Hhm, I wonder if I just need to switch over the Verity then? Didn't really
 want to redo all the syntax for my searches, but if it works



~|
Order the Adobe Coldfusion Anthology now!
http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion
Archive: 
http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:343656
Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm
Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm


Re: Solr Errors

2011-04-11 Thread Carl Von Stetten

Mary,

What are you loading into your index (queries or documents)?  Can you 
provide a code snippet of your process?

Carl

On 4/8/2011 9:36 AM, Mary Jo Sminkey wrote:
 Well, by doing some research on the Solr boards and lists, I was able to 
 figure out the problem. It appears to be due to CF committing after every 
 cfindex tag and this causes Solr to open a new searcher and auto warm it 
 (load from cache). If you are committing more frequently than the warming 
 process, these searches pile up and you hit the error. So if you have a page 
 that runs a lot of cfindex tags (as my unit tests were) you can easily hit 
 this error. Problem is, I'm not sure how we can work around this easily. I 
 tried setting the autoWarmCounts to 0 to see if I could reduce the startup 
 time (and since my app does a lot more indexing at runtime than searches so 
 slow startup is not a big issue) but I still hit the error when the number of 
 searches exceeded the maximum set. I could try setting the limit for warming 
 searches higher (setting it to 10 for instance fixes the problem with my 
 tests) but that supposedly is a bit of a performance killer. In cases where 
 my users are adding a batch of these data elements that I'm indexing, I'm 
 almost certainly to bang into that limit again. In my case, it may mean we 
 simply cannot use Solr for this, unless there's someway to batch the commits 
 and just do one single one at the end of the request. What we need is 
 something like a cftransaction tag for the cfindex tag.

 --- Mary Jo


 

~|
Order the Adobe Coldfusion Anthology now!
http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion
Archive: 
http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:343659
Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm
Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm


Re: Solr Errors

2011-04-11 Thread Mary Jo Sminkey

 What are you loading into your index (queries or documents)?  Can you 
 
 provide a code snippet of your process?


Just results of a query, so nothing real earth-shattering. Just wanted to use 
Solr to search all my long text fields that hold a considerable amount of data 
(users have a search interface to select which tables to search, I'm using 
categories to handle that). The majority of the data gets updated and reindexed 
nightly, this is the one type of data that users can add and so needs to be 
updated at runtime. My cfindex tag looks like this:

cfindex collection=#docCollection# action=update body=thedata 
category=IMPACT custom1=grant_id custom2=fy key=key 
query=local.qryImpacts /


--- Mary Jo



~|
Order the Adobe Coldfusion Anthology now!
http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion
Archive: 
http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:343664
Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm
Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm


Re: Solr Errors

2011-04-08 Thread Mary Jo Sminkey

Well, by doing some research on the Solr boards and lists, I was able to figure 
out the problem. It appears to be due to CF committing after every cfindex tag 
and this causes Solr to open a new searcher and auto warm it (load from 
cache). If you are committing more frequently than the warming process, these 
searches pile up and you hit the error. So if you have a page that runs a lot 
of cfindex tags (as my unit tests were) you can easily hit this error. Problem 
is, I'm not sure how we can work around this easily. I tried setting the 
autoWarmCounts to 0 to see if I could reduce the startup time (and since my app 
does a lot more indexing at runtime than searches so slow startup is not a big 
issue) but I still hit the error when the number of searches exceeded the 
maximum set. I could try setting the limit for warming searches higher (setting 
it to 10 for instance fixes the problem with my tests) but that supposedly is a 
bit of a performance killer. In cases where my users are adding a batch of 
these data elements that I'm indexing, I'm almost certainly to bang into that 
limit again. In my case, it may mean we simply cannot use Solr for this, unless 
there's someway to batch the commits and just do one single one at the end of 
the request. What we need is something like a cftransaction tag for the cfindex 
tag. 

--- Mary Jo


~|
Order the Adobe Coldfusion Anthology now!
http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion
Archive: 
http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:343624
Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm
Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm


Re: Solr Errors

2011-04-08 Thread Raymond Camden

To be clear - is this only for your unit tests? Could you possibly use
sleep() to slow things down a bit? That's a hack - but would allow you
to keep testing.

On Fri, Apr 8, 2011 at 11:36 AM, Mary Jo Sminkey mary...@cfwebstore.com wrote:

 Well, by doing some research on the Solr boards and lists, I was able to 
 figure out the problem. It appears to be due to CF committing after every 
 cfindex tag and this causes Solr to open a new searcher and auto warm it 
 (load from cache). If you are committing more frequently than the warming 
 process, these searches pile up and you hit the error. So if you have a page 
 that runs a lot of cfindex tags (as my unit tests were) you can easily hit 
 this error. Problem is, I'm not sure how we can work around this easily. I 
 tried setting the autoWarmCounts to 0 to see if I could reduce the startup 
 time (and since my app does a lot more indexing at runtime than searches so 
 slow startup is not a big issue) but I still hit the error when the number of 
 searches exceeded the maximum set. I could try setting the limit for warming 
 searches higher (setting it to 10 for instance fixes the problem with my 
 tests) but that supposedly is a bit of a performance killer. In cases where 
 my users are adding a batch of these data elements that I'm indexing, I'm 
 almost certainly to bang into that limit again. In my case, it may mean we 
 simply cannot use Solr for this, unless there's someway to batch the commits 
 and just do one single one at the end of the request. What we need is 
 something like a cftransaction tag for the cfindex tag.

 --- Mary Jo


 

~|
Order the Adobe Coldfusion Anthology now!
http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion
Archive: 
http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:343627
Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm
Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm


RE: Solr Errors

2011-04-08 Thread Mark A. Kruger

Mary Jo,

There has to be a way to disable that warmcache process altogether... don't
you think?

-Mark

Mark A. Kruger, MCSE, CFG
(402) 408-3733 ext 105
www.cfwebtools.com
www.coldfusionmuse.com
www.necfug.com


-Original Message-
From: Raymond Camden [mailto:rcam...@gmail.com] 
Sent: Friday, April 08, 2011 2:25 PM
To: cf-talk
Subject: Re: Solr Errors


To be clear - is this only for your unit tests? Could you possibly use
sleep() to slow things down a bit? That's a hack - but would allow you
to keep testing.

On Fri, Apr 8, 2011 at 11:36 AM, Mary Jo Sminkey mary...@cfwebstore.com
wrote:

 Well, by doing some research on the Solr boards and lists, I was able to
figure out the problem. It appears to be due to CF committing after every
cfindex tag and this causes Solr to open a new searcher and auto warm it
(load from cache). If you are committing more frequently than the warming
process, these searches pile up and you hit the error. So if you have a page
that runs a lot of cfindex tags (as my unit tests were) you can easily hit
this error. Problem is, I'm not sure how we can work around this easily. I
tried setting the autoWarmCounts to 0 to see if I could reduce the startup
time (and since my app does a lot more indexing at runtime than searches so
slow startup is not a big issue) but I still hit the error when the number
of searches exceeded the maximum set. I could try setting the limit for
warming searches higher (setting it to 10 for instance fixes the problem
with my tests) but that supposedly is a bit of a performance killer. In
cases where my users are adding a batch of these data elements that I'm
indexing, I'm almost certainly to bang into that limit again. In my case, it
may mean we simply cannot use Solr for this, unless there's someway to batch
the commits and just do one single one at the end of the request. What we
need is something like a cftransaction tag for the cfindex tag.

 --- Mary Jo


 



~|
Order the Adobe Coldfusion Anthology now!
http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion
Archive: 
http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:343628
Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm
Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm


RE: Solr Errors

2011-04-08 Thread Mark A. Kruger

According to this you should be able to comment out caching altogether in
the solrconfig.xml file.

http://wiki.apache.org/solr/SolrCaching#Disabling_Caching

Give it a shot Mary Jo - if it fixes it then you at least have an aswer for
those who want/need to use solr.


-Original Message-
From: Mark A. Kruger [mailto:mkru...@cfwebtools.com] 
Sent: Friday, April 08, 2011 3:37 PM
To: cf-talk
Subject: RE: Solr Errors


Mary Jo,

There has to be a way to disable that warmcache process altogether... don't
you think?

-Mark

Mark A. Kruger, MCSE, CFG
(402) 408-3733 ext 105
www.cfwebtools.com
www.coldfusionmuse.com
www.necfug.com


-Original Message-
From: Raymond Camden [mailto:rcam...@gmail.com] 
Sent: Friday, April 08, 2011 2:25 PM
To: cf-talk
Subject: Re: Solr Errors


To be clear - is this only for your unit tests? Could you possibly use
sleep() to slow things down a bit? That's a hack - but would allow you
to keep testing.

On Fri, Apr 8, 2011 at 11:36 AM, Mary Jo Sminkey mary...@cfwebstore.com
wrote:

 Well, by doing some research on the Solr boards and lists, I was able to
figure out the problem. It appears to be due to CF committing after every
cfindex tag and this causes Solr to open a new searcher and auto warm it
(load from cache). If you are committing more frequently than the warming
process, these searches pile up and you hit the error. So if you have a page
that runs a lot of cfindex tags (as my unit tests were) you can easily hit
this error. Problem is, I'm not sure how we can work around this easily. I
tried setting the autoWarmCounts to 0 to see if I could reduce the startup
time (and since my app does a lot more indexing at runtime than searches so
slow startup is not a big issue) but I still hit the error when the number
of searches exceeded the maximum set. I could try setting the limit for
warming searches higher (setting it to 10 for instance fixes the problem
with my tests) but that supposedly is a bit of a performance killer. In
cases where my users are adding a batch of these data elements that I'm
indexing, I'm almost certainly to bang into that limit again. In my case, it
may mean we simply cannot use Solr for this, unless there's someway to batch
the commits and just do one single one at the end of the request. What we
need is something like a cftransaction tag for the cfindex tag.

 --- Mary Jo


 





~|
Order the Adobe Coldfusion Anthology now!
http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion
Archive: 
http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:343630
Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm
Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm


Re: Solr Errors

2011-04-06 Thread Mary Jo Sminkey

Well, technically yes - there was a CHF after 901.

Sorry, I meant for Solr in particular. I can try the hot fix (don't recall if I 
installed it or not) but I'm not seeing anything listed that would effect Solr:

http://kb2.adobe.com/cps/862/cpsid_86263.html


MJS 

~|
Order the Adobe Coldfusion Anthology now!
http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion
Archive: 
http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:343570
Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm
Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm


Re: Solr Errors

2011-04-06 Thread Raymond Camden

There was definitely fixes for Solr indexing, which I don't
necessarily think will help you, but as a general rule I tend to
recommend getting up to the latest/greatest.


On Wed, Apr 6, 2011 at 8:36 AM, Mary Jo Sminkey mary...@cfwebstore.com wrote:

Well, technically yes - there was a CHF after 901.

 Sorry, I meant for Solr in particular. I can try the hot fix (don't recall if 
 I installed it or not) but I'm not seeing anything listed that would effect 
 Solr:

 http://kb2.adobe.com/cps/862/cpsid_86263.html


 MJS

 

~|
Order the Adobe Coldfusion Anthology now!
http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion
Archive: 
http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:343571
Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm
Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm


Re: Solr Errors

2011-04-05 Thread Mary Jo Sminkey

Interesting. It almost sounds like a load issue. Was the site under heavy load?


No, not at all. This was just running some unit tests locally. Basically the 
tests add a new data point, index it to add it to the collection, then run a 
search for it to make sure they are being picked up properly. I'm concerned 
that we'll see it even more when the site is actually being used, so wondered 
if I need to put cflocks around the index tags? I wouldn't have thought that 
was needed with an update action but I'm guessing this is happening when 2 or 3 
tests run concurrently. 


--- Mary Jo

 







~|
Order the Adobe Coldfusion Anthology now!
http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion
Archive: 
http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:343542
Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm
Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm


Re: Solr Errors

2011-04-05 Thread Mary Jo Sminkey

Mary Jo,

These are options you can set in the INI files of Solr - along with standard
JVM options. If you have a high traffic solr install you will need to fine
tune it to run according to the amount of traffic you have. 

As I mentioned in my other reply, this is *not* happening under load, just with 
localhost testing, so there seems to be some other reason for it. It seems that 
if there's a max thread setting, it should wait until one becomes available? 
Rather than just throwing an error. 


--- Mary Jo



~|
Order the Adobe Coldfusion Anthology now!
http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion
Archive: 
http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:343543
Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm
Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm


Re: Solr Errors

2011-04-05 Thread Dominic Watson

I shouldn't imagine adding cflocks will do much good. The error is to
do with the nature of your collections and the way in which the Solr
server is configured (potentially it's JVM settings and or the server
settings themselves). I think your best bet would be to ask the Solr
folks, they'll be in a better position to help you out I should
imagine.

http://lucene.apache.org/solr/

Dominic

On 5 April 2011 16:29, Mary Jo Sminkey mary...@cfwebstore.com wrote:

Mary Jo,

These are options you can set in the INI files of Solr - along with standard
JVM options. If you have a high traffic solr install you will need to fine
tune it to run according to the amount of traffic you have.

 As I mentioned in my other reply, this is *not* happening under load, just 
 with localhost testing, so there seems to be some other reason for it. It 
 seems that if there's a max thread setting, it should wait until one becomes 
 available? Rather than just throwing an error.


 --- Mary Jo



 

~|
Order the Adobe Coldfusion Anthology now!
http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion
Archive: 
http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:343544
Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm
Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm


Re: Solr Errors

2011-04-05 Thread Mary Jo Sminkey

I shouldn't imagine adding cflocks will do much good. The error is to
do with the nature of your collections and the way in which the Solr
server is configured (potentially it's JVM settings and or the server
settings themselves). I think your best bet would be to ask the Solr
folks, they'll be in a better position to help you out I should
imagine.

Just FYI, I've not configured anything up to this point to do with Solr, I'm 
just using it as it installs with ColdFusion. We've seen the same error on my 
local machine as well as our test server, so seems like there's some problem 
with how CF9 sets it up if I have to go in and modify the server because it's 
throwing these errors right out of the box.


--- Mary Jo







~|
Order the Adobe Coldfusion Anthology now!
http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion
Archive: 
http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:343545
Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm
Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm


Re: Solr Errors

2011-04-05 Thread Raymond Camden

Are you running the latest CF9? There were Solr fixes past 9.0.0.

On Tue, Apr 5, 2011 at 11:34 AM, Mary Jo Sminkey mary...@cfwebstore.com wrote:

I shouldn't imagine adding cflocks will do much good. The error is to
do with the nature of your collections and the way in which the Solr
server is configured (potentially it's JVM settings and or the server
settings themselves). I think your best bet would be to ask the Solr
folks, they'll be in a better position to help you out I should
imagine.

 Just FYI, I've not configured anything up to this point to do with Solr, I'm 
 just using it as it installs with ColdFusion. We've seen the same error on my 
 local machine as well as our test server, so seems like there's some problem 
 with how CF9 sets it up if I have to go in and modify the server because it's 
 throwing these errors right out of the box.


 --- Mary Jo







 

~|
Order the Adobe Coldfusion Anthology now!
http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion
Archive: 
http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:343547
Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm
Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm


Re: Solr Errors

2011-04-05 Thread Mary Jo Sminkey

Are you running the latest CF9? There were Solr fixes past 9.0.0.


CF9.01 on all boxes, so yes, unless there are other hot fixes past that. 


MJS



~|
Order the Adobe Coldfusion Anthology now!
http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion
Archive: 
http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:343551
Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm
Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm


RE: Solr Errors (UNCLASSIFIED)

2011-04-05 Thread Graziano, Michael E Mr CIV USA NETCOM

Classification: UNCLASSIFIED
Caveats: FOUO

There is stand alone Solr Software in the Coldfusion page. ColdFusion
technical support had me to uninstall Solr from Coldfusion  then install
stand alone Solr software

-Original Message-
From: Mary Jo Sminkey [mailto:mary...@cfwebstore.com] 
Sent: Tuesday, April 05, 2011 2:00 PM
To: cf-talk
Subject: Re: Solr Errors


Are you running the latest CF9? There were Solr fixes past 9.0.0.


CF9.01 on all boxes, so yes, unless there are other hot fixes past that. 


MJS





~|
Order the Adobe Coldfusion Anthology now!
http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion
Archive: 
http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:343552
Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm
Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm


Re: Solr Errors

2011-04-05 Thread Raymond Camden

Well, technically yes - there was a CHF after 901.

On Tue, Apr 5, 2011 at 12:59 PM, Mary Jo Sminkey mary...@cfwebstore.com wrote:

Are you running the latest CF9? There were Solr fixes past 9.0.0.


 CF9.01 on all boxes, so yes, unless there are other hot fixes past that.


 MJS



 

~|
Order the Adobe Coldfusion Anthology now!
http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion
Archive: 
http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:343566
Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm
Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm


Re: Solr Errors

2011-04-04 Thread Raymond Camden

Interesting. It almost sounds like a load issue. Was the site under heavy load?


On Mon, Apr 4, 2011 at 4:09 PM, Mary Jo Sminkey mary...@cfwebstore.com wrote:

 Has anyone else seen these kinds of errors? I keep getting them on CF9.01 
 when I run cfindex tags to add new data to a Solr collection.

 org.apache.solr.common.SolrException: 
 Error_opening_new_searcher_exceeded_limit_of_maxWarmingSearchers4_try_again_later
  
 Error_opening_new_searcher_exceeded_limit_of_maxWarmingSearchers4_try_again_later
  request: 
 http://localhost:8983/solr/impacts_docs/update?commit=truewaitFlush=falsewaitSearcher=falsewt=javabinversion=1


 --- Mary Jo


 

~|
Order the Adobe Coldfusion Anthology now!
http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion
Archive: 
http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:343540
Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm
Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm


RE: Solr Errors

2011-04-04 Thread Mark A. Kruger

Mary Jo,

These are options you can set in the INI files of Solr - along with standard
JVM options. If you have a high traffic solr install you will need to fine
tune it to run according to the amount of traffic you have. 

-Mark


Mark A. Kruger, MCSE, CFG
(402) 408-3733 ext 105
www.cfwebtools.com
www.coldfusionmuse.com
www.necfug.com


-Original Message-
From: Mary Jo Sminkey [mailto:mary...@cfwebstore.com] 
Sent: Monday, April 04, 2011 4:10 PM
To: cf-talk
Subject: Solr Errors


Has anyone else seen these kinds of errors? I keep getting them on CF9.01
when I run cfindex tags to add new data to a Solr collection.

org.apache.solr.common.SolrException:
Error_opening_new_searcher_exceeded_limit_of_maxWarmingSearchers4_try_again_
later
Error_opening_new_searcher_exceeded_limit_of_maxWarmingSearchers4_try_again_
later request:
http://localhost:8983/solr/impacts_docs/update?commit=truewaitFlush=falsew
aitSearcher=falsewt=javabinversion=1 


--- Mary Jo




~|
Order the Adobe Coldfusion Anthology now!
http://www.amazon.com/Adobe-Coldfusion-Anthology/dp/1430272155/?tag=houseoffusion
Archive: 
http://www.houseoffusion.com/groups/cf-talk/message.cfm/messageid:343541
Subscription: http://www.houseoffusion.com/groups/cf-talk/subscribe.cfm
Unsubscribe: http://www.houseoffusion.com/groups/cf-talk/unsubscribe.cfm