Re: Http Connection is hanging while deleteByQuery

2011-02-16 Thread Ravi Kiran 
Thanks for updating your solution

On Tue, Feb 8, 2011 at 8:20 AM, shan2812  wrote:

>
> Hi,
>
> At last the migration to Solr-1.4.1 does solve this issue :-)..
>
> Cheers
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/Http-Connection-is-hanging-while-deleteByQuery-tp2367405p2451214.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>

Re: Http Connection is hanging while deleteByQuery

2011-02-08 Thread shan2812 

Hi,

At last the migration to Solr-1.4.1 does solve this issue :-)..

Cheers
-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/Http-Connection-is-hanging-while-deleteByQuery-tp2367405p2451214.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: Http Connection is hanging while deleteByQuery

2011-02-07 Thread shan2812 

Hi Ravi Kiran,

I am using Solr version 1.4, and the solution suggested by you seems to be
there in solrconfig.xml already. 

But after reading your message again now, I checked the release
notes(CHANGES.TXT) of Solr 1.4.1 and I found these two entries..

* SOLR-1711: SolrJ - StreamingUpdateSolrServer had a race condition that
  could halt the streaming of documents. The original patch to fix this
  (never officially released) introduced another hanging bug due to
  connections not being released.  (Attila Babo, Erik Hetzner via yonik)
  
* SOLR-1748, SOLR-1747, SOLR-1746, SOLR-1745, SOLR-1744: Streams and Readers
  retrieved from ContentStreams are not closed in various places, resulting
  in file descriptor leaks.
  (Christoff Brill, Mark Miller)

Though I am not completely sure, I suspect by upgrading my Solr to 1.4.1
could solve this issue.

I am in the process of upgrading my Solr.

Will keep you posted on the updates when I have some..

Cheers
Shan

-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/Http-Connection-is-hanging-while-deleteByQuery-tp2367405p2445076.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: Http Connection is hanging while deleteByQuery

2011-01-31 Thread Ravi Kiran 
ing, boolean, Cookie[])
> 2011-01-31 10:07:18,988 DEBUG (main)[HttpMethodBase] enter
> HttpMethodBase.addProxyConnectionHeader(HttpState, HttpConnection)
> 2011-01-31 10:07:18,989 DEBUG (main)[EntityEnclosingMethod] enter
> EntityEnclosingMethod.addContentLengthRequestHeader(HttpState,
> HttpConnection)
> 2011-01-31 10:07:18,989 DEBUG (main)[EntityEnclosingMethod] enter
> EntityEnclosingMethod.getRequestContentLength()
> 2011-01-31 10:07:18,989 DEBUG (main)[PostMethod] enter
> PostMethod.hasRequestContent()
> 2011-01-31 10:07:18,989 DEBUG (main)[EntityEnclosingMethod] enter
> EntityEnclosingMethod.hasRequestContent()
> 2011-01-31 10:07:18,989 DEBUG (main)[HttpMethodBase]
> HttpMethodBase.addRequestHeader(Header)
> 2011-01-31 10:07:18,989 DEBUG (main)[EntityEnclosingMethod] enter
> EntityEnclosingMethod.renerateRequestBody()
> 2011-01-31 10:07:18,989 DEBUG (main)[header] >> "User-Agent:
> Solr[org.apache.solr.client.solrj.impl.CommonsHttpSolrServer] 1.0[\r][\n]"
> 2011-01-31 10:07:18,989 DEBUG (main)[HttpConnection] enter
> HttpConnection.print(String)
> 2011-01-31 10:07:18,989 DEBUG (main)[HttpConnection] enter
> HttpConnection.write(byte[])
> 2011-01-31 10:07:18,989 DEBUG (main)[HttpConnection] enter
> HttpConnection.write(byte[], int, int)
> 2011-01-31 10:07:18,989 DEBUG (main)[header] >> "Host:
> 10.145.10.154:8081[\r][\n]"
> 2011-01-31 10:07:18,989 DEBUG (main)[HttpConnection] enter
> HttpConnection.print(String)
> 2011-01-31 10:07:18,989 DEBUG (main)[HttpConnection] enter
> HttpConnection.write(byte[])
> 2011-01-31 10:07:18,989 DEBUG (main)[HttpConnection] enter
> HttpConnection.write(byte[], int, int)
> 2011-01-31 10:07:18,989 DEBUG (main)[header] >> "Transfer-Encoding:
> chunked[\r][\n]"
> 2011-01-31 10:07:18,989 DEBUG (main)[HttpConnection] enter
> HttpConnection.print(String)
> 2011-01-31 10:07:18,989 DEBUG (main)[HttpConnection] enter
> HttpConnection.write(byte[])
> 2011-01-31 10:07:18,989 DEBUG (main)[HttpConnection] enter
> HttpConnection.write(byte[], int, int)
> 2011-01-31 10:07:18,989 DEBUG (main)[header] >> "Content-Type: text/xml;
> charset=utf-8[\r][\n]"
> 2011-01-31 10:07:18,989 DEBUG (main)[HttpConnection] enter
> HttpConnection.print(String)
> 2011-01-31 10:07:18,989 DEBUG (main)[HttpConnection] enter
> HttpConnection.write(byte[])
> 2011-01-31 10:07:18,989 DEBUG (main)[HttpConnection] enter
> HttpConnection.write(byte[], int, int)
> 2011-01-31 10:07:18,989 DEBUG (main)[HttpConnection] enter
> HttpConnection.writeLine()
> 2011-01-31 10:07:18,989 DEBUG (main)[HttpConnection] enter
> HttpConnection.write(byte[])
> 2011-01-31 10:07:18,989 DEBUG (main)[HttpConnection] enter
> HttpConnection.write(byte[], int, int)
> 2011-01-31 10:07:18,989 DEBUG (main)[header] >> "[\r][\n]"
> 2011-01-31 10:07:18,989 DEBUG (main)[EntityEnclosingMethod] enter
> EntityEnclosingMethod.writeRequestBody(HttpState, HttpConnection)
> 2011-01-31 10:07:18,989 DEBUG (main)[PostMethod] enter
> PostMethod.hasRequestContent()
> 2011-01-31 10:07:18,989 DEBUG (main)[EntityEnclosingMethod] enter
> EntityEnclosingMethod.hasRequestContent()
> 2011-01-31 10:07:18,989 DEBUG (main)[EntityEnclosingMethod] enter
> EntityEnclosingMethod.getRequestContentLength()
> 2011-01-31 10:07:18,989 DEBUG (main)[PostMethod] enter
> PostMethod.hasRequestContent()
> 2011-01-31 10:07:18,989 DEBUG (main)[EntityEnclosingMethod] enter
> EntityEnclosingMethod.hasRequestContent()
> 2011-01-31 10:07:18,989 DEBUG (main)[HttpConnection] enter
> HttpConnection.getRequestOutputStream()
> 2011-01-31 10:07:18,992 DEBUG (main)[content] >> "58[\r][\n]"
> 2011-01-31 10:07:18,992 DEBUG (main)[content] >> "type:"LDI"
> AND sysname:"ICAO" AND itemtypedesc:"Airport""
> 2011-01-31 10:07:18,992 DEBUG (main)[content] >> "[\r][\n]"
> 2011-01-31 10:07:18,992 DEBUG (main)[content] >> "0"
> 2011-01-31 10:07:18,992 DEBUG (main)[content] >> "[\r][\n]"
> 2011-01-31 10:07:18,992 DEBUG (main)[content] >> "[\r][\n]"
> 2011-01-31 10:07:18,992 DEBUG (main)[EntityEnclosingMethod] Request body
> sent
> 2011-01-31 10:07:18,992 DEBUG (main)[HttpConnection] enter
> HttpConnection.flushRequestOutputStream()
> 2011-01-31 10:07:18,992 DEBUG (main)[HttpMethodBase] enter
> HttpMethodBase.readResponse(HttpState, HttpConnection)
> 2011-01-31 10:07:18,992 DEBUG (main)[HttpMethodBase] enter
> HttpMethodBase.readStatusLine(HttpState, HttpConnection)
> 2011-01-31 10:07:18,992 DEBUG (main)[HttpConnection] enter
> HttpConnection.readLine()
> 2011-01-31 10:07:18,993 DEBUG (main)[HttpParser] enter
> HttpParser.readLine(InputStream, String)
> 2011-01-31 10:07:18,993 DEBUG (main)[HttpParser] enter
> HttpParser.readRawLine()
>
>
> It stays here for 2-3 hours(it still..) and no exception or any error..
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/Http-Connection-is-hanging-while-deleteByQuery-tp2367405p2388953.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>

Re: Http Connection is hanging while deleteByQuery

2011-01-31 Thread shan2812 
er
HttpConnection.print(String)
2011-01-31 10:07:18,989 DEBUG (main)[HttpConnection] enter
HttpConnection.write(byte[])
2011-01-31 10:07:18,989 DEBUG (main)[HttpConnection] enter
HttpConnection.write(byte[], int, int)
2011-01-31 10:07:18,989 DEBUG (main)[header] >> "Host:
10.145.10.154:8081[\r][\n]"
2011-01-31 10:07:18,989 DEBUG (main)[HttpConnection] enter
HttpConnection.print(String)
2011-01-31 10:07:18,989 DEBUG (main)[HttpConnection] enter
HttpConnection.write(byte[])
2011-01-31 10:07:18,989 DEBUG (main)[HttpConnection] enter
HttpConnection.write(byte[], int, int)
2011-01-31 10:07:18,989 DEBUG (main)[header] >> "Transfer-Encoding:
chunked[\r][\n]"
2011-01-31 10:07:18,989 DEBUG (main)[HttpConnection] enter
HttpConnection.print(String)
2011-01-31 10:07:18,989 DEBUG (main)[HttpConnection] enter
HttpConnection.write(byte[])
2011-01-31 10:07:18,989 DEBUG (main)[HttpConnection] enter
HttpConnection.write(byte[], int, int)
2011-01-31 10:07:18,989 DEBUG (main)[header] >> "Content-Type: text/xml;
charset=utf-8[\r][\n]"
2011-01-31 10:07:18,989 DEBUG (main)[HttpConnection] enter
HttpConnection.print(String)
2011-01-31 10:07:18,989 DEBUG (main)[HttpConnection] enter
HttpConnection.write(byte[])
2011-01-31 10:07:18,989 DEBUG (main)[HttpConnection] enter
HttpConnection.write(byte[], int, int)
2011-01-31 10:07:18,989 DEBUG (main)[HttpConnection] enter
HttpConnection.writeLine()
2011-01-31 10:07:18,989 DEBUG (main)[HttpConnection] enter
HttpConnection.write(byte[])
2011-01-31 10:07:18,989 DEBUG (main)[HttpConnection] enter
HttpConnection.write(byte[], int, int)
2011-01-31 10:07:18,989 DEBUG (main)[header] >> "[\r][\n]"
2011-01-31 10:07:18,989 DEBUG (main)[EntityEnclosingMethod] enter
EntityEnclosingMethod.writeRequestBody(HttpState, HttpConnection)
2011-01-31 10:07:18,989 DEBUG (main)[PostMethod] enter
PostMethod.hasRequestContent()
2011-01-31 10:07:18,989 DEBUG (main)[EntityEnclosingMethod] enter
EntityEnclosingMethod.hasRequestContent()
2011-01-31 10:07:18,989 DEBUG (main)[EntityEnclosingMethod] enter
EntityEnclosingMethod.getRequestContentLength()
2011-01-31 10:07:18,989 DEBUG (main)[PostMethod] enter
PostMethod.hasRequestContent()
2011-01-31 10:07:18,989 DEBUG (main)[EntityEnclosingMethod] enter
EntityEnclosingMethod.hasRequestContent()
2011-01-31 10:07:18,989 DEBUG (main)[HttpConnection] enter
HttpConnection.getRequestOutputStream()
2011-01-31 10:07:18,992 DEBUG (main)[content] >> "58[\r][\n]"
2011-01-31 10:07:18,992 DEBUG (main)[content] >> "type:"LDI"
AND sysname:"ICAO" AND itemtypedesc:"Airport""
2011-01-31 10:07:18,992 DEBUG (main)[content] >> "[\r][\n]"
2011-01-31 10:07:18,992 DEBUG (main)[content] >> "0"
2011-01-31 10:07:18,992 DEBUG (main)[content] >> "[\r][\n]"
2011-01-31 10:07:18,992 DEBUG (main)[content] >> "[\r][\n]"
2011-01-31 10:07:18,992 DEBUG (main)[EntityEnclosingMethod] Request body
sent
2011-01-31 10:07:18,992 DEBUG (main)[HttpConnection] enter
HttpConnection.flushRequestOutputStream()
2011-01-31 10:07:18,992 DEBUG (main)[HttpMethodBase] enter
HttpMethodBase.readResponse(HttpState, HttpConnection)
2011-01-31 10:07:18,992 DEBUG (main)[HttpMethodBase] enter
HttpMethodBase.readStatusLine(HttpState, HttpConnection)
2011-01-31 10:07:18,992 DEBUG (main)[HttpConnection] enter
HttpConnection.readLine()
2011-01-31 10:07:18,993 DEBUG (main)[HttpParser] enter
HttpParser.readLine(InputStream, String)
2011-01-31 10:07:18,993 DEBUG (main)[HttpParser] enter
HttpParser.readRawLine()


It stays here for 2-3 hours(it still..) and no exception or any error..
-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/Http-Connection-is-hanging-while-deleteByQuery-tp2367405p2388953.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: Http Connection is hanging while deleteByQuery

2011-01-30 Thread shan2812 

Hello Ravi Kiran,

I am not quite sure if it has anything to do with the number of records.
Anyways there are around 400K docs in Solr, and my deleteByQuery() tries to
delete about 400 docs..

The thing is, it does seem to delete the records, but the control never
seems to come back to the caller. It just hangs. Also that that I did not
wait until it threw any exception(lets say an hour) as I felt anyway it
should be completed in few minutes. 

I tried to let it run hoping to see an exception, but for 3-4 hours nothing
happened really.


-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/Http-Connection-is-hanging-while-deleteByQuery-tp2367405p2383477.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: Http Connection is hanging while deleteByQuery

2011-01-29 Thread Ravi Kiran 
Hello Shan,
 Even my SOLR instance is getting hung on deleteById or
deleteByQuery. Iam using Solr 1.4.1 and have about 900k docs in my core.
solr used to work till about 750k docs (not exactly sure though), from then
onwards it is hanging for a long time and ultimately throws a
SocketTimeoutException. Do you also get timeout exception ? and how many
docs do you have?

Thanks
Ravi Kiran



On Fri, Jan 28, 2011 at 12:52 PM, shan2812 wrote:

>
> Though it may not be needed, just to ad..
>
> this is how I delete by query
>
> UpdateResponse updateResponse = solr.deleteByQuery(new
> SolrQuery("my_query"));
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/Http-Connection-is-hanging-while-deleteByQuery-tp2367405p2367410.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>

Re: Http Connection is hanging while deleteByQuery

2011-01-28 Thread shan2812 

Though it may not be needed, just to ad..

this is how I delete by query

UpdateResponse updateResponse = solr.deleteByQuery(new
SolrQuery("my_query"));
-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/Http-Connection-is-hanging-while-deleteByQuery-tp2367405p2367410.html
Sent from the Solr - User mailing list archive at Nabble.com.

Http Connection is hanging while deleteByQuery

2011-01-28 Thread shan2812 

Hi,

I am trying to delete Solr documents using deleteByQuery(). Unfortunately it
simply hangs, for a long time.

I have tried using both SimpleHttpConnectionManager and
MultiThreaded...(default)
1. 
SolrServer solr;
SimpleHttpConnectionManager cm = new SimpleHttpConnectionManager(true);

the below options were tried as nothing worked
//cm.closeIdleConnections(0L);
//cm.getParams().setConnectionTimeout(1);
//cm.getParams().setMaxTotalConnections(10);
HttpClient httpClient = new HttpClient(cm);

solr = new CommonsHttpSolrServer(solrUrl, httpClient);

2.
SolrServer solr;
solr = new CommonsHttpSolrServer(solrUrl);

Do anyone have any idea?

Thank You.

Regards,
Shan
-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/Http-Connection-is-hanging-while-deleteByQuery-tp2367405p2367405.html
Sent from the Solr - User mailing list archive at Nabble.com.