Re: SolrJ | IOException while Indexing a PDF document with additional fields
wasn't it the stacetrace in my posting before?
It is the same behavior when i use the HttpSolrServer.java
here is the console output of the solr server:
03.01.2013 11:32:31 org.apache.solr.core.SolrDeletionPolicy updateCommits
INFO: newest commit = 1
03.01.2013 11:32:31 org.apache.solr.update.processor.LogUpdateProcessor
finish
INFO: [core-main] webapp=/solr path=/update params={wt=javabinversion=2}
{add=[WiringDiagramSheetImpl@17171]} 0 296
03.01.2013 11:32:31 org.apache.solr.update.DirectUpdateHandler2 commit
INFO: start
commit{flags=0,_version_=0,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false}
03.01.2013 11:32:32 org.apache.solr.core.SolrDeletionPolicy onCommit
INFO: SolrDeletionPolicy.onCommit: commits:num=2
commit{dir=C:\Projects\Project_ConnectPORTAL\connect-portal\tools\solr\solr-home-4.0\core-main\data\index,segFN=segments_1,generation=1,filenames=[segments_1]
commit{dir=C:\Projects\Project_ConnectPORTAL\connect-portal\tools\solr\solr-home-4.0\core-main\data\index,segFN=segments_2,generation=2,filenames=[_0_Lucene40_0.tim,
_0.fnm, _0.tvd, _0.tvf,
_nrm.cfs, _0_Lucene40_0.prx, _0_Lucene40_0.tip, _0_Lucene40_0.frq, _0.tvx,
_0_nrm.cfe, segments_2, _0.fdx, _0.si, _0.fdt]
03.01.2013 11:32:32 org.apache.solr.core.SolrDeletionPolicy updateCommits
INFO: newest commit = 2
03.01.2013 11:32:32 org.apache.solr.search.SolrIndexSearcher init
INFO: Opening Searcher@7f2ea1dd main
03.01.2013 11:32:32 org.apache.solr.update.DirectUpdateHandler2 commit
INFO: end_commit_flush
03.01.2013 11:32:32 org.apache.solr.core.SolrCore registerSearcher
INFO: [core-main] Registered new searcher Searcher@7f2ea1dd
main{StandardDirectoryReader(segments_2:3 _0(4.0.0.2):C1)}
03.01.2013 11:32:32 org.apache.solr.update.processor.LogUpdateProcessor
finish
INFO: [core-main] webapp=/solr path=/update
params={waitSearcher=truewt=javabincommit=truesoftCommit=falseversion=2}
{commit=} 0 375
--
View this message in context:
http://lucene.472066.n3.nabble.com/SolrJ-IOException-while-Indexing-a-PDF-document-with-additional-fields-tp4029971p4030235.html
Sent from the Solr - User mailing list archive at Nabble.com.
Re: SolrJ - IOException
(DefaultRequestDirector.java:712)
... 15 more
Oct 8, 2012 7:27:22 AM com..rabbitmq.worker.SolrWriter work
SEVERE: {id:4049704,datetime:2012-10-08 07:22:05}
Server at
http://ec2-50-18-73-42.us-west-1.compute.amazonaws.com:8983/solr/coupon
server returned non ok status:500, message:Internal Server Error
org.apache.solr.client.solrj.SolrServerException: Server at server returned
non ok status:500, message:Internal Server Error
at
org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:328)
at
org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:211)
at
org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:105)
at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:69)
at org.apache.solr.client.solrj.SolrServer.addBeans(SolrServer.java:96)
at org.apache.solr.client.solrj.SolrServer.addBeans(SolrServer.java:79)
at com..solr.SolrIndexService.IndexCoupon(SolrIndexService.java:57)
at com..solr.SolrIndexService.Index(SolrIndexService.java:36)
at com..rabbitmq.worker.SolrWriter.work(SolrWriter.java:47)
at com..rabbitmq.job.Runner.run(Runner.java:84)
at com..rabbitmq.job.SolrConsumer.main(SolrConsumer.java:10)
On Fri, Oct 5, 2012 at 4:20 PM, Erick Erickson erickerick...@gmail.comwrote:
Well, using embedded Solr isn't necessarily indicated. I have a couple
of questions.
1 you say 30 tps. Are you sending a single doc at a time or batching them
up? I.e. server.add(doclist) or server.add(doc)?
2 Http isn't actually an inefficient protocol, I think the whole idea of
using embedded Solr is a red herring if that's the concern.
3 bq: call the VIP in front of the SOLR nodes to distribute the update
load
What does that mean? Only one process should be writing to an index
at a time. So there should be only one address to which all the
updates go. The servlet container will stack up multiple incoming requests.
So I totally don't understand what you're trying to accomplish here.
4 You haven't told us what version of Solr you're using, so the stack
trace
isn't all that helpful. We can pick random Solr versions and hope they
match
the line numbers, but that's not too efficient.
5 Have you thought about just putting some fallback logic in your SolrJ
program
and having it sleep for a few seconds and retrying?
Best
Erick
On Fri, Oct 5, 2012 at 4:35 PM, Sushil jain jain.ayushm...@gmail.com
wrote:
If you need to use solr in an embedded application, this is the
recommended
approach. It allows you to work with the same interface whether or not
you
have access to HTTP.
And it is not thread safe.
On Sat, Oct 6, 2012 at 1:58 AM, balaji.gandhi
balaji.gan...@apollogrp.eduwrote:
Sushil, we are trying to call the VIP in front of the SOLR nodes to
distribute the update load.
Also is EmbeddedSolrServer thread safe?
Balaji Gandhi, Senior Software Developer, Horizontal Platform Services
Product Engineering │ Apollo Group, Inc.
1225 W. Washington St. | AZ23 | Tempe, AZ 85281
Phone: 602.713.2417 | Email: balaji.gan...@apollogrp.edumailto:
balaji.gan...@apollogrp.edu
P Go Green. Don't Print. Moreover soft copies can be indexed by
algorithms.
From: Sushil jain [via Lucene] [mailto:
ml-node+s472066n4012179...@n3.nabble.com]
Sent: Friday, October 05, 2012 1:23 PM
To: Balaji Gandhi
Subject: Re: SolrJ - IOException
Yes, I'd recommend EmbeddedSolrServer, because it doesn't require any
web
server for read/write/update/delete operations.
On Sat, Oct 6, 2012 at 1:48 AM, balaji.gandhi
[hidden email]/user/SendEmail.jtp?type=nodenode=4012179i=0wrote:
Sushil,
30 TPS = 30 transactions (updates) per second.
Is the recommendation to use EmbeddedSolrServer instead of
HttpSolrServer?
Thanks,
Balaji
Balaji Gandhi, Senior Software Developer, Horizontal Platform Services
Product Engineering │ Apollo Group, Inc.
1225 W. Washington St. | AZ23 | Tempe, AZ 85281
Phone: 602.713.2417 | Email: [hidden
email]/user/SendEmail.jtp?type=nodenode=4012179i=1mailto:
[hidden email]/user/SendEmail.jtp?type=nodenode=4012179i=2
P Go Green. Don't Print. Moreover soft copies can be indexed by
algorithms.
From: Sushil jain [via Lucene] [mailto:
[hidden email]/user/SendEmail.jtp?type=nodenode=4012179i=3]
Sent: Friday, October 05, 2012 1:14 PM
To: Balaji Gandhi
Subject: Re: SolrJ - IOException
Balaji,
What is 30 TPS ?
Toke,
You should use EmbeddedSolrServer Instead.
On Fri, Oct 5, 2012 at 11:42 PM, balaji.gandhi
[hidden email]/user/SendEmail.jtp?type=nodenode=4012172i=0wrote:
Hi Toke,
Were you able to find anything on this issue? We are running at 30
TPS
and
using the default HttpSolrServer for the posts.
[cid:image001.png@01CDA2EA.370A6ED0]
Thanks,
Balaji
Balaji Gandhi, Senior Software Developer, Horizontal Platform
Services
Product
Re: SolrJ - IOException
(AbstractClientConnAdapter.java:227)
at
org.apache.http.protocol.HttpRequestExecutor.doSendRequest(HttpRequestExecutor.java:257)
at
org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
at
org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:712)
... 15 more
Oct 8, 2012 7:27:22 AM com..rabbitmq.worker.SolrWriter work
SEVERE: {id:4049704,datetime:2012-10-08 07:22:05}
Server at
http://ec2-50-18-73-42.us-west-1.compute.amazonaws.com:8983/solr/coupon
server returned non ok status:500, message:Internal Server Error
org.apache.solr.client.solrj.SolrServerException: Server at server returned
non ok status:500, message:Internal Server Error
at
org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:328)
at
org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:211)
at
org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:105)
at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:69)
at org.apache.solr.client.solrj.SolrServer.addBeans(SolrServer.java:96)
at org.apache.solr.client.solrj.SolrServer.addBeans(SolrServer.java:79)
at com..solr.SolrIndexService.IndexCoupon(SolrIndexService.java:57)
at com..solr.SolrIndexService.Index(SolrIndexService.java:36)
at com..rabbitmq.worker.SolrWriter.work(SolrWriter.java:47)
at com..rabbitmq.job.Runner.run(Runner.java:84)
at com..rabbitmq.job.SolrConsumer.main(SolrConsumer.java:10)
On Fri, Oct 5, 2012 at 4:20 PM, Erick Erickson erickerick...@gmail.comwrote:
Well, using embedded Solr isn't necessarily indicated. I have a couple
of questions.
1 you say 30 tps. Are you sending a single doc at a time or batching them
up? I.e. server.add(doclist) or server.add(doc)?
2 Http isn't actually an inefficient protocol, I think the whole idea of
using embedded Solr is a red herring if that's the concern.
3 bq: call the VIP in front of the SOLR nodes to distribute the update
load
What does that mean? Only one process should be writing to an index
at a time. So there should be only one address to which all the
updates go. The servlet container will stack up multiple incoming
requests.
So I totally don't understand what you're trying to accomplish here.
4 You haven't told us what version of Solr you're using, so the stack
trace
isn't all that helpful. We can pick random Solr versions and hope they
match
the line numbers, but that's not too efficient.
5 Have you thought about just putting some fallback logic in your SolrJ
program
and having it sleep for a few seconds and retrying?
Best
Erick
On Fri, Oct 5, 2012 at 4:35 PM, Sushil jain jain.ayushm...@gmail.com
wrote:
If you need to use solr in an embedded application, this is the
recommended
approach. It allows you to work with the same interface whether or not
you
have access to HTTP.
And it is not thread safe.
On Sat, Oct 6, 2012 at 1:58 AM, balaji.gandhi
balaji.gan...@apollogrp.eduwrote:
Sushil, we are trying to call the VIP in front of the SOLR nodes to
distribute the update load.
Also is EmbeddedSolrServer thread safe?
Balaji Gandhi, Senior Software Developer, Horizontal Platform Services
Product Engineering │ Apollo Group, Inc.
1225 W. Washington St. | AZ23 | Tempe, AZ 85281
Phone: 602.713.2417 | Email: balaji.gan...@apollogrp.edumailto:
balaji.gan...@apollogrp.edu
P Go Green. Don't Print. Moreover soft copies can be indexed by
algorithms.
From: Sushil jain [via Lucene] [mailto:
ml-node+s472066n4012179...@n3.nabble.com]
Sent: Friday, October 05, 2012 1:23 PM
To: Balaji Gandhi
Subject: Re: SolrJ - IOException
Yes, I'd recommend EmbeddedSolrServer, because it doesn't require any
web
server for read/write/update/delete operations.
On Sat, Oct 6, 2012 at 1:48 AM, balaji.gandhi
[hidden email]/user/SendEmail.jtp?type=nodenode=4012179i=0wrote:
Sushil,
30 TPS = 30 transactions (updates) per second.
Is the recommendation to use EmbeddedSolrServer instead of
HttpSolrServer?
Thanks,
Balaji
Balaji Gandhi, Senior Software Developer, Horizontal Platform
Services
Product Engineering │ Apollo Group, Inc.
1225 W. Washington St. | AZ23 | Tempe, AZ 85281
Phone: 602.713.2417 | Email: [hidden
email]/user/SendEmail.jtp?type=nodenode=4012179i=1mailto:
[hidden email]/user/SendEmail.jtp?type=nodenode=4012179i=2
P Go Green. Don't Print. Moreover soft copies can be indexed by
algorithms.
From: Sushil jain [via Lucene] [mailto:
[hidden email]/user/SendEmail.jtp?type=nodenode=4012179i=3]
Sent: Friday, October 05, 2012 1:14 PM
To: Balaji Gandhi
Subject: Re: SolrJ - IOException
Balaji,
What is 30 TPS ?
Toke,
You should use EmbeddedSolrServer Instead.
On Fri, Oct 5, 2012 at 11:42 PM, balaji.gandhi
[hidden
email]/user/SendEmail.jtp?type=nodenode=4012172i=0wrote
RE: SolrJ - IOException
Hi Toke, Were you able to find anything on this issue? We are running at 30 TPS and using the default HttpSolrServer for the posts. [cid:image001.png@01CDA2EA.370A6ED0] Thanks, Balaji Balaji Gandhi, Senior Software Developer, Horizontal Platform Services Product Engineering │ Apollo Group, Inc. 1225 W. Washington St. | AZ23 | Tempe, AZ 85281 Phone: 602.713.2417 | Email: balaji.gan...@apollogrp.edumailto:balaji.gan...@apollogrp.edu P Go Green. Don't Print. Moreover soft copies can be indexed by algorithms. From: Toke Eskildsen [via Lucene] [mailto:ml-node+s472066n4010082...@n3.nabble.com] Sent: Tuesday, September 25, 2012 12:19 AM To: Balaji Gandhi Subject: Re: SolrJ - IOException On Tue, 2012-09-25 at 01:50 +0200, balaji.gandhi wrote: I am encountering this error randomly (under load) when posting to Solr using SolrJ. Has anyone encountered a similar error? org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://localhost:8080/solr/profile at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:414) [...] This looks suspiciously like a potential bug in the HTTP keep-alive flow that we encountered some weeks ago. I am guessing that you are issuing more than 100 separate updates/second. Could you please provide the full stack trace? If you reply to this email, your message will be added to the discussion below: http://lucene.472066.n3.nabble.com/SolrJ-IOException-tp4010026p4010082.html To unsubscribe from SolrJ - IOException, click herehttp://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_codenode=4010026code=YmFsYWppLmdhbmRoaUBhcG9sbG9ncnAuZWR1fDQwMTAwMjZ8LTEwNzE2NTA1NDI=. NAMLhttp://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewerid=instant_html%21nabble%3Aemail.namlbase=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespacebreadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml This message is private and confidential. If you have received it in error, please notify the sender and remove it from your system. image001.png (37K) http://lucene.472066.n3.nabble.com/attachment/4012130/0/image001.png -- View this message in context: http://lucene.472066.n3.nabble.com/SolrJ-IOException-tp4010026p4012130.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: SolrJ - IOException
Balaji, What is 30 TPS ? Toke, You should use EmbeddedSolrServer Instead. On Fri, Oct 5, 2012 at 11:42 PM, balaji.gandhi balaji.gan...@apollogrp.eduwrote: Hi Toke, Were you able to find anything on this issue? We are running at 30 TPS and using the default HttpSolrServer for the posts. [cid:image001.png@01CDA2EA.370A6ED0] Thanks, Balaji Balaji Gandhi, Senior Software Developer, Horizontal Platform Services Product Engineering │ Apollo Group, Inc. 1225 W. Washington St. | AZ23 | Tempe, AZ 85281 Phone: 602.713.2417 | Email: balaji.gan...@apollogrp.edumailto: balaji.gan...@apollogrp.edu P Go Green. Don't Print. Moreover soft copies can be indexed by algorithms. From: Toke Eskildsen [via Lucene] [mailto: ml-node+s472066n4010082...@n3.nabble.com] Sent: Tuesday, September 25, 2012 12:19 AM To: Balaji Gandhi Subject: Re: SolrJ - IOException On Tue, 2012-09-25 at 01:50 +0200, balaji.gandhi wrote: I am encountering this error randomly (under load) when posting to Solr using SolrJ. Has anyone encountered a similar error? org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://localhost:8080/solr/profile at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:414) [...] This looks suspiciously like a potential bug in the HTTP keep-alive flow that we encountered some weeks ago. I am guessing that you are issuing more than 100 separate updates/second. Could you please provide the full stack trace? If you reply to this email, your message will be added to the discussion below: http://lucene.472066.n3.nabble.com/SolrJ-IOException-tp4010026p4010082.html To unsubscribe from SolrJ - IOException, click here http://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_codenode=4010026code=YmFsYWppLmdhbmRoaUBhcG9sbG9ncnAuZWR1fDQwMTAwMjZ8LTEwNzE2NTA1NDI= . NAML http://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewerid=instant_html%21nabble%3Aemail.namlbase=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespacebreadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml This message is private and confidential. If you have received it in error, please notify the sender and remove it from your system. image001.png (37K) http://lucene.472066.n3.nabble.com/attachment/4012130/0/image001.png -- View this message in context: http://lucene.472066.n3.nabble.com/SolrJ-IOException-tp4010026p4012130.html Sent from the Solr - User mailing list archive at Nabble.com.
RE: SolrJ - IOException
Sushil, 30 TPS = 30 transactions (updates) per second. Is the recommendation to use EmbeddedSolrServer instead of HttpSolrServer? Thanks, Balaji Balaji Gandhi, Senior Software Developer, Horizontal Platform Services Product Engineering │ Apollo Group, Inc. 1225 W. Washington St. | AZ23 | Tempe, AZ 85281 Phone: 602.713.2417 | Email: balaji.gan...@apollogrp.edumailto:balaji.gan...@apollogrp.edu P Go Green. Don't Print. Moreover soft copies can be indexed by algorithms. From: Sushil jain [via Lucene] [mailto:ml-node+s472066n4012172...@n3.nabble.com] Sent: Friday, October 05, 2012 1:14 PM To: Balaji Gandhi Subject: Re: SolrJ - IOException Balaji, What is 30 TPS ? Toke, You should use EmbeddedSolrServer Instead. On Fri, Oct 5, 2012 at 11:42 PM, balaji.gandhi [hidden email]/user/SendEmail.jtp?type=nodenode=4012172i=0wrote: Hi Toke, Were you able to find anything on this issue? We are running at 30 TPS and using the default HttpSolrServer for the posts. [cid:image001.png@01CDA2EA.370A6ED0] Thanks, Balaji Balaji Gandhi, Senior Software Developer, Horizontal Platform Services Product Engineering │ Apollo Group, Inc. 1225 W. Washington St. | AZ23 | Tempe, AZ 85281 Phone: 602.713.2417 | Email: [hidden email]/user/SendEmail.jtp?type=nodenode=4012172i=1mailto: [hidden email]/user/SendEmail.jtp?type=nodenode=4012172i=2 P Go Green. Don't Print. Moreover soft copies can be indexed by algorithms. From: Toke Eskildsen [via Lucene] [mailto: [hidden email]/user/SendEmail.jtp?type=nodenode=4012172i=3] Sent: Tuesday, September 25, 2012 12:19 AM To: Balaji Gandhi Subject: Re: SolrJ - IOException On Tue, 2012-09-25 at 01:50 +0200, balaji.gandhi wrote: I am encountering this error randomly (under load) when posting to Solr using SolrJ. Has anyone encountered a similar error? org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://localhost:8080/solr/profile at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:414) [...] This looks suspiciously like a potential bug in the HTTP keep-alive flow that we encountered some weeks ago. I am guessing that you are issuing more than 100 separate updates/second. Could you please provide the full stack trace? If you reply to this email, your message will be added to the discussion below: http://lucene.472066.n3.nabble.com/SolrJ-IOException-tp4010026p4010082.html To unsubscribe from SolrJ - IOException, click here . NAML http://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewerid=instant_html%21nabble%3Aemail.namlbase=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespacebreadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml This message is private and confidential. If you have received it in error, please notify the sender and remove it from your system. image001.png (37K) http://lucene.472066.n3.nabble.com/attachment/4012130/0/image001.png -- View this message in context: http://lucene.472066.n3.nabble.com/SolrJ-IOException-tp4010026p4012130.html Sent from the Solr - User mailing list archive at Nabble.com. If you reply to this email, your message will be added to the discussion below: http://lucene.472066.n3.nabble.com/SolrJ-IOException-tp4010026p4012172.html To unsubscribe from SolrJ - IOException, click herehttp://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_codenode=4010026code=YmFsYWppLmdhbmRoaUBhcG9sbG9ncnAuZWR1fDQwMTAwMjZ8LTEwNzE2NTA1NDI=. NAMLhttp://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewerid=instant_html%21nabble%3Aemail.namlbase=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespacebreadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml This message is private and confidential. If you have received it in error, please notify the sender and remove it from your system. -- View this message in context: http://lucene.472066.n3.nabble.com/SolrJ-IOException-tp4010026p4012176.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: SolrJ - IOException
Yes, I'd recommend EmbeddedSolrServer, because it doesn't require any web server for read/write/update/delete operations. On Sat, Oct 6, 2012 at 1:48 AM, balaji.gandhi balaji.gan...@apollogrp.eduwrote: Sushil, 30 TPS = 30 transactions (updates) per second. Is the recommendation to use EmbeddedSolrServer instead of HttpSolrServer? Thanks, Balaji Balaji Gandhi, Senior Software Developer, Horizontal Platform Services Product Engineering │ Apollo Group, Inc. 1225 W. Washington St. | AZ23 | Tempe, AZ 85281 Phone: 602.713.2417 | Email: balaji.gan...@apollogrp.edumailto: balaji.gan...@apollogrp.edu P Go Green. Don't Print. Moreover soft copies can be indexed by algorithms. From: Sushil jain [via Lucene] [mailto: ml-node+s472066n4012172...@n3.nabble.com] Sent: Friday, October 05, 2012 1:14 PM To: Balaji Gandhi Subject: Re: SolrJ - IOException Balaji, What is 30 TPS ? Toke, You should use EmbeddedSolrServer Instead. On Fri, Oct 5, 2012 at 11:42 PM, balaji.gandhi [hidden email]/user/SendEmail.jtp?type=nodenode=4012172i=0wrote: Hi Toke, Were you able to find anything on this issue? We are running at 30 TPS and using the default HttpSolrServer for the posts. [cid:image001.png@01CDA2EA.370A6ED0] Thanks, Balaji Balaji Gandhi, Senior Software Developer, Horizontal Platform Services Product Engineering │ Apollo Group, Inc. 1225 W. Washington St. | AZ23 | Tempe, AZ 85281 Phone: 602.713.2417 | Email: [hidden email]/user/SendEmail.jtp?type=nodenode=4012172i=1mailto: [hidden email]/user/SendEmail.jtp?type=nodenode=4012172i=2 P Go Green. Don't Print. Moreover soft copies can be indexed by algorithms. From: Toke Eskildsen [via Lucene] [mailto: [hidden email]/user/SendEmail.jtp?type=nodenode=4012172i=3] Sent: Tuesday, September 25, 2012 12:19 AM To: Balaji Gandhi Subject: Re: SolrJ - IOException On Tue, 2012-09-25 at 01:50 +0200, balaji.gandhi wrote: I am encountering this error randomly (under load) when posting to Solr using SolrJ. Has anyone encountered a similar error? org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://localhost:8080/solr/profile at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:414) [...] This looks suspiciously like a potential bug in the HTTP keep-alive flow that we encountered some weeks ago. I am guessing that you are issuing more than 100 separate updates/second. Could you please provide the full stack trace? If you reply to this email, your message will be added to the discussion below: http://lucene.472066.n3.nabble.com/SolrJ-IOException-tp4010026p4010082.html To unsubscribe from SolrJ - IOException, click here . NAML http://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewerid=instant_html%21nabble%3Aemail.namlbase=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespacebreadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml This message is private and confidential. If you have received it in error, please notify the sender and remove it from your system. image001.png (37K) http://lucene.472066.n3.nabble.com/attachment/4012130/0/image001.png -- View this message in context: http://lucene.472066.n3.nabble.com/SolrJ-IOException-tp4010026p4012130.html Sent from the Solr - User mailing list archive at Nabble.com. If you reply to this email, your message will be added to the discussion below: http://lucene.472066.n3.nabble.com/SolrJ-IOException-tp4010026p4012172.html To unsubscribe from SolrJ - IOException, click here http://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_codenode=4010026code=YmFsYWppLmdhbmRoaUBhcG9sbG9ncnAuZWR1fDQwMTAwMjZ8LTEwNzE2NTA1NDI= . NAML http://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewerid=instant_html%21nabble%3Aemail.namlbase=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespacebreadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml This message is private and confidential. If you have received it in error, please notify the sender and remove it from your system. -- View this message in context: http://lucene.472066.n3.nabble.com/SolrJ-IOException-tp4010026p4012176.html Sent from the Solr - User mailing list archive at Nabble.com.
RE: SolrJ - IOException
Sushil, we are trying to call the VIP in front of the SOLR nodes to distribute the update load. Also is EmbeddedSolrServer thread safe? Balaji Gandhi, Senior Software Developer, Horizontal Platform Services Product Engineering │ Apollo Group, Inc. 1225 W. Washington St. | AZ23 | Tempe, AZ 85281 Phone: 602.713.2417 | Email: balaji.gan...@apollogrp.edumailto:balaji.gan...@apollogrp.edu P Go Green. Don't Print. Moreover soft copies can be indexed by algorithms. From: Sushil jain [via Lucene] [mailto:ml-node+s472066n4012179...@n3.nabble.com] Sent: Friday, October 05, 2012 1:23 PM To: Balaji Gandhi Subject: Re: SolrJ - IOException Yes, I'd recommend EmbeddedSolrServer, because it doesn't require any web server for read/write/update/delete operations. On Sat, Oct 6, 2012 at 1:48 AM, balaji.gandhi [hidden email]/user/SendEmail.jtp?type=nodenode=4012179i=0wrote: Sushil, 30 TPS = 30 transactions (updates) per second. Is the recommendation to use EmbeddedSolrServer instead of HttpSolrServer? Thanks, Balaji Balaji Gandhi, Senior Software Developer, Horizontal Platform Services Product Engineering │ Apollo Group, Inc. 1225 W. Washington St. | AZ23 | Tempe, AZ 85281 Phone: 602.713.2417 | Email: [hidden email]/user/SendEmail.jtp?type=nodenode=4012179i=1mailto: [hidden email]/user/SendEmail.jtp?type=nodenode=4012179i=2 P Go Green. Don't Print. Moreover soft copies can be indexed by algorithms. From: Sushil jain [via Lucene] [mailto: [hidden email]/user/SendEmail.jtp?type=nodenode=4012179i=3] Sent: Friday, October 05, 2012 1:14 PM To: Balaji Gandhi Subject: Re: SolrJ - IOException Balaji, What is 30 TPS ? Toke, You should use EmbeddedSolrServer Instead. On Fri, Oct 5, 2012 at 11:42 PM, balaji.gandhi [hidden email]/user/SendEmail.jtp?type=nodenode=4012172i=0wrote: Hi Toke, Were you able to find anything on this issue? We are running at 30 TPS and using the default HttpSolrServer for the posts. [cid:image001.png@01CDA2EA.370A6ED0] Thanks, Balaji Balaji Gandhi, Senior Software Developer, Horizontal Platform Services Product Engineering │ Apollo Group, Inc. 1225 W. Washington St. | AZ23 | Tempe, AZ 85281 Phone: 602.713.2417 | Email: [hidden email]/user/SendEmail.jtp?type=nodenode=4012172i=1mailto: [hidden email]/user/SendEmail.jtp?type=nodenode=4012172i=2 P Go Green. Don't Print. Moreover soft copies can be indexed by algorithms. From: Toke Eskildsen [via Lucene] [mailto: [hidden email]/user/SendEmail.jtp?type=nodenode=4012172i=3] Sent: Tuesday, September 25, 2012 12:19 AM To: Balaji Gandhi Subject: Re: SolrJ - IOException On Tue, 2012-09-25 at 01:50 +0200, balaji.gandhi wrote: I am encountering this error randomly (under load) when posting to Solr using SolrJ. Has anyone encountered a similar error? org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://localhost:8080/solr/profile at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:414) [...] This looks suspiciously like a potential bug in the HTTP keep-alive flow that we encountered some weeks ago. I am guessing that you are issuing more than 100 separate updates/second. Could you please provide the full stack trace? If you reply to this email, your message will be added to the discussion below: http://lucene.472066.n3.nabble.com/SolrJ-IOException-tp4010026p4010082.html To unsubscribe from SolrJ - IOException, click here . NAML http://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewerid=instant_html%21nabble%3Aemail.namlbase=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespacebreadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml This message is private and confidential. If you have received it in error, please notify the sender and remove it from your system. image001.png (37K) http://lucene.472066.n3.nabble.com/attachment/4012130/0/image001.png -- View this message in context: http://lucene.472066.n3.nabble.com/SolrJ-IOException-tp4010026p4012130.html Sent from the Solr - User mailing list archive at Nabble.com. If you reply to this email, your message will be added to the discussion below: http://lucene.472066.n3.nabble.com/SolrJ-IOException-tp4010026p4012172.html To unsubscribe from SolrJ - IOException, click here . NAML http://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewerid=instant_html%21nabble%3Aemail.namlbase=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespacebreadcrumbs=notify_subscribers%21nabble
Re: SolrJ - IOException
If you need to use solr in an embedded application, this is the recommended approach. It allows you to work with the same interface whether or not you have access to HTTP. And it is not thread safe. On Sat, Oct 6, 2012 at 1:58 AM, balaji.gandhi balaji.gan...@apollogrp.eduwrote: Sushil, we are trying to call the VIP in front of the SOLR nodes to distribute the update load. Also is EmbeddedSolrServer thread safe? Balaji Gandhi, Senior Software Developer, Horizontal Platform Services Product Engineering │ Apollo Group, Inc. 1225 W. Washington St. | AZ23 | Tempe, AZ 85281 Phone: 602.713.2417 | Email: balaji.gan...@apollogrp.edumailto: balaji.gan...@apollogrp.edu P Go Green. Don't Print. Moreover soft copies can be indexed by algorithms. From: Sushil jain [via Lucene] [mailto: ml-node+s472066n4012179...@n3.nabble.com] Sent: Friday, October 05, 2012 1:23 PM To: Balaji Gandhi Subject: Re: SolrJ - IOException Yes, I'd recommend EmbeddedSolrServer, because it doesn't require any web server for read/write/update/delete operations. On Sat, Oct 6, 2012 at 1:48 AM, balaji.gandhi [hidden email]/user/SendEmail.jtp?type=nodenode=4012179i=0wrote: Sushil, 30 TPS = 30 transactions (updates) per second. Is the recommendation to use EmbeddedSolrServer instead of HttpSolrServer? Thanks, Balaji Balaji Gandhi, Senior Software Developer, Horizontal Platform Services Product Engineering │ Apollo Group, Inc. 1225 W. Washington St. | AZ23 | Tempe, AZ 85281 Phone: 602.713.2417 | Email: [hidden email]/user/SendEmail.jtp?type=nodenode=4012179i=1mailto: [hidden email]/user/SendEmail.jtp?type=nodenode=4012179i=2 P Go Green. Don't Print. Moreover soft copies can be indexed by algorithms. From: Sushil jain [via Lucene] [mailto: [hidden email]/user/SendEmail.jtp?type=nodenode=4012179i=3] Sent: Friday, October 05, 2012 1:14 PM To: Balaji Gandhi Subject: Re: SolrJ - IOException Balaji, What is 30 TPS ? Toke, You should use EmbeddedSolrServer Instead. On Fri, Oct 5, 2012 at 11:42 PM, balaji.gandhi [hidden email]/user/SendEmail.jtp?type=nodenode=4012172i=0wrote: Hi Toke, Were you able to find anything on this issue? We are running at 30 TPS and using the default HttpSolrServer for the posts. [cid:image001.png@01CDA2EA.370A6ED0] Thanks, Balaji Balaji Gandhi, Senior Software Developer, Horizontal Platform Services Product Engineering │ Apollo Group, Inc. 1225 W. Washington St. | AZ23 | Tempe, AZ 85281 Phone: 602.713.2417 | Email: [hidden email]/user/SendEmail.jtp?type=nodenode=4012172i=1mailto: [hidden email]/user/SendEmail.jtp?type=nodenode=4012172i=2 P Go Green. Don't Print. Moreover soft copies can be indexed by algorithms. From: Toke Eskildsen [via Lucene] [mailto: [hidden email]/user/SendEmail.jtp?type=nodenode=4012172i=3] Sent: Tuesday, September 25, 2012 12:19 AM To: Balaji Gandhi Subject: Re: SolrJ - IOException On Tue, 2012-09-25 at 01:50 +0200, balaji.gandhi wrote: I am encountering this error randomly (under load) when posting to Solr using SolrJ. Has anyone encountered a similar error? org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://localhost:8080/solr/profile at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:414) [...] This looks suspiciously like a potential bug in the HTTP keep-alive flow that we encountered some weeks ago. I am guessing that you are issuing more than 100 separate updates/second. Could you please provide the full stack trace? If you reply to this email, your message will be added to the discussion below: http://lucene.472066.n3.nabble.com/SolrJ-IOException-tp4010026p4010082.html To unsubscribe from SolrJ - IOException, click here . NAML http://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewerid=instant_html%21nabble%3Aemail.namlbase=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespacebreadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml This message is private and confidential. If you have received it in error, please notify the sender and remove it from your system. image001.png (37K) http://lucene.472066.n3.nabble.com/attachment/4012130/0/image001.png -- View this message in context: http://lucene.472066.n3.nabble.com/SolrJ-IOException-tp4010026p4012130.html Sent from the Solr - User mailing list archive at Nabble.com. If you reply to this email, your message will be added to the discussion below
Re: SolrJ - IOException
Well, using embedded Solr isn't necessarily indicated. I have a couple of questions. 1 you say 30 tps. Are you sending a single doc at a time or batching them up? I.e. server.add(doclist) or server.add(doc)? 2 Http isn't actually an inefficient protocol, I think the whole idea of using embedded Solr is a red herring if that's the concern. 3 bq: call the VIP in front of the SOLR nodes to distribute the update load What does that mean? Only one process should be writing to an index at a time. So there should be only one address to which all the updates go. The servlet container will stack up multiple incoming requests. So I totally don't understand what you're trying to accomplish here. 4 You haven't told us what version of Solr you're using, so the stack trace isn't all that helpful. We can pick random Solr versions and hope they match the line numbers, but that's not too efficient. 5 Have you thought about just putting some fallback logic in your SolrJ program and having it sleep for a few seconds and retrying? Best Erick On Fri, Oct 5, 2012 at 4:35 PM, Sushil jain jain.ayushm...@gmail.com wrote: If you need to use solr in an embedded application, this is the recommended approach. It allows you to work with the same interface whether or not you have access to HTTP. And it is not thread safe. On Sat, Oct 6, 2012 at 1:58 AM, balaji.gandhi balaji.gan...@apollogrp.eduwrote: Sushil, we are trying to call the VIP in front of the SOLR nodes to distribute the update load. Also is EmbeddedSolrServer thread safe? Balaji Gandhi, Senior Software Developer, Horizontal Platform Services Product Engineering │ Apollo Group, Inc. 1225 W. Washington St. | AZ23 | Tempe, AZ 85281 Phone: 602.713.2417 | Email: balaji.gan...@apollogrp.edumailto: balaji.gan...@apollogrp.edu P Go Green. Don't Print. Moreover soft copies can be indexed by algorithms. From: Sushil jain [via Lucene] [mailto: ml-node+s472066n4012179...@n3.nabble.com] Sent: Friday, October 05, 2012 1:23 PM To: Balaji Gandhi Subject: Re: SolrJ - IOException Yes, I'd recommend EmbeddedSolrServer, because it doesn't require any web server for read/write/update/delete operations. On Sat, Oct 6, 2012 at 1:48 AM, balaji.gandhi [hidden email]/user/SendEmail.jtp?type=nodenode=4012179i=0wrote: Sushil, 30 TPS = 30 transactions (updates) per second. Is the recommendation to use EmbeddedSolrServer instead of HttpSolrServer? Thanks, Balaji Balaji Gandhi, Senior Software Developer, Horizontal Platform Services Product Engineering │ Apollo Group, Inc. 1225 W. Washington St. | AZ23 | Tempe, AZ 85281 Phone: 602.713.2417 | Email: [hidden email]/user/SendEmail.jtp?type=nodenode=4012179i=1mailto: [hidden email]/user/SendEmail.jtp?type=nodenode=4012179i=2 P Go Green. Don't Print. Moreover soft copies can be indexed by algorithms. From: Sushil jain [via Lucene] [mailto: [hidden email]/user/SendEmail.jtp?type=nodenode=4012179i=3] Sent: Friday, October 05, 2012 1:14 PM To: Balaji Gandhi Subject: Re: SolrJ - IOException Balaji, What is 30 TPS ? Toke, You should use EmbeddedSolrServer Instead. On Fri, Oct 5, 2012 at 11:42 PM, balaji.gandhi [hidden email]/user/SendEmail.jtp?type=nodenode=4012172i=0wrote: Hi Toke, Were you able to find anything on this issue? We are running at 30 TPS and using the default HttpSolrServer for the posts. [cid:image001.png@01CDA2EA.370A6ED0] Thanks, Balaji Balaji Gandhi, Senior Software Developer, Horizontal Platform Services Product Engineering │ Apollo Group, Inc. 1225 W. Washington St. | AZ23 | Tempe, AZ 85281 Phone: 602.713.2417 | Email: [hidden email]/user/SendEmail.jtp?type=nodenode=4012172i=1mailto: [hidden email]/user/SendEmail.jtp?type=nodenode=4012172i=2 P Go Green. Don't Print. Moreover soft copies can be indexed by algorithms. From: Toke Eskildsen [via Lucene] [mailto: [hidden email]/user/SendEmail.jtp?type=nodenode=4012172i=3] Sent: Tuesday, September 25, 2012 12:19 AM To: Balaji Gandhi Subject: Re: SolrJ - IOException On Tue, 2012-09-25 at 01:50 +0200, balaji.gandhi wrote: I am encountering this error randomly (under load) when posting to Solr using SolrJ. Has anyone encountered a similar error? org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://localhost:8080/solr/profile at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:414) [...] This looks suspiciously like a potential bug in the HTTP keep-alive flow that we encountered some weeks ago. I am guessing that you are issuing more than 100 separate updates/second. Could you please provide the full stack trace? If you reply to this email, your message will be added to the discussion below
RE: SolrJ - IOException
Hi Toke, We encountered this issue again. This time the SOLR servers were stalled. We are at 30 TPS. Please let us know any updates in the HTTP issue. Thanks, Balaji Balaji Gandhi, Senior Software Developer, Horizontal Platform Services Product Engineering │ Apollo Group, Inc. 1225 W. Washington St. | AZ23 | Tempe, AZ 85281 Phone: 602.713.2417 | Email: balaji.gan...@apollogrp.edumailto:balaji.gan...@apollogrp.edu P Go Green. Don't Print. Moreover soft copies can be indexed by algorithms. From: Balaji Gandhi Sent: Thursday, September 27, 2012 10:52 AM To: 'Toke Eskildsen [via Lucene]' Subject: RE: SolrJ - IOException Here is the stack trace:- org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server: org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:414) at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:182) at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117) at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:122) at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:107) at org.apache.solr.handler.dataimport.thread.task.SolrUploadTask.upload(SolrUploadTask.java:31) at org.apache.solr.handler.dataimport.thread.SolrUploader.run(SolrUploader.java:31) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source) at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.NoHttpResponseException: The target server failed to respond at org.apache.http.impl.conn.DefaultResponseParser.parseHead(DefaultResponseParser.java:101) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:252) at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:282) at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:247) at org.apache.http.impl.conn.AbstractClientConnAdapter.receiveResponseHeader(AbstractClientConnAdapter.java:216) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:298) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125) at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:647) at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:464) at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:820) at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:754) at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:732) at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:353) ... 9 more Balaji Gandhi, Senior Software Developer, Horizontal Platform Services Product Engineering │ Apollo Group, Inc. 1225 W. Washington St. | AZ23 | Tempe, AZ 85281 Phone: 602.713.2417 | Email: balaji.gan...@apollogrp.edumailto:balaji.gan...@apollogrp.edu P Go Green. Don't Print. Moreover soft copies can be indexed by algorithms. From: Toke Eskildsen [via Lucene] [mailto:ml-node+s472066n4010082...@n3.nabble.com] Sent: Tuesday, September 25, 2012 12:19 AM To: Balaji Gandhi Subject: Re: SolrJ - IOException On Tue, 2012-09-25 at 01:50 +0200, balaji.gandhi wrote: I am encountering this error randomly (under load) when posting to Solr using SolrJ. Has anyone encountered a similar error? org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://localhost:8080/solr/profile at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:414) [...] This looks suspiciously like a potential bug in the HTTP keep-alive flow that we encountered some weeks ago. I am guessing that you are issuing more than 100 separate updates/second. Could you please provide the full stack trace? If you reply to this email, your message will be added to the discussion below: http://lucene.472066.n3.nabble.com/SolrJ-IOException-tp4010026p4010082.html To unsubscribe from SolrJ - IOException, click herehttp://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_codenode=4010026code=YmFsYWppLmdhbmRoaUBhcG9sbG9ncnAuZWR1fDQwMTAwMjZ8LTEwNzE2NTA1NDI=. NAMLhttp://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewerid=instant_html%21nabble%3Aemail.namlbase=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespacebreadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml This message is private and confidential. If you have received it in error, please notify the sender
Re: SolrJ - IOException
Was it stalled due to gc pause? Sent from my iPhone On Oct 2, 2012, at 10:02 AM, balaji.gandhi balaji.gan...@apollogrp.edu wrote: Hi Toke, We encountered this issue again. This time the SOLR servers were stalled. We are at 30 TPS. Please let us know any updates in the HTTP issue. Thanks, Balaji Balaji Gandhi, Senior Software Developer, Horizontal Platform Services Product Engineering │ Apollo Group, Inc. 1225 W. Washington St. | AZ23 | Tempe, AZ 85281 Phone: 602.713.2417 | Email: balaji.gan...@apollogrp.edumailto:balaji.gan...@apollogrp.edu P Go Green. Don't Print. Moreover soft copies can be indexed by algorithms. From: Balaji Gandhi Sent: Thursday, September 27, 2012 10:52 AM To: 'Toke Eskildsen [via Lucene]' Subject: RE: SolrJ - IOException Here is the stack trace:- org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server: org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:414) at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:182) at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117) at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:122) at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:107) at org.apache.solr.handler.dataimport.thread.task.SolrUploadTask.upload(SolrUploadTask.java:31) at org.apache.solr.handler.dataimport.thread.SolrUploader.run(SolrUploader.java:31) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source) at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.NoHttpResponseException: The target server failed to respond at org.apache.http.impl.conn.DefaultResponseParser.parseHead(DefaultResponseParser.java:101) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:252) at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:282) at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:247) at org.apache.http.impl.conn.AbstractClientConnAdapter.receiveResponseHeader(AbstractClientConnAdapter.java:216) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:298) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125) at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:647) at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:464) at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:820) at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:754) at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:732) at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:353) ... 9 more Balaji Gandhi, Senior Software Developer, Horizontal Platform Services Product Engineering │ Apollo Group, Inc. 1225 W. Washington St. | AZ23 | Tempe, AZ 85281 Phone: 602.713.2417 | Email: balaji.gan...@apollogrp.edumailto:balaji.gan...@apollogrp.edu P Go Green. Don't Print. Moreover soft copies can be indexed by algorithms. From: Toke Eskildsen [via Lucene] [mailto:ml-node+s472066n4010082...@n3.nabble.com] Sent: Tuesday, September 25, 2012 12:19 AM To: Balaji Gandhi Subject: Re: SolrJ - IOException On Tue, 2012-09-25 at 01:50 +0200, balaji.gandhi wrote: I am encountering this error randomly (under load) when posting to Solr using SolrJ. Has anyone encountered a similar error? org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://localhost:8080/solr/profile at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:414) [...] This looks suspiciously like a potential bug in the HTTP keep-alive flow that we encountered some weeks ago. I am guessing that you are issuing more than 100 separate updates/second. Could you please provide the full stack trace? If you reply to this email, your message will be added to the discussion below: http://lucene.472066.n3.nabble.com/SolrJ-IOException-tp4010026p4010082.html To unsubscribe from SolrJ - IOException, click herehttp://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_codenode=4010026code=YmFsYWppLmdhbmRoaUBhcG9sbG9ncnAuZWR1fDQwMTAwMjZ8LTEwNzE2NTA1NDI=. NAMLhttp://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewerid=instant_html%21nabble%3Aemail.namlbase=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespacebreadcrumbs=notify_subscribers%21nabble
RE: SolrJ - IOException
Thanks for your reply. SOLR Server is not stalled. Just the add fails with this exception. Balaji Gandhi, Senior Software Developer, Horizontal Platform Services Product Engineering │ Apollo Group, Inc. 1225 W. Washington St. | AZ23 | Tempe, AZ 85281 Phone: 602.713.2417 | Email: balaji.gan...@apollogrp.edumailto:balaji.gan...@apollogrp.edu P Go Green. Don't Print. Moreover soft copies can be indexed by algorithms. From: roz dev [via Lucene] [mailto:ml-node+s472066n4010037...@n3.nabble.com] Sent: Monday, September 24, 2012 5:46 PM To: Balaji Gandhi Subject: Re: SolrJ - IOException I have seen this happening We retry and that works. Is your solr server stalled? On Mon, Sep 24, 2012 at 4:50 PM, balaji.gandhi [hidden email]/user/SendEmail.jtp?type=nodenode=4010037i=0wrote: Hi, I am encountering this error randomly (under load) when posting to Solr using SolrJ. Has anyone encountered a similar error? org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://localhost:8080/solr/profile at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:414) at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:182) at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117) at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:122) at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:107) at Thanks, Balaji -- View this message in context: http://lucene.472066.n3.nabble.com/SolrJ-IOException-tp4010026.html Sent from the Solr - User mailing list archive at Nabble.com. If you reply to this email, your message will be added to the discussion below: http://lucene.472066.n3.nabble.com/SolrJ-IOException-tp4010026p4010037.html To unsubscribe from SolrJ - IOException, click herehttp://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_codenode=4010026code=YmFsYWppLmdhbmRoaUBhcG9sbG9ncnAuZWR1fDQwMTAwMjZ8LTEwNzE2NTA1NDI=. NAMLhttp://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewerid=instant_html%21nabble%3Aemail.namlbase=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespacebreadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml This message is private and confidential. If you have received it in error, please notify the sender and remove it from your system. -- View this message in context: http://lucene.472066.n3.nabble.com/SolrJ-IOException-tp4010026p4010795.html Sent from the Solr - User mailing list archive at Nabble.com.
RE: SolrJ - IOException
Here is the stack trace:- org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server: org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:414) at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:182) at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117) at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:122) at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:107) at org.apache.solr.handler.dataimport.thread.task.SolrUploadTask.upload(SolrUploadTask.java:31) at org.apache.solr.handler.dataimport.thread.SolrUploader.run(SolrUploader.java:31) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source) at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.lang.Thread.run(Unknown Source) Caused by: org.apache.http.NoHttpResponseException: The target server failed to respond at org.apache.http.impl.conn.DefaultResponseParser.parseHead(DefaultResponseParser.java:101) at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:252) at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:282) at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:247) at org.apache.http.impl.conn.AbstractClientConnAdapter.receiveResponseHeader(AbstractClientConnAdapter.java:216) at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:298) at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125) at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:647) at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:464) at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:820) at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:754) at org.apache.http.impl.client.AbstractHttpClient.execute(AbstractHttpClient.java:732) at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:353) ... 9 more Balaji Gandhi, Senior Software Developer, Horizontal Platform Services Product Engineering │ Apollo Group, Inc. 1225 W. Washington St. | AZ23 | Tempe, AZ 85281 Phone: 602.713.2417 | Email: balaji.gan...@apollogrp.edumailto:balaji.gan...@apollogrp.edu P Go Green. Don't Print. Moreover soft copies can be indexed by algorithms. From: Toke Eskildsen [via Lucene] [mailto:ml-node+s472066n4010082...@n3.nabble.com] Sent: Tuesday, September 25, 2012 12:19 AM To: Balaji Gandhi Subject: Re: SolrJ - IOException On Tue, 2012-09-25 at 01:50 +0200, balaji.gandhi wrote: I am encountering this error randomly (under load) when posting to Solr using SolrJ. Has anyone encountered a similar error? org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://localhost:8080/solr/profile at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:414) [...] This looks suspiciously like a potential bug in the HTTP keep-alive flow that we encountered some weeks ago. I am guessing that you are issuing more than 100 separate updates/second. Could you please provide the full stack trace? If you reply to this email, your message will be added to the discussion below: http://lucene.472066.n3.nabble.com/SolrJ-IOException-tp4010026p4010082.html To unsubscribe from SolrJ - IOException, click herehttp://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_codenode=4010026code=YmFsYWppLmdhbmRoaUBhcG9sbG9ncnAuZWR1fDQwMTAwMjZ8LTEwNzE2NTA1NDI=. NAMLhttp://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=macro_viewerid=instant_html%21nabble%3Aemail.namlbase=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespacebreadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml This message is private and confidential. If you have received it in error, please notify the sender and remove it from your system. -- View this message in context: http://lucene.472066.n3.nabble.com/SolrJ-IOException-tp4010026p4010796.html Sent from the Solr - User mailing list archive at Nabble.com.
Re: SolrJ - IOException
On Tue, 2012-09-25 at 01:50 +0200, balaji.gandhi wrote: I am encountering this error randomly (under load) when posting to Solr using SolrJ. Has anyone encountered a similar error? org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://localhost:8080/solr/profile at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:414) [...] This looks suspiciously like a potential bug in the HTTP keep-alive flow that we encountered some weeks ago. I am guessing that you are issuing more than 100 separate updates/second. Could you please provide the full stack trace?
Re: SolrJ - IOException
I have seen this happening We retry and that works. Is your solr server stalled? On Mon, Sep 24, 2012 at 4:50 PM, balaji.gandhi balaji.gan...@apollogrp.eduwrote: Hi, I am encountering this error randomly (under load) when posting to Solr using SolrJ. Has anyone encountered a similar error? org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://localhost:8080/solr/profile at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:414) at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:182) at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:117) at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:122) at org.apache.solr.client.solrj.SolrServer.add(SolrServer.java:107) at Thanks, Balaji -- View this message in context: http://lucene.472066.n3.nabble.com/SolrJ-IOException-tp4010026.html Sent from the Solr - User mailing list archive at Nabble.com.
