Re: EsRejectedExecutionException: rejected execution (queue capacity 1000)

2014-11-02 Thread spancer ray
Hi James, Have you fixed it? -- View this message in context: http://elasticsearch-users.115913.n3.nabble.com/EsRejectedExecutionException-rejected-execution-queue-capacity-1000-tp4061509p4065613.html Sent from the ElasticSearch Users mailing list archive at Nabble.com. -- You received

Re: EsRejectedExecutionException: rejected execution (queue capacity 1000)

2014-11-02 Thread Jason Wee
unbounded queue for threadpool, isn't changes such as unbounded will exhaust system resources? It could either exhaust system resources due to each thread use specific amount of system resources, thus render the system not stable or if the system has file descriptor set, probably via ulimit,

Re: EsRejectedExecutionException: rejected execution (queue capacity 1000)

2014-08-18 Thread Sávio S . Teles de Oliveira
You can put *threadpool.search.type: **cached* on elasticsearch.yml for unbounded queue for reads. 2014-08-10 9:52 GMT-03:00 James digital...@gmail.com: On Sat, 2014-08-09 at 23:53 -0700, Deep wrote: Hi, Elastic search internally has thread pool and a queue size is associated with

Re: EsRejectedExecutionException: rejected execution (queue capacity 1000)

2014-08-10 Thread Deep
Hi, Elastic search internally has thread pool and a queue size is associated with each pool. You can have pools for search threads, index threads etc. Please see the elastic search documentation in link

Re: EsRejectedExecutionException: rejected execution (queue capacity 1000)

2014-08-10 Thread James
On Sat, 2014-08-09 at 23:53 -0700, Deep wrote: Hi, Elastic search internally has thread pool and a queue size is associated with each pool. You can have pools for search threads, index threads etc. Please see the elastic search documentation in link

EsRejectedExecutionException: rejected execution (queue capacity 1000)

2014-08-08 Thread digitalx00
So I've seen a few posts on this, but I've not seen any solutions posted. I've been log monitoring and I was trying to determine how to fix the below...any information would be great thank you. [2014-08-08 19:14:12,578][DEBUG][action.search.type ] [Jericho Drumm] [bro-201408032100][2],

Re: EsRejectedExecutionException

2014-08-01 Thread Ivan Brusic
Your stack trace indicates that your search pool was exhausted, not your admin action thread pool. I don't think that restarting servers will cause searches to execute, but hopefully someone else would chime in and correct me. Do you have that many searches going on? -- Ivan On Fri, Aug 1,

EsRejectedExecutionException

2014-07-31 Thread Anand kumar
Hi All, In my cluster, I'm having around 500 indices. When i'm trying to start the elasticsearch instance, its showing the following exception. Why its happening, what should be done to resolve it? Thanks, Anand [2014-07-31 11:50:01,551][DEBUG][action.search.type ] [ESCS_NODE]

Re: EsRejectedExecutionException

2014-07-31 Thread Ivan Brusic
The thread pool will reject any search requests when there are 1000 actions already queued. http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/modules-threadpool.html Do you have this many search requests at one time? Do you have warmers and/or percolators running since you

Re: EsRejectedExecutionException[rejected execution (queue capacity 50)

2014-05-30 Thread srikanth ramineni
Hi , I am getting below es rejection exception. problem updating content indexing for entity: 85539735340578996965234585294218135410438591031260132420 error: EsRejectedExecutionException[rejected execution (queue capacity 50

Re: EsRejectedExecutionException[rejected execution (queue capacity 50)

2014-05-30 Thread Ivan Brusic
wrote: Hi , I am getting below es rejection exception. problem updating content indexing for entity: 85539735340578996965234585294218135410438591031260132420 error: EsRejectedExecutionException[rejected execution (queue capacity 50

Re: EsRejectedExecutionException[rejected execution (queue capacity 50)

2014-05-05 Thread Hui
why we can get EsRejectedExecutionException? This doesn't frequently in indexing process. We did try by setting with few thousand size but this exception comes but rarely. After setting bulk queue to -1 it appears to be working. -1 means unbounded size so is it safe to set to -1. Thanks

Re: EsRejectedExecutionException[rejected execution (queue capacity 50)

2014-04-28 Thread Le Thanh Nguyen
pointers why we can get EsRejectedExecutionException? This doesn't frequently in indexing process. We did try by setting with few thousand size but this exception comes but rarely. After setting bulk queue to -1 it appears to be working. -1 means unbounded size so is it safe to set to -1

Re: ESRejectedExecutionException

2014-04-03 Thread Pandiyan Arumugam
Hi Binh, Thanks for your reply.I am setting for *threadpool.bulk.queue_size: 300* in elasticsearch.yml it's okay. On Thursday, March 27, 2014 6:00:42 PM UTC+5:30, Binh Ly wrote: The bulk thread pool has a cap on the queue size which is 50 (threadpool.bulk.queue_size). Once you reach

Re: ESRejectedExecutionException

2014-04-03 Thread Pandiyan Arumugam
On Thursday, March 27, 2014 11:23:52 AM UTC+5:30, Pandiyan Arumugam wrote: Hi, I have 5 million records in database i create the index through BulkRequestBuilder every 10,000 records pushing to elasticsearch But while sometimes getting *ESRejectedExecutionException* ES_MIN=2gb

ESRejectedExecutionException

2014-04-02 Thread Pandiyan
could be finished, sometimes it cound't, because there are many EsRejectedExecutionException exceptions in ES log file. Thread pool configuration :: # use routing concept in elasticserach-java-api. based on this entry 0 to n-1 index.number_of_shards: 4 index.number_of_replicas: 1 #Compress

Re: ESRejectedExecutionException

2014-04-02 Thread joergpra...@gmail.com
there are many EsRejectedExecutionException exceptions in ES log file. Thread pool configuration :: # use routing concept in elasticserach-java-api. based on this entry 0 to n-1 index.number_of_shards: 4 index.number_of_replicas: 1 #Compress the data index.store.compress.stored: true

Re: ESRejectedExecutionException

2014-03-27 Thread Binh Ly
The bulk thread pool has a cap on the queue size which is 50 (threadpool.bulk.queue_size). Once you reach that cap, you will start getting the rejected exceptions. That is there for a reason so that the thread pool does not get out of control. You can try to increase the queue size slightly

Re: EsRejectedExecutionException[rejected execution (queue capacity 50)

2014-03-06 Thread Klavs Klavsen
did you resolve this issue?.. we seem top have the same issue - also with 0.90.9 -- You received this message because you are subscribed to the Google Groups elasticsearch group. To unsubscribe from this group and stop receiving emails from it, send an email to

Re: Queue capacity and EsRejectedExecutionException leads to loss of data

2014-02-26 Thread Thomas
and adding them to ES. The thing is that at some point we are receiving the following exception and we have as a result to *lose data*. [1775]: index [events-idx], type [click], id [3f6e4604146b435aabcf4ea5a493fd32], message [EsRejectedExecutionException[rejected execution (queue capacity 50

Re: Queue capacity and EsRejectedExecutionException leads to loss of data

2014-02-26 Thread David Pilato
the following exception and we have as a result to lose data. [1775]: index [events-idx], type [click], id [3f6e4604146b435aabcf4ea5a493fd32], message [EsRejectedExecutionException[rejected execution (queue capacity 50

Re: EsRejectedExecutionException when searching date based indices.

2014-02-26 Thread Alex Clark
nodes. I have recently upgraded to ES 1.0. When I search for all messages in a year (either using an alias or specifying “messages_2013*”), I get many failed nodes. The reason given is: “EsRejectedExecutionException[rejected execution (queue capacity 1000

Re: EsRejectedExecutionException when searching date based indices.

2014-02-26 Thread joergpra...@gmail.com
I think you have a misconception about shard over-allocation and re-indexing, so you should read https://groups.google.com/d/msg/elasticsearch/49q-_AgQCp8/MRol0t9asEcJ where kimchy explains how over-allocation of shards work. If you have time-series indexes, you need not 20 shards per day, just

EsRejectedExecutionException when searching date based indices.

2014-02-25 Thread Alex Clark
. The reason given is: “EsRejectedExecutionException[rejected execution (queue capacity 1000) on org.elasticsearch.action.search.type.TransportSearchTypeAction$BaseAsyncAction$4@651b8924]”). The more often I search, the fewer failed nodes I get (probably caching in ES) but I can’t get down

Re: EsRejectedExecutionException when searching date based indices.

2014-02-25 Thread David Pilato
messages in a year (either using an alias or specifying “messages_2013*”), I get many failed nodes. The reason given is: “EsRejectedExecutionException[rejected execution (queue capacity 1000) on org.elasticsearch.action.search.type.TransportSearchTypeAction$BaseAsyncAction$4@651b8924]”). The more

Re: EsRejectedExecutionException[rejected execution (queue capacity 50)

2014-02-03 Thread joergpra...@gmail.com
bulk API. Any pointers why we can get EsRejectedExecutionException? This doesn't frequently in indexing process. We did try by setting with few thousand size but this exception comes but rarely. After setting bulk queue to -1 it appears to be working. -1 means unbounded size so is it safe

EsRejectedExecutionException[rejected execution (queue capacity 50)

2014-01-30 Thread Ramchandra Phadake
Hi, Recently we migrated from 0.90.1 to 0.90.9. We did change index.codec.bloom.load=false initially but even with true we obsetve same behaviour. Nothing else has changed from indexing code. We are using bulk API. Any pointers why we can get EsRejectedExecutionException? This doesn't