I did only test it with 1 and with 10 shards, indeed with 1 shard it did
not have any issues, with 10 shards it has issues all the time.
I also had a colleague testing it with the two scripts in the gist (which
uses 10 shards).
Also I do not think the analyzer _should_ have impact, since it would only
index more terms on that field if it tokenizes it. Can you use the
aggsbug.load.sh to load the data? And than use aggsbug.test.sh to run the
test? It should give you a field analyzed with the default analyzer and 10
shards.
I'll try out some different analyzers, and loading the data in 3 shards now
to see if that changes things.
On Wednesday, February 5, 2014 4:02:54 PM UTC+1, Jörg Prante wrote:
>
> Also the same with shards = 3 and analyzer = standard. Stable results.
>
> {
> "took" : 240,
> "timed_out" : false,
> "_shards" : {
> "total" : 3,
> "successful" : 3,
> "failed" : 0
> },
> "hits" : {
> "total" : 1060387,
> "max_score" : 0.0,
> "hits" : [ ]
> },
> "aggregations" : {
> "a" : {
> "buckets" : [ {
> "key" : "totaltrafficbos",
> "doc_count" : 3599
> }, {
> "key" : "mai93thm",
> "doc_count" : 2517
> }, {
> "key" : "mai90thm",
> "doc_count" : 2207
> }, {
> "key" : "mai95thm",
> "doc_count" : 2207
> }, {
> "key" : "totaltrafficnyc",
> "doc_count" : 1660
> }, {
> "key" : "confessions",
> "doc_count" : 1534
> }, {
> "key" : "incidentreports",
> "doc_count" : 1468
> }, {
> "key" : "nji80thm",
> "doc_count" : 1180
> }, {
> "key" : "pai76thm",
> "doc_count" : 1142
> }, {
> "key" : "txi35thm",
> "doc_count" : 379
> } ]
> }
> }
> }
>
> You should examine your log files if your ES cluster was able to process
> all the docs correctly while indexing or searching, maybe you encountered
> OOMs or other subtle issues.
>
> Jörg
>
>
>
--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/7c74c649-8a4a-46c5-aaec-b6f3254cc0d9%40googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.
