Hi Mahmoud, I apologize for the late response here, but I also encountered
this same error a while ago when upgrading an arches database to Arches 5.
I was also concerned about just changing the maximum number of buckets, but
did do it just as you have and everything has run fine since then, though
frankly I couldn't know if performance is affected because it never worked
before the change...
I've had a look back at the original error messages I encountered, and it's
interesting that I had the same amount of buckets as you, 15,011. One thing
that Rob suggested to me was looking at the "Search Results Grid" in System
Settings UI or at the TIMEWHEEL_DATE_TIERS in settings.py, or perhaps the
"Hexagon Grid Precision". So, some of those settings may reduce the number
of buckets, but I don't think I looked very deeply into them.
As these are aggregation buckets of some kind, I would guess that the
number of resources doesn't really have anything to do with it, per se.
Interested to know if you have found anything new related to this issue. We
should probably put a note in it ES installation docs.
Adam
On Fri, Jun 19, 2020 at 11:59 AM Alina Myklebust <amykleb...@getty.edu>
wrote:
> Hi Mahmoud,
>
> Have you noticed a negative impact on performance since you edited the
> configuration file? Let us know how that's working for you. Thanks!
>
> Best,
>
> Alina
>
>
> On Monday, June 15, 2020 at 4:12:45 AM UTC-7, Mahmoud Abdelrazek wrote:
>>
>> Hi everyone,
>>
>> I have had an issue with an elasticsearch error when loading the main
>> search page. The error is as follows:
>>
>> TransportError at /search/resources TransportError(503,
>> 'search_phase_execution_exception', 'Trying to create too many buckets.
>> Must be less than or equal to: [10000] but was [15011]. This limit can be
>> set by changing the [search.max_buckets] cluster level setting.')
>>
>> We have uploaded more than 10k entries to one of the resource models
>> which seems to be the reason for this error. I did a quick search and found
>> that the following command would raise the max buckets limit to 20k which
>> solved the problem.
>>
>> curl -XPUT 127.0.0.1:9200/_cluster/settings -H 'Content-Type:
>> application/json' -d '{
>> "transient" : {
>> "search.max_buckets": 20000
>> }
>> }'
>>
>> However, when the server restarted, elasticsearch ran into the same error
>> again. This time I edited the configuration file by adding the following
>> line
>>
>> search.max_buckets: 20000
>>
>> It seems to work fine for now but I am concerned that raising this limit
>> might have a negative impact on the performance. Arches handles the
>> requests to elasticsearch automatically, so I am not sure how much is this
>> relevant.
>>
>> Did anyone run into the same issue? Any better solutions? and do you
>> think this will have an impact on the performance?
>>
>> Thank you,
>> Mahmoud
>>
> --
> -- To post, send email to archesproject@googlegroups.com. To unsubscribe,
> send email to archesproject+unsubscr...@googlegroups.com. For more
> information, visit https://groups.google.com/d/forum/archesproject?hl=en
> ---
> You received this message because you are subscribed to the Google Groups
> "Arches Project" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to archesproject+unsubscr...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/archesproject/e94e8783-e166-4d94-81df-b4f7c5621ab8o%40googlegroups.com
> <https://groups.google.com/d/msgid/archesproject/e94e8783-e166-4d94-81df-b4f7c5621ab8o%40googlegroups.com?utm_medium=email&utm_source=footer>
> .
>
--
-- To post, send email to archesproject@googlegroups.com. To unsubscribe, send
email to archesproject+unsubscr...@googlegroups.com. For more information,
visit https://groups.google.com/d/forum/archesproject?hl=en
---
You received this message because you are subscribed to the Google Groups
"Arches Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to archesproject+unsubscr...@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/archesproject/CAGYBTatvJwsNHpdK-ru7b1f6LERZwy1BsKUXYevALSWf9qx2Pw%40mail.gmail.com.
