arjansh commented on issue #229: Upgrade to Elasticsearch 7.3.1
URL: https://github.com/apache/metamodel/pull/229#issuecomment-543535205
 
 
   When doing lots of updates (more than 500) in a short period of time (less 
than 60 seconds), Elasticsearch will fail with this message: "Trying to create 
too many scroll contexts. Must be less than or equal to: [500]". This is caused 
by the fact that in the DeleteAndInsertBuilder#getRowsToUpdate() method a 
DataSet is created, which is converted to a List of rows, which is returned by 
the method, but the DataSet isn't closed, as a result of which, in case of 
Elasticsearch, the scroll request for the DataSet isn't cleared and will stay 
alive for 60 seconds.
   
   I want to address this problem within this pull request.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

Reply via email to