Hi all,
I plan to update my data while performing scrolling. Is this use case valid
for ElasticSearch? and is there any best practice for this use case?
What I plan to do is something like this (using Java API). While iterating
through the hits of ScrollResponse, I issue ElasticSearch update request.
public void updateWhileScrolling(){
SearchResponse scrollResp = esRelationshipClient
.prepareSearch(someIndex)
.setTypes(someType)
.setSearchType(SearchType.SCAN)
.setScroll(new TimeValue(scrollTimeWindow, scrollTimeUnit))
.setQuery(QueryBuilders.matchAllQuery())
.setSize(sizePerShard)
.execute().actionGet();
while(true){
scrollResp = esRelationshipClient
.prepareSearchScroll(scrollResp.getScrollId())
.setScroll(new TimeValue(scrollTimeWindow, scrollTimeUnit))
.execute().actionGet();
for(SearchHit hit: scrollResp.getHits()){
Map<String, Object> source = hit.getSource();
if(source != null){
*//update source using Update API*
}else{
logger.error("source is null for {}", hit.toString());
}
} //end for loop for processing each hit
//break condition, no hits are returned
if (scrollResp.getHits().getHits().length == 0) {
break;
}
}
}
--
You received this message because you are subscribed to the Google Groups
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
To view this discussion on the web visit
https://groups.google.com/d/msgid/elasticsearch/dd91574a-f8aa-4aef-959a-1ea10e7b3a3c%40googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.
