> How long are you waiting between the hard commit and the query? > Are you waiting for the commit operation to return a response before you try to > query?
Well that's kind of the crux of the issue. We're issuing a hard commit which (from what I've read) appears to be a synchronous operation. So. when the call comes back with a 200 http response code, we can be assured that the operation has gone through. But there's no artificial "wait time" after that, because how are we to know how long that should be? > I actually don't know whether a commit operation will wait for > all replicas when you're in cloud mode. Seems like our experimentation is showing that it doesn't at least for TLOG replica types. If we bound the query to the leaders, we can get accurate results immediately after the commit. If we don't add that restriction, sometimes the results sometimes won't show the groups of data that were indexed in the previous. At this point we're proceeding with a strategy of only querying the leaders during this operation... Seems to be working out so far. Thanks! Kyle On Fri, 3 Sept 2021 at 12:16, Shawn Heisey <apa...@elyograg.org> wrote: > On 9/3/2021 9:19 AM, lstusr 5u93n4 wrote: > > What we're seeing is the following: > > - index some data > > - issue a hard commit > > - issue a query for that data > > - sometimes the query gets routed to a replica that is not yet updated, > > and doesn't contain the data. > > How long are you waiting between the hard commit and the query? Are you > waiting for the commit operation to return a response before you try to > query? I actually don't know whether a commit operation will wait for > all replicas when you're in cloud mode. I don't have a lot of > experience with SolrCloud yet. I did set up a cloud deployment at an > old job, but it was VERY small. All my large-index experience is in > standalone mode. > > Commits can sometimes be very slow. This is mostly dependent on your > cache autowarm configuration and any manual warming queries that you > have defined. > > Thanks, > Shawn > >
