Re: NRT segment replication in AWS

2025-02-26 Thread Steven Schlansker
> On Feb 26, 2025, at 2:53 PM, Marc Davenport > wrote: > > Hello, > Our current search solution is a pretty big monolith running on pretty > beefy EC2 instances. Every node is responsible for indexing and serving > queries. We want to start decomposing our service and are starting with > se

Re: NRT segment replication in AWS

2025-02-26 Thread Michael Froh
Hi there, I'm happy to share some details about how Amazon Product Search does its segment replication. I haven't worked on Product Search in over three years, so anything that I remember is not particularly novel. Also, it's not really secret sauce -- I would have happily talked about it more in

Re: NRT segment replication in AWS

2025-02-26 Thread Sarthak Nandi
> I'm still debating if there should be some direct knowledge of the > replicas in the primary node. Or if the primary node can just churn away > creating base indexes and updates and publish to a queue when it produces a > new set of segments. Then the replicas are then free to pick up the lates

NRT segment replication in AWS

2025-02-26 Thread Marc Davenport
Hello, Our current search solution is a pretty big monolith running on pretty beefy EC2 instances. Every node is responsible for indexing and serving queries. We want to start decomposing our service and are starting with separating the indexing and query handling responsibilities. I'm in the re