Gotcha. That's definitely the biggest factor that I was aware of. I
wasn't sure if you knew more than I did by now ;). I can respect the
implications of too much bookkeeping going on. That might really start
pounding the metadata and replication tables.
Happy to do lunch, also happy to just
Thanks, Josh. I think the main pain-point is that replication doesn't
occur until the WAL is closed. We've made some aggressive configuration
changes to Accumulo to reduce the WAL time rollover and minor compaction
frequency to force replication to go faster. It is down to around 20
minutes or
Hi Adam,
I'm not presently working on anything (too many irons in other fires),
but I'd be happy to help work through a design doc for improvements.
Do you have a list of pain-points which are the primary causes of
latency? That would help in identifying the changes to make and how best
to
I'm currently scoping what it would take to improve the latency in the
replication feature of Accumulo. I'm interested in knowing what work, if
any, is being done to improve replication latency? If work is being done,
would there be some interest in collaborating on that effort?
If nothing is
