Re: [External] RE: accumulo 1.10 replication issue

2021-09-23 Thread Christopher
The design of replication is intentionally passive and "eventually consistent" for efficiency. Batching efficiency is one reason why the feature is tightly coupled to WALs. If you need immediate replication, or want greater control over the batching process, you can create a layer on top of two

RE: [External] RE: accumulo 1.10 replication issue

2021-09-23 Thread Ligade, Shailesh [USA]
Thanks, Appreciate your help. It can be confusing as I am waiting here but it is not replicating I will reduce those values temporarily and see what happens. Interesting part is Files Needing replication is stuck at 3 so it is possible that problem is some where else. Thanks again -S From:

Re: [External] RE: accumulo 1.10 replication issue

2021-09-23 Thread Adam J. Shook
Yes, if it is not heavily used then you may see a significant delay. You can change the defaults using tserver.walog.max.age [1] and tserver.walog.max.size [2]. If I recall you can change these via the shell and a restart is not required. If you aren't seeing much ingestion, then the max age

RE: [External] RE: accumulo 1.10 replication issue

2021-09-23 Thread Ligade, Shailesh [USA]
Thanks Adam, System is not heavily used, Does that mean it will wait for 1G data in wal file, (or 24 hours) before it will replicate? I don’t see any error In any log source master, tserver or target master,tserver Monitor replication page has correct status, and once in while I see

Re: [External] RE: accumulo 1.10 replication issue

2021-09-23 Thread Adam J. Shook
Yes, inserting via the shell will be enough to test it. Note that the replication system uses the write-ahead logs (WAL) to replicate the data. These logs must be closed before any replication can occur, so there will be a delay before it shows up in the peer table. How long of a delay depends

RE: [External] RE: accumulo 1.10 replication issue

2021-09-23 Thread Ligade, Shailesh [USA]
Thanks Adam, I am setting accumulo.name property in accumulo-site.xml. I think this property must be set to “Instance Name” value, I tried to set to “primary” and I saw error stating that instance id was not found in zookeeper I have few tables to replicate so I am thinking I will set all

Re: [External] RE: accumulo 1.10 replication issue

2021-09-23 Thread Adam J. Shook
Your configurations look correct to me, and it sounds like it is partially working as you are seeing files that need replicated in the Accumulo Monitor. I do have the replication.name and all replication.peer.* properties defined in accumulo-site.xml. Do you have all these properties defined

RE: [External] RE: accumulo 1.10 replication issue

2021-09-23 Thread Ligade, Shailesh [USA]
Thanks for reply I am using insert command from shell to insert data. Also, a quick question, replication.name property can it be set using cli? Will that work or it must be defined in accumilo-site.xml? Thanks -S From: d...@etcoleman.com Sent: Thursday, September 23, 2021 6:50 AM To:

RE: accumulo 1.10 replication issue

2021-09-23 Thread dev1
How are you inserting the data? From: Ligade, Shailesh [USA] Sent: Wednesday, September 22, 2021 10:22 PM To: user@accumulo.apache.org Subject: accumulo 1.10 replication issue Hello, I am following Apache Accumulo