[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16513286#comment-16513286 ] Sean Busbey commented on HBASE-20723: - could someone update the component and severity? It sounds

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16513284#comment-16513284 ] Hadoop QA commented on HBASE-20723: --- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16513224#comment-16513224 ] Hadoop QA commented on HBASE-20723: --- | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16513208#comment-16513208 ] Hadoop QA commented on HBASE-20723: --- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16513139#comment-16513139 ] Ted Yu commented on HBASE-20723: Patch v9 removed the FileSystem parameter to getRegionSplitEditsPath()

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16513113#comment-16513113 ] Zach York commented on HBASE-20723: --- Removed 1.1.2 from affects since the backport isn't in the public

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16513107#comment-16513107 ] Zach York commented on HBASE-20723: --- [~yuzhih...@gmail.com] The patch looks good to me. Let's see what

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16513075#comment-16513075 ] Ted Yu commented on HBASE-20723: Patch v8 does variable renaming w.r.t. walDir. > WALSplitter uses the

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16513067#comment-16513067 ] Zach York commented on HBASE-20723: --- Okay, let's do the quick fix here and look to HBASE-20734 for the

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16513062#comment-16513062 ] Ted Yu commented on HBASE-20723: bq. some indication of the number of records replayed The above metric

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16513048#comment-16513048 ] Zach York commented on HBASE-20723: --- It's great that we have these JMX values, but unless an admin

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16513043#comment-16513043 ] Ted Yu commented on HBASE-20723: Patch v7 sets wal.dir to different location than rootdir in

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16513023#comment-16513023 ] Ted Yu commented on HBASE-20723: For #2 above, we already have JMX for : {code} "Replay_num_ops" :

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16513019#comment-16513019 ] Zach York commented on HBASE-20723: --- [~yuzhih...@gmail.com] I did reproduce the issue on my side as

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16512958#comment-16512958 ] Josh Elser commented on HBASE-20723: Ok, thanks for that explanation, Ted. Leaves me wondering how

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16512931#comment-16512931 ] Ted Yu commented on HBASE-20723: Tried out multiwal : {code} diff --git

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16512925#comment-16512925 ] Ted Yu commented on HBASE-20723: Josh: See my earlier comment w.r.t. the incorrect calculation of table

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16512915#comment-16512915 ] Josh Elser commented on HBASE-20723: [~yuzhih...@gmail.com], have you tried writing a simple

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16512888#comment-16512888 ] Mike Drob commented on HBASE-20723: --- {code} WriterAndPath createWAP(byte[] region, Entry entry,

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16512886#comment-16512886 ] Mike Drob commented on HBASE-20723: --- +Path rootDir = new Path(conf.get(HConstants.HBASE_DIR)); Use

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16512875#comment-16512875 ] Ted Yu commented on HBASE-20723: I ran TestZooKeeper locally with patch v5 which passed. > WALSplitter

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16512861#comment-16512861 ] Hadoop QA commented on HBASE-20723: --- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16512464#comment-16512464 ] Hadoop QA commented on HBASE-20723: --- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16512239#comment-16512239 ] Ted Yu commented on HBASE-20723: TestWALFactory passes using patch v5 where table directory is located

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16512232#comment-16512232 ] Ted Yu commented on HBASE-20723: Looking at the change from HBASE-17437 in TestWALFactory : {code} -

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16512220#comment-16512220 ] Ted Yu commented on HBASE-20723: It turns out that retrieving conf from FileSystem may deviate from the

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16512088#comment-16512088 ] Hadoop QA commented on HBASE-20723: --- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16511982#comment-16511982 ] Hadoop QA commented on HBASE-20723: --- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16511808#comment-16511808 ] Tak Lon (Stephen) Wu commented on HBASE-20723: -- [~yuzhih...@gmail.com] I see, but then my

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16511807#comment-16511807 ] Zach York commented on HBASE-20723: --- [~yuzhih...@gmail.com] I think I'm starting to see your point.

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16511788#comment-16511788 ] Ted Yu commented on HBASE-20723: [~taklwu]: Alright. wal.dir is different from rootdir in your test.

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16511756#comment-16511756 ] Tak Lon (Stephen) Wu commented on HBASE-20723: -- I didn' set `hbase.wal.dir`, it is the

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16511758#comment-16511758 ] Zach York commented on HBASE-20723: --- [~taklwu] Yes hbase.wal.dir is set in your experiments.   >

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16511755#comment-16511755 ] Ted Yu commented on HBASE-20723: In WALSplitter#getRegionSplitEditsPath : {code} Path tableDir =

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16511736#comment-16511736 ] Ted Yu commented on HBASE-20723: [~taklwu]: What was the value for hbase.wal.dir you used ? Thanks >

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16511733#comment-16511733 ] Tak Lon (Stephen) Wu commented on HBASE-20723: -- [~busbey] I went back to check, here is the

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16511662#comment-16511662 ] Ted Yu commented on HBASE-20723: [~taklwu]: Did you see in the log anything similar to the following ?

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16511658#comment-16511658 ] stack commented on HBASE-20723: --- bq few records were missing. What we talking here? Were they sync'd

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16511654#comment-16511654 ] Sean Busbey commented on HBASE-20723: - Can we get logs from HBase and HDFS through a reproduction?

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16511647#comment-16511647 ] Zach York commented on HBASE-20723: --- [~busbey] That's what I expected, but Stephen's experiment seems

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16511644#comment-16511644 ] Sean Busbey commented on HBASE-20723: - {quote} or the hflush in DFSOutputStream using by WAL's

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16511621#comment-16511621 ] Tak Lon (Stephen) Wu commented on HBASE-20723: -- for the [hflush in DFSOutputStream 

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16511552#comment-16511552 ] Sean Busbey commented on HBASE-20723: - {quote} The one thing that one of my colleagues figured out

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16511133#comment-16511133 ] stack commented on HBASE-20723: --- Ignore me [~zyork]. Will be back if I have more tangibles. > WALSplitter

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16510654#comment-16510654 ] Zach York commented on HBASE-20723: --- [~yuzhih...@gmail.com] you're welcome to try that change, but as

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16510515#comment-16510515 ] Ted Yu commented on HBASE-20723: bq. HBase 1.1.2.2.6.3.2-14 This release backported HBASE-17437 bq.