[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

2018-06-14 Thread Sean Busbey (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16513286#comment-16513286 ] Sean Busbey commented on HBASE-20723: - could someone update the component and severi

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

2018-06-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16513284#comment-16513284 ] Hadoop QA commented on HBASE-20723: --- | (x) *{color:red}-1 overall{color}* | \\ \\ || V

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

2018-06-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16513224#comment-16513224 ] Hadoop QA commented on HBASE-20723: --- | (/) *{color:green}+1 overall{color}* | \\ \\ ||

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

2018-06-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16513208#comment-16513208 ] Hadoop QA commented on HBASE-20723: --- | (x) *{color:red}-1 overall{color}* | \\ \\ || V

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

2018-06-14 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16513139#comment-16513139 ] Ted Yu commented on HBASE-20723: Patch v9 removed the FileSystem parameter to getRegionS

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

2018-06-14 Thread Zach York (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16513113#comment-16513113 ] Zach York commented on HBASE-20723: --- Removed 1.1.2 from affects since the backport isn

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

2018-06-14 Thread Zach York (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16513107#comment-16513107 ] Zach York commented on HBASE-20723: --- [~yuzhih...@gmail.com] The patch looks good to me

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

2018-06-14 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16513075#comment-16513075 ] Ted Yu commented on HBASE-20723: Patch v8 does variable renaming w.r.t. walDir. > WALSp

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

2018-06-14 Thread Zach York (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16513067#comment-16513067 ] Zach York commented on HBASE-20723: --- Okay, let's do the quick fix here and look to HBA

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

2018-06-14 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16513062#comment-16513062 ] Ted Yu commented on HBASE-20723: bq. some indication of the number of records replayed

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

2018-06-14 Thread Zach York (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16513048#comment-16513048 ] Zach York commented on HBASE-20723: --- It's great that we have these JMX values, but unl

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

2018-06-14 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16513043#comment-16513043 ] Ted Yu commented on HBASE-20723: Patch v7 sets wal.dir to different location than rootdi

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

2018-06-14 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16513023#comment-16513023 ] Ted Yu commented on HBASE-20723: For #2 above, we already have JMX for : {code} "Rep

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

2018-06-14 Thread Zach York (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16513019#comment-16513019 ] Zach York commented on HBASE-20723: --- [~yuzhih...@gmail.com] I did reproduce the issue

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

2018-06-14 Thread Josh Elser (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16512958#comment-16512958 ] Josh Elser commented on HBASE-20723: Ok, thanks for that explanation, Ted. Leaves me

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

2018-06-14 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16512931#comment-16512931 ] Ted Yu commented on HBASE-20723: Tried out multiwal : {code} diff --git a/hbase-server/

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

2018-06-14 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16512925#comment-16512925 ] Ted Yu commented on HBASE-20723: Josh: See my earlier comment w.r.t. the incorrect calcu

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

2018-06-14 Thread Josh Elser (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16512915#comment-16512915 ] Josh Elser commented on HBASE-20723: [~yuzhih...@gmail.com], have you tried writing

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

2018-06-14 Thread Mike Drob (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16512888#comment-16512888 ] Mike Drob commented on HBASE-20723: --- {code} WriterAndPath createWAP(byte[] region

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

2018-06-14 Thread Mike Drob (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16512886#comment-16512886 ] Mike Drob commented on HBASE-20723: --- +Path rootDir = new Path(conf.get(HConstants.

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

2018-06-14 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16512875#comment-16512875 ] Ted Yu commented on HBASE-20723: I ran TestZooKeeper locally with patch v5 which passed.

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

2018-06-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16512861#comment-16512861 ] Hadoop QA commented on HBASE-20723: --- | (x) *{color:red}-1 overall{color}* | \\ \\ || V

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

2018-06-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16512464#comment-16512464 ] Hadoop QA commented on HBASE-20723: --- | (x) *{color:red}-1 overall{color}* | \\ \\ || V

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

2018-06-14 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16512239#comment-16512239 ] Ted Yu commented on HBASE-20723: TestWALFactory passes using patch v5 where table direct

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

2018-06-14 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16512232#comment-16512232 ] Ted Yu commented on HBASE-20723: Looking at the change from HBASE-17437 in TestWALFactor

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

2018-06-14 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16512220#comment-16512220 ] Ted Yu commented on HBASE-20723: It turns out that retrieving conf from FileSystem may d

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

2018-06-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16512088#comment-16512088 ] Hadoop QA commented on HBASE-20723: --- | (x) *{color:red}-1 overall{color}* | \\ \\ || V

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

2018-06-13 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16511982#comment-16511982 ] Hadoop QA commented on HBASE-20723: --- | (x) *{color:red}-1 overall{color}* | \\ \\ || V

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

2018-06-13 Thread Tak Lon (Stephen) Wu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16511808#comment-16511808 ] Tak Lon (Stephen) Wu commented on HBASE-20723: -- [~yuzhih...@gmail.com] I se

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

2018-06-13 Thread Zach York (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16511807#comment-16511807 ] Zach York commented on HBASE-20723: --- [~yuzhih...@gmail.com] I think I'm starting to se

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

2018-06-13 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16511788#comment-16511788 ] Ted Yu commented on HBASE-20723: [~taklwu]: Alright. wal.dir is different from rootdir i

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

2018-06-13 Thread Tak Lon (Stephen) Wu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16511756#comment-16511756 ] Tak Lon (Stephen) Wu commented on HBASE-20723: -- I didn' set `hbase.wal.dir`

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

2018-06-13 Thread Zach York (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16511758#comment-16511758 ] Zach York commented on HBASE-20723: --- [~taklwu] Yes hbase.wal.dir is set in your experi

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

2018-06-13 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16511755#comment-16511755 ] Ted Yu commented on HBASE-20723: In WALSplitter#getRegionSplitEditsPath : {code} Pat

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

2018-06-13 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16511736#comment-16511736 ] Ted Yu commented on HBASE-20723: [~taklwu]: What was the value for hbase.wal.dir you use

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

2018-06-13 Thread Tak Lon (Stephen) Wu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16511733#comment-16511733 ] Tak Lon (Stephen) Wu commented on HBASE-20723: -- [~busbey] I went back to ch

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

2018-06-13 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16511662#comment-16511662 ] Ted Yu commented on HBASE-20723: [~taklwu]: Did you see in the log anything similar to t

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

2018-06-13 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16511658#comment-16511658 ] stack commented on HBASE-20723: --- bq few records were missing. What we talking here?

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

2018-06-13 Thread Sean Busbey (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16511654#comment-16511654 ] Sean Busbey commented on HBASE-20723: - Can we get logs from HBase and HDFS through a

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

2018-06-13 Thread Zach York (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16511647#comment-16511647 ] Zach York commented on HBASE-20723: --- [~busbey] That's what I expected, but Stephen's e

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

2018-06-13 Thread Sean Busbey (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16511644#comment-16511644 ] Sean Busbey commented on HBASE-20723: - {quote} or the hflush in DFSOutputStream usi

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

2018-06-13 Thread Tak Lon (Stephen) Wu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16511621#comment-16511621 ] Tak Lon (Stephen) Wu commented on HBASE-20723: -- for theĀ [hflush in DFSOutpu

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

2018-06-13 Thread Sean Busbey (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16511552#comment-16511552 ] Sean Busbey commented on HBASE-20723: - {quote} The one thing that one of my colleagu

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

2018-06-13 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16511133#comment-16511133 ] stack commented on HBASE-20723: --- Ignore me [~zyork]. Will be back if I have more tangibles

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

2018-06-12 Thread Zach York (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16510654#comment-16510654 ] Zach York commented on HBASE-20723: --- [~yuzhih...@gmail.com] you're welcome to try that

[jira] [Commented] (HBASE-20723) WALSplitter uses the rootDir, which is walDir, as the tableDir root path.

2018-06-12 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-20723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16510515#comment-16510515 ] Ted Yu commented on HBASE-20723: bq. HBase 1.1.2.2.6.3.2-14 This release backported HBA