[jira] [Commented] (HBASE-21544) WAL writer for recovered.edits file in WalSplitting should not require hflush from filesystem

2018-12-04 Thread Josh Elser (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16708938#comment-16708938 ] Josh Elser commented on HBASE-21544: {quote}in a long term I do think we should remove the hflush

[jira] [Commented] (HBASE-21544) WAL writer for recovered.edits file in WalSplitting should not require hflush from filesystem

2018-12-03 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16708072#comment-16708072 ] Hadoop QA commented on HBASE-21544: --- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HBASE-21544) WAL writer for recovered.edits file in WalSplitting should not require hflush from filesystem

2018-12-03 Thread Duo Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16708012#comment-16708012 ] Duo Zhang commented on HBASE-21544: --- Agree that for recovered edits we do not need the FileSystem to

[jira] [Commented] (HBASE-21544) WAL writer for recovered.edits file in WalSplitting should not require hflush from filesystem

2018-12-03 Thread Josh Elser (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16707951#comment-16707951 ] Josh Elser commented on HBASE-21544: .001 has the first stab at a backport. The modified tests by

[jira] [Commented] (HBASE-21544) WAL writer for recovered.edits file in WalSplitting should not require hflush from filesystem

2018-12-03 Thread Josh Elser (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16707782#comment-16707782 ] Josh Elser commented on HBASE-21544: {quote}Sure. Changed my mind. Can push out a 2.0.4 in a few

[jira] [Commented] (HBASE-21544) WAL writer for recovered.edits file in WalSplitting should not require hflush from filesystem

2018-12-03 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16707776#comment-16707776 ] stack commented on HBASE-21544: --- Sure. Changed my mind [~elserj] Can push out a 2.0.4 in a few weeks w/

[jira] [Commented] (HBASE-21544) WAL writer for recovered.edits file in WalSplitting should not require hflush from filesystem

2018-12-03 Thread Josh Elser (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16707699#comment-16707699 ] Josh Elser commented on HBASE-21544: {quote}Does it only do that if the underlying FileSystem

[jira] [Commented] (HBASE-21544) WAL writer for recovered.edits file in WalSplitting should not require hflush from filesystem

2018-12-03 Thread Sean Busbey (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16707696#comment-16707696 ] Sean Busbey commented on HBASE-21544: - bq. FSDataOutputStream (assuming that's what you meant by

[jira] [Commented] (HBASE-21544) WAL writer for recovered.edits file in WalSplitting should not require hflush from filesystem

2018-12-03 Thread Josh Elser (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16707692#comment-16707692 ] Josh Elser commented on HBASE-21544: {quote}Edit: I see you're talking about WASB. Does that support

[jira] [Commented] (HBASE-21544) WAL writer for recovered.edits file in WalSplitting should not require hflush from filesystem

2018-12-03 Thread Sean Busbey (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16707657#comment-16707657 ] Sean Busbey commented on HBASE-21544: - what does the contract for FileSystem.close say about data

[jira] [Commented] (HBASE-21544) WAL writer for recovered.edits file in WalSplitting should not require hflush from filesystem

2018-12-03 Thread Zach York (JIRA)
[ https://issues.apache.org/jira/browse/HBASE-21544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16707642#comment-16707642 ] Zach York commented on HBASE-21544: --- [~elserj] are you guys storing the WAL on HDFS? In that case, I