[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14321262#comment-14321262 ] Lars Hofhansl commented on HBASE-5954: -- [~stack] and I looked at this patch together

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14301435#comment-14301435 ] stack commented on HBASE-5954: -- We could. Lets do that if can't make the API as is work.

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14300777#comment-14300777 ] stack commented on HBASE-5954: -- Oh, BTW, this is a critical improvement. Allow proper fsync

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14300776#comment-14300776 ] stack commented on HBASE-5954: -- I think that is a good idea [~lhofhansl] I wouldn't be

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14300742#comment-14300742 ] Lars Hofhansl commented on HBASE-5954: -- I am having a bit of hard time convincing

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14300935#comment-14300935 ] Lars Hofhansl commented on HBASE-5954: -- We can dramatically simplify this if we make

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14299886#comment-14299886 ] stack commented on HBASE-5954: -- Says this failed...

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14299931#comment-14299931 ] Hadoop QA commented on HBASE-5954: -- {color:red}-1 overall{color}. Here are the results

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14300032#comment-14300032 ] Hadoop QA commented on HBASE-5954: -- {color:red}-1 overall{color}. Here are the results

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14300058#comment-14300058 ] Hadoop QA commented on HBASE-5954: -- {color:red}-1 overall{color}. Here are the results

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14299270#comment-14299270 ] Lars Hofhansl commented on HBASE-5954: -- TestWALReplay passes locally every time I run

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14299438#comment-14299438 ] stack commented on HBASE-5954: -- What checkstyle, javadoc, and extra compiler warnings?

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14299610#comment-14299610 ] Hadoop QA commented on HBASE-5954: -- {color:red}-1 overall{color}. Here are the results

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14299684#comment-14299684 ] Hadoop QA commented on HBASE-5954: -- {color:red}-1 overall{color}. Here are the results

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14299620#comment-14299620 ] Lars Hofhansl commented on HBASE-5954: -- This time TestAcidGuarantees did not finish.

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14299644#comment-14299644 ] Lars Hofhansl commented on HBASE-5954: -- Passed locally a few time with patch applied.

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14299445#comment-14299445 ] stack commented on HBASE-5954: -- I took a look at that patch. LGTM. This stuff is hard to

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14298379#comment-14298379 ] Hadoop QA commented on HBASE-5954: -- {color:red}-1 overall{color}. Here are the results

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14297123#comment-14297123 ] Lars Hofhansl commented on HBASE-5954: -- Now, that does not look too swell. Looking.

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14297219#comment-14297219 ] Lars Hofhansl commented on HBASE-5954: -- These actually looks environmental. Trying

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14297357#comment-14297357 ] Hadoop QA commented on HBASE-5954: -- {color:red}-1 overall{color}. Here are the results

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14297789#comment-14297789 ] Sean Busbey commented on HBASE-5954: that's usually a memory problem. Allow proper

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14297780#comment-14297780 ] Lars Hofhansl commented on HBASE-5954: -- Hmm... Cannot create native thread? I fail to

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14298050#comment-14298050 ] Lars Hofhansl commented on HBASE-5954: -- Much better. Thinking about metrics now. At

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14298037#comment-14298037 ] Hadoop QA commented on HBASE-5954: -- {color:red}-1 overall{color}. Here are the results

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14298100#comment-14298100 ] Ted Yu commented on HBASE-5954: --- Good work, Lars Allow proper fsync support for HBase

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14295425#comment-14295425 ] stack commented on HBASE-5954: -- fsync every meta edit? I suppose that makes sense. Something

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14296377#comment-14296377 ] Lars Hofhansl commented on HBASE-5954: -- I'll rebase the patch (if needed), and get a

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14296413#comment-14296413 ] Lars Hofhansl commented on HBASE-5954: -- Another thought. If we had HDFS storage

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14296531#comment-14296531 ] Hadoop QA commented on HBASE-5954: -- {color:red}-1 overall{color}. Here are the results

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14296412#comment-14296412 ] Lars Hofhansl commented on HBASE-5954: -- [~stack], can I use the traces to get the

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14248882#comment-14248882 ] Lars Hofhansl commented on HBASE-5954: -- After thinking about this for a little bit, I

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14248907#comment-14248907 ] Sean Busbey commented on HBASE-5954: Can you update the patch to include changes to

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14248994#comment-14248994 ] Lars Hofhansl commented on HBASE-5954: -- That's a good idea. Will do. (In the end...

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14248998#comment-14248998 ] Sean Busbey commented on HBASE-5954: Oh certainly. I expect there's going to be a

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14249523#comment-14249523 ] Lars Hofhansl commented on HBASE-5954: -- [~stack] since you mention it's more mess.

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14229310#comment-14229310 ] Lars Hofhansl commented on HBASE-5954: -- Yeah, we probably need the mixed handling.

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14222459#comment-14222459 ] stack commented on HBASE-5954: -- Thinking on it, blanket fsync, or not, would be a little

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1446#comment-1446 ] Lars Hofhansl commented on HBASE-5954: -- Looking at trunk this is a whole lot more

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1489#comment-1489 ] stack commented on HBASE-5954: -- [~lhofhansl] I don't mind having a go at it if you want; its

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1494#comment-1494 ] Lars Hofhansl commented on HBASE-5954: -- I don't mind having a look. Still looking

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=1496#comment-1496 ] stack commented on HBASE-5954: -- We have to support a mix of sync and fsync? I suppose we do.

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14222311#comment-14222311 ] Sean Busbey commented on HBASE-5954: Why support the mix though? The last time we

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14222321#comment-14222321 ] Lars Hofhansl commented on HBASE-5954: -- Well... We do have the APIs already. We do

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14222326#comment-14222326 ] Lars Hofhansl commented on HBASE-5954: -- Other related setting that would be

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14167248#comment-14167248 ] Enis Soztutar commented on HBASE-5954: -- bq. In HBase trunk (2.x) can I assume we'll

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14167260#comment-14167260 ] Sean Busbey commented on HBASE-5954: Lars around when are you planning to get work on

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14168005#comment-14168005 ] Lars Hofhansl commented on HBASE-5954: -- [~busbey], I'll wait until your changes are

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14168006#comment-14168006 ] Elliott Clark commented on HBASE-5954: -- So I have to have split personality here.

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14168007#comment-14168007 ] Lars Hofhansl commented on HBASE-5954: -- The alternative is that fold this into the

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14164816#comment-14164816 ] Lars Hofhansl commented on HBASE-5954: -- I'd like to pick this up again. In HBase

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13834246#comment-13834246 ] Andrew Purtell commented on HBASE-5954: --- Where are we with this issue? Allow

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13834271#comment-13834271 ] Lars Hofhansl commented on HBASE-5954: -- It's probably best to unschedule this for

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13764643#comment-13764643 ] haosdent commented on HBASE-5954: - [~lhofhansl] Oh, are you sure you disks didn't have

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13761704#comment-13761704 ] haosdent commented on HBASE-5954: - my tests above were run with write barriers enabled and

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13762049#comment-13762049 ] Lars Hofhansl commented on HBASE-5954: -- Not sure on which machine I ran this now. I

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13762652#comment-13762652 ] haosdent commented on HBASE-5954: - [~lhofhansl]Haha, I have test hsync() in RAID10 before.

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13762719#comment-13762719 ] Lars Hofhansl commented on HBASE-5954: -- Nope. Software RAID. Allow

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13760865#comment-13760865 ] Luke Lu commented on HBASE-5954: As you've found out, the fsync performance is very

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13760918#comment-13760918 ] Lars Hofhansl commented on HBASE-5954: -- [~haosd...@gmail.com] From the article you

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13760919#comment-13760919 ] Lars Hofhansl commented on HBASE-5954: -- Also, my tests above were run with write

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13754419#comment-13754419 ] haosdent commented on HBASE-5954: - hi, [~lhofhansl], whether your disks have raid or not?

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13754467#comment-13754467 ] haosdent commented on HBASE-5954: - [~lhofhansl] My test result: Without WAL/HFile sync:

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13754475#comment-13754475 ] haosdent commented on HBASE-5954: - Only when we open write barrier and mount disk with

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13754495#comment-13754495 ] Liang Xie commented on HBASE-5954: -- [~haosd...@gmail.com], IMHO, fsync + write barrier

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13754646#comment-13754646 ] haosdent commented on HBASE-5954: - [~xieliang007]If mount disk with data=writeback, the

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13754654#comment-13754654 ] haosdent commented on HBASE-5954: - [~xieliang007]Because there is only have a journal file

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13754869#comment-13754869 ] Lars Hofhansl commented on HBASE-5954: -- @haosdent, we can't break the laws of

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13755411#comment-13755411 ] haosdent commented on HBASE-5954: - When we use the hsync of HDFS, the JVM in datanode will

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13728717#comment-13728717 ] Lars Hofhansl commented on HBASE-5954: -- HBASE-7801 and HBASE-8375 put the right

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13726428#comment-13726428 ] Dave Latham commented on HBASE-5954: Should update the recommended HDFS configuration

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13697588#comment-13697588 ] Lars Hofhansl commented on HBASE-5954: -- This is a HDFS server side setting, though,

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13697591#comment-13697591 ] Lars Hofhansl commented on HBASE-5954: -- And yes HDFS-1539 as well as HDFS-2465 for

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13697289#comment-13697289 ] Dave Latham commented on HBASE-5954: Would be great to see this go in to 0.96. Lars

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13697294#comment-13697294 ] Lars Hofhansl commented on HBASE-5954: -- Note that for performance reasons you

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13697293#comment-13697293 ] Lars Hofhansl commented on HBASE-5954: -- With HBASE-7801 and HBASE-8375 we're almost

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13697300#comment-13697300 ] Enis Soztutar commented on HBASE-5954: -- bq. Would be great to see this go in to 0.96.

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13697304#comment-13697304 ] stack commented on HBASE-5954: -- bq. Should we make this default? I'd vote for that.

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13697343#comment-13697343 ] Suresh Srinivas commented on HBASE-5954: bq. Should we make this default? +1 from

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13697361#comment-13697361 ] Dave Latham commented on HBASE-5954: {quote}You probably just want to enable

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13532989#comment-13532989 ] Varun Sharma commented on HBASE-5954: - Firstly, I certainly don't want to complicate

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13532908#comment-13532908 ] Varun Sharma commented on HBASE-5954: - Btw, are we going to provide a hard option of

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13532911#comment-13532911 ] Harsh J commented on HBASE-5954: bq. A middle ground feature like syncing every N seconds

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13532914#comment-13532914 ] Varun Sharma commented on HBASE-5954: - No I am not talking about deferred WAL flush.

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13532941#comment-13532941 ] Lars Hofhansl commented on HBASE-5954: -- We can make this arbitrarily complicated. :)

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13503528#comment-13503528 ] Jimmy Xiang commented on HBASE-5954: Those methods should be removed. But old

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13503557#comment-13503557 ] Lars Hofhansl commented on HBASE-5954: -- I'd vote for removing them. If we keep these

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13503558#comment-13503558 ] Andrew Purtell commented on HBASE-5954: --- bq. I'd vote for removing them. If we keep

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13503613#comment-13503613 ] Lars Hofhansl commented on HBASE-5954: -- Filed HBASE-7215. Allow

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13503461#comment-13503461 ] Lars Hofhansl commented on HBASE-5954: -- In 0.96 Put.java, Delete.java, and

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13503321#comment-13503321 ] Lars Hofhansl commented on HBASE-5954: -- While I'm add it, I'd like to add deferred

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13503326#comment-13503326 ] liang xie commented on HBASE-5954: -- sound good for me. hope more guys have an eye on it

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13494390#comment-13494390 ] Lars Hofhansl commented on HBASE-5954: -- I'm planning to pick this up again, soon.

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13493707#comment-13493707 ] liang xie commented on HBASE-5954: -- Hi [~lhofhansl],the HDFS-3979 has been committed, so

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13474886#comment-13474886 ] Luke Lu commented on HBASE-5954: bq. hsync is still better (even when it is not on the

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13475114#comment-13475114 ] Lars Hofhansl commented on HBASE-5954: -- I disagree, having the signal out for the DNs

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13475338#comment-13475338 ] Kan Zhang commented on HBASE-5954: -- It's true hsync is better than hflush in terms of

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13475475#comment-13475475 ] Lars Hofhansl commented on HBASE-5954: -- Wait, in all cases the data was flushed to

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13475491#comment-13475491 ] Kan Zhang commented on HBASE-5954: -- Hi Lars, I think you did misunderstand what I said,

[jira] [Commented] (HBASE-5954) Allow proper fsync support for HBase

[ https://issues.apache.org/jira/browse/HBASE-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13475511#comment-13475511 ] Lars Hofhansl commented on HBASE-5954: -- I see, you're right, the expectations are

  1   2   >