[
https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14318705#comment-14318705
]
Jing Zhao commented on HDFS-3689:
-
I've merged this to branch-2.
Add support for variable
[
https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317780#comment-14317780
]
Vinayakumar B commented on HDFS-3689:
-
HDFS-7703 is depend on this for the branch-2
[
https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14319623#comment-14319623
]
Vinayakumar B commented on HDFS-3689:
-
Thanks [~jingzhao].
Add support for variable
[
https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14316816#comment-14316816
]
Arpit Agarwal commented on HDFS-3689:
-
Hi [~jingzhao], can we merge this change to
[
https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317185#comment-14317185
]
Arpit Agarwal commented on HDFS-3689:
-
Thanks a lot for generating the branch-2 merge
[
https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317099#comment-14317099
]
Jing Zhao commented on HDFS-3689:
-
Yeah, I will post a patch for branch-2 soon.
Add
[
https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317248#comment-14317248
]
Suresh Srinivas commented on HDFS-3689:
---
[~jingzhao], can you please add a release
[
https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14317267#comment-14317267
]
Jing Zhao commented on HDFS-3689:
-
Thanks for the comments, Suresh! The current patch
[
https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14295176#comment-14295176
]
Hudson commented on HDFS-3689:
--
FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #84 (See
[
https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14295189#comment-14295189
]
Hudson commented on HDFS-3689:
--
FAILURE: Integrated in Hadoop-Hdfs-trunk #2019 (See
[
https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14295032#comment-14295032
]
Hudson commented on HDFS-3689:
--
FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #87 (See
[
https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14295050#comment-14295050
]
Hudson commented on HDFS-3689:
--
FAILURE: Integrated in Hadoop-Yarn-trunk #821 (See
[
https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14295270#comment-14295270
]
Hudson commented on HDFS-3689:
--
FAILURE: Integrated in Hadoop-Mapreduce-trunk #2038 (See
[
https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14295240#comment-14295240
]
Hudson commented on HDFS-3689:
--
FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #88 (See
[
https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14293159#comment-14293159
]
Hadoop QA commented on HDFS-3689:
-
{color:red}-1 overall{color}. Here are the results of
[
https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14294190#comment-14294190
]
Hudson commented on HDFS-3689:
--
SUCCESS: Integrated in Hadoop-trunk-Commit #6940 (See
[
https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292877#comment-14292877
]
Tsz Wo Nicholas Sze commented on HDFS-3689:
---
- Add an if-statement to check
[
https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289966#comment-14289966
]
Hadoop QA commented on HDFS-3689:
-
{color:red}-1 overall{color}. Here are the results of
[
https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14289129#comment-14289129
]
Hadoop QA commented on HDFS-3689:
-
{color:red}-1 overall{color}. Here are the results of
[
https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14288453#comment-14288453
]
Tsz Wo Nicholas Sze commented on HDFS-3689:
---
{code}
+
[
https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14286436#comment-14286436
]
Hadoop QA commented on HDFS-3689:
-
{color:red}-1 overall{color}. Here are the results of
[
https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14286800#comment-14286800
]
Hadoop QA commented on HDFS-3689:
-
{color:red}-1 overall{color}. Here are the results of
[
https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14285063#comment-14285063
]
Colin Patrick McCabe commented on HDFS-3689:
Thanks for working on this, Jing.
[
https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14283403#comment-14283403
]
Hadoop QA commented on HDFS-3689:
-
{color:red}-1 overall{color}. Here are the results of
[
https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14283152#comment-14283152
]
Tsz Wo Nicholas Sze commented on HDFS-3689:
---
- For concat,
-* We also need to
[
https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14283222#comment-14283222
]
Tsz Wo Nicholas Sze commented on HDFS-3689:
---
- Let's rename prepareFileForWrite
[
https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14279776#comment-14279776
]
Hadoop QA commented on HDFS-3689:
-
{color:red}-1 overall{color}. Here are the results of
[
https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14277548#comment-14277548
]
Jing Zhao commented on HDFS-3689:
-
Sure. Currently the patch includes the following
[
https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14277490#comment-14277490
]
Daryn Sharp commented on HDFS-3689:
---
To simplify review, would you please provide a
[
https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14277832#comment-14277832
]
Hadoop QA commented on HDFS-3689:
-
{color:red}-1 overall{color}. Here are the results of
[
https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14278050#comment-14278050
]
Hadoop QA commented on HDFS-3689:
-
{color:red}-1 overall{color}. Here are the results of
[
https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14278136#comment-14278136
]
Tsz Wo Nicholas Sze commented on HDFS-3689:
---
Thanks for working on this! Some
[
https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14276416#comment-14276416
]
Hadoop QA commented on HDFS-3689:
-
{color:red}-1 overall{color}. Here are the results of
[
https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14276583#comment-14276583
]
Hadoop QA commented on HDFS-3689:
-
{color:red}-1 overall{color}. Here are the results of
[
https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14257946#comment-14257946
]
Hadoop QA commented on HDFS-3689:
-
{color:red}-1 overall{color}. Here are the results of
[
https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14107148#comment-14107148
]
Doug Cutting commented on HDFS-3689:
bq. Right now these file formats need to accept
[
https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14107176#comment-14107176
]
Owen O'Malley commented on HDFS-3689:
-
Since this is a discussion of what to put into
[
https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14107194#comment-14107194
]
Owen O'Malley commented on HDFS-3689:
-
One follow up is that fixing MapReduce to use
[
https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14105733#comment-14105733
]
Colin Patrick McCabe commented on HDFS-3689:
bq. One thought is that we could
[
https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14106298#comment-14106298
]
Colin Patrick McCabe commented on HDFS-3689:
So, there are a few use-cases for
[
https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14103523#comment-14103523
]
Jing Zhao commented on HDFS-3689:
-
Thanks for the comments, [~cutting]! Do you think it is
[
https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14103909#comment-14103909
]
Kihwal Lee commented on HDFS-3689:
--
We also need to think about file checksum. I think we
[
https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14103930#comment-14103930
]
Andrey Stepachev commented on HDFS-3689:
May it is more convent to implement sparse
[
https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14104243#comment-14104243
]
Todd Lipcon commented on HDFS-3689:
---
Nice idea, Andrey. Jing, can you explain more what
[
https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14104363#comment-14104363
]
Doug Cutting commented on HDFS-3689:
+1 for sparse files. They could provide the same
[
https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14104400#comment-14104400
]
Andrey Stepachev commented on HDFS-3689:
[~cutting] I mentioned flag just as one of
[
https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14104402#comment-14104402
]
Suresh Srinivas commented on HDFS-3689:
---
[~cutting], the applications still need to
[
https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14104411#comment-14104411
]
Jing Zhao commented on HDFS-3689:
-
The sparse file idea sounds good to me. Let me see if I
[
https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14104472#comment-14104472
]
Gopal V commented on HDFS-3689:
---
The sparse file idea was thrown around a while back,
[
https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14104482#comment-14104482
]
Suresh Srinivas commented on HDFS-3689:
---
I also like the idea of sparse files. But I
[
https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14104506#comment-14104506
]
Jing Zhao commented on HDFS-3689:
-
Another question with the sparse file is that when we
[
https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14104539#comment-14104539
]
Andrey Stepachev commented on HDFS-3689:
[~jingzhao] of course they should. Sparse
[
https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14104536#comment-14104536
]
Doug Cutting commented on HDFS-3689:
[~sureshms], variable length blocks would permit
[
https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14104567#comment-14104567
]
Jing Zhao commented on HDFS-3689:
-
bq. It might be better not to have a transparent feature
[
https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14104599#comment-14104599
]
Andrey Stepachev commented on HDFS-3689:
You are right, [~jingzhao], it brings a
[
https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14104684#comment-14104684
]
Todd Lipcon commented on HDFS-3689:
---
The replication issue with sparse files isn't new.
[
https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14104713#comment-14104713
]
Andrey Stepachev commented on HDFS-3689:
[~tlipcon], here can be full sparse
[
https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14091390#comment-14091390
]
Jing Zhao commented on HDFS-3689:
-
Looks like we do not have a lot of dependency on the
[
https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14091434#comment-14091434
]
Doug Cutting commented on HDFS-3689:
Many applications assume that blocks but the last
[
https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13422602#comment-13422602
]
Suresh Srinivas commented on HDFS-3689:
---
My feeling is it should be able to start and
[
https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13418712#comment-13418712
]
Suresh Srinivas commented on HDFS-3689:
---
Some of the use cases include - support for
[
https://issues.apache.org/jira/browse/HDFS-3689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13418800#comment-13418800
]
Todd Lipcon commented on HDFS-3689:
---
Hey Suresh. This is an interesting idea which I've
62 matches
Mail list logo
