[jira] [Updated] (HDFS-8374) Remove chunkSize from ECSchema as its not required for coders

[ https://issues.apache.org/jira/browse/HDFS-8374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-8374: Status: Patch Available (was: Open) As HDFS-8382 committed, submitting patch now. Remove

[jira] [Updated] (HDFS-8374) Remove chunkSize from ECSchema as its not required for coders

[ https://issues.apache.org/jira/browse/HDFS-8374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-8374: Issue Type: Bug (was: Sub-task) Parent: (was: HDFS-7285) Remove chunkSize from

[jira] [Updated] (HDFS-8408) Revisit and refactor ErasureCodingInfo

[ https://issues.apache.org/jira/browse/HDFS-8408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-8408: Resolution: Fixed Fix Version/s: HDFS-7285 Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-8408) Revisit and refactor ErasureCodingInfo

[ https://issues.apache.org/jira/browse/HDFS-8408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14558003#comment-14558003 ] Vinayakumar B commented on HDFS-8408: - Thanks [~szetszwo] for the review. I will commit

[jira] [Updated] (HDFS-8463) Calling DFSInputStream.seekToNewSource just after stream creation causes NullPointerException

[ https://issues.apache.org/jira/browse/HDFS-8463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-8463: --- Attachment: HDFS-8463.001.patch I think there should be guard because {{seekToNewSource}} is

[jira] [Commented] (HDFS-8474) Impala compilation breaks with libhdfs in 2.7 as getJNIEnv is not visible

[ https://issues.apache.org/jira/browse/HDFS-8474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14558077#comment-14558077 ] Varun Saxena commented on HDFS-8474: This fails because now by default visibility has

[jira] [Updated] (HDFS-8474) Impala compilation breaks with libhdfs in 2.7 as getJNIEnv is not visible

[ https://issues.apache.org/jira/browse/HDFS-8474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated HDFS-8474: --- Status: Patch Available (was: Open) Impala compilation breaks with libhdfs in 2.7 as getJNIEnv is

[jira] [Created] (HDFS-8474) Impala compilation breaks with libhdfs in 2.7 as getJNIEnv is not visible

Varun Saxena created HDFS-8474: -- Summary: Impala compilation breaks with libhdfs in 2.7 as getJNIEnv is not visible Key: HDFS-8474 URL: https://issues.apache.org/jira/browse/HDFS-8474 Project: Hadoop

[jira] [Updated] (HDFS-8474) Impala compilation breaks with libhdfs in 2.7 as getJNIEnv is not visible

[ https://issues.apache.org/jira/browse/HDFS-8474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated HDFS-8474: --- Attachment: HDFS-8474.01.patch Impala compilation breaks with libhdfs in 2.7 as getJNIEnv is not

[jira] [Created] (HDFS-8473) createErasureCodingZone should check whether cellSize is available

Yong Zhang created HDFS-8473: Summary: createErasureCodingZone should check whether cellSize is available Key: HDFS-8473 URL: https://issues.apache.org/jira/browse/HDFS-8473 Project: Hadoop HDFS

[jira] [Commented] (HDFS-8474) Impala compilation breaks with libhdfs in 2.7 as getJNIEnv is not visible

[ https://issues.apache.org/jira/browse/HDFS-8474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14558089#comment-14558089 ] Kiran Kumar M R commented on HDFS-8474: --- On second thought, I checked getJNIEnv()

[jira] [Commented] (HDFS-8474) Impala compilation breaks with libhdfs in 2.7 as getJNIEnv is not visible

[ https://issues.apache.org/jira/browse/HDFS-8474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14558099#comment-14558099 ] Kiran Kumar M R commented on HDFS-8474: --- Link to Impala JIRA

[jira] [Created] (HDFS-8475) Exception in createBlockOutputStream java.io.EOFException: Premature EOF: no length prefix available

Vinod Valecha created HDFS-8475: --- Summary: Exception in createBlockOutputStream java.io.EOFException: Premature EOF: no length prefix available Key: HDFS-8475 URL: https://issues.apache.org/jira/browse/HDFS-8475

[jira] [Commented] (HDFS-8474) Impala compilation breaks with libhdfs in 2.7 as getJNIEnv is not visible

[ https://issues.apache.org/jira/browse/HDFS-8474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14558082#comment-14558082 ] Kiran Kumar M R commented on HDFS-8474: --- LGTM {{LIBHDFS_EXTERNAL}} is already defined

[jira] [Commented] (HDFS-8474) Impala compilation breaks with libhdfs in 2.7 as getJNIEnv is not visible

[ https://issues.apache.org/jira/browse/HDFS-8474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14558096#comment-14558096 ] Varun Saxena commented on HDFS-8474: Yeah, I have raised an issue in Impala JIRA too

[jira] [Commented] (HDFS-8474) Impala compilation breaks with libhdfs in 2.7 as getJNIEnv is not visible

[ https://issues.apache.org/jira/browse/HDFS-8474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14558095#comment-14558095 ] Varun Saxena commented on HDFS-8474: Yeah, I have raised an issue in Impala JIRA too

[jira] [Updated] (HDFS-8474) Impala compilation breaks with libhdfs in 2.7 as getJNIEnv is not visible

[ https://issues.apache.org/jira/browse/HDFS-8474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated HDFS-8474: --- Description: Impala in CDH 5.2.0 is not compiling with libhdfs.so in 2.7.0 on RedHat 6.4. This is

[jira] [Commented] (HDFS-8377) Support HTTP/2 in datanode

[ https://issues.apache.org/jira/browse/HDFS-8377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14558147#comment-14558147 ] Hudson commented on HDFS-8377: -- SUCCESS: Integrated in Hadoop-Yarn-trunk-Java8 #207 (See

[jira] [Commented] (HDFS-8377) Support HTTP/2 in datanode

[ https://issues.apache.org/jira/browse/HDFS-8377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14558151#comment-14558151 ] Hudson commented on HDFS-8377: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #938 (See

[jira] [Resolved] (HDFS-8473) createErasureCodingZone should check whether cellSize is available

[ https://issues.apache.org/jira/browse/HDFS-8473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yong Zhang resolved HDFS-8473. -- Resolution: Not A Problem Not a issue createErasureCodingZone should check whether cellSize is

[jira] [Commented] (HDFS-8474) Impala compilation breaks with libhdfs in 2.7 as getJNIEnv is not visible

[ https://issues.apache.org/jira/browse/HDFS-8474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14558172#comment-14558172 ] Hadoop QA commented on HDFS-8474: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (HDFS-8474) Impala compilation breaks with libhdfs in 2.7 as getJNIEnv is not visible

[ https://issues.apache.org/jira/browse/HDFS-8474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14558253#comment-14558253 ] Varun Saxena commented on HDFS-8474: Weird result from Jenkins. Gives NoSuchMethodError

[jira] [Commented] (HDFS-8474) Impala compilation breaks with libhdfs in 2.7 as getJNIEnv is not visible

[ https://issues.apache.org/jira/browse/HDFS-8474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14558252#comment-14558252 ] Varun Saxena commented on HDFS-8474: Weird result from Jenkins. Gives NoSuchMethodError

[jira] [Commented] (HDFS-8377) Support HTTP/2 in datanode

[ https://issues.apache.org/jira/browse/HDFS-8377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14558284#comment-14558284 ] Hudson commented on HDFS-8377: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2136 (See

[jira] [Commented] (HDFS-8377) Support HTTP/2 in datanode

[ https://issues.apache.org/jira/browse/HDFS-8377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14558333#comment-14558333 ] Hudson commented on HDFS-8377: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #206 (See

[jira] [Commented] (HDFS-8377) Support HTTP/2 in datanode

[ https://issues.apache.org/jira/browse/HDFS-8377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14558293#comment-14558293 ] Hudson commented on HDFS-8377: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #196 (See

[jira] [Commented] (HDFS-8452) In WebHDFS, duplicate directory creation is not throwing exception.

[ https://issues.apache.org/jira/browse/HDFS-8452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14558315#comment-14558315 ] Jagadesh Kiran N commented on HDFS-8452: please clarify on the above comments.

[jira] [Updated] (HDFS-8433) blockToken is not set in constructInternalBlock and parseStripedBlockGroup in StripedBlockUtil

[ https://issues.apache.org/jira/browse/HDFS-8433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-8433: Attachment: HDFS-8433.00.patch 00 initial patch: 1. Token support block Id range. So inner blocks of a block

[jira] [Commented] (HDFS-8377) Support HTTP/2 in datanode

[ https://issues.apache.org/jira/browse/HDFS-8377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14558339#comment-14558339 ] Hudson commented on HDFS-8377: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2154 (See

[jira] [Commented] (HDFS-8474) Impala compilation breaks with libhdfs in 2.7 as getJNIEnv is not visible

[ https://issues.apache.org/jira/browse/HDFS-8474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14558426#comment-14558426 ] Allen Wittenauer commented on HDFS-8474: bq. There is no reason for libhdfs to

[jira] [Updated] (HDFS-8319) Erasure Coding: support decoding for stateful read

[ https://issues.apache.org/jira/browse/HDFS-8319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8319: Attachment: HDFS-8319.001.patch Initial patch. The main change is to unify the stateful read code and the

[jira] [Commented] (HDFS-8465) Mover is success even when space exceeds storage quota.

[ https://issues.apache.org/jira/browse/HDFS-8465?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14558554#comment-14558554 ] Tsz Wo Nicholas Sze commented on HDFS-8465: --- Mover is similar to replication --

[jira] [Commented] (HDFS-8366) Erasure Coding: Make the timeout parameter of polling blocking queue configurable in DFSStripedOutputStream

[ https://issues.apache.org/jira/browse/HDFS-8366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14558551#comment-14558551 ] Tsz Wo Nicholas Sze commented on HDFS-8366: --- FYI, the blocking queue timeout (and

[jira] [Updated] (HDFS-8254) In StripedDataStreamer, it is hard to tolerate datanode failure in the leading streamer

[ https://issues.apache.org/jira/browse/HDFS-8254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8254: -- Attachment: h8254_20150526.patch h8254_20150526.patch: removes leading streamer code and

[jira] [Updated] (HDFS-8254) In StripedDataStreamer, it is hard to tolerate datanode failure in the leading streamer

[ https://issues.apache.org/jira/browse/HDFS-8254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8254: -- Attachment: h8254_20150526b.patch h8254_20150526b.patch: revises javadoc. In

[jira] [Updated] (HDFS-8452) In WebHDFS, duplicate directory creation is not throwing exception.

[ https://issues.apache.org/jira/browse/HDFS-8452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8452: - Fix Version/s: (was: 3.0.0) In WebHDFS, duplicate directory creation is not throwing exception.

[jira] [Updated] (HDFS-8463) Calling DFSInputStream.seekToNewSource just after stream creation causes NullPointerException

[ https://issues.apache.org/jira/browse/HDFS-8463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Masatake Iwasaki updated HDFS-8463: --- Status: Patch Available (was: Open) Calling DFSInputStream.seekToNewSource just after stream

[jira] [Commented] (HDFS-8452) In WebHDFS, duplicate directory creation is not throwing exception.

[ https://issues.apache.org/jira/browse/HDFS-8452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14558638#comment-14558638 ] Haohui Mai commented on HDFS-8452: -- {quote} 1. If this is an Idempotent Operation

[jira] [Updated] (HDFS-8453) Erasure coding: properly assign start offset for internal blocks in a block group

[ https://issues.apache.org/jira/browse/HDFS-8453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8453: Attachment: HDFS-8453-HDFS-7285.00.patch Erasure coding: properly assign start offset for internal blocks

[jira] [Updated] (HDFS-8453) Erasure coding: properly assign start offset for internal blocks in a block group

[ https://issues.apache.org/jira/browse/HDFS-8453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8453: Status: Patch Available (was: In Progress) Actually it's not possible to assign meaningful start offset

[jira] [Updated] (HDFS-8453) Erasure coding: properly assign start offset for internal blocks in a block group

[ https://issues.apache.org/jira/browse/HDFS-8453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8453: Description: (was: {{LocatedBlock#offset}} should indicate the offset of the first byte of the block in

[jira] [Commented] (HDFS-8452) In WebHDFS, duplicate directory creation is not throwing exception.

[ https://issues.apache.org/jira/browse/HDFS-8452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14558674#comment-14558674 ] Jagadesh Kiran N commented on HDFS-8452: Ok , Got you Haohui Mai ,Thanks for your

[jira] [Commented] (HDFS-8062) Remove hard-coded values in favor of EC schema

[ https://issues.apache.org/jira/browse/HDFS-8062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14558663#comment-14558663 ] Kai Zheng commented on HDFS-8062: - A quick look found this. Please note chunkSize had been

[jira] [Commented] (HDFS-8453) Erasure coding: properly assign start offset for internal blocks in a block group

[ https://issues.apache.org/jira/browse/HDFS-8453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14558671#comment-14558671 ] Zhe Zhang commented on HDFS-8453: - Moving initial description as a comment to avoid

[jira] [Commented] (HDFS-8463) Calling DFSInputStream.seekToNewSource just after stream creation causes NullPointerException

[ https://issues.apache.org/jira/browse/HDFS-8463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14558712#comment-14558712 ] Hadoop QA commented on HDFS-8463: - \\ \\ | (/) *{color:green}+1 overall{color}* | \\ \\ ||