[jira] [Created] (HDFS-10919) Provide admin/debug tool to dump out info of a given block

[Yongjun Zhang (JIRA)]

Yongjun Zhang created HDFS-10919:


 Summary: Provide admin/debug tool to dump out info of a given block
 Key: HDFS-10919
 URL: https://issues.apache.org/jira/browse/HDFS-10919
 Project: Hadoop HDFS
  Issue Type: New Feature
  Components: hdfs
Reporter: Yongjun Zhang


We have fsck to find out blocks associated with a file, which is nice. 
Sometimes, we saw trouble with a specific block, we'd like to collect info 
about this block, such as
* what file this block belong to, 
* where the replicas of this block are located, 
* whether the block is EC coded; 
* if a block is EC coded, whether it's a data block, or code
* if a block is EC coded, what's the codec.
* if a block is EC coded, what's the block group
* for the block group, what are the other blocks

Create this jira to provide such a util, as dfsadmin, or a debug tool.

Thanks.





--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org

[jira] [Created] (HDFS-10918) Add a tool to get FileEncryptionInfo from CLI

[Xiao Chen (JIRA)]

Xiao Chen created HDFS-10918:


 Summary: Add a tool to get FileEncryptionInfo from CLI
 Key: HDFS-10918
 URL: https://issues.apache.org/jira/browse/HDFS-10918
 Project: Hadoop HDFS
  Issue Type: New Feature
  Components: encryption
Reporter: Xiao Chen
Assignee: Xiao Chen






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org

[jira] [Created] (HDFS-10917) Maintain various peer performance statistics on DataNode

[Xiaobing Zhou (JIRA)]

Xiaobing Zhou created HDFS-10917:


 Summary: Maintain various peer performance statistics on DataNode
 Key: HDFS-10917
 URL: https://issues.apache.org/jira/browse/HDFS-10917
 Project: Hadoop HDFS
  Issue Type: Improvement
  Components: datanode
Affects Versions: 2.8.0
Reporter: Xiaobing Zhou
Assignee: Xiaobing Zhou






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org

Re: [VOTE] Release Apache Hadoop 2.6.5 (RC0)

[Lei Xu]

+1

The steps I've done:

* Downloaded release tar and source tar, verified MD5.
* Run a HDFS cluster, and copy files between local filesystem and HDFS.


On Tue, Sep 27, 2016 at 1:28 PM, Sangjin Lee  wrote:
> Hi folks,
>
> I have created a release candidate RC0 for the Apache Hadoop 2.6.5 release
> (the next maintenance release in the 2.6.x release line). Below are the
> details of this release candidate:
>
> The RC is available for validation at:
> http://home.apache.org/~sjlee/hadoop-2.6.5-RC0/.
>
> The RC tag in git is release-2.6.5-RC0 and its git commit is
> 6939fc935fba5651fdb33386d88aeb8e875cf27a.
>
> The maven artifacts are staged via repository.apache.org at:
> https://repository.apache.org/content/repositories/orgapachehadoop-1048/.
>
> You can find my public key at
> http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS.
>
> Please try the release and vote. The vote will run for the usual 5 days.
> Huge thanks to Chris Trezzo for spearheading the release management and
> doing all the work!
>
> Thanks,
> Sangjin



-- 
Lei (Eddy) Xu
Software Engineer, Cloudera

-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org

[jira] [Created] (HDFS-10916) Switch from "raw" to "system" namespace for erasure coding policy

[Andrew Wang (JIRA)]

Andrew Wang created HDFS-10916:
--

 Summary: Switch from "raw" to "system" namespace for erasure 
coding policy
 Key: HDFS-10916
 URL: https://issues.apache.org/jira/browse/HDFS-10916
 Project: Hadoop HDFS
  Issue Type: Sub-task
  Components: erasure-coding
Affects Versions: 3.0.0-alpha1
Reporter: Andrew Wang
Assignee: Andrew Wang


Currently EC policy is stored as in the raw xattr namespace. It would be better 
to store this in "system" like storage policy.

Raw is meant for attributes which need to be preserved across a distcp, like 
encryption info. EC policy is more similar to replication factor or storage 
policy, which can differ between the src and target of a distcp. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org

[jira] [Created] (HDFS-10915) fix typo in TestDatanodeRestart#testWaitForRegistrationOnRestart

[Xiaobing Zhou (JIRA)]

Xiaobing Zhou created HDFS-10915:


 Summary: fix typo in 
TestDatanodeRestart#testWaitForRegistrationOnRestart
 Key: HDFS-10915
 URL: https://issues.apache.org/jira/browse/HDFS-10915
 Project: Hadoop HDFS
  Issue Type: Bug
Reporter: Xiaobing Zhou
Assignee: Xiaobing Zhou


It should be milliseconds in the message of IOException.

{code}
} catch (org.apache.hadoop.ipc.RemoteException e) {
long elapsed = System.currentTimeMillis() - start;
// timers have at-least semantics, so it should be at least 5 seconds.
if (elapsed < 5000 || elapsed > 1) {
  throw new IOException(elapsed + " seconds passed.", e);
}
  }
{code}




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org

[jira] [Created] (HDFS-10914) Move remnants of oah.hdfs.client to hadoop-hdfs-client

[Andrew Wang (JIRA)]

Andrew Wang created HDFS-10914:
--

 Summary: Move remnants of oah.hdfs.client to hadoop-hdfs-client
 Key: HDFS-10914
 URL: https://issues.apache.org/jira/browse/HDFS-10914
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: hdfs-client
Affects Versions: 2.8.0
Reporter: Andrew Wang
Assignee: Andrew Wang
Priority: Critical


Some remaining classes in the oah.hdfs.client package are still in hadoop-hdfs 
rather than hadoop-hdfs-client.

This broke a client that depended on hadoop-client for HdfsAdmin. hadoop-client 
now pulls in hadoop-hdfs-client rather than hadoop-hdfs, meaning it lost access 
to HdfsAdmin.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org

[jira] [Created] (HDFS-10913) Refactor BlockReceiver by introducing faults injector to enhance testability of detecting slow mirrors

[Xiaobing Zhou (JIRA)]

Xiaobing Zhou created HDFS-10913:


 Summary: Refactor BlockReceiver by introducing faults injector to 
enhance testability of detecting slow mirrors
 Key: HDFS-10913
 URL: https://issues.apache.org/jira/browse/HDFS-10913
 Project: Hadoop HDFS
  Issue Type: Bug
Reporter: Xiaobing Zhou
Assignee: Xiaobing Zhou






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org

[VOTE] Release Apache Hadoop 2.6.5 (RC0)

[Sangjin Lee]

Hi folks,

I have created a release candidate RC0 for the Apache Hadoop 2.6.5 release
(the next maintenance release in the 2.6.x release line). Below are the
details of this release candidate:

The RC is available for validation at:
http://home.apache.org/~sjlee/hadoop-2.6.5-RC0/.

The RC tag in git is release-2.6.5-RC0 and its git commit is
6939fc935fba5651fdb33386d88aeb8e875cf27a.

The maven artifacts are staged via repository.apache.org at:
https://repository.apache.org/content/repositories/orgapachehadoop-1048/.

You can find my public key at
http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS.

Please try the release and vote. The vote will run for the usual 5 days.
Huge thanks to Chris Trezzo for spearheading the release management and
doing all the work!

Thanks,
Sangjin

[jira] [Created] (HDFS-10912) Ozone:SCM: Add safe mode support to NodeManager.

[Anu Engineer (JIRA)]

Anu Engineer created HDFS-10912:
---

 Summary: Ozone:SCM: Add safe mode support to NodeManager.
 Key: HDFS-10912
 URL: https://issues.apache.org/jira/browse/HDFS-10912
 Project: Hadoop HDFS
  Issue Type: Sub-task
  Components: ozone
Affects Versions: HDFS-7240
Reporter: Anu Engineer
Assignee: Anu Engineer


Add Safe mode support : That is add the ability to force exit or enter safe 
mode. As well as get the current safe mode status from node manager.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org

Apache Hadoop qbt Report: trunk+JDK8 on Linux/ppc64le

[Apache Jenkins Server]

For more details, see 
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/107/

[Sep 26, 2016 2:41:16 PM] (jianhe) YARN-5609. Expose upgrade and restart API in
[Sep 26, 2016 3:36:59 PM] (Arun Suresh) Revert "YARN-5609. Expose upgrade and 
restart API in
[Sep 26, 2016 3:46:54 PM] (Arun Suresh) YARN-5609. Expose upgrade and restart 
API in
[Sep 26, 2016 8:00:57 PM] (xiao) HADOOP-13638. KMS should set UGI's 
Configuration object properly.
[Sep 26, 2016 8:11:32 PM] (weichiu) HDFS-10609. Uncaught 
InvalidEncryptionKeyException during pipeline
[Sep 26, 2016 9:41:04 PM] (weichiu) Addendum patch for HDFS-10609. Uncaught 
InvalidEncryptionKeyException
[Sep 27, 2016 12:09:47 AM] (arp) HDFS-10713. Throttle FsNameSystem lock 
warnings. Contributed by Hanisha
[Sep 27, 2016 1:34:37 AM] (brahma) HDFS-9444. Add utility to find set of 
available ephemeral ports to
[Sep 27, 2016 5:15:12 AM] (brahma) HDFS-9885. Correct the distcp counters name 
while displaying counters.
[Sep 27, 2016 11:07:59 AM] (naganarasimha_gr) YARN-5660. Wrong audit constants 
are used in Get/Put of priority in




-1 overall


The following subsystems voted -1:
compile unit


The following subsystems voted -1 but
were configured to be filtered/ignored:
cc javac


The following subsystems are considered long running:
(runtime bigger than 1h  0m  0s)
unit


Specific tests:

Failed junit tests :

   hadoop.security.token.delegation.TestZKDelegationTokenSecretManager 
   hadoop.hdfs.TestWriteReadStripedFile 
   hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewer 
   hadoop.hdfs.TestFileCorruption 
   hadoop.hdfs.web.TestWebHdfsTimeouts 
   hadoop.hdfs.server.namenode.ha.TestHASafeMode 
   hadoop.contrib.bkjournal.TestBootstrapStandbyWithBKJM 
   hadoop.yarn.server.nodemanager.recovery.TestNMLeveldbStateStoreService 
   hadoop.yarn.server.nodemanager.TestNodeManagerShutdown 
   
hadoop.yarn.server.nodemanager.containermanager.queuing.TestQueuingContainerManager
 
   hadoop.yarn.server.timeline.TestRollingLevelDB 
   hadoop.yarn.server.applicationhistoryservice.webapp.TestAHSWebServices 
   hadoop.yarn.server.timeline.TestTimelineDataManager 
   hadoop.yarn.server.timeline.TestLeveldbTimelineStore 
   hadoop.yarn.server.timeline.recovery.TestLeveldbTimelineStateStore 
   hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore 
   
hadoop.yarn.server.applicationhistoryservice.TestApplicationHistoryServer 
   hadoop.yarn.server.timelineservice.storage.common.TestRowKeys 
   hadoop.yarn.server.timelineservice.storage.common.TestKeyConverters 
   hadoop.yarn.server.timelineservice.storage.common.TestSeparator 
   hadoop.yarn.server.resourcemanager.security.TestDelegationTokenRenewer 
   hadoop.yarn.server.resourcemanager.recovery.TestLeveldbRMStateStore 
   hadoop.yarn.server.resourcemanager.TestRMRestart 
   hadoop.yarn.server.resourcemanager.TestResourceTrackerService 
   hadoop.yarn.server.TestMiniYarnClusterNodeUtilization 
   hadoop.yarn.server.TestContainerManagerSecurity 
   hadoop.yarn.server.timeline.TestLevelDBCacheTimelineStore 
   hadoop.yarn.server.timeline.TestOverrideTimelineStoreYarnClient 
   hadoop.yarn.server.timeline.TestEntityGroupFSTimelineStore 
   hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorage 
   
hadoop.yarn.server.timelineservice.storage.flow.TestHBaseStorageFlowRunCompaction
 
   hadoop.yarn.server.timelineservice.storage.flow.TestHBaseStorageFlowRun 
   
hadoop.yarn.server.timelineservice.storage.TestPhoenixOfflineAggregationWriterImpl
 
   
hadoop.yarn.server.timelineservice.reader.TestTimelineReaderWebServicesHBaseStorage
 
   
hadoop.yarn.server.timelineservice.storage.flow.TestHBaseStorageFlowActivity 
   hadoop.yarn.applications.distributedshell.TestDistributedShell 
   hadoop.mapred.TestShuffleHandler 
   hadoop.mapreduce.v2.hs.TestHistoryServerLeveldbStateStoreService 
   hadoop.mapred.TestMiniMRWithDFSWithDistinctUsers 
   hadoop.contrib.bkjournal.TestBootstrapStandbyWithBKJM 

Timed out junit tests :

   org.apache.hadoop.hdfs.server.datanode.TestFsDatasetCache 
   org.apache.hadoop.mapred.TestMRIntermediateDataEncryption 
   org.apache.hadoop.mapred.TestMROpportunisticMaps 
  

   compile:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/107/artifact/out/patch-compile-root.txt
  [308K]

   cc:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/107/artifact/out/patch-compile-root.txt
  [308K]

   javac:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/107/artifact/out/patch-compile-root.txt
  [308K]

   unit:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/107/artifact/out/patch-unit-hadoop-common-project_hadoop-common.txt
  [120K]
   

[jira] [Created] (HDFS-10911) Change edit log OP_UPDATE_BLOCKS to store delta blocks only.

[Lei (Eddy) Xu (JIRA)]

Lei (Eddy) Xu created HDFS-10911:


 Summary: Change edit log OP_UPDATE_BLOCKS to store delta blocks 
only.
 Key: HDFS-10911
 URL: https://issues.apache.org/jira/browse/HDFS-10911
 Project: Hadoop HDFS
  Issue Type: Improvement
  Components: namenode
Affects Versions: 3.0.0-alpha1, 2.7.3
Reporter: Lei (Eddy) Xu
Assignee: Lei (Eddy) Xu


Every time a HDFS client {{close}}  or {{hflush}} an open file, NameNode 
enumerates all the blocks  and stores then into edit log (OP_UPDATE_BLOCKS). 

It would cause problem when the client is appending a large file frequently 
(i.e., WAL). 

Because HDFS is append only, we can only store the blocks that have been 
changed (delta blocks) in edit log.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

[Apache Jenkins Server]

For more details, see 
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/177/

[Sep 26, 2016 2:41:16 PM] (jianhe) YARN-5609. Expose upgrade and restart API in
[Sep 26, 2016 3:36:59 PM] (Arun Suresh) Revert "YARN-5609. Expose upgrade and 
restart API in
[Sep 26, 2016 3:46:54 PM] (Arun Suresh) YARN-5609. Expose upgrade and restart 
API in
[Sep 26, 2016 8:00:57 PM] (xiao) HADOOP-13638. KMS should set UGI's 
Configuration object properly.
[Sep 26, 2016 8:11:32 PM] (weichiu) HDFS-10609. Uncaught 
InvalidEncryptionKeyException during pipeline
[Sep 26, 2016 9:41:04 PM] (weichiu) Addendum patch for HDFS-10609. Uncaught 
InvalidEncryptionKeyException
[Sep 27, 2016 12:09:47 AM] (arp) HDFS-10713. Throttle FsNameSystem lock 
warnings. Contributed by Hanisha
[Sep 27, 2016 1:34:37 AM] (brahma) HDFS-9444. Add utility to find set of 
available ephemeral ports to
[Sep 27, 2016 5:15:12 AM] (brahma) HDFS-9885. Correct the distcp counters name 
while displaying counters.




-1 overall


The following subsystems voted -1:
asflicense unit


The following subsystems voted -1 but
were configured to be filtered/ignored:
cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace


The following subsystems are considered long running:
(runtime bigger than 1h  0m  0s)
unit


Specific tests:

Failed junit tests :

   hadoop.yarn.server.applicationhistoryservice.webapp.TestAHSWebServices 
   hadoop.yarn.server.TestMiniYarnClusterNodeUtilization 
   hadoop.yarn.server.TestContainerManagerSecurity 
  

   cc:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/177/artifact/out/diff-compile-cc-root.txt
  [4.0K]

   javac:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/177/artifact/out/diff-compile-javac-root.txt
  [168K]

   checkstyle:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/177/artifact/out/diff-checkstyle-root.txt
  [16M]

   pylint:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/177/artifact/out/diff-patch-pylint.txt
  [16K]

   shellcheck:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/177/artifact/out/diff-patch-shellcheck.txt
  [20K]

   shelldocs:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/177/artifact/out/diff-patch-shelldocs.txt
  [16K]

   whitespace:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/177/artifact/out/whitespace-eol.txt
  [11M]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/177/artifact/out/whitespace-tabs.txt
  [1.3M]

   javadoc:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/177/artifact/out/diff-javadoc-javadoc-root.txt
  [2.2M]

   unit:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/177/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-applicationhistoryservice.txt
  [12K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/177/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests.txt
  [268K]
   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/177/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-nativetask.txt
  [124K]

   asflicense:

   
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/177/artifact/out/patch-asflicense-problems.txt
  [4.0K]

Powered by Apache Yetus 0.4.0-SNAPSHOT   http://yetus.apache.org



-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org

[jira] [Created] (HDFS-10910) HDFS Erasure Coding doc should state its currently supported erasure coding policies

[Wei-Chiu Chuang (JIRA)]

Wei-Chiu Chuang created HDFS-10910:
--

 Summary: HDFS Erasure Coding doc should state its currently 
supported erasure coding policies
 Key: HDFS-10910
 URL: https://issues.apache.org/jira/browse/HDFS-10910
 Project: Hadoop HDFS
  Issue Type: Improvement
Affects Versions: 3.0.0-alpha1
Reporter: Wei-Chiu Chuang


While HDFS Erasure Coding doc states a variety of possible combinations of 
algorithms, block group size and cell size, the code (as of 3.0.0-alpha1) 
allows only three policies: RS_6_3_SCHEMA, RS_3_2_SCHEMA and 
RS_6_3_LEGACY_SCHEMA. All with default cell size. I think this should be 
documented.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org

[jira] [Created] (HDFS-10909) De-duplicate code in ErasureCodingWorker#initializeStripedReadThreadPool and DFSClient#initThreadsNumForStripedReads

[Wei-Chiu Chuang (JIRA)]

Wei-Chiu Chuang created HDFS-10909:
--

 Summary: De-duplicate code in 
ErasureCodingWorker#initializeStripedReadThreadPool and 
DFSClient#initThreadsNumForStripedReads
 Key: HDFS-10909
 URL: https://issues.apache.org/jira/browse/HDFS-10909
 Project: Hadoop HDFS
  Issue Type: Improvement
Reporter: Wei-Chiu Chuang
Priority: Minor


The two methods are mostly the same. Maybe it make sense to deduplicate the 
code. A good place to place the code is DFSUtilClient



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org

[jira] [Created] (HDFS-10908) Improve StripedBlockReader#createBlockReader error logging

[Wei-Chiu Chuang (JIRA)]

Wei-Chiu Chuang created HDFS-10908:
--

 Summary: Improve StripedBlockReader#createBlockReader error logging
 Key: HDFS-10908
 URL: https://issues.apache.org/jira/browse/HDFS-10908
 Project: Hadoop HDFS
  Issue Type: Improvement
  Components: erasure-coding
Reporter: Wei-Chiu Chuang
Priority: Minor


In {{StripedBlockReader#createBlockReader}} if any IOException is thrown, the 
error is logged at debug level and then returns a null. This means in a typical 
configuration an NPE may be thrown without logging a cause if the 
StripedBlockReader object is accessed.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org

[jira] [Created] (HDFS-10907) Fix Erasure Coding documentation

[Wei-Chiu Chuang (JIRA)]

Wei-Chiu Chuang created HDFS-10907:
--

 Summary: Fix Erasure Coding documentation
 Key: HDFS-10907
 URL: https://issues.apache.org/jira/browse/HDFS-10907
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: documentation, erasure-coding
Affects Versions: 3.0.0-alpha1
Reporter: Wei-Chiu Chuang
Priority: Trivial


Found one error in HDFSErasureCoding.md, missed by HDFS-9097:

Under 
bq. `policyName`: The ErasureCoding policy to be used for files under this 
directory. This is an optional parameter, specified using ‘-s’ flag.

It should be '-p'.

The same error also appears in HDFSCommands.md:

{quote}
Usage:

   hdfs erasurecode \[generic options]
 \[-setPolicy \[-s ] ]
{quote}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org