Re: Hadoop 3.2 Release Plan proposal

2018-07-19 Thread Sunil G
Thanks Subru for the thoughts. One of the main reason for a major release is to push out critical features with a faster cadence to the users. If we are pulling more and more different types of features to a minor release, that branch will become more destabilized and it may be tough to say that

[jira] [Resolved] (HDDS-209) createVolume command throws error when user is not present locally but creates the volume

2018-07-19 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao resolved HDDS-209. - Resolution: Duplicate This is a dup of HDDS-138 > createVolume command throws error when user is not

Apache Hadoop qbt Report: trunk+JDK8 on Windows/x64

2018-07-19 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-trunk-win/532/ [Jul 18, 2018 6:05:42 PM] (xyao) HDDS-207. ozone listVolume command accepts random values as argument. [Jul 18, 2018 6:46:26 PM] (xyao) HDDS-255. Fix TestOzoneConfigurationFields for missing [Jul 19, 2018 12:09:43 AM]

[jira] [Created] (HDFS-13750) RBF: Router ID in RouterRpcClient is always null

2018-07-19 Thread Takanobu Asanuma (JIRA)
Takanobu Asanuma created HDFS-13750: --- Summary: RBF: Router ID in RouterRpcClient is always null Key: HDFS-13750 URL: https://issues.apache.org/jira/browse/HDFS-13750 Project: Hadoop HDFS

[jira] [Created] (HDDS-270) Move generic container utils to ContianerUitls

2018-07-19 Thread Hanisha Koneru (JIRA)
Hanisha Koneru created HDDS-270: --- Summary: Move generic container utils to ContianerUitls Key: HDDS-270 URL: https://issues.apache.org/jira/browse/HDDS-270 Project: Hadoop Distributed Data Store

[jira] [Created] (HDDS-271) Create a block iterator to iterate blocks in a container

2018-07-19 Thread Bharat Viswanadham (JIRA)
Bharat Viswanadham created HDDS-271: --- Summary: Create a block iterator to iterate blocks in a container Key: HDDS-271 URL: https://issues.apache.org/jira/browse/HDDS-271 Project: Hadoop Distributed

Re: Hadoop 3.2 Release Plan proposal

2018-07-19 Thread Subru Krishnan
Thanks Sunil for volunteering to lead the release effort. I am generally supportive of a release but -1 on a 3.2 (prefer a 3.1.x) as feel we already have too many branches to be maintained. I already see many commits are in different branches with no apparent rationale, for e.g: 3.1 has commits

[jira] [Created] (HDDS-268) Add SCM close container watcher

2018-07-19 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDDS-268: --- Summary: Add SCM close container watcher Key: HDDS-268 URL: https://issues.apache.org/jira/browse/HDDS-268 Project: Hadoop Distributed Data Store Issue Type: Bug

[jira] [Created] (HDDS-269) Refactor IdentifiableEventPayload to use a long ID

2018-07-19 Thread Xiaoyu Yao (JIRA)
Xiaoyu Yao created HDDS-269: --- Summary: Refactor IdentifiableEventPayload to use a long ID Key: HDDS-269 URL: https://issues.apache.org/jira/browse/HDDS-269 Project: Hadoop Distributed Data Store

[jira] [Resolved] (HDDS-131) Replace pipeline info from container info with a pipeline id

2018-07-19 Thread Xiaoyu Yao (JIRA)
[ https://issues.apache.org/jira/browse/HDDS-131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao resolved HDDS-131. - Resolution: Implemented This has been implemented with HDDS-16 and HDDS-175.  > Replace pipeline info

Apache Hadoop qbt Report: trunk+JDK8 on Windows/x64

2018-07-19 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-trunk-win/531/ [Jul 14, 2018 1:17:53 AM] (aw) YETUS-639. hadoop: parallel tests on < 2.8.0 are not guarateed to work [Jul 17, 2018 8:49:44 PM] (aw) YETUS-641. Hardcoded pylint version [Jul 18, 2018 4:38:43 PM] (xyao) HDDS-241. Handle

[jira] [Created] (HDDS-263) Add retries in Ozone Client to handle BLOCK_NOT_COMMITTED Exception

2018-07-19 Thread Shashikant Banerjee (JIRA)
Shashikant Banerjee created HDDS-263: Summary: Add retries in Ozone Client to handle BLOCK_NOT_COMMITTED Exception Key: HDDS-263 URL: https://issues.apache.org/jira/browse/HDDS-263 Project:

Re: Hadoop 3.2 Release Plan proposal

2018-07-19 Thread Wangda Tan
Thanks Sunil for volunteering to be RM of 3.2 release, +1 for that. To concerns from Steve, It is a good idea to keep the door open to get important changes / features in before cutoff. I would prefer to keep the proposed release date to make sure things can happen earlier instead of last minute

Re: Hadoop 3.2 Release Plan proposal

2018-07-19 Thread Sunil G
Thanks Steve, Aaron, Wangda for sharing thoughts. Yes, important changes and features are much needed, hence we will be keeping the door open for them as possible. Also considering few more offline requests from other folks, I think extending the timeframe by couple of weeks makes sense

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2018-07-19 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/841/ [Jul 18, 2018 4:38:43 PM] (xyao) HDDS-241. Handle Volume in inconsistent state. Contributed by Hanisha [Jul 18, 2018 6:05:42 PM] (xyao) HDDS-207. ozone listVolume command accepts random values as

[jira] [Created] (HDDS-264) 'oz' subcommand reference is not present in 'ozone' command help

2018-07-19 Thread Nilotpal Nandi (JIRA)
Nilotpal Nandi created HDDS-264: --- Summary: 'oz' subcommand reference is not present in 'ozone' command help Key: HDDS-264 URL: https://issues.apache.org/jira/browse/HDDS-264 Project: Hadoop Distributed

[jira] [Created] (HDFS-13748) Hadoop 3.0.3 docker building when pip install pylint return typed_ast required py3 error

2018-07-19 Thread zhouhao (JIRA)
zhouhao created HDFS-13748: -- Summary: Hadoop 3.0.3 docker building when pip install pylint return typed_ast required py3 error Key: HDFS-13748 URL: https://issues.apache.org/jira/browse/HDFS-13748 Project:

[jira] [Created] (HDDS-265) Move numPendingDeletionBlocks and deleteTransactionId from ContainerData to KeyValueContainerData

2018-07-19 Thread Hanisha Koneru (JIRA)
Hanisha Koneru created HDDS-265: --- Summary: Move numPendingDeletionBlocks and deleteTransactionId from ContainerData to KeyValueContainerData Key: HDDS-265 URL: https://issues.apache.org/jira/browse/HDDS-265

[jira] [Created] (HDDS-266) Integrate checksum into .container file

2018-07-19 Thread Hanisha Koneru (JIRA)
Hanisha Koneru created HDDS-266: --- Summary: Integrate checksum into .container file Key: HDDS-266 URL: https://issues.apache.org/jira/browse/HDDS-266 Project: Hadoop Distributed Data Store

[jira] [Created] (HDDS-267) Handle consistency issues during container update/close

2018-07-19 Thread Hanisha Koneru (JIRA)
Hanisha Koneru created HDDS-267: --- Summary: Handle consistency issues during container update/close Key: HDDS-267 URL: https://issues.apache.org/jira/browse/HDDS-267 Project: Hadoop Distributed Data

[jira] [Created] (HDFS-13749) Implement a new client protocol method to get NameNode state

2018-07-19 Thread Chao Sun (JIRA)
Chao Sun created HDFS-13749: --- Summary: Implement a new client protocol method to get NameNode state Key: HDFS-13749 URL: https://issues.apache.org/jira/browse/HDFS-13749 Project: Hadoop HDFS

Re: Apache Hadoop 3.1.1 release plan

2018-07-19 Thread Wangda Tan
Hi all, After several blockers of 3.1.1 landed, I think we're pretty close to a clean 3.1.1 branch ready for RC. By far we have two blockers targeted 3.1.1 [1], and there're 420 tickets have fix version = 3.1.1 [2] As we previously communicated for 3.1.1 release date (May 01), we have delayed