Re: [VOTE] Release Apache Hadoop 3.0.3 (RC0)

2018-08-13 Thread Vinod Kumar Vavilapalli 
Yongjun,

Looks like you didn't add the links to 3.0.3 binary release on the 
http://hadoop.apache.org/releases.html page.

I just did it, FYI: 
https://svn.apache.org/viewvc?view=revision=1837967 


Thanks
+Vinod


> On May 31, 2018, at 10:48 PM, Yongjun Zhang  wrote:
> 
> Greetings all,
> 
> I've created the first release candidate (RC0) for Apache Hadoop
> 3.0.3. This is our next maintenance release to follow up 3.0.2. It includes
> about 249
> important fixes and improvements, among which there are 8 blockers. See
> https://issues.apache.org/jira/issues/?filter=12343997
> 
> The RC artifacts are available at:
> https://dist.apache.org/repos/dist/dev/hadoop/3.0.3-RC0/
> 
> The maven artifacts are available via
> https://repository.apache.org/content/repositories/orgapachehadoop-1126
> 
> Please try the release and vote; the vote will run for the usual 5 working
> days, ending on 06/07/2018 PST time. Would really appreciate your
> participation here.
> 
> I bumped into quite some issues along the way, many thanks to quite a few
> people who helped, especially Sammi Chen, Andrew Wang, Junping Du, Eddy Xu.
> 
> Thanks,
> 
> --Yongjun

[jira] [Created] (HDFS-13823) NameNode UI : "Utilities -> Browse the file system -> open a file -> Head the file" is not working

2018-08-13 Thread Nanda kumar (JIRA) 
Nanda kumar created HDFS-13823:
--

 Summary: NameNode UI : "Utilities -> Browse the file system -> 
open a file -> Head the file" is not working
 Key: HDFS-13823
 URL: https://issues.apache.org/jira/browse/HDFS-13823
 Project: Hadoop HDFS
  Issue Type: Bug
  Components: ui
Affects Versions: 3.1.1
Reporter: Nanda kumar
Assignee: Nanda kumar


In NameNode UI 'Head the file' and 'Tail the file' links under {{'Utilities -> 
Browse the file system -> open a file'}} are not working. The file contents box 
is coming up as empty.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2018-08-13 Thread Apache Jenkins Server 
For more details, see 
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/867/

[Aug 12, 2018 10:05:52 AM] (umamahesh) HDFS-10794. [SPS]: Provide storage 
policy satisfy worker at DN for
[Aug 12, 2018 10:05:53 AM] (umamahesh) HDFS-10800: [SPS]: Daemon thread in 
Namenode to find blocks placed in
[Aug 12, 2018 10:05:53 AM] (umamahesh) HDFS-10801. [SPS]: Protocol buffer 
changes for sending storage movement
[Aug 12, 2018 10:05:53 AM] (umamahesh) HDFS-10884: [SPS]: Add block movement 
tracker to track the completion of
[Aug 12, 2018 10:05:53 AM] (umamahesh) HDFS-10954. [SPS]: Provide mechanism to 
send blocks movement result back
[Aug 12, 2018 10:05:53 AM] (umamahesh) HDFS-11029. [SPS]:Provide retry 
mechanism for the blocks which were
[Aug 12, 2018 10:05:54 AM] (umamahesh) HDFS-11068: [SPS]: Provide unique 
trackID to track the block movement
[Aug 12, 2018 10:05:54 AM] (umamahesh) HDFS-10802. [SPS]: Add 
satisfyStoragePolicy API in HdfsAdmin.
[Aug 12, 2018 10:05:54 AM] (umamahesh) HDFS-11151. [SPS]: 
StoragePolicySatisfier should gracefully handle when
[Aug 12, 2018 10:05:55 AM] (umamahesh) HDFS-10885. [SPS]: Mover tool should not 
be allowed to run when Storage
[Aug 12, 2018 10:05:55 AM] (umamahesh) HDFS-11123. [SPS] Make storage policy 
satisfier daemon work on/off
[Aug 12, 2018 10:05:55 AM] (umamahesh) HDFS-11032: [SPS]: Handling of block 
movement failure at the coordinator
[Aug 12, 2018 10:05:55 AM] (umamahesh) HDFS-11248: [SPS]: Handle partial block 
location movements. Contributed
[Aug 12, 2018 10:05:56 AM] (umamahesh) HDFS-11193 : [SPS]: Erasure coded files 
should be considered for
[Aug 12, 2018 10:05:56 AM] (umamahesh) HDFS-11289. [SPS]: Make SPS movement 
monitor timeouts configurable.
[Aug 12, 2018 10:05:56 AM] (umamahesh) HDFS-11293: [SPS]: Local DN should be 
given preference as source node,
[Aug 12, 2018 10:05:57 AM] (umamahesh) HDFS-11150: [SPS]: Provide persistence 
when satisfying storage policy.
[Aug 12, 2018 10:05:57 AM] (umamahesh) HDFS-11186. [SPS]: Daemon thread of SPS 
should start only in Active NN.
[Aug 12, 2018 10:05:57 AM] (umamahesh) HDFS-11309. [SPS]: 
chooseTargetTypeInSameNode should pass accurate block
[Aug 12, 2018 10:05:57 AM] (umamahesh) HDFS-11243. [SPS]: Add a protocol 
command from NN to DN for dropping the
[Aug 12, 2018 10:05:57 AM] (umamahesh) HDFS-11239: [SPS]: Check Mover file ID 
lease also to determine whether
[Aug 12, 2018 10:05:58 AM] (umamahesh) HDFS-11336: [SPS]: Remove xAttrs when 
movements done or SPS disabled.
[Aug 12, 2018 10:05:58 AM] (umamahesh) HDFS-11338: [SPS]: Fix timeout issue in 
unit tests caused by longger NN
[Aug 12, 2018 10:05:58 AM] (umamahesh) HDFS-11334: [SPS]: NN switch and 
rescheduling movements can lead to have
[Aug 12, 2018 10:05:58 AM] (umamahesh) HDFS-11572. [SPS]: SPS should clean 
Xattrs when no blocks required to
[Aug 12, 2018 10:05:59 AM] (umamahesh) HDFS-11695: [SPS]: Namenode failed to 
start while loading SPS xAttrs
[Aug 12, 2018 10:05:59 AM] (umamahesh) HDFS-11883: [SPS] : Handle NPE in 
BlockStorageMovementTracker when
[Aug 12, 2018 10:05:59 AM] (umamahesh) HDFS-11762. [SPS]: Empty files should be 
ignored in
[Aug 12, 2018 10:05:59 AM] (umamahesh) HDFS-11726. [SPS]: 
StoragePolicySatisfier should not select same storage
[Aug 12, 2018 10:05:59 AM] (umamahesh) HDFS-11966. [SPS] Correct the log in
[Aug 12, 2018 10:05:59 AM] (umamahesh) HDFS-11670: [SPS]: Add CLI command for 
satisfy storage policy
[Aug 12, 2018 10:06:00 AM] (umamahesh) HDFS-11965: [SPS]: Should give chance to 
satisfy the low redundant
[Aug 12, 2018 10:06:00 AM] (umamahesh) HDFS-11264: [SPS]: Double checks to 
ensure that SPS/Mover are not
[Aug 12, 2018 10:06:00 AM] (umamahesh) HDFS-11874. [SPS]: Document the SPS 
feature. Contributed by Uma
[Aug 12, 2018 10:06:00 AM] (umamahesh) HDFS-12146. [SPS]: Fix
[Aug 12, 2018 10:06:00 AM] (umamahesh) HDFS-12141: [SPS]: Fix checkstyle 
warnings. Contributed by Rakesh R.
[Aug 12, 2018 10:06:00 AM] (umamahesh) HDFS-12152: [SPS]: Re-arrange 
StoragePolicySatisfyWorker stopping
[Aug 12, 2018 10:06:01 AM] (umamahesh) HDFS-12214: [SPS]: Fix review comments 
of StoragePolicySatisfier
[Aug 12, 2018 10:06:01 AM] (umamahesh) HDFS-12225: [SPS]: Optimize extended 
attributes for tracking SPS
[Aug 12, 2018 10:06:01 AM] (umamahesh) HDFS-12291: [SPS]: Provide a mechanism 
to recursively iterate and
[Aug 12, 2018 10:06:01 AM] (umamahesh) HDFS-12570: [SPS]: Refactor Co-ordinator 
datanode logic to track the
[Aug 12, 2018 10:06:01 AM] (umamahesh) HDFS-12556: [SPS] : Block movement 
analysis should be done in read lock.
[Aug 12, 2018 10:06:02 AM] (umamahesh) HDFS-12310: [SPS]: Provide an option to 
track the status of in progress
[Aug 12, 2018 10:06:02 AM] (umamahesh) HDFS-12790: [SPS]: Rebasing HDFS-10285 
branch after HDFS-10467,
[Aug 12, 2018 10:06:02 AM] (umamahesh) HDFS-12106: [SPS]: Improve storage 
policy satisfier configurations.
[Aug 12, 2018 10:06:02 AM] (umamahesh) HDFS-12955: [SPS]: Move SPS classes to a 
separate

[jira] [Created] (HDFS-13822) speedup libhdfs++ build (enable parallel build)

2018-08-13 Thread Pradeep Ambati (JIRA) 
Pradeep Ambati created HDFS-13822:
-

 Summary: speedup libhdfs++ build (enable parallel build)
 Key: HDFS-13822
 URL: https://issues.apache.org/jira/browse/HDFS-13822
 Project: Hadoop HDFS
  Issue Type: Improvement
Reporter: Pradeep Ambati


libhdfs++ has significantly increased clean build times for the native client 
on trunk. Problem is that libhdfs++ isn't build in parallel. When I tried to 
force a parallel build by specifying -Dnative_make_args=-j4, the build fails 
due to dependencies.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org

Apache Hadoop qbt Report: trunk+JDK8 on Windows/x64

2018-08-13 Thread Apache Jenkins Server 
For more details, see https://builds.apache.org/job/hadoop-trunk-win/557/

[Aug 13, 2018 7:17:52 AM] (msingh) HDDS-308. SCM should identify a container 
with pending deletes using
[Aug 13, 2018 8:52:55 AM] (sunilg) YARN-8561. [Submarine] Initial 
implementation: Training job submission
[Aug 13, 2018 9:32:56 AM] (drankye) HDFS-13668. FSPermissionChecker may throws 
AIOOE when check inode
[Aug 13, 2018 10:57:45 AM] (ewan.higgs) HADOOP-15645. 
ITestS3GuardToolLocal.testDiffCommand fails if bucket has


ERROR: File 'out/email-report.txt' does not exist

-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org

[jira] [Created] (HDDS-349) Ozone Datanode throws exception while sending datanode reports

2018-08-13 Thread Mukul Kumar Singh (JIRA) 
Mukul Kumar Singh created HDDS-349:
--

 Summary: Ozone Datanode throws exception while sending datanode 
reports
 Key: HDDS-349
 URL: https://issues.apache.org/jira/browse/HDDS-349
 Project: Hadoop Distributed Data Store
  Issue Type: Bug
  Components: Ozone Datanode
Affects Versions: 0.2.1
Reporter: Mukul Kumar Singh
 Fix For: 0.2.1


Following exception was seen while datanode was sending datanode report

{code}
2018-08-13 12:28:57,425 INFO  ozone.MiniOzoneClusterImpl 
(MiniOzoneClusterImpl.java:lambda$waitForClusterToBeReady$0(119)) - Waiting for 
cluster to be ready. Got 0 of 1 DN Heartbeats.
2018-08-13 12:28:58,428 INFO  ozone.MiniOzoneClusterImpl 
(MiniOzoneClusterImpl.java:lambda$waitForClusterToBeReady$0(119)) - Waiting for 
cluster to be ready. Got 0 of 1 DN Heartbeats.
2018-08-13 12:28:59,428 INFO  ozone.MiniOzoneClusterImpl 
(MiniOzoneClusterImpl.java:lambda$waitForClusterToBeReady$0(119)) - Waiting for 
cluster to be ready. Got 0 of 1 DN Heartbeats.
2018-08-13 12:29:00,311 WARN  concurrent.ExecutorHelper 
(ExecutorHelper.java:logThrowableFromAfterExecute(50)) - Execution exception 
when running task in Datanode ReportManager Thread - 0
2018-08-13 12:29:00,311 WARN  concurrent.ExecutorHelper 
(ExecutorHelper.java:logThrowableFromAfterExecute(63)) - Caught exception in 
thread Datanode ReportManager Thread - 0: 
java.lang.NullPointerException
at 
org.apache.hadoop.ozone.container.common.volume.VolumeInfo.getScmUsed(VolumeInfo.java:107)
at 
org.apache.hadoop.ozone.container.common.volume.VolumeSet.getNodeReport(VolumeSet.java:366)
at 
org.apache.hadoop.ozone.container.ozoneimpl.OzoneContainer.getNodeReport(OzoneContainer.java:262)
at 
org.apache.hadoop.ozone.container.common.report.NodeReportPublisher.getReport(NodeReportPublisher.java:64)
at 
org.apache.hadoop.ozone.container.common.report.NodeReportPublisher.getReport(NodeReportPublisher.java:39)
at 
org.apache.hadoop.ozone.container.common.report.ReportPublisher.publishReport(ReportPublisher.java:86)
at 
org.apache.hadoop.ozone.container.common.report.ReportPublisher.run(ReportPublisher.java:73)
at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at 
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at 
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
{code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org