date:20200929

Hadoop 3.2.2 Release Code Freeze Plan

2020-09-29 Thread Xiaoqiao He

Hi All,

Plan to code frozen for Hadoop-3.2.2 release at 2020/10/15. From now on,
most of the issues have been resolved. And there are two JIRA still open
which target to 3.2.2 traced by [1].

* https://issues.apache.org/jira/browse/YARN-10244
* https://issues.apache.org/jira/browse/HADOOP-17287

Please let us know if this is really blocking for 3.2.2, if not kindly move
it out. If required to involve in 3.2.2, Please try to push them forward
recently.

Thanks & Best Regards,
He Xiaoqiao

[1]
https://issues.apache.org/jira/secure/Dashboard.jspa?selectPageId=12335948

Re: [VOTE] Moving Ozone to a separated Apache project

2020-09-29 Thread Brahma Reddy Battula

+1


On Wed, 30 Sep 2020 at 6:06 AM, Wei-Chiu Chuang  wrote:

> +1
>
>
>
> Look forward to it.
>
>
>
> On Tue, Sep 29, 2020 at 4:48 PM Konstantin Shvachko 
>
> wrote:
>
>
>
> > +1
>
> >
>
> > Stay safe,
>
> > --Konstantin
>
> >
>
> > On Thu, Sep 24, 2020 at 10:59 PM Elek, Marton  wrote:
>
> >
>
> > > Hi all,
>
> > >
>
> > > Thank you for all the feedback and requests,
>
> > >
>
> > > As we discussed in the previous thread(s) [1], Ozone is proposed to be
> a
>
> > > separated Apache Top Level Project (TLP)
>
> > >
>
> > > The proposal with all the details, motivation and history is here:
>
> > >
>
> > >
>
> > >
>
> >
> https://cwiki.apache.org/confluence/display/HADOOP/Ozone+Hadoop+subproject+to+Apache+TLP+proposal
>
> > >
>
> > > This voting runs for 7 days and will be concluded at 2nd of October,
> 6AM
>
> > > GMT.
>
> > >
>
> > > Thanks,
>
> > > Marton Elek
>
> > >
>
> > > [1]:
>
> > >
>
> > >
>
> >
> https://lists.apache.org/thread.html/rc6c79463330b3e993e24a564c6817aca1d290f186a1206c43ff0436a%40%3Chdfs-dev.hadoop.apache.org%3E
>
> > >
>
> > > -
>
> > > To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
>
> > > For additional commands, e-mail: common-dev-h...@hadoop.apache.org
>
> > >
>
> > >
>
> >
>
> --



--Brahma Reddy Battula

Re: [VOTE] Moving Ozone to a separated Apache project

2020-09-29 Thread Konstantin Shvachko

+1

Stay safe,
--Konstantin

On Thu, Sep 24, 2020 at 10:59 PM Elek, Marton  wrote:

> Hi all,
>
> Thank you for all the feedback and requests,
>
> As we discussed in the previous thread(s) [1], Ozone is proposed to be a
> separated Apache Top Level Project (TLP)
>
> The proposal with all the details, motivation and history is here:
>
>
> https://cwiki.apache.org/confluence/display/HADOOP/Ozone+Hadoop+subproject+to+Apache+TLP+proposal
>
> This voting runs for 7 days and will be concluded at 2nd of October, 6AM
> GMT.
>
> Thanks,
> Marton Elek
>
> [1]:
>
> https://lists.apache.org/thread.html/rc6c79463330b3e993e24a564c6817aca1d290f186a1206c43ff0436a%40%3Chdfs-dev.hadoop.apache.org%3E
>
> -
> To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
> For additional commands, e-mail: common-dev-h...@hadoop.apache.org
>
>

Re: [VOTE] Moving Ozone to a separated Apache project

2020-09-29 Thread Mingliang Liu

+1

On Tue, Sep 29, 2020 at 3:44 PM Wangda Tan  wrote:

> +1,
>
> Thanks,
> Wangda Tan
>
> On Tue, Sep 29, 2020 at 10:10 AM Aravindan Vijayan
>  wrote:
>
> > +1, thank you Marton.
> >
> > On Tue, Sep 29, 2020 at 9:17 AM Bharat Viswanadham 
> > wrote:
> >
> > > +1
> > > Thank You @Elek, Marton  for driving this.
> > >
> > >
> > > Thanks,
> > > Bharat
> > >
> > >
> > > On Mon, Sep 28, 2020 at 10:54 AM Vivek Ratnavel <
> > vivekratna...@apache.org>
> > > wrote:
> > >
> > > > +1 for moving Ozone to a separated Top-Level Apache Project.
> > > >
> > > > Thanks,
> > > > Vivek Subramanian
> > > >
> > > > On Mon, Sep 28, 2020 at 8:30 AM Hanisha Koneru
> > > > 
> > > > wrote:
> > > >
> > > > > +1
> > > > >
> > > > > Thanks,
> > > > > Hanisha
> > > > >
> > > > > > On Sep 27, 2020, at 11:48 PM, Akira Ajisaka  >
> > > > wrote:
> > > > > >
> > > > > > +1
> > > > > >
> > > > > > Thanks,
> > > > > > Akira
> > > > > >
> > > > > > On Fri, Sep 25, 2020 at 3:00 PM Elek, Marton  > >  > > > > e...@apache.org>> wrote:
> > > > > >>
> > > > > >> Hi all,
> > > > > >>
> > > > > >> Thank you for all the feedback and requests,
> > > > > >>
> > > > > >> As we discussed in the previous thread(s) [1], Ozone is proposed
> > to
> > > > be a
> > > > > >> separated Apache Top Level Project (TLP)
> > > > > >>
> > > > > >> The proposal with all the details, motivation and history is
> here:
> > > > > >>
> > > > > >>
> > > > >
> > > >
> > >
> >
> https://cwiki.apache.org/confluence/display/HADOOP/Ozone+Hadoop+subproject+to+Apache+TLP+proposal
> > > > > >>
> > > > > >> This voting runs for 7 days and will be concluded at 2nd of
> > October,
> > > > 6AM
> > > > > >> GMT.
> > > > > >>
> > > > > >> Thanks,
> > > > > >> Marton Elek
> > > > > >>
> > > > > >> [1]:
> > > > > >>
> > > > >
> > > >
> > >
> >
> https://lists.apache.org/thread.html/rc6c79463330b3e993e24a564c6817aca1d290f186a1206c43ff0436a%40%3Chdfs-dev.hadoop.apache.org%3E
> > > > > >>
> > > > > >>
> > > -
> > > > > >> To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org
> > > >  > > > > yarn-dev-unsubscr...@hadoop.apache.org>
> > > > > >> For additional commands, e-mail:
> yarn-dev-h...@hadoop.apache.org
> > > > > 
> > > > > >>
> > > > > >
> > > > > >
> > -
> > > > > > To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
> > > > > 
> > > > > > For additional commands, e-mail:
> common-dev-h...@hadoop.apache.org
> > > > > 
> > > > >
> > > >
> > >
> >
> >
> > --
> > Thanks & Regards,
> > Aravindan
> >
>

Re: [VOTE] Moving Ozone to a separated Apache project

2020-09-29 Thread Wangda Tan

+1,

Thanks,
Wangda Tan

On Tue, Sep 29, 2020 at 10:10 AM Aravindan Vijayan
 wrote:

> +1, thank you Marton.
>
> On Tue, Sep 29, 2020 at 9:17 AM Bharat Viswanadham 
> wrote:
>
> > +1
> > Thank You @Elek, Marton  for driving this.
> >
> >
> > Thanks,
> > Bharat
> >
> >
> > On Mon, Sep 28, 2020 at 10:54 AM Vivek Ratnavel <
> vivekratna...@apache.org>
> > wrote:
> >
> > > +1 for moving Ozone to a separated Top-Level Apache Project.
> > >
> > > Thanks,
> > > Vivek Subramanian
> > >
> > > On Mon, Sep 28, 2020 at 8:30 AM Hanisha Koneru
> > > 
> > > wrote:
> > >
> > > > +1
> > > >
> > > > Thanks,
> > > > Hanisha
> > > >
> > > > > On Sep 27, 2020, at 11:48 PM, Akira Ajisaka 
> > > wrote:
> > > > >
> > > > > +1
> > > > >
> > > > > Thanks,
> > > > > Akira
> > > > >
> > > > > On Fri, Sep 25, 2020 at 3:00 PM Elek, Marton  >  > > > e...@apache.org>> wrote:
> > > > >>
> > > > >> Hi all,
> > > > >>
> > > > >> Thank you for all the feedback and requests,
> > > > >>
> > > > >> As we discussed in the previous thread(s) [1], Ozone is proposed
> to
> > > be a
> > > > >> separated Apache Top Level Project (TLP)
> > > > >>
> > > > >> The proposal with all the details, motivation and history is here:
> > > > >>
> > > > >>
> > > >
> > >
> >
> https://cwiki.apache.org/confluence/display/HADOOP/Ozone+Hadoop+subproject+to+Apache+TLP+proposal
> > > > >>
> > > > >> This voting runs for 7 days and will be concluded at 2nd of
> October,
> > > 6AM
> > > > >> GMT.
> > > > >>
> > > > >> Thanks,
> > > > >> Marton Elek
> > > > >>
> > > > >> [1]:
> > > > >>
> > > >
> > >
> >
> https://lists.apache.org/thread.html/rc6c79463330b3e993e24a564c6817aca1d290f186a1206c43ff0436a%40%3Chdfs-dev.hadoop.apache.org%3E
> > > > >>
> > > > >>
> > -
> > > > >> To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org
> > >  > > > yarn-dev-unsubscr...@hadoop.apache.org>
> > > > >> For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org
> > > > 
> > > > >>
> > > > >
> > > > >
> -
> > > > > To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
> > > > 
> > > > > For additional commands, e-mail: common-dev-h...@hadoop.apache.org
> > > > 
> > > >
> > >
> >
>
>
> --
> Thanks & Regards,
> Aravindan
>

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86_64

2020-09-29 Thread Apache Jenkins Server

For more details, see 
https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/280/

[Sep 28, 2020 9:27:41 AM] (noreply) HDFS-15577. Refactor TestTracing. (#2302)
[Sep 28, 2020 4:40:39 PM] (Iñigo Goiri) HDFS-15530. RBF: Fix typo in 
DFS_ROUTER_QUOTA_CACHE_UPDATE_INTERVAL var definition. Contributed by Sha 
Fanghao.
[Sep 28, 2020 4:54:01 PM] (noreply) HDFS-15604. Fix Typo for 
HdfsDataNodeAdminGuide doc (#2345)
[Sep 28, 2020 6:25:31 PM] (Ayush Saxena) HDFS-15591. RBF: Fix webHdfs file 
display error. Contributed by wangzhaohui.
[Sep 28, 2020 6:33:11 PM] (Ayush Saxena) HDFS-15603. RBF: Fix 
getLocationsForPath twice in create operation. Contributed by wangzhaohui.




-1 overall


The following subsystems voted -1:
asflicense pathlen unit xml


The following subsystems voted -1 but
were configured to be filtered/ignored:
cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace


The following subsystems are considered long running:
(runtime bigger than 1h  0m  0s)
unit


Specific tests:

XML :

   Parsing Error(s): 
   
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/resources/nvidia-smi-output-excerpt.xml
 
   
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/resources/nvidia-smi-output-missing-tags.xml
 
   
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/resources/nvidia-smi-output-missing-tags2.xml
 
   
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/resources/nvidia-smi-sample-output.xml
 
   
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/resources/fair-scheduler-invalid.xml
 
   
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/resources/yarn-site-with-invalid-allocation-file-ref.xml
 

Failed junit tests :

   hadoop.crypto.key.kms.server.TestKMS 
   hadoop.hdfs.TestFileChecksum 
   hadoop.hdfs.TestDFSClientRetries 
   hadoop.hdfs.server.balancer.TestBalancerWithMultipleNameNodes 
   hadoop.hdfs.TestViewDistributedFileSystem 
   hadoop.hdfs.TestStripedFileAppend 
   hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureReporting 
   hadoop.hdfs.server.datanode.TestDataNodeErasureCodingMetrics 
   hadoop.hdfs.server.sps.TestExternalStoragePolicySatisfier 
   hadoop.hdfs.TestMaintenanceState 
   
hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistReplicaRecovery 
   hadoop.hdfs.TestDFSInputStream 
   hadoop.hdfs.web.TestWebHDFS 
   hadoop.hdfs.server.blockmanagement.TestBlockTokenWithDFSStriped 
   hadoop.hdfs.TestDFSOutputStream 
   hadoop.hdfs.TestErasureCodingPolicyWithSnapshotWithRandomECPolicy 
   hadoop.hdfs.TestReconstructStripedFile 
   hadoop.hdfs.TestSafeModeWithStripedFileWithRandomECPolicy 
   hadoop.hdfs.server.federation.router.TestRouterQuota 
   
hadoop.yarn.server.resourcemanager.scheduler.fair.TestFairSchedulerOvercommit 
   
hadoop.yarn.server.resourcemanager.metrics.TestCombinedSystemMetricsPublisher 
   hadoop.yarn.applications.distributedshell.TestDistributedShell 
   hadoop.mapreduce.v2.hs.TestJobIdHistoryFileInfoMap 
   hadoop.mapred.TestMRTimelineEventHandling 
   hadoop.yarn.service.TestYarnNativeServices 
   hadoop.tools.dynamometer.TestDynamometerInfra 
   hadoop.tools.dynamometer.TestDynamometerInfra 
  

   cc:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/280/artifact/out/diff-compile-cc-root.txt
  [48K]

   javac:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/280/artifact/out/diff-compile-javac-root.txt
  [568K]

   checkstyle:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/280/artifact/out/diff-checkstyle-root.txt
  [16M]

   pathlen:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/280/artifact/out/pathlen.txt
  [12K]

   pylint:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/280/artifact/out/diff-patch-pylint.txt
  [60K]

   shellcheck:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/280/artifact/out/diff-patch-shellcheck.txt
  [20K]

   shelldocs:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/280/artifact/out/diff-patch-shelldocs.txt
  [44K]

   whitespace:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/280/artifact/out/whitespace-eol.txt
  [13M]
   
https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/280/artifact/out/whitespace-tabs.txt
  [1.9M]

   xml:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/280/artifact/out/xml.txt
  [24K]

   javadoc:

[jira] [Created] (YARN-10450) Add cpu and memory utilization per node and cluster-wide metrics

2020-09-29 Thread Jim Brennan (Jira)

Jim Brennan created YARN-10450:
--

 Summary: Add cpu and memory utilization per node and cluster-wide 
metrics
 Key: YARN-10450
 URL: https://issues.apache.org/jira/browse/YARN-10450
 Project: Hadoop YARN
  Issue Type: Improvement
  Components: yarn
Affects Versions: 3.3.1
Reporter: Jim Brennan
Assignee: Jim Brennan


Add metrics to show actual cpu and memory utilization for each node and 
aggregated for the entire cluster.  This is information is already passed from 
NM to RM in the node status update.
We have been running with this internally for quite a while and found it useful 
to be able to quickly see the actual cpu/memory utilization on the 
node/cluster.  It's especially useful if some form of overcommit is used.




--
This message was sent by Atlassian Jira
(v8.3.4#803005)

-
To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org

Re: [VOTE] Moving Ozone to a separated Apache project

2020-09-29 Thread Bharat Viswanadham

+1
Thank You @Elek, Marton  for driving this.


Thanks,
Bharat


On Mon, Sep 28, 2020 at 10:54 AM Vivek Ratnavel 
wrote:

> +1 for moving Ozone to a separated Top-Level Apache Project.
>
> Thanks,
> Vivek Subramanian
>
> On Mon, Sep 28, 2020 at 8:30 AM Hanisha Koneru
> 
> wrote:
>
> > +1
> >
> > Thanks,
> > Hanisha
> >
> > > On Sep 27, 2020, at 11:48 PM, Akira Ajisaka 
> wrote:
> > >
> > > +1
> > >
> > > Thanks,
> > > Akira
> > >
> > > On Fri, Sep 25, 2020 at 3:00 PM Elek, Marton  > e...@apache.org>> wrote:
> > >>
> > >> Hi all,
> > >>
> > >> Thank you for all the feedback and requests,
> > >>
> > >> As we discussed in the previous thread(s) [1], Ozone is proposed to
> be a
> > >> separated Apache Top Level Project (TLP)
> > >>
> > >> The proposal with all the details, motivation and history is here:
> > >>
> > >>
> >
> https://cwiki.apache.org/confluence/display/HADOOP/Ozone+Hadoop+subproject+to+Apache+TLP+proposal
> > >>
> > >> This voting runs for 7 days and will be concluded at 2nd of October,
> 6AM
> > >> GMT.
> > >>
> > >> Thanks,
> > >> Marton Elek
> > >>
> > >> [1]:
> > >>
> >
> https://lists.apache.org/thread.html/rc6c79463330b3e993e24a564c6817aca1d290f186a1206c43ff0436a%40%3Chdfs-dev.hadoop.apache.org%3E
> > >>
> > >> -
> > >> To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org
>  > yarn-dev-unsubscr...@hadoop.apache.org>
> > >> For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org
> > 
> > >>
> > >
> > > -
> > > To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
> > 
> > > For additional commands, e-mail: common-dev-h...@hadoop.apache.org
> > 
> >
>

Re: [VOTE] Moving Ozone to a separated Apache project

2020-09-29 Thread Subru Krishnan

+1

Thanks,
Subru

On Mon, Sep 28, 2020 at 6:49 AM Adam Antal 
wrote:

> +1
>
> Thanks,
> Adam Antal
>
> On Mon, Sep 28, 2020 at 2:19 PM 孙立晟  wrote:
>
> > +1
> >
> > Thanks,
> > Lisheng Sun
> >
> > Masatake Iwasaki  于2020年9月28日周一 下午7:19写道：
> >
> > > +1
> > >
> > > Thanks,
> > > Masatake Iwasaki
> > >
> > > On 2020/09/25 14:59, Elek, Marton wrote:
> > > > Hi all,
> > > >
> > > > Thank you for all the feedback and requests,
> > > >
> > > > As we discussed in the previous thread(s) [1], Ozone is proposed to
> be
> > a
> > > separated Apache Top Level Project (TLP)
> > > >
> > > > The proposal with all the details, motivation and history is here:
> > > >
> > > >
> > >
> >
> https://cwiki.apache.org/confluence/display/HADOOP/Ozone+Hadoop+subproject+to+Apache+TLP+proposal
> > > >
> > > > This voting runs for 7 days and will be concluded at 2nd of October,
> > 6AM
> > > GMT.
> > > >
> > > > Thanks,
> > > > Marton Elek
> > > >
> > > > [1]:
> > >
> >
> https://lists.apache.org/thread.html/rc6c79463330b3e993e24a564c6817aca1d290f186a1206c43ff0436a%40%3Chdfs-dev.hadoop.apache.org%3E
> > > >
> > > > -
> > > > To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
> > > > For additional commands, e-mail: common-dev-h...@hadoop.apache.org
> > > >
> > >
> > > -
> > > To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
> > > For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
> > >
> > >
> >
>

Apache Hadoop qbt Report: branch-2.10+JDK7 on Linux/x86_64

2020-09-29 Thread Apache Jenkins Server

For more details, see 
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/71/

No changes




-1 overall


The following subsystems voted -1:
asflicense hadolint jshint pathlen unit xml


The following subsystems voted -1 but
were configured to be filtered/ignored:
cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace


The following subsystems are considered long running:
(runtime bigger than 1h  0m  0s)
unit


Specific tests:

XML :

   Parsing Error(s): 
   hadoop-build-tools/src/main/resources/checkstyle/checkstyle.xml 
   hadoop-build-tools/src/main/resources/checkstyle/suppressions.xml 
   
hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/conf/empty-configuration.xml
 
   hadoop-tools/hadoop-azure/src/config/checkstyle-suppressions.xml 
   hadoop-tools/hadoop-azure/src/config/checkstyle.xml 
   hadoop-tools/hadoop-resourceestimator/src/config/checkstyle.xml 
   hadoop-yarn-project/hadoop-yarn/hadoop-yarn-ui/public/crossdomain.xml 
   
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-ui/src/main/webapp/public/crossdomain.xml
 

Failed junit tests :

   hadoop.hdfs.qjournal.server.TestJournalNodeRespectsBindHostKeys 
   
hadoop.hdfs.server.blockmanagement.TestReplicationPolicyWithUpgradeDomain 
   hadoop.contrib.bkjournal.TestBookKeeperHACheckpoints 
   hadoop.hdfs.server.federation.router.TestRouterQuota 
   hadoop.hdfs.server.federation.router.TestRouterNamenodeHeartbeat 
   hadoop.hdfs.server.federation.resolver.order.TestLocalResolver 
   hadoop.hdfs.server.federation.resolver.TestMultipleDestinationResolver 
   hadoop.contrib.bkjournal.TestBookKeeperHACheckpoints 
   hadoop.mapreduce.jobhistory.TestHistoryViewerPrinter 
   hadoop.resourceestimator.service.TestResourceEstimatorService 
   hadoop.resourceestimator.solver.impl.TestLpSolver 
   hadoop.yarn.server.resourcemanager.TestClientRMService 
  

   jshint:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/71/artifact/out/diff-patch-jshint.txt
  [208K]

   cc:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/71/artifact/out/diff-compile-cc-root.txt
  [4.0K]

   javac:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/71/artifact/out/diff-compile-javac-root.txt
  [456K]

   checkstyle:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/71/artifact/out/diff-checkstyle-root.txt
  [16M]

   hadolint:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/71/artifact/out/diff-patch-hadolint.txt
  [4.0K]

   pathlen:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/71/artifact/out/pathlen.txt
  [12K]

   pylint:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/71/artifact/out/diff-patch-pylint.txt
  [60K]

   shellcheck:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/71/artifact/out/diff-patch-shellcheck.txt
  [56K]

   shelldocs:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/71/artifact/out/diff-patch-shelldocs.txt
  [8.0K]

   whitespace:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/71/artifact/out/whitespace-eol.txt
  [12M]
   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/71/artifact/out/whitespace-tabs.txt
  [1.3M]

   xml:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/71/artifact/out/xml.txt
  [4.0K]

   javadoc:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/71/artifact/out/diff-javadoc-javadoc-root.txt
  [20K]

   unit:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/71/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
  [272K]
   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/71/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs-rbf.txt
  [36K]
   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/71/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs_src_contrib_bkjournal.txt
  [12K]
   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/71/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-core.txt
  [96K]
   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/71/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt
  [104K]
   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/71/artifact/out/patch-unit-hadoop-tools_hadoop-resourceestimator.txt
  [16K]

Re: Precommit job fails to write comments in the GitHub pull requests

2020-09-29 Thread Masatake Iwasaki


Hi Akira,

Thanks for working on this.
It looks like you are trying token on PR #2348.
https://github.com/apache/hadoop/pull/2348

It it does not work, I think option #4 is reasonable.
I prefer using fixed/static version of toolchain in order to
avoid surprising the developers.
We can upgrade Yetus when JDK11 Javadoc issue is fixed.

Regards,
Masatake Iwasaki

On 2020/09/29 2:55, Akira Ajisaka wrote:

Apache Hadoop developers,

After YETUS-994, the jenkins job updates the commit status instead of
writing a comment to the pull request. It requires an OAuth token with
write access to "repo:status" but now there is no such token for
Apache Hadoop. I asked the infra team to create a token:
https://issues.apache.org/jira/browse/INFRA-20906

For now, I think there 4 options to get the information:

1. Attach a patch to the JIRA instead of GitHub
2. Update the Jenkinsfile for a while (Sample PR:
https://github.com/apache/hadoop/pull/2346)
3. Search the job and get the comment from
https://ci-hadoop.apache.org/job/hadoop-multibranch/
4. Create a JIRA to update the Jenkinsfile to use 0.12.0 instead of
main. (JDK11 javadoc support is broken in Yetus 0.12.0)

Sorry for the inconvenience.

Regards,
Akira

-
To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org



-
To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org

Re: Precommit job fails to write comments in the GitHub pull requests

2020-09-29 Thread Akira Ajisaka

I've got a GitHub App token from the infra team and set this to the
hadoop-multibranch job.
The commit statuses in GitHub pull requests will be updated by Jenkins
and you'll need to check these statuses.

-Akira

On Tue, Sep 29, 2020 at 2:55 AM Akira Ajisaka  wrote:
>
> Apache Hadoop developers,
>
> After YETUS-994, the jenkins job updates the commit status instead of
> writing a comment to the pull request. It requires an OAuth token with
> write access to "repo:status" but now there is no such token for
> Apache Hadoop. I asked the infra team to create a token:
> https://issues.apache.org/jira/browse/INFRA-20906
>
> For now, I think there 4 options to get the information:
>
> 1. Attach a patch to the JIRA instead of GitHub
> 2. Update the Jenkinsfile for a while (Sample PR:
> https://github.com/apache/hadoop/pull/2346)
> 3. Search the job and get the comment from
> https://ci-hadoop.apache.org/job/hadoop-multibranch/
> 4. Create a JIRA to update the Jenkinsfile to use 0.12.0 instead of
> main. (JDK11 javadoc support is broken in Yetus 0.12.0)
>
> Sorry for the inconvenience.
>
> Regards,
> Akira

-
To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org

Hadoop 3.2.2 Release Code Freeze Plan

Re: [VOTE] Moving Ozone to a separated Apache project

Re: [VOTE] Moving Ozone to a separated Apache project

Re: [VOTE] Moving Ozone to a separated Apache project

Re: [VOTE] Moving Ozone to a separated Apache project

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86_64

[jira] [Created] (YARN-10450) Add cpu and memory utilization per node and cluster-wide metrics

Re: [VOTE] Moving Ozone to a separated Apache project

Re: [VOTE] Moving Ozone to a separated Apache project

Apache Hadoop qbt Report: branch-2.10+JDK7 on Linux/x86_64

Re: Precommit job fails to write comments in the GitHub pull requests

Re: Precommit job fails to write comments in the GitHub pull requests

12 matches

Site Navigation

Mail list logo

Footer information