[jira] [Commented] (YARN-7346) Add a profile to allow optional compilation for ATSv2 with HBase-2.0
[ https://issues.apache.org/jira/browse/YARN-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16389011#comment-16389011 ] Rohith Sharma K S commented on YARN-7346: - thanks [~haibochen] for creating YARN-8003. I will take a look at it. > Add a profile to allow optional compilation for ATSv2 with HBase-2.0 > > > Key: YARN-7346 > URL: https://issues.apache.org/jira/browse/YARN-7346 > Project: Hadoop YARN > Issue Type: Sub-task >Reporter: Ted Yu >Assignee: Haibo Chen >Priority: Major > Fix For: 3.2.0 > > Attachments: YARN-7346.00.patch, YARN-7346.01.patch, > YARN-7346.02.patch, YARN-7346.03-incremental.patch, YARN-7346.03.patch, > YARN-7346.04-incremental.patch, YARN-7346.04.patch, YARN-7346.05.patch, > YARN-7346.06.patch, YARN-7346.07.patch, YARN-7346.08-incremental.patch, > YARN-7346.08.patch, YARN-7346.09.patch, YARN-7346.10.patch, > YARN-7346.11.patch, YARN-7346.prelim1.patch, YARN-7346.prelim2.patch, > YARN-7581.prelim.patch, > hadoop-yarn-server-timelineservice-hbase-server-1-findbugsXml.xml, > hadoop-yarn-server-timelineservice-hbase-server-1-javadoc-report.txt, > hadoop-yarn-server-timelineservice-hbase-server-2-findbugsXml.xml, > hadoop-yarn-server-timelineservice-hbase-server-2-javadoc-report.txt > > > When compiling hadoop-yarn-server-timelineservice-hbase against 2.0.0-alpha3, > I got the following errors: > [https://pastebin.com/Ms4jYEVB] > This issue is to fix the compilation errors. > The scope of the Jira is to add a profile to allow optional compilation for > ATSv2 with HBase2.0. The default compilation for trunk will still be for > hbase 1.2.6. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-7346) Add a profile to allow optional compilation for ATSv2 with HBase-2.0
[ https://issues.apache.org/jira/browse/YARN-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16388617#comment-16388617 ] Haibo Chen commented on YARN-7346: -- {quote}maybe we should have a jira to track figuring out how we make sure the hbase shaded client is usable for Hadoop in this specific context {quote} YARN-5071 is where we have talked about some issues in this category. > Add a profile to allow optional compilation for ATSv2 with HBase-2.0 > > > Key: YARN-7346 > URL: https://issues.apache.org/jira/browse/YARN-7346 > Project: Hadoop YARN > Issue Type: Sub-task >Reporter: Ted Yu >Assignee: Haibo Chen >Priority: Major > Fix For: 3.2.0 > > Attachments: YARN-7346.00.patch, YARN-7346.01.patch, > YARN-7346.02.patch, YARN-7346.03-incremental.patch, YARN-7346.03.patch, > YARN-7346.04-incremental.patch, YARN-7346.04.patch, YARN-7346.05.patch, > YARN-7346.06.patch, YARN-7346.07.patch, YARN-7346.08-incremental.patch, > YARN-7346.08.patch, YARN-7346.09.patch, YARN-7346.10.patch, > YARN-7346.11.patch, YARN-7346.prelim1.patch, YARN-7346.prelim2.patch, > YARN-7581.prelim.patch, > hadoop-yarn-server-timelineservice-hbase-server-1-findbugsXml.xml, > hadoop-yarn-server-timelineservice-hbase-server-1-javadoc-report.txt, > hadoop-yarn-server-timelineservice-hbase-server-2-findbugsXml.xml, > hadoop-yarn-server-timelineservice-hbase-server-2-javadoc-report.txt > > > When compiling hadoop-yarn-server-timelineservice-hbase against 2.0.0-alpha3, > I got the following errors: > [https://pastebin.com/Ms4jYEVB] > This issue is to fix the compilation errors. > The scope of the Jira is to add a profile to allow optional compilation for > ATSv2 with HBase2.0. The default compilation for trunk will still be for > hbase 1.2.6. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-7346) Add a profile to allow optional compilation for ATSv2 with HBase-2.0
[ https://issues.apache.org/jira/browse/YARN-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16388603#comment-16388603 ] Haibo Chen commented on YARN-7346: -- Filed YARN-8003 to change the code structure in branch-2. > Add a profile to allow optional compilation for ATSv2 with HBase-2.0 > > > Key: YARN-7346 > URL: https://issues.apache.org/jira/browse/YARN-7346 > Project: Hadoop YARN > Issue Type: Sub-task >Reporter: Ted Yu >Assignee: Haibo Chen >Priority: Major > Fix For: 3.2.0 > > Attachments: YARN-7346.00.patch, YARN-7346.01.patch, > YARN-7346.02.patch, YARN-7346.03-incremental.patch, YARN-7346.03.patch, > YARN-7346.04-incremental.patch, YARN-7346.04.patch, YARN-7346.05.patch, > YARN-7346.06.patch, YARN-7346.07.patch, YARN-7346.08-incremental.patch, > YARN-7346.08.patch, YARN-7346.09.patch, YARN-7346.10.patch, > YARN-7346.11.patch, YARN-7346.prelim1.patch, YARN-7346.prelim2.patch, > YARN-7581.prelim.patch, > hadoop-yarn-server-timelineservice-hbase-server-1-findbugsXml.xml, > hadoop-yarn-server-timelineservice-hbase-server-1-javadoc-report.txt, > hadoop-yarn-server-timelineservice-hbase-server-2-findbugsXml.xml, > hadoop-yarn-server-timelineservice-hbase-server-2-javadoc-report.txt > > > When compiling hadoop-yarn-server-timelineservice-hbase against 2.0.0-alpha3, > I got the following errors: > [https://pastebin.com/Ms4jYEVB] > This issue is to fix the compilation errors. > The scope of the Jira is to add a profile to allow optional compilation for > ATSv2 with HBase2.0. The default compilation for trunk will still be for > hbase 1.2.6. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-7346) Add a profile to allow optional compilation for ATSv2 with HBase-2.0
[ https://issues.apache.org/jira/browse/YARN-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16388220#comment-16388220 ] Vrushali C commented on YARN-7346: -- Hi [~haibochen] [~rohithsharma] Let's keep the same source code structure in branch-2 but we need not add support for compilation with hbase 2.x in branch-2. This will keep things consistent while generating patches. I am of the opinion we do not need to support hbase 2.x on branch-2. > Add a profile to allow optional compilation for ATSv2 with HBase-2.0 > > > Key: YARN-7346 > URL: https://issues.apache.org/jira/browse/YARN-7346 > Project: Hadoop YARN > Issue Type: Sub-task >Reporter: Ted Yu >Assignee: Haibo Chen >Priority: Major > Fix For: 3.2.0 > > Attachments: YARN-7346.00.patch, YARN-7346.01.patch, > YARN-7346.02.patch, YARN-7346.03-incremental.patch, YARN-7346.03.patch, > YARN-7346.04-incremental.patch, YARN-7346.04.patch, YARN-7346.05.patch, > YARN-7346.06.patch, YARN-7346.07.patch, YARN-7346.08-incremental.patch, > YARN-7346.08.patch, YARN-7346.09.patch, YARN-7346.10.patch, > YARN-7346.11.patch, YARN-7346.prelim1.patch, YARN-7346.prelim2.patch, > YARN-7581.prelim.patch, > hadoop-yarn-server-timelineservice-hbase-server-1-findbugsXml.xml, > hadoop-yarn-server-timelineservice-hbase-server-1-javadoc-report.txt, > hadoop-yarn-server-timelineservice-hbase-server-2-findbugsXml.xml, > hadoop-yarn-server-timelineservice-hbase-server-2-javadoc-report.txt > > > When compiling hadoop-yarn-server-timelineservice-hbase against 2.0.0-alpha3, > I got the following errors: > [https://pastebin.com/Ms4jYEVB] > This issue is to fix the compilation errors. > The scope of the Jira is to add a profile to allow optional compilation for > ATSv2 with HBase2.0. The default compilation for trunk will still be for > hbase 1.2.6. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-7346) Add a profile to allow optional compilation for ATSv2 with HBase-2.0
[ https://issues.apache.org/jira/browse/YARN-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16388182#comment-16388182 ] Sean Busbey commented on YARN-7346: --- {quote} What I was trying to say is that, In the context of ATSv2, NMs and RM act as hbase clients that write data to HBase, so the hbase-client dependency code will be running inside NM/RM processes. If hadoop 2 depends on, say dependency X of version N and hbase-client 2.0 depends on X of version N+2 , then hbase-client 2.0 code will be running with X of version N inside NM/RM. This could potentially break if hbase-client 2.0 relies on something new that only exists in version N+2. {quote} Oh for sure. dependency convergence is always a concern. maybe we should have a jira to track figuring out how we make sure the hbase shaded client is usable for Hadoop in this specific context. > Add a profile to allow optional compilation for ATSv2 with HBase-2.0 > > > Key: YARN-7346 > URL: https://issues.apache.org/jira/browse/YARN-7346 > Project: Hadoop YARN > Issue Type: Sub-task >Reporter: Ted Yu >Assignee: Haibo Chen >Priority: Major > Fix For: 3.2.0 > > Attachments: YARN-7346.00.patch, YARN-7346.01.patch, > YARN-7346.02.patch, YARN-7346.03-incremental.patch, YARN-7346.03.patch, > YARN-7346.04-incremental.patch, YARN-7346.04.patch, YARN-7346.05.patch, > YARN-7346.06.patch, YARN-7346.07.patch, YARN-7346.08-incremental.patch, > YARN-7346.08.patch, YARN-7346.09.patch, YARN-7346.10.patch, > YARN-7346.11.patch, YARN-7346.prelim1.patch, YARN-7346.prelim2.patch, > YARN-7581.prelim.patch, > hadoop-yarn-server-timelineservice-hbase-server-1-findbugsXml.xml, > hadoop-yarn-server-timelineservice-hbase-server-1-javadoc-report.txt, > hadoop-yarn-server-timelineservice-hbase-server-2-findbugsXml.xml, > hadoop-yarn-server-timelineservice-hbase-server-2-javadoc-report.txt > > > When compiling hadoop-yarn-server-timelineservice-hbase against 2.0.0-alpha3, > I got the following errors: > [https://pastebin.com/Ms4jYEVB] > This issue is to fix the compilation errors. > The scope of the Jira is to add a profile to allow optional compilation for > ATSv2 with HBase2.0. The default compilation for trunk will still be for > hbase 1.2.6. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-7346) Add a profile to allow optional compilation for ATSv2 with HBase-2.0
[ https://issues.apache.org/jira/browse/YARN-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16388159#comment-16388159 ] Haibo Chen commented on YARN-7346: -- [~rohithsharma] Do you think it is worthwhile to have the same source code structure in branch-2 to ease any backport of fixes that also apply to hbase-1.2.6? If so, we can work on that in a separate jira. > Add a profile to allow optional compilation for ATSv2 with HBase-2.0 > > > Key: YARN-7346 > URL: https://issues.apache.org/jira/browse/YARN-7346 > Project: Hadoop YARN > Issue Type: Sub-task >Reporter: Ted Yu >Assignee: Haibo Chen >Priority: Major > Fix For: 3.2.0 > > Attachments: YARN-7346.00.patch, YARN-7346.01.patch, > YARN-7346.02.patch, YARN-7346.03-incremental.patch, YARN-7346.03.patch, > YARN-7346.04-incremental.patch, YARN-7346.04.patch, YARN-7346.05.patch, > YARN-7346.06.patch, YARN-7346.07.patch, YARN-7346.08-incremental.patch, > YARN-7346.08.patch, YARN-7346.09.patch, YARN-7346.10.patch, > YARN-7346.11.patch, YARN-7346.prelim1.patch, YARN-7346.prelim2.patch, > YARN-7581.prelim.patch, > hadoop-yarn-server-timelineservice-hbase-server-1-findbugsXml.xml, > hadoop-yarn-server-timelineservice-hbase-server-1-javadoc-report.txt, > hadoop-yarn-server-timelineservice-hbase-server-2-findbugsXml.xml, > hadoop-yarn-server-timelineservice-hbase-server-2-javadoc-report.txt > > > When compiling hadoop-yarn-server-timelineservice-hbase against 2.0.0-alpha3, > I got the following errors: > [https://pastebin.com/Ms4jYEVB] > This issue is to fix the compilation errors. > The scope of the Jira is to add a profile to allow optional compilation for > ATSv2 with HBase2.0. The default compilation for trunk will still be for > hbase 1.2.6. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-7346) Add a profile to allow optional compilation for ATSv2 with HBase-2.0
[ https://issues.apache.org/jira/browse/YARN-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16388154#comment-16388154 ] Haibo Chen commented on YARN-7346: -- What I was trying to say is that, In the context of ATSv2, NMs and RM act as hbase clients that write data to HBase, so the hbase-client dependency code will be running inside NM/RM processes. If hadoop 2 depends on, say dependency X of version N and hbase-client 2.0 depends on X of version N+2 , then hbase-client 2.0 code will be running with X of version N inside NM/RM. This could potentially break if hbase-client 2.0 relies on something new that only exists in version N+2. This is independent of the HBase -Hadoop backing storage compatibility issue, which is covered by the HBase support matrix. Sorry for the confusion. > Add a profile to allow optional compilation for ATSv2 with HBase-2.0 > > > Key: YARN-7346 > URL: https://issues.apache.org/jira/browse/YARN-7346 > Project: Hadoop YARN > Issue Type: Sub-task >Reporter: Ted Yu >Assignee: Haibo Chen >Priority: Major > Fix For: 3.2.0 > > Attachments: YARN-7346.00.patch, YARN-7346.01.patch, > YARN-7346.02.patch, YARN-7346.03-incremental.patch, YARN-7346.03.patch, > YARN-7346.04-incremental.patch, YARN-7346.04.patch, YARN-7346.05.patch, > YARN-7346.06.patch, YARN-7346.07.patch, YARN-7346.08-incremental.patch, > YARN-7346.08.patch, YARN-7346.09.patch, YARN-7346.10.patch, > YARN-7346.11.patch, YARN-7346.prelim1.patch, YARN-7346.prelim2.patch, > YARN-7581.prelim.patch, > hadoop-yarn-server-timelineservice-hbase-server-1-findbugsXml.xml, > hadoop-yarn-server-timelineservice-hbase-server-1-javadoc-report.txt, > hadoop-yarn-server-timelineservice-hbase-server-2-findbugsXml.xml, > hadoop-yarn-server-timelineservice-hbase-server-2-javadoc-report.txt > > > When compiling hadoop-yarn-server-timelineservice-hbase against 2.0.0-alpha3, > I got the following errors: > [https://pastebin.com/Ms4jYEVB] > This issue is to fix the compilation errors. > The scope of the Jira is to add a profile to allow optional compilation for > ATSv2 with HBase2.0. The default compilation for trunk will still be for > hbase 1.2.6. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-7346) Add a profile to allow optional compilation for ATSv2 with HBase-2.0
[ https://issues.apache.org/jira/browse/YARN-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16388083#comment-16388083 ] Sean Busbey commented on YARN-7346: --- [the hbase community support matrix on JDK versions also lists Java 8 as required for HBase 2.0|http://hbase.apache.org/book.html#java] > Add a profile to allow optional compilation for ATSv2 with HBase-2.0 > > > Key: YARN-7346 > URL: https://issues.apache.org/jira/browse/YARN-7346 > Project: Hadoop YARN > Issue Type: Sub-task >Reporter: Ted Yu >Assignee: Haibo Chen >Priority: Major > Fix For: 3.2.0 > > Attachments: YARN-7346.00.patch, YARN-7346.01.patch, > YARN-7346.02.patch, YARN-7346.03-incremental.patch, YARN-7346.03.patch, > YARN-7346.04-incremental.patch, YARN-7346.04.patch, YARN-7346.05.patch, > YARN-7346.06.patch, YARN-7346.07.patch, YARN-7346.08-incremental.patch, > YARN-7346.08.patch, YARN-7346.09.patch, YARN-7346.10.patch, > YARN-7346.11.patch, YARN-7346.prelim1.patch, YARN-7346.prelim2.patch, > YARN-7581.prelim.patch, > hadoop-yarn-server-timelineservice-hbase-server-1-findbugsXml.xml, > hadoop-yarn-server-timelineservice-hbase-server-1-javadoc-report.txt, > hadoop-yarn-server-timelineservice-hbase-server-2-findbugsXml.xml, > hadoop-yarn-server-timelineservice-hbase-server-2-javadoc-report.txt > > > When compiling hadoop-yarn-server-timelineservice-hbase against 2.0.0-alpha3, > I got the following errors: > [https://pastebin.com/Ms4jYEVB] > This issue is to fix the compilation errors. > The scope of the Jira is to add a profile to allow optional compilation for > ATSv2 with HBase2.0. The default compilation for trunk will still be for > hbase 1.2.6. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-7346) Add a profile to allow optional compilation for ATSv2 with HBase-2.0
[ https://issues.apache.org/jira/browse/YARN-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16388071#comment-16388071 ] Rohith Sharma K S commented on YARN-7346: - This would become a risk of back porting into branch-2 since HBase-2 claimed to compile on java8 only. I do see in hbase-env.sh as a note that 1.8+ required. {code} # The java implementation to use. Java 1.8+ required. # export JAVA_HOME=/usr/java/jdk1.8.0/ {code} Lets drop the idea of supporting HBase-2 in branch-2. cc :/ [~vrushalic] > Add a profile to allow optional compilation for ATSv2 with HBase-2.0 > > > Key: YARN-7346 > URL: https://issues.apache.org/jira/browse/YARN-7346 > Project: Hadoop YARN > Issue Type: Sub-task >Reporter: Ted Yu >Assignee: Haibo Chen >Priority: Major > Fix For: 3.2.0 > > Attachments: YARN-7346.00.patch, YARN-7346.01.patch, > YARN-7346.02.patch, YARN-7346.03-incremental.patch, YARN-7346.03.patch, > YARN-7346.04-incremental.patch, YARN-7346.04.patch, YARN-7346.05.patch, > YARN-7346.06.patch, YARN-7346.07.patch, YARN-7346.08-incremental.patch, > YARN-7346.08.patch, YARN-7346.09.patch, YARN-7346.10.patch, > YARN-7346.11.patch, YARN-7346.prelim1.patch, YARN-7346.prelim2.patch, > YARN-7581.prelim.patch, > hadoop-yarn-server-timelineservice-hbase-server-1-findbugsXml.xml, > hadoop-yarn-server-timelineservice-hbase-server-1-javadoc-report.txt, > hadoop-yarn-server-timelineservice-hbase-server-2-findbugsXml.xml, > hadoop-yarn-server-timelineservice-hbase-server-2-javadoc-report.txt > > > When compiling hadoop-yarn-server-timelineservice-hbase against 2.0.0-alpha3, > I got the following errors: > [https://pastebin.com/Ms4jYEVB] > This issue is to fix the compilation errors. > The scope of the Jira is to add a profile to allow optional compilation for > ATSv2 with HBase2.0. The default compilation for trunk will still be for > hbase 1.2.6. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-7346) Add a profile to allow optional compilation for ATSv2 with HBase-2.0
[ https://issues.apache.org/jira/browse/YARN-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16388060#comment-16388060 ] Sean Busbey commented on YARN-7346: --- {quote} I think it is worth mentioning that the 'support' we are talking about in this context refers to running HBase 2.0 client with hadoop2 jars/dependencies inside NM/RM. Sean Busbey Does the hadoop support matrix apply to that specific context? {quote} I don't understand the question, could you rephrase? that 'support' matrix is just about what the Apache HBase community recommends wrt versions of Hadoop to use as a backing storage layer for running an HBase instance. It impacts what they'll answer questions about without pushing back on. > Add a profile to allow optional compilation for ATSv2 with HBase-2.0 > > > Key: YARN-7346 > URL: https://issues.apache.org/jira/browse/YARN-7346 > Project: Hadoop YARN > Issue Type: Sub-task >Reporter: Ted Yu >Assignee: Haibo Chen >Priority: Major > Fix For: 3.2.0 > > Attachments: YARN-7346.00.patch, YARN-7346.01.patch, > YARN-7346.02.patch, YARN-7346.03-incremental.patch, YARN-7346.03.patch, > YARN-7346.04-incremental.patch, YARN-7346.04.patch, YARN-7346.05.patch, > YARN-7346.06.patch, YARN-7346.07.patch, YARN-7346.08-incremental.patch, > YARN-7346.08.patch, YARN-7346.09.patch, YARN-7346.10.patch, > YARN-7346.11.patch, YARN-7346.prelim1.patch, YARN-7346.prelim2.patch, > YARN-7581.prelim.patch, > hadoop-yarn-server-timelineservice-hbase-server-1-findbugsXml.xml, > hadoop-yarn-server-timelineservice-hbase-server-1-javadoc-report.txt, > hadoop-yarn-server-timelineservice-hbase-server-2-findbugsXml.xml, > hadoop-yarn-server-timelineservice-hbase-server-2-javadoc-report.txt > > > When compiling hadoop-yarn-server-timelineservice-hbase against 2.0.0-alpha3, > I got the following errors: > [https://pastebin.com/Ms4jYEVB] > This issue is to fix the compilation errors. > The scope of the Jira is to add a profile to allow optional compilation for > ATSv2 with HBase2.0. The default compilation for trunk will still be for > hbase 1.2.6. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-7346) Add a profile to allow optional compilation for ATSv2 with HBase-2.0
[ https://issues.apache.org/jira/browse/YARN-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16388027#comment-16388027 ] Haibo Chen commented on YARN-7346: -- [~rohithsharma] I am getting compilation errors due to java version. {code:java} [ERROR] /Users/haibochen/Documents/Apache/hadoop/ats/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase/hadoop-yarn-server-timelineservice-hbase-server/hadoop-yarn-server-timelineservice-hbase-server-2/src/main/java/org/apache/hadoop/yarn/server/timelineservice/storage/common/HBaseTimelineServerUtils.java:[155,35] static interface method invocations are not supported in -source 1.7 [ERROR] (use -source 8 or higher to enable static interface method invocations) [ERROR] /Users/haibochen/Documents/Apache/hadoop/ats/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase/hadoop-yarn-server-timelineservice-hbase-server/hadoop-yarn-server-timelineservice-hbase-server-2/src/main/java/org/apache/hadoop/yarn/server/timelineservice/storage/flow/FlowRunCoprocessor.java:[75,23] incompatible types: java.util.Optional cannot be converted to java.util.Optional{code} HBase 2 needs java 8, but we only do java 7 in branch-2. > Add a profile to allow optional compilation for ATSv2 with HBase-2.0 > > > Key: YARN-7346 > URL: https://issues.apache.org/jira/browse/YARN-7346 > Project: Hadoop YARN > Issue Type: Sub-task >Reporter: Ted Yu >Assignee: Haibo Chen >Priority: Major > Fix For: 3.2.0 > > Attachments: YARN-7346.00.patch, YARN-7346.01.patch, > YARN-7346.02.patch, YARN-7346.03-incremental.patch, YARN-7346.03.patch, > YARN-7346.04-incremental.patch, YARN-7346.04.patch, YARN-7346.05.patch, > YARN-7346.06.patch, YARN-7346.07.patch, YARN-7346.08-incremental.patch, > YARN-7346.08.patch, YARN-7346.09.patch, YARN-7346.10.patch, > YARN-7346.11.patch, YARN-7346.prelim1.patch, YARN-7346.prelim2.patch, > YARN-7581.prelim.patch, > hadoop-yarn-server-timelineservice-hbase-server-1-findbugsXml.xml, > hadoop-yarn-server-timelineservice-hbase-server-1-javadoc-report.txt, > hadoop-yarn-server-timelineservice-hbase-server-2-findbugsXml.xml, > hadoop-yarn-server-timelineservice-hbase-server-2-javadoc-report.txt > > > When compiling hadoop-yarn-server-timelineservice-hbase against 2.0.0-alpha3, > I got the following errors: > [https://pastebin.com/Ms4jYEVB] > This issue is to fix the compilation errors. > The scope of the Jira is to add a profile to allow optional compilation for > ATSv2 with HBase2.0. The default compilation for trunk will still be for > hbase 1.2.6. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-7346) Add a profile to allow optional compilation for ATSv2 with HBase-2.0
[ https://issues.apache.org/jira/browse/YARN-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16388019#comment-16388019 ] Haibo Chen commented on YARN-7346: -- I think it is worth mentioning that the 'support' we are talking about in this context refers to running HBase 2.0 client with hadoop2 jars/dependencies inside NM/RM. [~busbey] Does the hadoop support matrix apply to that specific context? > Add a profile to allow optional compilation for ATSv2 with HBase-2.0 > > > Key: YARN-7346 > URL: https://issues.apache.org/jira/browse/YARN-7346 > Project: Hadoop YARN > Issue Type: Sub-task >Reporter: Ted Yu >Assignee: Haibo Chen >Priority: Major > Fix For: 3.2.0 > > Attachments: YARN-7346.00.patch, YARN-7346.01.patch, > YARN-7346.02.patch, YARN-7346.03-incremental.patch, YARN-7346.03.patch, > YARN-7346.04-incremental.patch, YARN-7346.04.patch, YARN-7346.05.patch, > YARN-7346.06.patch, YARN-7346.07.patch, YARN-7346.08-incremental.patch, > YARN-7346.08.patch, YARN-7346.09.patch, YARN-7346.10.patch, > YARN-7346.11.patch, YARN-7346.prelim1.patch, YARN-7346.prelim2.patch, > YARN-7581.prelim.patch, > hadoop-yarn-server-timelineservice-hbase-server-1-findbugsXml.xml, > hadoop-yarn-server-timelineservice-hbase-server-1-javadoc-report.txt, > hadoop-yarn-server-timelineservice-hbase-server-2-findbugsXml.xml, > hadoop-yarn-server-timelineservice-hbase-server-2-javadoc-report.txt > > > When compiling hadoop-yarn-server-timelineservice-hbase against 2.0.0-alpha3, > I got the following errors: > [https://pastebin.com/Ms4jYEVB] > This issue is to fix the compilation errors. > The scope of the Jira is to add a profile to allow optional compilation for > ATSv2 with HBase2.0. The default compilation for trunk will still be for > hbase 1.2.6. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-7346) Add a profile to allow optional compilation for ATSv2 with HBase-2.0
[ https://issues.apache.org/jira/browse/YARN-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16387996#comment-16387996 ] Haibo Chen commented on YARN-7346: -- Thanks [~busbey] for the info. I'll proceed to work on cherry-picking the patch to branch-2. > Add a profile to allow optional compilation for ATSv2 with HBase-2.0 > > > Key: YARN-7346 > URL: https://issues.apache.org/jira/browse/YARN-7346 > Project: Hadoop YARN > Issue Type: Sub-task >Reporter: Ted Yu >Assignee: Haibo Chen >Priority: Major > Fix For: 3.2.0 > > Attachments: YARN-7346.00.patch, YARN-7346.01.patch, > YARN-7346.02.patch, YARN-7346.03-incremental.patch, YARN-7346.03.patch, > YARN-7346.04-incremental.patch, YARN-7346.04.patch, YARN-7346.05.patch, > YARN-7346.06.patch, YARN-7346.07.patch, YARN-7346.08-incremental.patch, > YARN-7346.08.patch, YARN-7346.09.patch, YARN-7346.10.patch, > YARN-7346.11.patch, YARN-7346.prelim1.patch, YARN-7346.prelim2.patch, > YARN-7581.prelim.patch, > hadoop-yarn-server-timelineservice-hbase-server-1-findbugsXml.xml, > hadoop-yarn-server-timelineservice-hbase-server-1-javadoc-report.txt, > hadoop-yarn-server-timelineservice-hbase-server-2-findbugsXml.xml, > hadoop-yarn-server-timelineservice-hbase-server-2-javadoc-report.txt > > > When compiling hadoop-yarn-server-timelineservice-hbase against 2.0.0-alpha3, > I got the following errors: > [https://pastebin.com/Ms4jYEVB] > This issue is to fix the compilation errors. > The scope of the Jira is to add a profile to allow optional compilation for > ATSv2 with HBase2.0. The default compilation for trunk will still be for > hbase 1.2.6. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-7346) Add a profile to allow optional compilation for ATSv2 with HBase-2.0
[ https://issues.apache.org/jira/browse/YARN-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16387988#comment-16387988 ] Haibo Chen commented on YARN-7346: -- {quote}Does HBase-2.0 officially claims their default Hadoop version is 3.0.0? {quote} [~yuzhih...@gmail.com], [~mdrob] Is this the case? Specifically, what we will be effectively doing in branch-2 is running HBase 2.0 client with hadoop2 jars. > Add a profile to allow optional compilation for ATSv2 with HBase-2.0 > > > Key: YARN-7346 > URL: https://issues.apache.org/jira/browse/YARN-7346 > Project: Hadoop YARN > Issue Type: Sub-task >Reporter: Ted Yu >Assignee: Haibo Chen >Priority: Major > Fix For: 3.2.0 > > Attachments: YARN-7346.00.patch, YARN-7346.01.patch, > YARN-7346.02.patch, YARN-7346.03-incremental.patch, YARN-7346.03.patch, > YARN-7346.04-incremental.patch, YARN-7346.04.patch, YARN-7346.05.patch, > YARN-7346.06.patch, YARN-7346.07.patch, YARN-7346.08-incremental.patch, > YARN-7346.08.patch, YARN-7346.09.patch, YARN-7346.10.patch, > YARN-7346.11.patch, YARN-7346.prelim1.patch, YARN-7346.prelim2.patch, > YARN-7581.prelim.patch, > hadoop-yarn-server-timelineservice-hbase-server-1-findbugsXml.xml, > hadoop-yarn-server-timelineservice-hbase-server-1-javadoc-report.txt, > hadoop-yarn-server-timelineservice-hbase-server-2-findbugsXml.xml, > hadoop-yarn-server-timelineservice-hbase-server-2-javadoc-report.txt > > > When compiling hadoop-yarn-server-timelineservice-hbase against 2.0.0-alpha3, > I got the following errors: > [https://pastebin.com/Ms4jYEVB] > This issue is to fix the compilation errors. > The scope of the Jira is to add a profile to allow optional compilation for > ATSv2 with HBase2.0. The default compilation for trunk will still be for > hbase 1.2.6. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-7346) Add a profile to allow optional compilation for ATSv2 with HBase-2.0
[ https://issues.apache.org/jira/browse/YARN-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16387981#comment-16387981 ] Sean Busbey commented on YARN-7346: --- HBase 2.0 does not default to Hadoop 3. [our hadoop support matrix|http://hbase.apache.org/book.html#basic.prerequisites] as of today still lists the Hadoop 3 line as "Not Tested (NT)" which is how the community labels things that are experimental. > Add a profile to allow optional compilation for ATSv2 with HBase-2.0 > > > Key: YARN-7346 > URL: https://issues.apache.org/jira/browse/YARN-7346 > Project: Hadoop YARN > Issue Type: Sub-task >Reporter: Ted Yu >Assignee: Haibo Chen >Priority: Major > Fix For: 3.2.0 > > Attachments: YARN-7346.00.patch, YARN-7346.01.patch, > YARN-7346.02.patch, YARN-7346.03-incremental.patch, YARN-7346.03.patch, > YARN-7346.04-incremental.patch, YARN-7346.04.patch, YARN-7346.05.patch, > YARN-7346.06.patch, YARN-7346.07.patch, YARN-7346.08-incremental.patch, > YARN-7346.08.patch, YARN-7346.09.patch, YARN-7346.10.patch, > YARN-7346.11.patch, YARN-7346.prelim1.patch, YARN-7346.prelim2.patch, > YARN-7581.prelim.patch, > hadoop-yarn-server-timelineservice-hbase-server-1-findbugsXml.xml, > hadoop-yarn-server-timelineservice-hbase-server-1-javadoc-report.txt, > hadoop-yarn-server-timelineservice-hbase-server-2-findbugsXml.xml, > hadoop-yarn-server-timelineservice-hbase-server-2-javadoc-report.txt > > > When compiling hadoop-yarn-server-timelineservice-hbase against 2.0.0-alpha3, > I got the following errors: > [https://pastebin.com/Ms4jYEVB] > This issue is to fix the compilation errors. > The scope of the Jira is to add a profile to allow optional compilation for > ATSv2 with HBase2.0. The default compilation for trunk will still be for > hbase 1.2.6. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-7346) Add a profile to allow optional compilation for ATSv2 with HBase-2.0
[ https://issues.apache.org/jira/browse/YARN-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16387957#comment-16387957 ] Rohith Sharma K S commented on YARN-7346: - This is really a good point to be discussed. Does HBase-2.0 officially claims their default Hadoop version is 3.0.0? I just saw looking HBase-2.0-beta release and found that hadoop-2.7.3 jars in HBase/lib folder. > Add a profile to allow optional compilation for ATSv2 with HBase-2.0 > > > Key: YARN-7346 > URL: https://issues.apache.org/jira/browse/YARN-7346 > Project: Hadoop YARN > Issue Type: Sub-task >Reporter: Ted Yu >Assignee: Haibo Chen >Priority: Major > Fix For: 3.2.0 > > Attachments: YARN-7346.00.patch, YARN-7346.01.patch, > YARN-7346.02.patch, YARN-7346.03-incremental.patch, YARN-7346.03.patch, > YARN-7346.04-incremental.patch, YARN-7346.04.patch, YARN-7346.05.patch, > YARN-7346.06.patch, YARN-7346.07.patch, YARN-7346.08-incremental.patch, > YARN-7346.08.patch, YARN-7346.09.patch, YARN-7346.10.patch, > YARN-7346.11.patch, YARN-7346.prelim1.patch, YARN-7346.prelim2.patch, > YARN-7581.prelim.patch, > hadoop-yarn-server-timelineservice-hbase-server-1-findbugsXml.xml, > hadoop-yarn-server-timelineservice-hbase-server-1-javadoc-report.txt, > hadoop-yarn-server-timelineservice-hbase-server-2-findbugsXml.xml, > hadoop-yarn-server-timelineservice-hbase-server-2-javadoc-report.txt > > > When compiling hadoop-yarn-server-timelineservice-hbase against 2.0.0-alpha3, > I got the following errors: > [https://pastebin.com/Ms4jYEVB] > This issue is to fix the compilation errors. > The scope of the Jira is to add a profile to allow optional compilation for > ATSv2 with HBase2.0. The default compilation for trunk will still be for > hbase 1.2.6. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-7346) Add a profile to allow optional compilation for ATSv2 with HBase-2.0
[ https://issues.apache.org/jira/browse/YARN-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16387930#comment-16387930 ] Haibo Chen commented on YARN-7346: -- [~rohithsharma] While resolving the conflicts and thinking about this more, do we want to support branch-2 with HBase-2.0 given that HBase 2.0 takes hadoop 3.0 as a dependency? The HBase 2.0 with branch-2 combo might be something no others will try to test and maintain, which means we, ATSv2 community, needs to take care of that by ourselves. Just to keep the two branches (branch-2 and trunk) close, we can file a Jira to change branch-2 so that it has the same file structure of trunk without the conditional compilation bits. Thoughts? CC [~vrushalic] > Add a profile to allow optional compilation for ATSv2 with HBase-2.0 > > > Key: YARN-7346 > URL: https://issues.apache.org/jira/browse/YARN-7346 > Project: Hadoop YARN > Issue Type: Sub-task >Reporter: Ted Yu >Assignee: Haibo Chen >Priority: Major > Fix For: 3.2.0 > > Attachments: YARN-7346.00.patch, YARN-7346.01.patch, > YARN-7346.02.patch, YARN-7346.03-incremental.patch, YARN-7346.03.patch, > YARN-7346.04-incremental.patch, YARN-7346.04.patch, YARN-7346.05.patch, > YARN-7346.06.patch, YARN-7346.07.patch, YARN-7346.08-incremental.patch, > YARN-7346.08.patch, YARN-7346.09.patch, YARN-7346.10.patch, > YARN-7346.11.patch, YARN-7346.prelim1.patch, YARN-7346.prelim2.patch, > YARN-7581.prelim.patch, > hadoop-yarn-server-timelineservice-hbase-server-1-findbugsXml.xml, > hadoop-yarn-server-timelineservice-hbase-server-1-javadoc-report.txt, > hadoop-yarn-server-timelineservice-hbase-server-2-findbugsXml.xml, > hadoop-yarn-server-timelineservice-hbase-server-2-javadoc-report.txt > > > When compiling hadoop-yarn-server-timelineservice-hbase against 2.0.0-alpha3, > I got the following errors: > [https://pastebin.com/Ms4jYEVB] > This issue is to fix the compilation errors. > The scope of the Jira is to add a profile to allow optional compilation for > ATSv2 with HBase2.0. The default compilation for trunk will still be for > hbase 1.2.6. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-7346) Add a profile to allow optional compilation for ATSv2 with HBase-2.0
[ https://issues.apache.org/jira/browse/YARN-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16387369#comment-16387369 ] Hudson commented on YARN-7346: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13776 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/13776/]) YARN-7346. Add a profile to allow optional compilation for ATSv2 with (rohithsharmaks: rev 55ba49dd071b66e72c47a1c41e88b9a5feddf53b) * (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase/hadoop-yarn-server-timelineservice-hbase-server/pom.xml * (add) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase/hadoop-yarn-server-timelineservice-hbase-server/hadoop-yarn-server-timelineservice-hbase-server-2/src/main/java/org/apache/hadoop/yarn/server/timelineservice/storage/flow/FlowRunCoprocessor.java * (add) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase/hadoop-yarn-server-timelineservice-hbase-server/hadoop-yarn-server-timelineservice-hbase-server-2/src/main/java/org/apache/hadoop/yarn/server/timelineservice/storage/common/package-info.java * (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase-tests/pom.xml * (add) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase/hadoop-yarn-server-timelineservice-hbase-server/hadoop-yarn-server-timelineservice-hbase-server-2/src/main/java/org/apache/hadoop/yarn/server/timelineservice/storage/flow/FlowScanner.java * (delete) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase/hadoop-yarn-server-timelineservice-hbase-server/src/main/java/org/apache/hadoop/yarn/server/timelineservice/storage/flow/FlowScanner.java * (add) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase/hadoop-yarn-server-timelineservice-hbase-server/hadoop-yarn-server-timelineservice-hbase-server-1/src/main/java/org/apache/hadoop/yarn/server/timelineservice/storage/flow/package-info.java * (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase/hadoop-yarn-server-timelineservice-hbase-client/pom.xml * (add) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase/hadoop-yarn-server-timelineservice-hbase-server/hadoop-yarn-server-timelineservice-hbase-server-1/pom.xml * (add) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase/hadoop-yarn-server-timelineservice-hbase-server/hadoop-yarn-server-timelineservice-hbase-server-1/src/main/java/org/apache/hadoop/yarn/server/timelineservice/storage/package-info.java * (edit) hadoop-assemblies/src/main/resources/assemblies/hadoop-yarn-dist.xml * (delete) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase/hadoop-yarn-server-timelineservice-hbase-server/src/main/java/org/apache/hadoop/yarn/server/timelineservice/storage/flow/FlowRunCoprocessor.java * (edit) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase-tests/src/test/java/org/apache/hadoop/yarn/server/timelineservice/storage/flow/TestHBaseStorageFlowRunCompaction.java * (add) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase/hadoop-yarn-server-timelineservice-hbase-server/hadoop-yarn-server-timelineservice-hbase-server-1/src/main/java/org/apache/hadoop/yarn/server/timelineservice/storage/flow/FlowScanner.java * (delete) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase/hadoop-yarn-server-timelineservice-hbase-server/src/assembly/coprocessor.xml * (delete) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase/hadoop-yarn-server-timelineservice-hbase-server/src/main/java/org/apache/hadoop/yarn/server/timelineservice/storage/flow/package-info.java * (add) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase/hadoop-yarn-server-timelineservice-hbase-server/hadoop-yarn-server-timelineservice-hbase-server-2/pom.xml * (edit) hadoop-project/pom.xml * (delete) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase/hadoop-yarn-server-timelineservice-hbase-server/src/main/java/org/apache/hadoop/yarn/server/timelineservice/storage/common/HBaseTimelineServerUtils.java * (add) hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase/hadoop-yarn-server-timelineservice-hbase-server/hadoop-yarn-server-timelineservice-hbase-server-2/src/main/java/org/apache/hadoop/yarn/server/timelineservice/storage/flow/FlowScannerOperation.java * (add)
[jira] [Commented] (YARN-7346) Add a profile to allow optional compilation for ATSv2 with HBase-2.0
[ https://issues.apache.org/jira/browse/YARN-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16387352#comment-16387352 ] Rohith Sharma K S commented on YARN-7346: - I committed to trunk. thanks [~haibochen] for the patch! Now you can cherry-pick into branch-2. thanks. > Add a profile to allow optional compilation for ATSv2 with HBase-2.0 > > > Key: YARN-7346 > URL: https://issues.apache.org/jira/browse/YARN-7346 > Project: Hadoop YARN > Issue Type: Sub-task >Reporter: Ted Yu >Assignee: Haibo Chen >Priority: Major > Attachments: YARN-7346.00.patch, YARN-7346.01.patch, > YARN-7346.02.patch, YARN-7346.03-incremental.patch, YARN-7346.03.patch, > YARN-7346.04-incremental.patch, YARN-7346.04.patch, YARN-7346.05.patch, > YARN-7346.06.patch, YARN-7346.07.patch, YARN-7346.08-incremental.patch, > YARN-7346.08.patch, YARN-7346.09.patch, YARN-7346.10.patch, > YARN-7346.11.patch, YARN-7346.prelim1.patch, YARN-7346.prelim2.patch, > YARN-7581.prelim.patch, > hadoop-yarn-server-timelineservice-hbase-server-1-findbugsXml.xml, > hadoop-yarn-server-timelineservice-hbase-server-1-javadoc-report.txt, > hadoop-yarn-server-timelineservice-hbase-server-2-findbugsXml.xml, > hadoop-yarn-server-timelineservice-hbase-server-2-javadoc-report.txt > > > When compiling hadoop-yarn-server-timelineservice-hbase against 2.0.0-alpha3, > I got the following errors: > [https://pastebin.com/Ms4jYEVB] > This issue is to fix the compilation errors. > The scope of the Jira is to add a profile to allow optional compilation for > ATSv2 with HBase2.0. The default compilation for trunk will still be for > hbase 1.2.6. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-7346) Add a profile to allow optional compilation for ATSv2 with HBase-2.0
[ https://issues.apache.org/jira/browse/YARN-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16387338#comment-16387338 ] Rohith Sharma K S commented on YARN-7346: - I haven't committed yet. I will do it now. > Add a profile to allow optional compilation for ATSv2 with HBase-2.0 > > > Key: YARN-7346 > URL: https://issues.apache.org/jira/browse/YARN-7346 > Project: Hadoop YARN > Issue Type: Sub-task >Reporter: Ted Yu >Assignee: Haibo Chen >Priority: Major > Attachments: YARN-7346.00.patch, YARN-7346.01.patch, > YARN-7346.02.patch, YARN-7346.03-incremental.patch, YARN-7346.03.patch, > YARN-7346.04-incremental.patch, YARN-7346.04.patch, YARN-7346.05.patch, > YARN-7346.06.patch, YARN-7346.07.patch, YARN-7346.08-incremental.patch, > YARN-7346.08.patch, YARN-7346.09.patch, YARN-7346.10.patch, > YARN-7346.11.patch, YARN-7346.prelim1.patch, YARN-7346.prelim2.patch, > YARN-7581.prelim.patch, > hadoop-yarn-server-timelineservice-hbase-server-1-findbugsXml.xml, > hadoop-yarn-server-timelineservice-hbase-server-1-javadoc-report.txt, > hadoop-yarn-server-timelineservice-hbase-server-2-findbugsXml.xml, > hadoop-yarn-server-timelineservice-hbase-server-2-javadoc-report.txt > > > When compiling hadoop-yarn-server-timelineservice-hbase against 2.0.0-alpha3, > I got the following errors: > [https://pastebin.com/Ms4jYEVB] > This issue is to fix the compilation errors. > The scope of the Jira is to add a profile to allow optional compilation for > ATSv2 with HBase2.0. The default compilation for trunk will still be for > hbase 1.2.6. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-7346) Add a profile to allow optional compilation for ATSv2 with HBase-2.0
[ https://issues.apache.org/jira/browse/YARN-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16387306#comment-16387306 ] Haibo Chen commented on YARN-7346: -- Sure. Are you able to commit it to trunk? I can try to cherry-pick from trunk and resolve conflicts, which is easier than trying from the patch directly. > Add a profile to allow optional compilation for ATSv2 with HBase-2.0 > > > Key: YARN-7346 > URL: https://issues.apache.org/jira/browse/YARN-7346 > Project: Hadoop YARN > Issue Type: Sub-task >Reporter: Ted Yu >Assignee: Haibo Chen >Priority: Major > Attachments: YARN-7346.00.patch, YARN-7346.01.patch, > YARN-7346.02.patch, YARN-7346.03-incremental.patch, YARN-7346.03.patch, > YARN-7346.04-incremental.patch, YARN-7346.04.patch, YARN-7346.05.patch, > YARN-7346.06.patch, YARN-7346.07.patch, YARN-7346.08-incremental.patch, > YARN-7346.08.patch, YARN-7346.09.patch, YARN-7346.10.patch, > YARN-7346.11.patch, YARN-7346.prelim1.patch, YARN-7346.prelim2.patch, > YARN-7581.prelim.patch, > hadoop-yarn-server-timelineservice-hbase-server-1-findbugsXml.xml, > hadoop-yarn-server-timelineservice-hbase-server-1-javadoc-report.txt, > hadoop-yarn-server-timelineservice-hbase-server-2-findbugsXml.xml, > hadoop-yarn-server-timelineservice-hbase-server-2-javadoc-report.txt > > > When compiling hadoop-yarn-server-timelineservice-hbase against 2.0.0-alpha3, > I got the following errors: > [https://pastebin.com/Ms4jYEVB] > This issue is to fix the compilation errors. > The scope of the Jira is to add a profile to allow optional compilation for > ATSv2 with HBase2.0. The default compilation for trunk will still be for > hbase 1.2.6. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-7346) Add a profile to allow optional compilation for ATSv2 with HBase-2.0
[ https://issues.apache.org/jira/browse/YARN-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16387287#comment-16387287 ] Rohith Sharma K S commented on YARN-7346: - [~haibochen] there are few conflicts for branch-2. Would you provide patch for branch-2? > Add a profile to allow optional compilation for ATSv2 with HBase-2.0 > > > Key: YARN-7346 > URL: https://issues.apache.org/jira/browse/YARN-7346 > Project: Hadoop YARN > Issue Type: Sub-task >Reporter: Ted Yu >Assignee: Haibo Chen >Priority: Major > Attachments: YARN-7346.00.patch, YARN-7346.01.patch, > YARN-7346.02.patch, YARN-7346.03-incremental.patch, YARN-7346.03.patch, > YARN-7346.04-incremental.patch, YARN-7346.04.patch, YARN-7346.05.patch, > YARN-7346.06.patch, YARN-7346.07.patch, YARN-7346.08-incremental.patch, > YARN-7346.08.patch, YARN-7346.09.patch, YARN-7346.10.patch, > YARN-7346.11.patch, YARN-7346.prelim1.patch, YARN-7346.prelim2.patch, > YARN-7581.prelim.patch, > hadoop-yarn-server-timelineservice-hbase-server-1-findbugsXml.xml, > hadoop-yarn-server-timelineservice-hbase-server-1-javadoc-report.txt, > hadoop-yarn-server-timelineservice-hbase-server-2-findbugsXml.xml, > hadoop-yarn-server-timelineservice-hbase-server-2-javadoc-report.txt > > > When compiling hadoop-yarn-server-timelineservice-hbase against 2.0.0-alpha3, > I got the following errors: > [https://pastebin.com/Ms4jYEVB] > This issue is to fix the compilation errors. > The scope of the Jira is to add a profile to allow optional compilation for > ATSv2 with HBase2.0. The default compilation for trunk will still be for > hbase 1.2.6. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-7346) Add a profile to allow optional compilation for ATSv2 with HBase-2.0
[ https://issues.apache.org/jira/browse/YARN-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16387280#comment-16387280 ] Rohith Sharma K S commented on YARN-7346: - committing shortly > Add a profile to allow optional compilation for ATSv2 with HBase-2.0 > > > Key: YARN-7346 > URL: https://issues.apache.org/jira/browse/YARN-7346 > Project: Hadoop YARN > Issue Type: Sub-task >Reporter: Ted Yu >Assignee: Haibo Chen >Priority: Major > Attachments: YARN-7346.00.patch, YARN-7346.01.patch, > YARN-7346.02.patch, YARN-7346.03-incremental.patch, YARN-7346.03.patch, > YARN-7346.04-incremental.patch, YARN-7346.04.patch, YARN-7346.05.patch, > YARN-7346.06.patch, YARN-7346.07.patch, YARN-7346.08-incremental.patch, > YARN-7346.08.patch, YARN-7346.09.patch, YARN-7346.10.patch, > YARN-7346.11.patch, YARN-7346.prelim1.patch, YARN-7346.prelim2.patch, > YARN-7581.prelim.patch, > hadoop-yarn-server-timelineservice-hbase-server-1-findbugsXml.xml, > hadoop-yarn-server-timelineservice-hbase-server-1-javadoc-report.txt, > hadoop-yarn-server-timelineservice-hbase-server-2-findbugsXml.xml, > hadoop-yarn-server-timelineservice-hbase-server-2-javadoc-report.txt > > > When compiling hadoop-yarn-server-timelineservice-hbase against 2.0.0-alpha3, > I got the following errors: > [https://pastebin.com/Ms4jYEVB] > This issue is to fix the compilation errors. > The scope of the Jira is to add a profile to allow optional compilation for > ATSv2 with HBase2.0. The default compilation for trunk will still be for > hbase 1.2.6. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-7346) Add a profile to allow optional compilation for ATSv2 with HBase-2.0
[ https://issues.apache.org/jira/browse/YARN-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16386374#comment-16386374 ] Rohith Sharma K S commented on YARN-7346: - +1 lgtm.. I will commit it later of today if no more objections. thanks [~haibochen] > Add a profile to allow optional compilation for ATSv2 with HBase-2.0 > > > Key: YARN-7346 > URL: https://issues.apache.org/jira/browse/YARN-7346 > Project: Hadoop YARN > Issue Type: Sub-task >Reporter: Ted Yu >Assignee: Haibo Chen >Priority: Major > Attachments: YARN-7346.00.patch, YARN-7346.01.patch, > YARN-7346.02.patch, YARN-7346.03-incremental.patch, YARN-7346.03.patch, > YARN-7346.04-incremental.patch, YARN-7346.04.patch, YARN-7346.05.patch, > YARN-7346.06.patch, YARN-7346.07.patch, YARN-7346.08-incremental.patch, > YARN-7346.08.patch, YARN-7346.09.patch, YARN-7346.10.patch, > YARN-7346.11.patch, YARN-7346.prelim1.patch, YARN-7346.prelim2.patch, > YARN-7581.prelim.patch, > hadoop-yarn-server-timelineservice-hbase-server-1-findbugsXml.xml, > hadoop-yarn-server-timelineservice-hbase-server-1-javadoc-report.txt, > hadoop-yarn-server-timelineservice-hbase-server-2-findbugsXml.xml, > hadoop-yarn-server-timelineservice-hbase-server-2-javadoc-report.txt > > > When compiling hadoop-yarn-server-timelineservice-hbase against 2.0.0-alpha3, > I got the following errors: > [https://pastebin.com/Ms4jYEVB] > This issue is to fix the compilation errors. > The scope of the Jira is to add a profile to allow optional compilation for > ATSv2 with HBase2.0. The default compilation for trunk will still be for > hbase 1.2.6. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-7346) Add a profile to allow optional compilation for ATSv2 with HBase-2.0
[ https://issues.apache.org/jira/browse/YARN-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16386342#comment-16386342 ] genericqa commented on YARN-7346: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Comment || | {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 0m 24s{color} | {color:blue} Docker mode activated. {color} | || || || || {color:brown} Prechecks {color} || | {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s{color} | {color:green} The patch does not contain any @author tags. {color} | | {color:green}+1{color} | {color:green} test4tests {color} | {color:green} 0m 0s{color} | {color:green} The patch appears to include 2 new or modified test files. {color} | || || || || {color:brown} trunk Compile Tests {color} || | {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m 17s{color} | {color:blue} Maven dependency ordering for branch {color} | | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 17m 10s{color} | {color:green} trunk passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 14m 26s{color} | {color:green} trunk passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 3m 10s{color} | {color:green} trunk passed {color} | | {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 2m 17s{color} | {color:green} trunk passed {color} | | {color:green}+1{color} | {color:green} shadedclient {color} | {color:green} 16m 22s{color} | {color:green} branch has no errors when building and testing our client artifacts. {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m 0s{color} | {color:blue} Skipped patched modules with no Java source: hadoop-project hadoop-assemblies hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase-tests {color} | | {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 1m 9s{color} | {color:green} trunk passed {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m 49s{color} | {color:green} trunk passed {color} | || || || || {color:brown} Patch Compile Tests {color} || | {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m 21s{color} | {color:blue} Maven dependency ordering for patch {color} | | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 3m 7s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 13m 0s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javac {color} | {color:green} 13m 0s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 3m 9s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 3m 17s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m 0s{color} | {color:green} The patch has no whitespace issues. {color} | | {color:green}+1{color} | {color:green} xml {color} | {color:green} 0m 11s{color} | {color:green} The patch has no ill-formed XML file. {color} | | {color:green}+1{color} | {color:green} shadedclient {color} | {color:green} 10m 39s{color} | {color:green} patch has no errors when building and testing our client artifacts. {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m 0s{color} | {color:blue} Skipped patched modules with no Java source: hadoop-project hadoop-assemblies hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase/hadoop-yarn-server-timelineservice-hbase-server hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase-tests {color} | | {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 2m 19s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 2m 32s{color} | {color:green} the patch passed {color} | || || || || {color:brown} Other Tests {color} || | {color:green}+1{color} | {color:green} unit {color} | {color:green} 0m 19s{color} | {color:green} hadoop-project in the patch passed. {color} | | {color:green}+1{color} | {color:green} unit {color} | {color:green} 0m 20s{color} | {color:green} hadoop-assemblies in the patch passed. {color} | | {color:green}+1{color} | {color:green} unit {color} | {color:green} 0m 29s{color} | {color:green} hadoop-yarn-server-timelineservice-hbase-client in the patch passed. {color} | | {color:green}+1{color} | {color:green} unit {color} | {color:green} 0m 26s{color} | {color:green}
[jira] [Commented] (YARN-7346) Add a profile to allow optional compilation for ATSv2 with HBase-2.0
[ https://issues.apache.org/jira/browse/YARN-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16385662#comment-16385662 ] genericqa commented on YARN-7346: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Comment || | {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 0m 40s{color} | {color:blue} Docker mode activated. {color} | || || || || {color:brown} Prechecks {color} || | {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s{color} | {color:green} The patch does not contain any @author tags. {color} | | {color:green}+1{color} | {color:green} test4tests {color} | {color:green} 0m 0s{color} | {color:green} The patch appears to include 2 new or modified test files. {color} | || || || || {color:brown} trunk Compile Tests {color} || | {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m 18s{color} | {color:blue} Maven dependency ordering for branch {color} | | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 16m 12s{color} | {color:green} trunk passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 16m 0s{color} | {color:green} trunk passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 3m 3s{color} | {color:green} trunk passed {color} | | {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 2m 4s{color} | {color:green} trunk passed {color} | | {color:green}+1{color} | {color:green} shadedclient {color} | {color:green} 14m 24s{color} | {color:green} branch has no errors when building and testing our client artifacts. {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m 0s{color} | {color:blue} Skipped patched modules with no Java source: hadoop-project hadoop-assemblies hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase-tests {color} | | {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 1m 6s{color} | {color:green} trunk passed {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m 36s{color} | {color:green} trunk passed {color} | || || || || {color:brown} Patch Compile Tests {color} || | {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m 24s{color} | {color:blue} Maven dependency ordering for patch {color} | | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 2m 38s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 14m 18s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javac {color} | {color:green} 14m 18s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 2m 41s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 2m 51s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m 0s{color} | {color:green} The patch has no whitespace issues. {color} | | {color:green}+1{color} | {color:green} xml {color} | {color:green} 0m 11s{color} | {color:green} The patch has no ill-formed XML file. {color} | | {color:green}+1{color} | {color:green} shadedclient {color} | {color:green} 8m 48s{color} | {color:green} patch has no errors when building and testing our client artifacts. {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m 0s{color} | {color:blue} Skipped patched modules with no Java source: hadoop-project hadoop-assemblies hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase/hadoop-yarn-server-timelineservice-hbase-server hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase-tests {color} | | {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 1m 54s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 2m 28s{color} | {color:green} the patch passed {color} | || || || || {color:brown} Other Tests {color} || | {color:green}+1{color} | {color:green} unit {color} | {color:green} 0m 18s{color} | {color:green} hadoop-project in the patch passed. {color} | | {color:green}+1{color} | {color:green} unit {color} | {color:green} 0m 21s{color} | {color:green} hadoop-assemblies in the patch passed. {color} | | {color:green}+1{color} | {color:green} unit {color} | {color:green} 0m 29s{color} | {color:green} hadoop-yarn-server-timelineservice-hbase-client in the patch passed. {color} | | {color:green}+1{color} | {color:green} unit {color} | {color:green} 0m 23s{color} | {color:green}
[jira] [Commented] (YARN-7346) Add a profile to allow optional compilation for ATSv2 with HBase-2.0
[ https://issues.apache.org/jira/browse/YARN-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16385608#comment-16385608 ] Haibo Chen commented on YARN-7346: -- The 09 patch seems to miss some changes based on its size. I have uploaded a v10 patch that is a combination of v08 and Rohith's incremental change. > Add a profile to allow optional compilation for ATSv2 with HBase-2.0 > > > Key: YARN-7346 > URL: https://issues.apache.org/jira/browse/YARN-7346 > Project: Hadoop YARN > Issue Type: Sub-task >Reporter: Ted Yu >Assignee: Haibo Chen >Priority: Major > Attachments: YARN-7346.00.patch, YARN-7346.01.patch, > YARN-7346.02.patch, YARN-7346.03-incremental.patch, YARN-7346.03.patch, > YARN-7346.04-incremental.patch, YARN-7346.04.patch, YARN-7346.05.patch, > YARN-7346.06.patch, YARN-7346.07.patch, YARN-7346.08-incremental.patch, > YARN-7346.08.patch, YARN-7346.09.patch, YARN-7346.10.patch, > YARN-7346.prelim1.patch, YARN-7346.prelim2.patch, YARN-7581.prelim.patch, > hadoop-yarn-server-timelineservice-hbase-server-1-findbugsXml.xml, > hadoop-yarn-server-timelineservice-hbase-server-1-javadoc-report.txt, > hadoop-yarn-server-timelineservice-hbase-server-2-findbugsXml.xml, > hadoop-yarn-server-timelineservice-hbase-server-2-javadoc-report.txt > > > When compiling hadoop-yarn-server-timelineservice-hbase against 2.0.0-alpha3, > I got the following errors: > [https://pastebin.com/Ms4jYEVB] > This issue is to fix the compilation errors. > The scope of the Jira is to add a profile to allow optional compilation for > ATSv2 with HBase2.0. The default compilation for trunk will still be for > hbase 1.2.6. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-7346) Add a profile to allow optional compilation for ATSv2 with HBase-2.0
[ https://issues.apache.org/jira/browse/YARN-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16384596#comment-16384596 ] genericqa commented on YARN-7346: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Comment || | {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 0m 41s{color} | {color:blue} Docker mode activated. {color} | || || || || {color:brown} Prechecks {color} || | {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s{color} | {color:green} The patch does not contain any @author tags. {color} | | {color:green}+1{color} | {color:green} test4tests {color} | {color:green} 0m 0s{color} | {color:green} The patch appears to include 2 new or modified test files. {color} | || || || || {color:brown} trunk Compile Tests {color} || | {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m 21s{color} | {color:blue} Maven dependency ordering for branch {color} | | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 16m 21s{color} | {color:green} trunk passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 16m 9s{color} | {color:green} trunk passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 3m 13s{color} | {color:green} trunk passed {color} | | {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 1m 59s{color} | {color:green} trunk passed {color} | | {color:green}+1{color} | {color:green} shadedclient {color} | {color:green} 14m 37s{color} | {color:green} branch has no errors when building and testing our client artifacts. {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m 0s{color} | {color:blue} Skipped patched modules with no Java source: hadoop-project hadoop-assemblies hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase-tests {color} | | {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 1m 8s{color} | {color:green} trunk passed {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m 33s{color} | {color:green} trunk passed {color} | || || || || {color:brown} Patch Compile Tests {color} || | {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m 21s{color} | {color:blue} Maven dependency ordering for patch {color} | | {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 3m 14s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} compile {color} | {color:green} 15m 25s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javac {color} | {color:green} 15m 25s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 2m 41s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 3m 3s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m 0s{color} | {color:green} The patch has no whitespace issues. {color} | | {color:green}+1{color} | {color:green} xml {color} | {color:green} 0m 12s{color} | {color:green} The patch has no ill-formed XML file. {color} | | {color:green}+1{color} | {color:green} shadedclient {color} | {color:green} 9m 17s{color} | {color:green} patch has no errors when building and testing our client artifacts. {color} | | {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m 0s{color} | {color:blue} Skipped patched modules with no Java source: hadoop-project hadoop-assemblies hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase/hadoop-yarn-server-timelineservice-hbase-server hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase-tests {color} | | {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 2m 12s{color} | {color:green} the patch passed {color} | | {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 2m 19s{color} | {color:green} the patch passed {color} | || || || || {color:brown} Other Tests {color} || | {color:green}+1{color} | {color:green} unit {color} | {color:green} 0m 17s{color} | {color:green} hadoop-project in the patch passed. {color} | | {color:green}+1{color} | {color:green} unit {color} | {color:green} 0m 21s{color} | {color:green} hadoop-assemblies in the patch passed. {color} | | {color:green}+1{color} | {color:green} unit {color} | {color:green} 0m 30s{color} | {color:green} hadoop-yarn-server-timelineservice-hbase-client in the patch passed. {color} | | {color:green}+1{color} | {color:green} unit {color} | {color:green} 0m 28s{color} | {color:green}
[jira] [Commented] (YARN-7346) Add a profile to allow optional compilation for ATSv2 with HBase-2.0
[ https://issues.apache.org/jira/browse/YARN-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16384562#comment-16384562 ] Rohith Sharma K S commented on YARN-7346: - I figured out way to compile individual module. It doesn't require any YETUS modifications. Attached incremental patch to know what is the modifications I did for pom.xml. And also attached full patch to run jenkins by taking liberty from Haibo! > Add a profile to allow optional compilation for ATSv2 with HBase-2.0 > > > Key: YARN-7346 > URL: https://issues.apache.org/jira/browse/YARN-7346 > Project: Hadoop YARN > Issue Type: Sub-task >Reporter: Ted Yu >Assignee: Haibo Chen >Priority: Major > Attachments: YARN-7346.00.patch, YARN-7346.01.patch, > YARN-7346.02.patch, YARN-7346.03-incremental.patch, YARN-7346.03.patch, > YARN-7346.04-incremental.patch, YARN-7346.04.patch, YARN-7346.05.patch, > YARN-7346.06.patch, YARN-7346.07.patch, YARN-7346.08-incremental.patch, > YARN-7346.08.patch, YARN-7346.09.patch, YARN-7346.prelim1.patch, > YARN-7346.prelim2.patch, YARN-7581.prelim.patch, > hadoop-yarn-server-timelineservice-hbase-server-1-findbugsXml.xml, > hadoop-yarn-server-timelineservice-hbase-server-1-javadoc-report.txt, > hadoop-yarn-server-timelineservice-hbase-server-2-findbugsXml.xml, > hadoop-yarn-server-timelineservice-hbase-server-2-javadoc-report.txt > > > When compiling hadoop-yarn-server-timelineservice-hbase against 2.0.0-alpha3, > I got the following errors: > [https://pastebin.com/Ms4jYEVB] > This issue is to fix the compilation errors. > The scope of the Jira is to add a profile to allow optional compilation for > ATSv2 with HBase2.0. The default compilation for trunk will still be for > hbase 1.2.6. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-7346) Add a profile to allow optional compilation for ATSv2 with HBase-2.0
[ https://issues.apache.org/jira/browse/YARN-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16384349#comment-16384349 ] Rohith Sharma K S commented on YARN-7346: - bq. I believe that personality currently lives in the yetus repository. since you'd be activating a profile, it should only cause a WARN to have the change in place prior to this patch. I cross checked with yarn-UI2 folks [~wangda] [~sunil.gov...@gmail.com] who had added -Pyarn-ui profile for Hadoop. They have added -Pyarn-ui in Hadoop personality precommit in YETUS-463. But for them, yarn-ui is only single module to be build where default compilation wasn't building this profile. In case for ATSv2, there are 2 different module which need to be activated based on the profile. One module will be activated by default always. So my doubt is does Yetus has ability to activate a profile only if corresponding module files are modified? Say, if hbase-2 module files are modified then hbase-2 profile need to be activated. Otherwise I don't think we can control this from YETUS. > Add a profile to allow optional compilation for ATSv2 with HBase-2.0 > > > Key: YARN-7346 > URL: https://issues.apache.org/jira/browse/YARN-7346 > Project: Hadoop YARN > Issue Type: Sub-task >Reporter: Ted Yu >Assignee: Haibo Chen >Priority: Major > Attachments: YARN-7346.00.patch, YARN-7346.01.patch, > YARN-7346.02.patch, YARN-7346.03-incremental.patch, YARN-7346.03.patch, > YARN-7346.04-incremental.patch, YARN-7346.04.patch, YARN-7346.05.patch, > YARN-7346.06.patch, YARN-7346.07.patch, YARN-7346.08.patch, > YARN-7346.prelim1.patch, YARN-7346.prelim2.patch, YARN-7581.prelim.patch, > hadoop-yarn-server-timelineservice-hbase-server-1-findbugsXml.xml, > hadoop-yarn-server-timelineservice-hbase-server-1-javadoc-report.txt, > hadoop-yarn-server-timelineservice-hbase-server-2-findbugsXml.xml, > hadoop-yarn-server-timelineservice-hbase-server-2-javadoc-report.txt > > > When compiling hadoop-yarn-server-timelineservice-hbase against 2.0.0-alpha3, > I got the following errors: > [https://pastebin.com/Ms4jYEVB] > This issue is to fix the compilation errors. > The scope of the Jira is to add a profile to allow optional compilation for > ATSv2 with HBase2.0. The default compilation for trunk will still be for > hbase 1.2.6. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-7346) Add a profile to allow optional compilation for ATSv2 with HBase-2.0
[ https://issues.apache.org/jira/browse/YARN-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16383382#comment-16383382 ] Rohith Sharma K S commented on YARN-7346: - I am here by attaching findbug and javadoc report for the 08 patch which is compiled in local machine by activating individual profile. This report shows there is *NO* findbug or javadoc errors exist for hbase-2 profile. - Default profile - hadoop-yarn-server-timelineservice-hbase-server-1 : [^hadoop-yarn-server-timelineservice-hbase-server-1-findbugsXml.xml] [^hadoop-yarn-server-timelineservice-hbase-server-1-javadoc-report.txt] - Hbase-2 profile - hadoop-yarn-server-timelineservice-hbase-server-2 : [^hadoop-yarn-server-timelineservice-hbase-server-2-findbugsXml.xml] [^hadoop-yarn-server-timelineservice-hbase-server-2-javadoc-report.txt] > Add a profile to allow optional compilation for ATSv2 with HBase-2.0 > > > Key: YARN-7346 > URL: https://issues.apache.org/jira/browse/YARN-7346 > Project: Hadoop YARN > Issue Type: Sub-task >Reporter: Ted Yu >Assignee: Haibo Chen >Priority: Major > Attachments: YARN-7346.00.patch, YARN-7346.01.patch, > YARN-7346.02.patch, YARN-7346.03-incremental.patch, YARN-7346.03.patch, > YARN-7346.04-incremental.patch, YARN-7346.04.patch, YARN-7346.05.patch, > YARN-7346.06.patch, YARN-7346.07.patch, YARN-7346.08.patch, > YARN-7346.prelim1.patch, YARN-7346.prelim2.patch, YARN-7581.prelim.patch, > hadoop-yarn-server-timelineservice-hbase-server-1-findbugsXml.xml, > hadoop-yarn-server-timelineservice-hbase-server-1-javadoc-report.txt, > hadoop-yarn-server-timelineservice-hbase-server-2-findbugsXml.xml, > hadoop-yarn-server-timelineservice-hbase-server-2-javadoc-report.txt > > > When compiling hadoop-yarn-server-timelineservice-hbase against 2.0.0-alpha3, > I got the following errors: > [https://pastebin.com/Ms4jYEVB] > This issue is to fix the compilation errors. > The scope of the Jira is to add a profile to allow optional compilation for > ATSv2 with HBase2.0. The default compilation for trunk will still be for > hbase 1.2.6. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-7346) Add a profile to allow optional compilation for ATSv2 with HBase-2.0
[ https://issues.apache.org/jira/browse/YARN-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16383113#comment-16383113 ] Rohith Sharma K S commented on YARN-7346: - Thanks [~busbey] for suggestions. Should we raise any corresponding bug in Yetus to make this change? If it is going to be delayed much more then expected, could we do this change post committing this patch? This is first step for supporting hbase-2 profile, and there are many stability issues with hbase-2 which need to be fixed. And many other stories such as ACLs are depends on this JIRA. Basically we have blocked by this patch. However ATSv2 folks takes *responsibility of ensuring that there are NO* findbugs and javadoc errors are introduced for hbase-2 profile modules. We have discussed this plan in weekly call as I commented earlier also to have separate jenkins in branch with hbase-2 profile as default. As a long term, we definitely want to go ahead with your suggestion which we can start discussion how to achieve it. > Add a profile to allow optional compilation for ATSv2 with HBase-2.0 > > > Key: YARN-7346 > URL: https://issues.apache.org/jira/browse/YARN-7346 > Project: Hadoop YARN > Issue Type: Sub-task >Reporter: Ted Yu >Assignee: Haibo Chen >Priority: Major > Attachments: YARN-7346.00.patch, YARN-7346.01.patch, > YARN-7346.02.patch, YARN-7346.03-incremental.patch, YARN-7346.03.patch, > YARN-7346.04-incremental.patch, YARN-7346.04.patch, YARN-7346.05.patch, > YARN-7346.06.patch, YARN-7346.07.patch, YARN-7346.08.patch, > YARN-7346.prelim1.patch, YARN-7346.prelim2.patch, YARN-7581.prelim.patch > > > When compiling hadoop-yarn-server-timelineservice-hbase against 2.0.0-alpha3, > I got the following errors: > [https://pastebin.com/Ms4jYEVB] > This issue is to fix the compilation errors. > The scope of the Jira is to add a profile to allow optional compilation for > ATSv2 with HBase2.0. The default compilation for trunk will still be for > hbase 1.2.6. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-7346) Add a profile to allow optional compilation for ATSv2 with HBase-2.0
[ https://issues.apache.org/jira/browse/YARN-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16383096#comment-16383096 ] Sean Busbey commented on YARN-7346: --- I believe the easiest way to make the change I'm suggesting would be to alter the project specific personality used in our precommit runs. I believe that personality currently lives in the yetus repository. since you'd be activating a profile, it should only cause a WARN to have the change in place prior to this patch. > Add a profile to allow optional compilation for ATSv2 with HBase-2.0 > > > Key: YARN-7346 > URL: https://issues.apache.org/jira/browse/YARN-7346 > Project: Hadoop YARN > Issue Type: Sub-task >Reporter: Ted Yu >Assignee: Haibo Chen >Priority: Major > Attachments: YARN-7346.00.patch, YARN-7346.01.patch, > YARN-7346.02.patch, YARN-7346.03-incremental.patch, YARN-7346.03.patch, > YARN-7346.04-incremental.patch, YARN-7346.04.patch, YARN-7346.05.patch, > YARN-7346.06.patch, YARN-7346.07.patch, YARN-7346.08.patch, > YARN-7346.prelim1.patch, YARN-7346.prelim2.patch, YARN-7581.prelim.patch > > > When compiling hadoop-yarn-server-timelineservice-hbase against 2.0.0-alpha3, > I got the following errors: > [https://pastebin.com/Ms4jYEVB] > This issue is to fix the compilation errors. > The scope of the Jira is to add a profile to allow optional compilation for > ATSv2 with HBase2.0. The default compilation for trunk will still be for > hbase 1.2.6. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-7346) Add a profile to allow optional compilation for ATSv2 with HBase-2.0
[ https://issues.apache.org/jira/browse/YARN-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16383079#comment-16383079 ] Rohith Sharma K S commented on YARN-7346: - bq. We should fix this by updating the Hadoop personality so that we only run in each module with an appropriate profile active Sorry didn't get it. Could you elaborate more? Does this change is in Yetus or current patch? > Add a profile to allow optional compilation for ATSv2 with HBase-2.0 > > > Key: YARN-7346 > URL: https://issues.apache.org/jira/browse/YARN-7346 > Project: Hadoop YARN > Issue Type: Sub-task >Reporter: Ted Yu >Assignee: Haibo Chen >Priority: Major > Attachments: YARN-7346.00.patch, YARN-7346.01.patch, > YARN-7346.02.patch, YARN-7346.03-incremental.patch, YARN-7346.03.patch, > YARN-7346.04-incremental.patch, YARN-7346.04.patch, YARN-7346.05.patch, > YARN-7346.06.patch, YARN-7346.07.patch, YARN-7346.08.patch, > YARN-7346.prelim1.patch, YARN-7346.prelim2.patch, YARN-7581.prelim.patch > > > When compiling hadoop-yarn-server-timelineservice-hbase against 2.0.0-alpha3, > I got the following errors: > [https://pastebin.com/Ms4jYEVB] > This issue is to fix the compilation errors. > The scope of the Jira is to add a profile to allow optional compilation for > ATSv2 with HBase2.0. The default compilation for trunk will still be for > hbase 1.2.6. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-7346) Add a profile to allow optional compilation for ATSv2 with HBase-2.0
[ https://issues.apache.org/jira/browse/YARN-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16382652#comment-16382652 ] Sean Busbey commented on YARN-7346: --- Sorry, still catching up on things and haven't gotten to dig in here yet. but one quick bit: {quote} The findbugs & javadocs from yetus will fail for one hbase module when the compilation profile is set for the other hbase version. But we can check the jenkins builds for patches for each hbase version and confirm that the patches are good for their respective hbase versions. {quote} We should fix this by updating the Hadoop personality so that we only run in each module with an appropriate profile active > Add a profile to allow optional compilation for ATSv2 with HBase-2.0 > > > Key: YARN-7346 > URL: https://issues.apache.org/jira/browse/YARN-7346 > Project: Hadoop YARN > Issue Type: Sub-task >Reporter: Ted Yu >Assignee: Haibo Chen >Priority: Major > Attachments: YARN-7346.00.patch, YARN-7346.01.patch, > YARN-7346.02.patch, YARN-7346.03-incremental.patch, YARN-7346.03.patch, > YARN-7346.04-incremental.patch, YARN-7346.04.patch, YARN-7346.05.patch, > YARN-7346.06.patch, YARN-7346.07.patch, YARN-7346.08.patch, > YARN-7346.prelim1.patch, YARN-7346.prelim2.patch, YARN-7581.prelim.patch > > > When compiling hadoop-yarn-server-timelineservice-hbase against 2.0.0-alpha3, > I got the following errors: > [https://pastebin.com/Ms4jYEVB] > This issue is to fix the compilation errors. > The scope of the Jira is to add a profile to allow optional compilation for > ATSv2 with HBase2.0. The default compilation for trunk will still be for > hbase 1.2.6. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-7346) Add a profile to allow optional compilation for ATSv2 with HBase-2.0
[ https://issues.apache.org/jira/browse/YARN-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16382429#comment-16382429 ] Vrushali C commented on YARN-7346: -- [~rohithsharma] and I had an offline discussion. We had earlier proposes to have a default branch that will have compilation for hbase 2.x. Let's get that going so that we can track the findbugs & javadoc compilation success/failures for both hbase compilation profiles in this jira. The findbugs & javadocs from yetus will fail for one hbase module when the compilation profile is set for the other hbase version. But we can check the jenkins builds for patches for each hbase version and confirm that the patches are good for their respective hbase versions. > Add a profile to allow optional compilation for ATSv2 with HBase-2.0 > > > Key: YARN-7346 > URL: https://issues.apache.org/jira/browse/YARN-7346 > Project: Hadoop YARN > Issue Type: Sub-task >Reporter: Ted Yu >Assignee: Haibo Chen >Priority: Major > Attachments: YARN-7346.00.patch, YARN-7346.01.patch, > YARN-7346.02.patch, YARN-7346.03-incremental.patch, YARN-7346.03.patch, > YARN-7346.04-incremental.patch, YARN-7346.04.patch, YARN-7346.05.patch, > YARN-7346.06.patch, YARN-7346.07.patch, YARN-7346.08.patch, > YARN-7346.prelim1.patch, YARN-7346.prelim2.patch, YARN-7581.prelim.patch > > > When compiling hadoop-yarn-server-timelineservice-hbase against 2.0.0-alpha3, > I got the following errors: > [https://pastebin.com/Ms4jYEVB] > This issue is to fix the compilation errors. > The scope of the Jira is to add a profile to allow optional compilation for > ATSv2 with HBase2.0. The default compilation for trunk will still be for > hbase 1.2.6. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org