[jira] [Commented] (YARN-6905) Multiple test failures due to FastNumberFormat
[ https://issues.apache.org/jira/browse/YARN-6905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16121863#comment-16121863 ] Haibo Chen commented on YARN-6905: -- I am more supportive of overriding Application.toString() internally. Will upload a patch based on that idea. Do you see major issues of upgrading to HBase 2.0 once it comes out? > Multiple test failures due to FastNumberFormat > -- > > Key: YARN-6905 > URL: https://issues.apache.org/jira/browse/YARN-6905 > Project: Hadoop YARN > Issue Type: Sub-task > Components: timelineserver >Affects Versions: 3.0.0-beta1 > Environment: Ubuntu 14.04 > x86, ppc64le > $ java -version > openjdk version "1.8.0_111" > OpenJDK Runtime Environment (build 1.8.0_111-8u111-b14-3~14.04.1-b14) > OpenJDK 64-Bit Server VM (build 25.111-b14, mixed mode) >Reporter: Sonia Garudi >Assignee: Haibo Chen > > There are multiple test failing in Hadoop YARN Timeline Service HBase tests > project with the following error : > {code} > java.lang.NoClassDefFoundError: org/apache/hadoop/util/FastNumberFormat > at > org.apache.hadoop.yarn.api.records.ApplicationId.toString(ApplicationId.java:104) > {code} > Below are the failing tests : > {code} > TestHBaseTimelineStorageApps.testWriteApplicationToHBase > TestHBaseTimelineStorageApps.testEvents > TestHBaseTimelineStorageEntities.testEventsEscapeTs > TestHBaseTimelineStorageEntities.testWriteEntityToHBase > TestHBaseTimelineStorageEntities.testEventsWithEmptyInfo > {code} -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-6905) Multiple test failures due to FastNumberFormat
[ https://issues.apache.org/jira/browse/YARN-6905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16120680#comment-16120680 ] Vrushali C commented on YARN-6905: -- So the ApplicationId.toString is being invoked in AppIdKeyConverter#decode function which is in the hadoop-yarn-server-timelineservice-hbase module. This module depends on hadoop-yarn-api as well as hadoop-common. So I think moving the FastNumberFormat from hadoop-common to hadoop-yarn-api may not help. I think timeline service would need to override the ApplicationId.toString internally. Or, although I think this won't be very likable, hadoop-yarn-api can provide a ApplicationId#toStringSlowImpl function (or some such named function) in ApplicationId itself which keeps the old code instead of the changes to ApplicationId #toString() in YARN-6768. Unfortunately, we could see more classpath conflicts as trunk keeps evolving, till timeline service on trunk can be based on the hbase version which is based on hadoop trunk. > Multiple test failures due to FastNumberFormat > -- > > Key: YARN-6905 > URL: https://issues.apache.org/jira/browse/YARN-6905 > Project: Hadoop YARN > Issue Type: Sub-task > Components: timelineserver >Affects Versions: 3.0.0-beta1 > Environment: Ubuntu 14.04 > x86, ppc64le > $ java -version > openjdk version "1.8.0_111" > OpenJDK Runtime Environment (build 1.8.0_111-8u111-b14-3~14.04.1-b14) > OpenJDK 64-Bit Server VM (build 25.111-b14, mixed mode) >Reporter: Sonia Garudi >Assignee: Haibo Chen > > There are multiple test failing in Hadoop YARN Timeline Service HBase tests > project with the following error : > {code} > java.lang.NoClassDefFoundError: org/apache/hadoop/util/FastNumberFormat > at > org.apache.hadoop.yarn.api.records.ApplicationId.toString(ApplicationId.java:104) > {code} > Below are the failing tests : > {code} > TestHBaseTimelineStorageApps.testWriteApplicationToHBase > TestHBaseTimelineStorageApps.testEvents > TestHBaseTimelineStorageEntities.testEventsEscapeTs > TestHBaseTimelineStorageEntities.testWriteEntityToHBase > TestHBaseTimelineStorageEntities.testEventsWithEmptyInfo > {code} -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-6905) Multiple test failures due to FastNumberFormat
[ https://issues.apache.org/jira/browse/YARN-6905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16118924#comment-16118924 ] Haibo Chen commented on YARN-6905: -- The hadoop-yarn-server-timelineservice-hbase-tests module uses hadoop-yarn-api-3.0 which depends on hadoop-common-3.0 (to be able to use the newly added FastNumberFormat in ApplicationId.toString()), but it also forces hadoop-common-2.5.1 for hbase-client-1.2.4 jars. The solution to the diamond dependency issue is to upgrade hbase-client to 2.0 so we don't need to force hadoop-common-2.5.1, but it has not been released yet. Before, the final solution becomes an option, we could either move FastNumberFormat to hadoop-yarn-api since only hadoop-yarn-api is using FastNumberFormat for now, or override ApplicationId.toString() in hadoop-yarn-server-timelineservice-hbase-tests. I think the former is less hackier. Thoughts? CC [~vrushalic] [~varun_saxena] [~rohithsharma]. > Multiple test failures due to FastNumberFormat > -- > > Key: YARN-6905 > URL: https://issues.apache.org/jira/browse/YARN-6905 > Project: Hadoop YARN > Issue Type: Sub-task > Components: timelineserver >Affects Versions: 3.0.0-beta1 > Environment: Ubuntu 14.04 > x86, ppc64le > $ java -version > openjdk version "1.8.0_111" > OpenJDK Runtime Environment (build 1.8.0_111-8u111-b14-3~14.04.1-b14) > OpenJDK 64-Bit Server VM (build 25.111-b14, mixed mode) >Reporter: Sonia Garudi > > There are multiple test failing in Hadoop YARN Timeline Service HBase tests > project with the following error : > {code} > java.lang.NoClassDefFoundError: org/apache/hadoop/util/FastNumberFormat > at > org.apache.hadoop.yarn.api.records.ApplicationId.toString(ApplicationId.java:104) > {code} > Below are the failing tests : > {code} > TestHBaseTimelineStorageApps.testWriteApplicationToHBase > TestHBaseTimelineStorageApps.testEvents > TestHBaseTimelineStorageEntities.testEventsEscapeTs > TestHBaseTimelineStorageEntities.testWriteEntityToHBase > TestHBaseTimelineStorageEntities.testEventsWithEmptyInfo > {code} -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-6905) Multiple test failures due to FastNumberFormat
[ https://issues.apache.org/jira/browse/YARN-6905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16107722#comment-16107722 ] Jason Lowe commented on YARN-6905: -- These tests are failing because they are mixing and matching very different versions of Hadoop jars. IIUC the Hadoop project does not make any binary compatibility claims when mixing different versions of jars that are distributed as part of Hadoop itself. To me this looks like an invalid setup. > Multiple test failures due to FastNumberFormat > -- > > Key: YARN-6905 > URL: https://issues.apache.org/jira/browse/YARN-6905 > Project: Hadoop YARN > Issue Type: Bug > Components: timelineserver >Affects Versions: 3.0.0-beta1 > Environment: Ubuntu 14.04 > x86, ppc64le > $ java -version > openjdk version "1.8.0_111" > OpenJDK Runtime Environment (build 1.8.0_111-8u111-b14-3~14.04.1-b14) > OpenJDK 64-Bit Server VM (build 25.111-b14, mixed mode) >Reporter: Sonia Garudi > > There are multiple test failing in Hadoop YARN Timeline Service HBase tests > project with the following error : > {code} > java.lang.NoClassDefFoundError: org/apache/hadoop/util/FastNumberFormat > at > org.apache.hadoop.yarn.api.records.ApplicationId.toString(ApplicationId.java:104) > {code} > Below are the failing tests : > {code} > TestHBaseTimelineStorageApps.testWriteApplicationToHBase > TestHBaseTimelineStorageApps.testEvents > TestHBaseTimelineStorageEntities.testEventsEscapeTs > TestHBaseTimelineStorageEntities.testWriteEntityToHBase > TestHBaseTimelineStorageEntities.testEventsWithEmptyInfo > {code} -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-6905) Multiple test failures due to FastNumberFormat
[ https://issues.apache.org/jira/browse/YARN-6905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16107186#comment-16107186 ] Sonia Garudi commented on YARN-6905: These errors are appearing post YARN-6768 commit. In hbase-tests module, the hadoop-common version used is 2.5.1(hbase-compatible-hadoop.version). > Multiple test failures due to FastNumberFormat > -- > > Key: YARN-6905 > URL: https://issues.apache.org/jira/browse/YARN-6905 > Project: Hadoop YARN > Issue Type: Bug > Components: timelineserver >Affects Versions: 3.0.0-beta1 > Environment: Ubuntu 14.04 > x86, ppc64le > $ java -version > openjdk version "1.8.0_111" > OpenJDK Runtime Environment (build 1.8.0_111-8u111-b14-3~14.04.1-b14) > OpenJDK 64-Bit Server VM (build 25.111-b14, mixed mode) >Reporter: Sonia Garudi > > There are multiple test failing in Hadoop YARN Timeline Service HBase tests > project with the following error : > {code} > java.lang.NoClassDefFoundError: org/apache/hadoop/util/FastNumberFormat > at > org.apache.hadoop.yarn.api.records.ApplicationId.toString(ApplicationId.java:104) > {code} > Below are the failing tests : > {code} > TestHBaseTimelineStorageApps.testWriteApplicationToHBase > TestHBaseTimelineStorageApps.testEvents > TestHBaseTimelineStorageEntities.testEventsEscapeTs > TestHBaseTimelineStorageEntities.testWriteEntityToHBase > TestHBaseTimelineStorageEntities.testEventsWithEmptyInfo > {code} -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org