[
https://issues.apache.org/jira/browse/AMBARI-21068?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16018217#comment-16018217
]
Hudson commented on AMBARI-21068:
---------------------------------
FAILURE: Integrated in Jenkins build Ambari-trunk-Commit #7506 (See
[https://builds.apache.org/job/Ambari-trunk-Commit/7506/])
AMBARI-21068 : Kafka broker goes down after Ambari upgrade from 2.5.0 to
(avijayan:
[http://git-wip-us.apache.org/repos/asf?p=ambari.git&a=commit&h=c9f705de801aac16f7da4550bcd180ff56b8c685])
* (edit)
ambari-server/src/test/java/org/apache/ambari/server/upgrade/UpgradeCatalog251Test.java
* (edit)
ambari-server/src/main/java/org/apache/ambari/server/upgrade/UpgradeCatalog251.java
AMBARI-21068 : Kafka broker goes down after Ambari upgrade from 2.5.0 to
(avijayan:
[http://git-wip-us.apache.org/repos/asf?p=ambari.git&a=commit&h=d740384e8059d9d7b12d7ae99e7423a92c4df4bf])
* (edit)
ambari-server/src/main/resources/common-services/HIVE/2.1.0.3.0/package/templates/hadoop-metrics2-hivemetastore.properties.j2
* (edit)
ambari-server/src/main/resources/stacks/HDP/2.0.6/hooks/before-START/templates/hadoop-metrics2.properties.j2
* (edit)
ambari-metrics/ambari-metrics-hadoop-sink/src/main/java/org/apache/hadoop/metrics2/sink/timeline/HadoopTimelineMetricsSink.java
* (edit)
ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/templates/hadoop-metrics2-hivemetastore.properties.j2
* (edit)
ambari-metrics/ambari-metrics-hadoop-sink/src/test/java/org/apache/hadoop/metrics2/sink/timeline/HadoopTimelineMetricsSinkTest.java
* (edit)
ambari-metrics/ambari-metrics-storm-sink-legacy/src/main/java/org/apache/hadoop/metrics2/sink/storm/StormTimelineMetricsReporter.java
* (edit)
ambari-server/src/main/resources/common-services/STORM/1.0.1.3.0/package/templates/config.yaml.j2
* (edit)
ambari-server/src/main/resources/common-services/STORM/0.9.1/package/templates/storm-metrics2.properties.j2
* (edit)
ambari-server/src/main/resources/stacks/HDP/2.6/services/HDFS/configuration/hadoop-metrics2.properties.xml
* (edit)
ambari-server/src/main/resources/common-services/HBASE/0.96.0.2.0/package/templates/hadoop-metrics2-hbase.properties-GANGLIA-MASTER.j2
* (edit)
ambari-server/src/main/resources/common-services/STORM/1.0.1.3.0/package/templates/storm-metrics2.properties.j2
* (edit)
ambari-server/src/main/resources/common-services/KAFKA/0.10.0.3.0/configuration/kafka-broker.xml
* (edit)
ambari-server/src/main/resources/common-services/HIVE/2.1.0.3.0/package/templates/hadoop-metrics2-llapdaemon.j2
* (edit)
ambari-server/src/main/resources/common-services/AMBARI_METRICS/0.1.0/package/templates/hadoop-metrics2-hbase.properties.j2
* (edit)
ambari-server/src/main/resources/common-services/FLUME/1.4.0.2.0/package/templates/flume-metrics2.properties.j2
* (edit)
ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/templates/hadoop-metrics2-hiveserver2.properties.j2
* (edit)
ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/templates/hadoop-metrics2-llaptaskscheduler.j2
* (edit)
ambari-server/src/main/resources/common-services/HIVE/2.1.0.3.0/package/templates/hadoop-metrics2-llaptaskscheduler.j2
* (edit)
ambari-metrics/ambari-metrics-storm-sink/src/main/java/org/apache/hadoop/metrics2/sink/storm/StormTimelineMetricsSink.java
* (edit)
ambari-server/src/main/resources/common-services/KAFKA/0.8.1/configuration/kafka-broker.xml
* (edit)
ambari-server/src/main/resources/common-services/HIVE/2.1.0.3.0/package/templates/hadoop-metrics2-hiveserver2.properties.j2
* (edit)
ambari-server/src/main/resources/stacks/HDP/3.0/hooks/before-START/templates/hadoop-metrics2.properties.j2
* (edit)
ambari-server/src/main/resources/common-services/HBASE/0.96.0.2.0/package/templates/hadoop-metrics2-hbase.properties-GANGLIA-RS.j2
* (edit)
ambari-server/src/main/resources/common-services/HDFS/3.0.0.3.0/configuration/hadoop-metrics2.properties.xml
* (edit)
ambari-server/src/main/resources/common-services/HIVE/0.12.0.2.0/package/templates/hadoop-metrics2-llapdaemon.j2
* (edit)
ambari-server/src/main/resources/common-services/STORM/0.9.1/package/templates/config.yaml.j2
* (edit)
ambari-metrics/ambari-metrics-kafka-sink/src/main/java/org/apache/hadoop/metrics2/sink/kafka/KafkaTimelineMetricsReporter.java
* (edit)
ambari-metrics/ambari-metrics-storm-sink-legacy/src/main/java/org/apache/hadoop/metrics2/sink/storm/StormTimelineMetricsSink.java
* (edit)
ambari-server/src/main/resources/common-services/ACCUMULO/1.6.1.2.2.0/package/templates/hadoop-metrics2-accumulo.properties.j2
> Kafka broker goes down after Ambari upgrade from 2.5.0 to 2.5.1 due to
> missing 'kafka.timeline.metrics.instanceId' property
> ---------------------------------------------------------------------------------------------------------------------------
>
> Key: AMBARI-21068
> URL: https://issues.apache.org/jira/browse/AMBARI-21068
> Project: Ambari
> Issue Type: Bug
> Components: ambari-upgrade
> Affects Versions: 2.5.1
> Reporter: Vivek Sharma
> Assignee: Dmytro Sen
> Priority: Blocker
> Labels: upgrade
> Fix For: 2.5.1
>
> Attachments: AMBARI-21068-addendum-2.5.patch,
> AMBARI-21068-addendum-trunk.patch, AMBARI-21075-branch-2.5.patch,
> AMBARI-21075.patch
>
>
> STR:
> 1. Deploy HDP-2.6.0 cluster with Ambari-2.5.0.3
> 2. Upgrade Ambari to 2.5.1.0-130 (hash:
> e7745e411638405dd0a406305e1da222c6879daa)
> 3. Observed that Kafka broker went down
> Kafka logs indicate:
> {code}
> [2017-05-19 03:42:17,105] FATAL (kafka.Kafka$)
> java.lang.IllegalArgumentException: requirement failed: Missing required
> property 'kafka.timeline.metrics.instanceId'
> at scala.Predef$.require(Predef.scala:233)
> at
> kafka.utils.VerifiableProperties.getString(VerifiableProperties.scala:177)
> at
> org.apache.hadoop.metrics2.sink.kafka.KafkaTimelineMetricsReporter.init(KafkaTimelineMetricsReporter.java:169)
> at
> kafka.metrics.KafkaMetricsReporter$$anonfun$startReporters$1.apply(KafkaMetricsReporter.scala:66)
> at
> kafka.metrics.KafkaMetricsReporter$$anonfun$startReporters$1.apply(KafkaMetricsReporter.scala:64)
> at
> scala.collection.IndexedSeqOptimized$class.foreach(IndexedSeqOptimized.scala:33)
> at
> scala.collection.mutable.WrappedArray.foreach(WrappedArray.scala:34)
> at
> kafka.metrics.KafkaMetricsReporter$.startReporters(KafkaMetricsReporter.scala:64)
> at
> kafka.server.KafkaServerStartable$.fromProps(KafkaServerStartable.scala:27)
> at kafka.Kafka$.main(Kafka.scala:58)
> at kafka.Kafka.main(Kafka.scala)
> {code}
> Did not see this property being added on ambari_upgrade_config_changes.json
> file
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
