[
https://issues.apache.org/jira/browse/AMBARI-23780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16475726#comment-16475726
]
Hudson commented on AMBARI-23780:
---------------------------------
SUCCESS: Integrated in Jenkins build Ambari-trunk-Commit #9253 (See
[https://builds.apache.org/job/Ambari-trunk-Commit/9253/])
[AMBARI-23780] Implement an upgrade helper in Ambari Metrics collector (github:
[https://gitbox.apache.org/repos/asf?p=ambari.git&a=commit&h=b9c2fbb65a0fa844a0f68f7cd0c74a7eb0c6417e])
* (add)
ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/ambari/metrics/core/timeline/upgrade/core/PhoenixClusterMetricsCopier.java
* (add)
ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/ambari/metrics/core/timeline/upgrade/core/MetricsDataMigrationLauncher.java
* (add)
ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/ambari/metrics/core/timeline/upgrade/core/PhoenixHostMetricsCopier.java
* (add)
ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/ambari/metrics/core/timeline/upgrade/core/AbstractPhoenixMetricsCopier.java
* (edit)
ambari-metrics/ambari-metrics-timelineservice/src/main/java/org/apache/ambari/metrics/core/timeline/PhoenixHBaseAccessor.java
> Implement an upgrade helper in Ambari Metrics collector that copies data from
> the old schema to the new.
> ---------------------------------------------------------------------------------------------------------
>
> Key: AMBARI-23780
> URL: https://issues.apache.org/jira/browse/AMBARI-23780
> Project: Ambari
> Issue Type: Bug
> Components: ambari-metrics
> Affects Versions: 2.7.0
> Reporter: Dmytro Sen
> Assignee: Dmytro Sen
> Priority: Critical
> Labels: pull-request-available
> Fix For: 2.7.0
>
> Time Spent: 2h 50m
> Remaining Estimate: 0h
>
> * The upgrade helper can be a main class that is callable through command
> line.
> * Inputs to the upgrade helper
> # Metric list file (Default -> metrics_whitelist file in conf. If not
> present, copy over all the metrics)
> # Start timestamp (Default -> Last 1 month) (Max 8640 points per metric
> in minute table)
> * The upgrade helper runs a set of SQL queries to fetch data from all
> aggregate tables except METRIC_AGGREGATE and uses the API to write to the
> corresponding new tables.
> * The tool marks the completion of every metric entry by using a marker file
> (list of processed metric names) or a simple hbase table.
> * The next time the upgrade tool is invoked, the marker is used to identify
> whether the metric needs to be copied.
> * Let's have the upgrade helper log the status to a different file than
> collector log as a mechanism to monitor the status.
> We have to make a decision on whether the upgrade tool helper should be
> *synchronous* or *asynchronous*. If it is asynchronous, we should add the
> ability for it to '*stop performing upgrade*'.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
