[ 
https://issues.apache.org/jira/browse/AMBARI-22514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16268953#comment-16268953
 ] 

Hudson commented on AMBARI-22514:
---------------------------------

SUCCESS: Integrated in Jenkins build Ambari-trunk-Commit #8452 (See 
[https://builds.apache.org/job/Ambari-trunk-Commit/8452/])
AMBARI-22514. Initial implementation of Schedulable document deletion & 
(oleewere: 
[http://git-wip-us.apache.org/repos/asf?p=ambari.git&a=commit&h=393fdb8048ff579e8a55cd1b477a23d1bf105576])
* (add) 
ambari-infra/ambari-infra-manager/src/main/java/org/apache/ambari/infra/job/archive/DocumentIterator.java
* (add) 
ambari-infra/ambari-infra-manager/src/main/java/org/apache/ambari/infra/job/archive/DocumentItemWriter.java
* (edit) ambari-infra/ambari-infra-manager/src/main/resources/log4j2.xml
* (add) 
ambari-infra/ambari-infra-manager/src/main/java/org/apache/ambari/infra/job/archive/FileAction.java
* (add) 
ambari-infra/ambari-infra-manager/src/main/java/org/apache/ambari/infra/job/archive/DocumentDestination.java
* (add) 
ambari-infra/ambari-infra-manager/src/test/java/org/apache/ambari/infra/job/archive/DocumentExporterTest.java
* (add) 
ambari-infra/ambari-infra-manager/src/main/java/org/apache/ambari/infra/job/archive/DocumentExportProperties.java
* (edit) ambari-logsearch/docker/test-config/logfeeder/logfeeder.properties
* (add) 
ambari-infra/ambari-infra-manager/src/test/java/org/apache/ambari/infra/job/archive/DocumentItemReaderTest.java
* (add) 
ambari-infra/ambari-infra-manager/src/main/java/org/apache/ambari/infra/job/archive/SolrDocumentSource.java
* (add) 
ambari-infra/ambari-infra-manager/src/main/java/org/apache/ambari/infra/job/archive/LocalDocumentItemWriter.java
* (add) 
ambari-infra/ambari-infra-manager/src/main/java/org/apache/ambari/infra/job/archive/SolrDocumentIterator.java
* (add) 
ambari-infra/ambari-infra-manager/src/main/java/org/apache/ambari/infra/job/archive/CompositeFileAction.java
* (edit) ambari-infra/ambari-infra-manager/pom.xml
* (add) 
ambari-infra/ambari-infra-manager/src/test/java/org/apache/ambari/infra/job/archive/SolrQueryBuilderTest.java
* (add) 
ambari-infra/ambari-infra-manager/src/main/java/org/apache/ambari/infra/job/archive/DocumentExportConfiguration.java
* (add) 
ambari-infra/ambari-infra-manager/src/test/java/org/apache/ambari/infra/job/archive/LocalDocumentItemWriterTest.java
* (add) 
ambari-infra/ambari-infra-manager/src/main/java/org/apache/ambari/infra/job/archive/DocumentExportStepListener.java
* (add) 
ambari-infra/ambari-infra-manager/src/main/java/org/apache/ambari/infra/job/archive/S3Uploader.java
* (add) 
ambari-infra/ambari-infra-manager/src/main/java/org/apache/ambari/infra/job/archive/TarGzCompressor.java
* (add) 
ambari-infra/ambari-infra-manager/src/main/java/org/apache/ambari/infra/job/archive/SolrQueryProperties.java
* (add) 
ambari-infra/ambari-infra-manager/src/main/java/org/apache/ambari/infra/job/archive/DocumentItemReader.java
* (edit) 
ambari-infra/ambari-infra-manager/src/main/java/org/apache/ambari/infra/manager/JobManager.java
* (add) 
ambari-infra/ambari-infra-manager/src/main/java/org/apache/ambari/infra/job/archive/DocumentExportJobListener.java
* (add) 
ambari-infra/ambari-infra-manager/src/main/java/org/apache/ambari/infra/job/archive/DocumentExporter.java
* (add) 
ambari-infra/ambari-infra-manager/src/main/java/org/apache/ambari/infra/job/archive/S3Properties.java
* (add) 
ambari-infra/ambari-infra-manager/src/main/java/org/apache/ambari/infra/job/archive/SolrQueryBuilder.java
* (add) 
ambari-infra/ambari-infra-manager/src/main/java/org/apache/ambari/infra/job/archive/DocumentSource.java
* (edit) 
ambari-infra/ambari-infra-manager/src/main/resources/infra-manager.properties
* (add) 
ambari-infra/ambari-infra-manager/src/main/java/org/apache/ambari/infra/job/archive/Document.java


> Infra Manager: Schedulable document deletion & archiving for Infra Solr
> -----------------------------------------------------------------------
>
>                 Key: AMBARI-22514
>                 URL: https://issues.apache.org/jira/browse/AMBARI-22514
>             Project: Ambari
>          Issue Type: Bug
>          Components: ambari-infra
>    Affects Versions: 3.0.0
>            Reporter: Krisztian Kasa
>            Assignee: Krisztian Kasa
>            Priority: Critical
>             Fix For: 3.0.0
>
>   Original Estimate: 240h
>  Remaining Estimate: 240h
>
> If the data size is too big, and the max retention is not good enough, we 
> should delete the latest logs from solr, but of course we need the data 
> itself, so we should archive the data somewhere else (like s3 or hdfs)
> This feature should also provide support for configurable policies that users 
> can configure in order to determine how long data is held and/or archived.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Reply via email to