[
https://issues.apache.org/jira/browse/CHUKWA-194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jerome Boulon updated CHUKWA-194:
---------------------------------
Attachment: CHUKWA-194.patch
Backfilling tool:
Class:
- BackfillingLoader
Input:
- String cluster = args[0];
- String machine = args[1];
- String adaptorName = args[2];
- String recordType = args[3];
- String logFile = args[4];
Major change API change: for backfilling I need to know when an adaptor has
finished posting data to the queue. So instead of create yet another shutdown
method I have deprecated the hardStop and the shutdown method to add a new one:
public long shutdown(AdaptorShutdownPolicy shutdownPolicy) throws
AdaptorException;
AdaptorShutdownPolicy are: HARD_STOP, GRACEFULLY, WAIT_TILL_FINISHED
Minor change for the socket controller :
s.setReuseAddress(true); for the socket controller
> Backfilling tools
> -----------------
>
> Key: CHUKWA-194
> URL: https://issues.apache.org/jira/browse/CHUKWA-194
> Project: Hadoop Chukwa
> Issue Type: New Feature
> Components: data collection
> Reporter: Jerome Boulon
> Assignee: Jerome Boulon
> Fix For: 0.2.0
>
> Attachments: CHUKWA-194.patch
>
>
> Chukwa should have a command line tools todo some backfilling process.
> Parameters should be:
> - cluster
> - machine
> - adaptor
> - recordType
> - file
> The idea is to call all component within the same process and the output
> should be a dataSink file ready to be processed by Demux.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
