Ok, let us reenable post processing sending the jms message and take up the fix 
in master.   This means we will revert FACON-1926 only in 0.10 and apply to 
master and continue to make the fixes in master – right?

Venkat

On 6/29/16, 12:48 PM, "Venky Ramachandran" <vramachand...@hortonworks.com> 
wrote:

>(Apache JIRA is down so continuing with email)
>
>[~pallavi.rao], [~peeyushb], [~bvellanki], [~vrangan]
>
>
>As it makes sense, I took a look at constructing the counters.txt path 
>mentioned below in the JMSMessageConsumer class.
>{noformat}
>6-06-29 02:46:11,574 INFO [main] 
>org.apache.falcon.workflow.WorkflowExecutionContext: counterFile - 
>hdfs://c6401.ambari.apache.org:8020/tmp/fs-backup/falcon/workflows/feed/sampleReplFeed/logs/job-2016-06-23-08-36/primaryCluster/counter.txt
>{noformat}
>
>From the OOZIE JMS message, I can get the entity name and entity type 
>(decoding the WF name), but the cluster names are not there -- in this case, 
>the replication WF runs on the destination cluster (backupCluster and so the 
>/tmp/fs-backup staging dir), but there is also primaryCluster in the path. 
>
>So, I think we need to rethink about where the counters file gets stored -- 
>possibly in the STATS dir as pallavi points out or some other place that can 
>be derived independently. 
>
>Given that this is blocking 0.10 release, I would prefer to go ahead with Post 
>Processing sending the JMS message so that we can have this functionality work 
>and address the counters path in a separate JIRA. 
>What do people think? 
>

Reply via email to