Sowmya Ramesh created FALCON-760:
------------------------------------
Summary: Messaging is broken for FALCON.ENTITY.TOPIC in case of
Eviction
Key: FALCON-760
URL: https://issues.apache.org/jira/browse/FALCON-760
Project: Falcon
Issue Type: Bug
Affects Versions: 0.6
Reporter: Sowmya Ramesh
Assignee: Sowmya Ramesh
Fix For: 0.5
Couple of issues:
1> In FalconPostProcessing the sequence is to first send the user message and
then falcon message. For eviction instance paths deleted is deserialized from
csv file. During processing of user message, after instance paths are read from
csv file its being deleted. Hence while processing the Falcon message evicted
instance paths are NIL and hence "IGNORE" is being sent in feedInstancePaths
which is incorrect
2> MetadataMappingService expects instance path to construct Lineage. For HCat
retention in FeedEvictor only partitionInfo is sent instead of path which
breaks Lineage
{noformat}
2014-09-26 23:55:04,347 INFO - [ActiveMQ Session Task:] ~ Adding evicted feed
instance: 2014-09-26T23:54Z (MetadataMappingService:299)
2014-09-26 23:55:04,347 INFO - [ActiveMQ Session Task:] ~ Recording lineage
for evicted instances [2009] (InstanceRelationshipGraphBuilder:209)
2014-09-26 23:55:04,347 INFO - [ActiveMQ Session Task:] ~ Computing feed
instance for : name= raaw-logs16-7eaac361, path=[2009], in cluster:
corp-7dce063c (InstanceRelationshipGraphBuilder:216)
2014-09-26 23:55:04,348 ERROR - [ActiveMQ Session Task:] ~ Error in listener
org.apache.falcon.metadata.MetadataMappingService
(WorkflowJobEndNotificationService:104)
org.apache.falcon.FalconException: java.net.URISyntaxException: Illegal
character in path at index 0: [2009]
at
org.apache.falcon.metadata.InstanceRelationshipGraphBuilder.getFeedInstanceName(InstanceRelationshipGraphBuilder.java:284)
at
org.apache.falcon.metadata.InstanceRelationshipGraphBuilder.addEvictedInstance(InstanceRelationshipGraphBuilder.java:218)
at
org.apache.falcon.metadata.MetadataMappingService.onFeedInstanceEvicted(MetadataMappingService.java:300)
at
org.apache.falcon.metadata.MetadataMappingService.onSuccess(MetadataMappingService.java:274)
at
org.apache.falcon.workflow.WorkflowJobEndNotificationService.notifySuccess(WorkflowJobEndNotificationService.java:101)
at
org.apache.falcon.messaging.JMSMessageConsumer.onSuccess(JMSMessageConsumer.java:134)
at
org.apache.falcon.messaging.JMSMessageConsumer.onMessage(JMSMessageConsumer.java:106)
at
org.apache.activemq.ActiveMQMessageConsumer.dispatch(ActiveMQMessageConsumer.java:1229)
at
org.apache.activemq.ActiveMQSessionExecutor.dispatch(ActiveMQSessionExecutor.java:134)
at
org.apache.activemq.ActiveMQSessionExecutor.iterate(ActiveMQSessionExecutor.java:205)
at
org.apache.activemq.thread.PooledTaskRunner.runTask(PooledTaskRunner.java:122)
at
org.apache.activemq.thread.PooledTaskRunner$1.run(PooledTaskRunner.java:43)
at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
Caused by: java.net.URISyntaxException: Illegal character in path at index 0:
[2009]
at java.net.URI$Parser.fail(URI.java:2810)
at java.net.URI$Parser.checkChars(URI.java:2983)
at java.net.URI$Parser.parseHierarchical(URI.java:3067)
at java.net.URI$Parser.parse(URI.java:3025)
at java.net.URI.<init>(URI.java:577)
at
org.apache.falcon.entity.CatalogStorage.<init>(CatalogStorage.java:155)
at
org.apache.falcon.entity.FeedHelper.createStorage(FeedHelper.java:154)
at
org.apache.falcon.metadata.InstanceRelationshipGraphBuilder.getTableFeedInstanceName(InstanceRelationshipGraphBuilder.java:290)
at
org.apache.falcon.metadata.InstanceRelationshipGraphBuilder.getFeedInstanceName(InstanceRelationshipGraphBuilder.java:279)
{noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
