[ 
https://issues.apache.org/jira/browse/FLUME-1862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13559416#comment-13559416
 ] 

Hari Shreedharan commented on FLUME-1862:
-----------------------------------------

Is the reason for the failure that the index is being recovered from disk? 
Looks like the failure is in the transaction commit?
{code}
org.apache.flume.EventDeliveryException: Failed to commit transaction. 
Transaction rolled back.
        at 
org.apache.flume.sink.elasticsearch.ElasticSearchSink.process(ElasticSearchSink.java:229)
        at 
org.apache.flume.sink.elasticsearch.TestElasticSearchSink.shouldIndexFiveEventsOverThreeBatches(TestElasticSearchSink.java:139)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at 
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:45)
        at 
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:15)
        at 
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:42)
        at 
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:20)
        at 
org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:28)
        at 
org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:30)
        at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:263)
        at 
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:68)
        at 
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:47)
        at org.junit.runners.ParentRunner$3.run(ParentRunner.java:231)
        at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:60)
        at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:229)
        at org.junit.runners.ParentRunner.access$000(ParentRunner.java:50)
        at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:222)
        at org.junit.runners.ParentRunner.run(ParentRunner.java:300)
        at 
org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:236)
        at 
org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:134)
        at 
org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:113)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at 
org.apache.maven.surefire.util.ReflectionUtils.invokeMethodWithArray(ReflectionUtils.java:189)
        at 
org.apache.maven.surefire.booter.ProviderFactory$ProviderProxy.invoke(ProviderFactory.java:165)
        at 
org.apache.maven.surefire.booter.ProviderFactory.invokeProvider(ProviderFactory.java:85)
        at 
org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:103)
        at 
org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:74)
Caused by: org.apache.flume.EventDeliveryException: failure in bulk execution:
[0]: index [flume-2013-01-18], type [log], id [JmKw9Ua5RTOoWtyzhM6QaA], message 
[UnavailableShardsException[[flume-2013-01-18][3] [2] shardIt, [0] active : 
Timeout waiting for [1m], request: 
org.elasticsearch.action.bulk.BulkShardRequest@2cd5a3]]
[1]: index [flume-2013-01-18], type [log], id [ia_lCgKNT4K4aGJbbTzHyw], message 
[UnavailableShardsException[[flume-2013-01-18][4] [2] shardIt, [0] active : 
Timeout waiting for [1m], request: 
org.elasticsearch.action.bulk.BulkShardRequest@4a6ccc]]
        at 
org.apache.flume.sink.elasticsearch.ElasticSearchSink.process(ElasticSearchSink.java:206)
{code}
                
> ElasticSearchSink test is flakey
> --------------------------------
>
>                 Key: FLUME-1862
>                 URL: https://issues.apache.org/jira/browse/FLUME-1862
>             Project: Flume
>          Issue Type: Bug
>            Reporter: Hari Shreedharan
>         Attachments: FLUME-1862.patch
>
>
> Looks like this test: 
> org.apache.flume.sink.elasticsearch.TestElasticSearchSink.shouldIndexFiveEventsOverThreeBatches
> fails intermittently:
> https://builds.apache.org/job/flume-trunk/353/
> https://builds.apache.org/job/flume-trunk/341/

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Reply via email to