[ 
https://issues.apache.org/jira/browse/FLINK-9349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16480207#comment-16480207
 ] 

ASF GitHub Bot commented on FLINK-9349:
---------------------------------------

Github user snuyanzin commented on the issue:

    https://github.com/apache/flink/pull/6040
  
    @tzulitai, @tedyu thnk you for your review, comments and contribution tips
    I did updates which includes moving test into AbstractFetcherTest and 
making it kafka connector version independent
    
    Could you please help me a bit?
    Suddenly the travis build failed on YARNSessionCapacitySchedulerITCase 
(only on flink travis, on my fork it passed several times).  It does not look 
like result of changes as there is nothing related to yarn. Anyway I tried to 
investigate it. I found several similar issues on jira however they are closed. 
    
    Also I downloaded logs mentioned in failed travis job 
    
    > Uploading to transfer.sh
    https://transfer.sh/JspTz/24547.10.tar.gz
    
    based on them it looks like there was a connectivity issue with one of the 
ApplicationMaster 
    as log yarn-tests/container_1526608500321_0007_01_000001/job-manager.log is 
full of
    > 2018-05-18 01:56:49,448 WARN  akka.remote.transport.netty.NettyTransport  
                  - Remote connection to [null] failed with 
java.net.ConnectException: Connection refused: 
travis-job-2a2afdc5-7bf8-4597-946e-16551a5ebbc4/127.0.1.1:43980
    2018-05-18 01:56:49,449 WARN  akka.remote.ReliableDeliverySupervisor        
                - Association with remote system 
[akka.tcp://flink@travis-job-2a2afdc5-7bf8-4597-946e-16551a5ebbc4:43980] has 
failed, address is now gated for [50] ms. Reason: [Association failed with 
[akka.tcp://flink@travis-job-2a2afdc5-7bf8-4597-946e-16551a5ebbc4:43980]] 
Caused by: [Connection refused: 
travis-job-2a2afdc5-7bf8-4597-946e-16551a5ebbc4/127.0.1.1:43980]
    
    very strange thing 
    
    > Remote connection to [null] 



> KafkaConnector Exception  while fetching from multiple kafka topics
> -------------------------------------------------------------------
>
>                 Key: FLINK-9349
>                 URL: https://issues.apache.org/jira/browse/FLINK-9349
>             Project: Flink
>          Issue Type: Bug
>          Components: Kafka Connector
>    Affects Versions: 1.4.0, 1.5.0
>            Reporter: Vishal Santoshi
>            Assignee: Sergey Nuyanzin
>            Priority: Critical
>         Attachments: Flink9349Test.java
>
>
> ./flink-connectors/flink-connector-kafka-0.9/src/main/java/org/apache/flink/streaming/connectors/kafka/internal/Kafka09Fetcher.java
>  
> It seems the List subscribedPartitionStates was being modified when 
> runFetchLoop iterated the List.
> This can happen if, e.g., FlinkKafkaConsumer runs the following code 
> concurrently:
>                 kafkaFetcher.addDiscoveredPartitions(discoveredPartitions);
>  
> {code:java}
>  java.util.ConcurrentModificationException
>       at 
> java.util.LinkedList$ListItr.checkForComodification(LinkedList.java:966)
>       at java.util.LinkedList$ListItr.next(LinkedList.java:888)
>       at 
> org.apache.flink.streaming.connectors.kafka.internal.Kafka09Fetcher.runFetchLoop(Kafka09Fetcher.java:134)
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to