[
https://issues.apache.org/jira/browse/BEAM-8453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17423437#comment-17423437
]
Miguel Anzo commented on BEAM-8453:
-----------------------------------
Hi, I have been trying to get this issue resolved but I have some questions
about how to proceed.
I initially thought this could be a concurrency issue, as that is what the test
is about, but after analyzing the code and logs it seems that the
NullPointerException is happening
[here|https://github.com/apache/beam/blob/9a4cdfba601bae9165928d1a4df8035785b4c871/sdks/java/io/jms/src/test/java/org/apache/beam/sdk/io/jms/JmsIOTest.java#L386]
which is when the test reads the first messages before the second thread is
started and that has made me rethink that it might be a concurrency issue.
Inside the advance() method the exception happens during the
[receive()|https://github.com/apache/beam/blob/9a4cdfba601bae9165928d1a4df8035785b4c871/sdks/java/io/jms/src/main/java/org/apache/beam/sdk/io/jms/JmsIO.java#L503]
method, there where trying to reproduce the error locally my only success
getting the same error was closing the consumer before the read happens, could
it be that the flake happens because a closed consumer?
I have seen also that there have been other issues with the checkpoint
finalization on JmsIO, is there someone with knowledge is this IO that can
answer me some questions regarding the finalizaCheckpoint part and how the
consumer is created/closed?
Thanks
> Failure in org.apache.beam.sdk.io.jms.JmsIOTest.testCheckpointMarkSafety
> ------------------------------------------------------------------------
>
> Key: BEAM-8453
> URL: https://issues.apache.org/jira/browse/BEAM-8453
> Project: Beam
> Issue Type: Bug
> Components: io-java-jms
> Reporter: Kenneth Knowles
> Assignee: Miguel Anzo
> Priority: P1
> Labels: flake
> Fix For: Not applicable
>
>
> {code}
> Caused by: java.lang.NullPointerException: (No message provided)
> at
> org.apache.beam.sdk.io.jms.JmsIOTest.lambda$withSlowAcks$2(JmsIOTest.java:463)
> at
> org.apache.beam.sdk.io.jms.JmsIOTest.lambda$proxyMethod$6(JmsIOTest.java:489)
> at com.sun.proxy.$Proxy62.receiveNoWait(Unknown Source)
> at org.apache.beam.sdk.io.jms.JmsIO$UnboundedJmsReader.advance(JmsIO.java:512)
> at
> org.apache.beam.sdk.io.jms.JmsIOTest.testCheckpointMarkSafety(JmsIOTest.java:381)
> ...
> {code}
> stdout:
> {code}
> Oct 21, 2019 9:52:32 PM org.apache.activemq.broker.BrokerService
> doStartPersistenceAdapter
> INFO: Using Persistence Adapter: MemoryPersistenceAdapter
> Oct 21, 2019 9:52:32 PM org.apache.activemq.store.kahadb.plist.PListStoreImpl
> doStart
> INFO:
> PListStore:[/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Java_Commit@2/src/sdks/java/io/jms/activemq-data/localhost/tmp_storage]
> started
> Oct 21, 2019 9:52:32 PM org.apache.activemq.broker.BrokerService doStartBroker
> INFO: Apache ActiveMQ 5.13.1 (localhost,
> ID:apache-beam-jenkins-8-45641-1571694713139-0:6) is starting
> Oct 21, 2019 9:52:32 PM org.apache.activemq.broker.TransportConnector start
> INFO: Connector vm://localhost started
> Oct 21, 2019 9:52:32 PM org.apache.activemq.broker.BrokerService doStartBroker
> INFO: Apache ActiveMQ 5.13.1 (localhost,
> ID:apache-beam-jenkins-8-45641-1571694713139-0:6) started
> Oct 21, 2019 9:52:32 PM org.apache.activemq.broker.BrokerService doStartBroker
> INFO: For help or more information please see: http://activemq.apache.org
> Oct 21, 2019 9:52:33 PM org.apache.activemq.broker.BrokerService stop
> INFO: Apache ActiveMQ 5.13.1 (localhost,
> ID:apache-beam-jenkins-8-45641-1571694713139-0:6) is shutting down
> Oct 21, 2019 9:52:33 PM org.apache.activemq.broker.TransportConnector stop
> INFO: Connector vm://localhost stopped
> Oct 21, 2019 9:52:33 PM org.apache.activemq.store.kahadb.plist.PListStoreImpl
> doStop
> INFO:
> PListStore:[/home/jenkins/jenkins-slave/workspace/beam_PreCommit_Java_Commit@2/src/sdks/java/io/jms/activemq-data/localhost/tmp_storage]
> stopped
> Oct 21, 2019 9:52:33 PM org.apache.activemq.broker.BrokerService stop
> INFO: Apache ActiveMQ 5.13.1 (localhost,
> ID:apache-beam-jenkins-8-45641-1571694713139-0:6) uptime 0.512 seconds
> Oct 21, 2019 9:52:33 PM org.apache.activemq.broker.BrokerService stop
> INFO: Apache ActiveMQ 5.13.1 (localhost,
> ID:apache-beam-jenkins-8-45641-1571694713139-0:6) is shutdown
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)