[
https://issues.apache.org/jira/browse/BEAM-11805?focusedWorklogId=553313&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-553313
]
ASF GitHub Bot logged work on BEAM-11805:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 17/Feb/21 01:46
Start Date: 17/Feb/21 01:46
Worklog Time Spent: 10m
Work Description: allenpradeep commented on pull request #13990:
URL: https://github.com/apache/beam/pull/13990#issuecomment-780237668
> @allenpradeep could you also cherry-pick the the version update commits
from #13765? They were rolled back in #13792. I'd like to apply both changes at
once to make sure they pass CI before merging.
There were some spanner test issues with the previous commit. I'll cherry
pick #13765 after the integration tests passes and resend.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 553313)
Time Spent: 7.5h (was: 7h 20m)
> SpannerReadIT broken in PostCommit_Java
> ---------------------------------------
>
> Key: BEAM-11805
> URL: https://issues.apache.org/jira/browse/BEAM-11805
> Project: Beam
> Issue Type: Bug
> Components: io-java-gcp
> Reporter: Brian Hulette
> Assignee: Allen Pradeep Xavier
> Priority: P1
> Time Spent: 7.5h
> Remaining Estimate: 0h
>
> SpannerReadIT started failing after https://github.com/apache/beam/pull/13765
> went in:
> https://ci-beam.apache.org/job/beam_PostCommit_Java/7195/
> Example log:
> {code}
> java.lang.RuntimeException: java.lang.RuntimeException:
> org.apache.beam.sdk.util.UserCodeException:
> java.lang.IllegalArgumentException: Multiple entries with same key:
> user-agent=Apache_Beam_Java/2.29.0-SNAPSHOT and user-agent=spanner-java/3.2.1
> at
> org.apache.beam.runners.dataflow.worker.IntrinsicMapTaskExecutorFactory$1.typedApply(IntrinsicMapTaskExecutorFactory.java:197)
> at
> org.apache.beam.runners.dataflow.worker.IntrinsicMapTaskExecutorFactory$1.typedApply(IntrinsicMapTaskExecutorFactory.java:168)
> at
> org.apache.beam.runners.dataflow.worker.graph.Networks$TypeSafeNodeFunction.apply(Networks.java:66)
> at
> org.apache.beam.runners.dataflow.worker.graph.Networks$TypeSafeNodeFunction.apply(Networks.java:53)
> at
> org.apache.beam.runners.dataflow.worker.graph.Networks.replaceDirectedNetworkNodes(Networks.java:90)
> at
> org.apache.beam.runners.dataflow.worker.IntrinsicMapTaskExecutorFactory.create(IntrinsicMapTaskExecutorFactory.java:128)
> at
> org.apache.beam.runners.dataflow.worker.BatchDataflowWorker.doWork(BatchDataflowWorker.java:361)
> at
> org.apache.beam.runners.dataflow.worker.BatchDataflowWorker.getAndPerformWork(BatchDataflowWorker.java:314)
> at
> org.apache.beam.runners.dataflow.worker.DataflowBatchWorkerHarness$WorkerThread.doWork(DataflowBatchWorkerHarness.java:140)
> at
> org.apache.beam.runners.dataflow.worker.DataflowBatchWorkerHarness$WorkerThread.call(DataflowBatchWorkerHarness.java:120)
> at
> org.apache.beam.runners.dataflow.worker.DataflowBatchWorkerHarness$WorkerThread.call(DataflowBatchWorkerHarness.java:107)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
> at java.lang.Thread.run(Thread.java:748)
> Caused by: org.apache.beam.sdk.util.UserCodeException:
> java.lang.IllegalArgumentException: Multiple entries with same key:
> user-agent=Apache_Beam_Java/2.29.0-SNAPSHOT and user-agent=spanner-java/3.2.1
> at
> org.apache.beam.sdk.util.UserCodeException.wrap(UserCodeException.java:39)
> at
> org.apache.beam.sdk.io.gcp.spanner.CreateTransactionFn$DoFnInvoker.invokeSetup(Unknown
> Source)
> at
> org.apache.beam.runners.dataflow.worker.DoFnInstanceManagers$ConcurrentQueueInstanceManager.deserializeCopy(DoFnInstanceManagers.java:83)
> at
> org.apache.beam.runners.dataflow.worker.DoFnInstanceManagers$ConcurrentQueueInstanceManager.peek(DoFnInstanceManagers.java:65)
> at
> org.apache.beam.runners.dataflow.worker.UserParDoFnFactory.create(UserParDoFnFactory.java:99)
> at
> org.apache.beam.runners.dataflow.worker.DefaultParDoFnFactory.create(DefaultParDoFnFactory.java:75)
> at
> org.apache.beam.runners.dataflow.worker.IntrinsicMapTaskExecutorFactory.createParDoOperation(IntrinsicMapTaskExecutorFactory.java:267)
> at
> org.apache.beam.runners.dataflow.worker.IntrinsicMapTaskExecutorFactory.access$000(IntrinsicMapTaskExecutorFactory.java:89)
> at
> org.apache.beam.runners.dataflow.worker.IntrinsicMapTaskExecutorFactory$1.typedApply(IntrinsicMapTaskExecutorFactory.java:186)
> ... 14 more
> Caused by: java.lang.IllegalArgumentException: Multiple entries with same
> key: user-agent=Apache_Beam_Java/2.29.0-SNAPSHOT and
> user-agent=spanner-java/3.2.1
> at
> com.google.common.collect.ImmutableMap.conflictException(ImmutableMap.java:215)
> at
> com.google.common.collect.ImmutableMap.checkNoConflict(ImmutableMap.java:209)
> at
> com.google.common.collect.RegularImmutableMap.checkNoConflictInKeyBucket(RegularImmutableMap.java:147)
> at
> com.google.common.collect.RegularImmutableMap.fromEntryArray(RegularImmutableMap.java:110)
> at
> com.google.common.collect.ImmutableMap$Builder.build(ImmutableMap.java:393)
> at
> com.google.cloud.spanner.spi.v1.GapicSpannerRpc.<init>(GapicSpannerRpc.java:320)
> at
> com.google.cloud.spanner.SpannerOptions$DefaultSpannerRpcFactory.create(SpannerOptions.java:467)
> at
> com.google.cloud.spanner.SpannerOptions$DefaultSpannerRpcFactory.create(SpannerOptions.java:462)
> at com.google.cloud.ServiceOptions.getRpc(ServiceOptions.java:561)
> at
> com.google.cloud.spanner.SpannerOptions.getSpannerRpcV1(SpannerOptions.java:1169)
> at com.google.cloud.spanner.SpannerImpl.<init>(SpannerImpl.java:134)
> at
> com.google.cloud.spanner.SpannerOptions$DefaultSpannerFactory.create(SpannerOptions.java:457)
> at
> com.google.cloud.spanner.SpannerOptions$DefaultSpannerFactory.create(SpannerOptions.java:452)
> at com.google.cloud.ServiceOptions.getService(ServiceOptions.java:541)
> at
> org.apache.beam.sdk.io.gcp.spanner.SpannerAccessor.createAndConnect(SpannerAccessor.java:163)
> at
> org.apache.beam.sdk.io.gcp.spanner.SpannerAccessor.getOrCreate(SpannerAccessor.java:98)
> at
> org.apache.beam.sdk.io.gcp.spanner.CreateTransactionFn.setup(CreateTransactionFn.java:39)
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
