See
<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/323/display/redirect>
Changes:
------------------------------------------
[...truncated 4.93 MB...]
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[samza-runner-job-invoker-1] ERROR org.apache.samza.container.SamzaContainer$ -
Failed to create a producer for n8, so skipping.
java.lang.UnsupportedOperationException: SamzaImpulseSystem doesn't support
producing
at
org.apache.beam.runners.samza.translation.SamzaImpulseSystemFactory.getProducer(SamzaImpulseSystemFactory.java:59)
at
org.apache.samza.container.SamzaContainer$$anonfun$15.apply(SamzaContainer.scala:246)
at
org.apache.samza.container.SamzaContainer$$anonfun$15.apply(SamzaContainer.scala:243)
at
scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
at
scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:234)
at scala.collection.immutable.Map$Map4.foreach(Map.scala:188)
at scala.collection.TraversableLike$class.map(TraversableLike.scala:234)
at scala.collection.AbstractTraversable.map(Traversable.scala:104)
at
org.apache.samza.container.SamzaContainer$.apply(SamzaContainer.scala:243)
at org.apache.samza.container.SamzaContainer.apply(SamzaContainer.scala)
at
org.apache.samza.processor.StreamProcessor.createSamzaContainer(StreamProcessor.java:407)
at
org.apache.samza.processor.StreamProcessor$1.onNewJobModel(StreamProcessor.java:513)
at
org.apache.samza.standalone.PassthroughJobCoordinator.start(PassthroughJobCoordinator.java:99)
at
org.apache.samza.processor.StreamProcessor.start(StreamProcessor.java:317)
at
org.apache.samza.runtime.LocalApplicationRunner.lambda$run$2(LocalApplicationRunner.java:241)
at
java.util.concurrent.ConcurrentHashMap$KeySetView.forEach(ConcurrentHashMap.java:4649)
at
org.apache.samza.runtime.LocalApplicationRunner.run(LocalApplicationRunner.java:241)
at
org.apache.beam.runners.samza.SamzaRunner.runSamzaApp(SamzaRunner.java:200)
at
org.apache.beam.runners.samza.SamzaRunner.runPortablePipeline(SamzaRunner.java:111)
at
org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:72)
at
org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[samza-runner-job-invoker-1] INFO org.apache.samza.container.SamzaContainer$ -
Got system producers: Set()
[samza-runner-job-invoker-1] INFO org.apache.samza.container.SamzaContainer$ -
Got serdes from factories: Set(stateValueSerde, byteArraySerde)
[samza-runner-job-invoker-1] INFO org.apache.samza.container.SamzaContainer$ -
Got serdes from serialized instances: Set()
[samza-runner-job-invoker-1] INFO org.apache.samza.container.SamzaContainer$ -
Got change log system streams: Map()
[samza-runner-job-invoker-1] INFO org.apache.samza.container.SamzaContainer$ -
Got intermediate streams: List()
[samza-runner-job-invoker-1] INFO org.apache.samza.container.SamzaContainer$ -
Setting up JVM metrics.
[samza-runner-job-invoker-1] INFO org.apache.samza.container.SamzaContainer$ -
Setting up message chooser.
[samza-runner-job-invoker-1] INFO
org.apache.samza.system.chooser.DefaultChooser - Building default chooser with:
useBatching=false, useBootstrapping=false, usePriority=false
[samza-runner-job-invoker-1] INFO org.apache.samza.container.SamzaContainer$ -
Setting up metrics reporters.
[samza-runner-job-invoker-1] INFO org.apache.samza.container.SamzaContainer$ -
Got metrics reporters: Set()
[samza-runner-job-invoker-1] INFO org.apache.samza.container.SamzaContainer$ -
Got security manager: null
[samza-runner-job-invoker-1] INFO org.apache.samza.container.SamzaContainer$ -
Got checkpoint manager: null
[samza-runner-job-invoker-1] INFO org.apache.samza.container.SamzaContainer$ -
Got checkpointListeners : Map()
[samza-runner-job-invoker-1] INFO org.apache.samza.container.SamzaContainer$ -
Got offset manager: org.apache.samza.checkpoint.OffsetManager@1c3c9aa8
[samza-runner-job-invoker-1] INFO org.apache.samza.container.SamzaContainer$ -
Got storage engines: Set(beamStore)
[samza-runner-job-invoker-1] INFO org.apache.samza.container.SamzaContainer$ -
Got thread pool size: 0
[samza-runner-job-invoker-1] INFO org.apache.samza.task.TaskFactoryUtil -
Adapting StreamOperatorTaskFactory to inject container thread pool
[samza-runner-job-invoker-1] INFO org.apache.samza.container.SamzaContainer$ -
Got default storage engine base directory:
<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/src/state>
[samza-runner-job-invoker-1] INFO org.apache.samza.container.SamzaContainer$ -
Got base directory for non logged data stores:
<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/src/state>
[samza-runner-job-invoker-1] WARN org.apache.samza.container.SamzaContainer$ -
No override was provided for logged store base directory. This disables local
state re-use on application restart. If you want to enable this feature, set
LOGGED_STORE_BASE_DIR as an environment variable in all machines running the
Samza container or configure job.logged.store.base.dir for your application
[samza-runner-job-invoker-1] INFO org.apache.samza.container.SamzaContainer$ -
Got base directory for logged data stores:
<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/src/state>
[samza-runner-job-invoker-1] INFO
org.apache.samza.storage.ContainerStorageManager - Starting with
changelogSystemStreams = {} sideInputSystemStreams = {}
[samza-runner-job-invoker-1] WARN
org.apache.samza.storage.ContainerStorageManager - Logged and non-logged store
base directory are configured to same path:
<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/src/state.> It
is recommended to configurethem separately to ensure clean up of non-logged
store data doesn't accidentally impact logged store data.
[samza-runner-job-invoker-1] INFO
org.apache.samza.storage.ContainerStorageManager - Created store beamStore for
task Partition 0 in mode BulkLoad
[samza-runner-job-invoker-1] INFO org.apache.samza.container.SamzaContainer$ -
Got task SSPs: Set(SystemStreamPartition [n14, n14, 0], SystemStreamPartition
[n10, n10, 0], SystemStreamPartition [n1, n1, 0], SystemStreamPartition [n8,
n8, 0])
[samza-runner-job-invoker-1] INFO org.apache.samza.container.SamzaContainer$ -
Got task side input SSPs: Set()
[samza-runner-job-invoker-1] INFO org.apache.samza.table.TableManager - Added 0
tables
[samza-runner-job-invoker-1] INFO org.apache.samza.container.SamzaContainer$ -
Got table manager
[samza-runner-job-invoker-1] INFO org.apache.samza.container.RunLoopFactory -
Got window milliseconds: -1.
[samza-runner-job-invoker-1] INFO org.apache.samza.container.RunLoopFactory -
Got commit milliseconds: -1.
[samza-runner-job-invoker-1] INFO org.apache.samza.container.RunLoopFactory -
Got taskMaxConcurrency: 1.
[samza-runner-job-invoker-1] INFO org.apache.samza.container.RunLoopFactory -
Got asyncCommitEnabled: false.
[samza-runner-job-invoker-1] INFO org.apache.samza.container.RunLoopFactory -
Got callbackTimeout: -1.
[samza-runner-job-invoker-1] INFO org.apache.samza.container.RunLoopFactory -
Got maxIdleMs: 10.
[samza-runner-job-invoker-1] INFO org.apache.samza.container.RunLoopFactory -
Run loop in asynchronous mode.
[samza-runner-job-invoker-1] INFO
org.apache.samza.container.disk.NoThrottlingDiskQuotaPolicy - Using a no
throttling disk quota policy
[samza-runner-job-invoker-1] INFO org.apache.samza.container.SamzaContainer$ -
Disk quotas disabled because polling interval is not set
(container.disk.poll.interval.ms)
[samza-runner-job-invoker-1] INFO org.apache.samza.container.SamzaContainer$ -
Samza container setup complete.
[samza-runner-job-invoker-1] WARN org.apache.samza.config.TaskConfig - Unable
to parse user-configure value for task.shutdown.ms - null. Using default value
30000
[samza-runner-job-invoker-1] INFO org.apache.samza.processor.StreamProcessor -
Starting the container: org.apache.samza.container.SamzaContainer@6d63af69 for
the stream processor: 1.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Starting container.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.metrics.JmxServer - According to Util.getLocalHost.getHostName
we are apache-ci-beam-jenkins-6
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.metrics.JmxServer - Not overriding system property
com.sun.management.jmxremote.authenticate as already has value false
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.metrics.JmxServer - Not overriding system property
com.sun.management.jmxremote.ssl as already has value false
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.metrics.JmxServer - Not overriding system property
java.rmi.server.hostname as already has value apache-ci-beam-jenkins-6
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.metrics.JmxServer - Started JmxServer registry port=41349
server port=38285
url=service:jmx:rmi://localhost:38285/jndi/rmi://localhost:41349/jmxrmi
[Samza StreamProcessor Container Thread-0] INFO STARTUP_LOGGER - Started
JmxServer registry port=41349 server port=38285
url=service:jmx:rmi://localhost:38285/jndi/rmi://localhost:41349/jmxrmi
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.metrics.JmxServer - If you are tunneling, you might want to
try JmxServer registry port=41349 server port=38285
url=service:jmx:rmi://apache-ci-beam-jenkins-6:38285/jndi/rmi://apache-ci-beam-jenkins-6:41349/jmxrmi
[Samza StreamProcessor Container Thread-0] INFO STARTUP_LOGGER - If you are
tunneling, you might want to try JmxServer registry port=41349 server
port=38285
url=service:jmx:rmi://apache-ci-beam-jenkins-6:38285/jndi/rmi://apache-ci-beam-jenkins-6:41349/jmxrmi
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Registering task instance metrics.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Starting JVM metrics.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Starting metrics reporters.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Starting admin multiplexer.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Registering task instances with
offsets.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Starting offset manager.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.checkpoint.OffsetManager - Successfully loaded last processed
offsets: {}
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.checkpoint.OffsetManager - Successfully loaded starting
offsets: Map(Partition 0 -> Map(SystemStreamPartition [n1, n1, 0] -> 0,
SystemStreamPartition [n8, n8, 0] -> 0, SystemStreamPartition [n14, n14, 0] ->
0, SystemStreamPartition [n10, n10, 0] -> 0))
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Registering task instances with
producers.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Starting producer multiplexer.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Starting container storage manager.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.storage.ContainerStorageManager - Checkpointed changelog ssp
offsets: {}
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.storage.ContainerStorageManager - Store Restore started
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.storage.TransactionalStateTaskRestoreManager - Got current
changelog offsets for taskName: Partition 0 as: {}
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.storage.TransactionalStateTaskRestoreManager - Marking current
directory:
<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/src/state/beamStore/Partition_0>
for store: beamStore in task: Partition 0 for deletion since it is not a
logged store.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.storage.TransactionalStateTaskRestoreManager - Store
directories to be retained in Task: Partition 0 are: {}
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.storage.TransactionalStateTaskRestoreManager - Store
directories to be deleted in Task: Partition 0 are:
{beamStore=[<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/src/state/beamStore/Partition_0]}>
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.storage.TransactionalStateTaskRestoreManager - Stores to be
restored in Task: Partition 0 are: {}
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.storage.TransactionalStateTaskRestoreManager - Deleting
persistent store directory:
<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/src/state/beamStore/Partition_0>
for store: beamStore in task: Partition 0
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.storage.TransactionalStateTaskRestoreManager - Creating
missing persistent store current directory:
<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/src/state/beamStore/Partition_0>
for store: beamStore in task: Partition 0
[Samza Restore Thread-0] INFO org.apache.samza.storage.ContainerStorageManager
- Starting stores in task instance Partition 0
[Samza Restore Thread-0] INFO
org.apache.samza.storage.TransactionalStateTaskRestoreManager - Stopped
persistent store: beamStore in task: Partition 0
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.storage.ContainerStorageManager - Re-created store beamStore
in read-write mode for task Partition 0 because it a persistent store
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.storage.ContainerStorageManager - Store Restore complete
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Starting table manager in task
instance Partition 0
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Starting host statistics monitor
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Initializing stream tasks.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0
event time timers in memory
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0
processing time timers in memory
[Samza StreamProcessor Container Thread-0] WARN
org.apache.beam.runners.fnexecution.environment.DockerCommand - Unable to pull
docker image apache/beam_go_sdk:dev, cause: Received exit code 1 for command
'docker pull apache/beam_go_sdk:dev'. stderr: Error response from daemon:
manifest for apache/beam_go_sdk:dev not found
[grpc-default-executor-4] INFO
org.apache.beam.runners.fnexecution.logging.GrpcLoggingService - Beam Fn
Logging client connected.
[grpc-default-executor-4] INFO
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService -
Beam Fn Control client connected with id 30-1
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0
event time timers in memory
[grpc-default-executor-4] INFO
<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:525
- Connecting via grpc @ localhost:40701 ...
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0
processing time timers in memory
[grpc-default-executor-4] INFO
<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:525
- Connecting via grpc @ localhost:35093 ...
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0
event time timers in memory
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0
processing time timers in memory
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0
event time timers in memory
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0
processing time timers in memory
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0
event time timers in memory
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0
processing time timers in memory
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0
event time timers in memory
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0
processing time timers in memory
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0
event time timers in memory
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0
processing time timers in memory
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0
event time timers in memory
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0
processing time timers in memory
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0
event time timers in memory
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0
processing time timers in memory
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0
event time timers in memory
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0
processing time timers in memory
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0
event time timers in memory
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0
processing time timers in memory
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Registering task instances with
consumers.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Starting consumer multiplexer.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Entering run loop.
[Samza StreamProcessor Container Thread-0] WARN
org.apache.samza.processor.StreamProcessor - Received container start
notification for container: org.apache.samza.container.SamzaContainer@6d63af69
in stream processor: 1.
[grpc-default-executor-1] INFO
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService -
getProcessBundleDescriptor request with id 30-5
[grpc-default-executor-1] INFO
<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:525
- Connecting via grpc @ localhost:37781 ...
[grpc-default-executor-1] INFO
org.apache.beam.runners.fnexecution.data.GrpcDataService - Beam Fn Data client
connected.
[grpc-default-executor-1] INFO
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService -
getProcessBundleDescriptor request with id 30-4
[grpc-default-executor-4] INFO
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService -
getProcessBundleDescriptor request with id 30-2
[grpc-default-executor-4] INFO
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService -
getProcessBundleDescriptor request with id 30-6
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0
event time timers in memory
[grpc-default-executor-1] INFO
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService -
getProcessBundleDescriptor request with id 30-3
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0
event time timers in memory
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0
event time timers in memory
[grpc-default-executor-1] INFO
<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:525
- Connecting via grpc @ localhost:44139 ...
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0
event time timers in memory
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.system.SystemConsumers - End of stream reached for partition:
SystemStreamPartition [n14, n14, 0]
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.system.SystemConsumers - End of stream reached for partition:
SystemStreamPartition [n10, n10, 0]
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.system.SystemConsumers - End of stream reached for partition:
SystemStreamPartition [n1, n1, 0]
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.system.SystemConsumers - End of stream reached for partition:
SystemStreamPartition [n8, n8, 0]
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.task.CoordinatorRequests - Shutdown has now been requested by
tasks [Partition 0]
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.task.CoordinatorRequests - Shutdown requested.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Shutting down SamzaContainer.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Shutting down consumer multiplexer.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Shutting down task instance stream
tasks.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Shutting down timer executor
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory - Closing
environment urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\ng/tmp/beam-artifact-staging/ad022372d28d9fcb4316abcc18f913f9fdbd56dcd274e5a3de60742a0edb9b96/1-go-worker"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006worker"
}
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn
Logging clients still connected during shutdown.
[Samza StreamProcessor Container Thread-0] WARN
org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown
endpoint.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment -
Closing Docker container
290f30d3b72306ffb7b7d8a1babee4ff7d816864eed4fc71a794a3046125d32b. Logs:
2021/10/02 18:10:04 Provision info:
pipeline_options:{fields:{key:"beam:option:app_name:v1"
value:{string_value:"go-job-7-1633198198776506691"}}
fields:{key:"beam:option:experiments:v1"
value:{list_value:{values:{string_value:"beam_fn_api"}}}}
fields:{key:"beam:option:go_options:v1"
value:{struct_value:{fields:{key:"options"
value:{struct_value:{fields:{key:"hooks" value:{string_value:"{}"}}}}}}}}
fields:{key:"beam:option:parallelism:v1" value:{number_value:-1}}
fields:{key:"beam:option:retain_docker_containers:v1" value:{bool_value:false}}
fields:{key:"beam:option:runner:v1" value:{string_value:""}}}
logging_endpoint:{url:"localhost:35093"}
artifact_endpoint:{url:"localhost:44421"}
control_endpoint:{url:"localhost:40701"}
dependencies:{type_urn:"beam:artifact:type:file:v1"
type_payload:"\ng/tmp/beam-artifact-staging/ad022372d28d9fcb4316abcc18f913f9fdbd56dcd274e5a3de60742a0edb9b96/1-go-worker"
role_urn:"beam:artifact:role:staging_to:v1" role_payload:"\n\x06worker"}
2021/10/02 18:10:04 Initializing Go harness: /opt/apache/beam/boot --id=30-1
--provision_endpoint=localhost:32995
2021/10/02 18:10:04 Downloaded: /tmp/staged/worker (sha256:
7ec5cb7d3f056cb6f9e7db9f3d2a038f640baaf0e38c8ea8cb4115b3e7414ada, size:
26582946)
Worker exited successfully!
2021/10/02 18:10:04 control response channel closed
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Shutting down task instance table
manager.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Shutting down container storage
manager.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.storage.ContainerStorageManager - Shutdown complete
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Shutting down host statistics
monitor.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Shutting down producer multiplexer.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Shutting down offset manager.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Shutting down metrics reporters.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Shutting down JVM metrics.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Shutting down admin multiplexer.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Shutdown complete.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.processor.StreamProcessor - Container:
org.apache.samza.container.SamzaContainer@6d63af69 stopped. Stopping the stream
processor: 1.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.processor.StreamProcessor - Ignoring onJobModelExpired
invocation since the current state is STOPPING and not in [RUNNING, STARTED,
IN_REBALANCE].
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.processor.StreamProcessor - Shutting down the executor service
of the stream processor: 1.
[Samza StreamProcessor Container Thread-0] WARN
org.apache.samza.container.SamzaContainer - Shutdown is no-op since the
container is already in state: STOPPED
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.processor.StreamProcessor - Waiting 30000 ms for the
container: org.apache.samza.container.SamzaContainer@6d63af69 to shutdown.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.processor.StreamProcessor - Shutdown status of container:
org.apache.samza.container.SamzaContainer@6d63af69 for stream processor: 1 is:
true.
[samza-runner-job-invoker-1] INFO
org.apache.beam.runners.samza.SamzaPipelineResult - Pipeline finished. Final
state: DONE
[samza-runner-job-invoker-0] WARN
org.apache.beam.runners.samza.SamzaPortablePipelineResult - Collecting
monitoring infos is not implemented yet in Samza portable runner.
2021/10/02 18:10:05 Job state: DONE
[grpc-default-executor-5] INFO
org.apache.beam.runners.jobsubmission.InMemoryJobService - Getting job metrics
for
go0job0701633198198776506691-jenkins-1002181001-d00841db_08370a6a-37fa-4456-bd4c-d0b693a43b9c
[grpc-default-executor-5] INFO
org.apache.beam.runners.jobsubmission.InMemoryJobService - Finished getting job
metrics for
go0job0701633198198776506691-jenkins-1002181001-d00841db_08370a6a-37fa-4456-bd4c-d0b693a43b9c
--- PASS: TestEmitParDoAfterGBK (6.64s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/regression 40.911s
> Task :sdks:go:test:samzaValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file
'<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/src/sdks/go/test/build.gradle'>
line: 114
* What went wrong:
Execution failed for task ':sdks:go:test:samzaValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 9m 43s
114 actionable tasks: 81 executed, 28 from cache, 5 up-to-date
Publishing build scan...
https://gradle.com/s/nposp3fdcv3g4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
