See
<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/653/display/redirect?page=changes>
Changes:
[alexander.zhuravlev] [BEAM-13489] Updated manifest.json and index.html to
follow best
[stranniknm] [BEAM-13531] playground - fetch example info only once
[noreply] Merge pull request #16320 from [BEAM-13512] [Playground] send request
to
[noreply] Merge pull request #16209 from [Playground][BEAM-13304]Deploy Python
[noreply] Merge pull request #16105 from [BEAM-13328] [Playground] Add
[noreply] Merge pull request #16103 from [BEAM-13252] [Playground] Feedback
Thumbs
[noreply] Better type inference for GroupBy. (#16318)
[noreply] [BEAM-13534] Update TestAutomatedExpansionService liveness check to
not
------------------------------------------
[...truncated 6.05 MB...]
at
org.apache.samza.container.SamzaContainer$.apply(SamzaContainer.scala:243)
at org.apache.samza.container.SamzaContainer.apply(SamzaContainer.scala)
at
org.apache.samza.processor.StreamProcessor.createSamzaContainer(StreamProcessor.java:407)
at
org.apache.samza.processor.StreamProcessor$1.onNewJobModel(StreamProcessor.java:513)
at
org.apache.samza.standalone.PassthroughJobCoordinator.start(PassthroughJobCoordinator.java:99)
at
org.apache.samza.processor.StreamProcessor.start(StreamProcessor.java:317)
at
org.apache.samza.runtime.LocalApplicationRunner.lambda$run$2(LocalApplicationRunner.java:241)
at
java.util.concurrent.ConcurrentHashMap$KeySetView.forEach(ConcurrentHashMap.java:4649)
at
org.apache.samza.runtime.LocalApplicationRunner.run(LocalApplicationRunner.java:241)
at
org.apache.beam.runners.samza.SamzaRunner.runSamzaApp(SamzaRunner.java:200)
at
org.apache.beam.runners.samza.SamzaRunner.runPortablePipeline(SamzaRunner.java:111)
at
org.apache.beam.runners.samza.SamzaPipelineRunner.run(SamzaPipelineRunner.java:72)
at
org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:86)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
[samza-runner-job-invoker-2] INFO org.apache.samza.container.SamzaContainer$ -
Got system producers: Set()
[samza-runner-job-invoker-2] INFO org.apache.samza.container.SamzaContainer$ -
Got serdes from factories: Set(stateValueSerde, byteArraySerde)
[samza-runner-job-invoker-2] INFO org.apache.samza.container.SamzaContainer$ -
Got serdes from serialized instances: Set()
[samza-runner-job-invoker-2] INFO org.apache.samza.container.SamzaContainer$ -
Got change log system streams: Map()
[samza-runner-job-invoker-2] INFO org.apache.samza.container.SamzaContainer$ -
Got intermediate streams: List()
[samza-runner-job-invoker-2] INFO org.apache.samza.container.SamzaContainer$ -
Setting up JVM metrics.
[samza-runner-job-invoker-2] INFO org.apache.samza.container.SamzaContainer$ -
Setting up message chooser.
[samza-runner-job-invoker-2] INFO
org.apache.samza.system.chooser.DefaultChooser - Building default chooser with:
useBatching=false, useBootstrapping=false, usePriority=false
[samza-runner-job-invoker-2] INFO org.apache.samza.container.SamzaContainer$ -
Setting up metrics reporters.
[samza-runner-job-invoker-2] INFO org.apache.samza.container.SamzaContainer$ -
Got metrics reporters: Set()
[samza-runner-job-invoker-2] INFO org.apache.samza.container.SamzaContainer$ -
Got security manager: null
[samza-runner-job-invoker-2] INFO org.apache.samza.container.SamzaContainer$ -
Got checkpoint manager: null
[samza-runner-job-invoker-2] INFO org.apache.samza.container.SamzaContainer$ -
Got checkpointListeners : Map()
[samza-runner-job-invoker-2] INFO org.apache.samza.container.SamzaContainer$ -
Got offset manager: org.apache.samza.checkpoint.OffsetManager@535af1cb
[samza-runner-job-invoker-2] INFO org.apache.samza.container.SamzaContainer$ -
Got storage engines: Set(beamStore)
[samza-runner-job-invoker-2] INFO org.apache.samza.container.SamzaContainer$ -
Got thread pool size: 0
[samza-runner-job-invoker-2] INFO org.apache.samza.task.TaskFactoryUtil -
Adapting StreamOperatorTaskFactory to inject container thread pool
[samza-runner-job-invoker-2] INFO org.apache.samza.container.SamzaContainer$ -
Got default storage engine base directory:
<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/src/state>
[samza-runner-job-invoker-2] INFO org.apache.samza.container.SamzaContainer$ -
Got base directory for non logged data stores:
<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/src/state>
[samza-runner-job-invoker-2] WARN org.apache.samza.container.SamzaContainer$ -
No override was provided for logged store base directory. This disables local
state re-use on application restart. If you want to enable this feature, set
LOGGED_STORE_BASE_DIR as an environment variable in all machines running the
Samza container or configure job.logged.store.base.dir for your application
[samza-runner-job-invoker-2] INFO org.apache.samza.container.SamzaContainer$ -
Got base directory for logged data stores:
<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/src/state>
[samza-runner-job-invoker-2] INFO
org.apache.samza.storage.ContainerStorageManager - Starting with
changelogSystemStreams = {} sideInputSystemStreams = {}
[samza-runner-job-invoker-2] WARN
org.apache.samza.storage.ContainerStorageManager - Logged and non-logged store
base directory are configured to same path:
<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/src/state.> It
is recommended to configurethem separately to ensure clean up of non-logged
store data doesn't accidentally impact logged store data.
[samza-runner-job-invoker-2] INFO
org.apache.samza.storage.ContainerStorageManager - Created store beamStore for
task Partition 0 in mode BulkLoad
[samza-runner-job-invoker-2] INFO org.apache.samza.container.SamzaContainer$ -
Got task SSPs: Set(SystemStreamPartition [n14, n14, 0], SystemStreamPartition
[n10, n10, 0], SystemStreamPartition [n1, n1, 0], SystemStreamPartition [n8,
n8, 0])
[samza-runner-job-invoker-2] INFO org.apache.samza.container.SamzaContainer$ -
Got task side input SSPs: Set()
[samza-runner-job-invoker-2] INFO org.apache.samza.table.TableManager - Added 0
tables
[samza-runner-job-invoker-2] INFO org.apache.samza.container.SamzaContainer$ -
Got table manager
[samza-runner-job-invoker-2] INFO org.apache.samza.container.RunLoopFactory -
Got window milliseconds: -1.
[samza-runner-job-invoker-2] INFO org.apache.samza.container.RunLoopFactory -
Got commit milliseconds: -1.
[samza-runner-job-invoker-2] INFO org.apache.samza.container.RunLoopFactory -
Got taskMaxConcurrency: 1.
[samza-runner-job-invoker-2] INFO org.apache.samza.container.RunLoopFactory -
Got asyncCommitEnabled: false.
[samza-runner-job-invoker-2] INFO org.apache.samza.container.RunLoopFactory -
Got callbackTimeout: -1.
[samza-runner-job-invoker-2] INFO org.apache.samza.container.RunLoopFactory -
Got maxIdleMs: 10.
[samza-runner-job-invoker-2] INFO org.apache.samza.container.RunLoopFactory -
Run loop in asynchronous mode.
[samza-runner-job-invoker-2] INFO
org.apache.samza.container.disk.NoThrottlingDiskQuotaPolicy - Using a no
throttling disk quota policy
[samza-runner-job-invoker-2] INFO org.apache.samza.container.SamzaContainer$ -
Disk quotas disabled because polling interval is not set
(container.disk.poll.interval.ms)
[samza-runner-job-invoker-2] INFO org.apache.samza.container.SamzaContainer$ -
Samza container setup complete.
[samza-runner-job-invoker-2] WARN org.apache.samza.config.TaskConfig - Unable
to parse user-configure value for task.shutdown.ms - null. Using default value
30000
[samza-runner-job-invoker-2] INFO org.apache.samza.processor.StreamProcessor -
Starting the container: org.apache.samza.container.SamzaContainer@5cd362e8 for
the stream processor: 1.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Starting container.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.metrics.JmxServer - According to Util.getLocalHost.getHostName
we are apache-ci-beam-jenkins-4
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.metrics.JmxServer - Not overriding system property
com.sun.management.jmxremote.authenticate as already has value false
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.metrics.JmxServer - Not overriding system property
com.sun.management.jmxremote.ssl as already has value false
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.metrics.JmxServer - Not overriding system property
java.rmi.server.hostname as already has value apache-ci-beam-jenkins-4
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.metrics.JmxServer - Started JmxServer registry port=45149
server port=34609
url=service:jmx:rmi://localhost:34609/jndi/rmi://localhost:45149/jmxrmi
[Samza StreamProcessor Container Thread-0] INFO STARTUP_LOGGER - Started
JmxServer registry port=45149 server port=34609
url=service:jmx:rmi://localhost:34609/jndi/rmi://localhost:45149/jmxrmi
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.metrics.JmxServer - If you are tunneling, you might want to
try JmxServer registry port=45149 server port=34609
url=service:jmx:rmi://apache-ci-beam-jenkins-4:34609/jndi/rmi://apache-ci-beam-jenkins-4:45149/jmxrmi
[Samza StreamProcessor Container Thread-0] INFO STARTUP_LOGGER - If you are
tunneling, you might want to try JmxServer registry port=45149 server
port=34609
url=service:jmx:rmi://apache-ci-beam-jenkins-4:34609/jndi/rmi://apache-ci-beam-jenkins-4:45149/jmxrmi
JMX Server: JmxServer registry port=45149 server port=34609
url=service:jmx:rmi://apache-ci-beam-jenkins-4:34609/jndi/rmi://apache-ci-beam-jenkins-4:45149/jmxrmi
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Registering task instance metrics.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Starting JVM metrics.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Starting metrics reporters.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Starting admin multiplexer.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Registering task instances with
offsets.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Starting offset manager.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.checkpoint.OffsetManager - Successfully loaded last processed
offsets: {}
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.checkpoint.OffsetManager - Successfully loaded starting
offsets: Map(Partition 0 -> Map(SystemStreamPartition [n1, n1, 0] -> 0,
SystemStreamPartition [n8, n8, 0] -> 0, SystemStreamPartition [n14, n14, 0] ->
0, SystemStreamPartition [n10, n10, 0] -> 0))
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Registering task instances with
producers.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Starting producer multiplexer.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Starting container storage manager.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.storage.ContainerStorageManager - Checkpointed changelog ssp
offsets: {}
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.storage.ContainerStorageManager - Store Restore started
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.storage.TransactionalStateTaskRestoreManager - Got current
changelog offsets for taskName: Partition 0 as: {}
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.storage.TransactionalStateTaskRestoreManager - Marking current
directory:
<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/src/state/beamStore/Partition_0>
for store: beamStore in task: Partition 0 for deletion since it is not a
logged store.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.storage.TransactionalStateTaskRestoreManager - Store
directories to be retained in Task: Partition 0 are: {}
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.storage.TransactionalStateTaskRestoreManager - Store
directories to be deleted in Task: Partition 0 are:
{beamStore=[<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/src/state/beamStore/Partition_0]}>
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.storage.TransactionalStateTaskRestoreManager - Stores to be
restored in Task: Partition 0 are: {}
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.storage.TransactionalStateTaskRestoreManager - Deleting
persistent store directory:
<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/src/state/beamStore/Partition_0>
for store: beamStore in task: Partition 0
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.storage.TransactionalStateTaskRestoreManager - Creating
missing persistent store current directory:
<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/src/state/beamStore/Partition_0>
for store: beamStore in task: Partition 0
[Samza Restore Thread-0] INFO org.apache.samza.storage.ContainerStorageManager
- Starting stores in task instance Partition 0
[Samza Restore Thread-0] INFO
org.apache.samza.storage.TransactionalStateTaskRestoreManager - Stopped
persistent store: beamStore in task: Partition 0
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.storage.ContainerStorageManager - Re-created store beamStore
in read-write mode for task Partition 0 because it a persistent store
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.storage.ContainerStorageManager - Store Restore complete
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Starting table manager in task
instance Partition 0
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Starting host statistics monitor
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Initializing stream tasks.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0
event time timers in memory
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0
processing time timers in memory
[Samza StreamProcessor Container Thread-0] WARN
org.apache.beam.runners.fnexecution.environment.DockerCommand - Unable to pull
docker image apache/beam_go_sdk:dev, cause: Received exit code 1 for command
'docker pull apache/beam_go_sdk:dev'. stderr: Error response from daemon:
manifest for apache/beam_go_sdk:dev not found
[grpc-default-executor-21] INFO
org.apache.beam.runners.fnexecution.logging.GrpcLoggingService - Beam Fn
Logging client connected.
[grpc-default-executor-20] INFO
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService -
Beam Fn Control client connected with id 27-1
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0
event time timers in memory
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0
processing time timers in memory
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0
event time timers in memory
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0
processing time timers in memory
[grpc-default-executor-20] INFO
<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:539
- Connecting via grpc @ localhost:38479 ...
[grpc-default-executor-20] INFO
<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:539
- Connecting via grpc @ localhost:39969 ...
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0
event time timers in memory
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0
processing time timers in memory
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0
event time timers in memory
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0
processing time timers in memory
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0
event time timers in memory
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0
processing time timers in memory
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0
event time timers in memory
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0
processing time timers in memory
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0
event time timers in memory
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0
processing time timers in memory
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0
event time timers in memory
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0
processing time timers in memory
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0
event time timers in memory
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0
processing time timers in memory
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0
event time timers in memory
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0
processing time timers in memory
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Registering task instances with
consumers.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Starting consumer multiplexer.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Entering run loop.
[Samza StreamProcessor Container Thread-0] WARN
org.apache.samza.processor.StreamProcessor - Received container start
notification for container: org.apache.samza.container.SamzaContainer@5cd362e8
in stream processor: 1.
[grpc-default-executor-21] INFO
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService -
getProcessBundleDescriptor request with id 27-5
[grpc-default-executor-21] INFO
<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:539
- Connecting via grpc @ localhost:39803 ...
[grpc-default-executor-21] INFO
org.apache.beam.runners.fnexecution.data.GrpcDataService - Beam Fn Data client
connected.
[grpc-default-executor-20] INFO
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService -
getProcessBundleDescriptor request with id 27-4
[grpc-default-executor-20] INFO
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService -
getProcessBundleDescriptor request with id 27-2
[grpc-default-executor-19] INFO
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService -
getProcessBundleDescriptor request with id 27-6
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0
event time timers in memory
[grpc-default-executor-20] INFO
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService -
getProcessBundleDescriptor request with id 27-3
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0
event time timers in memory
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0
event time timers in memory
[grpc-default-executor-19] INFO
<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:539
- Connecting via grpc @ localhost:46325 ...
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0
event time timers in memory
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.system.SystemConsumers - End of stream reached for partition:
SystemStreamPartition [n14, n14, 0]
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.system.SystemConsumers - End of stream reached for partition:
SystemStreamPartition [n10, n10, 0]
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.system.SystemConsumers - End of stream reached for partition:
SystemStreamPartition [n1, n1, 0]
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.system.SystemConsumers - End of stream reached for partition:
SystemStreamPartition [n8, n8, 0]
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.task.CoordinatorRequests - Shutdown has now been requested by
tasks [Partition 0]
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.task.CoordinatorRequests - Shutdown requested.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Shutting down SamzaContainer.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Shutting down consumer multiplexer.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Shutting down task instance stream
tasks.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Shutting down timer executor
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory - Closing
environment urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\ng/tmp/beam-artifact-staging/d01be7385497c26740721d4b27aede67c5fedd99b2ab83edf33dee63b90aa268/1-go-worker"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006worker"
}
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn
Logging clients still connected during shutdown.
[Samza StreamProcessor Container Thread-0] WARN
org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown
endpoint.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment -
Closing Docker container
7749e97bd91518a179e846a54b0479d7ebad02d06ed45924e96686c403424f45. Logs:
2021/12/24 00:32:54 Provision info:
pipeline_options:{fields:{key:"beam:option:app_name:v1"
value:{string_value:"go-job-7-1640305971806193742"}}
fields:{key:"beam:option:experiments:v1"
value:{list_value:{values:{string_value:"beam_fn_api"}}}}
fields:{key:"beam:option:go_options:v1"
value:{struct_value:{fields:{key:"options"
value:{struct_value:{fields:{key:"hookOrder"
value:{string_value:"[\"default_remote_logging\"]"}} fields:{key:"hooks"
value:{string_value:"{\"default_remote_logging\":null}"}}}}}}}}
fields:{key:"beam:option:parallelism:v1" value:{number_value:-1}}
fields:{key:"beam:option:retain_docker_containers:v1"
value:{bool_value:false}} fields:{key:"beam:option:runner:v1"
value:{string_value:""}}} logging_endpoint:{url:"localhost:39969"}
artifact_endpoint:{url:"localhost:46073"}
control_endpoint:{url:"localhost:38479"}
dependencies:{type_urn:"beam:artifact:type:file:v1"
type_payload:"\ng/tmp/beam-artifact-staging/d01be7385497c26740721d4b27aede67c5fedd99b2ab83edf33dee63b90aa268/1-go-worker"
role_urn:"beam:artifact:role:staging_to:v1" role_payload:"\n\x06worker"}
2021/12/24 00:32:54 Initializing Go harness: /opt/apache/beam/boot --id=27-1
--provision_endpoint=localhost:41445
2021/12/24 00:32:54 Downloaded: /tmp/staged/worker (sha256:
69297fb4a43daf11241416339049a25a31f11da7ba2d23f6ad50336299112212, size:
22772555)
Worker exited successfully!
2021/12/24 00:32:54 control response channel closed
Remote logging shutting down.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Shutting down task instance table
manager.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Shutting down container storage
manager.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.storage.ContainerStorageManager - Shutdown complete
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Shutting down host statistics
monitor.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Shutting down producer multiplexer.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Shutting down offset manager.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Shutting down metrics reporters.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Shutting down JVM metrics.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Shutting down admin multiplexer.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Shutdown complete.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.processor.StreamProcessor - Container:
org.apache.samza.container.SamzaContainer@5cd362e8 stopped. Stopping the stream
processor: 1.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.processor.StreamProcessor - Ignoring onJobModelExpired
invocation since the current state is STOPPING and not in [RUNNING, STARTED,
IN_REBALANCE].
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.processor.StreamProcessor - Shutting down the executor service
of the stream processor: 1.
[Samza StreamProcessor Container Thread-0] WARN
org.apache.samza.container.SamzaContainer - Shutdown is no-op since the
container is already in state: STOPPED
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.processor.StreamProcessor - Waiting 30000 ms for the
container: org.apache.samza.container.SamzaContainer@5cd362e8 to shutdown.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.processor.StreamProcessor - Shutdown status of container:
org.apache.samza.container.SamzaContainer@5cd362e8 for stream processor: 1 is:
true.
[samza-runner-job-invoker-2] INFO
org.apache.beam.runners.samza.SamzaPipelineResult - Pipeline finished. Final
state: DONE
[samza-runner-job-invoker-1] WARN
org.apache.beam.runners.samza.SamzaPortablePipelineResult - Collecting
monitoring infos is not implemented yet in Samza portable runner.
2021/12/24 00:32:55 Job state: DONE
[grpc-default-executor-20] INFO
org.apache.beam.runners.jobsubmission.InMemoryJobService - Getting job metrics
for
go0job0701640305971806193742-jenkins-1224003253-3bc62eef_fb022429-5d75-47be-b738-7e7d4f2fbc76
[grpc-default-executor-20] INFO
org.apache.beam.runners.jobsubmission.InMemoryJobService - Finished getting job
metrics for
go0job0701640305971806193742-jenkins-1224003253-3bc62eef_fb022429-5d75-47be-b738-7e7d4f2fbc76
--- PASS: TestEmitParDoAfterGBK (3.41s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/regression 23.920s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ exit 1
$ exit 1
> Task :sdks:go:test:samzaValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file
'<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/src/sdks/go/test/build.gradle'>
line: 86
* What went wrong:
Execution failed for task ':sdks:go:test:samzaValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 2 invalid unit(s) of work during
this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 32m 29s
101 actionable tasks: 62 executed, 32 from cache, 7 up-to-date
Publishing build scan...
https://gradle.com/s/3ladfzabnhsvs
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
