See
<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/858/display/redirect?page=changes>
Changes:
[noreply] Update 2.36.0 blog post to mention ARM64 support
[noreply] Minor: Disable checker framework in nightly snapshot (#16829)
[noreply] [BEAM-13860] Make `DoFn.infer_output_type` return element type
(#16788)
------------------------------------------
[...truncated 5.51 MB...]
at java.lang.Thread.run(Thread.java:748)
[samza-runner-job-invoker-0] INFO org.apache.samza.container.SamzaContainer$ -
Got system producers: Set()
[samza-runner-job-invoker-0] INFO org.apache.samza.container.SamzaContainer$ -
Got serdes from factories: Set(stateValueSerde, byteArraySerde)
[samza-runner-job-invoker-0] INFO org.apache.samza.container.SamzaContainer$ -
Got serdes from serialized instances: Set()
[samza-runner-job-invoker-0] INFO org.apache.samza.container.SamzaContainer$ -
Got change log system streams: Map()
[samza-runner-job-invoker-0] INFO org.apache.samza.container.SamzaContainer$ -
Got intermediate streams: List()
[samza-runner-job-invoker-0] INFO org.apache.samza.container.SamzaContainer$ -
Setting up JVM metrics.
[samza-runner-job-invoker-0] INFO org.apache.samza.container.SamzaContainer$ -
Setting up message chooser.
[samza-runner-job-invoker-0] INFO
org.apache.samza.system.chooser.DefaultChooser - Building default chooser with:
useBatching=false, useBootstrapping=false, usePriority=false
[samza-runner-job-invoker-0] INFO org.apache.samza.container.SamzaContainer$ -
Setting up metrics reporters.
[samza-runner-job-invoker-0] INFO org.apache.samza.container.SamzaContainer$ -
Got metrics reporters: Set()
[samza-runner-job-invoker-0] INFO org.apache.samza.container.SamzaContainer$ -
Got security manager: null
[samza-runner-job-invoker-0] INFO org.apache.samza.container.SamzaContainer$ -
Got checkpoint manager: null
[samza-runner-job-invoker-0] INFO org.apache.samza.container.SamzaContainer$ -
Got checkpointListeners : Map()
[samza-runner-job-invoker-0] INFO org.apache.samza.container.SamzaContainer$ -
Got offset manager: org.apache.samza.checkpoint.OffsetManager@2aac4916
[samza-runner-job-invoker-0] INFO org.apache.samza.container.SamzaContainer$ -
Got storage engines: Set(beamStore)
[samza-runner-job-invoker-0] INFO org.apache.samza.container.SamzaContainer$ -
Got thread pool size: 0
[samza-runner-job-invoker-0] INFO org.apache.samza.task.TaskFactoryUtil -
Adapting StreamOperatorTaskFactory to inject container thread pool
[samza-runner-job-invoker-0] INFO org.apache.samza.container.SamzaContainer$ -
Got default storage engine base directory:
<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/src/state>
[samza-runner-job-invoker-0] INFO org.apache.samza.container.SamzaContainer$ -
Got base directory for non logged data stores:
<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/src/state>
[samza-runner-job-invoker-0] WARN org.apache.samza.container.SamzaContainer$ -
No override was provided for logged store base directory. This disables local
state re-use on application restart. If you want to enable this feature, set
LOGGED_STORE_BASE_DIR as an environment variable in all machines running the
Samza container or configure job.logged.store.base.dir for your application
[samza-runner-job-invoker-0] INFO org.apache.samza.container.SamzaContainer$ -
Got base directory for logged data stores:
<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/src/state>
[samza-runner-job-invoker-0] INFO
org.apache.samza.storage.ContainerStorageManager - Starting with
changelogSystemStreams = {} sideInputSystemStreams = {}
[samza-runner-job-invoker-0] WARN
org.apache.samza.storage.ContainerStorageManager - Logged and non-logged store
base directory are configured to same path:
<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/src/state.> It
is recommended to configurethem separately to ensure clean up of non-logged
store data doesn't accidentally impact logged store data.
[samza-runner-job-invoker-0] INFO
org.apache.samza.storage.ContainerStorageManager - Created store beamStore for
task Partition 0 in mode BulkLoad
[samza-runner-job-invoker-0] INFO org.apache.samza.container.SamzaContainer$ -
Got task SSPs: Set(SystemStreamPartition [n14, n14, 0], SystemStreamPartition
[n10, n10, 0], SystemStreamPartition [n1, n1, 0], SystemStreamPartition [n8,
n8, 0])
[samza-runner-job-invoker-0] INFO org.apache.samza.container.SamzaContainer$ -
Got task side input SSPs: Set()
[samza-runner-job-invoker-0] INFO org.apache.samza.table.TableManager - Added 0
tables
[samza-runner-job-invoker-0] INFO org.apache.samza.container.SamzaContainer$ -
Got table manager
[samza-runner-job-invoker-0] INFO org.apache.samza.container.RunLoopFactory -
Got window milliseconds: -1.
[samza-runner-job-invoker-0] INFO org.apache.samza.container.RunLoopFactory -
Got commit milliseconds: -1.
[samza-runner-job-invoker-0] INFO org.apache.samza.container.RunLoopFactory -
Got taskMaxConcurrency: 1.
[samza-runner-job-invoker-0] INFO org.apache.samza.container.RunLoopFactory -
Got asyncCommitEnabled: false.
[samza-runner-job-invoker-0] INFO org.apache.samza.container.RunLoopFactory -
Got callbackTimeout: -1.
[samza-runner-job-invoker-0] INFO org.apache.samza.container.RunLoopFactory -
Got maxIdleMs: 10.
[samza-runner-job-invoker-0] INFO org.apache.samza.container.RunLoopFactory -
Run loop in asynchronous mode.
[samza-runner-job-invoker-0] INFO
org.apache.samza.container.disk.NoThrottlingDiskQuotaPolicy - Using a no
throttling disk quota policy
[samza-runner-job-invoker-0] INFO org.apache.samza.container.SamzaContainer$ -
Disk quotas disabled because polling interval is not set
(container.disk.poll.interval.ms)
[samza-runner-job-invoker-0] INFO org.apache.samza.container.SamzaContainer$ -
Samza container setup complete.
[samza-runner-job-invoker-0] WARN org.apache.samza.config.TaskConfig - Unable
to parse user-configure value for task.shutdown.ms - null. Using default value
30000
[samza-runner-job-invoker-0] INFO org.apache.samza.processor.StreamProcessor -
Starting the container: org.apache.samza.container.SamzaContainer@142c029a for
the stream processor: 1.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Starting container.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.metrics.JmxServer - According to Util.getLocalHost.getHostName
we are apache-ci-beam-jenkins-6
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.metrics.JmxServer - Not overriding system property
com.sun.management.jmxremote.authenticate as already has value false
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.metrics.JmxServer - Not overriding system property
com.sun.management.jmxremote.ssl as already has value false
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.metrics.JmxServer - Not overriding system property
java.rmi.server.hostname as already has value apache-ci-beam-jenkins-6
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.metrics.JmxServer - Started JmxServer registry port=40317
server port=42129
url=service:jmx:rmi://localhost:42129/jndi/rmi://localhost:40317/jmxrmi
[Samza StreamProcessor Container Thread-0] INFO STARTUP_LOGGER - Started
JmxServer registry port=40317 server port=42129
url=service:jmx:rmi://localhost:42129/jndi/rmi://localhost:40317/jmxrmi
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.metrics.JmxServer - If you are tunneling, you might want to
try JmxServer registry port=40317 server port=42129
url=service:jmx:rmi://apache-ci-beam-jenkins-6:42129/jndi/rmi://apache-ci-beam-jenkins-6:40317/jmxrmi
[Samza StreamProcessor Container Thread-0] INFO STARTUP_LOGGER - If you are
tunneling, you might want to try JmxServer registry port=40317 server
port=42129
url=service:jmx:rmi://apache-ci-beam-jenkins-6:42129/jndi/rmi://apache-ci-beam-jenkins-6:40317/jmxrmi
JMX Server: JmxServer registry port=40317 server port=42129
url=service:jmx:rmi://apache-ci-beam-jenkins-6:42129/jndi/rmi://apache-ci-beam-jenkins-6:40317/jmxrmi
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Registering task instance metrics.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Starting JVM metrics.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Starting metrics reporters.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Starting admin multiplexer.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Registering task instances with
offsets.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Starting offset manager.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.checkpoint.OffsetManager - Successfully loaded last processed
offsets: {}
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.checkpoint.OffsetManager - Successfully loaded starting
offsets: Map(Partition 0 -> Map(SystemStreamPartition [n1, n1, 0] -> 0,
SystemStreamPartition [n8, n8, 0] -> 0, SystemStreamPartition [n14, n14, 0] ->
0, SystemStreamPartition [n10, n10, 0] -> 0))
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Registering task instances with
producers.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Starting producer multiplexer.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Starting container storage manager.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.storage.ContainerStorageManager - Checkpointed changelog ssp
offsets: {}
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.storage.ContainerStorageManager - Store Restore started
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.storage.TransactionalStateTaskRestoreManager - Got current
changelog offsets for taskName: Partition 0 as: {}
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.storage.TransactionalStateTaskRestoreManager - Marking current
directory:
<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/src/state/beamStore/Partition_0>
for store: beamStore in task: Partition 0 for deletion since it is not a
logged store.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.storage.TransactionalStateTaskRestoreManager - Store
directories to be retained in Task: Partition 0 are: {}
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.storage.TransactionalStateTaskRestoreManager - Store
directories to be deleted in Task: Partition 0 are:
{beamStore=[<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/src/state/beamStore/Partition_0]}>
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.storage.TransactionalStateTaskRestoreManager - Stores to be
restored in Task: Partition 0 are: {}
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.storage.TransactionalStateTaskRestoreManager - Deleting
persistent store directory:
<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/src/state/beamStore/Partition_0>
for store: beamStore in task: Partition 0
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.storage.TransactionalStateTaskRestoreManager - Creating
missing persistent store current directory:
<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/src/state/beamStore/Partition_0>
for store: beamStore in task: Partition 0
[Samza Restore Thread-0] INFO org.apache.samza.storage.ContainerStorageManager
- Starting stores in task instance Partition 0
[Samza Restore Thread-0] INFO
org.apache.samza.storage.TransactionalStateTaskRestoreManager - Stopped
persistent store: beamStore in task: Partition 0
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.storage.ContainerStorageManager - Re-created store beamStore
in read-write mode for task Partition 0 because it a persistent store
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.storage.ContainerStorageManager - Store Restore complete
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Starting table manager in task
instance Partition 0
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Starting host statistics monitor
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Initializing stream tasks.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0
event time timers in memory
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0
processing time timers in memory
[Samza StreamProcessor Container Thread-0] WARN
org.apache.beam.runners.fnexecution.environment.DockerCommand - Unable to pull
docker image apache/beam_go_sdk:dev, cause: Received exit code 1 for command
'docker pull apache/beam_go_sdk:dev'. stderr: Error response from daemon:
manifest for apache/beam_go_sdk:dev not found
[grpc-default-executor-1] INFO
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService -
Beam Fn Control client connected with id 27-1
[grpc-default-executor-4] INFO
org.apache.beam.runners.fnexecution.logging.GrpcLoggingService - Beam Fn
Logging client connected.
[grpc-default-executor-4] INFO
<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:539
- Connecting via grpc @ localhost:40683 ...
[grpc-default-executor-4] INFO
<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:539
- Connecting via grpc @ localhost:37333 ...
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0
event time timers in memory
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0
processing time timers in memory
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0
event time timers in memory
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0
processing time timers in memory
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0
event time timers in memory
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0
processing time timers in memory
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0
event time timers in memory
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0
processing time timers in memory
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0
event time timers in memory
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0
processing time timers in memory
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0
event time timers in memory
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0
processing time timers in memory
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0
event time timers in memory
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0
processing time timers in memory
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0
event time timers in memory
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0
processing time timers in memory
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0
event time timers in memory
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0
processing time timers in memory
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0
event time timers in memory
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0
processing time timers in memory
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Registering task instances with
consumers.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Starting consumer multiplexer.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Entering run loop.
[Samza StreamProcessor Container Thread-0] WARN
org.apache.samza.processor.StreamProcessor - Received container start
notification for container: org.apache.samza.container.SamzaContainer@142c029a
in stream processor: 1.
[grpc-default-executor-1] INFO
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService -
getProcessBundleDescriptor request with id 27-5
[grpc-default-executor-1] INFO
<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:539
- Connecting via grpc @ localhost:42177 ...
[grpc-default-executor-1] INFO
org.apache.beam.runners.fnexecution.data.GrpcDataService - Beam Fn Data client
connected.
[grpc-default-executor-4] INFO
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService -
getProcessBundleDescriptor request with id 27-4
[grpc-default-executor-4] INFO
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService -
getProcessBundleDescriptor request with id 27-2
[grpc-default-executor-1] INFO
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService -
getProcessBundleDescriptor request with id 27-6
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0
event time timers in memory
[grpc-default-executor-1] INFO
org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService -
getProcessBundleDescriptor request with id 27-3
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0
event time timers in memory
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0
event time timers in memory
[grpc-default-executor-4] INFO
<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/src/sdks/go/pkg/beam/core/runtime/harness/harness.go>:539
- Connecting via grpc @ localhost:32997 ...
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0
event time timers in memory
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.system.SystemConsumers - End of stream reached for partition:
SystemStreamPartition [n14, n14, 0]
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.system.SystemConsumers - End of stream reached for partition:
SystemStreamPartition [n10, n10, 0]
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.system.SystemConsumers - End of stream reached for partition:
SystemStreamPartition [n1, n1, 0]
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.system.SystemConsumers - End of stream reached for partition:
SystemStreamPartition [n8, n8, 0]
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.task.CoordinatorRequests - Shutdown has now been requested by
tasks [Partition 0]
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.task.CoordinatorRequests - Shutdown requested.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Shutting down SamzaContainer.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Shutting down consumer multiplexer.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Shutting down task instance stream
tasks.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Shutting down timer executor
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory - Closing
environment urn: "beam:env:docker:v1"
payload: "\n\026apache/beam_go_sdk:dev"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies {
type_urn: "beam:artifact:type:file:v1"
type_payload:
"\n\202\001/tmp/beam-artifact-staging/4623bc8b9e46deece8b9662fc5e8fbf46762572aeec3f7785d11a97fa181708a/1-go-/tmp/worker-7-1644862409506145533"
role_urn: "beam:artifact:role:go_worker_binary:v1"
}
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn
Logging clients still connected during shutdown.
[Samza StreamProcessor Container Thread-0] WARN
org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown
endpoint.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment -
Closing Docker container
c8fba1a5dd8da1cc6c645500028ce2ce40f995ad8c963094acb0d148b9bf3439. Logs:
2022/02/14 18:13:36 Provision info:
pipeline_options:{fields:{key:"beam:option:app_name:v1"
value:{string_value:"go-testemitpardoaftergbk"}}
fields:{key:"beam:option:experiments:v1"
value:{list_value:{values:{string_value:"beam_fn_api"}}}}
fields:{key:"beam:option:go_options:v1"
value:{struct_value:{fields:{key:"options"
value:{struct_value:{fields:{key:"dataflow_worker_jar"
value:{string_value:""}} fields:{key:"endpoint"
value:{string_value:"localhost:56821"}} fields:{key:"environment_config"
value:{string_value:"apache/beam_go_sdk:dev"}} fields:{key:"environment_type"
value:{string_value:"DOCKER"}} fields:{key:"hookOrder"
value:{string_value:"[\"default_remote_logging\"]"}} fields:{key:"hooks"
value:{string_value:"{\"default_remote_logging\":null}"}}
fields:{key:"project" value:{string_value:"apache-beam-testing"}}
fields:{key:"region" value:{string_value:"us-central1"}} fields:{key:"runner"
value:{string_value:"samza"}} fields:{key:"staging_location"
value:{string_value:"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test"}}
fields:{key:"temp_location"
value:{string_value:"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test"}}
fields:{key:"test.paniconexit0" value:{string_value:"true"}}
fields:{key:"test.timeout" value:{string_value:"2h0m0s"}}
fields:{key:"test.v" value:{string_value:"true"}}
fields:{key:"test_expansion_addr"
value:{string_value:"localhost:60609"}}}}}}}}
fields:{key:"beam:option:parallelism:v1" value:{number_value:-1}}
fields:{key:"beam:option:retain_docker_containers:v1"
value:{bool_value:false}} fields:{key:"beam:option:runner:v1"
value:{string_value:""}}} logging_endpoint:{url:"localhost:37333"}
artifact_endpoint:{url:"localhost:38771"}
control_endpoint:{url:"localhost:40683"}
dependencies:{type_urn:"beam:artifact:type:file:v1"
type_payload:"\n\x82\x01/tmp/beam-artifact-staging/4623bc8b9e46deece8b9662fc5e8fbf46762572aeec3f7785d11a97fa181708a/1-go-/tmp/worker-7-1644862409506145533"
role_urn:"beam:artifact:role:go_worker_binary:v1"}
2022/02/14 18:13:36 Initializing Go harness: /opt/apache/beam/boot --id=27-1
--provision_endpoint=localhost:44371
2022/02/14 18:13:37 Downloaded: /tmp/staged/1-worker-7-1644862409506145533
(sha256: c21fcf41d87132b59fdbff3e3454d73a638a2b78942cf4360b02f9617e6a03af,
size: 22851739)
2022/02/14 18:13:37 control response channel closed
Remote logging shutting down.
Worker exited successfully!
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Shutting down task instance table
manager.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Shutting down container storage
manager.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.storage.ContainerStorageManager - Shutdown complete
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Shutting down host statistics
monitor.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Shutting down producer multiplexer.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Shutting down offset manager.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Shutting down metrics reporters.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Shutting down JVM metrics.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Shutting down admin multiplexer.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.container.SamzaContainer - Shutdown complete.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.processor.StreamProcessor - Container:
org.apache.samza.container.SamzaContainer@142c029a stopped. Stopping the stream
processor: 1.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.processor.StreamProcessor - Ignoring onJobModelExpired
invocation since the current state is STOPPING and not in [RUNNING, STARTED,
IN_REBALANCE].
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.processor.StreamProcessor - Shutting down the executor service
of the stream processor: 1.
[Samza StreamProcessor Container Thread-0] WARN
org.apache.samza.container.SamzaContainer - Shutdown is no-op since the
container is already in state: STOPPED
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.processor.StreamProcessor - Waiting 30000 ms for the
container: org.apache.samza.container.SamzaContainer@142c029a to shutdown.
[Samza StreamProcessor Container Thread-0] INFO
org.apache.samza.processor.StreamProcessor - Shutdown status of container:
org.apache.samza.container.SamzaContainer@142c029a for stream processor: 1 is:
true.
[samza-runner-job-invoker-0] INFO
org.apache.beam.runners.samza.SamzaPipelineResult - Pipeline finished. Final
state: DONE
[samza-runner-job-invoker-1] WARN
org.apache.beam.runners.samza.SamzaPortablePipelineResult - Collecting
monitoring infos is not implemented yet in Samza portable runner.
[samza-runner-job-invoker-1] WARN
org.apache.beam.runners.jobsubmission.InMemoryJobService - Failed to remove job
staging directory for token
go-testemitpardoaftergbk_35ac56d0-0196-4dd4-866b-e1d411cf62f5.
java.io.FileNotFoundException: No files found for spec:
/tmp/beam-artifact-staging/4623bc8b9e46deece8b9662fc5e8fbf46762572aeec3f7785d11a97fa181708a/*
in working directory
<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/src/.>
at
org.apache.beam.sdk.io.LocalFileSystem.matchOne(LocalFileSystem.java:307)
at
org.apache.beam.sdk.io.LocalFileSystem.match(LocalFileSystem.java:105)
at org.apache.beam.sdk.io.LocalFileSystem.match(LocalFileSystem.java:98)
at org.apache.beam.sdk.io.FileSystems.match(FileSystems.java:124)
at
org.apache.beam.sdk.io.FileSystems.matchResources(FileSystems.java:217)
at
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService$1.removeStagedArtifacts(ArtifactStagingService.java:180)
at
org.apache.beam.runners.fnexecution.artifact.ArtifactStagingService.removeStagedArtifacts(ArtifactStagingService.java:115)
at
org.apache.beam.runners.jobsubmission.JobServerDriver.lambda$createJobService$0(JobServerDriver.java:67)
at
org.apache.beam.runners.jobsubmission.InMemoryJobService.lambda$run$0(InMemoryJobService.java:261)
at
org.apache.beam.runners.jobsubmission.JobInvocation.setState(JobInvocation.java:249)
at
org.apache.beam.runners.jobsubmission.JobInvocation.access$200(JobInvocation.java:51)
at
org.apache.beam.runners.jobsubmission.JobInvocation$1.onSuccess(JobInvocation.java:115)
at
org.apache.beam.runners.jobsubmission.JobInvocation$1.onSuccess(JobInvocation.java:101)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.Futures$CallbackListener.run(Futures.java:1058)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
2022/02/14 18:13:38 Job state: DONE
[grpc-default-executor-4] INFO
org.apache.beam.runners.jobsubmission.InMemoryJobService - Getting job metrics
for
go0testemitpardoaftergbk-jenkins-0214181332-5ccecfd9_4df0412f-1467-4779-a94f-ae2e07cf49d7
[grpc-default-executor-4] INFO
org.apache.beam.runners.jobsubmission.InMemoryJobService - Finished getting job
metrics for
go0testemitpardoaftergbk-jenkins-0214181332-5ccecfd9_4df0412f-1467-4779-a94f-ae2e07cf49d7
--- PASS: TestEmitParDoAfterGBK (8.78s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/regression 93.544s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ exit 1
$ exit 1
> Task :sdks:go:test:samzaValidatesRunner FAILED
FAILURE: Build failed with an exception.
* Where:
Build file
'<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/src/sdks/go/test/build.gradle'>
line: 86
* What went wrong:
Execution failed for task ':sdks:go:test:samzaValidatesRunner'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 2 invalid unit(s) of work during
this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 12m 42s
119 actionable tasks: 80 executed, 32 from cache, 7 up-to-date
Publishing build scan...
https://gradle.com/s/pj2pjc473zg7c
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
