See <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/36/display/redirect?page=changes>
Changes: [Kyle Weaver] [BEAM-12625] Annotate [noreply] [BEAM-12643] Resolved the concurrent writes issue for parallel tests [noreply] [BEAM-10212] Add caching state client wrapper (#15170) ------------------------------------------ [...truncated 4.24 MB...] [samza-runner-job-invoker-0] INFO org.apache.samza.container.SamzaContainer$ - Got serdes from factories: Set(stateValueSerde, byteArraySerde) [samza-runner-job-invoker-0] INFO org.apache.samza.container.SamzaContainer$ - Got serdes from serialized instances: Set() [samza-runner-job-invoker-0] INFO org.apache.samza.container.SamzaContainer$ - Got change log system streams: Map() [samza-runner-job-invoker-0] INFO org.apache.samza.container.SamzaContainer$ - Got intermediate streams: List() [samza-runner-job-invoker-0] INFO org.apache.samza.container.SamzaContainer$ - Setting up JVM metrics. [samza-runner-job-invoker-0] INFO org.apache.samza.container.SamzaContainer$ - Setting up message chooser. [samza-runner-job-invoker-0] INFO org.apache.samza.system.chooser.DefaultChooser - Building default chooser with: useBatching=false, useBootstrapping=false, usePriority=false [samza-runner-job-invoker-0] INFO org.apache.samza.container.SamzaContainer$ - Setting up metrics reporters. [samza-runner-job-invoker-0] INFO org.apache.samza.container.SamzaContainer$ - Got metrics reporters: Set() [samza-runner-job-invoker-0] INFO org.apache.samza.container.SamzaContainer$ - Got security manager: null [samza-runner-job-invoker-0] INFO org.apache.samza.container.SamzaContainer$ - Got checkpoint manager: null [samza-runner-job-invoker-0] INFO org.apache.samza.container.SamzaContainer$ - Got checkpointListeners : Map() [samza-runner-job-invoker-0] INFO org.apache.samza.container.SamzaContainer$ - Got offset manager: org.apache.samza.checkpoint.OffsetManager@732e577b [samza-runner-job-invoker-0] INFO org.apache.samza.container.SamzaContainer$ - Got storage engines: Set(beamStore) [samza-runner-job-invoker-0] INFO org.apache.samza.container.SamzaContainer$ - Got thread pool size: 0 [samza-runner-job-invoker-0] INFO org.apache.samza.task.TaskFactoryUtil - Adapting StreamOperatorTaskFactory to inject container thread pool [samza-runner-job-invoker-0] INFO org.apache.samza.container.SamzaContainer$ - Got default storage engine base directory: <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/src/state> [samza-runner-job-invoker-0] INFO org.apache.samza.container.SamzaContainer$ - Got base directory for non logged data stores: <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/src/state> [samza-runner-job-invoker-0] WARN org.apache.samza.container.SamzaContainer$ - No override was provided for logged store base directory. This disables local state re-use on application restart. If you want to enable this feature, set LOGGED_STORE_BASE_DIR as an environment variable in all machines running the Samza container or configure job.logged.store.base.dir for your application [samza-runner-job-invoker-0] INFO org.apache.samza.container.SamzaContainer$ - Got base directory for logged data stores: <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/src/state> [samza-runner-job-invoker-0] INFO org.apache.samza.storage.ContainerStorageManager - Starting with changelogSystemStreams = {} sideInputSystemStreams = {} [samza-runner-job-invoker-0] WARN org.apache.samza.storage.ContainerStorageManager - Logged and non-logged store base directory are configured to same path: <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/src/state.> It is recommended to configurethem separately to ensure clean up of non-logged store data doesn't accidentally impact logged store data. [samza-runner-job-invoker-0] INFO org.apache.samza.storage.ContainerStorageManager - Created store beamStore for task Partition 0 in mode BulkLoad [samza-runner-job-invoker-0] INFO org.apache.samza.container.SamzaContainer$ - Got task SSPs: Set(SystemStreamPartition [n14, n14, 0], SystemStreamPartition [n10, n10, 0], SystemStreamPartition [n1, n1, 0], SystemStreamPartition [n8, n8, 0]) [samza-runner-job-invoker-0] INFO org.apache.samza.container.SamzaContainer$ - Got task side input SSPs: Set() [samza-runner-job-invoker-0] INFO org.apache.samza.table.TableManager - Added 0 tables [samza-runner-job-invoker-0] INFO org.apache.samza.container.SamzaContainer$ - Got table manager [samza-runner-job-invoker-0] INFO org.apache.samza.container.RunLoopFactory - Got window milliseconds: -1. [samza-runner-job-invoker-0] INFO org.apache.samza.container.RunLoopFactory - Got commit milliseconds: -1. [samza-runner-job-invoker-0] INFO org.apache.samza.container.RunLoopFactory - Got taskMaxConcurrency: 1. [samza-runner-job-invoker-0] INFO org.apache.samza.container.RunLoopFactory - Got asyncCommitEnabled: false. [samza-runner-job-invoker-0] INFO org.apache.samza.container.RunLoopFactory - Got callbackTimeout: -1. [samza-runner-job-invoker-0] INFO org.apache.samza.container.RunLoopFactory - Got maxIdleMs: 10. [samza-runner-job-invoker-0] INFO org.apache.samza.container.RunLoopFactory - Run loop in asynchronous mode. [samza-runner-job-invoker-0] INFO org.apache.samza.container.disk.NoThrottlingDiskQuotaPolicy - Using a no throttling disk quota policy [samza-runner-job-invoker-0] INFO org.apache.samza.container.SamzaContainer$ - Disk quotas disabled because polling interval is not set (container.disk.poll.interval.ms) [samza-runner-job-invoker-0] INFO org.apache.samza.container.SamzaContainer$ - Samza container setup complete. [samza-runner-job-invoker-0] WARN org.apache.samza.config.TaskConfig - Unable to parse user-configure value for task.shutdown.ms - null. Using default value 30000 [samza-runner-job-invoker-0] INFO org.apache.samza.processor.StreamProcessor - Starting the container: org.apache.samza.container.SamzaContainer@fb0f14d for the stream processor: 1. [Samza StreamProcessor Container Thread-0] INFO org.apache.samza.container.SamzaContainer - Starting container. [Samza StreamProcessor Container Thread-0] INFO org.apache.samza.metrics.JmxServer - According to Util.getLocalHost.getHostName we are apache-ci-beam-jenkins-9 [Samza StreamProcessor Container Thread-0] INFO org.apache.samza.metrics.JmxServer - Not overriding system property com.sun.management.jmxremote.authenticate as already has value false [Samza StreamProcessor Container Thread-0] INFO org.apache.samza.metrics.JmxServer - Not overriding system property com.sun.management.jmxremote.ssl as already has value false [Samza StreamProcessor Container Thread-0] INFO org.apache.samza.metrics.JmxServer - Not overriding system property java.rmi.server.hostname as already has value apache-ci-beam-jenkins-9 [Samza StreamProcessor Container Thread-0] INFO org.apache.samza.metrics.JmxServer - Started JmxServer registry port=33293 server port=38573 url=service:jmx:rmi://localhost:38573/jndi/rmi://localhost:33293/jmxrmi [Samza StreamProcessor Container Thread-0] INFO STARTUP_LOGGER - Started JmxServer registry port=33293 server port=38573 url=service:jmx:rmi://localhost:38573/jndi/rmi://localhost:33293/jmxrmi [Samza StreamProcessor Container Thread-0] INFO org.apache.samza.metrics.JmxServer - If you are tunneling, you might want to try JmxServer registry port=33293 server port=38573 url=service:jmx:rmi://apache-ci-beam-jenkins-9:38573/jndi/rmi://apache-ci-beam-jenkins-9:33293/jmxrmi [Samza StreamProcessor Container Thread-0] INFO STARTUP_LOGGER - If you are tunneling, you might want to try JmxServer registry port=33293 server port=38573 url=service:jmx:rmi://apache-ci-beam-jenkins-9:38573/jndi/rmi://apache-ci-beam-jenkins-9:33293/jmxrmi [Samza StreamProcessor Container Thread-0] INFO org.apache.samza.container.SamzaContainer - Registering task instance metrics. [Samza StreamProcessor Container Thread-0] INFO org.apache.samza.container.SamzaContainer - Starting JVM metrics. [Samza StreamProcessor Container Thread-0] INFO org.apache.samza.container.SamzaContainer - Starting metrics reporters. [Samza StreamProcessor Container Thread-0] INFO org.apache.samza.container.SamzaContainer - Starting admin multiplexer. [Samza StreamProcessor Container Thread-0] INFO org.apache.samza.container.SamzaContainer - Registering task instances with offsets. [Samza StreamProcessor Container Thread-0] INFO org.apache.samza.container.SamzaContainer - Starting offset manager. [Samza StreamProcessor Container Thread-0] INFO org.apache.samza.checkpoint.OffsetManager - Successfully loaded last processed offsets: {} [Samza StreamProcessor Container Thread-0] INFO org.apache.samza.checkpoint.OffsetManager - Successfully loaded starting offsets: Map(Partition 0 -> Map(SystemStreamPartition [n1, n1, 0] -> 0, SystemStreamPartition [n8, n8, 0] -> 0, SystemStreamPartition [n14, n14, 0] -> 0, SystemStreamPartition [n10, n10, 0] -> 0)) [Samza StreamProcessor Container Thread-0] INFO org.apache.samza.container.SamzaContainer - Registering task instances with producers. [Samza StreamProcessor Container Thread-0] INFO org.apache.samza.container.SamzaContainer - Starting producer multiplexer. [Samza StreamProcessor Container Thread-0] INFO org.apache.samza.container.SamzaContainer - Starting container storage manager. [Samza StreamProcessor Container Thread-0] INFO org.apache.samza.storage.ContainerStorageManager - Checkpointed changelog ssp offsets: {} [Samza StreamProcessor Container Thread-0] INFO org.apache.samza.storage.ContainerStorageManager - Store Restore started [Samza StreamProcessor Container Thread-0] INFO org.apache.samza.storage.TransactionalStateTaskRestoreManager - Got current changelog offsets for taskName: Partition 0 as: {} [Samza StreamProcessor Container Thread-0] INFO org.apache.samza.storage.TransactionalStateTaskRestoreManager - Marking current directory: <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/src/state/beamStore/Partition_0> for store: beamStore in task: Partition 0 for deletion since it is not a logged store. [Samza StreamProcessor Container Thread-0] INFO org.apache.samza.storage.TransactionalStateTaskRestoreManager - Store directories to be retained in Task: Partition 0 are: {} [Samza StreamProcessor Container Thread-0] INFO org.apache.samza.storage.TransactionalStateTaskRestoreManager - Store directories to be deleted in Task: Partition 0 are: {beamStore=[<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/src/state/beamStore/Partition_0]}> [Samza StreamProcessor Container Thread-0] INFO org.apache.samza.storage.TransactionalStateTaskRestoreManager - Stores to be restored in Task: Partition 0 are: {} [Samza StreamProcessor Container Thread-0] INFO org.apache.samza.storage.TransactionalStateTaskRestoreManager - Deleting persistent store directory: <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/src/state/beamStore/Partition_0> for store: beamStore in task: Partition 0 [Samza StreamProcessor Container Thread-0] INFO org.apache.samza.storage.TransactionalStateTaskRestoreManager - Creating missing persistent store current directory: <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/src/state/beamStore/Partition_0> for store: beamStore in task: Partition 0 [Samza Restore Thread-0] INFO org.apache.samza.storage.ContainerStorageManager - Starting stores in task instance Partition 0 [Samza Restore Thread-0] INFO org.apache.samza.storage.TransactionalStateTaskRestoreManager - Stopped persistent store: beamStore in task: Partition 0 [Samza StreamProcessor Container Thread-0] INFO org.apache.samza.storage.ContainerStorageManager - Re-created store beamStore in read-write mode for task Partition 0 because it a persistent store [Samza StreamProcessor Container Thread-0] INFO org.apache.samza.storage.ContainerStorageManager - Store Restore complete [Samza StreamProcessor Container Thread-0] INFO org.apache.samza.container.SamzaContainer - Starting table manager in task instance Partition 0 [Samza StreamProcessor Container Thread-0] INFO org.apache.samza.container.SamzaContainer - Starting host statistics monitor [Samza StreamProcessor Container Thread-0] INFO org.apache.samza.container.SamzaContainer - Initializing stream tasks. [Samza StreamProcessor Container Thread-0] INFO org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0 event time timers in memory [Samza StreamProcessor Container Thread-0] INFO org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0 processing time timers in memory [Samza StreamProcessor Container Thread-0] WARN org.apache.beam.runners.fnexecution.environment.DockerCommand - Unable to pull docker image apache/beam_go_sdk:dev, cause: Received exit code 1 for command 'docker pull apache/beam_go_sdk:dev'. stderr: Error response from daemon: manifest for apache/beam_go_sdk:dev not found [grpc-default-executor-9] INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService - Beam Fn Logging client connected. [grpc-default-executor-9] INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService - Beam Fn Control client connected with id 29-1 [grpc-default-executor-9] INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:506 - Connecting via grpc @ localhost:43957 ... [grpc-default-executor-9] INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:506 - Connecting via grpc @ localhost:35737 ... [Samza StreamProcessor Container Thread-0] INFO org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0 event time timers in memory [Samza StreamProcessor Container Thread-0] INFO org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0 processing time timers in memory [Samza StreamProcessor Container Thread-0] INFO org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0 event time timers in memory [Samza StreamProcessor Container Thread-0] INFO org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0 processing time timers in memory [Samza StreamProcessor Container Thread-0] INFO org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0 event time timers in memory [Samza StreamProcessor Container Thread-0] INFO org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0 processing time timers in memory [Samza StreamProcessor Container Thread-0] INFO org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0 event time timers in memory [Samza StreamProcessor Container Thread-0] INFO org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0 processing time timers in memory [Samza StreamProcessor Container Thread-0] INFO org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0 event time timers in memory [Samza StreamProcessor Container Thread-0] INFO org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0 processing time timers in memory [Samza StreamProcessor Container Thread-0] INFO org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0 event time timers in memory [Samza StreamProcessor Container Thread-0] INFO org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0 processing time timers in memory [Samza StreamProcessor Container Thread-0] INFO org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0 event time timers in memory [Samza StreamProcessor Container Thread-0] INFO org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0 processing time timers in memory [Samza StreamProcessor Container Thread-0] INFO org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0 event time timers in memory [Samza StreamProcessor Container Thread-0] INFO org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0 processing time timers in memory [Samza StreamProcessor Container Thread-0] INFO org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0 event time timers in memory [Samza StreamProcessor Container Thread-0] INFO org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0 processing time timers in memory [Samza StreamProcessor Container Thread-0] INFO org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0 event time timers in memory [Samza StreamProcessor Container Thread-0] INFO org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0 processing time timers in memory [Samza StreamProcessor Container Thread-0] INFO org.apache.samza.container.SamzaContainer - Registering task instances with consumers. [Samza StreamProcessor Container Thread-0] INFO org.apache.samza.container.SamzaContainer - Starting consumer multiplexer. [Samza StreamProcessor Container Thread-0] INFO org.apache.samza.container.SamzaContainer - Entering run loop. [Samza StreamProcessor Container Thread-0] WARN org.apache.samza.processor.StreamProcessor - Received container start notification for container: org.apache.samza.container.SamzaContainer@fb0f14d in stream processor: 1. [grpc-default-executor-9] INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService - getProcessBundleDescriptor request with id 29-5 [grpc-default-executor-7] INFO org.apache.beam.runners.fnexecution.data.GrpcDataService - Beam Fn Data client connected. [grpc-default-executor-9] INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:506 - Connecting via grpc @ localhost:40883 ... [grpc-default-executor-9] INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:232 - DataSource: 0 elements in 8128213 ns [grpc-default-executor-7] INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService - getProcessBundleDescriptor request with id 29-4 [grpc-default-executor-7] INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:232 - DataSource: 0 elements in 1596201 ns [grpc-default-executor-4] INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasink.go>:84 - DataSink: 0 elements in 1623977 ns [grpc-default-executor-4] INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasink.go>:84 - DataSink: 0 elements in 1648819 ns [grpc-default-executor-4] INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasink.go>:84 - DataSink: 0 elements in 1657575 ns [grpc-default-executor-4] INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService - getProcessBundleDescriptor request with id 29-2 [grpc-default-executor-7] INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService - getProcessBundleDescriptor request with id 29-6 [grpc-default-executor-9] INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:232 - DataSource: 1 elements in 68306 ns [grpc-default-executor-9] INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasink.go>:84 - DataSink: 4 elements in 85031 ns [grpc-default-executor-7] INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:232 - DataSource: 1 elements in 49887 ns [grpc-default-executor-7] INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasink.go>:84 - DataSink: 1 elements in 79745 ns [Samza StreamProcessor Container Thread-0] INFO org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0 event time timers in memory [grpc-default-executor-7] INFO org.apache.beam.runners.fnexecution.control.FnApiControlClientPoolService - getProcessBundleDescriptor request with id 29-3 [Samza StreamProcessor Container Thread-0] INFO org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0 event time timers in memory [grpc-default-executor-4] INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:232 - DataSource: 1 elements in 50078 ns [grpc-default-executor-4] INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasink.go>:84 - DataSink: 1 elements in 87587 ns [grpc-default-executor-9] INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:232 - DataSource: 0 elements in 158267 ns [grpc-default-executor-9] INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasink.go>:84 - DataSink: 0 elements in 205647 ns [grpc-default-executor-9] INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasink.go>:84 - DataSink: 0 elements in 227295 ns [grpc-default-executor-9] INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasink.go>:84 - DataSink: 0 elements in 235685 ns [Samza StreamProcessor Container Thread-0] INFO org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0 event time timers in memory [grpc-default-executor-9] INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/harness/harness.go>:506 - Connecting via grpc @ localhost:35879 ... [grpc-default-executor-7] INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:232 - DataSource: 1 elements in 5357624 ns [grpc-default-executor-7] INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasink.go>:84 - DataSink: 0 elements in 5439164 ns [grpc-default-executor-4] INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasink.go>:84 - DataSink: 1 elements in 5467186 ns [grpc-default-executor-4] INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasink.go>:84 - DataSink: 0 elements in 5478781 ns [Samza StreamProcessor Container Thread-0] INFO org.apache.beam.runners.samza.runtime.SamzaTimerInternalsFactory - Loaded 0 event time timers in memory [grpc-default-executor-4] INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:232 - DataSource: 0 elements in 86618 ns [Samza StreamProcessor Container Thread-0] INFO org.apache.samza.system.SystemConsumers - End of stream reached for partition: SystemStreamPartition [n14, n14, 0] [Samza StreamProcessor Container Thread-0] INFO org.apache.samza.system.SystemConsumers - End of stream reached for partition: SystemStreamPartition [n10, n10, 0] [Samza StreamProcessor Container Thread-0] INFO org.apache.samza.system.SystemConsumers - End of stream reached for partition: SystemStreamPartition [n1, n1, 0] [Samza StreamProcessor Container Thread-0] INFO org.apache.samza.system.SystemConsumers - End of stream reached for partition: SystemStreamPartition [n8, n8, 0] [Samza StreamProcessor Container Thread-0] INFO org.apache.samza.task.CoordinatorRequests - Shutdown has now been requested by tasks [Partition 0] [Samza StreamProcessor Container Thread-0] INFO org.apache.samza.task.CoordinatorRequests - Shutdown requested. [Samza StreamProcessor Container Thread-0] INFO org.apache.samza.container.SamzaContainer - Shutting down SamzaContainer. [Samza StreamProcessor Container Thread-0] INFO org.apache.samza.container.SamzaContainer - Shutting down consumer multiplexer. [Samza StreamProcessor Container Thread-0] INFO org.apache.samza.container.SamzaContainer - Shutting down task instance stream tasks. [Samza StreamProcessor Container Thread-0] INFO org.apache.samza.container.SamzaContainer - Shutting down timer executor [Samza StreamProcessor Container Thread-0] INFO org.apache.beam.runners.fnexecution.control.DefaultJobBundleFactory - Closing environment urn: "beam:env:docker:v1" payload: "\n\026apache/beam_go_sdk:dev" capabilities: "beam:protocol:progress_reporting:v0" capabilities: "beam:protocol:multi_core_bundle_processing:v1" capabilities: "beam:version:sdk_base:go" capabilities: "beam:coder:bytes:v1" capabilities: "beam:coder:bool:v1" capabilities: "beam:coder:varint:v1" capabilities: "beam:coder:double:v1" capabilities: "beam:coder:string_utf8:v1" capabilities: "beam:coder:length_prefix:v1" capabilities: "beam:coder:kv:v1" capabilities: "beam:coder:iterable:v1" capabilities: "beam:coder:state_backed_iterable:v1" capabilities: "beam:coder:windowed_value:v1" capabilities: "beam:coder:global_window:v1" capabilities: "beam:coder:interval_window:v1" dependencies { type_urn: "beam:artifact:type:file:v1" type_payload: "\ng/tmp/beam-artifact-staging/57592c6cc0d2b05c152e7cfa4e3444252c0edc5241b6f44691de8d8d57ffcf55/1-go-worker" role_urn: "beam:artifact:role:staging_to:v1" role_payload: "\n\006worker" } [grpc-default-executor-7] INFO <https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/temp_gopath/src/github.com/apache/beam/sdks/go/test/vendor/github.com/apache/beam/sdks/go/pkg/beam/core/runtime/exec/datasource.go>:232 - DataSource: 1 elements in 3853801 ns [Samza StreamProcessor Container Thread-0] INFO org.apache.beam.runners.fnexecution.logging.GrpcLoggingService - 1 Beam Fn Logging clients still connected during shutdown. [Samza StreamProcessor Container Thread-0] WARN org.apache.beam.sdk.fn.data.BeamFnDataGrpcMultiplexer - Hanged up for unknown endpoint. [Samza StreamProcessor Container Thread-0] INFO org.apache.beam.runners.fnexecution.environment.DockerContainerEnvironment - Closing Docker container 5bea8d387be3366b05e11421586b062ebd31eeb8a0a3d0b6d2e7f8cd22b0f720. Logs: 2021/07/23 00:20:07 Provision info: pipeline_options:{fields:{key:"beam:option:app_name:v1" value:{string_value:"go-job-7-1626999601019796705"}} fields:{key:"beam:option:experiments:v1" value:{list_value:{values:{string_value:"beam_fn_api"}}}} fields:{key:"beam:option:go_options:v1" value:{struct_value:{fields:{key:"options" value:{struct_value:{fields:{key:"hooks" value:{string_value:"{}"}}}}}}}} fields:{key:"beam:option:parallelism:v1" value:{number_value:-1}} fields:{key:"beam:option:retain_docker_containers:v1" value:{bool_value:false}} fields:{key:"beam:option:runner:v1" value:{string_value:""}}} logging_endpoint:{url:"localhost:35737"} artifact_endpoint:{url:"localhost:45763"} control_endpoint:{url:"localhost:43957"} dependencies:{type_urn:"beam:artifact:type:file:v1" type_payload:"\ng/tmp/beam-artifact-staging/57592c6cc0d2b05c152e7cfa4e3444252c0edc5241b6f44691de8d8d57ffcf55/1-go-worker" role_urn:"beam:artifact:role:staging_to:v1" role_payload:"\n\x06worker"} 2021/07/23 00:20:07 Initializing Go harness: /opt/apache/beam/boot --id=29-1 --provision_endpoint=localhost:35337 2021/07/23 00:20:07 Downloaded: /tmp/staged/worker (sha256: fbb010018590f84688d969cb80378cd6820c729c41cd71d49341e873d5a78f5f, size: 27177358) Worker exited successfully! 2021/07/23 00:20:08 control response channel closed [Samza StreamProcessor Container Thread-0] INFO org.apache.samza.container.SamzaContainer - Shutting down task instance table manager. [Samza StreamProcessor Container Thread-0] INFO org.apache.samza.container.SamzaContainer - Shutting down container storage manager. [Samza StreamProcessor Container Thread-0] INFO org.apache.samza.storage.ContainerStorageManager - Shutdown complete [Samza StreamProcessor Container Thread-0] INFO org.apache.samza.container.SamzaContainer - Shutting down host statistics monitor. [Samza StreamProcessor Container Thread-0] INFO org.apache.samza.container.SamzaContainer - Shutting down producer multiplexer. [Samza StreamProcessor Container Thread-0] INFO org.apache.samza.container.SamzaContainer - Shutting down offset manager. [Samza StreamProcessor Container Thread-0] INFO org.apache.samza.container.SamzaContainer - Shutting down metrics reporters. [Samza StreamProcessor Container Thread-0] INFO org.apache.samza.container.SamzaContainer - Shutting down JVM metrics. [Samza StreamProcessor Container Thread-0] INFO org.apache.samza.container.SamzaContainer - Shutting down admin multiplexer. [Samza StreamProcessor Container Thread-0] INFO org.apache.samza.container.SamzaContainer - Shutdown complete. [Samza StreamProcessor Container Thread-0] INFO org.apache.samza.processor.StreamProcessor - Container: org.apache.samza.container.SamzaContainer@fb0f14d stopped. Stopping the stream processor: 1. [Samza StreamProcessor Container Thread-0] INFO org.apache.samza.processor.StreamProcessor - Ignoring onJobModelExpired invocation since the current state is STOPPING and not in [RUNNING, STARTED, IN_REBALANCE]. [Samza StreamProcessor Container Thread-0] INFO org.apache.samza.processor.StreamProcessor - Shutting down the executor service of the stream processor: 1. [Samza StreamProcessor Container Thread-0] WARN org.apache.samza.container.SamzaContainer - Shutdown is no-op since the container is already in state: STOPPED [Samza StreamProcessor Container Thread-0] INFO org.apache.samza.processor.StreamProcessor - Waiting 30000 ms for the container: org.apache.samza.container.SamzaContainer@fb0f14d to shutdown. [Samza StreamProcessor Container Thread-0] INFO org.apache.samza.processor.StreamProcessor - Shutdown status of container: org.apache.samza.container.SamzaContainer@fb0f14d for stream processor: 1 is: true. [samza-runner-job-invoker-0] INFO org.apache.beam.runners.samza.SamzaPipelineResult - Pipeline finished. Final state: DONE [samza-runner-job-invoker-1] WARN org.apache.beam.runners.samza.SamzaPortablePipelineResult - Collecting monitoring infos is not implemented yet in Samza portable runner. [grpc-default-executor-7] INFO org.apache.beam.runners.jobsubmission.InMemoryJobService - Getting job metrics for go0job0701626999601019796705-jenkins-0723002005-c0239b6a_a68634c2-2636-4d75-854c-03bc4b83c40b [grpc-default-executor-7] INFO org.apache.beam.runners.jobsubmission.InMemoryJobService - Finished getting job metrics for go0job0701626999601019796705-jenkins-0723002005-c0239b6a_a68634c2-2636-4d75-854c-03bc4b83c40b if [[ "$RUNNER" == "dataflow" ]]; then # Delete the container locally and remotely docker rmi $CONTAINER:$TAG || echo "Failed to remove container" gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to delete container" if [[ -n "$TEST_EXPANSION_ADDR" || -n "$IO_EXPANSION_ADDR" ]]; then # Delete the java cross-language container locally and remotely docker rmi $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to remove container" gcloud --quiet container images delete $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to delete container" fi # Clean up tempdir rm -rf $TMPDIR fi exit $TEST_EXIT_CODE exit_background_processes > Task :sdks:go:test:samzaValidatesRunner FAILED FAILURE: Build failed with an exception. * Where: Build file '<https://ci-beam.apache.org/job/beam_PostCommit_Go_VR_Samza/ws/src/sdks/go/test/build.gradle'> line: 115 * What went wrong: Execution failed for task ':sdks:go:test:samzaValidatesRunner'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 19m 41s 93 actionable tasks: 67 executed, 24 from cache, 2 up-to-date Publishing build scan... https://gradle.com/s/l4exmeguguzeg Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
