See <https://ci-beam.apache.org/job/beam_PostCommit_Python38/1215/display/redirect>
Changes: ------------------------------------------ [...truncated 137.79 KB...] datanode_1 | 21/05/16 06:02:28 INFO common.Storage: Lock on /hadoop/dfs/data/in_use.lock acquired by nodename 82@datanode datanode_1 | 21/05/16 06:02:28 INFO common.Storage: Storage directory /hadoop/dfs/data is not formatted for namespace 601306649. Formatting... datanode_1 | 21/05/16 06:02:28 INFO common.Storage: Generated new storageID DS-b0e5aab1-eb59-4f80-908d-8d3941d25792 for directory /hadoop/dfs/data datanode_1 | 21/05/16 06:02:28 INFO common.Storage: Analyzing storage directories for bpid BP-46512315-172.19.0.2-1621144932642 datanode_1 | 21/05/16 06:02:28 INFO common.Storage: Locking is disabled for /hadoop/dfs/data/current/BP-46512315-172.19.0.2-1621144932642 datanode_1 | 21/05/16 06:02:28 INFO common.Storage: Block pool storage directory /hadoop/dfs/data/current/BP-46512315-172.19.0.2-1621144932642 is not formatted for BP-46512315-172.19.0.2-1621144932642. Formatting ... datanode_1 | 21/05/16 06:02:28 INFO common.Storage: Formatting block pool BP-46512315-172.19.0.2-1621144932642 directory /hadoop/dfs/data/current/BP-46512315-172.19.0.2-1621144932642/current datanode_1 | 21/05/16 06:02:28 INFO datanode.DataNode: Setting up storage: nsid=601306649;bpid=BP-46512315-172.19.0.2-1621144932642;lv=-57;nsInfo=lv=-63;cid=CID-3f15bd9b-2e69-441e-b894-9a3016c8f3fa;nsid=601306649;c=1621144932642;bpid=BP-46512315-172.19.0.2-1621144932642;dnuuid=null datanode_1 | 21/05/16 06:02:28 INFO datanode.DataNode: Generated and persisted new Datanode UUID 32e1334f-b44e-4ef2-a763-d285cb686dc7 datanode_1 | 21/05/16 06:02:28 INFO impl.FsDatasetImpl: Added new volume: DS-b0e5aab1-eb59-4f80-908d-8d3941d25792 datanode_1 | 21/05/16 06:02:28 INFO impl.FsDatasetImpl: Added volume - /hadoop/dfs/data/current, StorageType: DISK datanode_1 | 21/05/16 06:02:28 INFO impl.FsDatasetImpl: Registered FSDatasetState MBean datanode_1 | 21/05/16 06:02:28 INFO impl.FsDatasetImpl: Volume reference is released. datanode_1 | 21/05/16 06:02:28 INFO impl.FsDatasetImpl: Adding block pool BP-46512315-172.19.0.2-1621144932642 datanode_1 | 21/05/16 06:02:28 INFO impl.FsDatasetImpl: Scanning block pool BP-46512315-172.19.0.2-1621144932642 on volume /hadoop/dfs/data/current... datanode_1 | 21/05/16 06:02:28 INFO impl.FsDatasetImpl: Time taken to scan block pool BP-46512315-172.19.0.2-1621144932642 on /hadoop/dfs/data/current: 42ms datanode_1 | 21/05/16 06:02:28 INFO impl.FsDatasetImpl: Total time to scan all replicas for block pool BP-46512315-172.19.0.2-1621144932642: 52ms datanode_1 | 21/05/16 06:02:28 INFO impl.FsDatasetImpl: Adding replicas to map for block pool BP-46512315-172.19.0.2-1621144932642 on volume /hadoop/dfs/data/current... datanode_1 | 21/05/16 06:02:28 INFO impl.BlockPoolSlice: Replica Cache file: /hadoop/dfs/data/current/BP-46512315-172.19.0.2-1621144932642/current/replicas doesn't exist datanode_1 | 21/05/16 06:02:28 INFO impl.FsDatasetImpl: Time to add replicas to map for block pool BP-46512315-172.19.0.2-1621144932642 on volume /hadoop/dfs/data/current: 1ms datanode_1 | 21/05/16 06:02:28 INFO impl.FsDatasetImpl: Total time to add all replicas to map: 4ms datanode_1 | 21/05/16 06:02:28 INFO datanode.VolumeScanner: Now scanning bpid BP-46512315-172.19.0.2-1621144932642 on volume /hadoop/dfs/data datanode_1 | 21/05/16 06:02:28 INFO datanode.VolumeScanner: VolumeScanner(/hadoop/dfs/data, DS-b0e5aab1-eb59-4f80-908d-8d3941d25792): finished scanning block pool BP-46512315-172.19.0.2-1621144932642 datanode_1 | 21/05/16 06:02:28 INFO datanode.DirectoryScanner: Periodic Directory Tree Verification scan starting at 5/16/21 7:05 AM with interval of 21600000ms datanode_1 | 21/05/16 06:02:28 INFO datanode.DataNode: Block pool BP-46512315-172.19.0.2-1621144932642 (Datanode Uuid 32e1334f-b44e-4ef2-a763-d285cb686dc7) service to namenode/172.19.0.2:8020 beginning handshake with NN datanode_1 | 21/05/16 06:02:28 INFO datanode.VolumeScanner: VolumeScanner(/hadoop/dfs/data, DS-b0e5aab1-eb59-4f80-908d-8d3941d25792): no suitable block pools found to scan. Waiting 1814399940 ms. namenode_1 | 21/05/16 06:02:28 INFO hdfs.StateChange: BLOCK* registerDatanode: from DatanodeRegistration(172.19.0.3:50010, datanodeUuid=32e1334f-b44e-4ef2-a763-d285cb686dc7, infoPort=50075, infoSecurePort=0, ipcPort=50020, storageInfo=lv=-57;cid=CID-3f15bd9b-2e69-441e-b894-9a3016c8f3fa;nsid=601306649;c=1621144932642) storage 32e1334f-b44e-4ef2-a763-d285cb686dc7 namenode_1 | 21/05/16 06:02:28 INFO net.NetworkTopology: Adding a new node: /default-rack/172.19.0.3:50010 namenode_1 | 21/05/16 06:02:28 INFO blockmanagement.BlockReportLeaseManager: Registered DN 32e1334f-b44e-4ef2-a763-d285cb686dc7 (172.19.0.3:50010). datanode_1 | 21/05/16 06:02:28 INFO datanode.DataNode: Block pool Block pool BP-46512315-172.19.0.2-1621144932642 (Datanode Uuid 32e1334f-b44e-4ef2-a763-d285cb686dc7) service to namenode/172.19.0.2:8020 successfully registered with NN datanode_1 | 21/05/16 06:02:28 INFO datanode.DataNode: For namenode namenode/172.19.0.2:8020 using BLOCKREPORT_INTERVAL of 21600000msec CACHEREPORT_INTERVAL of 10000msec Initial delay: 0msec; heartBeatInterval=3000 namenode_1 | 21/05/16 06:02:28 INFO blockmanagement.DatanodeDescriptor: Adding new storage ID DS-b0e5aab1-eb59-4f80-908d-8d3941d25792 for DN 172.19.0.3:50010 namenode_1 | 21/05/16 06:02:28 INFO BlockStateChange: BLOCK* processReport 0x92f8bb68556acf65: Processing first storage report for DS-b0e5aab1-eb59-4f80-908d-8d3941d25792 from datanode 32e1334f-b44e-4ef2-a763-d285cb686dc7 namenode_1 | 21/05/16 06:02:28 INFO BlockStateChange: BLOCK* processReport 0x92f8bb68556acf65: from storage DS-b0e5aab1-eb59-4f80-908d-8d3941d25792 node DatanodeRegistration(172.19.0.3:50010, datanodeUuid=32e1334f-b44e-4ef2-a763-d285cb686dc7, infoPort=50075, infoSecurePort=0, ipcPort=50020, storageInfo=lv=-57;cid=CID-3f15bd9b-2e69-441e-b894-9a3016c8f3fa;nsid=601306649;c=1621144932642), blocks: 0, hasStaleStorage: false, processing time: 2 msecs, invalidatedBlocks: 0 datanode_1 | 21/05/16 06:02:28 INFO datanode.DataNode: Successfully sent block report 0x92f8bb68556acf65, containing 1 storage report(s), of which we sent 1. The reports had 0 total blocks and used 1 RPC(s). This took 4 msec to generate and 118 msecs for RPC and NN processing. Got back one command: FinalizeCommand/5. datanode_1 | 21/05/16 06:02:28 INFO datanode.DataNode: Got finalize command for block pool BP-46512315-172.19.0.2-1621144932642 test_1 | hdfs_integration_test create: /app/sdks/python/target/.tox/hdfs_integration_test test_1 | hdfs_integration_test installdeps: -rbuild-requirements.txt, gsutil==4.47, holdup==1.8.0 > Task :sdks:go:resolveBuildDependencies Resolving go.opencensus.io: commit='3fb168f674736c026e623310bfccb0691e6dec8a', urls=[https://github.com/census-instrumentation/opencensus-go] Resolving golang.org/x/crypto: commit='d9133f5469342136e669e85192a26056b587f503', urls=[https://go.googlesource.com/crypto] Resolving golang.org/x/debug: commit='95515998a8a4bd7448134b2cb5971dbeb12e0b77', urls=[https://go.googlesource.com/debug] Resolving golang.org/x/net: commit='2fb46b16b8dda405028c50f7c7f0f9dd1fa6bfb1', urls=[https://go.googlesource.com/net] Resolving golang.org/x/oauth2: commit='5d25da1a8d43b66f2898c444f899c7bcfd6a407e', urls=[https://go.googlesource.com/oauth2] Resolving golang.org/x/sync: commit='fd80eb99c8f653c847d294a001bdf2a3a6f768f5', urls=[https://go.googlesource.com/sync] Resolving golang.org/x/sys: commit='fde4db37ae7ad8191b03d30d27f258b5291ae4e3', urls=[https://go.googlesource.com/sys] > Task :sdks:python:test-suites:direct:py38:hdfsIntegrationTest test_1 | hdfs_integration_test inst: /app/sdks/python/target/.tox/.tmp/package/1/apache-beam-2.31.0.dev0.zip > Task :sdks:go:resolveBuildDependencies Resolving golang.org/x/text: commit='23ae387dee1f90d29a23c0e87ee0b46038fbed0e', urls=[https://go.googlesource.com/text] Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, [email protected]:etcd-io/etcd.git] > Task :release:go-licenses:java:dockerRun + go-licenses save github.com/apache/beam/sdks/java/container --save_path=/output/licenses > Task :release:go-licenses:py:dockerRun + go-licenses save github.com/apache/beam/sdks/python/container --save_path=/output/licenses + go-licenses csv github.com/apache/beam/sdks/python/container + tee /output/licenses/list.csv github.com/apache/beam/sdks/go/pkg/beam,https://github.com/apache/beam/blob/master/sdks/go/README.md,Apache-2.0 github.com/golang/protobuf,https://github.com/golang/protobuf/blob/master/LICENSE,BSD-3-Clause google.golang.org/protobuf,https://go.googlesource.com/protobuf/+/refs/heads/master/LICENSE,BSD-3-Clause google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/master/LICENSE,Apache-2.0 golang.org/x/sys,https://go.googlesource.com/sys/+/refs/heads/master/LICENSE,BSD-3-Clause github.com/apache/beam/sdks/python/container,https://github.com/apache/beam/blob/master/LICENSE,Apache-2.0 google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/master/LICENSE,Apache-2.0 golang.org/x/net,https://go.googlesource.com/net/+/refs/heads/master/LICENSE,BSD-3-Clause golang.org/x/text,https://go.googlesource.com/text/+/refs/heads/master/LICENSE,BSD-3-Clause github.com/nightlyone/lockfile,https://github.com/nightlyone/lockfile/blob/master/LICENSE,MIT + chmod -R a+w /output/licenses > Task :release:go-licenses:java:dockerRun + go-licenses csv github.com/apache/beam/sdks/java/container + tee /output/licenses/list.csv github.com/apache/beam/sdks/java/container,https://github.com/apache/beam/blob/master/LICENSE,Apache-2.0 google.golang.org/protobuf,https://go.googlesource.com/protobuf/+/refs/heads/master/LICENSE,BSD-3-Clause google.golang.org/grpc,https://github.com/grpc/grpc-go/blob/master/LICENSE,Apache-2.0 golang.org/x/net,https://go.googlesource.com/net/+/refs/heads/master/LICENSE,BSD-3-Clause golang.org/x/sys,https://go.googlesource.com/sys/+/refs/heads/master/LICENSE,BSD-3-Clause golang.org/x/text,https://go.googlesource.com/text/+/refs/heads/master/LICENSE,BSD-3-Clause github.com/apache/beam/sdks/go/pkg/beam,https://github.com/apache/beam/blob/master/sdks/go/README.md,Apache-2.0 github.com/golang/protobuf,https://github.com/golang/protobuf/blob/master/LICENSE,BSD-3-Clause google.golang.org/genproto/googleapis/rpc/status,https://github.com/googleapis/go-genproto/blob/master/LICENSE,Apache-2.0 + chmod -R a+w /output/licenses > Task :release:go-licenses:py:createLicenses > Task :sdks:python:container:py38:copyGolangLicenses FAILED > Task :release:go-licenses:java:createLicenses > Task :sdks:java:container:java8:copyGolangLicenses FAILED > Task :sdks:python:test-suites:direct:py38:hdfsIntegrationTest Stopping hdfs_it-jenkins-beam_postcommit_python38-1215_datanode_1 ... Stopping hdfs_it-jenkins-beam_postcommit_python38-1215_namenode_1 ... Stopping hdfs_it-jenkins-beam_postcommit_python38-1215_datanode_1 ... done Stopping hdfs_it-jenkins-beam_postcommit_python38-1215_namenode_1 ... done real 4m26.446s user 0m2.076s sys 0m0.185s + finally + docker-compose -p hdfs_IT-jenkins-beam_PostCommit_Python38-1215 --no-ansi down Removing hdfs_it-jenkins-beam_postcommit_python38-1215_test_1 ... Removing hdfs_it-jenkins-beam_postcommit_python38-1215_datanode_1 ... Removing hdfs_it-jenkins-beam_postcommit_python38-1215_namenode_1 ... Removing hdfs_it-jenkins-beam_postcommit_python38-1215_namenode_1 ... done Removing hdfs_it-jenkins-beam_postcommit_python38-1215_test_1 ... done Removing hdfs_it-jenkins-beam_postcommit_python38-1215_datanode_1 ... done Removing network hdfs_it-jenkins-beam_postcommit_python38-1215_test_net real 0m1.642s user 0m0.843s sys 0m0.172s > Task :sdks:python:test-suites:direct:py38:setupVirtualenv FAILED > Task :sdks:go:resolveBuildDependencies Resolving google.golang.org/api: commit='0324d5e90dc7753607860272666845fad9ceb97e', urls=[https://code.googlesource.com/google-api-go-client] Resolving google.golang.org/genproto: commit='4d944d34d83c502a5f761500a14d8842648415c3', urls=[https://github.com/google/go-genproto] Resolving google.golang.org/grpc: commit='5e8f83304c0563d1ba74db05fee83d9c18ab9a58', urls=[https://github.com/grpc/grpc-go] Resolving google.golang.org/protobuf: commit='d165be301fb1e13390ad453281ded24385fd8ebc', urls=[https://go.googlesource.com/protobuf] Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, [email protected]:etcd-io/etcd.git] Resolving cached github.com/etcd-io/etcd: commit='11214aa33bf5a47d3d9d8dafe0f6b97237dfe921', urls=[https://github.com/etcd-io/etcd.git, [email protected]:etcd-io/etcd.git] > Task :sdks:go:installDependencies > Task :sdks:go:buildLinuxAmd64 > Task :sdks:go:goBuild > Task :sdks:python:container:resolveBuildDependencies FAILED > Task :sdks:python:container:installDependencies > Task :sdks:java:container:resolveBuildDependencies FAILED > Task :sdks:java:container:installDependencies FAILURE: Build completed with 9 failures. 1: Task failed with an exception. ----------- * What went wrong: Execution failed for task ':sdks:java:harness:jar'. > Could not create task ':sdks:java:io:synthetic:clean'. > java.util.ConcurrentModificationException (no error message) * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. ============================================================================== 2: Task failed with an exception. ----------- * What went wrong: Execution failed for task ':sdks:java:harness:shadowJar'. > Could not create task ':sdks:java:io:synthetic:clean'. > java.util.ConcurrentModificationException (no error message) * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. ============================================================================== 3: Task failed with an exception. ----------- * What went wrong: Execution failed for task ':sdks:java:container:pullLicenses'. > Could not create task ':sdks:java:io:synthetic:clean'. > java.util.ConcurrentModificationException (no error message) * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. ============================================================================== 4: Task failed with an exception. ----------- * What went wrong: Execution failed for task ':sdks:python:sdist'. > Could not create task ':sdks:java:io:synthetic:clean'. > java.util.ConcurrentModificationException (no error message) * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. ============================================================================== 5: Task failed with an exception. ----------- * What went wrong: Execution failed for task ':sdks:python:container:py38:copyGolangLicenses'. > Could not create task ':sdks:java:io:synthetic:clean'. > java.util.ConcurrentModificationException (no error message) * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. ============================================================================== 6: Task failed with an exception. ----------- * What went wrong: Execution failed for task ':sdks:java:container:java8:copyGolangLicenses'. > Could not create task ':sdks:java:io:synthetic:clean'. > java.util.ConcurrentModificationException (no error message) * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. ============================================================================== 7: Task failed with an exception. ----------- * What went wrong: Execution failed for task ':sdks:python:test-suites:direct:py38:setupVirtualenv'. > Could not create task ':sdks:java:io:synthetic:clean'. > java.util.ConcurrentModificationException (no error message) * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. ============================================================================== 8: Task failed with an exception. ----------- * What went wrong: Execution failed for task ':sdks:python:container:resolveBuildDependencies'. > Could not create task ':sdks:java:io:synthetic:clean'. > java.util.ConcurrentModificationException (no error message) * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. ============================================================================== 9: Task failed with an exception. ----------- * What went wrong: Execution failed for task ':sdks:java:container:resolveBuildDependencies'. > Could not create task ':sdks:java:io:synthetic:clean'. > java.util.ConcurrentModificationException (no error message) * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. ============================================================================== * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 7m 23s 154 actionable tasks: 118 executed, 32 from cache, 4 up-to-date Publishing build scan... https://gradle.com/s/r2xipakyor64u Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
