See <https://ci-beam.apache.org/job/beam_PostCommit_Java_ValidatesRunner_SparkStructuredStreaming/2634/display/redirect?page=changes>
Changes: [tomasz.szerszen] Create Spark Metrics in directory using Spark History Server format [tomasz.szerszen] java spotless apply [tomasz.szerszen] add --spark-history-dir option in spark job server [tomasz.szerszen] add driver distribution logs [tomasz.szerszen] remove start import check [tomasz.szerszen] spotless apply [tomasz.szerszen] render all metrics & add eventLogEnabled [tomasz.szerszen] add exception when eventLogEnabled is true [tomasz.szerszen] handle eventLogEnabled [tomasz.szerszen] apply spotless [tomasz.szerszen] remove star import [tomasz.szerszen] run java spotless [tomasz.szerszen] fix renderName is static from now on [sychen] Add transform translator for GroupIntoBatches in Java. [tomasz.szerszen] spark.executor.id loop and switch to boolean [tomasz.szerszen] spotless apply [tomasz.szerszen] remove uncessary code [Pablo Estrada] [BEAM-11705] Fixing ignore_insert_id implementation [tomasz.szerszen] scope.Option.apply [tomasz.szerszen] remove options from spark job server configuration & fix the spark [tomasz.szerszen] remove options from spark job server configuration & fix the spark [tomasz.szerszen] remove options from spark job server configuration & fix the spark [tomasz.szerszen] remove options from spark job server configuration & fix the spark [tomasz.szerszen] remove options from spark job server configuration & fix the spark [tomasz.szerszen] remove options from spark job server configuration & fix the spark [sychen] Fix checkStyle error; add a condition to disable autosharding for JRH [sychen] Fail jobs that would otherwise fall back to the default implementation [sychen] Fix failed test; update checkArgument logs. [tomasz.szerszen.poczta] minor cleanup [tomasz.szerszen.poczta] minor cleanup [tomasz.szerszen.poczta] minor improvments [tomasz.szerszen.poczta] remove whitespace changes [tomasz.szerszen.poczta] remove whitespace changes [tysonjh] Bump Dataflow worker container version. ------------------------------------------ [...truncated 2.12 KB...] [EnvInject] - Variables injected successfully. [Gradle] - Launching build. [src] $ <https://ci-beam.apache.org/job/beam_PostCommit_Java_ValidatesRunner_SparkStructuredStreaming/ws/src/gradlew> --continue --max-workers=12 -Dorg.gradle.jvmargs=-Xms2g -Dorg.gradle.jvmargs=-Xmx4g -Pdocker-pull-licenses :runners:spark:validatesStructuredStreamingRunnerBatch Starting a Gradle Daemon, 1 busy Daemon could not be reused, use --status for details > Task :buildSrc:compileJava NO-SOURCE > Task :buildSrc:compileGroovy FROM-CACHE > Task :buildSrc:pluginDescriptors > Task :buildSrc:processResources > Task :buildSrc:classes > Task :buildSrc:jar > Task :buildSrc:assemble > Task :buildSrc:spotlessGroovy FROM-CACHE > Task :buildSrc:spotlessGroovyCheck UP-TO-DATE > Task :buildSrc:spotlessGroovyGradle FROM-CACHE > Task :buildSrc:spotlessGroovyGradleCheck UP-TO-DATE > Task :buildSrc:spotlessCheck UP-TO-DATE > Task :buildSrc:pluginUnderTestMetadata > Task :buildSrc:compileTestJava NO-SOURCE > Task :buildSrc:compileTestGroovy NO-SOURCE > Task :buildSrc:processTestResources NO-SOURCE > Task :buildSrc:testClasses UP-TO-DATE > Task :buildSrc:test NO-SOURCE > Task :buildSrc:validatePlugins FROM-CACHE > Task :buildSrc:check UP-TO-DATE > Task :buildSrc:build Configuration on demand is an incubating feature. > Task :runners:core-construction-java:createCheckerFrameworkManifest > Task :sdks:java:harness:createCheckerFrameworkManifest > Task :model:pipeline:createCheckerFrameworkManifest > Task :sdks:java:core:createCheckerFrameworkManifest > Task :model:fn-execution:createCheckerFrameworkManifest > Task :sdks:java:fn-execution:createCheckerFrameworkManifest > Task :vendor:sdks-java-extensions-protobuf:createCheckerFrameworkManifest > Task :runners:java-fn-execution:createCheckerFrameworkManifest > Task > :sdks:java:extensions:google-cloud-platform-core:createCheckerFrameworkManifest > Task :model:job-management:createCheckerFrameworkManifest > Task :runners:core-java:createCheckerFrameworkManifest > Task :examples:java:createCheckerFrameworkManifest > Task :sdks:java:core:generateAvroProtocol NO-SOURCE > Task :sdks:java:extensions:google-cloud-platform-core:processResources > NO-SOURCE > Task :runners:core-java:processResources NO-SOURCE > Task :runners:core-construction-java:processResources NO-SOURCE > Task :vendor:sdks-java-extensions-protobuf:processResources NO-SOURCE > Task :runners:java-fn-execution:processResources NO-SOURCE > Task :sdks:java:fn-execution:processResources NO-SOURCE > Task :sdks:java:harness:processResources NO-SOURCE > Task :sdks:java:expansion-service:createCheckerFrameworkManifest > Task :examples:java:processResources NO-SOURCE > Task :sdks:java:core:generateAvroJava NO-SOURCE > Task :sdks:java:expansion-service:processResources NO-SOURCE > Task :runners:core-java:processTestResources NO-SOURCE > Task :sdks:java:extensions:ml:createCheckerFrameworkManifest > Task :sdks:java:extensions:ml:processResources NO-SOURCE > Task :model:job-management:extractProto > Task :model:fn-execution:extractProto > Task :examples:java:processTestResources > Task :runners:local-java:createCheckerFrameworkManifest > Task :runners:local-java:processResources NO-SOURCE > Task :sdks:java:extensions:protobuf:createCheckerFrameworkManifest > Task :sdks:java:io:google-cloud-platform:createCheckerFrameworkManifest > Task :runners:direct-java:createCheckerFrameworkManifest > Task :runners:spark:createCheckerFrameworkManifest > Task :runners:java-job-service:createCheckerFrameworkManifest > Task :model:job-management:processResources > Task :runners:direct-java:processResources NO-SOURCE > Task :sdks:java:io:kafka:createCheckerFrameworkManifest > Task :sdks:java:io:google-cloud-platform:processResources NO-SOURCE > Task :sdks:java:extensions:protobuf:extractProto > Task :sdks:java:io:hadoop-format:createCheckerFrameworkManifest > Task :sdks:java:io:hadoop-common:createCheckerFrameworkManifest > Task :sdks:java:io:kafka:processResources NO-SOURCE > Task :runners:java-job-service:processResources NO-SOURCE > Task :sdks:java:extensions:protobuf:processResources NO-SOURCE > Task :sdks:java:io:hadoop-format:processResources NO-SOURCE > Task :sdks:java:io:hadoop-common:processResources NO-SOURCE > Task :sdks:java:io:common:createCheckerFrameworkManifest > Task :sdks:java:io:jdbc:createCheckerFrameworkManifest > Task :runners:spark:processResources > Task :model:fn-execution:processResources > Task :sdks:java:testing:test-utils:createCheckerFrameworkManifest > Task :sdks:java:testing:test-utils:processResources NO-SOURCE > Task :sdks:java:io:hadoop-format:processTestResources > Task :sdks:java:io:common:compileJava NO-SOURCE > Task :sdks:java:io:common:processResources NO-SOURCE > Task :sdks:java:io:common:classes UP-TO-DATE > Task :runners:spark:processTestResources > Task :sdks:java:testing:test-utils:processTestResources NO-SOURCE > Task :sdks:java:io:jdbc:processResources NO-SOURCE > Task :sdks:java:io:common:jar > Task :sdks:java:io:common:processTestResources NO-SOURCE > Task :sdks:java:core:generateGrammarSource FROM-CACHE > Task :sdks:java:core:processResources > Task :sdks:java:core:generateTestAvroProtocol NO-SOURCE > Task :sdks:java:core:generateTestAvroJava > Task :sdks:java:core:generateTestGrammarSource NO-SOURCE > Task :sdks:java:core:processTestResources > Task :model:pipeline:extractIncludeProto > Task :model:pipeline:extractProto > Task :model:pipeline:generateProto FROM-CACHE > Task :model:pipeline:compileJava FROM-CACHE > Task :model:pipeline:processResources > Task :model:pipeline:classes > Task :model:pipeline:jar > Task :model:pipeline:shadowJar FROM-CACHE > Task :model:job-management:extractIncludeProto > Task :model:fn-execution:extractIncludeProto > Task :model:job-management:generateProto FROM-CACHE > Task :model:fn-execution:generateProto FROM-CACHE > Task :model:job-management:compileJava FROM-CACHE > Task :model:job-management:classes > Task :model:fn-execution:compileJava FROM-CACHE > Task :model:fn-execution:classes > Task :model:job-management:shadowJar FROM-CACHE > Task :model:fn-execution:shadowJar FROM-CACHE > Task :sdks:java:core:compileJava FROM-CACHE > Task :sdks:java:core:classes > Task :sdks:java:core:shadowJar FROM-CACHE > Task :sdks:java:extensions:protobuf:extractIncludeProto > Task :sdks:java:extensions:protobuf:generateProto NO-SOURCE > Task :sdks:java:io:hadoop-common:compileJava FROM-CACHE > Task :runners:local-java:compileJava FROM-CACHE > Task :sdks:java:io:common:compileTestJava FROM-CACHE > Task :sdks:java:testing:test-utils:compileJava FROM-CACHE > Task :sdks:java:io:hadoop-common:classes UP-TO-DATE > Task :runners:local-java:classes UP-TO-DATE > Task :sdks:java:testing:test-utils:classes UP-TO-DATE > Task :sdks:java:io:common:testClasses UP-TO-DATE > Task :vendor:sdks-java-extensions-protobuf:compileJava FROM-CACHE > Task :vendor:sdks-java-extensions-protobuf:classes UP-TO-DATE > Task :sdks:java:extensions:protobuf:compileJava FROM-CACHE > Task :sdks:java:extensions:protobuf:classes UP-TO-DATE > Task :sdks:java:io:jdbc:compileJava FROM-CACHE > Task :sdks:java:io:jdbc:classes UP-TO-DATE > Task :sdks:java:fn-execution:compileJava FROM-CACHE > Task :runners:local-java:jar > Task :sdks:java:fn-execution:classes UP-TO-DATE > Task :sdks:java:io:hadoop-common:jar > Task :sdks:java:io:common:testJar > Task :sdks:java:testing:test-utils:jar > Task :sdks:java:fn-execution:jar > Task :sdks:java:io:jdbc:jar > Task :sdks:java:extensions:protobuf:jar > Task :sdks:java:testing:test-utils:compileTestJava FROM-CACHE > Task :sdks:java:testing:test-utils:testClasses UP-TO-DATE > Task :sdks:java:testing:test-utils:testJar > Task :sdks:java:io:hadoop-format:compileJava FROM-CACHE > Task :sdks:java:io:hadoop-format:classes UP-TO-DATE > Task :sdks:java:io:hadoop-format:jar > Task :runners:core-construction-java:compileJava FROM-CACHE > Task :runners:core-construction-java:classes UP-TO-DATE > Task :vendor:sdks-java-extensions-protobuf:shadowJar FROM-CACHE > Task :runners:core-construction-java:jar > Task :sdks:java:core:compileTestJava FROM-CACHE > Task :sdks:java:core:testClasses > Task :sdks:java:core:shadowTestJar FROM-CACHE > Task :runners:core-java:compileJava FROM-CACHE > Task :runners:core-java:classes UP-TO-DATE > Task :runners:core-java:jar > Task :sdks:java:extensions:google-cloud-platform-core:compileJava FROM-CACHE > Task :sdks:java:extensions:google-cloud-platform-core:classes UP-TO-DATE > Task :sdks:java:extensions:google-cloud-platform-core:jar > Task :sdks:java:harness:compileJava FROM-CACHE > Task :sdks:java:harness:classes UP-TO-DATE > Task :sdks:java:harness:jar > Task :runners:core-java:compileTestJava FROM-CACHE > Task :runners:core-java:testClasses UP-TO-DATE > Task :runners:core-java:testJar > Task :sdks:java:harness:shadowJar FROM-CACHE > Task :runners:java-fn-execution:compileJava FROM-CACHE > Task :runners:java-fn-execution:classes UP-TO-DATE > Task :runners:java-fn-execution:jar > Task :sdks:java:expansion-service:compileJava FROM-CACHE > Task :sdks:java:expansion-service:classes UP-TO-DATE > Task :sdks:java:expansion-service:jar > Task :runners:direct-java:compileJava FROM-CACHE > Task :runners:direct-java:classes UP-TO-DATE > Task :runners:java-job-service:compileJava FROM-CACHE > Task :runners:java-job-service:classes UP-TO-DATE > Task :sdks:java:extensions:ml:compileJava FROM-CACHE > Task :sdks:java:extensions:ml:classes UP-TO-DATE > Task :runners:direct-java:shadowJar FROM-CACHE > Task :sdks:java:extensions:ml:jar > Task :runners:java-job-service:jar > Task :sdks:java:io:kafka:compileJava FROM-CACHE > Task :sdks:java:io:kafka:classes UP-TO-DATE > Task :sdks:java:io:kafka:jar > Task :sdks:java:io:google-cloud-platform:compileJava FROM-CACHE > Task :sdks:java:io:google-cloud-platform:classes UP-TO-DATE > Task :sdks:java:io:google-cloud-platform:jar > Task :examples:java:compileJava FROM-CACHE > Task :examples:java:classes UP-TO-DATE > Task :examples:java:jar > Task :examples:java:compileTestJava FROM-CACHE > Task :examples:java:testClasses > Task :examples:java:testJar > Task :sdks:java:io:hadoop-format:compileTestJava FROM-CACHE > Task :sdks:java:io:hadoop-format:testClasses > Task :runners:spark:compileJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. > Task :runners:spark:classes > Task :runners:spark:jar > Task :runners:spark:compileTestJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. > Task :runners:spark:testClasses > Task :runners:spark:testJar > Task :runners:spark:validatesStructuredStreamingRunnerBatch org.apache.beam.sdk.transforms.GroupByKeyTest > org.apache.beam.sdk.transforms.GroupByKeyTest$BasicTests.testGroupByKeyWithBadEqualsHashCode FAILED org.apache.beam.sdk.Pipeline$PipelineExecutionException at GroupByKeyTest.java:452 Caused by: java.lang.IllegalAccessError at null:-1 199 tests completed, 1 failed, 2 skipped > Task :runners:spark:validatesStructuredStreamingRunnerBatch FAILED FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':runners:spark:validatesStructuredStreamingRunnerBatch'. > Process 'Gradle Test Executor 213' finished with non-zero exit value 52 This problem might be caused by incorrect test process configuration. Please refer to the test execution section in the User Manual at https://docs.gradle.org/6.8/userguide/java_testing.html#sec:test_execution * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.8/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 10m 59s 115 actionable tasks: 73 executed, 42 from cache Publishing build scan... https://gradle.com/s/l2zhf7oifpe2m Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
