See <https://ci-beam.apache.org/job/beam_PostCommit_SQL/6588/display/redirect?page=changes>
Changes: [Etienne Chauchot] [BEAM-12591] Put Spark Structured Streaming runner sources back to main [Etienne Chauchot] [BEAM-12629] As spark DataSourceV2 is only available for spark 2, [Etienne Chauchot] [BEAM-12627] Deal with spark Encoders braking change between spark 2 and [Etienne Chauchot] [BEAM-12591] move SchemaHelpers to correct package [Etienne Chauchot] [BEAM-8470] Disable wait for termination in a streaming pipeline because [Etienne Chauchot] [BEAM-12630] Deal with breaking change in streaming pipelines start by [Etienne Chauchot] [BEAM-12629] Make source tests spark version agnostic and move them back [Etienne Chauchot] [BEAM-12629] Make a spark 3 source impl [Etienne Chauchot] [BEAM-12591] Fix checkstyle and spotless [Etienne Chauchot] [BEAM-12629] Reduce serializable to only needed classes and Fix schema [Etienne Chauchot] [BEAM-12591] Add checkstyle exceptions for version specific classes [Etienne Chauchot] [BEAM-12629] Fix sources javadocs and improve impl [Etienne Chauchot] [BEAM-12591] Add spark 3 to structured streaming validates runner tests [noreply] [BEAM-6516] Fixes race condition in RabbitMqIO causing duplicate acks ------------------------------------------ [...truncated 14.10 KB...] > Task :sdks:java:io:hadoop-common:createCheckerFrameworkManifest > Task :sdks:java:io:kafka:createCheckerFrameworkManifest > Task :sdks:java:expansion-service:createCheckerFrameworkManifest > Task :sdks:java:io:google-cloud-platform:createCheckerFrameworkManifest > Task :sdks:java:expansion-service:processResources NO-SOURCE > Task :sdks:java:io:kafka:processResources NO-SOURCE > Task :sdks:java:extensions:arrow:processResources NO-SOURCE > Task :sdks:java:io:google-cloud-platform:processResources NO-SOURCE > Task :sdks:java:extensions:join-library:processResources NO-SOURCE > Task :sdks:java:io:hadoop-common:processResources NO-SOURCE > Task :sdks:java:io:parquet:createCheckerFrameworkManifest > Task :sdks:java:extensions:protobuf:extractProto > Task :sdks:java:io:mongodb:createCheckerFrameworkManifest > Task :sdks:java:extensions:sql:udf:createCheckerFrameworkManifest > Task :model:job-management:processResources > Task :sdks:java:io:parquet:processResources NO-SOURCE > Task :sdks:java:extensions:protobuf:processResources NO-SOURCE > Task :sdks:java:io:mongodb:processResources NO-SOURCE > Task :model:fn-execution:processResources > Task :sdks:java:io:mongodb:processTestResources NO-SOURCE > Task :sdks:java:core:generateGrammarSource FROM-CACHE > Task :sdks:java:io:thrift:createCheckerFrameworkManifest > Task :sdks:java:io:common:createCheckerFrameworkManifest > Task :sdks:java:extensions:sql:zetasql:createCheckerFrameworkManifest > Task :sdks:java:testing:test-utils:createCheckerFrameworkManifest > Task :sdks:java:extensions:google-cloud-platform-core:processTestResources > NO-SOURCE > Task :sdks:java:io:common:compileJava NO-SOURCE > Task :sdks:java:extensions:sql:zetasql:processResources NO-SOURCE > Task :sdks:java:testing:test-utils:processResources NO-SOURCE > Task :sdks:java:io:thrift:processResources NO-SOURCE > Task :sdks:java:extensions:protobuf:extractTestProto > Task :sdks:java:extensions:sql:datacatalog:createCheckerFrameworkManifest > Task > :sdks:java:extensions:sql:udf-test-provider:createCheckerFrameworkManifest > Task :sdks:java:extensions:sql:datacatalog:processResources NO-SOURCE > Task :sdks:java:testing:test-utils:processTestResources NO-SOURCE > Task :sdks:java:io:common:processResources NO-SOURCE > Task :sdks:java:io:common:classes UP-TO-DATE > Task :sdks:java:extensions:sql:datacatalog:processTestResources NO-SOURCE > Task :sdks:java:extensions:sql:jdbc:createCheckerFrameworkManifest > Task :sdks:java:io:common:jar > Task :sdks:java:extensions:sql:udf-test-provider:processResources NO-SOURCE > Task :sdks:java:io:thrift:processTestResources > Task :sdks:java:extensions:protobuf:processTestResources > Task :sdks:java:io:common:processTestResources NO-SOURCE > Task :sdks:java:core:processResources > Task :sdks:java:core:generateTestAvroProtocol NO-SOURCE > Task :sdks:java:extensions:sql:udf:compileJava FROM-CACHE > Task :sdks:java:extensions:sql:udf:processResources NO-SOURCE > Task :sdks:java:extensions:sql:udf:classes UP-TO-DATE > Task :sdks:java:extensions:sql:jdbc:processResources > Task :sdks:java:extensions:sql:jdbc:processTestResources NO-SOURCE > Task :sdks:java:extensions:sql:udf:jar > Task :sdks:java:io:google-cloud-platform:processTestResources > Task :sdks:java:extensions:sql:udf-test-provider:compileJava FROM-CACHE > Task :sdks:java:extensions:sql:udf-test-provider:classes UP-TO-DATE > Task :sdks:java:extensions:sql:udf-test-provider:jar > Task :model:pipeline:extractIncludeProto > Task :model:pipeline:extractProto > Task :sdks:java:extensions:sql:copyFmppTemplatesFromCalciteCore > Task :model:pipeline:generateProto FROM-CACHE > Task :sdks:java:extensions:sql:copyFmppTemplatesFromSrc > Task :sdks:java:core:generateTestAvroJava > Task :sdks:java:core:generateTestGrammarSource NO-SOURCE > Task :sdks:java:core:processTestResources > Task :sdks:java:extensions:sql:generateFmppSources > Task :model:pipeline:compileJava FROM-CACHE > Task :model:pipeline:processResources > Task :model:pipeline:classes > Task :model:pipeline:jar > Task :sdks:java:extensions:sql:compileJavacc Java Compiler Compiler Version 4.0 (Parser Generator) (type "javacc" with no arguments for help) Reading from file <https://ci-beam.apache.org/job/beam_PostCommit_SQL/ws/src/sdks/java/extensions/sql/build/generated/fmpp/javacc/Parser.jj> . . . Note: UNICODE_INPUT option is specified. Please make sure you create the parser/lexer using a Reader with the correct character encoding. Warning: Lookahead adequacy checking not being performed since option LOOKAHEAD is more than 1. Set option FORCE_LA_CHECK to true to force checking. > Task :model:pipeline:shadowJar FROM-CACHE > Task :model:job-management:extractIncludeProto > Task :model:job-management:generateProto FROM-CACHE > Task :sdks:java:extensions:sql:compileJavacc File "TokenMgrError.java" does not exist. Will create one. File "ParseException.java" does not exist. Will create one. File "Token.java" does not exist. Will create one. File "SimpleCharStream.java" does not exist. Will create one. Parser generated with 0 errors and 1 warnings. > Task :model:fn-execution:extractIncludeProto > Task :model:fn-execution:generateProto FROM-CACHE > Task :sdks:java:extensions:sql:createCheckerFrameworkManifest > Task :sdks:java:extensions:sql:processResources > Task :sdks:java:extensions:sql:emptyJar > Task :sdks:java:extensions:sql:processTestResources > Task :model:fn-execution:compileJava FROM-CACHE > Task :model:fn-execution:classes > Task :model:job-management:compileJava FROM-CACHE > Task :model:job-management:classes > Task :model:job-management:shadowJar FROM-CACHE > Task :model:fn-execution:shadowJar FROM-CACHE > Task :sdks:java:core:compileJava FROM-CACHE > Task :sdks:java:core:classes > Task :sdks:java:core:shadowJar FROM-CACHE > Task :sdks:java:extensions:join-library:compileJava FROM-CACHE > Task :sdks:java:extensions:join-library:classes UP-TO-DATE > Task :sdks:java:io:hadoop-common:compileJava FROM-CACHE > Task :sdks:java:io:hadoop-common:classes UP-TO-DATE > Task :runners:local-java:compileJava FROM-CACHE > Task :runners:local-java:classes UP-TO-DATE > Task :sdks:java:io:common:compileTestJava FROM-CACHE > Task :sdks:java:io:common:testClasses UP-TO-DATE > Task :sdks:java:extensions:arrow:compileJava FROM-CACHE > Task :sdks:java:extensions:arrow:classes UP-TO-DATE > Task :sdks:java:io:mongodb:compileJava FROM-CACHE > Task :sdks:java:io:mongodb:classes UP-TO-DATE > Task :sdks:java:io:thrift:compileJava FROM-CACHE > Task :sdks:java:extensions:arrow:jar > Task :sdks:java:io:thrift:classes UP-TO-DATE > Task :sdks:java:testing:test-utils:compileJava FROM-CACHE > Task :sdks:java:testing:test-utils:classes UP-TO-DATE > Task :sdks:java:fn-execution:compileJava FROM-CACHE > Task :sdks:java:fn-execution:classes UP-TO-DATE > Task :sdks:java:io:common:testJar > Task :runners:local-java:jar > Task :sdks:java:io:hadoop-common:jar > Task :sdks:java:testing:test-utils:jar > Task :sdks:java:io:thrift:jar > Task :sdks:java:io:mongodb:jar > Task :sdks:java:extensions:join-library:jar > Task :sdks:java:fn-execution:jar > Task :sdks:java:extensions:protobuf:extractIncludeProto > Task :sdks:java:extensions:protobuf:generateProto NO-SOURCE > Task :sdks:java:testing:test-utils:compileTestJava FROM-CACHE > Task :sdks:java:testing:test-utils:testClasses UP-TO-DATE > Task :sdks:java:testing:test-utils:testJar > Task :sdks:java:io:thrift:compileTestJava FROM-CACHE > Task :sdks:java:io:thrift:testClasses > Task :sdks:java:io:parquet:compileJava FROM-CACHE > Task :sdks:java:io:parquet:classes UP-TO-DATE > Task :sdks:java:io:parquet:jar > Task :sdks:java:extensions:protobuf:compileJava FROM-CACHE > Task :sdks:java:extensions:protobuf:classes UP-TO-DATE > Task :sdks:java:io:thrift:testJar > Task :sdks:java:io:mongodb:compileTestJava FROM-CACHE > Task :sdks:java:io:mongodb:testClasses UP-TO-DATE > Task :runners:core-construction-java:compileJava FROM-CACHE > Task :runners:core-construction-java:classes UP-TO-DATE > Task :sdks:java:io:mongodb:testJar > Task :sdks:java:extensions:protobuf:jar > Task :sdks:java:core:compileTestJava FROM-CACHE > Task :sdks:java:core:testClasses > Task :runners:core-construction-java:jar > Task :sdks:java:core:shadowTestJar FROM-CACHE > Task :runners:core-java:compileJava FROM-CACHE > Task :runners:core-java:classes UP-TO-DATE > Task :runners:core-java:jar > Task :sdks:java:extensions:google-cloud-platform-core:compileJava FROM-CACHE > Task :sdks:java:extensions:google-cloud-platform-core:classes UP-TO-DATE > Task :sdks:java:extensions:google-cloud-platform-core:jar > Task :sdks:java:harness:compileJava FROM-CACHE > Task :sdks:java:harness:classes UP-TO-DATE > Task :sdks:java:harness:jar > Task :sdks:java:extensions:google-cloud-platform-core:compileTestJava > FROM-CACHE > Task :sdks:java:extensions:google-cloud-platform-core:testClasses UP-TO-DATE > Task :sdks:java:extensions:google-cloud-platform-core:testJar > Task :sdks:java:extensions:protobuf:extractIncludeTestProto > Task :sdks:java:extensions:protobuf:generateTestProto FROM-CACHE > Task :sdks:java:extensions:protobuf:compileTestJava FROM-CACHE > Task :sdks:java:extensions:protobuf:testClasses > Task :sdks:java:extensions:protobuf:testJar > Task :sdks:java:harness:shadowJar FROM-CACHE > Task :runners:java-fn-execution:compileJava FROM-CACHE > Task :runners:java-fn-execution:classes UP-TO-DATE > Task :runners:java-fn-execution:jar > Task :sdks:java:expansion-service:compileJava FROM-CACHE > Task :sdks:java:expansion-service:classes UP-TO-DATE > Task :sdks:java:expansion-service:jar > Task :runners:direct-java:compileJava FROM-CACHE > Task :runners:direct-java:classes UP-TO-DATE > Task :sdks:java:io:kafka:compileJava FROM-CACHE > Task :sdks:java:io:kafka:classes UP-TO-DATE > Task :runners:direct-java:shadowJar FROM-CACHE > Task :sdks:java:io:kafka:jar > Task :sdks:java:io:google-cloud-platform:compileJava FROM-CACHE > Task :sdks:java:io:google-cloud-platform:classes UP-TO-DATE > Task :sdks:java:io:google-cloud-platform:jar > Task :sdks:java:io:google-cloud-platform:compileTestJava FROM-CACHE > Task :sdks:java:io:google-cloud-platform:testClasses > Task :sdks:java:extensions:sql:compileJava FROM-CACHE > Task :sdks:java:extensions:sql:classes > Task :sdks:java:io:google-cloud-platform:testJar > Task :sdks:java:extensions:sql:compileTestJava FROM-CACHE > Task :sdks:java:extensions:sql:testClasses > Task :sdks:java:extensions:sql:hadoopVersion2101Test FROM-CACHE > Task :sdks:java:extensions:sql:hadoopVersion285Test FROM-CACHE > Task :sdks:java:extensions:sql:hadoopVersion292Test FROM-CACHE > Task :sdks:java:extensions:sql:hadoopVersion321Test FROM-CACHE > Task :sdks:java:extensions:sql:hadoopVersionsTest UP-TO-DATE > Task :sdks:java:extensions:sql:integrationTest org.apache.beam.sdk.extensions.sql.meta.provider.pubsub.PubsubTableProviderIT > testSQLSelectsArrayAttributes[1] FAILED java.lang.AssertionError at PubsubTableProviderIT.java:265 org.apache.beam.sdk.extensions.sql.meta.provider.pubsub.PubsubTableProviderIT > testSQLSelectsArrayAttributes[2] FAILED java.lang.AssertionError at PubsubTableProviderIT.java:265 68 tests completed, 2 failed, 1 skipped > Task :sdks:java:extensions:sql:integrationTest FAILED > Task :sdks:java:extensions:sql:jar > Task :sdks:java:extensions:sql:jdbc:compileJava FROM-CACHE > Task :sdks:java:extensions:sql:jdbc:classes > Task :sdks:java:extensions:sql:datacatalog:compileJava FROM-CACHE > Task :sdks:java:extensions:sql:datacatalog:classes UP-TO-DATE > Task :sdks:java:extensions:sql:zetasql:compileJava FROM-CACHE > Task :sdks:java:extensions:sql:zetasql:classes UP-TO-DATE > Task :sdks:java:extensions:sql:zetasql:jar > Task :sdks:java:extensions:sql:datacatalog:compileTestJava FROM-CACHE > Task :sdks:java:extensions:sql:datacatalog:testClasses UP-TO-DATE > Task :sdks:java:extensions:sql:jdbc:compileTestJava FROM-CACHE > Task :sdks:java:extensions:sql:jdbc:testClasses UP-TO-DATE > Task :sdks:java:extensions:sql:jdbc:endToEndTest > Task :sdks:java:extensions:sql:jdbc:postCommit > Task :sdks:java:extensions:sql:datacatalog:integrationTest > Task :sdks:java:extensions:sql:datacatalog:postCommit FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':sdks:java:extensions:sql:integrationTest'. > There were failing tests. See the report at: > file://<https://ci-beam.apache.org/job/beam_PostCommit_SQL/ws/src/sdks/java/extensions/sql/build/reports/tests/integrationTest/index.html> * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 35m 55s 147 actionable tasks: 91 executed, 56 from cache Publishing build scan... https://gradle.com/s/qgmytyofk3usw Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
