See <https://ci-beam.apache.org/job/beam_PostCommit_SQL/8475/display/redirect?page=changes>
Changes: [Robert Bradshaw] Add a portable runner that renders pipelines as a dot graph. [Robert Bradshaw] Add basic tests for render runner. [Robert Bradshaw] Add the ability to pass a pipeline proto directly. [Robert Bradshaw] lint [Valentyn Tymofieiev] Fix typo. [Valentyn Tymofieiev] Serve the graph when output file is not specified. [Valentyn Tymofieiev] Serve the graph when output file is not specified. [Valentyn Tymofieiev] Fix parsing of standalone protos. [Valentyn Tymofieiev] Support reading from GCS. [Valentyn Tymofieiev] Add text logging. [Valentyn Tymofieiev] fix typo. [Valentyn Tymofieiev] Some lint and yapf. [Robert Bradshaw] Fix dot detection logic. [Robert Bradshaw] fix error detected by lint [Robert Bradshaw] Make gcs an optional dependency. [Robert Bradshaw] return rather than sys.exit [Robert Bradshaw] lint [noreply] Apply suggestions from code review [Robert Bradshaw] More cleanup, mypy. [noreply] Dask runner tests action (#24324) [Robert Bradshaw] lint ------------------------------------------ [...truncated 16.34 KB...] > Task :sdks:java:extensions:arrow:createCheckerFrameworkManifest > Task :sdks:java:io:mongodb:processResources NO-SOURCE > Task :sdks:java:core:generateGrammarSource FROM-CACHE > Task :sdks:java:io:google-cloud-platform:createCheckerFrameworkManifest > Task :sdks:java:io:hadoop-common:createCheckerFrameworkManifest > Task :sdks:java:io:google-cloud-platform:processResources NO-SOURCE > Task :sdks:java:extensions:protobuf:processResources NO-SOURCE > Task :sdks:java:extensions:arrow:processResources NO-SOURCE > Task :sdks:java:io:hadoop-common:processResources NO-SOURCE > Task :runners:core-java:processTestResources NO-SOURCE > Task :runners:direct-java:processTestResources NO-SOURCE > Task :sdks:java:io:parquet:createCheckerFrameworkManifest > Task :sdks:java:io:parquet:processResources NO-SOURCE > Task :sdks:java:io:mongodb:processTestResources NO-SOURCE > Task :sdks:java:extensions:protobuf:extractTestProto > Task :sdks:java:testing:test-utils:createCheckerFrameworkManifest > Task :sdks:java:extensions:sql:udf:createCheckerFrameworkManifest > Task :sdks:java:testing:test-utils:processResources NO-SOURCE > Task :sdks:java:io:thrift:createCheckerFrameworkManifest > Task :sdks:java:testing:test-utils:processTestResources NO-SOURCE > Task :sdks:java:io:common:createCheckerFrameworkManifest > Task :sdks:java:io:common:compileJava NO-SOURCE > Task :sdks:java:io:thrift:processResources NO-SOURCE > Task :sdks:java:io:common:processResources NO-SOURCE > Task :sdks:java:io:common:classes UP-TO-DATE > Task > :sdks:java:extensions:sql:udf-test-provider:createCheckerFrameworkManifest > Task :sdks:java:extensions:protobuf:processTestResources > Task :sdks:java:extensions:sql:udf-test-provider:processResources NO-SOURCE > Task :sdks:java:io:thrift:processTestResources > Task :sdks:java:extensions:sql:datacatalog:createCheckerFrameworkManifest > Task :sdks:java:io:common:jar > Task :sdks:java:extensions:sql:datacatalog:processResources NO-SOURCE > Task :sdks:java:extensions:sql:zetasql:createCheckerFrameworkManifest > Task :sdks:java:io:common:processTestResources NO-SOURCE > Task :sdks:java:extensions:sql:datacatalog:processTestResources NO-SOURCE > Task :sdks:java:extensions:sql:zetasql:processResources NO-SOURCE > Task :sdks:java:extensions:google-cloud-platform-core:processTestResources > NO-SOURCE > Task :sdks:java:extensions:sql:jdbc:createCheckerFrameworkManifest > Task :sdks:java:core:processResources > Task :sdks:java:core:generateTestAvroProtocol NO-SOURCE > Task :sdks:java:extensions:sql:jdbc:processResources > Task :sdks:java:extensions:sql:jdbc:processTestResources NO-SOURCE > Task :sdks:java:extensions:sql:udf:compileJava FROM-CACHE > Task :sdks:java:extensions:sql:udf:processResources NO-SOURCE > Task :sdks:java:extensions:sql:udf:classes UP-TO-DATE > Task :sdks:java:extensions:sql:udf:jar > Task :sdks:java:io:google-cloud-platform:processTestResources > Task :sdks:java:extensions:sql:udf-test-provider:compileJava FROM-CACHE > Task :sdks:java:extensions:sql:udf-test-provider:classes UP-TO-DATE > Task :sdks:java:extensions:sql:udf-test-provider:jar > Task :sdks:java:core:generateTestAvroJava > Task :sdks:java:core:generateTestGrammarSource NO-SOURCE > Task :sdks:java:core:processTestResources > Task :sdks:java:extensions:sql:copyFmppTemplatesFromCalciteCore > Task :sdks:java:extensions:sql:copyFmppTemplatesFromSrc > Task :sdks:java:extensions:sql:generateFmppSources > Task :model:pipeline:extractIncludeProto > Task :model:pipeline:extractProto > Task :model:pipeline:generateProto FROM-CACHE > Task :model:pipeline:compileJava FROM-CACHE > Task :model:pipeline:processResources > Task :model:pipeline:classes > Task :sdks:java:extensions:sql:compileJavacc Java Compiler Compiler Version 4.0 (Parser Generator) (type "javacc" with no arguments for help) Reading from file <https://ci-beam.apache.org/job/beam_PostCommit_SQL/ws/src/sdks/java/extensions/sql/build/generated/fmpp/javacc/Parser.jj> . . . Note: UNICODE_INPUT option is specified. Please make sure you create the parser/lexer using a Reader with the correct character encoding.Warning: Lookahead adequacy checking not being performed since option LOOKAHEAD is more than 1. Set option FORCE_LA_CHECK to true to force checking. > Task :model:pipeline:jar > Task :model:pipeline:shadowJar FROM-CACHE > Task :model:fn-execution:extractIncludeProto > Task :model:fn-execution:generateProto FROM-CACHE > Task :model:job-management:extractIncludeProto > Task :model:job-management:generateProto FROM-CACHE > Task :sdks:java:extensions:sql:compileJavacc File "TokenMgrError.java" does not exist. Will create one. File "ParseException.java" does not exist. Will create one. File "Token.java" does not exist. Will create one. File "SimpleCharStream.java" does not exist. Will create one. Parser generated with 0 errors and 1 warnings. > Task :model:fn-execution:compileJava FROM-CACHE > Task :model:fn-execution:classes > Task :model:job-management:compileJava FROM-CACHE > Task :model:job-management:classes > Task :sdks:java:extensions:sql:createCheckerFrameworkManifest > Task :sdks:java:extensions:sql:processResources > Task :sdks:java:extensions:sql:processTestResources > Task :model:fn-execution:shadowJar FROM-CACHE > Task :model:job-management:shadowJar FROM-CACHE > Task :sdks:java:core:compileJava FROM-CACHE > Task :sdks:java:core:classes > Task :sdks:java:core:shadowJar FROM-CACHE > Task :runners:local-java:compileJava FROM-CACHE > Task :runners:local-java:classes UP-TO-DATE > Task :runners:local-java:jar > Task :sdks:java:extensions:arrow:compileJava FROM-CACHE > Task :sdks:java:extensions:arrow:classes UP-TO-DATE > Task :sdks:java:io:common:compileTestJava FROM-CACHE > Task :sdks:java:io:common:testClasses UP-TO-DATE > Task :sdks:java:extensions:arrow:jar > Task :sdks:java:io:common:testJar > Task :sdks:java:io:mongodb:compileJava FROM-CACHE > Task :sdks:java:io:mongodb:classes UP-TO-DATE > Task :sdks:java:io:thrift:compileJava FROM-CACHE > Task :sdks:java:io:thrift:classes UP-TO-DATE > Task :sdks:java:testing:test-utils:compileJava FROM-CACHE > Task :sdks:java:extensions:join-library:compileJava FROM-CACHE > Task :sdks:java:testing:test-utils:classes UP-TO-DATE > Task :sdks:java:extensions:join-library:classes UP-TO-DATE > Task :sdks:java:io:mongodb:jar > Task :sdks:java:io:thrift:jar > Task :sdks:java:testing:test-utils:jar > Task :sdks:java:extensions:join-library:jar > Task :sdks:java:io:hadoop-common:compileJava FROM-CACHE > Task :sdks:java:io:hadoop-common:classes UP-TO-DATE > Task :sdks:java:extensions:protobuf:extractIncludeProto > Task :sdks:java:io:hadoop-common:jar > Task :sdks:java:extensions:protobuf:generateProto NO-SOURCE > Task :sdks:java:testing:test-utils:compileTestJava FROM-CACHE > Task :sdks:java:testing:test-utils:testClasses UP-TO-DATE > Task :sdks:java:testing:test-utils:testJar > Task :sdks:java:io:thrift:compileTestJava FROM-CACHE > Task :sdks:java:io:thrift:testClasses > Task :sdks:java:extensions:protobuf:compileJava FROM-CACHE > Task :sdks:java:extensions:protobuf:classes UP-TO-DATE > Task :sdks:java:io:thrift:testJar > Task :sdks:java:fn-execution:compileJava FROM-CACHE > Task :sdks:java:fn-execution:classes UP-TO-DATE > Task :sdks:java:io:parquet:compileJava FROM-CACHE > Task :sdks:java:io:parquet:classes UP-TO-DATE > Task :sdks:java:extensions:protobuf:jar > Task :sdks:java:io:parquet:jar > Task :sdks:java:fn-execution:jar > Task :runners:core-construction-java:compileJava FROM-CACHE > Task :runners:core-construction-java:classes UP-TO-DATE > Task :runners:core-construction-java:jar > Task :sdks:java:core:compileTestJava FROM-CACHE > Task :sdks:java:core:testClasses > Task :runners:core-java:compileJava FROM-CACHE > Task :runners:core-java:classes UP-TO-DATE > Task :runners:core-java:jar > Task :sdks:java:core:shadowTestJar FROM-CACHE > Task :sdks:java:harness:compileJava FROM-CACHE > Task :sdks:java:harness:classes UP-TO-DATE > Task :sdks:java:extensions:google-cloud-platform-core:compileJava FROM-CACHE > Task :sdks:java:extensions:google-cloud-platform-core:classes UP-TO-DATE > Task :sdks:java:extensions:google-cloud-platform-core:jar > Task :sdks:java:harness:jar > Task :runners:java-fn-execution:compileJava FROM-CACHE > Task :runners:java-fn-execution:classes UP-TO-DATE > Task :runners:java-fn-execution:jar > Task :runners:core-java:compileTestJava FROM-CACHE > Task :runners:core-java:testClasses UP-TO-DATE > Task :sdks:java:expansion-service:compileJava FROM-CACHE > Task :sdks:java:expansion-service:classes UP-TO-DATE > Task :sdks:java:expansion-service:jar > Task :sdks:java:extensions:google-cloud-platform-core:compileTestJava > FROM-CACHE > Task :sdks:java:extensions:google-cloud-platform-core:testClasses UP-TO-DATE > Task :runners:core-java:testJar > Task :sdks:java:extensions:google-cloud-platform-core:testJar > Task :runners:direct-java:compileJava FROM-CACHE > Task :runners:direct-java:classes UP-TO-DATE > Task :sdks:java:io:kafka:compileJava FROM-CACHE > Task :sdks:java:io:kafka:classes UP-TO-DATE > Task :sdks:java:io:kafka:jar > Task :runners:direct-java:shadowJar FROM-CACHE > Task :sdks:java:io:google-cloud-platform:compileJava FROM-CACHE > Task :sdks:java:io:google-cloud-platform:classes UP-TO-DATE > Task :runners:direct-java:compileTestJava FROM-CACHE > Task :runners:direct-java:testClasses UP-TO-DATE > Task :sdks:java:extensions:protobuf:extractIncludeTestProto > Task :sdks:java:extensions:protobuf:generateTestProto FROM-CACHE > Task :sdks:java:extensions:protobuf:compileTestJava FROM-CACHE > Task :sdks:java:extensions:protobuf:testClasses > Task :runners:direct-java:shadowTestJar FROM-CACHE > Task :sdks:java:io:google-cloud-platform:jar > Task :sdks:java:extensions:protobuf:testJar > Task :runners:direct-java:jar > Task :sdks:java:io:mongodb:compileTestJava FROM-CACHE > Task :sdks:java:io:mongodb:testClasses UP-TO-DATE > Task :sdks:java:io:mongodb:testJar > Task :sdks:java:extensions:sql:compileJava FROM-CACHE > Task :sdks:java:extensions:sql:classes > Task :sdks:java:io:google-cloud-platform:compileTestJava FROM-CACHE > Task :sdks:java:io:google-cloud-platform:testClasses > Task :sdks:java:extensions:sql:jar > Task :sdks:java:extensions:sql:jdbc:compileJava FROM-CACHE > Task :sdks:java:extensions:sql:jdbc:classes > Task :sdks:java:extensions:sql:zetasql:compileJava FROM-CACHE > Task :sdks:java:extensions:sql:zetasql:classes UP-TO-DATE > Task :sdks:java:extensions:sql:datacatalog:compileJava FROM-CACHE > Task :sdks:java:extensions:sql:datacatalog:classes UP-TO-DATE > Task :sdks:java:extensions:sql:zetasql:jar > Task :sdks:java:io:google-cloud-platform:testJar > Task :sdks:java:extensions:sql:datacatalog:compileTestJava FROM-CACHE > Task :sdks:java:extensions:sql:datacatalog:testClasses UP-TO-DATE > Task :sdks:java:extensions:sql:compileTestJava FROM-CACHE > Task :sdks:java:extensions:sql:testClasses > Task :sdks:java:extensions:sql:jdbc:compileTestJava FROM-CACHE > Task :sdks:java:extensions:sql:jdbc:testClasses UP-TO-DATE > Task :sdks:java:extensions:sql:jdbc:endToEndTest > Task :sdks:java:extensions:sql:jdbc:postCommit > Task :sdks:java:extensions:sql:datacatalog:integrationTest > Task :sdks:java:extensions:sql:hadoopVersion2102Test > Task :sdks:java:extensions:sql:datacatalog:postCommit > Task :sdks:java:extensions:sql:hadoopVersion285Test > Task :sdks:java:extensions:sql:hadoopVersion292Test > Task :sdks:java:extensions:sql:hadoopVersion324Test > Task :sdks:java:extensions:sql:hadoopVersionsTest > Task :sdks:java:extensions:sql:integrationTest org.apache.beam.sdk.extensions.sql.meta.provider.pubsub.PubsubTableProviderIT > testSQLWithBytePayload[0] FAILED com.google.api.gax.rpc.DeadlineExceededException at ApiExceptionFactory.java:94 Caused by: io.grpc.StatusRuntimeException at Status.java:535 68 tests completed, 1 failed, 1 skipped > Task :sdks:java:extensions:sql:integrationTest FAILED FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':sdks:java:extensions:sql:integrationTest'. > There were failing tests. See the report at: > file://<https://ci-beam.apache.org/job/beam_PostCommit_SQL/ws/src/sdks/java/extensions/sql/build/reports/tests/integrationTest/index.html> * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 32m 29s 161 actionable tasks: 101 executed, 58 from cache, 2 up-to-date Publishing build scan... https://gradle.com/s/fq4a2jzstoo62 Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
