See <https://builds.apache.org/job/beam_PostCommit_Java_Nexmark_Dataflow/3036/display/redirect?page=changes>
Changes: [melissapa] Merge pull request #8836: Add Beam Katas to the website's "Learning ------------------------------------------ [...truncated 332.98 KB...] > Task :runners:google-cloud-dataflow-java:worker:windmill:compileJava > UP-TO-DATE > Task :model:pipeline:processResources UP-TO-DATE > Task :runners:google-cloud-dataflow-java:worker:windmill:processResources > UP-TO-DATE > Task :model:pipeline:classes UP-TO-DATE > Task :runners:google-cloud-dataflow-java:worker:windmill:classes UP-TO-DATE > Task :model:pipeline:jar UP-TO-DATE > Task :runners:google-cloud-dataflow-java:worker:windmill:shadowJar UP-TO-DATE > Task :model:pipeline:shadowJar UP-TO-DATE > Task :model:job-management:extractIncludeProto UP-TO-DATE > Task :model:fn-execution:extractIncludeProto UP-TO-DATE > Task :model:job-management:generateProto UP-TO-DATE > Task :model:fn-execution:generateProto UP-TO-DATE > Task :sdks:java:extensions:sql:copyFmppTemplatesFromCalciteCore UP-TO-DATE > Task :model:job-management:compileJava UP-TO-DATE > Task :model:job-management:classes UP-TO-DATE > Task :sdks:java:extensions:sql:copyFmppTemplatesFromSrc UP-TO-DATE > Task :model:fn-execution:compileJava UP-TO-DATE > Task :model:fn-execution:classes UP-TO-DATE > Task :model:job-management:shadowJar UP-TO-DATE > Task :model:fn-execution:shadowJar UP-TO-DATE > Task :sdks:java:core:compileJava UP-TO-DATE > Task :sdks:java:core:classes UP-TO-DATE > Task :sdks:java:core:shadowJar UP-TO-DATE > Task :vendor:sdks-java-extensions-protobuf:compileJava UP-TO-DATE > Task :vendor:sdks-java-extensions-protobuf:classes UP-TO-DATE > Task :sdks:java:extensions:protobuf:extractIncludeProto UP-TO-DATE > Task :runners:local-java:compileJava UP-TO-DATE > Task :sdks:java:extensions:protobuf:generateProto NO-SOURCE > Task :runners:local-java:classes UP-TO-DATE > Task :vendor:sdks-java-extensions-protobuf:shadowJar UP-TO-DATE > Task :sdks:java:extensions:join-library:compileJava UP-TO-DATE > Task :runners:local-java:jar UP-TO-DATE > Task :sdks:java:fn-execution:compileJava UP-TO-DATE > Task :sdks:java:extensions:google-cloud-platform-core:compileJava UP-TO-DATE > Task :sdks:java:fn-execution:classes UP-TO-DATE > Task :sdks:java:extensions:join-library:classes UP-TO-DATE > Task :sdks:java:extensions:protobuf:compileJava UP-TO-DATE > Task :sdks:java:extensions:google-cloud-platform-core:classes UP-TO-DATE > Task :runners:core-construction-java:compileJava UP-TO-DATE > Task :sdks:java:fn-execution:jar UP-TO-DATE > Task :sdks:java:extensions:join-library:jar UP-TO-DATE > Task :sdks:java:extensions:google-cloud-platform-core:jar UP-TO-DATE > Task :sdks:java:extensions:protobuf:classes UP-TO-DATE > Task :runners:core-construction-java:classes UP-TO-DATE > Task :sdks:java:extensions:protobuf:jar UP-TO-DATE > Task :sdks:java:io:kafka:compileJava UP-TO-DATE > Task :sdks:java:io:kafka:classes UP-TO-DATE > Task :runners:core-construction-java:jar UP-TO-DATE > Task :sdks:java:io:kafka:jar UP-TO-DATE > Task :sdks:java:testing:test-utils:compileJava UP-TO-DATE > Task :sdks:java:testing:test-utils:classes UP-TO-DATE > Task :sdks:java:testing:test-utils:jar UP-TO-DATE > Task :runners:core-java:compileJava UP-TO-DATE > Task :runners:core-java:classes UP-TO-DATE > Task :runners:core-java:jar UP-TO-DATE > Task :sdks:java:harness:compileJava UP-TO-DATE > Task :sdks:java:harness:classes UP-TO-DATE > Task :sdks:java:harness:jar UP-TO-DATE > Task :sdks:java:io:google-cloud-platform:compileJava UP-TO-DATE > Task :sdks:java:io:google-cloud-platform:classes UP-TO-DATE > Task :sdks:java:harness:shadowJar UP-TO-DATE > Task :sdks:java:io:google-cloud-platform:jar UP-TO-DATE > Task :runners:java-fn-execution:compileJava UP-TO-DATE > Task :runners:java-fn-execution:classes UP-TO-DATE > Task :runners:java-fn-execution:jar UP-TO-DATE > Task :runners:google-cloud-dataflow-java:compileJava UP-TO-DATE > Task :runners:google-cloud-dataflow-java:classes UP-TO-DATE > Task :runners:google-cloud-dataflow-java:jar UP-TO-DATE > Task :runners:direct-java:compileJava UP-TO-DATE > Task :runners:direct-java:classes UP-TO-DATE > Task :runners:direct-java:shadowJar UP-TO-DATE > Task :runners:google-cloud-dataflow-java:worker:legacy-worker:compileJava > UP-TO-DATE > Task :runners:google-cloud-dataflow-java:worker:legacy-worker:classes > UP-TO-DATE > Task :runners:google-cloud-dataflow-java:worker:legacy-worker:shadowJar > UP-TO-DATE > Task :sdks:java:extensions:sql:generateFmppSources > Task :sdks:java:extensions:sql:compileJavacc UP-TO-DATE > Task :sdks:java:extensions:sql:compileJava UP-TO-DATE > Task :sdks:java:extensions:sql:processResources UP-TO-DATE > Task :sdks:java:extensions:sql:classes UP-TO-DATE > Task :sdks:java:extensions:sql:shadowJar UP-TO-DATE > Task :sdks:java:testing:nexmark:compileJava UP-TO-DATE > Task :sdks:java:testing:nexmark:classes UP-TO-DATE > Task :sdks:java:testing:nexmark:jar UP-TO-DATE > Task :sdks:java:testing:nexmark:run SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder". SLF4J: Defaulting to no-operation (NOP) logger implementation SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details. 2019-06-17T21:14:18.639Z Running query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000 2019-06-17T21:14:18.639Z Running query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000 2019-06-17T21:14:18.639Z Running query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000 2019-06-17T21:14:18.639Z Running query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000 2019-06-17T21:14:18.639Z Running query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000 2019-06-17T21:14:18.639Z Running query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000 2019-06-17T21:14:18.639Z Running query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000 2019-06-17T21:14:18.639Z Running query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000 2019-06-17T21:14:18.639Z Running query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000 2019-06-17T21:14:18.639Z Running query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000 2019-06-17T21:14:18.639Z Running query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000 2019-06-17T21:14:18.639Z Running query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000 2019-06-17T21:14:18.639Z Running query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000 2019-06-17T21:14:18.639Z Running query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000 2019-06-17T21:14:18.639Z Running query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000 2019-06-17T21:14:18.734Z skipping since configuration is not implemented 2019-06-17T21:14:18.735Z skipping since configuration is not implemented 2019-06-17T21:14:18.735Z skipping since configuration is not implemented 2019-06-17T21:14:18.735Z skipping since configuration is not implemented 2019-06-17T21:14:18.735Z skipping since configuration is not implemented 2019-06-17T21:14:18.735Z skipping since configuration is not implemented 2019-06-17T21:14:18.736Z skipping since configuration is not implemented 2019-06-17T21:14:18.736Z skipping since configuration is not implemented 2019-06-17T21:14:18.737Z skipping since configuration is not implemented 2019-06-17T21:14:19.609Z Generating 10000000 events in batch mode 2019-06-17T21:14:19.609Z Generating 10000000 events in batch mode 2019-06-17T21:14:19.609Z Generating 10000000 events in batch mode 2019-06-17T21:14:19.609Z Generating 10000000 events in batch mode 2019-06-17T21:14:19.609Z Generating 10000000 events in batch mode 2019-06-17T21:14:19.609Z Generating 10000000 events in batch mode ========================================================================================== Run started 2019-06-17T21:14:18.432Z and ran for PT2.447S Default configuration: {"debug":true,"query":null,"sourceType":"DIRECT","sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":{"standardDays":0,"standardHours":0,"standardMinutes":10,"standardSeconds":600,"millis":600000},"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1} Configurations: Conf Description 0000 query:PASSTHROUGH; exportSummaryToBigQuery:true; numEvents:10000000 0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true; numEvents:10000000 0002 query:SELECTION; exportSummaryToBigQuery:true; numEvents:10000000 0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true; numEvents:10000000 0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true; numEvents:1000000 0005 query:HOT_ITEMS; exportSummaryToBigQuery:true; numEvents:10000000 0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true; numEvents:1000000 0007 query:HIGHEST_BID; exportSummaryToBigQuery:true; numEvents:10000000 0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true; numEvents:10000000 0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:1000000 0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true; numEvents:10000000 0011 query:USER_SESSIONS; exportSummaryToBigQuery:true; numEvents:10000000 0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true; numEvents:10000000 0013 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000 0014 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true; numEvents:10000000 Performance: Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results (Baseline) 0000 *** not run *** 0001 *** not run *** 0002 *** not run *** 0003 *** not run *** 0004 *** not run *** 0005 *** not run *** 0006 *** not run *** 0007 *** not run *** 0008 *** not run *** 0009 *** not run *** 0010 *** not run *** 0011 *** not run *** 0012 *** not run *** 0013 *** not run *** 0014 *** not run *** ========================================================================================== Exception in thread "main" java.lang.RuntimeException: org.apache.beam.sdk.extensions.sql.impl.ParseException: Unable to parse query SELECT P.name, P.city, P.state, A.id FROM Auction A INNER JOIN Person P on A.seller = P.id WHERE A.category = 10 AND (P.state = 'OR' OR P.state = 'ID' OR P.state = 'CA') at org.apache.beam.sdk.nexmark.Main.runAll(Main.java:128) at org.apache.beam.sdk.nexmark.Main.main(Main.java:415) Caused by: org.apache.beam.sdk.extensions.sql.impl.ParseException: Unable to parse query SELECT P.name, P.city, P.state, A.id FROM Auction A INNER JOIN Person P on A.seller = P.id WHERE A.category = 10 AND (P.state = 'OR' OR P.state = 'ID' OR P.state = 'CA') at org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner.convertToBeamRel(CalciteQueryPlanner.java:146) at org.apache.beam.sdk.extensions.sql.impl.BeamSqlEnv.parseQuery(BeamSqlEnv.java:101) at org.apache.beam.sdk.extensions.sql.SqlTransform.expand(SqlTransform.java:124) at org.apache.beam.sdk.extensions.sql.SqlTransform.expand(SqlTransform.java:82) at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537) at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471) at org.apache.beam.sdk.values.PCollectionTuple.apply(PCollectionTuple.java:248) at org.apache.beam.sdk.nexmark.queries.sql.SqlQuery3.expand(SqlQuery3.java:101) at org.apache.beam.sdk.nexmark.queries.sql.SqlQuery3.expand(SqlQuery3.java:69) at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537) at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471) at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:357) at org.apache.beam.sdk.nexmark.queries.NexmarkQuery.expand(NexmarkQuery.java:89) at org.apache.beam.sdk.nexmark.queries.NexmarkQuery.expand(NexmarkQuery.java:33) at org.apache.beam.sdk.Pipeline.applyInternal(Pipeline.java:537) at org.apache.beam.sdk.Pipeline.applyTransform(Pipeline.java:471) at org.apache.beam.sdk.values.PCollection.apply(PCollection.java:357) at org.apache.beam.sdk.nexmark.NexmarkLauncher.run(NexmarkLauncher.java:1160) at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:90) at org.apache.beam.sdk.nexmark.Main$Run.call(Main.java:79) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: org.apache.beam.repackaged.sql.org.apache.calcite.tools.ValidationException: java.lang.IllegalArgumentException: Class interface org.apache.beam.sdk.options.PipelineOptions missing a property named 'exportSummaryToBigQuery'. at org.apache.beam.repackaged.sql.org.apache.calcite.prepare.PlannerImpl.validate(PlannerImpl.java:190) at org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner.convertToBeamRel(CalciteQueryPlanner.java:125) ... 25 more Caused by: java.lang.IllegalArgumentException: Class interface org.apache.beam.sdk.options.PipelineOptions missing a property named 'exportSummaryToBigQuery'. at org.apache.beam.sdk.options.PipelineOptionsFactory.parseObjects(PipelineOptionsFactory.java:1608) at org.apache.beam.sdk.options.PipelineOptionsFactory.access$400(PipelineOptionsFactory.java:114) at org.apache.beam.sdk.options.PipelineOptionsFactory$Builder.as(PipelineOptionsFactory.java:297) at org.apache.beam.sdk.options.PipelineOptionsFactory$Builder.create(PipelineOptionsFactory.java:277) at org.apache.beam.sdk.extensions.sql.impl.rel.BeamEnumerableConverter.createPipelineOptions(BeamEnumerableConverter.java:138) at org.apache.beam.sdk.extensions.sql.impl.BeamCalciteTable.getStatistic(BeamCalciteTable.java:78) at org.apache.beam.repackaged.sql.org.apache.calcite.prepare.RelOptTableImpl.getMonotonicity(RelOptTableImpl.java:340) at org.apache.beam.repackaged.sql.org.apache.calcite.sql.validate.TableNamespace.getMonotonicity(TableNamespace.java:79) at org.apache.beam.repackaged.sql.org.apache.calcite.sql.validate.IdentifierNamespace.validateImpl(IdentifierNamespace.java:223) at org.apache.beam.repackaged.sql.org.apache.calcite.sql.validate.AbstractNamespace.validate(AbstractNamespace.java:84) at org.apache.beam.repackaged.sql.org.apache.calcite.sql.validate.SqlValidatorImpl.validateNamespace(SqlValidatorImpl.java:994) at org.apache.beam.repackaged.sql.org.apache.calcite.sql.validate.SqlValidatorImpl.validateQuery(SqlValidatorImpl.java:954) at org.apache.beam.repackaged.sql.org.apache.calcite.sql.validate.SqlValidatorImpl.validateFrom(SqlValidatorImpl.java:3087) at org.apache.beam.repackaged.sql.org.apache.calcite.sql.validate.SqlValidatorImpl.validateFrom(SqlValidatorImpl.java:3069) at org.apache.beam.repackaged.sql.org.apache.calcite.sql.validate.SqlValidatorImpl.validateJoin(SqlValidatorImpl.java:3131) at org.apache.beam.repackaged.sql.org.apache.calcite.sql.validate.SqlValidatorImpl.validateFrom(SqlValidatorImpl.java:3078) at org.apache.beam.repackaged.sql.org.apache.calcite.sql.validate.SqlValidatorImpl.validateSelect(SqlValidatorImpl.java:3339) at org.apache.beam.repackaged.sql.org.apache.calcite.sql.validate.SelectNamespace.validateImpl(SelectNamespace.java:60) at org.apache.beam.repackaged.sql.org.apache.calcite.sql.validate.AbstractNamespace.validate(AbstractNamespace.java:84) at org.apache.beam.repackaged.sql.org.apache.calcite.sql.validate.SqlValidatorImpl.validateNamespace(SqlValidatorImpl.java:994) at org.apache.beam.repackaged.sql.org.apache.calcite.sql.validate.SqlValidatorImpl.validateQuery(SqlValidatorImpl.java:954) at org.apache.beam.repackaged.sql.org.apache.calcite.sql.SqlSelect.validate(SqlSelect.java:216) at org.apache.beam.repackaged.sql.org.apache.calcite.sql.validate.SqlValidatorImpl.validateScopedExpression(SqlValidatorImpl.java:929) at org.apache.beam.repackaged.sql.org.apache.calcite.sql.validate.SqlValidatorImpl.validate(SqlValidatorImpl.java:633) at org.apache.beam.repackaged.sql.org.apache.calcite.prepare.PlannerImpl.validate(PlannerImpl.java:188) ... 26 more > Task :sdks:java:testing:nexmark:run FAILED FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':sdks:java:testing:nexmark:run'. > Process 'command '/usr/lib/jvm/java-8-openjdk-amd64/bin/java'' finished with > non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 6s 76 actionable tasks: 2 executed, 74 up-to-date Publishing build scan... https://gradle.com/s/47zikhpy2mtso Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
