See
<https://ci-beam.apache.org/job/beam_PostCommit_Java_Nexmark_Direct/10164/display/redirect>
Changes:
------------------------------------------
[...truncated 327.91 KB...]
2023-04-27T19:14:20.256Z Running query:WINNING_BIDS;
exportSummaryToBigQuery:true; numEvents:10000
2023-04-27T19:14:20.256Z skipping since configuration is not implemented
2023-04-27T19:14:20.256Z Running query:LOG_TO_SHARDED_FILES;
exportSummaryToBigQuery:true
2023-04-27T19:14:20.256Z skipping since configuration is not implemented
2023-04-27T19:14:20.256Z Running query:USER_SESSIONS;
exportSummaryToBigQuery:true
2023-04-27T19:14:20.256Z skipping since configuration is not implemented
2023-04-27T19:14:20.256Z Running query:PROCESSING_TIME_WINDOWS;
exportSummaryToBigQuery:true
2023-04-27T19:14:20.256Z skipping since configuration is not implemented
2023-04-27T19:14:20.256Z Running query:PORTABILITY_BATCH;
exportSummaryToBigQuery:true
2023-04-27T19:14:20.256Z skipping since configuration is not implemented
2023-04-27T19:14:20.256Z Running query:RESHUFFLE; exportSummaryToBigQuery:true
2023-04-27T19:14:20.256Z skipping since configuration is not implemented
2023-04-27T19:14:20.256Z Running query:BOUNDED_SIDE_INPUT_JOIN;
exportSummaryToBigQuery:true
==========================================================================================
Run started 2023-04-27T19:04:31.031Z and ran for PT589.224S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true
0002 query:SELECTION; exportSummaryToBigQuery:true
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true;
numEvents:10000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true;
numEvents:10000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:10000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true
0013 query:PORTABILITY_BATCH; exportSummaryToBigQuery:true
0014 query:RESHUFFLE; exportSummaryToBigQuery:true
0015 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true
0016 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 6.3 15989.8 92000
0001 4.1 24402.1 92000
0002 1.6 61804.7 351
0003 3.5 28985.5 580
0004 *** not run ***
0005 *** not run ***
0006 *** not run ***
0007 566.2 176.6 1
0008 *** not run ***
0009 *** not run ***
0010 *** not run ***
0011 *** not run ***
0012 *** not run ***
0013 *** not run ***
0014 *** not run ***
0015 *** not run ***
0016 *** not run ***
==========================================================================================
2023-04-27T19:14:20.258Z Generating 100000 events in batch mode
Apr 27, 2023 7:14:20 PM
org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO: SQL:
WITH `bid_with_side` (`auction`, `bidder`, `price`, `dateTime`, `extra`,
`side_id`) AS (SELECT `bid`.`auction`, `bid`.`bidder`, `bid`.`price`,
`bid`.`dateTime`, `bid`.`extra`, CAST(MOD(`bid`.`bidder`, 500) AS BIGINT) AS
`side_id`
FROM `beam`.`bid` AS `bid`) (SELECT `bid_with_side`.`auction`,
`bid_with_side`.`bidder`, `bid_with_side`.`price`, `bid_with_side`.`dateTime`,
`side`.`extra`
FROM `bid_with_side` AS `bid_with_side`,
`beam`.`side` AS `side`
WHERE `bid_with_side`.`side_id` = `side`.`id`)
Apr 27, 2023 7:14:20 PM
org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO: SQLPlan>
LogicalProject(auction=[$0], bidder=[$1], price=[$2], dateTime=[$3], extra=[$7])
LogicalFilter(condition=[=($5, $6)])
LogicalJoin(condition=[true], joinType=[inner])
LogicalProject(auction=[$0], bidder=[$1], price=[$2], dateTime=[$3],
extra=[$4], side_id=[CAST(MOD($1, 500)):BIGINT NOT NULL])
BeamIOSourceRel(table=[[beam, bid]])
BeamIOSourceRel(table=[[beam, side]])
Apr 27, 2023 7:14:20 PM
org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
INFO: BEAMPlan>
BeamCalcRel(expr#0..7=[{inputs}], proj#0..3=[{exprs}], extra=[$t7])
BeamCoGBKJoinRel(condition=[=($5, $6)], joinType=[inner])
BeamCalcRel(expr#0..4=[{inputs}], expr#5=[500], expr#6=[MOD($t1, $t5)],
expr#7=[CAST($t6):BIGINT NOT NULL], proj#0..4=[{exprs}], side_id=[$t7])
BeamIOSourceRel(table=[[beam, bid]])
BeamIOSourceRel(table=[[beam, side]])
2023-04-27T19:14:30.347Z Waiting for main pipeline to 'finish'
2023-04-27T19:14:30.347Z DONE SqlBoundedSideInputJoin
2023-04-27T19:14:30.347Z Running query:SESSION_SIDE_INPUT_JOIN;
exportSummaryToBigQuery:true
2023-04-27T19:14:30.348Z skipping since configuration is not implemented
==========================================================================================
Run started 2023-04-27T19:04:31.031Z and ran for PT599.317S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true
0002 query:SELECTION; exportSummaryToBigQuery:true
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true;
numEvents:10000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true;
numEvents:10000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:10000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true
0013 query:PORTABILITY_BATCH; exportSummaryToBigQuery:true
0014 query:RESHUFFLE; exportSummaryToBigQuery:true
0015 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true
0016 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 6.3 15989.8 92000
0001 4.1 24402.1 92000
0002 1.6 61804.7 351
0003 3.5 28985.5 580
0004 *** not run ***
0005 *** not run ***
0006 *** not run ***
0007 566.2 176.6 1
0008 *** not run ***
0009 *** not run ***
0010 *** not run ***
0011 *** not run ***
0012 *** not run ***
0013 *** not run ***
0014 *** not run ***
0015 9.2 10841.3 92000
0016 *** not run ***
==========================================================================================
==========================================================================================
Run started 2023-04-27T19:04:31.031Z and ran for PT599.713S
Default configuration:
{"debug":true,"query":null,"sourceType":"DIRECT","generateEventFilePathPrefix":null,"sinkType":"DEVNULL","exportSummaryToBigQuery":false,"pubSubMode":"COMBINED","pubsubMessageSerializationMethod":"CODER","sideInputType":"DIRECT","sideInputRowCount":500,"sideInputNumShards":3,"sideInputUrl":null,"sessionGap":600000,"numEvents":100000,"numEventGenerators":100,"rateShape":"SINE","firstEventRate":10000,"nextEventRate":10000,"rateUnit":"PER_SECOND","ratePeriodSec":600,"preloadSeconds":0,"streamTimeout":240,"isRateLimited":false,"useWallclockEventTime":false,"avgPersonByteSize":200,"avgAuctionByteSize":500,"avgBidByteSize":100,"hotAuctionRatio":2,"hotSellersRatio":4,"hotBiddersRatio":4,"windowSizeSec":10,"windowPeriodSec":5,"watermarkHoldbackSec":0,"numInFlightAuctions":100,"numActivePeople":1000,"coderStrategy":"HAND","cpuDelayMs":0,"diskBusyBytes":0,"auctionSkip":123,"fanout":5,"maxAuctionsWaitingTime":600,"occasionalDelaySec":3,"probDelayedEvent":0.1,"maxLogEvents":100000,"usePubsubPublishTime":false,"outOfOrderGroupSize":1,"numKeyBuckets":20000,"pardoCPUFactor":1.0}
Configurations:
Conf Description
0000 query:PASSTHROUGH; exportSummaryToBigQuery:true
0001 query:CURRENCY_CONVERSION; exportSummaryToBigQuery:true
0002 query:SELECTION; exportSummaryToBigQuery:true
0003 query:LOCAL_ITEM_SUGGESTION; exportSummaryToBigQuery:true
0004 query:AVERAGE_PRICE_FOR_CATEGORY; exportSummaryToBigQuery:true;
numEvents:10000
0005 query:HOT_ITEMS; exportSummaryToBigQuery:true
0006 query:AVERAGE_SELLING_PRICE_BY_SELLER; exportSummaryToBigQuery:true;
numEvents:10000
0007 query:HIGHEST_BID; exportSummaryToBigQuery:true
0008 query:MONITOR_NEW_USERS; exportSummaryToBigQuery:true
0009 query:WINNING_BIDS; exportSummaryToBigQuery:true; numEvents:10000
0010 query:LOG_TO_SHARDED_FILES; exportSummaryToBigQuery:true
0011 query:USER_SESSIONS; exportSummaryToBigQuery:true
0012 query:PROCESSING_TIME_WINDOWS; exportSummaryToBigQuery:true
0013 query:PORTABILITY_BATCH; exportSummaryToBigQuery:true
0014 query:RESHUFFLE; exportSummaryToBigQuery:true
0015 query:BOUNDED_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true
0016 query:SESSION_SIDE_INPUT_JOIN; exportSummaryToBigQuery:true
Performance:
Conf Runtime(sec) (Baseline) Events(/sec) (Baseline) Results
(Baseline)
0000 6.3 15989.8 92000
0001 4.1 24402.1 92000
0002 1.6 61804.7 351
0003 3.5 28985.5 580
0004 *** not run ***
0005 *** not run ***
0006 *** not run ***
0007 566.2 176.6 1
0008 *** not run ***
0009 *** not run ***
0010 *** not run ***
0011 *** not run ***
0012 *** not run ***
0013 *** not run ***
0014 *** not run ***
0015 9.2 10841.3 92000
0016 *** not run ***
==========================================================================================
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD SUCCESSFUL in 10m 21s
115 actionable tasks: 2 executed, 113 up-to-date
Build scan background action failed.
java.lang.IllegalArgumentException:
com.gradle.enterprise.gradleplugin.internal.extension.a is not an interface
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:590)
at java.lang.reflect.Proxy$ProxyClassFactory.apply(Proxy.java:557)
at java.lang.reflect.WeakCache$Factory.get(WeakCache.java:230)
at java.lang.reflect.WeakCache.get(WeakCache.java:127)
at java.lang.reflect.Proxy.getProxyClass0(Proxy.java:419)
at java.lang.reflect.Proxy.newProxyInstance(Proxy.java:719)
at
com.gradle.ProxyFactory$ProxyingInvocationHandler.createLocalProxy(ProxyFactory.java:64)
at
com.gradle.ProxyFactory$ProxyingInvocationHandler.lambda$adaptActionArg$1(ProxyFactory.java:59)
at
com.gradle.enterprise.gradleplugin.internal.extension.b$3.run(SourceFile:100)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:750)
Publishing build scan...
https://gradle.com/s/xjglrdb4wo4a2
FATAL: command execution failed
hudson.remoting.ChannelClosedException: Channel
"hudson.remoting.Channel@65515e01:apache-beam-jenkins-16": Remote call on
apache-beam-jenkins-16 failed. The channel is closing down or has closed down
at hudson.remoting.Channel.call(Channel.java:993)
at
hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:285)
at com.sun.proxy.$Proxy135.isAlive(Unknown Source)
at hudson.Launcher$RemoteLauncher$ProcImpl.isAlive(Launcher.java:1215)
at hudson.Launcher$RemoteLauncher$ProcImpl.join(Launcher.java:1207)
at hudson.Launcher$ProcStarter.join(Launcher.java:524)
at hudson.plugins.gradle.Gradle.perform(Gradle.java:321)
at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
at
hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:814)
at hudson.model.Build$BuildExecution.build(Build.java:199)
at hudson.model.Build$BuildExecution.doRun(Build.java:164)
at
hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:522)
at hudson.model.Run.execute(Run.java:1896)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:44)
at hudson.model.ResourceController.execute(ResourceController.java:101)
at hudson.model.Executor.run(Executor.java:442)
Caused by: java.io.IOException
at hudson.remoting.Channel.close(Channel.java:1470)
at hudson.remoting.Channel.close(Channel.java:1447)
at hudson.slaves.SlaveComputer.closeChannel(SlaveComputer.java:902)
at hudson.slaves.SlaveComputer.access$100(SlaveComputer.java:111)
at hudson.slaves.SlaveComputer$2.run(SlaveComputer.java:782)
at
jenkins.util.ContextResettingExecutorService$1.run(ContextResettingExecutorService.java:28)
at
jenkins.security.ImpersonatingExecutorService$1.run(ImpersonatingExecutorService.java:68)
at
java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
at
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)
at
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)
at java.base/java.lang.Thread.run(Thread.java:829)
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
ERROR: apache-beam-jenkins-16 is offline; cannot locate jdk_1.8_latest
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
