See
<https://builds.apache.org/job/beam_PerformanceTests_TFRecordIOIT/1031/display/redirect?page=changes>
Changes:
[jeff] Composite transform lambdas via PTransform::compose
[github] Fix sliding time windows example documentation
[github] Update session windows Python to match description
[github] Trigger pre-commit checks
[github] Undo changes to website programming guide :rewind:
[valentyn] Fix futurize-based checker in py27-lint3 compatibility tox test
suite.
[ehudm] Pass --pubsubRooturl option to Dataflow runner.
[ankurgoenka] Add PortablePipelineOption for environment
[ankurgoenka] Lazy initializing JobBundleFactory supporting multiple type of
[amyrvold] Website publiish task and Jenkins job
[ankurgoenka] Adding environment to python portable options
[ankurgoenka] Go Changes for using configurable environment. Only docker is
supported
------------------------------------------
[...truncated 353.60 KB...]
org.apache.beam.sdk.io.tfrecord.TFRecordIOIT > writeThenReadAll STANDARD_OUT
Submitted job: 2018-09-26_17_32_10-14698969171140389714
org.apache.beam.sdk.io.tfrecord.TFRecordIOIT > writeThenReadAll STANDARD_ERROR
Sep 27, 2018 12:32:15 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel
--region=us-central1 2018-09-26_17_32_10-14698969171140389714
Sep 27, 2018 12:32:15 AM
org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-09-26_17_32_10-14698969171140389714 with 1
expected assertions.
Sep 27, 2018 12:32:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:32:10.762Z: Autoscaling is enabled for job
2018-09-26_17_32_10-14698969171140389714. The number of workers will be between
1 and 1000.
Sep 27, 2018 12:32:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:32:10.805Z: Autoscaling was automatically enabled for
job 2018-09-26_17_32_10-14698969171140389714.
Sep 27, 2018 12:32:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:32:17.570Z: Checking permissions granted to controller
Service Account.
Sep 27, 2018 12:32:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:32:24.426Z: Worker configuration: n1-standard-1 in
us-central1-b.
Sep 27, 2018 12:32:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:32:24.848Z: Expanding CoGroupByKey operations into
optimizable parts.
Sep 27, 2018 12:32:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:32:25.043Z: Expanding GroupByKey operations into
optimizable parts.
Sep 27, 2018 12:32:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:32:25.085Z: Lifting ValueCombiningMappingFns into
MergeBucketsMappingFns
Sep 27, 2018 12:32:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:32:25.382Z: Fusing adjacent ParDo, Read, Write, and
Flatten operations
Sep 27, 2018 12:32:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:32:25.429Z: Fusing consumer
PAssert$0/CreateActual/FilterActuals/Window.Assign into
Reshuffle.ViaRandomKey/Values/Values/Map
Sep 27, 2018 12:32:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:32:25.461Z: Fusing consumer
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
into Reshuffle.ViaRandomKey/Values/Values/Map
Sep 27, 2018 12:32:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:32:25.506Z: Fusing consumer
Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign into
Reshuffle.ViaRandomKey/Pair with random key
Sep 27, 2018 12:32:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:32:25.546Z: Fusing consumer
Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify into
Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign
Sep 27, 2018 12:32:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:32:25.575Z: Fusing consumer
PAssert$0/CreateActual/RewindowActuals/Window.Assign into
PAssert$0/CreateActual/Flatten.Iterables/FlattenIterables/FlatMap
Sep 27, 2018 12:32:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:32:25.613Z: Fusing consumer
PAssert$0/CreateActual/ParDo(Anonymous) into
PAssert$0/CreateActual/RewindowActuals/Window.Assign
Sep 27, 2018 12:32:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:32:25.652Z: Fusing consumer
PAssert$0/CreateActual/ExtractPane/Map into
PAssert$0/CreateActual/GatherPanes/Values/Values/Map
Sep 27, 2018 12:32:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:32:25.693Z: Fusing consumer
PAssert$0/CreateActual/Flatten.Iterables/FlattenIterables/FlatMap into
PAssert$0/CreateActual/ExtractPane/Map
Sep 27, 2018 12:32:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:32:25.740Z: Fusing consumer
View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
into
View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
Sep 27, 2018 12:32:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:32:25.788Z: Fusing consumer
View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
into
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
Sep 27, 2018 12:32:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:32:25.828Z: Fusing consumer
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
into
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
Sep 27, 2018 12:32:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:32:25.870Z: Fusing consumer
View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
into
View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
Sep 27, 2018 12:32:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:32:25.903Z: Fusing consumer
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
into
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
Sep 27, 2018 12:32:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:32:25.944Z: Fusing consumer
PAssert$0/CreateActual/GatherPanes/GroupByKey/Reify into
PAssert$0/CreateActual/GatherPanes/Window.Into()/Window.Assign
Sep 27, 2018 12:32:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:32:25.982Z: Fusing consumer
PAssert$0/CreateActual/GatherPanes/GroupByKey/GroupByWindow into
PAssert$0/CreateActual/GatherPanes/GroupByKey/Read
Sep 27, 2018 12:32:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:32:26.024Z: Fusing consumer
PAssert$0/CreateActual/GatherPanes/Values/Values/Map into
PAssert$0/CreateActual/GatherPanes/GroupByKey/GroupByWindow
Sep 27, 2018 12:32:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:32:26.068Z: Fusing consumer
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
into
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
Sep 27, 2018 12:32:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:32:26.112Z: Fusing consumer
PAssert$0/CreateActual/GatherPanes/GroupByKey/Write into
PAssert$0/CreateActual/GatherPanes/GroupByKey/Reify
Sep 27, 2018 12:32:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:32:26.153Z: Fusing consumer
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
into
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
Sep 27, 2018 12:32:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:32:26.198Z: Fusing consumer
PAssert$0/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
into
PAssert$0/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
Sep 27, 2018 12:32:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:32:26.247Z: Fusing consumer
PAssert$0/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
into
PAssert$0/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
Sep 27, 2018 12:32:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:32:26.294Z: Fusing consumer
PAssert$0/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
into
PAssert$0/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
Sep 27, 2018 12:32:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:32:26.330Z: Fusing consumer
PAssert$0/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
into
PAssert$0/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
Sep 27, 2018 12:32:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:32:26.379Z: Fusing consumer
PAssert$0/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
into
PAssert$0/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
Sep 27, 2018 12:32:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:32:26.425Z: Unzipping flatten s11 for input
s10.org.apache.beam.sdk.values.PCollection.<init>:384#dda1859988aa034b
Sep 27, 2018 12:32:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:32:26.470Z: Fusing unzipped copy of
Reshuffle.ViaRandomKey/Pair with random key, through flatten Calculate
hashcode/Flatten.PCollections, into producer Calculate hashcode/ProduceDefault
Sep 27, 2018 12:32:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:32:26.514Z: Fusing consumer
PAssert$0/CreateActual/GatherPanes/WithKeys/AddKeys/Map into
PAssert$0/CreateActual/GatherPanes/Reify.Window/ParDo(Anonymous)
Sep 27, 2018 12:32:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:32:26.553Z: Fusing consumer
PAssert$0/CreateActual/GatherPanes/Window.Into()/Window.Assign into
PAssert$0/CreateActual/GatherPanes/WithKeys/AddKeys/Map
Sep 27, 2018 12:32:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:32:26.600Z: Fusing consumer
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
into
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
Sep 27, 2018 12:32:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:32:26.640Z: Unzipping flatten s11-u90 for input
s14-reify-value27-c88
Sep 27, 2018 12:32:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:32:26.682Z: Fusing unzipped copy of
Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write, through flatten s11-u90,
into producer Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify
Sep 27, 2018 12:32:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:32:26.731Z: Fusing consumer
PAssert$0/CreateActual/GatherPanes/Reify.Window/ParDo(Anonymous) into
PAssert$0/CreateActual/FilterActuals/Window.Assign
Sep 27, 2018 12:32:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:32:26.779Z: Fusing consumer
PAssert$0/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
into
PAssert$0/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
Sep 27, 2018 12:32:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:32:26.892Z: Fusing consumer
PAssert$0/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map
into
PAssert$0/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
Sep 27, 2018 12:32:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:32:27.007Z: Fusing consumer
Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow into
Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read
Sep 27, 2018 12:32:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:32:27.056Z: Fusing consumer
Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable into
Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow
Sep 27, 2018 12:32:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:32:27.099Z: Fusing consumer
Reshuffle.ViaRandomKey/Values/Values/Map into
Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable
Sep 27, 2018 12:32:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:32:27.144Z: Fusing consumer
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
into
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
Sep 27, 2018 12:32:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:32:27.198Z: Fusing consumer
PAssert$0/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
into PAssert$0/CreateActual/ParDo(Anonymous)
Sep 27, 2018 12:32:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:32:27.259Z: Fusing consumer
PAssert$0/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
into
PAssert$0/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+PAssert$0/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
Sep 27, 2018 12:32:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:32:27.323Z: Fusing consumer
PAssert$0/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+PAssert$0/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
into
PAssert$0/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
Sep 27, 2018 12:32:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:32:27.427Z: Fusing consumer Reshuffle.ViaRandomKey/Pair
with random key into Calculate hashcode/Values/Values/Map
Sep 27, 2018 12:32:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:32:27.481Z: Fusing consumer Calculate
hashcode/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow) into Calculate
hashcode/Values/Values/Map
Sep 27, 2018 12:32:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:32:27.518Z: Fusing consumer
Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write into
Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify
Sep 27, 2018 12:32:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:32:27.551Z: Fusing consumer Calculate
hashcode/ProduceDefault into Calculate hashcode/CreateVoid/Read(CreateSource)
Sep 27, 2018 12:32:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:32:27.585Z: Fusing consumer Calculate
hashcode/Combine.perKey(Hashing)/Combine.GroupedValues/Extract into Calculate
hashcode/Combine.perKey(Hashing)/Combine.GroupedValues
Sep 27, 2018 12:32:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:32:27.624Z: Fusing consumer Calculate
hashcode/Combine.perKey(Hashing)/Combine.GroupedValues into Calculate
hashcode/Combine.perKey(Hashing)/GroupByKey/Read
Sep 27, 2018 12:32:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:32:27.668Z: Fusing consumer Calculate
hashcode/Values/Values/Map into Calculate
hashcode/Combine.perKey(Hashing)/Combine.GroupedValues/Extract
Sep 27, 2018 12:32:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:32:27.693Z: Fusing consumer Calculate
hashcode/Combine.perKey(Hashing)/GroupByKey+Calculate
hashcode/Combine.perKey(Hashing)/Combine.GroupedValues/Partial into Calculate
hashcode/WithKeys/AddKeys/Map
Sep 27, 2018 12:32:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:32:27.722Z: Fusing consumer Calculate
hashcode/Combine.perKey(Hashing)/GroupByKey/Write into Calculate
hashcode/Combine.perKey(Hashing)/GroupByKey/Reify
Sep 27, 2018 12:32:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:32:27.752Z: Fusing consumer Transform bytes to
strings/Map into TFRecordIO.Read/Read
Sep 27, 2018 12:32:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:32:27.792Z: Fusing consumer Calculate
hashcode/WithKeys/AddKeys/Map into Transform bytes to strings/Map
Sep 27, 2018 12:32:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:32:27.835Z: Fusing consumer Calculate
hashcode/Combine.perKey(Hashing)/GroupByKey/Reify into Calculate
hashcode/Combine.perKey(Hashing)/GroupByKey+Calculate
hashcode/Combine.perKey(Hashing)/Combine.GroupedValues/Partial
Sep 27, 2018 12:32:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:32:27.868Z: Fusing consumer Delete test files into
Create.Values/Read(CreateSource)
Sep 27, 2018 12:32:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:32:27.916Z: Fusing consumer
PAssert$0/WindowToken/Window.Assign into
PAssert$0/Create.Values/Read(CreateSource)
Sep 27, 2018 12:32:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:32:27.945Z: Fusing consumer
PAssert$0/VerifyAssertions/ParDo(DefaultConclude) into PAssert$0/RunChecks
Sep 27, 2018 12:32:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:32:27.993Z: Fusing consumer PAssert$0/RunChecks into
PAssert$0/WindowToken/Window.Assign
Sep 27, 2018 12:32:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:32:28.488Z: Executing operation
Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Create
Sep 27, 2018 12:32:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:32:28.571Z: Executing operation
PAssert$0/CreateActual/GatherPanes/GroupByKey/Create
Sep 27, 2018 12:32:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:32:28.654Z: Starting 1 workers in us-central1-b...
Sep 27, 2018 12:32:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:32:28.668Z: Executing operation
PAssert$0/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
Sep 27, 2018 12:32:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:32:28.715Z: Executing operation
PAssert$0/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
Sep 27, 2018 12:32:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:32:28.750Z: Executing operation
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Create
Sep 27, 2018 12:32:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:32:28.796Z: Executing operation Calculate
hashcode/Combine.perKey(Hashing)/GroupByKey/Create
Sep 27, 2018 12:32:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:32:28.835Z: Executing operation
View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Create
Sep 27, 2018 12:32:31 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:32:29.222Z: Executing operation
TFRecordIO.Read/Read+Transform bytes to strings/Map+Calculate
hashcode/WithKeys/AddKeys/Map+Calculate
hashcode/Combine.perKey(Hashing)/GroupByKey+Calculate
hashcode/Combine.perKey(Hashing)/Combine.GroupedValues/Partial+Calculate
hashcode/Combine.perKey(Hashing)/GroupByKey/Reify+Calculate
hashcode/Combine.perKey(Hashing)/GroupByKey/Write
Sep 27, 2018 12:32:42 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:32:41.188Z: Autoscaling: Raised the number of workers
to 0 based on the rate of progress in the currently running step(s).
Sep 27, 2018 12:33:33 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:33:31.337Z: Workers have started successfully.
Sep 27, 2018 12:33:37 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:33:37.146Z: Autoscaling: Raised the number of workers
to 1 based on the rate of progress in the currently running step(s).
Sep 27, 2018 12:33:37 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:33:37.186Z: Autoscaling: Would further reduce the
number of workers but reached the minimum number allowed for the job.
Sep 27, 2018 12:33:57 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:33:57.647Z: Executing operation Calculate
hashcode/Combine.perKey(Hashing)/GroupByKey/Close
Sep 27, 2018 12:33:57 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:33:57.766Z: Executing operation Calculate
hashcode/Combine.perKey(Hashing)/GroupByKey/Read+Calculate
hashcode/Combine.perKey(Hashing)/Combine.GroupedValues+Calculate
hashcode/Combine.perKey(Hashing)/Combine.GroupedValues/Extract+Calculate
hashcode/Values/Values/Map+Reshuffle.ViaRandomKey/Pair with random
key+Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+Calculate
hashcode/View.AsIterable/ParDo(ToIsmRecordForGlobalWindow)+Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
Sep 27, 2018 12:34:03 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:34:02.572Z: Workers have started successfully.
Sep 27, 2018 12:34:06 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:34:04.689Z: Executing operation Calculate
hashcode/View.AsIterable/CreateDataflowView
Sep 27, 2018 12:34:06 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:34:04.903Z: Executing operation Calculate
hashcode/CreateVoid/Read(CreateSource)+Calculate
hashcode/ProduceDefault+Reshuffle.ViaRandomKey/Pair with random
key+Reshuffle.ViaRandomKey/Reshuffle/Window.Into()/Window.Assign+Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Reify+Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Write
Sep 27, 2018 12:34:10 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:34:08.556Z: Executing operation
Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Close
Sep 27, 2018 12:34:10 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:34:08.657Z: Executing operation
Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/Read+Reshuffle.ViaRandomKey/Reshuffle/GroupByKey/GroupByWindow+Reshuffle.ViaRandomKey/Reshuffle/ExpandIterable+Reshuffle.ViaRandomKey/Values/Values/Map+PAssert$0/CreateActual/FilterActuals/Window.Assign+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+PAssert$0/CreateActual/GatherPanes/Reify.Window/ParDo(Anonymous)+PAssert$0/CreateActual/GatherPanes/WithKeys/AddKeys/Map+PAssert$0/CreateActual/GatherPanes/Window.Into()/Window.Assign+PAssert$0/CreateActual/GatherPanes/GroupByKey/Reify+PAssert$0/CreateActual/GatherPanes/GroupByKey/Write+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
Sep 27, 2018 12:34:17 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:34:15.286Z: Executing operation
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
Sep 27, 2018 12:34:17 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:34:15.331Z: Executing operation
PAssert$0/CreateActual/GatherPanes/GroupByKey/Close
Sep 27, 2018 12:34:17 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:34:15.382Z: Executing operation
View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
Sep 27, 2018 12:34:17 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:34:15.472Z: Executing operation
PAssert$0/CreateActual/GatherPanes/GroupByKey/Read+PAssert$0/CreateActual/GatherPanes/GroupByKey/GroupByWindow+PAssert$0/CreateActual/GatherPanes/Values/Values/Map+PAssert$0/CreateActual/ExtractPane/Map+PAssert$0/CreateActual/Flatten.Iterables/FlattenIterables/FlatMap+PAssert$0/CreateActual/RewindowActuals/Window.Assign+PAssert$0/CreateActual/ParDo(Anonymous)+PAssert$0/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map+PAssert$0/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+PAssert$0/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial+PAssert$0/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify+PAssert$0/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
Sep 27, 2018 12:34:23 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:34:21.028Z: Executing operation
View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
Sep 27, 2018 12:34:23 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:34:21.123Z: Executing operation
View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
Sep 27, 2018 12:34:23 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:34:22.211Z: Executing operation
PAssert$0/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Close
Sep 27, 2018 12:34:23 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:34:22.310Z: Executing operation
PAssert$0/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read+PAssert$0/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues+PAssert$0/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract+PAssert$0/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Values/Values/Map+PAssert$0/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)+PAssert$0/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
Sep 27, 2018 12:34:30 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:34:28.400Z: Executing operation
PAssert$0/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Close
Sep 27, 2018 12:34:30 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:34:28.474Z: Executing operation
PAssert$0/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read+PAssert$0/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow)
Sep 27, 2018 12:34:30 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:34:30.522Z: Executing operation
View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
Sep 27, 2018 12:34:30 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:34:30.712Z: Executing operation
Create.Values/Read(CreateSource)+Delete test files
Sep 27, 2018 12:43:27 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:43:24.473Z: Executing operation
PAssert$0/CreateActual/View.AsSingleton/Combine.GloballyAsSingletonView/CreateDataflowView
Sep 27, 2018 12:43:27 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:43:24.658Z: Executing operation
PAssert$0/Create.Values/Read(CreateSource)+PAssert$0/WindowToken/Window.Assign+PAssert$0/RunChecks+PAssert$0/VerifyAssertions/ParDo(DefaultConclude)
Sep 27, 2018 12:43:28 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:43:28.543Z: Cleaning up.
Sep 27, 2018 12:43:28 AM
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-09-27T00:43:28.651Z: Stopping worker pool...
STDERR:
2018-09-27 00:44:28,831 9d095e1d MainThread beam_integration_benchmark(1/1)
ERROR Error during benchmark beam_integration_benchmark
Traceback (most recent call last):
File
"<https://builds.apache.org/job/beam_PerformanceTests_TFRecordIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,>
line 695, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File
"<https://builds.apache.org/job/beam_PerformanceTests_TFRecordIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,>
line 575, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File
"<https://builds.apache.org/job/beam_PerformanceTests_TFRecordIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py";,>
line 160, in Run
job_type=job_type)
File
"<https://builds.apache.org/job/beam_PerformanceTests_TFRecordIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py";,>
line 90, in SubmitJob
assert retcode == 0, "Integration Test Failed."
AssertionError: Integration Test Failed.
2018-09-27 00:44:28,832 9d095e1d MainThread beam_integration_benchmark(1/1)
INFO Cleaning up benchmark beam_integration_benchmark
2018-09-27 00:44:28,834 9d095e1d MainThread beam_integration_benchmark(1/1)
ERROR Exception running benchmark
Traceback (most recent call last):
File
"<https://builds.apache.org/job/beam_PerformanceTests_TFRecordIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,>
line 832, in RunBenchmarkTask
RunBenchmark(spec, collector)
File
"<https://builds.apache.org/job/beam_PerformanceTests_TFRecordIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,>
line 695, in RunBenchmark
DoRunPhase(spec, collector, detailed_timer)
File
"<https://builds.apache.org/job/beam_PerformanceTests_TFRecordIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/pkb.py";,>
line 575, in DoRunPhase
samples = spec.BenchmarkRun(spec)
File
"<https://builds.apache.org/job/beam_PerformanceTests_TFRecordIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/linux_benchmarks/beam_integration_benchmark.py";,>
line 160, in Run
job_type=job_type)
File
"<https://builds.apache.org/job/beam_PerformanceTests_TFRecordIOIT/ws/PerfKitBenchmarker/perfkitbenchmarker/providers/gcp/gcp_dpb_dataflow.py";,>
line 90, in SubmitJob
assert retcode == 0, "Integration Test Failed."
AssertionError: Integration Test Failed.
2018-09-27 00:44:28,835 9d095e1d MainThread beam_integration_benchmark(1/1)
ERROR Benchmark 1/1 beam_integration_benchmark (UID:
beam_integration_benchmark0) failed. Execution will continue.
2018-09-27 00:44:28,864 9d095e1d MainThread INFO Benchmark run statuses:
---------------------------------------------------------------------------------
Name UID Status Failed
Substatus
---------------------------------------------------------------------------------
beam_integration_benchmark beam_integration_benchmark0 FAILED
---------------------------------------------------------------------------------
Success rate: 0.00% (0/1)
2018-09-27 00:44:28,865 9d095e1d MainThread INFO Complete logs can be found
at:
<https://builds.apache.org/job/beam_PerformanceTests_TFRecordIOIT/ws/runs/9d095e1d/pkb.log>
2018-09-27 00:44:28,865 9d095e1d MainThread INFO Completion statuses can be
found at:
<https://builds.apache.org/job/beam_PerformanceTests_TFRecordIOIT/ws/runs/9d095e1d/completion_statuses.json>
Build step 'Execute shell' marked build as failure
