See
<https://builds.apache.org/job/beam_PostCommit_Go_GradleBuild/248/display/redirect?page=changes>
Changes:
[herohde] [BEAM-4474] Ensure unbounded Dataflow jobs are submitted as streaming
[kedin] [SQL] Manually read rows in TestBigQuery
[robertwb] Use ByteCountingOutputStream for estimate_size.
[kedin] Add polling assertion support to TestBigQuery
[kedin] [SQL] Add Pubsub to BigQuery E2E integration test
[kedin] [SQL] Delete BeamSql
[kedin] [SQL] Rename QueryTransform to SqlTransform
[wcn] Encode position ids.
[robertwb] Explain why module namespace is modified in Cython codepath.
------------------------------------------
[...truncated 294.26 KB...]
Edges: 1: Impulse [] -> [Out: []uint8 -> {1: []uint8/bytes GLO}]
2: ParDo [In(Main): []uint8 <- {1: []uint8/bytes GLO}] -> [Out: T -> {2:
int/int[varintz] GLO}]
3: ParDo [In(Main): int <- {2: int/int[varintz] GLO}] -> [Out: int -> {3:
int/int[varintz] GLO} Out: int -> {4: int/int[varintz] GLO} Out: int -> {5:
int/int[varintz] GLO} Out: int -> {6: int/int[varintz] GLO} Out: int -> {7:
int/int[varintz] GLO}]
2018/06/12 00:17:19 Plan[plan]:
8: Impulse[0]
1: Discard
2: Discard
3: Discard
4: Discard
5: Discard
6: ParDo[beam.partitionFn] Out:[1 2 3 4 5]
7: ParDo[beam.createFn] Out:[6]
--- PASS: TestPartitionFailures (0.00s)
=== RUN TestPartitionFlattenIdentity
2018/06/12 00:17:19 Pipeline:
2018/06/12 00:17:19 Nodes: {1: []uint8/bytes GLO}
{2: int/int[varintz] GLO}
{3: int/int[varintz] GLO}
{4: int/int[varintz] GLO}
{5: int/int[varintz] GLO}
{6: []uint8/bytes GLO}
{7: int/int[varintz] GLO}
{8: int/int[varintz] GLO}
{9: int/int[varintz] GLO}
Edges: 1: Impulse [] -> [Out: []uint8 -> {1: []uint8/bytes GLO}]
2: ParDo [In(Main): []uint8 <- {1: []uint8/bytes GLO}] -> [Out: T -> {2:
int/int[varintz] GLO}]
3: ParDo [In(Main): int <- {2: int/int[varintz] GLO}] -> [Out: int -> {3:
int/int[varintz] GLO} Out: int -> {4: int/int[varintz] GLO}]
4: Flatten [In(Main): int <- {3: int/int[varintz] GLO} In(Main): int <- {4:
int/int[varintz] GLO}] -> [Out: int -> {5: int/int[varintz] GLO}]
5: Impulse [] -> [Out: []uint8 -> {6: []uint8/bytes GLO}]
6: ParDo [In(Main): []uint8 <- {6: []uint8/bytes GLO} In(Iter): T <- {5:
int/int[varintz] GLO} In(Iter): T <- {2: int/int[varintz] GLO}] -> [Out: T ->
{7: int/int[varintz] GLO} Out: T -> {8: int/int[varintz] GLO} Out: T -> {9:
int/int[varintz] GLO}]
7: ParDo [In(Main): X <- {7: int/int[varintz] GLO}] -> []
8: ParDo [In(Main): X <- {9: int/int[varintz] GLO}] -> []
2018/06/12 00:17:19 Plan[plan]:
12: Impulse[0]
13: Impulse[0]
1: ParDo[passert.failFn] Out:[]
2: Discard
3: ParDo[passert.failFn] Out:[]
4: ParDo[passert.diffFn] Out:[1 2 3]
5: wait[2] Out:4
6: buffer[6]. wait:5 Out:4
7: buffer[7]. wait:5 Out:4
8: Flatten[2]. Out:buffer[6]. wait:5 Out:4
9: ParDo[beam.partitionFn] Out:[8 8]
10: Multiplex. Out:[9 7]
11: ParDo[beam.createFn] Out:[10]
2018/06/12 00:17:19 wait[5] unblocked w/ 1 [false]
2018/06/12 00:17:19 wait[5] done
2018/06/12 00:17:19 Pipeline:
2018/06/12 00:17:19 Nodes: {1: []uint8/bytes GLO}
{2: int/int[varintz] GLO}
{3: int/int[varintz] GLO}
{4: int/int[varintz] GLO}
{5: int/int[varintz] GLO}
{6: []uint8/bytes GLO}
{7: int/int[varintz] GLO}
{8: int/int[varintz] GLO}
{9: int/int[varintz] GLO}
Edges: 1: Impulse [] -> [Out: []uint8 -> {1: []uint8/bytes GLO}]
2: ParDo [In(Main): []uint8 <- {1: []uint8/bytes GLO}] -> [Out: T -> {2:
int/int[varintz] GLO}]
3: ParDo [In(Main): int <- {2: int/int[varintz] GLO}] -> [Out: int -> {3:
int/int[varintz] GLO} Out: int -> {4: int/int[varintz] GLO}]
4: Flatten [In(Main): int <- {3: int/int[varintz] GLO} In(Main): int <- {4:
int/int[varintz] GLO}] -> [Out: int -> {5: int/int[varintz] GLO}]
5: Impulse [] -> [Out: []uint8 -> {6: []uint8/bytes GLO}]
6: ParDo [In(Main): []uint8 <- {6: []uint8/bytes GLO} In(Iter): T <- {5:
int/int[varintz] GLO} In(Iter): T <- {2: int/int[varintz] GLO}] -> [Out: T ->
{7: int/int[varintz] GLO} Out: T -> {8: int/int[varintz] GLO} Out: T -> {9:
int/int[varintz] GLO}]
7: ParDo [In(Main): X <- {7: int/int[varintz] GLO}] -> []
8: ParDo [In(Main): X <- {9: int/int[varintz] GLO}] -> []
2018/06/12 00:17:19 Plan[plan]:
12: Impulse[0]
13: Impulse[0]
1: ParDo[passert.failFn] Out:[]
2: Discard
3: ParDo[passert.failFn] Out:[]
4: ParDo[passert.diffFn] Out:[1 2 3]
5: wait[2] Out:4
6: buffer[6]. wait:5 Out:4
7: buffer[7]. wait:5 Out:4
8: Flatten[2]. Out:buffer[6]. wait:5 Out:4
9: ParDo[beam.partitionFn] Out:[8 8]
10: Multiplex. Out:[9 7]
11: ParDo[beam.createFn] Out:[10]
2018/06/12 00:17:19 wait[5] unblocked w/ 1 [false]
2018/06/12 00:17:19 wait[5] done
2018/06/12 00:17:19 Pipeline:
2018/06/12 00:17:19 Nodes: {1: []uint8/bytes GLO}
{2: int/int[varintz] GLO}
{3: int/int[varintz] GLO}
{4: int/int[varintz] GLO}
{5: int/int[varintz] GLO}
{6: int/int[varintz] GLO}
{7: int/int[varintz] GLO}
{8: int/int[varintz] GLO}
{9: int/int[varintz] GLO}
{10: int/int[varintz] GLO}
{11: []uint8/bytes GLO}
{12: int/int[varintz] GLO}
{13: int/int[varintz] GLO}
{14: int/int[varintz] GLO}
Edges: 1: Impulse [] -> [Out: []uint8 -> {1: []uint8/bytes GLO}]
2: ParDo [In(Main): []uint8 <- {1: []uint8/bytes GLO}] -> [Out: T -> {2:
int/int[varintz] GLO}]
3: ParDo [In(Main): int <- {2: int/int[varintz] GLO}] -> [Out: int -> {3:
int/int[varintz] GLO} Out: int -> {4: int/int[varintz] GLO} Out: int -> {5:
int/int[varintz] GLO} Out: int -> {6: int/int[varintz] GLO} Out: int -> {7:
int/int[varintz] GLO} Out: int -> {8: int/int[varintz] GLO} Out: int -> {9:
int/int[varintz] GLO}]
4: Flatten [In(Main): int <- {3: int/int[varintz] GLO} In(Main): int <- {4:
int/int[varintz] GLO} In(Main): int <- {5: int/int[varintz] GLO} In(Main): int
<- {6: int/int[varintz] GLO} In(Main): int <- {7: int/int[varintz] GLO}
In(Main): int <- {8: int/int[varintz] GLO} In(Main): int <- {9:
int/int[varintz] GLO}] -> [Out: int -> {10: int/int[varintz] GLO}]
5: Impulse [] -> [Out: []uint8 -> {11: []uint8/bytes GLO}]
6: ParDo [In(Main): []uint8 <- {11: []uint8/bytes GLO} In(Iter): T <- {10:
int/int[varintz] GLO} In(Iter): T <- {2: int/int[varintz] GLO}] -> [Out: T ->
{12: int/int[varintz] GLO} Out: T -> {13: int/int[varintz] GLO} Out: T -> {14:
int/int[varintz] GLO}]
7: ParDo [In(Main): X <- {12: int/int[varintz] GLO}] -> []
8: ParDo [In(Main): X <- {14: int/int[varintz] GLO}] -> []
2018/06/12 00:17:19 Plan[plan]:
12: Impulse[0]
13: Impulse[0]
1: ParDo[passert.failFn] Out:[]
2: Discard
3: ParDo[passert.failFn] Out:[]
4: ParDo[passert.diffFn] Out:[1 2 3]
5: wait[2] Out:4
6: buffer[6]. wait:5 Out:4
7: buffer[7]. wait:5 Out:4
8: Flatten[7]. Out:buffer[6]. wait:5 Out:4
9: ParDo[beam.partitionFn] Out:[8 8 8 8 8 8 8]
10: Multiplex. Out:[9 7]
11: ParDo[beam.createFn] Out:[10]
2018/06/12 00:17:19 wait[5] unblocked w/ 1 [false]
2018/06/12 00:17:19 wait[5] done
--- PASS: TestPartitionFlattenIdentity (0.00s)
=== RUN Example_metricsDeclaredAnywhere
--- PASS: Example_metricsDeclaredAnywhere (0.00s)
=== RUN Example_metricsReusable
--- PASS: Example_metricsReusable (0.00s)
PASS
coverage: 44.8% of statements
ok github.com/apache/beam/sdks/go/pkg/beam 0.016s coverage: 44.8% of
statements
=== RUN TestOptions
--- PASS: TestOptions (0.00s)
=== RUN TestKey
--- PASS: TestKey (0.00s)
=== RUN TestRegister
--- PASS: TestRegister (0.00s)
PASS
coverage: 51.5% of statements
ok github.com/apache/beam/sdks/go/pkg/beam/core/runtime 0.003s
coverage: 51.5% of statements
> Task :beam-sdks-go:test
Test for github.com/apache/beam/sdks/go/pkg/beam finished, 7 completed, 0 failed
Result of package github.com/apache/beam/sdks/go/pkg/beam/core/runtime:
Test for github.com/apache/beam/sdks/go/pkg/beam/core/runtime finished, 3
completed, 0 failed
Result of package github.com/apache/beam/sdks/go/pkg/beam/transforms/top:
=== RUN TestCombineFn3String
--- PASS: TestCombineFn3String (0.00s)
=== RUN TestCombineFn3RevString
--- PASS: TestCombineFn3RevString (0.00s)
=== RUN TestCombineFnMerge
--- PASS: TestCombineFnMerge (0.00s)
PASS
coverage: 54.8% of statements
ok github.com/apache/beam/sdks/go/pkg/beam/transforms/top 0.007s
coverage: 54.8% of statements
=== RUN TestClassOf
--- PASS: TestClassOf (0.00s)
=== RUN TestIsConcrete
--- PASS: TestIsConcrete (0.00s)
=== RUN TestIsBound
--- PASS: TestIsBound (0.00s)
=== RUN TestIsStructurallyAssignable
--- PASS: TestIsStructurallyAssignable (0.00s)
=== RUN TestBindSubstitute
--- PASS: TestBindSubstitute (0.00s)
PASS
coverage: 61.5% of statements
ok github.com/apache/beam/sdks/go/pkg/beam/core/typex 0.003s
coverage: 61.5% of statements
> Task :beam-sdks-go:test
Test for github.com/apache/beam/sdks/go/pkg/beam/transforms/top finished, 3
completed, 0 failed
Result of package github.com/apache/beam/sdks/go/pkg/beam/core/typex:
Test for github.com/apache/beam/sdks/go/pkg/beam/core/typex finished, 5
completed, 0 failed
Generating HTML test report...
Finished generating test html results (0.081 secs) into:
<https://builds.apache.org/job/beam_PostCommit_Go_GradleBuild/ws/src/sdks/go/.gogradle/reports/test>
:beam-sdks-go:test (Thread[Task worker for ':' Thread 6,5,main]) completed.
Took 21.916 secs.
FAILURE: Build completed with 4 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':beam-sdks-go-examples:resolveBuildDependencies'.
> Exception in resolution, message is:
null
Resolution stack is:
+- github.com/apache/beam/sdks/go/examples
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to
get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':beam-sdks-java-container:resolveBuildDependencies'.
> Exception in resolution, message is:
null
Resolution stack is:
+- github.com/apache/beam/sdks/java/boot
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to
get more log output. Run with --scan to get full insights.
==============================================================================
3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':beam-sdks-go-test:resolveBuildDependencies'.
> Exception in resolution, message is:
null
Resolution stack is:
+- github.com/apache/beam/sdks/go/test
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to
get more log output. Run with --scan to get full insights.
==============================================================================
4: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':beam-runners-gcp-gcemd:resolveBuildDependencies'.
> Exception in resolution, message is:
null
Resolution stack is:
+- github.com/apache/beam/runners/gcp/gcemd
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to
get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
BUILD FAILED in 2m 12s
35 actionable tasks: 35 executed
Publishing build scan...
https://gradle.com/s/4ieicq3fzsci2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
Not sending mail to unregistered user aljoscha.kret...@gmail.com
Not sending mail to unregistered user git...@alasdairhodge.co.uk
Not sending mail to unregistered user szewi...@gmail.com
Not sending mail to unregistered user ke...@google.com
Not sending mail to unregistered user w...@google.com
