Build failed in Jenkins: beam_PostCommit_Python_ValidatesContainer_Dataflow #100

[Apache Jenkins Server]

See 


--
[...truncated 92.10 KB...]

creating python_build/temp.linux-x86_64-2.7/src/core/ext/transport/inproc

creating 
python_build/temp.linux-x86_64-2.7/src/core/ext/filters/client_channel/lb_policy

creating 
python_build/temp.linux-x86_64-2.7/src/core/ext/filters/client_channel/lb_policy/grpclb

creating 
python_build/temp.linux-x86_64-2.7/src/core/ext/filters/client_channel/lb_policy/grpclb/proto

creating 
python_build/temp.linux-x86_64-2.7/src/core/ext/filters/client_channel/lb_policy/grpclb/proto/grpc

creating 
python_build/temp.linux-x86_64-2.7/src/core/ext/filters/client_channel/lb_policy/grpclb/proto/grpc/lb

creating 
python_build/temp.linux-x86_64-2.7/src/core/ext/filters/client_channel/lb_policy/grpclb/proto/grpc/lb/v1

creating 
python_build/temp.linux-x86_64-2.7/src/core/ext/filters/client_channel/resolver

creating 
python_build/temp.linux-x86_64-2.7/src/core/ext/filters/client_channel/resolver/fake

creating 
python_build/temp.linux-x86_64-2.7/src/core/ext/filters/client_channel/lb_policy/pick_first

creating 
python_build/temp.linux-x86_64-2.7/src/core/ext/filters/client_channel/lb_policy/round_robin

creating 
python_build/temp.linux-x86_64-2.7/src/core/ext/filters/client_channel/resolver/dns

creating 
python_build/temp.linux-x86_64-2.7/src/core/ext/filters/client_channel/resolver/dns/c_ares

creating 
python_build/temp.linux-x86_64-2.7/src/core/ext/filters/client_channel/resolver/dns/native

creating 
python_build/temp.linux-x86_64-2.7/src/core/ext/filters/client_channel/resolver/sockaddr

creating python_build/temp.linux-x86_64-2.7/src/core/ext/filters/load_reporting

creating python_build/temp.linux-x86_64-2.7/src/core/ext/census

creating python_build/temp.linux-x86_64-2.7/src/core/ext/filters/max_age

creating python_build/temp.linux-x86_64-2.7/src/core/ext/filters/message_size

creating python_build/temp.linux-x86_64-2.7/src/core/ext/filters/workarounds

creating python_build/temp.linux-x86_64-2.7/src/core/plugin_registry

creating python_build/temp.linux-x86_64-2.7/src/boringssl

creating python_build/temp.linux-x86_64-2.7/third_party/boringssl

creating python_build/temp.linux-x86_64-2.7/third_party/boringssl/crypto

creating python_build/temp.linux-x86_64-2.7/third_party/boringssl/crypto/asn1

creating python_build/temp.linux-x86_64-2.7/third_party/boringssl/crypto/base64

creating python_build/temp.linux-x86_64-2.7/third_party/boringssl/crypto/bio

creating 
python_build/temp.linux-x86_64-2.7/third_party/boringssl/crypto/bn_extra

creating python_build/temp.linux-x86_64-2.7/third_party/boringssl/crypto/buf

creating 
python_build/temp.linux-x86_64-2.7/third_party/boringssl/crypto/bytestring

creating python_build/temp.linux-x86_64-2.7/third_party/boringssl/crypto/chacha

creating 
python_build/temp.linux-x86_64-2.7/third_party/boringssl/crypto/cipher_extra

creating python_build/temp.linux-x86_64-2.7/third_party/boringssl/crypto/cmac

creating python_build/temp.linux-x86_64-2.7/third_party/boringssl/crypto/conf

creating 
python_build/temp.linux-x86_64-2.7/third_party/boringssl/crypto/curve25519

creating python_build/temp.linux-x86_64-2.7/third_party/boringssl/crypto/dh

creating 
python_build/temp.linux-x86_64-2.7/third_party/boringssl/crypto/digest_extra

creating python_build/temp.linux-x86_64-2.7/third_party/boringssl/crypto/dsa

creating 
python_build/temp.linux-x86_64-2.7/third_party/boringssl/crypto/ec_extra

creating python_build/temp.linux-x86_64-2.7/third_party/boringssl/crypto/ecdh

creating 
python_build/temp.linux-x86_64-2.7/third_party/boringssl/crypto/ecdsa_extra

creating python_build/temp.linux-x86_64-2.7/third_party/boringssl/crypto/engine

creating python_build/temp.linux-x86_64-2.7/third_party/boringssl/crypto/err

creating python_build/temp.linux-x86_64-2.7/third_party/boringssl/crypto/evp

creating 
python_build/temp.linux-x86_64-2.7/third_party/boringssl/crypto/fipsmodule

creating python_build/temp.linux-x86_64-2.7/third_party/boringssl/crypto/hkdf

creating python_build/temp.linux-x86_64-2.7/third_party/boringssl/crypto/lhash

creating python_build/temp.linux-x86_64-2.7/third_party/boringssl/crypto/obj

creating python_build/temp.linux-x86_64-2.7/third_party/boringssl/crypto/pem

creating python_build/temp.linux-x86_64-2.7/third_party/boringssl/crypto/pkcs7

creating python_build/temp.linux-x86_64-2.7/third_party/boringssl/crypto/pkcs8

creating 
python_build/temp.linux-x86_64-2.7/third_party/boringssl/crypto/poly1305

creating python_build/temp.linux-x86_64-2.7/third_party/boringssl/crypto/pool

creating 
python_build/temp.linux-x86_64-2.7/third_party/boringssl/crypto/rand_extra

creating python_build/temp.linux-x86_64-2.7/third_party/boringssl/crypto/rc4

creating 
python_build/temp.linux-x86_64-2.7/third_party/boringssl/crypto/rsa_extra

creating 

[jira] [Commented] (BEAM-4035) Spark validatesRunner fails, ResumeFromCheckpointStreamingTest > classMethod FAILED java.lang.NoClassDefFoundError: org/apache/zookeeper/server/NIOServerCnxnFactory

[Alan Myrvold (JIRA)]

[ 
https://issues.apache.org/jira/browse/BEAM-4035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16433380#comment-16433380
 ] 

Alan Myrvold commented on BEAM-4035:


Increasing the gatekeeper version to 3.4.11 also fixes the issue.

> Spark validatesRunner fails, ResumeFromCheckpointStreamingTest > classMethod 
> FAILED java.lang.NoClassDefFoundError: 
> org/apache/zookeeper/server/NIOServerCnxnFactory
> 
>
> Key: BEAM-4035
> URL: https://issues.apache.org/jira/browse/BEAM-4035
> Project: Beam
>  Issue Type: Bug
>  Components: runner-spark
>Reporter: Alan Myrvold
>Assignee: Alan Myrvold
>Priority: Major
>  Time Spent: 1.5h
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Jenkins build is back to normal : beam_PostCommit_Java_ValidatesRunner_Spark_Gradle #60

[Apache Jenkins Server]

See 

[jira] [Work logged] (BEAM-4035) Spark validatesRunner fails, ResumeFromCheckpointStreamingTest > classMethod FAILED java.lang.NoClassDefFoundError: org/apache/zookeeper/server/NIOServerCnxnFactory

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-4035?focusedWorklogId=89760=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-89760
 ]

ASF GitHub Bot logged work on BEAM-4035:


Author: ASF GitHub Bot
Created on: 11/Apr/18 03:46
Start Date: 11/Apr/18 03:46
Worklog Time Spent: 10m 
  Work Description: alanmyrvold commented on issue #5093: [BEAM-4035] Fix 
spark validatesrunner
URL: https://github.com/apache/beam/pull/5093#issuecomment-380318084
 
 
   Run Spark ValidatesRunner


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 89760)
Time Spent: 1.5h  (was: 1h 20m)

> Spark validatesRunner fails, ResumeFromCheckpointStreamingTest > classMethod 
> FAILED java.lang.NoClassDefFoundError: 
> org/apache/zookeeper/server/NIOServerCnxnFactory
> 
>
> Key: BEAM-4035
> URL: https://issues.apache.org/jira/browse/BEAM-4035
> Project: Beam
>  Issue Type: Bug
>  Components: runner-spark
>Reporter: Alan Myrvold
>Assignee: Alan Myrvold
>Priority: Major
>  Time Spent: 1.5h
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Jenkins build is back to normal : beam_PostCommit_Python_ValidatesContainer_Dataflow #99

[Apache Jenkins Server]

See 

Build failed in Jenkins: beam_PostCommit_Python_Verify #4656

[Apache Jenkins Server]

See 


--
[...truncated 1.04 MB...]
copying apache_beam/runners/job/manager.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/job
copying apache_beam/runners/job/utils.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/job
copying apache_beam/runners/portability/__init__.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/portability
copying apache_beam/runners/portability/fn_api_runner.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/portability
copying apache_beam/runners/portability/fn_api_runner_test.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/portability
copying apache_beam/runners/portability/universal_local_runner.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/portability
copying apache_beam/runners/portability/universal_local_runner_main.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/portability
copying apache_beam/runners/portability/universal_local_runner_test.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/portability
copying apache_beam/runners/test/__init__.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/test
copying apache_beam/runners/worker/__init__.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/bundle_processor.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/data_plane.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/data_plane_test.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/log_handler.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/log_handler_test.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/logger.pxd -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/logger.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/logger_test.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/opcounters.pxd -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/opcounters.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/opcounters_test.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/operation_specs.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/operations.pxd -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/operations.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/sdk_worker.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/sdk_worker_main.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/sdk_worker_main_test.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/sdk_worker_test.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/sideinputs.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/sideinputs_test.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/statesampler.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/statesampler_fast.pyx -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/statesampler_slow.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/statesampler_test.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/worker_id_interceptor.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/worker_id_interceptor_test.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/testing/__init__.py -> 
apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/pipeline_verifiers.py -> 
apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/pipeline_verifiers_test.py -> 
apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/test_pipeline.py -> 
apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/test_pipeline_test.py -> 
apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/test_stream.py -> 
apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/test_stream_test.py -> 
apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/test_utils.py -> 
apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/test_utils_test.py -> 
apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/util.py -> 
apache-beam-2.5.0.dev0/apache_beam/testing
copying 

[jira] [Work logged] (BEAM-3249) Use Gradle to build/release project

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-3249?focusedWorklogId=89754=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-89754
 ]

ASF GitHub Bot logged work on BEAM-3249:


Author: ASF GitHub Bot
Created on: 11/Apr/18 02:44
Start Date: 11/Apr/18 02:44
Worklog Time Spent: 10m 
  Work Description: lukecwik commented on issue #5087: [BEAM-3249, 
BEAM-4014] Automatically propagate shading configuration to test-jar
URL: https://github.com/apache/beam/pull/5087#issuecomment-380308929
 
 
   Run Java PreCommit


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 89754)
Time Spent: 10h 40m  (was: 10.5h)

> Use Gradle to build/release project
> ---
>
> Key: BEAM-3249
> URL: https://issues.apache.org/jira/browse/BEAM-3249
> Project: Beam
>  Issue Type: Improvement
>  Components: build-system, testing
>Reporter: Luke Cwik
>Assignee: Luke Cwik
>Priority: Major
>  Time Spent: 10h 40m
>  Remaining Estimate: 0h
>
> I have collected data by running several builds against master using Gradle 
> and Maven without using Gradle's support for incremental builds.
> Gradle (mins)
> min: 25.04
> max: 160.14
> median: 45.78
> average: 52.19
> stdev: 30.80
> Maven (mins)
> min: 56.86
> max: 216.55
> median: 87.93
> average: 109.10
> stdev: 48.01
> I excluded a few timeouts (240 mins) that happened during the Maven build 
> from its numbers but we can see conclusively that Gradle is about twice as 
> fast for the build when compared to Maven when run using Jenkins.
> Original dev@ thread: 
> https://lists.apache.org/thread.html/225dddcfc78f39bbb296a0d2bbef1caf37e17677c7e5573f0b6fe253@%3Cdev.beam.apache.org%3E
> The data is available here 
> https://docs.google.com/spreadsheets/d/1MHVjF-xoI49_NJqEQakUgnNIQ7Qbjzu8Y1q_h3dbF1M/edit?usp=sharing



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Build failed in Jenkins: beam_PostCommit_Python_Verify #4655

[Apache Jenkins Server]

See 


Changes:

[ccy] Update DataflowRunner to suppress duplicate system messages

[Pablo] Fixing data race in statesampler_fast.

[swegner] Decrease flink ValidatesRunner maxParallelForks from 4 to 2 in order 
to

[herohde] [BEAM-4015] Always update Go dependences in Maven build

[herohde] Update Go maven plugin

--
[...truncated 1.04 MB...]
copying apache_beam/runners/job/manager.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/job
copying apache_beam/runners/job/utils.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/job
copying apache_beam/runners/portability/__init__.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/portability
copying apache_beam/runners/portability/fn_api_runner.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/portability
copying apache_beam/runners/portability/fn_api_runner_test.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/portability
copying apache_beam/runners/portability/universal_local_runner.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/portability
copying apache_beam/runners/portability/universal_local_runner_main.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/portability
copying apache_beam/runners/portability/universal_local_runner_test.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/portability
copying apache_beam/runners/test/__init__.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/test
copying apache_beam/runners/worker/__init__.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/bundle_processor.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/data_plane.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/data_plane_test.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/log_handler.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/log_handler_test.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/logger.pxd -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/logger.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/logger_test.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/opcounters.pxd -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/opcounters.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/opcounters_test.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/operation_specs.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/operations.pxd -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/operations.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/sdk_worker.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/sdk_worker_main.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/sdk_worker_main_test.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/sdk_worker_test.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/sideinputs.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/sideinputs_test.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/statesampler.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/statesampler_fast.pyx -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/statesampler_slow.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/statesampler_test.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/worker_id_interceptor.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/worker_id_interceptor_test.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/testing/__init__.py -> 
apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/pipeline_verifiers.py -> 
apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/pipeline_verifiers_test.py -> 
apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/test_pipeline.py -> 
apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/test_pipeline_test.py -> 
apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/test_stream.py -> 
apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/test_stream_test.py -> 

Build failed in Jenkins: beam_PostCommit_Java_GradleBuild #37

[Apache Jenkins Server]

See 


Changes:

[swegner] Decrease flink ValidatesRunner maxParallelForks from 4 to 2 in order 
to

--
[...truncated 18.07 MB...]
Apr 11, 2018 2:23:12 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-11T02:23:11.415Z: Fusing consumer SpannerIO.Write/Write 
mutations to Cloud Spanner/Read information schema into SpannerIO.Write/Write 
mutations to Cloud Spanner/Create.Values/Read(CreateSource)
Apr 11, 2018 2:23:12 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-11T02:23:11.449Z: Fusing consumer SpannerIO.Write/Write 
mutations to Cloud Spanner/Schema 
View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+SpannerIO.Write/Write
 mutations to Cloud Spanner/Schema 
View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
 into SpannerIO.Write/Write mutations to Cloud Spanner/Schema 
View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
Apr 11, 2018 2:23:12 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-11T02:23:11.472Z: Fusing consumer SpannerIO.Write/Write 
mutations to Cloud Spanner/Schema 
View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
 into SpannerIO.Write/Write mutations to Cloud Spanner/Schema 
View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
Apr 11, 2018 2:23:12 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-11T02:23:11.505Z: Fusing consumer SpannerIO.Write/Write 
mutations to Cloud Spanner/Schema 
View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
 into SpannerIO.Write/Write mutations to Cloud Spanner/Schema 
View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
Apr 11, 2018 2:23:12 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-11T02:23:11.536Z: Fusing consumer SpannerIO.Write/Write 
mutations to Cloud Spanner/Schema 
View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
 into SpannerIO.Write/Write mutations to Cloud Spanner/Read information schema
Apr 11, 2018 2:23:12 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-11T02:23:11.560Z: Fusing consumer SpannerIO.Write/Write 
mutations to Cloud Spanner/Schema 
View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Write
 into SpannerIO.Write/Write mutations to Cloud Spanner/Schema 
View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
Apr 11, 2018 2:23:12 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-11T02:23:11.587Z: Fusing consumer SpannerIO.Write/Write 
mutations to Cloud Spanner/Schema 
View/Combine.GloballyAsSingletonView/ParDo(IsmRecordForSingularValuePerWindow) 
into SpannerIO.Write/Write mutations to Cloud Spanner/Schema 
View/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Read
Apr 11, 2018 2:23:12 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-11T02:23:11.620Z: Fusing consumer SpannerIO.Write/Write 
mutations to Cloud Spanner/Schema 
View/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/BatchViewOverrides.GroupByKeyAndSortValuesOnly/Write
 into SpannerIO.Write/Write mutations to Cloud Spanner/Schema 
View/Combine.GloballyAsSingletonView/BatchViewOverrides.GroupByWindowHashAsKeyAndWindowAsSortKey/ParDo(UseWindowHashAsKeyAndWindowAsSortKey)
Apr 11, 2018 2:23:12 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-11T02:23:11.644Z: Fusing consumer SpannerIO.Write/Write 
mutations to Cloud Spanner/Schema 
View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Reify
 into SpannerIO.Write/Write mutations to Cloud Spanner/Schema 
View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+SpannerIO.Write/Write
 mutations to Cloud Spanner/Schema 
View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
Apr 11, 2018 2:23:12 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-11T02:23:11.679Z: 

Build failed in Jenkins: beam_PostCommit_Java_GradleBuild #34

[Apache Jenkins Server]

See 


Changes:

[herohde] [BEAM-4015] Always update Go dependences in Maven build

[herohde] Update Go maven plugin

--
[...truncated 17.62 MB...]
Apr 11, 2018 2:21:33 AM 
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding SpannerIO.Write/Write mutations to Cloud Spanner/Partition 
input as step s27
Apr 11, 2018 2:21:33 AM 
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding SpannerIO.Write/Write mutations to Cloud Spanner/Group by 
partition as step s28
Apr 11, 2018 2:21:33 AM 
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding SpannerIO.Write/Write mutations to Cloud Spanner/Batch 
mutations together as step s29
Apr 11, 2018 2:21:33 AM 
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding SpannerIO.Write/Write mutations to Cloud Spanner/Write 
mutations to Spanner as step s30
Apr 11, 2018 2:21:33 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to 
gs://temp-storage-for-end-to-end-tests/spannerwriteit0testwrite-jenkins-0411022129-52e7b3/output/results/staging/
Apr 11, 2018 2:21:33 AM org.apache.beam.runners.dataflow.util.PackageUtil 
tryStagePackage
INFO: Uploading <80747 bytes, hash 98gswR9r25yO6ZwpNnfacQ> to 
gs://temp-storage-for-end-to-end-tests/spannerwriteit0testwrite-jenkins-0411022129-52e7b3/output/results/staging/pipeline-98gswR9r25yO6ZwpNnfacQ.pb

org.apache.beam.sdk.io.gcp.spanner.SpannerWriteIT > testWrite STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT

org.apache.beam.sdk.io.gcp.spanner.SpannerWriteIT > testWrite STANDARD_ERROR
Apr 11, 2018 2:21:34 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to 
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-04-10_19_21_33-14455536247060519508?project=apache-beam-testing

org.apache.beam.sdk.io.gcp.spanner.SpannerWriteIT > testWrite STANDARD_OUT
Submitted job: 2018-04-10_19_21_33-14455536247060519508

org.apache.beam.sdk.io.gcp.spanner.SpannerWriteIT > testWrite STANDARD_ERROR
Apr 11, 2018 2:21:34 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel 
--region=us-central1 2018-04-10_19_21_33-14455536247060519508
Apr 11, 2018 2:21:34 AM org.apache.beam.runners.dataflow.TestDataflowRunner 
run
INFO: Running Dataflow job 2018-04-10_19_21_33-14455536247060519508 with 0 
expected assertions.
Apr 11, 2018 2:21:42 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-11T02:21:33.676Z: Autoscaling is enabled for job 
2018-04-10_19_21_33-14455536247060519508. The number of workers will be between 
1 and 1000.
Apr 11, 2018 2:21:42 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-11T02:21:33.705Z: Autoscaling was automatically enabled for 
job 2018-04-10_19_21_33-14455536247060519508.
Apr 11, 2018 2:21:42 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-11T02:21:36.384Z: Checking required Cloud APIs are enabled.
Apr 11, 2018 2:21:42 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-11T02:21:36.680Z: Checking permissions granted to controller 
Service Account.
Apr 11, 2018 2:21:42 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-11T02:21:40.055Z: Worker configuration: n1-standard-1 in 
us-central1-f.
Apr 11, 2018 2:21:42 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-11T02:21:40.429Z: Expanding CoGroupByKey operations into 
optimizable parts.
Apr 11, 2018 2:21:42 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-11T02:21:40.574Z: Expanding GroupByKey operations into 
optimizable parts.
Apr 11, 2018 2:21:42 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-11T02:21:40.608Z: Lifting ValueCombiningMappingFns into 
MergeBucketsMappingFns
Apr 11, 2018 2:21:42 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-11T02:21:40.750Z: Fusing adjacent ParDo, Read, Write, and 
Flatten operations
Apr 11, 2018 2:21:42 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-11T02:21:40.786Z: Fusing consumer SpannerIO.Write/Write 
mutations to Cloud Spanner/Read information schema into SpannerIO.Write/Write 
mutations to Cloud 

Build failed in Jenkins: beam_PostCommit_Java_GradleBuild #36

[Apache Jenkins Server]

See 


Changes:

[Pablo] Fixing data race in statesampler_fast.

--
[...truncated 18.22 MB...]
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel 
--region=us-central1 2018-04-10_19_20_15-17296707280158169453
Apr 11, 2018 2:20:16 AM org.apache.beam.runners.dataflow.TestDataflowRunner 
run
INFO: Running Dataflow job 2018-04-10_19_20_15-17296707280158169453 with 0 
expected assertions.
Apr 11, 2018 2:20:26 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-11T02:20:15.993Z: Autoscaling is enabled for job 
2018-04-10_19_20_15-17296707280158169453. The number of workers will be between 
1 and 1000.
Apr 11, 2018 2:20:26 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-11T02:20:16.009Z: Autoscaling was automatically enabled for 
job 2018-04-10_19_20_15-17296707280158169453.
Apr 11, 2018 2:20:26 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-11T02:20:19.309Z: Checking required Cloud APIs are enabled.
Apr 11, 2018 2:20:26 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-11T02:20:19.613Z: Checking permissions granted to controller 
Service Account.
Apr 11, 2018 2:20:26 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-11T02:20:23.699Z: Worker configuration: n1-standard-1 in 
us-central1-f.
Apr 11, 2018 2:20:26 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-11T02:20:24.202Z: Expanding CoGroupByKey operations into 
optimizable parts.
Apr 11, 2018 2:20:26 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-11T02:20:24.455Z: Expanding GroupByKey operations into 
optimizable parts.
Apr 11, 2018 2:20:26 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-11T02:20:24.482Z: Lifting ValueCombiningMappingFns into 
MergeBucketsMappingFns
Apr 11, 2018 2:20:26 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-11T02:20:24.657Z: Fusing adjacent ParDo, Read, Write, and 
Flatten operations
Apr 11, 2018 2:20:26 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-11T02:20:24.689Z: Fusing consumer SpannerIO.Write/Write 
mutations to Cloud Spanner/Read information schema into SpannerIO.Write/Write 
mutations to Cloud Spanner/Create.Values/Read(CreateSource)
Apr 11, 2018 2:20:26 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-11T02:20:24.716Z: Fusing consumer SpannerIO.Write/Write 
mutations to Cloud Spanner/Schema 
View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey+SpannerIO.Write/Write
 mutations to Cloud Spanner/Schema 
View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Partial
 into SpannerIO.Write/Write mutations to Cloud Spanner/Schema 
View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
Apr 11, 2018 2:20:26 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-11T02:20:24.740Z: Fusing consumer SpannerIO.Write/Write 
mutations to Cloud Spanner/Schema 
View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues/Extract
 into SpannerIO.Write/Write mutations to Cloud Spanner/Schema 
View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
Apr 11, 2018 2:20:26 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-11T02:20:24.816Z: Fusing consumer SpannerIO.Write/Write 
mutations to Cloud Spanner/Schema 
View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/Combine.GroupedValues
 into SpannerIO.Write/Write mutations to Cloud Spanner/Schema 
View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/Combine.perKey(Singleton)/GroupByKey/Read
Apr 11, 2018 2:20:26 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-11T02:20:24.845Z: Fusing consumer SpannerIO.Write/Write 
mutations to Cloud Spanner/Schema 
View/Combine.GloballyAsSingletonView/Combine.globally(Singleton)/WithKeys/AddKeys/Map
 into SpannerIO.Write/Write mutations to Cloud Spanner/Read information schema
Apr 11, 2018 2:20:26 AM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-11T02:20:24.876Z: Fusing consumer 

[jira] [Work logged] (BEAM-4035) Spark validatesRunner fails, ResumeFromCheckpointStreamingTest > classMethod FAILED java.lang.NoClassDefFoundError: org/apache/zookeeper/server/NIOServerCnxnFactory

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-4035?focusedWorklogId=89751=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-89751
 ]

ASF GitHub Bot logged work on BEAM-4035:


Author: ASF GitHub Bot
Created on: 11/Apr/18 02:18
Start Date: 11/Apr/18 02:18
Worklog Time Spent: 10m 
  Work Description: alanmyrvold commented on issue #5093: Testing (don't 
submit[BEAM-4035] Fix spark validatesrunner
URL: https://github.com/apache/beam/pull/5093#issuecomment-380304811
 
 
   Passed, 
https://builds.apache.org/view/A-D/view/Beam/job/beam_PostCommit_Java_ValidatesRunner_Spark_Gradle/56/


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 89751)
Time Spent: 1h 10m  (was: 1h)

> Spark validatesRunner fails, ResumeFromCheckpointStreamingTest > classMethod 
> FAILED java.lang.NoClassDefFoundError: 
> org/apache/zookeeper/server/NIOServerCnxnFactory
> 
>
> Key: BEAM-4035
> URL: https://issues.apache.org/jira/browse/BEAM-4035
> Project: Beam
>  Issue Type: Bug
>  Components: runner-spark
>Reporter: Alan Myrvold
>Assignee: Alan Myrvold
>Priority: Major
>  Time Spent: 1h 10m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work logged] (BEAM-4035) Spark validatesRunner fails, ResumeFromCheckpointStreamingTest > classMethod FAILED java.lang.NoClassDefFoundError: org/apache/zookeeper/server/NIOServerCnxnFactory

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-4035?focusedWorklogId=89753=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-89753
 ]

ASF GitHub Bot logged work on BEAM-4035:


Author: ASF GitHub Bot
Created on: 11/Apr/18 02:18
Start Date: 11/Apr/18 02:18
Worklog Time Spent: 10m 
  Work Description: alanmyrvold commented on issue #5093: [BEAM-4035] Fix 
spark validatesrunner
URL: https://github.com/apache/beam/pull/5093#issuecomment-380304898
 
 
   +R: @lukecwik 


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 89753)
Time Spent: 1h 20m  (was: 1h 10m)

> Spark validatesRunner fails, ResumeFromCheckpointStreamingTest > classMethod 
> FAILED java.lang.NoClassDefFoundError: 
> org/apache/zookeeper/server/NIOServerCnxnFactory
> 
>
> Key: BEAM-4035
> URL: https://issues.apache.org/jira/browse/BEAM-4035
> Project: Beam
>  Issue Type: Bug
>  Components: runner-spark
>Reporter: Alan Myrvold
>Assignee: Alan Myrvold
>Priority: Major
>  Time Spent: 1h 20m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Commented] (BEAM-4035) Spark validatesRunner fails, ResumeFromCheckpointStreamingTest > classMethod FAILED java.lang.NoClassDefFoundError: org/apache/zookeeper/server/NIOServerCnxnFactory

[Alan Myrvold (JIRA)]

[ 
https://issues.apache.org/jira/browse/BEAM-4035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16433304#comment-16433304
 ] 

Alan Myrvold commented on BEAM-4035:


Removing mavenLocal from the repository spec worked. The logs on the failures 
showed the zookeeper jar was resolved from .m2.

> Spark validatesRunner fails, ResumeFromCheckpointStreamingTest > classMethod 
> FAILED java.lang.NoClassDefFoundError: 
> org/apache/zookeeper/server/NIOServerCnxnFactory
> 
>
> Key: BEAM-4035
> URL: https://issues.apache.org/jira/browse/BEAM-4035
> Project: Beam
>  Issue Type: Bug
>  Components: runner-spark
>Reporter: Alan Myrvold
>Assignee: Alan Myrvold
>Priority: Major
>  Time Spent: 1h
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Build failed in Jenkins: beam_PostCommit_Java_ValidatesRunner_Spark_Gradle #59

[Apache Jenkins Server]

See 


Changes:

[ccy] Update DataflowRunner to suppress duplicate system messages

[Pablo] Fixing data race in statesampler_fast.

[swegner] Decrease flink ValidatesRunner maxParallelForks from 4 to 2 in order 
to

--
[...truncated 1.59 MB...]
at org.apache.spark.SparkContext.(SparkContext.scala:457)
at 
org.apache.spark.api.java.JavaSparkContext.(JavaSparkContext.scala:58)
at 
org.apache.beam.runners.spark.translation.SparkContextFactory.createSparkContext(SparkContextFactory.java:103)
at 
org.apache.beam.runners.spark.translation.SparkContextFactory.getSparkContext(SparkContextFactory.java:68)
at 
org.apache.beam.runners.spark.translation.streaming.SparkRunnerStreamingContextFactory.call(SparkRunnerStreamingContextFactory.java:79)
at 
org.apache.beam.runners.spark.translation.streaming.SparkRunnerStreamingContextFactory.call(SparkRunnerStreamingContextFactory.java:47)
at 
org.apache.spark.streaming.api.java.JavaStreamingContext$$anonfun$7.apply(JavaStreamingContext.scala:627)
at 
org.apache.spark.streaming.api.java.JavaStreamingContext$$anonfun$7.apply(JavaStreamingContext.scala:626)
at scala.Option.getOrElse(Option.scala:121)
at 
org.apache.spark.streaming.StreamingContext$.getOrCreate(StreamingContext.scala:828)
at 
org.apache.spark.streaming.api.java.JavaStreamingContext$.getOrCreate(JavaStreamingContext.scala:626)
at 
org.apache.spark.streaming.api.java.JavaStreamingContext.getOrCreate(JavaStreamingContext.scala)
at org.apache.beam.runners.spark.SparkRunner.run(SparkRunner.java:169)
at 
org.apache.beam.runners.spark.TestSparkRunner.run(TestSparkRunner.java:123)
at 
org.apache.beam.runners.spark.TestSparkRunner.run(TestSparkRunner.java:83)
at org.apache.beam.sdk.Pipeline.run(Pipeline.java:311)
at org.apache.beam.sdk.testing.TestPipeline.run(TestPipeline.java:346)
at org.apache.beam.sdk.testing.TestPipeline.run(TestPipeline.java:328)
at 
org.apache.beam.runners.spark.translation.streaming.CreateStreamTest.testDiscardingMode(CreateStreamTest.java:203)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at 
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
at 
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at 
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
at 
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
at 
org.apache.beam.sdk.testing.TestPipeline$1.evaluate(TestPipeline.java:317)
at 
org.junit.rules.ExpectedException$ExpectedExceptionStatement.evaluate(ExpectedException.java:239)
at org.junit.rules.RunRules.evaluate(RunRules.java:20)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
at 
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
at 
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
at 
org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.runTestClass(JUnitTestClassExecuter.java:114)
at 
org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.execute(JUnitTestClassExecuter.java:57)
at 
org.gradle.api.internal.tasks.testing.junit.JUnitTestClassProcessor.processTestClass(JUnitTestClassProcessor.java:66)
at 
org.gradle.api.internal.tasks.testing.SuiteTestClassProcessor.processTestClass(SuiteTestClassProcessor.java:51)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at 
org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
at 

[jira] [Commented] (BEAM-4035) Spark validatesRunner fails, ResumeFromCheckpointStreamingTest > classMethod FAILED java.lang.NoClassDefFoundError: org/apache/zookeeper/server/NIOServerCnxnFactory

[Alan Myrvold (JIRA)]

[ 
https://issues.apache.org/jira/browse/BEAM-4035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16433301#comment-16433301
 ] 

Alan Myrvold commented on BEAM-4035:


Passes locally, but not on Jenkins machines.

org.apache.beam.runners.spark.translation.streaming.ResumeFromCheckpointStreamingTest
 > classMethod FAILED java.lang.NoClassDefFoundError: 
org/apache/zookeeper/server/NIOServerCnxnFactory

The output from the gradle DependencyReportTask is identical in both 
environments. The gradle configurations.validatesRunner.getFiles() is missing 
the the zookeeper class on jenkins only. All other classes identica

> Spark validatesRunner fails, ResumeFromCheckpointStreamingTest > classMethod 
> FAILED java.lang.NoClassDefFoundError: 
> org/apache/zookeeper/server/NIOServerCnxnFactory
> 
>
> Key: BEAM-4035
> URL: https://issues.apache.org/jira/browse/BEAM-4035
> Project: Beam
>  Issue Type: Bug
>  Components: runner-spark
>Reporter: Alan Myrvold
>Assignee: Alan Myrvold
>Priority: Major
>  Time Spent: 1h
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work logged] (BEAM-3995) Launch Nexmark suites from gradle and update web page docs

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-3995?focusedWorklogId=89750=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-89750
 ]

ASF GitHub Bot logged work on BEAM-3995:


Author: ASF GitHub Bot
Created on: 11/Apr/18 02:11
Start Date: 11/Apr/18 02:11
Worklog Time Spent: 10m 
  Work Description: lukecwik commented on issue #5051: [BEAM-3995] Add 
basic Gradle run task to Nexmark
URL: https://github.com/apache/beam/pull/5051#issuecomment-380303801
 
 
   Aligning the naming for projects was needed to generate the correct 
dependency names between projects.
   
   Note that you can always use `-p path/to/project taskWithinProject` to 
execute using directory names instead of `:beam-project-name:taskWithinProject`


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 89750)
Time Spent: 3h 20m  (was: 3h 10m)

> Launch Nexmark suites from gradle and update web page docs
> --
>
> Key: BEAM-3995
> URL: https://issues.apache.org/jira/browse/BEAM-3995
> Project: Beam
>  Issue Type: Sub-task
>  Components: examples-nexmark, website
>Reporter: Kenneth Knowles
>Assignee: Kenneth Knowles
>Priority: Major
>  Time Spent: 3h 20m
>  Remaining Estimate: 0h
>
> Currently our instructions for running Nexmark benchmarks on various runners 
> is pretty tightly tied to Maven. We need a good story for running them with 
> gradle (or just building an executable with gradle and running that 
> standalone).



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Jenkins build is back to normal : beam_PostCommit_Java_ValidatesRunner_Flink_Gradle #75

[Apache Jenkins Server]

See 

Build failed in Jenkins: beam_PostCommit_Python_Verify #4654

[Apache Jenkins Server]

See 


Changes:

[robertwb] Use valid name for fake ArgSpec args.

--
[...truncated 1.04 MB...]
copying apache_beam/runners/job/__init__.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/job
copying apache_beam/runners/job/manager.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/job
copying apache_beam/runners/job/utils.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/job
copying apache_beam/runners/portability/__init__.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/portability
copying apache_beam/runners/portability/fn_api_runner.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/portability
copying apache_beam/runners/portability/fn_api_runner_test.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/portability
copying apache_beam/runners/portability/universal_local_runner.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/portability
copying apache_beam/runners/portability/universal_local_runner_main.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/portability
copying apache_beam/runners/portability/universal_local_runner_test.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/portability
copying apache_beam/runners/test/__init__.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/test
copying apache_beam/runners/worker/__init__.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/bundle_processor.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/data_plane.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/data_plane_test.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/log_handler.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/log_handler_test.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/logger.pxd -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/logger.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/logger_test.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/opcounters.pxd -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/opcounters.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/opcounters_test.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/operation_specs.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/operations.pxd -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/operations.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/sdk_worker.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/sdk_worker_main.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/sdk_worker_main_test.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/sdk_worker_test.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/sideinputs.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/sideinputs_test.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/statesampler.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/statesampler_fast.pyx -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/statesampler_slow.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/statesampler_test.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/worker_id_interceptor.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/worker_id_interceptor_test.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/testing/__init__.py -> 
apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/pipeline_verifiers.py -> 
apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/pipeline_verifiers_test.py -> 
apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/test_pipeline.py -> 
apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/test_pipeline_test.py -> 
apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/test_stream.py -> 
apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/test_stream_test.py -> 
apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/test_utils.py -> 
apache-beam-2.5.0.dev0/apache_beam/testing
copying 

Build failed in Jenkins: beam_PostCommit_Java_ValidatesRunner_Spark_Gradle #58

[Apache Jenkins Server]

See 


Changes:

[herohde] [BEAM-4015] Always update Go dependences in Maven build

[herohde] Update Go maven plugin

--
[...truncated 1.59 MB...]
at 
org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:457)
at scala.collection.immutable.List.foreach(List.scala:392)
at org.apache.spark.SparkContext.(SparkContext.scala:457)
at 
org.apache.spark.api.java.JavaSparkContext.(JavaSparkContext.scala:58)
at 
org.apache.beam.runners.spark.translation.SparkContextFactory.createSparkContext(SparkContextFactory.java:103)
at 
org.apache.beam.runners.spark.translation.SparkContextFactory.getSparkContext(SparkContextFactory.java:68)
at 
org.apache.beam.runners.spark.translation.streaming.SparkRunnerStreamingContextFactory.call(SparkRunnerStreamingContextFactory.java:79)
at 
org.apache.beam.runners.spark.translation.streaming.SparkRunnerStreamingContextFactory.call(SparkRunnerStreamingContextFactory.java:47)
at 
org.apache.spark.streaming.api.java.JavaStreamingContext$$anonfun$7.apply(JavaStreamingContext.scala:627)
at 
org.apache.spark.streaming.api.java.JavaStreamingContext$$anonfun$7.apply(JavaStreamingContext.scala:626)
at scala.Option.getOrElse(Option.scala:121)
at 
org.apache.spark.streaming.StreamingContext$.getOrCreate(StreamingContext.scala:828)
at 
org.apache.spark.streaming.api.java.JavaStreamingContext$.getOrCreate(JavaStreamingContext.scala:626)
at 
org.apache.spark.streaming.api.java.JavaStreamingContext.getOrCreate(JavaStreamingContext.scala)
at org.apache.beam.runners.spark.SparkRunner.run(SparkRunner.java:169)
at 
org.apache.beam.runners.spark.TestSparkRunner.run(TestSparkRunner.java:123)
at 
org.apache.beam.runners.spark.TestSparkRunner.run(TestSparkRunner.java:83)
at org.apache.beam.sdk.Pipeline.run(Pipeline.java:311)
at org.apache.beam.sdk.testing.TestPipeline.run(TestPipeline.java:346)
at org.apache.beam.sdk.testing.TestPipeline.run(TestPipeline.java:328)
at 
org.apache.beam.runners.spark.translation.streaming.CreateStreamTest.testDiscardingMode(CreateStreamTest.java:203)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at 
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
at 
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at 
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
at 
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
at 
org.apache.beam.sdk.testing.TestPipeline$1.evaluate(TestPipeline.java:317)
at 
org.junit.rules.ExpectedException$ExpectedExceptionStatement.evaluate(ExpectedException.java:239)
at org.junit.rules.RunRules.evaluate(RunRules.java:20)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
at 
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
at 
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
at 
org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.runTestClass(JUnitTestClassExecuter.java:114)
at 
org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.execute(JUnitTestClassExecuter.java:57)
at 
org.gradle.api.internal.tasks.testing.junit.JUnitTestClassProcessor.processTestClass(JUnitTestClassProcessor.java:66)
at 
org.gradle.api.internal.tasks.testing.SuiteTestClassProcessor.processTestClass(SuiteTestClassProcessor.java:51)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at 

Build failed in Jenkins: beam_PostCommit_Java_GradleBuild #33

[Apache Jenkins Server]

See 


Changes:

[robertwb] Use valid name for fake ArgSpec args.

--
[...truncated 17.86 MB...]
INFO: Adding SpannerIO.Write/Write mutations to Cloud Spanner/Sample 
keys/GroupByKey as step s16
Apr 11, 2018 1:50:57 AM 
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding SpannerIO.Write/Write mutations to Cloud Spanner/Sample 
keys/Combine.GroupedValues as step s17
Apr 11, 2018 1:50:57 AM 
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding SpannerIO.Write/Write mutations to Cloud Spanner/Keys sample 
as view/GBKaSVForData/ParDo(GroupByKeyHashAndSortByKeyAndWindow) as step s18
Apr 11, 2018 1:50:57 AM 
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding SpannerIO.Write/Write mutations to Cloud Spanner/Keys sample 
as view/GBKaSVForData/BatchViewOverrides.GroupByKeyAndSortValuesOnly as step s19
Apr 11, 2018 1:50:57 AM 
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding SpannerIO.Write/Write mutations to Cloud Spanner/Keys sample 
as view/ParMultiDo(ToIsmRecordForMapLike) as step s20
Apr 11, 2018 1:50:57 AM 
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding SpannerIO.Write/Write mutations to Cloud Spanner/Keys sample 
as view/GBKaSVForSize as step s21
Apr 11, 2018 1:50:57 AM 
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding SpannerIO.Write/Write mutations to Cloud Spanner/Keys sample 
as view/ParDo(ToIsmMetadataRecordForSize) as step s22
Apr 11, 2018 1:50:57 AM 
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding SpannerIO.Write/Write mutations to Cloud Spanner/Keys sample 
as view/GBKaSVForKeys as step s23
Apr 11, 2018 1:50:57 AM 
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding SpannerIO.Write/Write mutations to Cloud Spanner/Keys sample 
as view/ParDo(ToIsmMetadataRecordForKey) as step s24
Apr 11, 2018 1:50:57 AM 
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding SpannerIO.Write/Write mutations to Cloud Spanner/Keys sample 
as view/Flatten.PCollections as step s25
Apr 11, 2018 1:50:57 AM 
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding SpannerIO.Write/Write mutations to Cloud Spanner/Keys sample 
as view/CreateDataflowView as step s26
Apr 11, 2018 1:50:57 AM 
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding SpannerIO.Write/Write mutations to Cloud Spanner/Partition 
input as step s27
Apr 11, 2018 1:50:57 AM 
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding SpannerIO.Write/Write mutations to Cloud Spanner/Group by 
partition as step s28
Apr 11, 2018 1:50:57 AM 
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding SpannerIO.Write/Write mutations to Cloud Spanner/Batch 
mutations together as step s29
Apr 11, 2018 1:50:57 AM 
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding SpannerIO.Write/Write mutations to Cloud Spanner/Write 
mutations to Spanner as step s30
Apr 11, 2018 1:50:57 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to 
gs://temp-storage-for-end-to-end-tests/spannerwriteit0testwrite-jenkins-0411015051-12d897e6/output/results/staging/
Apr 11, 2018 1:50:57 AM org.apache.beam.runners.dataflow.util.PackageUtil 
tryStagePackage
INFO: Uploading <80747 bytes, hash iT7j_d1y9DgQFIDZNlZBOA> to 
gs://temp-storage-for-end-to-end-tests/spannerwriteit0testwrite-jenkins-0411015051-12d897e6/output/results/staging/pipeline-iT7j_d1y9DgQFIDZNlZBOA.pb

org.apache.beam.sdk.io.gcp.spanner.SpannerWriteIT > testWrite STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT

org.apache.beam.sdk.io.gcp.spanner.SpannerWriteIT > testWrite STANDARD_ERROR
Apr 11, 2018 1:50:59 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to 
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-04-10_18_50_58-13344191797101611556?project=apache-beam-testing

org.apache.beam.sdk.io.gcp.spanner.SpannerWriteIT > testWrite STANDARD_OUT
Submitted job: 2018-04-10_18_50_58-13344191797101611556

org.apache.beam.sdk.io.gcp.spanner.SpannerWriteIT > testWrite STANDARD_ERROR
Apr 11, 2018 1:50:59 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing 

Build failed in Jenkins: beam_PostCommit_Java_ValidatesRunner_Flink_Gradle #74

[Apache Jenkins Server]

See 


Changes:

[herohde] [BEAM-4015] Always update Go dependences in Maven build

[herohde] Update Go maven plugin

--
[...truncated 95.24 MB...]
Apr 11, 2018 1:44:44 AM org.apache.flink.runtime.taskmanager.Task run
INFO: Ensuring all FileSystem streams are closed for task 
PAssert$136/GroupGlobally/GatherAllOutputs/GroupByKey -> 
PAssert$136/GroupGlobally/GatherAllOutputs/Values/Values/Map/ParMultiDo(Anonymous)
 -> PAssert$136/GroupGlobally/RewindowActuals/Window.Assign.out -> 
PAssert$136/GroupGlobally/KeyForDummy/AddKeys/Map/ParMultiDo(Anonymous) (1/1) 
(31fd8d84e4164b923b9d1fef2ff7538b) [FINISHED]
Apr 11, 2018 1:44:44 AM grizzled.slf4j.Logger info
INFO: Un-registering task and sending final execution state FINISHED to 
JobManager for task 
View.AsSingleton/Combine.GloballyAsSingletonView/View.CreatePCollectionView/Combine.globally(Concatenate)/Combine.perKey(Concatenate)
 -> 
View.AsSingleton/Combine.GloballyAsSingletonView/View.CreatePCollectionView/Combine.globally(Concatenate)/Values/Values/Map/ParMultiDo(Anonymous)
 -> (Map, Map) (f6f76deb47b4f799117273bcc2709381)
Apr 11, 2018 1:44:44 AM org.apache.flink.runtime.taskmanager.Task 
transitionState
INFO: ToKeyedWorkItem (1/1) (96a87315c077a002521a2d199619c1fa) switched 
from RUNNING to FINISHED.
Apr 11, 2018 1:44:44 AM org.apache.flink.runtime.taskmanager.Task run
INFO: Freeing task resources for ToKeyedWorkItem (1/1) 
(96a87315c077a002521a2d199619c1fa).
Apr 11, 2018 1:44:44 AM grizzled.slf4j.Logger info
INFO: Un-registering task and sending final execution state FINISHED to 
JobManager for task PAssert$134/GroupGlobally/GroupDummyAndContents -> 
PAssert$134/GroupGlobally/Values/Values/Map/ParMultiDo(Anonymous) -> 
PAssert$134/GroupGlobally/ParDo(Concat)/ParMultiDo(Concat) -> 
PAssert$134/GetPane/Map/ParMultiDo(Anonymous) -> 
PAssert$134/RunChecks/ParMultiDo(GroupedValuesChecker) -> 
PAssert$134/VerifyAssertions/ParDo(DefaultConclude)/ParMultiDo(DefaultConclude) 
(d0e02474e4fdc07f287207cfea8e8c04)
Apr 11, 2018 1:44:44 AM org.apache.flink.runtime.taskmanager.Task run
INFO: Ensuring all FileSystem streams are closed for task ToKeyedWorkItem 
(1/1) (96a87315c077a002521a2d199619c1fa) [FINISHED]
Apr 11, 2018 1:44:44 AM grizzled.slf4j.Logger info
INFO: Un-registering task and sending final execution state FINISHED to 
JobManager for task 
Combine.globally(TestCombineFnWithContext)/Combine.perKey(TestCombineFnWithContext)/Combine.GroupedValues/ParDo(Anonymous)/ParMultiDo(Anonymous)
 -> 
Combine.globally(TestCombineFnWithContext)/Values/Values/Map/ParMultiDo(Anonymous)
 -> PAssert$136/GroupGlobally/Window.Into()/Window.Assign.out -> 
PAssert$136/GroupGlobally/GatherAllOutputs/Reify.Window/ParDo(Anonymous)/ParMultiDo(Anonymous)
 -> 
PAssert$136/GroupGlobally/GatherAllOutputs/WithKeys/AddKeys/Map/ParMultiDo(Anonymous)
 -> PAssert$136/GroupGlobally/GatherAllOutputs/Window.Into()/Window.Assign.out 
-> ToKeyedWorkItem (e7304656e71d7502a069d0081cf1a2c6)
Apr 11, 2018 1:44:44 AM org.apache.flink.runtime.taskmanager.Task 
transitionState
INFO: PAssert$136/GroupGlobally/GroupDummyAndContents -> 
PAssert$136/GroupGlobally/Values/Values/Map/ParMultiDo(Anonymous) -> 
PAssert$136/GroupGlobally/ParDo(Concat)/ParMultiDo(Concat) -> 
PAssert$136/GetPane/Map/ParMultiDo(Anonymous) -> 
PAssert$136/RunChecks/ParMultiDo(GroupedValuesChecker) -> 
PAssert$136/VerifyAssertions/ParDo(DefaultConclude)/ParMultiDo(DefaultConclude) 
(1/1) (b41f9dc3538634e4b1453b4d285dff26) switched from RUNNING to FINISHED.
Apr 11, 2018 1:44:44 AM org.apache.flink.runtime.taskmanager.Task run
INFO: Freeing task resources for 
PAssert$136/GroupGlobally/GroupDummyAndContents -> 
PAssert$136/GroupGlobally/Values/Values/Map/ParMultiDo(Anonymous) -> 
PAssert$136/GroupGlobally/ParDo(Concat)/ParMultiDo(Concat) -> 
PAssert$136/GetPane/Map/ParMultiDo(Anonymous) -> 
PAssert$136/RunChecks/ParMultiDo(GroupedValuesChecker) -> 
PAssert$136/VerifyAssertions/ParDo(DefaultConclude)/ParMultiDo(DefaultConclude) 
(1/1) (b41f9dc3538634e4b1453b4d285dff26).
Apr 11, 2018 1:44:44 AM org.apache.flink.runtime.taskmanager.Task run
INFO: Ensuring all FileSystem streams are closed for task 
PAssert$136/GroupGlobally/GroupDummyAndContents -> 
PAssert$136/GroupGlobally/Values/Values/Map/ParMultiDo(Anonymous) -> 
PAssert$136/GroupGlobally/ParDo(Concat)/ParMultiDo(Concat) -> 
PAssert$136/GetPane/Map/ParMultiDo(Anonymous) -> 
PAssert$136/RunChecks/ParMultiDo(GroupedValuesChecker) -> 
PAssert$136/VerifyAssertions/ParDo(DefaultConclude)/ParMultiDo(DefaultConclude) 
(1/1) (b41f9dc3538634e4b1453b4d285dff26) [FINISHED]
Apr 11, 2018 1:44:44 AM org.apache.flink.runtime.taskmanager.Task 
transitionState
INFO: 

[beam] 01/01: Decrease parallelism of Flink ValidatesRunner tests to reduce flakiness

[lcwik]

This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git

commit f75d0f43f2e4f75b0439643f6742dda30c0b52dc
Merge: f821de8 d582ce3
Author: Lukasz Cwik 
AuthorDate: Tue Apr 10 21:35:55 2018 -0400

Decrease parallelism of Flink ValidatesRunner tests to reduce flakiness

 runners/flink/build.gradle | 3 ++-
 1 file changed, 2 insertions(+), 1 deletion(-)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.

[beam] branch master updated (f821de8 -> f75d0f4)

[lcwik]

This is an automated email from the ASF dual-hosted git repository.

lcwik pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


from f821de8  Merge pull request #5083 from pabloem/no-data-race
 add d582ce3  Decrease flink ValidatesRunner maxParallelForks from 4 to 2 
in order to avoid OOM errors
 new f75d0f4  Decrease parallelism of Flink ValidatesRunner tests to reduce 
flakiness

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 runners/flink/build.gradle | 3 ++-
 1 file changed, 2 insertions(+), 1 deletion(-)

-- 
To stop receiving notification emails like this one, please contact
lc...@apache.org.

Build failed in Jenkins: beam_PostCommit_Java_GradleBuild #32

[Apache Jenkins Server]

See 


--
[...truncated 17.87 MB...]
INFO: Adding SpannerIO.Write/Write mutations to Cloud Spanner/Extract keys 
as step s15
Apr 11, 2018 1:30:00 AM 
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding SpannerIO.Write/Write mutations to Cloud Spanner/Sample 
keys/GroupByKey as step s16
Apr 11, 2018 1:30:00 AM 
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding SpannerIO.Write/Write mutations to Cloud Spanner/Sample 
keys/Combine.GroupedValues as step s17
Apr 11, 2018 1:30:00 AM 
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding SpannerIO.Write/Write mutations to Cloud Spanner/Keys sample 
as view/GBKaSVForData/ParDo(GroupByKeyHashAndSortByKeyAndWindow) as step s18
Apr 11, 2018 1:30:00 AM 
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding SpannerIO.Write/Write mutations to Cloud Spanner/Keys sample 
as view/GBKaSVForData/BatchViewOverrides.GroupByKeyAndSortValuesOnly as step s19
Apr 11, 2018 1:30:00 AM 
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding SpannerIO.Write/Write mutations to Cloud Spanner/Keys sample 
as view/ParMultiDo(ToIsmRecordForMapLike) as step s20
Apr 11, 2018 1:30:00 AM 
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding SpannerIO.Write/Write mutations to Cloud Spanner/Keys sample 
as view/GBKaSVForSize as step s21
Apr 11, 2018 1:30:00 AM 
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding SpannerIO.Write/Write mutations to Cloud Spanner/Keys sample 
as view/ParDo(ToIsmMetadataRecordForSize) as step s22
Apr 11, 2018 1:30:00 AM 
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding SpannerIO.Write/Write mutations to Cloud Spanner/Keys sample 
as view/GBKaSVForKeys as step s23
Apr 11, 2018 1:30:00 AM 
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding SpannerIO.Write/Write mutations to Cloud Spanner/Keys sample 
as view/ParDo(ToIsmMetadataRecordForKey) as step s24
Apr 11, 2018 1:30:00 AM 
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding SpannerIO.Write/Write mutations to Cloud Spanner/Keys sample 
as view/Flatten.PCollections as step s25
Apr 11, 2018 1:30:00 AM 
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding SpannerIO.Write/Write mutations to Cloud Spanner/Keys sample 
as view/CreateDataflowView as step s26
Apr 11, 2018 1:30:00 AM 
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding SpannerIO.Write/Write mutations to Cloud Spanner/Partition 
input as step s27
Apr 11, 2018 1:30:00 AM 
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding SpannerIO.Write/Write mutations to Cloud Spanner/Group by 
partition as step s28
Apr 11, 2018 1:30:00 AM 
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding SpannerIO.Write/Write mutations to Cloud Spanner/Batch 
mutations together as step s29
Apr 11, 2018 1:30:00 AM 
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding SpannerIO.Write/Write mutations to Cloud Spanner/Write 
mutations to Spanner as step s30
Apr 11, 2018 1:30:00 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to 
gs://temp-storage-for-end-to-end-tests/spannerwriteit0testwrite-jenkins-0411012952-bb8f2e18/output/results/staging/
Apr 11, 2018 1:30:00 AM org.apache.beam.runners.dataflow.util.PackageUtil 
tryStagePackage
INFO: Uploading <80747 bytes, hash i0iz5Yr45fk9UWdImVPnBw> to 
gs://temp-storage-for-end-to-end-tests/spannerwriteit0testwrite-jenkins-0411012952-bb8f2e18/output/results/staging/pipeline-i0iz5Yr45fk9UWdImVPnBw.pb

org.apache.beam.sdk.io.gcp.spanner.SpannerWriteIT > testWrite STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT

org.apache.beam.sdk.io.gcp.spanner.SpannerWriteIT > testWrite STANDARD_ERROR
Apr 11, 2018 1:30:02 AM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to 
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-04-10_18_30_00-6162801894643781890?project=apache-beam-testing

org.apache.beam.sdk.io.gcp.spanner.SpannerWriteIT > testWrite STANDARD_OUT
Submitted job: 2018-04-10_18_30_00-6162801894643781890

org.apache.beam.sdk.io.gcp.spanner.SpannerWriteIT > testWrite STANDARD_ERROR
Apr 11, 2018 1:30:02 AM 

[beam] branch master updated (1912089 -> f821de8)

[altay]

This is an automated email from the ASF dual-hosted git repository.

altay pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


from 1912089  Merge pull request #4897 from 
charlesccychen/fix-duplicate-outputs
 add 4a5602b  Fixing data race in statesampler_fast.
 new f821de8  Merge pull request #5083 from pabloem/no-data-race

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 sdks/python/apache_beam/runners/worker/statesampler_fast.pyx | 4 ++--
 1 file changed, 2 insertions(+), 2 deletions(-)

-- 
To stop receiving notification emails like this one, please contact
al...@apache.org.

[beam] 01/01: Merge pull request #5083 from pabloem/no-data-race

[altay]

This is an automated email from the ASF dual-hosted git repository.

altay pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git

commit f821de8a1e53af67a2cb54e241ffd731ebf306c7
Merge: 1912089 4a5602b
Author: Ahmet Altay 
AuthorDate: Tue Apr 10 18:33:07 2018 -0700

Merge pull request #5083 from pabloem/no-data-race

Fixing data race in statesampler_fast.

 sdks/python/apache_beam/runners/worker/statesampler_fast.pyx | 4 ++--
 1 file changed, 2 insertions(+), 2 deletions(-)

-- 
To stop receiving notification emails like this one, please contact
al...@apache.org.

[beam] 01/01: Merge pull request #4897 from charlesccychen/fix-duplicate-outputs

[altay]

This is an automated email from the ASF dual-hosted git repository.

altay pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git

commit 19120896b77c939f48f837590746c539a1a14389
Merge: 8b8c84b 2d5e10c
Author: Ahmet Altay 
AuthorDate: Tue Apr 10 18:32:24 2018 -0700

Merge pull request #4897 from charlesccychen/fix-duplicate-outputs

Update DataflowRunner to suppress duplicate system messages

 .../apache_beam/runners/dataflow/dataflow_runner.py   | 19 +++
 1 file changed, 11 insertions(+), 8 deletions(-)

-- 
To stop receiving notification emails like this one, please contact
al...@apache.org.

[beam] branch master updated (8b8c84b -> 1912089)

[altay]

This is an automated email from the ASF dual-hosted git repository.

altay pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


from 8b8c84b  Merge pull request #5095 from herohde/maven
 add 2d5e10c  Update DataflowRunner to suppress duplicate system messages
 new 1912089  Merge pull request #4897 from 
charlesccychen/fix-duplicate-outputs

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 .../apache_beam/runners/dataflow/dataflow_runner.py   | 19 +++
 1 file changed, 11 insertions(+), 8 deletions(-)

-- 
To stop receiving notification emails like this one, please contact
al...@apache.org.

[jira] [Work logged] (BEAM-3339) Create post-release testing of the nightly snapshots

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-3339?focusedWorklogId=89739=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-89739
 ]

ASF GitHub Bot logged work on BEAM-3339:


Author: ASF GitHub Bot
Created on: 11/Apr/18 01:24
Start Date: 11/Apr/18 01:24
Worklog Time Spent: 10m 
  Work Description: yifanzou commented on issue #4788: [BEAM-3339] Mobile 
gaming automation for Java nightly snapshot on core runners
URL: https://github.com/apache/beam/pull/4788#issuecomment-380296622
 
 
   @tgroh  I am appreciate for your comments and helps on this. I made some 
changes base on previous comments, rebased the HEAD and squashed commits. PTAL


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 89739)
Time Spent: 90h  (was: 89h 50m)

> Create post-release testing of the nightly snapshots
> 
>
> Key: BEAM-3339
> URL: https://issues.apache.org/jira/browse/BEAM-3339
> Project: Beam
>  Issue Type: Improvement
>  Components: testing
>Reporter: Alan Myrvold
>Assignee: Jason Kuster
>Priority: Major
>  Time Spent: 90h
>  Remaining Estimate: 0h
>
> The nightly java snapshots in 
> https://repository.apache.org/content/groups/snapshots/org/apache/beam should 
> be verified by following the 
> https://beam.apache.org/get-started/quickstart-java/ instructions, to verify 
> that the release is usable.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Resolved] (BEAM-4015) GCS artifact proxy is breaking the build when credentials are not available

[Henning Rohde (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-4015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Henning Rohde resolved BEAM-4015.
-
Resolution: Fixed

Hopefully fixed now.

> GCS artifact proxy is breaking the build when credentials are not available
> ---
>
> Key: BEAM-4015
> URL: https://issues.apache.org/jira/browse/BEAM-4015
> Project: Beam
>  Issue Type: Bug
>  Components: sdk-go
>Reporter: Ismaël Mejía
>Assignee: Henning Rohde
>Priority: Blocker
> Fix For: 2.5.0
>
>  Time Spent: 1h 10m
>  Remaining Estimate: 0h
>
> When running the maven build in a machine without the valid auth credentials 
> the module breaks like this:
> {code:bash}
> {{[INFO] --- mvn-golang-wrapper:2.1.6:build (go-build) @ 
> beam-runners-gcp-gcsproxy ---}}
> {{[INFO] Prepared command line : bin/go build -buildmode=default -o 
> /home/ismael/upstream/beam/runners/gcp/gcsproxy/target/gcsproxy 
> github.com/apache/beam/cmd/gcsproxy}}
> {{[ERROR] }}
> {{[ERROR] -Exec.Err-}}
> {{[ERROR] # github.com/apache/beam/sdks/go/pkg/beam/util/gcsx}}
> {{[ERROR] github.com/apache/beam/sdks/go/pkg/beam/util/gcsx/gcs.go:46:37: 
> undefined: option.WithoutAuthentication}}
> {{[ERROR] }}
> {{}}
> {{[INFO] Apache Beam :: Runners :: Google Cloud Platform :: GCS artifact 
> proxy FAILURE [  1.038 s]}}
> {{}}
> {{[INFO] BUILD FAILURE}}
> {{}}
> {{[ERROR] Failed to execute goal 
> com.igormaznitsa:mvn-golang-wrapper:2.1.6:build (go-build) on project 
> beam-runners-gcp-gcsproxy: Can't find generated target file : 
> /home/ismael/upstream/beam/runners/gcp/gcsproxy/target/gcsproxy -> [Help 1]}}
> {{[ERROR] }}
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work logged] (BEAM-4015) GCS artifact proxy is breaking the build when credentials are not available

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-4015?focusedWorklogId=89738=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-89738
 ]

ASF GitHub Bot logged work on BEAM-4015:


Author: ASF GitHub Bot
Created on: 11/Apr/18 01:23
Start Date: 11/Apr/18 01:23
Worklog Time Spent: 10m 
  Work Description: robertwb closed pull request #5095: [BEAM-4015] Always 
update Go dependences in Maven build
URL: https://github.com/apache/beam/pull/5095
 
 
   

This is a PR merged from a forked repository.
As GitHub hides the original diff on merge, it is displayed below for
the sake of provenance:

As this is a foreign pull request (from a fork), the diff is supplied
below (as it won't show otherwise due to GitHub magic):

diff --git a/pom.xml b/pom.xml
index a93b72f1fba..e14a190f2e7 100644
--- a/pom.xml
+++ b/pom.xml
@@ -2113,7 +2113,7 @@
 
   com.igormaznitsa
   mvn-golang-wrapper
-  2.1.6
+  2.1.7
   true
   
 1.9
diff --git a/runners/gcp/gcemd/pom.xml b/runners/gcp/gcemd/pom.xml
index 367343ead91..2db323615be 100644
--- a/runners/gcp/gcemd/pom.xml
+++ b/runners/gcp/gcemd/pom.xml
@@ -104,6 +104,9 @@
 
 compile
 
+  
+-u
+  
   
 google.golang.org/grpc
 golang.org/x/oauth2/google
diff --git a/runners/gcp/gcsproxy/pom.xml b/runners/gcp/gcsproxy/pom.xml
index b1e210c0eec..dd1af9c2dec 100644
--- a/runners/gcp/gcsproxy/pom.xml
+++ b/runners/gcp/gcsproxy/pom.xml
@@ -104,6 +104,9 @@
 
 compile
 
+  
+-u
+  
   
 google.golang.org/grpc
 golang.org/x/oauth2/google
diff --git a/sdks/go/container/pom.xml b/sdks/go/container/pom.xml
index c70aa6389e7..d2214adf6d2 100644
--- a/sdks/go/container/pom.xml
+++ b/sdks/go/container/pom.xml
@@ -104,6 +104,9 @@
 
 compile
 
+  
+-u
+  
   
 google.golang.org/grpc
 golang.org/x/oauth2/google
diff --git a/sdks/go/pom.xml b/sdks/go/pom.xml
index 571c85d52b8..8b8538114d1 100644
--- a/sdks/go/pom.xml
+++ b/sdks/go/pom.xml
@@ -113,6 +113,9 @@
 
 compile
 
+  
+-u
+  
   
 google.golang.org/grpc
 golang.org/x/oauth2/google
diff --git a/sdks/java/container/pom.xml b/sdks/java/container/pom.xml
index 10e42522020..17f0ebe89d1 100644
--- a/sdks/java/container/pom.xml
+++ b/sdks/java/container/pom.xml
@@ -134,6 +134,9 @@
 
 compile
 
+  
+-u
+  
   
 google.golang.org/grpc
 golang.org/x/oauth2/google
diff --git a/sdks/python/container/pom.xml b/sdks/python/container/pom.xml
index 49cc7f9e9e0..2b706826553 100644
--- a/sdks/python/container/pom.xml
+++ b/sdks/python/container/pom.xml
@@ -104,6 +104,9 @@
 
 compile
 
+  
+-u
+  
   
 google.golang.org/grpc
 golang.org/x/oauth2/google


 


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 89738)
Time Spent: 1h 10m  (was: 1h)

> GCS artifact proxy is breaking the build when credentials are not available
> ---
>
> Key: BEAM-4015
> URL: https://issues.apache.org/jira/browse/BEAM-4015
> Project: Beam
>  Issue Type: Bug
>  Components: sdk-go
>Reporter: Ismaël Mejía
>Assignee: Henning Rohde
>Priority: Blocker
> Fix For: 2.5.0
>
>  Time Spent: 1h 10m
>  Remaining Estimate: 0h
>
> When running the maven build in a machine without the valid auth credentials 
> the module breaks like this:
> {code:bash}
> {{[INFO] --- mvn-golang-wrapper:2.1.6:build (go-build) @ 
> beam-runners-gcp-gcsproxy ---}}
> {{[INFO] Prepared command line : bin/go build -buildmode=default -o 
> /home/ismael/upstream/beam/runners/gcp/gcsproxy/target/gcsproxy 
> github.com/apache/beam/cmd/gcsproxy}}
> {{[ERROR] }}
> {{[ERROR] -Exec.Err-}}
> {{[ERROR] # github.com/apache/beam/sdks/go/pkg/beam/util/gcsx}}
> {{[ERROR] 

[beam] branch master updated (0aed543 -> 8b8c84b)

[robertwb]

This is an automated email from the ASF dual-hosted git repository.

robertwb pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git.


from 0aed543  Merge pull request #5052 Use valid name for fake 
inspect.ArgSpec args.
 add 20856e3  [BEAM-4015] Always update Go dependences in Maven build
 add 0ae88d2  Update Go maven plugin
 new 8b8c84b  Merge pull request #5095 from herohde/maven

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 pom.xml   | 2 +-
 runners/gcp/gcemd/pom.xml | 3 +++
 runners/gcp/gcsproxy/pom.xml  | 3 +++
 sdks/go/container/pom.xml | 3 +++
 sdks/go/pom.xml   | 3 +++
 sdks/java/container/pom.xml   | 3 +++
 sdks/python/container/pom.xml | 3 +++
 7 files changed, 19 insertions(+), 1 deletion(-)

-- 
To stop receiving notification emails like this one, please contact
rober...@apache.org.

[beam] 01/01: Merge pull request #5095 from herohde/maven

[robertwb]

This is an automated email from the ASF dual-hosted git repository.

robertwb pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git

commit 8b8c84bff7dbf683a99b62783281a90780b99676
Merge: 0aed543 0ae88d2
Author: Robert Bradshaw 
AuthorDate: Tue Apr 10 18:23:11 2018 -0700

Merge pull request #5095 from herohde/maven

[BEAM-4015] Always update Go dependences in Maven build

 pom.xml   | 2 +-
 runners/gcp/gcemd/pom.xml | 3 +++
 runners/gcp/gcsproxy/pom.xml  | 3 +++
 sdks/go/container/pom.xml | 3 +++
 sdks/go/pom.xml   | 3 +++
 sdks/java/container/pom.xml   | 3 +++
 sdks/python/container/pom.xml | 3 +++
 7 files changed, 19 insertions(+), 1 deletion(-)

-- 
To stop receiving notification emails like this one, please contact
rober...@apache.org.

Build failed in Jenkins: beam_PerformanceTests_Python #1133

[Apache Jenkins Server]

See 


--
[...truncated 64.22 KB...]
[INFO] Copying 6 resources
[INFO] 
[INFO] --- maven-assembly-plugin:3.1.0:single (export-go-pkg-sources) @ 
beam-sdks-go ---
[INFO] Reading assembly descriptor: descriptor.xml
[INFO] Building zip: 

[INFO] 
[INFO] --- maven-remote-resources-plugin:1.5:process (process-resource-bundles) 
@ beam-sdks-go ---
[INFO] 
[INFO] --- mvn-golang-wrapper:2.1.6:get (go-get-imports) @ beam-sdks-go ---
[INFO] Prepared command line : bin/go get google.golang.org/grpc 
golang.org/x/oauth2/google google.golang.org/api/storage/v1 
github.com/spf13/cobra cloud.google.com/go/bigquery 
google.golang.org/api/googleapi google.golang.org/api/dataflow/v1b3
[INFO] 
[INFO] --- mvn-golang-wrapper:2.1.6:build (go-build) @ beam-sdks-go ---
[INFO] Prepared command line : bin/go build -buildmode=default -o 

 github.com/apache/beam/sdks/go/cmd/beamctl
[INFO] The Result file has been successfuly created : 

[INFO] 
[INFO] --- mvn-golang-wrapper:2.1.6:build (go-build-linux-amd64) @ beam-sdks-go 
---
[INFO] Prepared command line : bin/go build -buildmode=default -o 

 github.com/apache/beam/sdks/go/cmd/beamctl
[INFO] The Result file has been successfuly created : 

[INFO] 
[INFO] --- maven-checkstyle-plugin:3.0.0:check (default) @ beam-sdks-go ---
[INFO] 
[INFO] --- mvn-golang-wrapper:2.1.6:test (go-test) @ beam-sdks-go ---
[INFO] Prepared command line : bin/go test ./...
[INFO] 
[INFO] -Exec.Out-
[INFO] ?github.com/apache/beam/sdks/go/cmd/beamctl  [no test files]
[INFO] ?github.com/apache/beam/sdks/go/cmd/beamctl/cmd  [no test files]
[INFO] ?github.com/apache/beam/sdks/go/cmd/specialize   [no test files]
[INFO] ?github.com/apache/beam/sdks/go/cmd/symtab   [no test files]
[INFO] ok   github.com/apache/beam/sdks/go/pkg/beam 0.083s
[INFO] ok   github.com/apache/beam/sdks/go/pkg/beam/artifact0.187s
[INFO] 
[ERROR] 
[ERROR] -Exec.Err-
[ERROR] # github.com/apache/beam/sdks/go/pkg/beam/util/gcsx
[ERROR] github.com/apache/beam/sdks/go/pkg/beam/util/gcsx/gcs.go:46:37: 
undefined: option.WithoutAuthentication
[ERROR] 
[INFO] 
[INFO] Reactor Summary:
[INFO] 
[INFO] Apache Beam :: Parent .. SUCCESS [ 23.393 s]
[INFO] Apache Beam :: SDKs :: Java :: Build Tools . SUCCESS [ 13.835 s]
[INFO] Apache Beam :: Model ... SUCCESS [  0.427 s]
[INFO] Apache Beam :: Model :: Pipeline ... SUCCESS [ 38.360 s]
[INFO] Apache Beam :: Model :: Job Management . SUCCESS [ 17.348 s]
[INFO] Apache Beam :: Model :: Fn Execution ... SUCCESS [ 23.470 s]
[INFO] Apache Beam :: SDKs  SUCCESS [  0.945 s]
[INFO] Apache Beam :: SDKs :: Go .. FAILURE [01:27 min]
[INFO] Apache Beam :: SDKs :: Go :: Container . SKIPPED
[INFO] Apache Beam :: SDKs :: Java  SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Core  SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Fn Execution  SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions .. SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Google Cloud Platform Core 
SKIPPED
[INFO] Apache Beam :: Runners . SKIPPED
[INFO] Apache Beam :: Runners :: Core Construction Java ... SKIPPED
[INFO] Apache Beam :: Runners :: Core Java  SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Harness . SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Container ... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO .. SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Amazon Web Services SKIPPED
[INFO] Apache Beam :: Runners :: Local Java Core .. SKIPPED
[INFO] Apache Beam :: Runners :: Direct Java .. SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: AMQP .. SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Common  SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Cassandra . SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch . SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests SKIPPED
[INFO] Apache 

[jira] [Work logged] (BEAM-4015) GCS artifact proxy is breaking the build when credentials are not available

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-4015?focusedWorklogId=89735=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-89735
 ]

ASF GitHub Bot logged work on BEAM-4015:


Author: ASF GitHub Bot
Created on: 11/Apr/18 01:14
Start Date: 11/Apr/18 01:14
Worklog Time Spent: 10m 
  Work Description: herohde commented on issue #5095: [BEAM-4015] Always 
update Go dependences in Maven build
URL: https://github.com/apache/beam/pull/5095#issuecomment-380295122
 
 
   Run Python Performance Test


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 89735)
Time Spent: 50m  (was: 40m)

> GCS artifact proxy is breaking the build when credentials are not available
> ---
>
> Key: BEAM-4015
> URL: https://issues.apache.org/jira/browse/BEAM-4015
> Project: Beam
>  Issue Type: Bug
>  Components: sdk-go
>Reporter: Ismaël Mejía
>Assignee: Henning Rohde
>Priority: Blocker
> Fix For: 2.5.0
>
>  Time Spent: 50m
>  Remaining Estimate: 0h
>
> When running the maven build in a machine without the valid auth credentials 
> the module breaks like this:
> {code:bash}
> {{[INFO] --- mvn-golang-wrapper:2.1.6:build (go-build) @ 
> beam-runners-gcp-gcsproxy ---}}
> {{[INFO] Prepared command line : bin/go build -buildmode=default -o 
> /home/ismael/upstream/beam/runners/gcp/gcsproxy/target/gcsproxy 
> github.com/apache/beam/cmd/gcsproxy}}
> {{[ERROR] }}
> {{[ERROR] -Exec.Err-}}
> {{[ERROR] # github.com/apache/beam/sdks/go/pkg/beam/util/gcsx}}
> {{[ERROR] github.com/apache/beam/sdks/go/pkg/beam/util/gcsx/gcs.go:46:37: 
> undefined: option.WithoutAuthentication}}
> {{[ERROR] }}
> {{}}
> {{[INFO] Apache Beam :: Runners :: Google Cloud Platform :: GCS artifact 
> proxy FAILURE [  1.038 s]}}
> {{}}
> {{[INFO] BUILD FAILURE}}
> {{}}
> {{[ERROR] Failed to execute goal 
> com.igormaznitsa:mvn-golang-wrapper:2.1.6:build (go-build) on project 
> beam-runners-gcp-gcsproxy: Can't find generated target file : 
> /home/ismael/upstream/beam/runners/gcp/gcsproxy/target/gcsproxy -> [Help 1]}}
> {{[ERROR] }}
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Build failed in Jenkins: beam_PerformanceTests_Python #1132

[Apache Jenkins Server]

See 


--
[...truncated 62.98 KB...]
[INFO] Copying 6 resources
[INFO] 
[INFO] --- maven-assembly-plugin:3.1.0:single (export-go-pkg-sources) @ 
beam-sdks-go ---
[INFO] Reading assembly descriptor: descriptor.xml
[INFO] Building zip: 

[INFO] 
[INFO] --- maven-remote-resources-plugin:1.5:process (process-resource-bundles) 
@ beam-sdks-go ---
[INFO] 
[INFO] --- mvn-golang-wrapper:2.1.6:get (go-get-imports) @ beam-sdks-go ---
[INFO] Prepared command line : bin/go get google.golang.org/grpc 
golang.org/x/oauth2/google google.golang.org/api/storage/v1 
github.com/spf13/cobra cloud.google.com/go/bigquery 
google.golang.org/api/googleapi google.golang.org/api/dataflow/v1b3
[INFO] 
[INFO] --- mvn-golang-wrapper:2.1.6:build (go-build) @ beam-sdks-go ---
[INFO] Prepared command line : bin/go build -buildmode=default -o 

 github.com/apache/beam/sdks/go/cmd/beamctl
[INFO] The Result file has been successfuly created : 

[INFO] 
[INFO] --- mvn-golang-wrapper:2.1.6:build (go-build-linux-amd64) @ beam-sdks-go 
---
[INFO] Prepared command line : bin/go build -buildmode=default -o 

 github.com/apache/beam/sdks/go/cmd/beamctl
[INFO] The Result file has been successfuly created : 

[INFO] 
[INFO] --- maven-checkstyle-plugin:3.0.0:check (default) @ beam-sdks-go ---
[INFO] 
[INFO] --- mvn-golang-wrapper:2.1.6:test (go-test) @ beam-sdks-go ---
[INFO] Prepared command line : bin/go test ./...
[INFO] 
[INFO] -Exec.Out-
[INFO] ?github.com/apache/beam/sdks/go/cmd/beamctl  [no test files]
[INFO] ?github.com/apache/beam/sdks/go/cmd/beamctl/cmd  [no test files]
[INFO] ?github.com/apache/beam/sdks/go/cmd/specialize   [no test files]
[INFO] ?github.com/apache/beam/sdks/go/cmd/symtab   [no test files]
[INFO] ok   github.com/apache/beam/sdks/go/pkg/beam 0.015s
[INFO] ok   github.com/apache/beam/sdks/go/pkg/beam/artifact0.160s
[INFO] 
[ERROR] 
[ERROR] -Exec.Err-
[ERROR] # github.com/apache/beam/sdks/go/pkg/beam/util/gcsx
[ERROR] github.com/apache/beam/sdks/go/pkg/beam/util/gcsx/gcs.go:46:37: 
undefined: option.WithoutAuthentication
[ERROR] 
[INFO] 
[INFO] Reactor Summary:
[INFO] 
[INFO] Apache Beam :: Parent .. SUCCESS [ 13.081 s]
[INFO] Apache Beam :: SDKs :: Java :: Build Tools . SUCCESS [  6.136 s]
[INFO] Apache Beam :: Model ... SUCCESS [  0.177 s]
[INFO] Apache Beam :: Model :: Pipeline ... SUCCESS [  9.708 s]
[INFO] Apache Beam :: Model :: Job Management . SUCCESS [  3.658 s]
[INFO] Apache Beam :: Model :: Fn Execution ... SUCCESS [  3.944 s]
[INFO] Apache Beam :: SDKs  SUCCESS [  0.171 s]
[INFO] Apache Beam :: SDKs :: Go .. FAILURE [ 26.648 s]
[INFO] Apache Beam :: SDKs :: Go :: Container . SKIPPED
[INFO] Apache Beam :: SDKs :: Java  SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Core  SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Fn Execution  SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions .. SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Extensions :: Google Cloud Platform Core 
SKIPPED
[INFO] Apache Beam :: Runners . SKIPPED
[INFO] Apache Beam :: Runners :: Core Construction Java ... SKIPPED
[INFO] Apache Beam :: Runners :: Core Java  SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Harness . SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: Container ... SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO .. SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Amazon Web Services SKIPPED
[INFO] Apache Beam :: Runners :: Local Java Core .. SKIPPED
[INFO] Apache Beam :: Runners :: Direct Java .. SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: AMQP .. SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Common  SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Cassandra . SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch . SKIPPED
[INFO] Apache Beam :: SDKs :: Java :: IO :: Elasticsearch-Tests SKIPPED
[INFO] Apache 

[jira] [Work logged] (BEAM-4015) GCS artifact proxy is breaking the build when credentials are not available

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-4015?focusedWorklogId=89734=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-89734
 ]

ASF GitHub Bot logged work on BEAM-4015:


Author: ASF GitHub Bot
Created on: 11/Apr/18 01:07
Start Date: 11/Apr/18 01:07
Worklog Time Spent: 10m 
  Work Description: herohde commented on issue #5095: [BEAM-4015] Always 
update Go dependences in Maven build
URL: https://github.com/apache/beam/pull/5095#issuecomment-380294068
 
 
   Run Python Performance Test


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 89734)
Time Spent: 40m  (was: 0.5h)

> GCS artifact proxy is breaking the build when credentials are not available
> ---
>
> Key: BEAM-4015
> URL: https://issues.apache.org/jira/browse/BEAM-4015
> Project: Beam
>  Issue Type: Bug
>  Components: sdk-go
>Reporter: Ismaël Mejía
>Assignee: Henning Rohde
>Priority: Blocker
> Fix For: 2.5.0
>
>  Time Spent: 40m
>  Remaining Estimate: 0h
>
> When running the maven build in a machine without the valid auth credentials 
> the module breaks like this:
> {code:bash}
> {{[INFO] --- mvn-golang-wrapper:2.1.6:build (go-build) @ 
> beam-runners-gcp-gcsproxy ---}}
> {{[INFO] Prepared command line : bin/go build -buildmode=default -o 
> /home/ismael/upstream/beam/runners/gcp/gcsproxy/target/gcsproxy 
> github.com/apache/beam/cmd/gcsproxy}}
> {{[ERROR] }}
> {{[ERROR] -Exec.Err-}}
> {{[ERROR] # github.com/apache/beam/sdks/go/pkg/beam/util/gcsx}}
> {{[ERROR] github.com/apache/beam/sdks/go/pkg/beam/util/gcsx/gcs.go:46:37: 
> undefined: option.WithoutAuthentication}}
> {{[ERROR] }}
> {{}}
> {{[INFO] Apache Beam :: Runners :: Google Cloud Platform :: GCS artifact 
> proxy FAILURE [  1.038 s]}}
> {{}}
> {{[INFO] BUILD FAILURE}}
> {{}}
> {{[ERROR] Failed to execute goal 
> com.igormaznitsa:mvn-golang-wrapper:2.1.6:build (go-build) on project 
> beam-runners-gcp-gcsproxy: Can't find generated target file : 
> /home/ismael/upstream/beam/runners/gcp/gcsproxy/target/gcsproxy -> [Help 1]}}
> {{[ERROR] }}
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[beam-site] 01/02: Fix tox lint command in contribution guide

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch mergebot
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit 9990581f21d1d59242e6e2520f25483b57c5fd98
Author: Charles Chen 
AuthorDate: Tue Apr 10 11:20:06 2018 -0700

Fix tox lint command in contribution guide
---
 content/contribute/contribution-guide/index.html | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/content/contribute/contribution-guide/index.html 
b/content/contribute/contribution-guide/index.html
index 96e09a4..a8985b7 100644
--- a/content/contribute/contribution-guide/index.html
+++ b/content/contribute/contribution-guide/index.html
@@ -456,7 +456,7 @@ environment before testing your code.
 command.
 
 $ pip install tox
-$ tox -e lint_py2,lint_py3
+$ tox -e py27-lint,py3-lint
 
 
 

-- 
To stop receiving notification emails like this one, please contact
mergebot-r...@apache.org.

Build failed in Jenkins: beam_PostCommit_Java_ValidatesRunner_Spark_Gradle #57

[Apache Jenkins Server]

See 


Changes:

[robertwb] Use valid name for fake ArgSpec args.

--
[...truncated 1.60 MB...]
at 
org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:457)
at 
org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:457)
at scala.collection.immutable.List.foreach(List.scala:392)
at org.apache.spark.SparkContext.(SparkContext.scala:457)
at 
org.apache.spark.api.java.JavaSparkContext.(JavaSparkContext.scala:58)
at 
org.apache.beam.runners.spark.translation.SparkContextFactory.createSparkContext(SparkContextFactory.java:103)
at 
org.apache.beam.runners.spark.translation.SparkContextFactory.getSparkContext(SparkContextFactory.java:68)
at 
org.apache.beam.runners.spark.translation.streaming.SparkRunnerStreamingContextFactory.call(SparkRunnerStreamingContextFactory.java:79)
at 
org.apache.beam.runners.spark.translation.streaming.SparkRunnerStreamingContextFactory.call(SparkRunnerStreamingContextFactory.java:47)
at 
org.apache.spark.streaming.api.java.JavaStreamingContext$$anonfun$7.apply(JavaStreamingContext.scala:627)
at 
org.apache.spark.streaming.api.java.JavaStreamingContext$$anonfun$7.apply(JavaStreamingContext.scala:626)
at scala.Option.getOrElse(Option.scala:121)
at 
org.apache.spark.streaming.StreamingContext$.getOrCreate(StreamingContext.scala:828)
at 
org.apache.spark.streaming.api.java.JavaStreamingContext$.getOrCreate(JavaStreamingContext.scala:626)
at 
org.apache.spark.streaming.api.java.JavaStreamingContext.getOrCreate(JavaStreamingContext.scala)
at org.apache.beam.runners.spark.SparkRunner.run(SparkRunner.java:169)
at 
org.apache.beam.runners.spark.TestSparkRunner.run(TestSparkRunner.java:123)
at 
org.apache.beam.runners.spark.TestSparkRunner.run(TestSparkRunner.java:83)
at org.apache.beam.sdk.Pipeline.run(Pipeline.java:311)
at org.apache.beam.sdk.testing.TestPipeline.run(TestPipeline.java:346)
at org.apache.beam.sdk.testing.TestPipeline.run(TestPipeline.java:328)
at 
org.apache.beam.runners.spark.translation.streaming.CreateStreamTest.testDiscardingMode(CreateStreamTest.java:203)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at 
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
at 
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at 
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
at 
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
at 
org.apache.beam.sdk.testing.TestPipeline$1.evaluate(TestPipeline.java:317)
at 
org.junit.rules.ExpectedException$ExpectedExceptionStatement.evaluate(ExpectedException.java:239)
at org.junit.rules.RunRules.evaluate(RunRules.java:20)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
at 
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
at 
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
at 
org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.runTestClass(JUnitTestClassExecuter.java:114)
at 
org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.execute(JUnitTestClassExecuter.java:57)
at 
org.gradle.api.internal.tasks.testing.junit.JUnitTestClassProcessor.processTestClass(JUnitTestClassProcessor.java:66)
at 
org.gradle.api.internal.tasks.testing.SuiteTestClassProcessor.processTestClass(SuiteTestClassProcessor.java:51)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at 

Build failed in Jenkins: beam_PostCommit_Java_ValidatesRunner_Flink_Gradle #73

[Apache Jenkins Server]

See 


Changes:

[robertwb] Use valid name for fake ArgSpec args.

--
[...truncated 71.82 MB...]
Apr 11, 2018 1:07:36 AM org.apache.flink.runtime.taskmanager.Task run
INFO: Ensuring all FileSystem streams are closed for task 
PAssert$134/GroupGlobally/GroupDummyAndContents -> 
PAssert$134/GroupGlobally/Values/Values/Map/ParMultiDo(Anonymous) -> 
PAssert$134/GroupGlobally/ParDo(Concat)/ParMultiDo(Concat) -> 
PAssert$134/GetPane/Map/ParMultiDo(Anonymous) -> 
PAssert$134/RunChecks/ParMultiDo(GroupedValuesChecker) -> 
PAssert$134/VerifyAssertions/ParDo(DefaultConclude)/ParMultiDo(DefaultConclude) 
(1/1) (e70700d575eb5b9fbec5404ec44e1085) [FINISHED]
Apr 11, 2018 1:07:36 AM org.apache.flink.runtime.taskmanager.Task 
transitionState
INFO: PAssert$135/GroupGlobally/GroupDummyAndContents -> 
PAssert$135/GroupGlobally/Values/Values/Map/ParMultiDo(Anonymous) -> 
PAssert$135/GroupGlobally/ParDo(Concat)/ParMultiDo(Concat) -> 
PAssert$135/GetPane/Map/ParMultiDo(Anonymous) -> 
PAssert$135/RunChecks/ParMultiDo(GroupedValuesChecker) -> 
PAssert$135/VerifyAssertions/ParDo(DefaultConclude)/ParMultiDo(DefaultConclude) 
(1/1) (bc9bc1333688c9a8cb84c0a5e524519c) switched from RUNNING to FINISHED.
Apr 11, 2018 1:07:36 AM org.apache.flink.runtime.taskmanager.Task run
INFO: Freeing task resources for 
PAssert$135/GroupGlobally/GroupDummyAndContents -> 
PAssert$135/GroupGlobally/Values/Values/Map/ParMultiDo(Anonymous) -> 
PAssert$135/GroupGlobally/ParDo(Concat)/ParMultiDo(Concat) -> 
PAssert$135/GetPane/Map/ParMultiDo(Anonymous) -> 
PAssert$135/RunChecks/ParMultiDo(GroupedValuesChecker) -> 
PAssert$135/VerifyAssertions/ParDo(DefaultConclude)/ParMultiDo(DefaultConclude) 
(1/1) (bc9bc1333688c9a8cb84c0a5e524519c).
Apr 11, 2018 1:07:36 AM org.apache.flink.runtime.taskmanager.Task run
INFO: Ensuring all FileSystem streams are closed for task 
PAssert$135/GroupGlobally/GroupDummyAndContents -> 
PAssert$135/GroupGlobally/Values/Values/Map/ParMultiDo(Anonymous) -> 
PAssert$135/GroupGlobally/ParDo(Concat)/ParMultiDo(Concat) -> 
PAssert$135/GetPane/Map/ParMultiDo(Anonymous) -> 
PAssert$135/RunChecks/ParMultiDo(GroupedValuesChecker) -> 
PAssert$135/VerifyAssertions/ParDo(DefaultConclude)/ParMultiDo(DefaultConclude) 
(1/1) (bc9bc1333688c9a8cb84c0a5e524519c) [FINISHED]
Apr 11, 2018 1:07:36 AM org.apache.flink.runtime.taskmanager.Task 
transitionState
INFO: PAssert$136/GroupGlobally/GroupDummyAndContents -> 
PAssert$136/GroupGlobally/Values/Values/Map/ParMultiDo(Anonymous) -> 
PAssert$136/GroupGlobally/ParDo(Concat)/ParMultiDo(Concat) -> 
PAssert$136/GetPane/Map/ParMultiDo(Anonymous) -> 
PAssert$136/RunChecks/ParMultiDo(GroupedValuesChecker) -> 
PAssert$136/VerifyAssertions/ParDo(DefaultConclude)/ParMultiDo(DefaultConclude) 
(1/1) (2371a17fb5d8a6c622964ebf1370fb40) switched from RUNNING to FINISHED.
Apr 11, 2018 1:07:36 AM org.apache.flink.runtime.taskmanager.Task 
transitionState
INFO: ToKeyedWorkItem (1/1) (e844948a0724544176ba0496f9ec476e) switched 
from RUNNING to FINISHED.
Apr 11, 2018 1:07:36 AM org.apache.flink.runtime.taskmanager.Task run
INFO: Freeing task resources for 
PAssert$136/GroupGlobally/GroupDummyAndContents -> 
PAssert$136/GroupGlobally/Values/Values/Map/ParMultiDo(Anonymous) -> 
PAssert$136/GroupGlobally/ParDo(Concat)/ParMultiDo(Concat) -> 
PAssert$136/GetPane/Map/ParMultiDo(Anonymous) -> 
PAssert$136/RunChecks/ParMultiDo(GroupedValuesChecker) -> 
PAssert$136/VerifyAssertions/ParDo(DefaultConclude)/ParMultiDo(DefaultConclude) 
(1/1) (2371a17fb5d8a6c622964ebf1370fb40).
Apr 11, 2018 1:07:36 AM org.apache.flink.runtime.taskmanager.Task run
INFO: Freeing task resources for ToKeyedWorkItem (1/1) 
(e844948a0724544176ba0496f9ec476e).
Apr 11, 2018 1:07:36 AM org.apache.flink.runtime.taskmanager.Task run
INFO: Ensuring all FileSystem streams are closed for task 
PAssert$136/GroupGlobally/GroupDummyAndContents -> 
PAssert$136/GroupGlobally/Values/Values/Map/ParMultiDo(Anonymous) -> 
PAssert$136/GroupGlobally/ParDo(Concat)/ParMultiDo(Concat) -> 
PAssert$136/GetPane/Map/ParMultiDo(Anonymous) -> 
PAssert$136/RunChecks/ParMultiDo(GroupedValuesChecker) -> 
PAssert$136/VerifyAssertions/ParDo(DefaultConclude)/ParMultiDo(DefaultConclude) 
(1/1) (2371a17fb5d8a6c622964ebf1370fb40) [FINISHED]
Apr 11, 2018 1:07:36 AM org.apache.flink.runtime.taskmanager.Task run
INFO: Ensuring all FileSystem streams are closed for task ToKeyedWorkItem 
(1/1) (e844948a0724544176ba0496f9ec476e) [FINISHED]
Apr 11, 2018 1:07:36 AM grizzled.slf4j.Logger info
INFO: Un-registering task and sending final execution state FINISHED to 
JobManager for task PAssert$135/GroupGlobally/GatherAllOutputs/GroupByKey -> 
PAssert$135/GroupGlobally/GatherAllOutputs/Values/Values/Map/ParMultiDo(Anonymous)
 -> 

[beam-site] branch mergebot updated (a49c7b1 -> 8ed8fc8)

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a change to branch mergebot
in repository https://gitbox.apache.org/repos/asf/beam-site.git.


from a49c7b1  This closes #413
 add cc24caa  Prepare repository for deployment.
 add c9cc9ac  parallelise test
 add e95720d  This closes #405
 new 9990581  Fix tox lint command in contribution guide
 new 8ed8fc8  This closes #415

The 2 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 README.md| 2 ++
 Rakefile | 4 +++-
 content/contribute/contribution-guide/index.html | 2 +-
 content/contribute/work-in-progress/index.html   | 2 +-
 4 files changed, 7 insertions(+), 3 deletions(-)

-- 
To stop receiving notification emails like this one, please contact
mergebot-r...@apache.org.

[beam-site] 02/02: This closes #415

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch mergebot
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit 8ed8fc85269a6390f9be234f5e1feca036104f79
Merge: e95720d 9990581
Author: Mergebot 
AuthorDate: Tue Apr 10 18:06:58 2018 -0700

This closes #415

 content/contribute/contribution-guide/index.html | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

-- 
To stop receiving notification emails like this one, please contact
mergebot-r...@apache.org.

[jira] [Work logged] (BEAM-4015) GCS artifact proxy is breaking the build when credentials are not available

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-4015?focusedWorklogId=89731=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-89731
 ]

ASF GitHub Bot logged work on BEAM-4015:


Author: ASF GitHub Bot
Created on: 11/Apr/18 01:01
Start Date: 11/Apr/18 01:01
Worklog Time Spent: 10m 
  Work Description: herohde commented on issue #5095: [BEAM-4015] Always 
update Go dependences in Maven build
URL: https://github.com/apache/beam/pull/5095#issuecomment-380293356
 
 
   @robertwb What test should I run?


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 89731)
Time Spent: 20m  (was: 10m)

> GCS artifact proxy is breaking the build when credentials are not available
> ---
>
> Key: BEAM-4015
> URL: https://issues.apache.org/jira/browse/BEAM-4015
> Project: Beam
>  Issue Type: Bug
>  Components: sdk-go
>Reporter: Ismaël Mejía
>Assignee: Henning Rohde
>Priority: Blocker
> Fix For: 2.5.0
>
>  Time Spent: 20m
>  Remaining Estimate: 0h
>
> When running the maven build in a machine without the valid auth credentials 
> the module breaks like this:
> {code:bash}
> {{[INFO] --- mvn-golang-wrapper:2.1.6:build (go-build) @ 
> beam-runners-gcp-gcsproxy ---}}
> {{[INFO] Prepared command line : bin/go build -buildmode=default -o 
> /home/ismael/upstream/beam/runners/gcp/gcsproxy/target/gcsproxy 
> github.com/apache/beam/cmd/gcsproxy}}
> {{[ERROR] }}
> {{[ERROR] -Exec.Err-}}
> {{[ERROR] # github.com/apache/beam/sdks/go/pkg/beam/util/gcsx}}
> {{[ERROR] github.com/apache/beam/sdks/go/pkg/beam/util/gcsx/gcs.go:46:37: 
> undefined: option.WithoutAuthentication}}
> {{[ERROR] }}
> {{}}
> {{[INFO] Apache Beam :: Runners :: Google Cloud Platform :: GCS artifact 
> proxy FAILURE [  1.038 s]}}
> {{}}
> {{[INFO] BUILD FAILURE}}
> {{}}
> {{[ERROR] Failed to execute goal 
> com.igormaznitsa:mvn-golang-wrapper:2.1.6:build (go-build) on project 
> beam-runners-gcp-gcsproxy: Can't find generated target file : 
> /home/ismael/upstream/beam/runners/gcp/gcsproxy/target/gcsproxy -> [Help 1]}}
> {{[ERROR] }}
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Reopened] (BEAM-4015) GCS artifact proxy is breaking the build when credentials are not available

[Henning Rohde (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-4015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Henning Rohde reopened BEAM-4015:
-

This is also happening on Jenkins, so I'll see if it can be addressed.

> GCS artifact proxy is breaking the build when credentials are not available
> ---
>
> Key: BEAM-4015
> URL: https://issues.apache.org/jira/browse/BEAM-4015
> Project: Beam
>  Issue Type: Bug
>  Components: sdk-go
>Reporter: Ismaël Mejía
>Assignee: Henning Rohde
>Priority: Blocker
> Fix For: 2.5.0
>
>
> When running the maven build in a machine without the valid auth credentials 
> the module breaks like this:
> {code:bash}
> {{[INFO] --- mvn-golang-wrapper:2.1.6:build (go-build) @ 
> beam-runners-gcp-gcsproxy ---}}
> {{[INFO] Prepared command line : bin/go build -buildmode=default -o 
> /home/ismael/upstream/beam/runners/gcp/gcsproxy/target/gcsproxy 
> github.com/apache/beam/cmd/gcsproxy}}
> {{[ERROR] }}
> {{[ERROR] -Exec.Err-}}
> {{[ERROR] # github.com/apache/beam/sdks/go/pkg/beam/util/gcsx}}
> {{[ERROR] github.com/apache/beam/sdks/go/pkg/beam/util/gcsx/gcs.go:46:37: 
> undefined: option.WithoutAuthentication}}
> {{[ERROR] }}
> {{}}
> {{[INFO] Apache Beam :: Runners :: Google Cloud Platform :: GCS artifact 
> proxy FAILURE [  1.038 s]}}
> {{}}
> {{[INFO] BUILD FAILURE}}
> {{}}
> {{[ERROR] Failed to execute goal 
> com.igormaznitsa:mvn-golang-wrapper:2.1.6:build (go-build) on project 
> beam-runners-gcp-gcsproxy: Can't find generated target file : 
> /home/ismael/upstream/beam/runners/gcp/gcsproxy/target/gcsproxy -> [Help 1]}}
> {{[ERROR] }}
> {code}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Jenkins build is back to normal : beam_PostCommit_Java_ValidatesRunner_Spark_Gradle #56

[Apache Jenkins Server]

See 

[beam] 01/01: Merge pull request #5052 Use valid name for fake inspect.ArgSpec args.

[robertwb]

This is an automated email from the ASF dual-hosted git repository.

robertwb pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/beam.git

commit 0aed5433bbcf5f28fb502f1c2b959586aee17fc5
Merge: 74f6bfe 08a1105
Author: Robert Bradshaw 
AuthorDate: Tue Apr 10 17:47:59 2018 -0700

Merge pull request #5052 Use valid name for fake inspect.ArgSpec args.

 sdks/python/apache_beam/transforms/ptransform.py | 2 +-
 sdks/python/apache_beam/typehints/decorators.py  | 2 +-
 2 files changed, 2 insertions(+), 2 deletions(-)

-- 
To stop receiving notification emails like this one, please contact
rober...@apache.org.

Build failed in Jenkins: beam_PerformanceTests_Spark #1575

[Apache Jenkins Server]

See 


Changes:

[tgroh] Make EmptyInputProvider Javadoc more precise

[coheigea] Properly clean up HBase IO test data

[amyrvold] Fix validates container test by changing gradle target name

[1147435+chuanyu] Fix pickling for "recursive" classes.

[swegner] Disable Gradle agent for Jenkins build jobs.

[swegner] fixup! Add common Gradle switches to remaining jobs

[swegner] fixup! Execute switches on the passed-in context object

[swegner] fixup! Fix stale variable in java precommits

--
[...truncated 88.25 KB...]
'apache-beam-testing:bqjob_r5db94ca1566c85e9_0162b2253650_1': Invalid schema
update. Field timestamp has changed type from TIMESTAMP to FLOAT

STDERR: 
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
 UserWarning: You have requested explicit scopes to be used with a GCE service 
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.

  warnings.warn(_SCOPES_WARNING)
Upload complete.Waiting on bqjob_r5db94ca1566c85e9_0162b2253650_1 ... (0s) 
Current status: RUNNING 
 Waiting on 
bqjob_r5db94ca1566c85e9_0162b2253650_1 ... (0s) Current status: DONE   
2018-04-11 00:40:08,004 a6bb3691 MainThread INFO Retrying exception running 
IssueRetryableCommand: Command returned a non-zero exit code.

2018-04-11 00:40:36,452 a6bb3691 MainThread INFO Running: bq load 
--autodetect --source_format=NEWLINE_DELIMITED_JSON 
beam_performance.pkb_results 

2018-04-11 00:40:41,424 a6bb3691 MainThread INFO Ran: {bq load --autodetect 
--source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results 

  ReturnCode:1
STDOUT: 

BigQuery error in load operation: Error processing job
'apache-beam-testing:bqjob_r449e751572fe1750_0162b225b7d6_1': Invalid schema
update. Field timestamp has changed type from TIMESTAMP to FLOAT

STDERR: 
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
 UserWarning: You have requested explicit scopes to be used with a GCE service 
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.

  warnings.warn(_SCOPES_WARNING)
Upload complete.Waiting on bqjob_r449e751572fe1750_0162b225b7d6_1 ... (0s) 
Current status: RUNNING 
 Waiting on 
bqjob_r449e751572fe1750_0162b225b7d6_1 ... (0s) Current status: DONE   
2018-04-11 00:40:41,425 a6bb3691 MainThread INFO Retrying exception running 
IssueRetryableCommand: Command returned a non-zero exit code.

2018-04-11 00:41:08,168 a6bb3691 MainThread INFO Running: bq load 
--autodetect --source_format=NEWLINE_DELIMITED_JSON 
beam_performance.pkb_results 

2018-04-11 00:41:12,009 a6bb3691 MainThread INFO Ran: {bq load --autodetect 
--source_format=NEWLINE_DELIMITED_JSON beam_performance.pkb_results 

  ReturnCode:1
STDOUT: 

BigQuery error in load operation: Error processing job
'apache-beam-testing:bqjob_r326f2e87a09793bb_0162b2262f95_1': Invalid schema
update. Field timestamp has changed type from TIMESTAMP to FLOAT

STDERR: 
/usr/lib/google-cloud-sdk/platform/bq/third_party/oauth2client/contrib/gce.py:73:
 UserWarning: You have requested explicit scopes to be used with a GCE service 
account.
Using this argument will have no effect on the actual scopes for tokens
requested. These scopes are set at VM instance creation time and
can't be overridden in the request.

  warnings.warn(_SCOPES_WARNING)
Upload complete.Waiting on bqjob_r326f2e87a09793bb_0162b2262f95_1 ... (0s) 
Current status: RUNNING 
 Waiting on 
bqjob_r326f2e87a09793bb_0162b2262f95_1 ... (0s) Current status: DONE   
2018-04-11 00:41:12,009 a6bb3691 MainThread INFO Retrying exception running 
IssueRetryableCommand: Command returned a non-zero exit code.

2018-04-11 00:41:40,292 a6bb3691 MainThread INFO Running: bq load 
--autodetect --source_format=NEWLINE_DELIMITED_JSON 
beam_performance.pkb_results 

2018-04-11 00:41:44,611 a6bb3691 

Build failed in Jenkins: beam_PostCommit_Python_ValidatesContainer_Dataflow #98

[Apache Jenkins Server]

See 


--
[...truncated 39.42 KB...]
provide an improved interface to the existing per-instance autoscaling.
  o Promoted --source-snapshot flag of gcloud compute images create
command to beta. This flag allows creating images from snapshots.
  o Promoted --guest-os-features flag of gcloud compute disks create to
beta. This flag allows create disks with additional specified GuestOS
features.
  o Promoted --licenses flag of gcloud compute disks create to GA. This
flag allows create disks with additional specified licenses.

  Container Builder
  o Changed gcloud container builds submit command to no longer create a
.gcloudignore file on disk. Git files are still ignored by default, see
gcloud topic gcloudignore to learn more.

  Container Engine
  o Promoted --accelerator flag of gcloud container clusters create and
gcloud container node-pools create to beta.

  Container Registry
  o Removed public read-only endpoints from default registries used by
gcloud docker and docker-credential-gcloud for authentication.

  Kubernetes Engine
  o Fixed an issue causing relative KUBECONFIG paths to fail when used
with the gcloud container clusters get-credentials command.

  Miscellaneous
  o Fixed crash when attempting to use a SOCKS proxy
https://issuetracker.google.com/72407295
(https://issuetracker.google.com/72407295).

##
#= Creating update staging area =#
##
#= Uninstalling: BigQuery Command Line Tool =#
##
#= Uninstalling: Cloud SDK Core Libraries   =#
##
#= Uninstalling: Cloud SDK Core Libraries (Platform Spec... =#
##
#= Uninstalling: Cloud Storage Command Line Tool=#
##
#= Uninstalling: gcloud cli dependencies=#
##
#= Installing: BigQuery Command Line Tool   =#
##
#= Installing: Cloud SDK Core Libraries =#
##
#= Installing: Cloud SDK Core Libraries (Platform Specific) =#
##
#= Installing: Cloud Storage Command Line Tool  =#
##
#= Installing: gcloud cli dependencies  =#
##
#= Creating backup and activating new installation  =#
##

Performing post processing steps...
done.

Update done!

To revert your SDK to the previously installed version, you may run:
  $ gcloud components update --version 186.0.0

WARNING:   There are older versions of Google Cloud Platform tools on your 
system PATH.
  Please remove the following to avoid accidentally invoking these old tools:

  /usr/lib/google-cloud-sdk/bin/git-credential-gcloud.sh
/usr/lib/google-cloud-sdk/bin/gsutil
/usr/lib/google-cloud-sdk/bin/bq
/usr/lib/google-cloud-sdk/bin/gcloud

  
Google Cloud SDK 197.0.0
bq 2.0.31
core 2018.04.06
gsutil 4.30

# Build the container
TAG=$(date +%Y%m%d-%H%M%S)
date +%Y%m%d-%H%M%S
CONTAINER=us.gcr.io/$PROJECT/$USER/python
echo "Using container $CONTAINER"
Using container us.gcr.io/apache-beam-testing/jenkins/python
./gradlew :beam-sdks-python-container:docker 
-Pdocker-repository-root=us.gcr.io/$PROJECT/$USER -Pdocker-tag=$TAG
Parallel execution with configuration on demand is an incubating feature.
Applying build_rules.gradle to beam
Adding 47 .gitignore exclusions to Apache Rat
Applying build_rules.gradle to beam-sdks-python-container
applyGoNature with default configuration for project beam-sdks-python-container
applyDockerNature with default configuration for project 
beam-sdks-python-container
containerImageName with [name:python] for project beam-sdks-python-container
Applying build_rules.gradle to beam-sdks-go
applyGoNature with default configuration for project beam-sdks-go
:beam-sdks-python-container:prepare
:beam-sdks-go:prepare
Use project GOPATH: 

Use project GOPATH: 

Build failed in Jenkins: beam_PostCommit_Python_Verify #4653

[Apache Jenkins Server]

See 


Changes:

[1147435+chuanyu] Fix pickling for "recursive" classes.

--
[...truncated 1.04 MB...]
copying apache_beam/runners/job/__init__.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/job
copying apache_beam/runners/job/manager.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/job
copying apache_beam/runners/job/utils.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/job
copying apache_beam/runners/portability/__init__.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/portability
copying apache_beam/runners/portability/fn_api_runner.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/portability
copying apache_beam/runners/portability/fn_api_runner_test.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/portability
copying apache_beam/runners/portability/universal_local_runner.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/portability
copying apache_beam/runners/portability/universal_local_runner_main.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/portability
copying apache_beam/runners/portability/universal_local_runner_test.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/portability
copying apache_beam/runners/test/__init__.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/test
copying apache_beam/runners/worker/__init__.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/bundle_processor.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/data_plane.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/data_plane_test.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/log_handler.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/log_handler_test.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/logger.pxd -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/logger.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/logger_test.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/opcounters.pxd -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/opcounters.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/opcounters_test.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/operation_specs.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/operations.pxd -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/operations.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/sdk_worker.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/sdk_worker_main.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/sdk_worker_main_test.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/sdk_worker_test.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/sideinputs.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/sideinputs_test.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/statesampler.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/statesampler_fast.pyx -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/statesampler_slow.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/statesampler_test.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/worker_id_interceptor.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/worker_id_interceptor_test.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/testing/__init__.py -> 
apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/pipeline_verifiers.py -> 
apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/pipeline_verifiers_test.py -> 
apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/test_pipeline.py -> 
apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/test_pipeline_test.py -> 
apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/test_stream.py -> 
apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/test_stream_test.py -> 
apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/test_utils.py -> 
apache-beam-2.5.0.dev0/apache_beam/testing
copying 

Build failed in Jenkins: beam_PerformanceTests_MongoDBIO_IT #35

[Apache Jenkins Server]

See 


Changes:

[tgroh] Make EmptyInputProvider Javadoc more precise

[coheigea] Properly clean up HBase IO test data

[amyrvold] Fix validates container test by changing gradle target name

[1147435+chuanyu] Fix pickling for "recursive" classes.

[swegner] Disable Gradle agent for Jenkins build jobs.

[swegner] fixup! Add common Gradle switches to remaining jobs

[swegner] fixup! Execute switches on the passed-in context object

[swegner] fixup! Fix stale variable in java precommits

--
[...truncated 80.96 KB...]
at java.lang.Thread.run(Thread.java:745)
Caused by: com.mongodb.MongoTimeoutException: Timed out after 3 ms while 
waiting for a server that matches 
ReadPreferenceServerSelector{readPreference=primary}. Client view of cluster 
state is {type=UNKNOWN, servers=[{address=35.224.56.11:27017, type=UNKNOWN, 
state=CONNECTING, exception={com.mongodb.MongoSocketOpenException: Exception 
opening socket}, caused by {java.net.SocketTimeoutException: connect timed 
out}}]
at 
com.mongodb.connection.BaseCluster.createTimeoutException(BaseCluster.java:369)
at com.mongodb.connection.BaseCluster.selectServer(BaseCluster.java:101)
at 
com.mongodb.binding.ClusterBinding$ClusterBindingConnectionSource.(ClusterBinding.java:75)
at 
com.mongodb.binding.ClusterBinding$ClusterBindingConnectionSource.(ClusterBinding.java:71)
at 
com.mongodb.binding.ClusterBinding.getReadConnectionSource(ClusterBinding.java:63)
at 
com.mongodb.operation.OperationHelper.withConnection(OperationHelper.java:210)
at com.mongodb.operation.FindOperation.execute(FindOperation.java:482)
at com.mongodb.operation.FindOperation.execute(FindOperation.java:79)
at com.mongodb.Mongo.execute(Mongo.java:772)
at com.mongodb.Mongo$2.execute(Mongo.java:759)
at com.mongodb.OperationIterable.iterator(OperationIterable.java:47)
at com.mongodb.FindIterableImpl.iterator(FindIterableImpl.java:143)
at 
org.apache.beam.sdk.io.mongodb.MongoDbIO$BoundedMongoDbReader.start(MongoDbIO.java:456)
at 
com.google.cloud.dataflow.worker.WorkerCustomSources$BoundedReaderIterator.start(WorkerCustomSources.java:592)
... 14 more
java.io.IOException: Failed to start reading from source: 
org.apache.beam.sdk.io.mongodb.MongoDbIO$BoundedMongoDbSource@4e5324e2
at 
com.google.cloud.dataflow.worker.WorkerCustomSources$BoundedReaderIterator.start(WorkerCustomSources.java:595)
at 
com.google.cloud.dataflow.worker.util.common.worker.ReadOperation$SynchronizedReaderIterator.start(ReadOperation.java:341)
at 
com.google.cloud.dataflow.worker.util.common.worker.ReadOperation.runReadLoop(ReadOperation.java:185)
at 
com.google.cloud.dataflow.worker.util.common.worker.ReadOperation.start(ReadOperation.java:150)
at 
com.google.cloud.dataflow.worker.util.common.worker.MapTaskExecutor.execute(MapTaskExecutor.java:74)
at 
com.google.cloud.dataflow.worker.BatchDataflowWorker.executeWork(BatchDataflowWorker.java:381)
at 
com.google.cloud.dataflow.worker.BatchDataflowWorker.doWork(BatchDataflowWorker.java:353)
at 
com.google.cloud.dataflow.worker.BatchDataflowWorker.getAndPerformWork(BatchDataflowWorker.java:284)
at 
com.google.cloud.dataflow.worker.DataflowBatchWorkerHarness$WorkerThread.doWork(DataflowBatchWorkerHarness.java:134)
at 
com.google.cloud.dataflow.worker.DataflowBatchWorkerHarness$WorkerThread.call(DataflowBatchWorkerHarness.java:114)
at 
com.google.cloud.dataflow.worker.DataflowBatchWorkerHarness$WorkerThread.call(DataflowBatchWorkerHarness.java:101)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: com.mongodb.MongoTimeoutException: Timed out after 3 ms while 
waiting for a server that matches 
ReadPreferenceServerSelector{readPreference=primary}. Client view of cluster 
state is {type=UNKNOWN, servers=[{address=35.224.56.11:27017, type=UNKNOWN, 
state=CONNECTING, exception={com.mongodb.MongoSocketOpenException: Exception 
opening socket}, caused by {java.net.SocketTimeoutException: connect timed 
out}}]
at 
com.mongodb.connection.BaseCluster.createTimeoutException(BaseCluster.java:369)
at com.mongodb.connection.BaseCluster.selectServer(BaseCluster.java:101)
at 
com.mongodb.binding.ClusterBinding$ClusterBindingConnectionSource.(ClusterBinding.java:75)
at 
com.mongodb.binding.ClusterBinding$ClusterBindingConnectionSource.(ClusterBinding.java:71)
at 
com.mongodb.binding.ClusterBinding.getReadConnectionSource(ClusterBinding.java:63)
   

[jira] [Commented] (BEAM-3407) Post-commit test fails with "Backing channel 'beam8' is disconnected"

[Robert Bradshaw (JIRA)]

[ 
https://issues.apache.org/jira/browse/BEAM-3407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16433219#comment-16433219
 ] 

Robert Bradshaw commented on BEAM-3407:
---

This is still happening, e.g.

[https://builds.apache.org/job/beam_PostCommit_Java_GradleBuild/31/console]

https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Dataflow_Gradle/34/console

> Post-commit test fails with "Backing channel 'beam8' is disconnected"
> -
>
> Key: BEAM-3407
> URL: https://issues.apache.org/jira/browse/BEAM-3407
> Project: Beam
>  Issue Type: Bug
>  Components: testing
>Reporter: Henning Rohde
>Assignee: Jason Kuster
>Priority: Major
>
> Example failure below.
> https://builds.apache.org/job/beam_PostCommit_Java_ValidatesRunner_Spark/3809/console
> ...
> 2018-01-02T22:46:30.423 [INFO] Excluding io.grpc:grpc-protobuf-lite:jar:1.2.0 
> from the shaded jar.
> 2018-01-02T22:46:30.423 [INFO] Excluding io.grpc:grpc-stub:jar:1.2.0 from the 
> shaded jar.
> ERROR: Failed to parse POMs
> java.io.IOException: Backing channel 'beam8' is disconnected.
>   at 
> hudson.remoting.RemoteInvocationHandler.channelOrFail(RemoteInvocationHandler.java:212)
>   at 
> hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:281)
>   at com.sun.proxy.$Proxy131.isAlive(Unknown Source)
>   at hudson.Launcher$RemoteLauncher$ProcImpl.isAlive(Launcher.java:1138)
>   at hudson.maven.ProcessCache$MavenProcess.call(ProcessCache.java:166)
>   at 
> hudson.maven.MavenModuleSetBuild$MavenModuleSetBuildExecution.doRun(MavenModuleSetBuild.java:879)
>   at 
> hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:504)
>   at hudson.model.Run.execute(Run.java:1724)
>   at hudson.maven.MavenModuleSetBuild.run(MavenModuleSetBuild.java:543)
>   at hudson.model.ResourceController.execute(ResourceController.java:97)
>   at hudson.model.Executor.run(Executor.java:421)
> Caused by: java.io.IOException: Unexpected termination of the channel
>   at 
> hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:77)
> Caused by: java.io.EOFException
>   at 
> java.io.ObjectInputStream$PeekInputStream.readFully(ObjectInputStream.java:2675)
>   at 
> java.io.ObjectInputStream$BlockDataInputStream.readShort(ObjectInputStream.java:3150)
>   at 
> java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:859)
>   at java.io.ObjectInputStream.(ObjectInputStream.java:355)
>   at 
> hudson.remoting.ObjectInputStreamEx.(ObjectInputStreamEx.java:48)
>   at 
> hudson.remoting.AbstractSynchronousByteArrayCommandTransport.read(AbstractSynchronousByteArrayCommandTransport.java:35)
>   at 
> hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:63)
> ERROR: Step ‘E-mail Notification’ failed: no workspace for 
> beam_PostCommit_Java_ValidatesRunner_Spark #3809
> ERROR: beam8 is offline; cannot locate JDK 1.8 (latest)
> ERROR: beam8 is offline; cannot locate Maven 3.3.3
> Finished: FAILURE



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Build failed in Jenkins: beam_PerformanceTests_HadoopInputFormat #126

[Apache Jenkins Server]

See 


Changes:

[tgroh] Make EmptyInputProvider Javadoc more precise

[coheigea] Properly clean up HBase IO test data

[amyrvold] Fix validates container test by changing gradle target name

[1147435+chuanyu] Fix pickling for "recursive" classes.

[swegner] Disable Gradle agent for Jenkins build jobs.

[swegner] fixup! Add common Gradle switches to remaining jobs

[swegner] fixup! Execute switches on the passed-in context object

[swegner] fixup! Fix stale variable in java precommits

--
[...truncated 86.33 KB...]
[INFO] Excluding com.google.api.grpc:proto-google-longrunning-v1:jar:0.1.11 
from the shaded jar.
[INFO] Excluding com.google.cloud.bigtable:bigtable-protos:jar:1.0.0-pre3 from 
the shaded jar.
[INFO] Excluding com.google.cloud.bigtable:bigtable-client-core:jar:1.0.0 from 
the shaded jar.
[INFO] Excluding com.google.auth:google-auth-library-appengine:jar:0.7.0 from 
the shaded jar.
[INFO] Excluding io.opencensus:opencensus-contrib-grpc-util:jar:0.7.0 from the 
shaded jar.
[INFO] Excluding io.opencensus:opencensus-api:jar:0.7.0 from the shaded jar.
[INFO] Excluding 
com.google.api.grpc:proto-google-cloud-spanner-admin-database-v1:jar:0.1.9 from 
the shaded jar.
[INFO] Excluding com.google.api.grpc:proto-google-common-protos:jar:0.1.9 from 
the shaded jar.
[INFO] Excluding io.grpc:grpc-all:jar:1.2.0 from the shaded jar.
[INFO] Excluding io.grpc:grpc-okhttp:jar:1.2.0 from the shaded jar.
[INFO] Excluding com.squareup.okhttp:okhttp:jar:2.5.0 from the shaded jar.
[INFO] Excluding com.squareup.okio:okio:jar:1.6.0 from the shaded jar.
[INFO] Excluding io.grpc:grpc-protobuf-lite:jar:1.2.0 from the shaded jar.
[INFO] Excluding io.grpc:grpc-protobuf-nano:jar:1.2.0 from the shaded jar.
[INFO] Excluding com.google.protobuf.nano:protobuf-javanano:jar:3.0.0-alpha-5 
from the shaded jar.
[INFO] Excluding io.netty:netty-tcnative-boringssl-static:jar:1.1.33.Fork26 
from the shaded jar.
[INFO] Excluding 
org.apache.beam:beam-runners-core-construction-java:jar:2.5.0-SNAPSHOT from the 
shaded jar.
[INFO] Excluding org.apache.beam:beam-model-job-management:jar:2.5.0-SNAPSHOT 
from the shaded jar.
[INFO] Excluding com.google.protobuf:protobuf-java-util:jar:3.2.0 from the 
shaded jar.
[INFO] Excluding com.google.api-client:google-api-client:jar:1.22.0 from the 
shaded jar.
[INFO] Excluding com.google.oauth-client:google-oauth-client:jar:1.22.0 from 
the shaded jar.
[INFO] Excluding com.google.http-client:google-http-client:jar:1.22.0 from the 
shaded jar.
[INFO] Excluding com.google.http-client:google-http-client-jackson2:jar:1.22.0 
from the shaded jar.
[INFO] Excluding 
com.google.apis:google-api-services-dataflow:jar:v1b3-rev221-1.22.0 from the 
shaded jar.
[INFO] Excluding 
com.google.apis:google-api-services-clouddebugger:jar:v2-rev8-1.22.0 from the 
shaded jar.
[INFO] Excluding 
com.google.apis:google-api-services-storage:jar:v1-rev71-1.22.0 from the shaded 
jar.
[INFO] Excluding com.google.auth:google-auth-library-credentials:jar:0.7.1 from 
the shaded jar.
[INFO] Excluding com.google.auth:google-auth-library-oauth2-http:jar:0.7.1 from 
the shaded jar.
[INFO] Excluding com.google.cloud.bigdataoss:util:jar:1.4.5 from the shaded jar.
[INFO] Excluding com.google.api-client:google-api-client-java6:jar:1.22.0 from 
the shaded jar.
[INFO] Excluding com.google.api-client:google-api-client-jackson2:jar:1.22.0 
from the shaded jar.
[INFO] Excluding com.google.oauth-client:google-oauth-client-java6:jar:1.22.0 
from the shaded jar.
[INFO] Replacing original artifact with shaded artifact.
[INFO] Replacing 

 with 

[INFO] Replacing original test artifact with shaded test artifact.
[INFO] Replacing 

 with 

[INFO] Dependency-reduced POM written at: 

[INFO] 
[INFO] --- maven-failsafe-plugin:2.21.0:integration-test (default) @ 
beam-sdks-java-io-hadoop-input-format ---
[INFO] Failsafe report directory: 

Build failed in Jenkins: beam_PostCommit_Java_ValidatesRunner_Spark_Gradle #55

[Apache Jenkins Server]

See 


Changes:

[1147435+chuanyu] Fix pickling for "recursive" classes.

--
[...truncated 1.60 MB...]
at 
org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:457)
at scala.collection.immutable.List.foreach(List.scala:392)
at org.apache.spark.SparkContext.(SparkContext.scala:457)
at 
org.apache.spark.api.java.JavaSparkContext.(JavaSparkContext.scala:58)
at 
org.apache.beam.runners.spark.translation.SparkContextFactory.createSparkContext(SparkContextFactory.java:103)
at 
org.apache.beam.runners.spark.translation.SparkContextFactory.getSparkContext(SparkContextFactory.java:68)
at 
org.apache.beam.runners.spark.translation.streaming.SparkRunnerStreamingContextFactory.call(SparkRunnerStreamingContextFactory.java:79)
at 
org.apache.beam.runners.spark.translation.streaming.SparkRunnerStreamingContextFactory.call(SparkRunnerStreamingContextFactory.java:47)
at 
org.apache.spark.streaming.api.java.JavaStreamingContext$$anonfun$7.apply(JavaStreamingContext.scala:627)
at 
org.apache.spark.streaming.api.java.JavaStreamingContext$$anonfun$7.apply(JavaStreamingContext.scala:626)
at scala.Option.getOrElse(Option.scala:121)
at 
org.apache.spark.streaming.StreamingContext$.getOrCreate(StreamingContext.scala:828)
at 
org.apache.spark.streaming.api.java.JavaStreamingContext$.getOrCreate(JavaStreamingContext.scala:626)
at 
org.apache.spark.streaming.api.java.JavaStreamingContext.getOrCreate(JavaStreamingContext.scala)
at org.apache.beam.runners.spark.SparkRunner.run(SparkRunner.java:169)
at 
org.apache.beam.runners.spark.TestSparkRunner.run(TestSparkRunner.java:123)
at 
org.apache.beam.runners.spark.TestSparkRunner.run(TestSparkRunner.java:83)
at org.apache.beam.sdk.Pipeline.run(Pipeline.java:311)
at org.apache.beam.sdk.testing.TestPipeline.run(TestPipeline.java:346)
at org.apache.beam.sdk.testing.TestPipeline.run(TestPipeline.java:328)
at 
org.apache.beam.runners.spark.translation.streaming.CreateStreamTest.testDiscardingMode(CreateStreamTest.java:203)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at 
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
at 
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at 
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
at 
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
at 
org.apache.beam.sdk.testing.TestPipeline$1.evaluate(TestPipeline.java:317)
at 
org.junit.rules.ExpectedException$ExpectedExceptionStatement.evaluate(ExpectedException.java:239)
at org.junit.rules.RunRules.evaluate(RunRules.java:20)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
at 
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
at 
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
at 
org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.runTestClass(JUnitTestClassExecuter.java:114)
at 
org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.execute(JUnitTestClassExecuter.java:57)
at 
org.gradle.api.internal.tasks.testing.junit.JUnitTestClassProcessor.processTestClass(JUnitTestClassProcessor.java:66)
at 
org.gradle.api.internal.tasks.testing.SuiteTestClassProcessor.processTestClass(SuiteTestClassProcessor.java:51)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at 
org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
at 

[jira] [Work logged] (BEAM-3339) Create post-release testing of the nightly snapshots

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-3339?focusedWorklogId=89720=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-89720
 ]

ASF GitHub Bot logged work on BEAM-3339:


Author: ASF GitHub Bot
Created on: 10/Apr/18 23:59
Start Date: 10/Apr/18 23:59
Worklog Time Spent: 10m 
  Work Description: yifanzou commented on issue #4788: [BEAM-3339] Mobile 
gaming automation for Java nightly snapshot on core runners
URL: https://github.com/apache/beam/pull/4788#issuecomment-380284134
 
 
   Run Dataflow PostRelease


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 89720)
Time Spent: 89h 50m  (was: 89h 40m)

> Create post-release testing of the nightly snapshots
> 
>
> Key: BEAM-3339
> URL: https://issues.apache.org/jira/browse/BEAM-3339
> Project: Beam
>  Issue Type: Improvement
>  Components: testing
>Reporter: Alan Myrvold
>Assignee: Jason Kuster
>Priority: Major
>  Time Spent: 89h 50m
>  Remaining Estimate: 0h
>
> The nightly java snapshots in 
> https://repository.apache.org/content/groups/snapshots/org/apache/beam should 
> be verified by following the 
> https://beam.apache.org/get-started/quickstart-java/ instructions, to verify 
> that the release is usable.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work logged] (BEAM-4044) Take advantage of Calcite DDL

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-4044?focusedWorklogId=89717=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-89717
 ]

ASF GitHub Bot logged work on BEAM-4044:


Author: ASF GitHub Bot
Created on: 10/Apr/18 23:46
Start Date: 10/Apr/18 23:46
Worklog Time Spent: 10m 
  Work Description: apilloud commented on a change in pull request #5040: 
[BEAM-4044] [SQL] Refresh DDL from 1.16
URL: https://github.com/apache/beam/pull/5040#discussion_r180599529
 
 

 ##
 File path: 
sdks/java/extensions/sql/src/test/java/org/apache/beam/sdk/extensions/sql/meta/provider/kafka/KafkaTableProviderTest.java
 ##
 @@ -65,17 +64,17 @@ private static Table mockTable(String name) {
 return Table.builder()
 .name(name)
 .comment(name + " table")
-.location(URI.create("kafka://localhost:2181/brokers?topic=test"))
+.location("kafka://localhost:2181/brokers?topic=test")
 
 Review comment:
   The DDL already requires a type. Syntax for this looks something like 
`CREATE TABLE mytable TYPE kafka LOCATION 
"kafka://localhost:2181/brokers?topic=test"`
   
   PR #4991 links to #4947 which adds bigquery. I was honestly expecting both 
to be merged before this one was reviewed, but I haven't been able to get 
reviews on #4991.


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 89717)
Time Spent: 1h 40m  (was: 1.5h)

> Take advantage of Calcite DDL
> -
>
> Key: BEAM-4044
> URL: https://issues.apache.org/jira/browse/BEAM-4044
> Project: Beam
>  Issue Type: New Feature
>  Components: dsl-sql
>Reporter: Andrew Pilloud
>Assignee: Andrew Pilloud
>Priority: Major
>  Time Spent: 1h 40m
>  Remaining Estimate: 0h
>
> In Calcite 1.15 support for abstract DDL moved into calcite core. We should 
> take advantage of that.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Jenkins build is back to normal : beam_PostCommit_Java_ValidatesRunner_Flink_Gradle #71

[Apache Jenkins Server]

See 

[jira] [Work logged] (BEAM-3036) Checkstyle error in IntelliJ

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-3036?focusedWorklogId=89718=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-89718
 ]

ASF GitHub Bot logged work on BEAM-3036:


Author: ASF GitHub Bot
Created on: 10/Apr/18 23:46
Start Date: 10/Apr/18 23:46
Worklog Time Spent: 10m 
  Work Description: youngoli opened a new pull request #5094: [BEAM-3036] 
Fixing Checkstyle error in IntelliJ.
URL: https://github.com/apache/beam/pull/5094
 
 
   It seems that recent versions of Checkstyle have broken the script
   so that Checkstyle is not properly loaded in IntelliJ. This change
   updates the Checkstyle file.
   
   The error had to do with the SuppressionCommentFilter not allowed to be a 
child of TreeWalker so I moved it outside of TreeWalker and Checkstyle now 
seems to work in my IntelliJ.
   
   
   
   Follow this checklist to help us incorporate your contribution quickly and 
easily:
   
- [x] Make sure there is a [JIRA 
issue](https://issues.apache.org/jira/projects/BEAM/issues/) filed for the 
change (usually before you start working on it).  Trivial changes like typos do 
not require a JIRA issue.  Your pull request should address just this issue, 
without pulling in other changes.
- [x] Format the pull request title like `[BEAM-XXX] Fixes bug in 
ApproximateQuantiles`, where you replace `BEAM-XXX` with the appropriate JIRA 
issue.
- [x] Write a pull request description that is detailed enough to 
understand:
  - [x] What the pull request does
  - [x] Why it does it
  - [x] How it does it
  - [x] Why this approach
- [x] Each commit in the pull request should have a meaningful subject line 
and body.
- [x] Run `mvn clean verify` to make sure basic checks pass. A more 
thorough check will be performed on your pull request automatically.
- [ ] If this contribution is large, please file an Apache [Individual 
Contributor License Agreement](https://www.apache.org/licenses/icla.pdf).
   
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 89718)
Time Spent: 10m
Remaining Estimate: 0h

> Checkstyle error in IntelliJ
> 
>
> Key: BEAM-3036
> URL: https://issues.apache.org/jira/browse/BEAM-3036
> Project: Beam
>  Issue Type: Task
>  Components: website
>Reporter: Kwang-in (Dennis) JUNG
>Assignee: Daniel Oliveira
>Priority: Trivial
>  Time Spent: 10m
>  Remaining Estimate: 0h
>
> Hello.
> I'm following Beam contribution guide, and encountered at some bug when 
> setting checkstyle.
> 1.Install the “Checkstyle-IDEA” plugin from the IntelliJ plugin repository.
> 2.Configure the plugin by going to Settings -> Other Settings -> Checkstyle.
> 3.Set the “Scan Scope” to “Only Java sources (including tests)”.
> 4.In the “Configuration File” pane, add a new configuration using the plus 
> icon:
>   4-1.Set the “Description” to “Beam”.
>   4-2.Select “Use a local Checkstyle file”, and point it to 
> “sdks/java/build-tools/src/main/resources/beam/checkstyle.xml” within your 
> repository.
>   4-3.Check the box for “Store relative to project location”, and click 
> “Next”.
>   4-4.Configure the “checkstyle.suppressions.file” property value to 
> “suppressions.xml”, and click “Next”, then “Finish”.
> After I click Next in 4-4, it shows error below in dialog box.
> ```
> org.infernus.idea.checkstyle.exception.CheckStylePluginException: 
> The Checkstyle rules file could not be 
> parsed.SuppressionCommentFilter is not allowed as a child in 
> CheckerThe file has been blacklisted for 60s.
>   at 
> org.infernus.idea.checkstyle.checker.CheckerFactory.blacklistAndShowMessage(CheckerFactory.java:198)
>   at 
> org.infernus.idea.checkstyle.checker.CheckerFactory.blacklistAndShowMessage(CheckerFactory.java:214)
>   at 
> org.infernus.idea.checkstyle.checker.CheckerFactory.createChecker(CheckerFactory.java:146)
>   at 
> org.infernus.idea.checkstyle.checker.CheckerFactory.getOrCreateCachedChecker(CheckerFactory.java:74)
>   at 
> org.infernus.idea.checkstyle.checker.CheckerFactory.checker(CheckerFactory.java:56)
>   at 
> org.infernus.idea.checkstyle.checker.CheckerFactory.verify(CheckerFactory.java:43)
>   at 
> org.infernus.idea.checkstyle.ui.LocationDialogue.attemptLoadOfFile(LocationDialogue.java:205)
>   at 
> org.infernus.idea.checkstyle.ui.LocationDialogue.access$800(LocationDialogue.java:35)
>   at 
> 

[jira] [Work logged] (BEAM-4036) Pickler enters infinite recursion with self-referential classes

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-4036?focusedWorklogId=89714=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-89714
 ]

ASF GitHub Bot logged work on BEAM-4036:


Author: ASF GitHub Bot
Created on: 10/Apr/18 23:43
Start Date: 10/Apr/18 23:43
Worklog Time Spent: 10m 
  Work Description: aaltay closed pull request #5072: [BEAM-4036] Fix 
pickling for "recursive" classes.
URL: https://github.com/apache/beam/pull/5072
 
 
   

This is a PR merged from a forked repository.
As GitHub hides the original diff on merge, it is displayed below for
the sake of provenance:

As this is a foreign pull request (from a fork), the diff is supplied
below (as it won't show otherwise due to GitHub magic):

diff --git a/sdks/python/apache_beam/internal/module_test.py 
b/sdks/python/apache_beam/internal/module_test.py
index c7bb320253a..be34ac27e25 100644
--- a/sdks/python/apache_beam/internal/module_test.py
+++ b/sdks/python/apache_beam/internal/module_test.py
@@ -61,3 +61,15 @@ def get(self):
 
 
 XYZ_OBJECT = Xyz()
+
+
+class RecursiveClass(object):
+  """A class that contains a reference to itself."""
+
+  SELF_TYPE = None
+
+  def __init__(self, datum):
+self.datum = 'RecursiveClass:%s' % datum
+
+
+RecursiveClass.SELF_TYPE = RecursiveClass
diff --git a/sdks/python/apache_beam/internal/pickler.py 
b/sdks/python/apache_beam/internal/pickler.py
index 102cf23877d..3e4fe05974b 100644
--- a/sdks/python/apache_beam/internal/pickler.py
+++ b/sdks/python/apache_beam/internal/pickler.py
@@ -46,9 +46,14 @@ def _is_nested_class(cls):
 
 
 def _find_containing_class(nested_class):
-  """Finds containing class of a nestec class passed as argument."""
+  """Finds containing class of a nested class passed as argument."""
+
+  seen = set()
 
   def _find_containing_class_inner(outer):
+if outer in seen:
+  return None
+seen.add(outer)
 for k, v in outer.__dict__.items():
   if v is nested_class:
 return outer, k
diff --git a/sdks/python/apache_beam/internal/pickler_test.py 
b/sdks/python/apache_beam/internal/pickler_test.py
index 05062d282da..e75dac38462 100644
--- a/sdks/python/apache_beam/internal/pickler_test.py
+++ b/sdks/python/apache_beam/internal/pickler_test.py
@@ -80,6 +80,10 @@ def test_generators(self):
 with self.assertRaises(TypeError):
   dumps((_ for _ in range(10)))
 
+  def test_recursive_class(self):
+self.assertEquals('RecursiveClass:abc',
+  loads(dumps(module_test.RecursiveClass('abc').datum)))
+
 
 if __name__ == '__main__':
   unittest.main()


 


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 89714)
Time Spent: 1h 10m  (was: 1h)

> Pickler enters infinite recursion with self-referential classes
> ---
>
> Key: BEAM-4036
> URL: https://issues.apache.org/jira/browse/BEAM-4036
> Project: Beam
>  Issue Type: Bug
>  Components: sdk-py-core
>Reporter: Chuan Yu Foo
>Assignee: Ahmet Altay
>Priority: Major
>  Time Spent: 1h 10m
>  Remaining Estimate: 0h
>
> The pickler recurses infinitely and dies with maximum recursion limit 
> exceeded when a module contains a self-referential class (or any class which 
> is part of a cycle).
> Here's a minimal example: 
> {code}
> class RecursiveClass(object):
>  SELF_TYPE = None
>  def __init__(self, datum)
>self.datum = 'RecursiveClass:%s' % datum
> RecursiveClass.SELF_TYPE = RecursiveClass
> {code}
> If this is in a module, then the pickler will enter the infinite recursion 
> when trying to pickle any nested class in that module.
>   
> An actual example is with typing.Type, which is part of a cycle typing.Type 
> -> type -> object -> typing.Type. If a module contains an attribute that 
> refers to typing.Type, such as a type alias, it will trigger this bug.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work logged] (BEAM-4035) Spark validatesRunner fails, ResumeFromCheckpointStreamingTest > classMethod FAILED java.lang.NoClassDefFoundError: org/apache/zookeeper/server/NIOServerCnxnFactory

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-4035?focusedWorklogId=89715=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-89715
 ]

ASF GitHub Bot logged work on BEAM-4035:


Author: ASF GitHub Bot
Created on: 10/Apr/18 23:43
Start Date: 10/Apr/18 23:43
Worklog Time Spent: 10m 
  Work Description: alanmyrvold commented on issue #5093: Testing (don't 
submit[BEAM-4035] Fix spark validatesrunner
URL: https://github.com/apache/beam/pull/5093#issuecomment-380281502
 
 
   Run Spark ValidatesRunner


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 89715)
Time Spent: 1h  (was: 50m)

> Spark validatesRunner fails, ResumeFromCheckpointStreamingTest > classMethod 
> FAILED java.lang.NoClassDefFoundError: 
> org/apache/zookeeper/server/NIOServerCnxnFactory
> 
>
> Key: BEAM-4035
> URL: https://issues.apache.org/jira/browse/BEAM-4035
> Project: Beam
>  Issue Type: Bug
>  Components: runner-spark
>Reporter: Alan Myrvold
>Assignee: Alan Myrvold
>Priority: Major
>  Time Spent: 1h
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work logged] (BEAM-4035) Spark validatesRunner fails, ResumeFromCheckpointStreamingTest > classMethod FAILED java.lang.NoClassDefFoundError: org/apache/zookeeper/server/NIOServerCnxnFactory

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-4035?focusedWorklogId=89712=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-89712
 ]

ASF GitHub Bot logged work on BEAM-4035:


Author: ASF GitHub Bot
Created on: 10/Apr/18 23:42
Start Date: 10/Apr/18 23:42
Worklog Time Spent: 10m 
  Work Description: alanmyrvold opened a new pull request #5093: Testing 
(don't submit[BEAM-4035] Fix spark validatesrunner
URL: https://github.com/apache/beam/pull/5093
 
 
   DESCRIPTION HERE
   
   
   
   Follow this checklist to help us incorporate your contribution quickly and 
easily:
   
- [ ] Make sure there is a [JIRA 
issue](https://issues.apache.org/jira/projects/BEAM/issues/) filed for the 
change (usually before you start working on it).  Trivial changes like typos do 
not require a JIRA issue.  Your pull request should address just this issue, 
without pulling in other changes.
- [ ] Format the pull request title like `[BEAM-XXX] Fixes bug in 
ApproximateQuantiles`, where you replace `BEAM-XXX` with the appropriate JIRA 
issue.
- [ ] Write a pull request description that is detailed enough to 
understand:
  - [ ] What the pull request does
  - [ ] Why it does it
  - [ ] How it does it
  - [ ] Why this approach
- [ ] Each commit in the pull request should have a meaningful subject line 
and body.
- [ ] Run `mvn clean verify` to make sure basic checks pass. A more 
thorough check will be performed on your pull request automatically.
- [ ] If this contribution is large, please file an Apache [Individual 
Contributor License Agreement](https://www.apache.org/licenses/icla.pdf).
   
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 89712)
Time Spent: 50m  (was: 40m)

> Spark validatesRunner fails, ResumeFromCheckpointStreamingTest > classMethod 
> FAILED java.lang.NoClassDefFoundError: 
> org/apache/zookeeper/server/NIOServerCnxnFactory
> 
>
> Key: BEAM-4035
> URL: https://issues.apache.org/jira/browse/BEAM-4035
> Project: Beam
>  Issue Type: Bug
>  Components: runner-spark
>Reporter: Alan Myrvold
>Assignee: Alan Myrvold
>Priority: Major
>  Time Spent: 50m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Assigned] (BEAM-3036) Checkstyle error in IntelliJ

[Daniel Oliveira (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-3036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Daniel Oliveira reassigned BEAM-3036:
-

Assignee: Daniel Oliveira  (was: Reuven Lax)

> Checkstyle error in IntelliJ
> 
>
> Key: BEAM-3036
> URL: https://issues.apache.org/jira/browse/BEAM-3036
> Project: Beam
>  Issue Type: Task
>  Components: website
>Reporter: Kwang-in (Dennis) JUNG
>Assignee: Daniel Oliveira
>Priority: Trivial
>
> Hello.
> I'm following Beam contribution guide, and encountered at some bug when 
> setting checkstyle.
> 1.Install the “Checkstyle-IDEA” plugin from the IntelliJ plugin repository.
> 2.Configure the plugin by going to Settings -> Other Settings -> Checkstyle.
> 3.Set the “Scan Scope” to “Only Java sources (including tests)”.
> 4.In the “Configuration File” pane, add a new configuration using the plus 
> icon:
>   4-1.Set the “Description” to “Beam”.
>   4-2.Select “Use a local Checkstyle file”, and point it to 
> “sdks/java/build-tools/src/main/resources/beam/checkstyle.xml” within your 
> repository.
>   4-3.Check the box for “Store relative to project location”, and click 
> “Next”.
>   4-4.Configure the “checkstyle.suppressions.file” property value to 
> “suppressions.xml”, and click “Next”, then “Finish”.
> After I click Next in 4-4, it shows error below in dialog box.
> ```
> org.infernus.idea.checkstyle.exception.CheckStylePluginException: 
> The Checkstyle rules file could not be 
> parsed.SuppressionCommentFilter is not allowed as a child in 
> CheckerThe file has been blacklisted for 60s.
>   at 
> org.infernus.idea.checkstyle.checker.CheckerFactory.blacklistAndShowMessage(CheckerFactory.java:198)
>   at 
> org.infernus.idea.checkstyle.checker.CheckerFactory.blacklistAndShowMessage(CheckerFactory.java:214)
>   at 
> org.infernus.idea.checkstyle.checker.CheckerFactory.createChecker(CheckerFactory.java:146)
>   at 
> org.infernus.idea.checkstyle.checker.CheckerFactory.getOrCreateCachedChecker(CheckerFactory.java:74)
>   at 
> org.infernus.idea.checkstyle.checker.CheckerFactory.checker(CheckerFactory.java:56)
>   at 
> org.infernus.idea.checkstyle.checker.CheckerFactory.verify(CheckerFactory.java:43)
>   at 
> org.infernus.idea.checkstyle.ui.LocationDialogue.attemptLoadOfFile(LocationDialogue.java:205)
>   at 
> org.infernus.idea.checkstyle.ui.LocationDialogue.access$800(LocationDialogue.java:35)
>   at 
> org.infernus.idea.checkstyle.ui.LocationDialogue$NextAction.actionPerformed(LocationDialogue.java:256)
>   at 
> javax.swing.AbstractButton.fireActionPerformed(AbstractButton.java:2022)
>   at 
> javax.swing.AbstractButton$Handler.actionPerformed(AbstractButton.java:2348)
>   at 
> javax.swing.DefaultButtonModel.fireActionPerformed(DefaultButtonModel.java:402)
>   at 
> javax.swing.DefaultButtonModel.setPressed(DefaultButtonModel.java:259)
>   at 
> javax.swing.plaf.basic.BasicButtonListener.mouseReleased(BasicButtonListener.java:252)
>   at 
> java.awt.AWTEventMulticaster.mouseReleased(AWTEventMulticaster.java:289)
>   at java.awt.Component.processMouseEvent(Component.java:6541)
>   at javax.swing.JComponent.processMouseEvent(JComponent.java:3324)
>   at java.awt.Component.processEvent(Component.java:6306)
>   at java.awt.Container.processEvent(Container.java:2237)
>   at java.awt.Component.dispatchEventImpl(Component.java:4897)
>   at java.awt.Container.dispatchEventImpl(Container.java:2295)
>   at java.awt.Component.dispatchEvent(Component.java:4719)
>   at 
> java.awt.LightweightDispatcher.retargetMouseEvent(Container.java:4889)
>   at java.awt.LightweightDispatcher.processMouseEvent(Container.java:4526)
>   at java.awt.LightweightDispatcher.dispatchEvent(Container.java:4467)
>   at java.awt.Container.dispatchEventImpl(Container.java:2281)
>   at java.awt.Window.dispatchEventImpl(Window.java:2746)
>   at java.awt.Component.dispatchEvent(Component.java:4719)
>   at java.awt.EventQueue.dispatchEventImpl(EventQueue.java:764)
>   at java.awt.EventQueue.access$500(EventQueue.java:98)
>   at java.awt.EventQueue$3.run(EventQueue.java:715)
>   at java.awt.EventQueue$3.run(EventQueue.java:709)
>   at java.security.AccessController.doPrivileged(Native Method)
>   at 
> java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(ProtectionDomain.java:80)
>   at 
> java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(ProtectionDomain.java:90)
>   at java.awt.EventQueue$4.run(EventQueue.java:737)
>   at java.awt.EventQueue$4.run(EventQueue.java:735)
>   at java.security.AccessController.doPrivileged(Native Method)
>   at 
> 

[jira] [Work logged] (BEAM-4044) Take advantage of Calcite DDL

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-4044?focusedWorklogId=89708=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-89708
 ]

ASF GitHub Bot logged work on BEAM-4044:


Author: ASF GitHub Bot
Created on: 10/Apr/18 23:37
Start Date: 10/Apr/18 23:37
Worklog Time Spent: 10m 
  Work Description: akedin commented on a change in pull request #5040: 
[BEAM-4044] [SQL] Refresh DDL from 1.16
URL: https://github.com/apache/beam/pull/5040#discussion_r180598326
 
 

 ##
 File path: 
sdks/java/extensions/sql/src/test/java/org/apache/beam/sdk/extensions/sql/meta/provider/kafka/KafkaTableProviderTest.java
 ##
 @@ -65,17 +64,17 @@ private static Table mockTable(String name) {
 return Table.builder()
 .name(name)
 .comment(name + " table")
-.location(URI.create("kafka://localhost:2181/brokers?topic=test"))
+.location("kafka://localhost:2181/brokers?topic=test")
 
 Review comment:
   Got it. The #4991 doesn't show any BQ-specific examples so this wasn't 
clear. How do we know that the table is a BQ table then if we can't use 
Location to identify it?
   
   And I think that URI format actually supports the syntax for BQ table IDs, 
but not sure how semantically correct that would be. It would probably 
technically be a URN at that point which our code has to resolve using some 
other data.


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 89708)
Time Spent: 1.5h  (was: 1h 20m)

> Take advantage of Calcite DDL
> -
>
> Key: BEAM-4044
> URL: https://issues.apache.org/jira/browse/BEAM-4044
> Project: Beam
>  Issue Type: New Feature
>  Components: dsl-sql
>Reporter: Andrew Pilloud
>Assignee: Andrew Pilloud
>Priority: Major
>  Time Spent: 1.5h
>  Remaining Estimate: 0h
>
> In Calcite 1.15 support for abstract DDL moved into calcite core. We should 
> take advantage of that.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work logged] (BEAM-3339) Create post-release testing of the nightly snapshots

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-3339?focusedWorklogId=89707=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-89707
 ]

ASF GitHub Bot logged work on BEAM-3339:


Author: ASF GitHub Bot
Created on: 10/Apr/18 23:35
Start Date: 10/Apr/18 23:35
Worklog Time Spent: 10m 
  Work Description: yifanzou commented on issue #4788: [BEAM-3339] Mobile 
gaming automation for Java nightly snapshot on core runners
URL: https://github.com/apache/beam/pull/4788#issuecomment-380280140
 
 
   Run Seed Job


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 89707)
Time Spent: 89h 40m  (was: 89.5h)

> Create post-release testing of the nightly snapshots
> 
>
> Key: BEAM-3339
> URL: https://issues.apache.org/jira/browse/BEAM-3339
> Project: Beam
>  Issue Type: Improvement
>  Components: testing
>Reporter: Alan Myrvold
>Assignee: Jason Kuster
>Priority: Major
>  Time Spent: 89h 40m
>  Remaining Estimate: 0h
>
> The nightly java snapshots in 
> https://repository.apache.org/content/groups/snapshots/org/apache/beam should 
> be verified by following the 
> https://beam.apache.org/get-started/quickstart-java/ instructions, to verify 
> that the release is usable.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work logged] (BEAM-3339) Create post-release testing of the nightly snapshots

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-3339?focusedWorklogId=89700=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-89700
 ]

ASF GitHub Bot logged work on BEAM-3339:


Author: ASF GitHub Bot
Created on: 10/Apr/18 23:34
Start Date: 10/Apr/18 23:34
Worklog Time Spent: 10m 
  Work Description: yifanzou commented on issue #4788: [BEAM-3339] Mobile 
gaming automation for Java nightly snapshot on core runners
URL: https://github.com/apache/beam/pull/4788#issuecomment-380210549
 
 
   Run Seed Job


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 89700)
Time Spent: 88.5h  (was: 88h 20m)

> Create post-release testing of the nightly snapshots
> 
>
> Key: BEAM-3339
> URL: https://issues.apache.org/jira/browse/BEAM-3339
> Project: Beam
>  Issue Type: Improvement
>  Components: testing
>Reporter: Alan Myrvold
>Assignee: Jason Kuster
>Priority: Major
>  Time Spent: 88.5h
>  Remaining Estimate: 0h
>
> The nightly java snapshots in 
> https://repository.apache.org/content/groups/snapshots/org/apache/beam should 
> be verified by following the 
> https://beam.apache.org/get-started/quickstart-java/ instructions, to verify 
> that the release is usable.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work logged] (BEAM-3339) Create post-release testing of the nightly snapshots

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-3339?focusedWorklogId=89689=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-89689
 ]

ASF GitHub Bot logged work on BEAM-3339:


Author: ASF GitHub Bot
Created on: 10/Apr/18 23:34
Start Date: 10/Apr/18 23:34
Worklog Time Spent: 10m 
  Work Description: yifanzou commented on issue #4788: [BEAM-3339] Mobile 
gaming automation for Java nightly snapshot on core runners
URL: https://github.com/apache/beam/pull/4788#issuecomment-377110712
 
 
   Run Seed Job


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 89689)
Time Spent: 86h 40m  (was: 86.5h)

> Create post-release testing of the nightly snapshots
> 
>
> Key: BEAM-3339
> URL: https://issues.apache.org/jira/browse/BEAM-3339
> Project: Beam
>  Issue Type: Improvement
>  Components: testing
>Reporter: Alan Myrvold
>Assignee: Jason Kuster
>Priority: Major
>  Time Spent: 86h 40m
>  Remaining Estimate: 0h
>
> The nightly java snapshots in 
> https://repository.apache.org/content/groups/snapshots/org/apache/beam should 
> be verified by following the 
> https://beam.apache.org/get-started/quickstart-java/ instructions, to verify 
> that the release is usable.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work logged] (BEAM-3339) Create post-release testing of the nightly snapshots

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-3339?focusedWorklogId=89699=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-89699
 ]

ASF GitHub Bot logged work on BEAM-3339:


Author: ASF GitHub Bot
Created on: 10/Apr/18 23:34
Start Date: 10/Apr/18 23:34
Worklog Time Spent: 10m 
  Work Description: yifanzou commented on issue #4788: [BEAM-3339] Mobile 
gaming automation for Java nightly snapshot on core runners
URL: https://github.com/apache/beam/pull/4788#issuecomment-379968837
 
 
   Run Dataflow PostRelease


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 89699)
Time Spent: 88h 20m  (was: 88h 10m)

> Create post-release testing of the nightly snapshots
> 
>
> Key: BEAM-3339
> URL: https://issues.apache.org/jira/browse/BEAM-3339
> Project: Beam
>  Issue Type: Improvement
>  Components: testing
>Reporter: Alan Myrvold
>Assignee: Jason Kuster
>Priority: Major
>  Time Spent: 88h 20m
>  Remaining Estimate: 0h
>
> The nightly java snapshots in 
> https://repository.apache.org/content/groups/snapshots/org/apache/beam should 
> be verified by following the 
> https://beam.apache.org/get-started/quickstart-java/ instructions, to verify 
> that the release is usable.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work logged] (BEAM-3339) Create post-release testing of the nightly snapshots

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-3339?focusedWorklogId=89682=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-89682
 ]

ASF GitHub Bot logged work on BEAM-3339:


Author: ASF GitHub Bot
Created on: 10/Apr/18 23:34
Start Date: 10/Apr/18 23:34
Worklog Time Spent: 10m 
  Work Description: yifanzou commented on issue #4788: [BEAM-3339] Mobile 
gaming automation for Java nightly snapshot on core runners
URL: https://github.com/apache/beam/pull/4788#issuecomment-374856466
 
 
   Run Dataflow PostRelease


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 89682)
Time Spent: 85.5h  (was: 85h 20m)

> Create post-release testing of the nightly snapshots
> 
>
> Key: BEAM-3339
> URL: https://issues.apache.org/jira/browse/BEAM-3339
> Project: Beam
>  Issue Type: Improvement
>  Components: testing
>Reporter: Alan Myrvold
>Assignee: Jason Kuster
>Priority: Major
>  Time Spent: 85.5h
>  Remaining Estimate: 0h
>
> The nightly java snapshots in 
> https://repository.apache.org/content/groups/snapshots/org/apache/beam should 
> be verified by following the 
> https://beam.apache.org/get-started/quickstart-java/ instructions, to verify 
> that the release is usable.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work logged] (BEAM-3339) Create post-release testing of the nightly snapshots

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-3339?focusedWorklogId=89706=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-89706
 ]

ASF GitHub Bot logged work on BEAM-3339:


Author: ASF GitHub Bot
Created on: 10/Apr/18 23:34
Start Date: 10/Apr/18 23:34
Worklog Time Spent: 10m 
  Work Description: yifanzou commented on issue #4788: [BEAM-3339] Mobile 
gaming automation for Java nightly snapshot on core runners
URL: https://github.com/apache/beam/pull/4788#issuecomment-380268013
 
 
   Run Dataflow PostRelease


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 89706)
Time Spent: 89.5h  (was: 89h 20m)

> Create post-release testing of the nightly snapshots
> 
>
> Key: BEAM-3339
> URL: https://issues.apache.org/jira/browse/BEAM-3339
> Project: Beam
>  Issue Type: Improvement
>  Components: testing
>Reporter: Alan Myrvold
>Assignee: Jason Kuster
>Priority: Major
>  Time Spent: 89.5h
>  Remaining Estimate: 0h
>
> The nightly java snapshots in 
> https://repository.apache.org/content/groups/snapshots/org/apache/beam should 
> be verified by following the 
> https://beam.apache.org/get-started/quickstart-java/ instructions, to verify 
> that the release is usable.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work logged] (BEAM-3339) Create post-release testing of the nightly snapshots

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-3339?focusedWorklogId=89704=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-89704
 ]

ASF GitHub Bot logged work on BEAM-3339:


Author: ASF GitHub Bot
Created on: 10/Apr/18 23:34
Start Date: 10/Apr/18 23:34
Worklog Time Spent: 10m 
  Work Description: yifanzou commented on issue #4788: [BEAM-3339] Mobile 
gaming automation for Java nightly snapshot on core runners
URL: https://github.com/apache/beam/pull/4788#issuecomment-380259492
 
 
   Run Dataflow PostRelease


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 89704)
Time Spent: 89h 10m  (was: 89h)

> Create post-release testing of the nightly snapshots
> 
>
> Key: BEAM-3339
> URL: https://issues.apache.org/jira/browse/BEAM-3339
> Project: Beam
>  Issue Type: Improvement
>  Components: testing
>Reporter: Alan Myrvold
>Assignee: Jason Kuster
>Priority: Major
>  Time Spent: 89h 10m
>  Remaining Estimate: 0h
>
> The nightly java snapshots in 
> https://repository.apache.org/content/groups/snapshots/org/apache/beam should 
> be verified by following the 
> https://beam.apache.org/get-started/quickstart-java/ instructions, to verify 
> that the release is usable.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work logged] (BEAM-3339) Create post-release testing of the nightly snapshots

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-3339?focusedWorklogId=89687=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-89687
 ]

ASF GitHub Bot logged work on BEAM-3339:


Author: ASF GitHub Bot
Created on: 10/Apr/18 23:34
Start Date: 10/Apr/18 23:34
Worklog Time Spent: 10m 
  Work Description: yifanzou commented on issue #4788: [BEAM-3339] Mobile 
gaming automation for Java nightly snapshot on core runners
URL: https://github.com/apache/beam/pull/4788#issuecomment-377109314
 
 
   Run Seed Job


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 89687)
Time Spent: 86h 20m  (was: 86h 10m)

> Create post-release testing of the nightly snapshots
> 
>
> Key: BEAM-3339
> URL: https://issues.apache.org/jira/browse/BEAM-3339
> Project: Beam
>  Issue Type: Improvement
>  Components: testing
>Reporter: Alan Myrvold
>Assignee: Jason Kuster
>Priority: Major
>  Time Spent: 86h 20m
>  Remaining Estimate: 0h
>
> The nightly java snapshots in 
> https://repository.apache.org/content/groups/snapshots/org/apache/beam should 
> be verified by following the 
> https://beam.apache.org/get-started/quickstart-java/ instructions, to verify 
> that the release is usable.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work logged] (BEAM-3339) Create post-release testing of the nightly snapshots

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-3339?focusedWorklogId=89681=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-89681
 ]

ASF GitHub Bot logged work on BEAM-3339:


Author: ASF GitHub Bot
Created on: 10/Apr/18 23:34
Start Date: 10/Apr/18 23:34
Worklog Time Spent: 10m 
  Work Description: yifanzou commented on issue #4788: [BEAM-3339] Mobile 
gaming automation for Java nightly snapshot on core runners
URL: https://github.com/apache/beam/pull/4788#issuecomment-374850524
 
 
   Run Dataflow PostRelease


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 89681)
Time Spent: 85h 20m  (was: 85h 10m)

> Create post-release testing of the nightly snapshots
> 
>
> Key: BEAM-3339
> URL: https://issues.apache.org/jira/browse/BEAM-3339
> Project: Beam
>  Issue Type: Improvement
>  Components: testing
>Reporter: Alan Myrvold
>Assignee: Jason Kuster
>Priority: Major
>  Time Spent: 85h 20m
>  Remaining Estimate: 0h
>
> The nightly java snapshots in 
> https://repository.apache.org/content/groups/snapshots/org/apache/beam should 
> be verified by following the 
> https://beam.apache.org/get-started/quickstart-java/ instructions, to verify 
> that the release is usable.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work logged] (BEAM-3339) Create post-release testing of the nightly snapshots

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-3339?focusedWorklogId=89705=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-89705
 ]

ASF GitHub Bot logged work on BEAM-3339:


Author: ASF GitHub Bot
Created on: 10/Apr/18 23:34
Start Date: 10/Apr/18 23:34
Worklog Time Spent: 10m 
  Work Description: yifanzou commented on issue #4788: [BEAM-3339] Mobile 
gaming automation for Java nightly snapshot on core runners
URL: https://github.com/apache/beam/pull/4788#issuecomment-380261207
 
 
   Run Seed Job


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 89705)
Time Spent: 89h 20m  (was: 89h 10m)

> Create post-release testing of the nightly snapshots
> 
>
> Key: BEAM-3339
> URL: https://issues.apache.org/jira/browse/BEAM-3339
> Project: Beam
>  Issue Type: Improvement
>  Components: testing
>Reporter: Alan Myrvold
>Assignee: Jason Kuster
>Priority: Major
>  Time Spent: 89h 20m
>  Remaining Estimate: 0h
>
> The nightly java snapshots in 
> https://repository.apache.org/content/groups/snapshots/org/apache/beam should 
> be verified by following the 
> https://beam.apache.org/get-started/quickstart-java/ instructions, to verify 
> that the release is usable.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work logged] (BEAM-3339) Create post-release testing of the nightly snapshots

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-3339?focusedWorklogId=89676=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-89676
 ]

ASF GitHub Bot logged work on BEAM-3339:


Author: ASF GitHub Bot
Created on: 10/Apr/18 23:34
Start Date: 10/Apr/18 23:34
Worklog Time Spent: 10m 
  Work Description: yifanzou commented on issue #4788: [BEAM-3339] Mobile 
gaming automation for Java nightly snapshot on core runners
URL: https://github.com/apache/beam/pull/4788#issuecomment-374838339
 
 
   Run Seed Job


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 89676)
Time Spent: 84.5h  (was: 84h 20m)

> Create post-release testing of the nightly snapshots
> 
>
> Key: BEAM-3339
> URL: https://issues.apache.org/jira/browse/BEAM-3339
> Project: Beam
>  Issue Type: Improvement
>  Components: testing
>Reporter: Alan Myrvold
>Assignee: Jason Kuster
>Priority: Major
>  Time Spent: 84.5h
>  Remaining Estimate: 0h
>
> The nightly java snapshots in 
> https://repository.apache.org/content/groups/snapshots/org/apache/beam should 
> be verified by following the 
> https://beam.apache.org/get-started/quickstart-java/ instructions, to verify 
> that the release is usable.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work logged] (BEAM-3339) Create post-release testing of the nightly snapshots

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-3339?focusedWorklogId=89703=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-89703
 ]

ASF GitHub Bot logged work on BEAM-3339:


Author: ASF GitHub Bot
Created on: 10/Apr/18 23:34
Start Date: 10/Apr/18 23:34
Worklog Time Spent: 10m 
  Work Description: yifanzou commented on issue #4788: [BEAM-3339] Mobile 
gaming automation for Java nightly snapshot on core runners
URL: https://github.com/apache/beam/pull/4788#issuecomment-380247576
 
 
   Run Dataflow PostRelease


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 89703)
Time Spent: 89h  (was: 88h 50m)

> Create post-release testing of the nightly snapshots
> 
>
> Key: BEAM-3339
> URL: https://issues.apache.org/jira/browse/BEAM-3339
> Project: Beam
>  Issue Type: Improvement
>  Components: testing
>Reporter: Alan Myrvold
>Assignee: Jason Kuster
>Priority: Major
>  Time Spent: 89h
>  Remaining Estimate: 0h
>
> The nightly java snapshots in 
> https://repository.apache.org/content/groups/snapshots/org/apache/beam should 
> be verified by following the 
> https://beam.apache.org/get-started/quickstart-java/ instructions, to verify 
> that the release is usable.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work logged] (BEAM-3339) Create post-release testing of the nightly snapshots

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-3339?focusedWorklogId=89691=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-89691
 ]

ASF GitHub Bot logged work on BEAM-3339:


Author: ASF GitHub Bot
Created on: 10/Apr/18 23:34
Start Date: 10/Apr/18 23:34
Worklog Time Spent: 10m 
  Work Description: yifanzou commented on issue #4788: [BEAM-3339] Mobile 
gaming automation for Java nightly snapshot on core runners
URL: https://github.com/apache/beam/pull/4788#issuecomment-377112562
 
 
   Run Seed Job


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 89691)
Time Spent: 87h  (was: 86h 50m)

> Create post-release testing of the nightly snapshots
> 
>
> Key: BEAM-3339
> URL: https://issues.apache.org/jira/browse/BEAM-3339
> Project: Beam
>  Issue Type: Improvement
>  Components: testing
>Reporter: Alan Myrvold
>Assignee: Jason Kuster
>Priority: Major
>  Time Spent: 87h
>  Remaining Estimate: 0h
>
> The nightly java snapshots in 
> https://repository.apache.org/content/groups/snapshots/org/apache/beam should 
> be verified by following the 
> https://beam.apache.org/get-started/quickstart-java/ instructions, to verify 
> that the release is usable.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work logged] (BEAM-3339) Create post-release testing of the nightly snapshots

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-3339?focusedWorklogId=89701=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-89701
 ]

ASF GitHub Bot logged work on BEAM-3339:


Author: ASF GitHub Bot
Created on: 10/Apr/18 23:34
Start Date: 10/Apr/18 23:34
Worklog Time Spent: 10m 
  Work Description: yifanzou commented on issue #4788: [BEAM-3339] Mobile 
gaming automation for Java nightly snapshot on core runners
URL: https://github.com/apache/beam/pull/4788#issuecomment-380221113
 
 
   Run Dataflow PostRelease


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 89701)
Time Spent: 88h 40m  (was: 88.5h)

> Create post-release testing of the nightly snapshots
> 
>
> Key: BEAM-3339
> URL: https://issues.apache.org/jira/browse/BEAM-3339
> Project: Beam
>  Issue Type: Improvement
>  Components: testing
>Reporter: Alan Myrvold
>Assignee: Jason Kuster
>Priority: Major
>  Time Spent: 88h 40m
>  Remaining Estimate: 0h
>
> The nightly java snapshots in 
> https://repository.apache.org/content/groups/snapshots/org/apache/beam should 
> be verified by following the 
> https://beam.apache.org/get-started/quickstart-java/ instructions, to verify 
> that the release is usable.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work logged] (BEAM-3339) Create post-release testing of the nightly snapshots

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-3339?focusedWorklogId=89692=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-89692
 ]

ASF GitHub Bot logged work on BEAM-3339:


Author: ASF GitHub Bot
Created on: 10/Apr/18 23:34
Start Date: 10/Apr/18 23:34
Worklog Time Spent: 10m 
  Work Description: yifanzou commented on issue #4788: [BEAM-3339] Mobile 
gaming automation for Java nightly snapshot on core runners
URL: https://github.com/apache/beam/pull/4788#issuecomment-377113184
 
 
   Run Dataflow PostRelease


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 89692)
Time Spent: 87h 10m  (was: 87h)

> Create post-release testing of the nightly snapshots
> 
>
> Key: BEAM-3339
> URL: https://issues.apache.org/jira/browse/BEAM-3339
> Project: Beam
>  Issue Type: Improvement
>  Components: testing
>Reporter: Alan Myrvold
>Assignee: Jason Kuster
>Priority: Major
>  Time Spent: 87h 10m
>  Remaining Estimate: 0h
>
> The nightly java snapshots in 
> https://repository.apache.org/content/groups/snapshots/org/apache/beam should 
> be verified by following the 
> https://beam.apache.org/get-started/quickstart-java/ instructions, to verify 
> that the release is usable.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work logged] (BEAM-3339) Create post-release testing of the nightly snapshots

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-3339?focusedWorklogId=89698=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-89698
 ]

ASF GitHub Bot logged work on BEAM-3339:


Author: ASF GitHub Bot
Created on: 10/Apr/18 23:34
Start Date: 10/Apr/18 23:34
Worklog Time Spent: 10m 
  Work Description: yifanzou commented on issue #4788: [BEAM-3339] Mobile 
gaming automation for Java nightly snapshot on core runners
URL: https://github.com/apache/beam/pull/4788#issuecomment-379965687
 
 
   Run Dataflow PostRelease


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 89698)
Time Spent: 88h 10m  (was: 88h)

> Create post-release testing of the nightly snapshots
> 
>
> Key: BEAM-3339
> URL: https://issues.apache.org/jira/browse/BEAM-3339
> Project: Beam
>  Issue Type: Improvement
>  Components: testing
>Reporter: Alan Myrvold
>Assignee: Jason Kuster
>Priority: Major
>  Time Spent: 88h 10m
>  Remaining Estimate: 0h
>
> The nightly java snapshots in 
> https://repository.apache.org/content/groups/snapshots/org/apache/beam should 
> be verified by following the 
> https://beam.apache.org/get-started/quickstart-java/ instructions, to verify 
> that the release is usable.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work logged] (BEAM-3339) Create post-release testing of the nightly snapshots

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-3339?focusedWorklogId=89683=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-89683
 ]

ASF GitHub Bot logged work on BEAM-3339:


Author: ASF GitHub Bot
Created on: 10/Apr/18 23:34
Start Date: 10/Apr/18 23:34
Worklog Time Spent: 10m 
  Work Description: yifanzou commented on issue #4788: [BEAM-3339] Mobile 
gaming automation for Java nightly snapshot on core runners
URL: https://github.com/apache/beam/pull/4788#issuecomment-376615235
 
 
   Run Seed Job


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 89683)
Time Spent: 85h 40m  (was: 85.5h)

> Create post-release testing of the nightly snapshots
> 
>
> Key: BEAM-3339
> URL: https://issues.apache.org/jira/browse/BEAM-3339
> Project: Beam
>  Issue Type: Improvement
>  Components: testing
>Reporter: Alan Myrvold
>Assignee: Jason Kuster
>Priority: Major
>  Time Spent: 85h 40m
>  Remaining Estimate: 0h
>
> The nightly java snapshots in 
> https://repository.apache.org/content/groups/snapshots/org/apache/beam should 
> be verified by following the 
> https://beam.apache.org/get-started/quickstart-java/ instructions, to verify 
> that the release is usable.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work logged] (BEAM-3339) Create post-release testing of the nightly snapshots

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-3339?focusedWorklogId=89677=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-89677
 ]

ASF GitHub Bot logged work on BEAM-3339:


Author: ASF GitHub Bot
Created on: 10/Apr/18 23:34
Start Date: 10/Apr/18 23:34
Worklog Time Spent: 10m 
  Work Description: yifanzou commented on issue #4788: [BEAM-3339] Mobile 
gaming automation for Java nightly snapshot on core runners
URL: https://github.com/apache/beam/pull/4788#issuecomment-374839138
 
 
   Run Dataflow PostRelease


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 89677)
Time Spent: 84h 40m  (was: 84.5h)

> Create post-release testing of the nightly snapshots
> 
>
> Key: BEAM-3339
> URL: https://issues.apache.org/jira/browse/BEAM-3339
> Project: Beam
>  Issue Type: Improvement
>  Components: testing
>Reporter: Alan Myrvold
>Assignee: Jason Kuster
>Priority: Major
>  Time Spent: 84h 40m
>  Remaining Estimate: 0h
>
> The nightly java snapshots in 
> https://repository.apache.org/content/groups/snapshots/org/apache/beam should 
> be verified by following the 
> https://beam.apache.org/get-started/quickstart-java/ instructions, to verify 
> that the release is usable.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work logged] (BEAM-3339) Create post-release testing of the nightly snapshots

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-3339?focusedWorklogId=89694=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-89694
 ]

ASF GitHub Bot logged work on BEAM-3339:


Author: ASF GitHub Bot
Created on: 10/Apr/18 23:34
Start Date: 10/Apr/18 23:34
Worklog Time Spent: 10m 
  Work Description: yifanzou commented on issue #4788: [BEAM-3339] Mobile 
gaming automation for Java nightly snapshot on core runners
URL: https://github.com/apache/beam/pull/4788#issuecomment-379961457
 
 
   Run Dataflow PostRelease


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 89694)
Time Spent: 87.5h  (was: 87h 20m)

> Create post-release testing of the nightly snapshots
> 
>
> Key: BEAM-3339
> URL: https://issues.apache.org/jira/browse/BEAM-3339
> Project: Beam
>  Issue Type: Improvement
>  Components: testing
>Reporter: Alan Myrvold
>Assignee: Jason Kuster
>Priority: Major
>  Time Spent: 87.5h
>  Remaining Estimate: 0h
>
> The nightly java snapshots in 
> https://repository.apache.org/content/groups/snapshots/org/apache/beam should 
> be verified by following the 
> https://beam.apache.org/get-started/quickstart-java/ instructions, to verify 
> that the release is usable.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work logged] (BEAM-3339) Create post-release testing of the nightly snapshots

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-3339?focusedWorklogId=89696=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-89696
 ]

ASF GitHub Bot logged work on BEAM-3339:


Author: ASF GitHub Bot
Created on: 10/Apr/18 23:34
Start Date: 10/Apr/18 23:34
Worklog Time Spent: 10m 
  Work Description: yifanzou commented on issue #4788: [BEAM-3339] Mobile 
gaming automation for Java nightly snapshot on core runners
URL: https://github.com/apache/beam/pull/4788#issuecomment-379963938
 
 
   Run Dataflow PostRelease


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 89696)
Time Spent: 87h 50m  (was: 87h 40m)

> Create post-release testing of the nightly snapshots
> 
>
> Key: BEAM-3339
> URL: https://issues.apache.org/jira/browse/BEAM-3339
> Project: Beam
>  Issue Type: Improvement
>  Components: testing
>Reporter: Alan Myrvold
>Assignee: Jason Kuster
>Priority: Major
>  Time Spent: 87h 50m
>  Remaining Estimate: 0h
>
> The nightly java snapshots in 
> https://repository.apache.org/content/groups/snapshots/org/apache/beam should 
> be verified by following the 
> https://beam.apache.org/get-started/quickstart-java/ instructions, to verify 
> that the release is usable.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work logged] (BEAM-3339) Create post-release testing of the nightly snapshots

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-3339?focusedWorklogId=89688=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-89688
 ]

ASF GitHub Bot logged work on BEAM-3339:


Author: ASF GitHub Bot
Created on: 10/Apr/18 23:34
Start Date: 10/Apr/18 23:34
Worklog Time Spent: 10m 
  Work Description: yifanzou commented on issue #4788: [BEAM-3339] Mobile 
gaming automation for Java nightly snapshot on core runners
URL: https://github.com/apache/beam/pull/4788#issuecomment-377109950
 
 
   Run Dataflow PostRelease


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 89688)
Time Spent: 86.5h  (was: 86h 20m)

> Create post-release testing of the nightly snapshots
> 
>
> Key: BEAM-3339
> URL: https://issues.apache.org/jira/browse/BEAM-3339
> Project: Beam
>  Issue Type: Improvement
>  Components: testing
>Reporter: Alan Myrvold
>Assignee: Jason Kuster
>Priority: Major
>  Time Spent: 86.5h
>  Remaining Estimate: 0h
>
> The nightly java snapshots in 
> https://repository.apache.org/content/groups/snapshots/org/apache/beam should 
> be verified by following the 
> https://beam.apache.org/get-started/quickstart-java/ instructions, to verify 
> that the release is usable.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work logged] (BEAM-3339) Create post-release testing of the nightly snapshots

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-3339?focusedWorklogId=89685=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-89685
 ]

ASF GitHub Bot logged work on BEAM-3339:


Author: ASF GitHub Bot
Created on: 10/Apr/18 23:34
Start Date: 10/Apr/18 23:34
Worklog Time Spent: 10m 
  Work Description: yifanzou commented on issue #4788: [BEAM-3339] Mobile 
gaming automation for Java nightly snapshot on core runners
URL: https://github.com/apache/beam/pull/4788#issuecomment-376718650
 
 
   Run Seed Job


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 89685)
Time Spent: 86h  (was: 85h 50m)

> Create post-release testing of the nightly snapshots
> 
>
> Key: BEAM-3339
> URL: https://issues.apache.org/jira/browse/BEAM-3339
> Project: Beam
>  Issue Type: Improvement
>  Components: testing
>Reporter: Alan Myrvold
>Assignee: Jason Kuster
>Priority: Major
>  Time Spent: 86h
>  Remaining Estimate: 0h
>
> The nightly java snapshots in 
> https://repository.apache.org/content/groups/snapshots/org/apache/beam should 
> be verified by following the 
> https://beam.apache.org/get-started/quickstart-java/ instructions, to verify 
> that the release is usable.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work logged] (BEAM-3339) Create post-release testing of the nightly snapshots

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-3339?focusedWorklogId=89697=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-89697
 ]

ASF GitHub Bot logged work on BEAM-3339:


Author: ASF GitHub Bot
Created on: 10/Apr/18 23:34
Start Date: 10/Apr/18 23:34
Worklog Time Spent: 10m 
  Work Description: yifanzou commented on issue #4788: [BEAM-3339] Mobile 
gaming automation for Java nightly snapshot on core runners
URL: https://github.com/apache/beam/pull/4788#issuecomment-379965106
 
 
   Run Seed Job


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 89697)
Time Spent: 88h  (was: 87h 50m)

> Create post-release testing of the nightly snapshots
> 
>
> Key: BEAM-3339
> URL: https://issues.apache.org/jira/browse/BEAM-3339
> Project: Beam
>  Issue Type: Improvement
>  Components: testing
>Reporter: Alan Myrvold
>Assignee: Jason Kuster
>Priority: Major
>  Time Spent: 88h
>  Remaining Estimate: 0h
>
> The nightly java snapshots in 
> https://repository.apache.org/content/groups/snapshots/org/apache/beam should 
> be verified by following the 
> https://beam.apache.org/get-started/quickstart-java/ instructions, to verify 
> that the release is usable.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work logged] (BEAM-3339) Create post-release testing of the nightly snapshots

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-3339?focusedWorklogId=89680=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-89680
 ]

ASF GitHub Bot logged work on BEAM-3339:


Author: ASF GitHub Bot
Created on: 10/Apr/18 23:34
Start Date: 10/Apr/18 23:34
Worklog Time Spent: 10m 
  Work Description: yifanzou commented on issue #4788: [BEAM-3339] Mobile 
gaming automation for Java nightly snapshot on core runners
URL: https://github.com/apache/beam/pull/4788#issuecomment-374846612
 
 
   Run Dataflow PostRelease


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 89680)
Time Spent: 85h 10m  (was: 85h)

> Create post-release testing of the nightly snapshots
> 
>
> Key: BEAM-3339
> URL: https://issues.apache.org/jira/browse/BEAM-3339
> Project: Beam
>  Issue Type: Improvement
>  Components: testing
>Reporter: Alan Myrvold
>Assignee: Jason Kuster
>Priority: Major
>  Time Spent: 85h 10m
>  Remaining Estimate: 0h
>
> The nightly java snapshots in 
> https://repository.apache.org/content/groups/snapshots/org/apache/beam should 
> be verified by following the 
> https://beam.apache.org/get-started/quickstart-java/ instructions, to verify 
> that the release is usable.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Build failed in Jenkins: beam_PostCommit_Java_GradleBuild #30

[Apache Jenkins Server]

See 


Changes:

[swegner] Disable Gradle agent for Jenkins build jobs.

[swegner] fixup! Add common Gradle switches to remaining jobs

[swegner] fixup! Execute switches on the passed-in context object

[swegner] fixup! Fix stale variable in java precommits

--
[...truncated 18.00 MB...]
INFO: Adding SpannerIO.Write/Write mutations to Cloud Spanner/Keys sample 
as view/Flatten.PCollections as step s25
Apr 10, 2018 11:30:14 PM 
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding SpannerIO.Write/Write mutations to Cloud Spanner/Keys sample 
as view/CreateDataflowView as step s26
Apr 10, 2018 11:30:14 PM 
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding SpannerIO.Write/Write mutations to Cloud Spanner/Partition 
input as step s27
Apr 10, 2018 11:30:14 PM 
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding SpannerIO.Write/Write mutations to Cloud Spanner/Group by 
partition as step s28
Apr 10, 2018 11:30:15 PM 
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding SpannerIO.Write/Write mutations to Cloud Spanner/Batch 
mutations together as step s29
Apr 10, 2018 11:30:15 PM 
org.apache.beam.runners.dataflow.DataflowPipelineTranslator$Translator addStep
INFO: Adding SpannerIO.Write/Write mutations to Cloud Spanner/Write 
mutations to Spanner as step s30
Apr 10, 2018 11:30:15 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: Staging pipeline description to 
gs://temp-storage-for-end-to-end-tests/spannerwriteit0testwrite-jenkins-0410233006-add08c1b/output/results/staging/
Apr 10, 2018 11:30:15 PM org.apache.beam.runners.dataflow.util.PackageUtil 
tryStagePackage
INFO: Uploading <80745 bytes, hash zwYgL8128NW3waUjUjO-sQ> to 
gs://temp-storage-for-end-to-end-tests/spannerwriteit0testwrite-jenkins-0410233006-add08c1b/output/results/staging/pipeline-zwYgL8128NW3waUjUjO-sQ.pb

org.apache.beam.sdk.io.gcp.spanner.SpannerWriteIT > testWrite STANDARD_OUT
Dataflow SDK version: 2.5.0-SNAPSHOT

org.apache.beam.sdk.io.gcp.spanner.SpannerWriteIT > testWrite STANDARD_ERROR
Apr 10, 2018 11:30:16 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To access the Dataflow monitoring console, please navigate to 
https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-04-10_16_30_15-8241605357955851022?project=apache-beam-testing

org.apache.beam.sdk.io.gcp.spanner.SpannerWriteIT > testWrite STANDARD_OUT
Submitted job: 2018-04-10_16_30_15-8241605357955851022

org.apache.beam.sdk.io.gcp.spanner.SpannerWriteIT > testWrite STANDARD_ERROR
Apr 10, 2018 11:30:16 PM org.apache.beam.runners.dataflow.DataflowRunner run
INFO: To cancel the job using the 'gcloud' tool, run:
> gcloud dataflow jobs --project=apache-beam-testing cancel 
--region=us-central1 2018-04-10_16_30_15-8241605357955851022
Apr 10, 2018 11:30:16 PM 
org.apache.beam.runners.dataflow.TestDataflowRunner run
INFO: Running Dataflow job 2018-04-10_16_30_15-8241605357955851022 with 0 
expected assertions.
Apr 10, 2018 11:30:27 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-10T23:30:15.684Z: Autoscaling is enabled for job 
2018-04-10_16_30_15-8241605357955851022. The number of workers will be between 
1 and 1000.
Apr 10, 2018 11:30:27 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-10T23:30:15.714Z: Autoscaling was automatically enabled for 
job 2018-04-10_16_30_15-8241605357955851022.
Apr 10, 2018 11:30:27 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-10T23:30:19.105Z: Checking required Cloud APIs are enabled.
Apr 10, 2018 11:30:27 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-10T23:30:19.275Z: Checking permissions granted to controller 
Service Account.
Apr 10, 2018 11:30:27 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-10T23:30:24.176Z: Worker configuration: n1-standard-1 in 
us-central1-f.
Apr 10, 2018 11:30:27 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-10T23:30:24.601Z: Expanding CoGroupByKey operations into 
optimizable parts.
Apr 10, 2018 11:30:27 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-10T23:30:24.796Z: Expanding GroupByKey operations into 
optimizable parts.
Apr 10, 2018 11:30:27 PM 
org.apache.beam.runners.dataflow.util.MonitoringUtil$LoggingHandler process
INFO: 2018-04-10T23:30:24.831Z: Lifting ValueCombiningMappingFns into 

[jira] [Work logged] (BEAM-4035) Spark validatesRunner fails, ResumeFromCheckpointStreamingTest > classMethod FAILED java.lang.NoClassDefFoundError: org/apache/zookeeper/server/NIOServerCnxnFactory

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-4035?focusedWorklogId=89669=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-89669
 ]

ASF GitHub Bot logged work on BEAM-4035:


Author: ASF GitHub Bot
Created on: 10/Apr/18 23:30
Start Date: 10/Apr/18 23:30
Worklog Time Spent: 10m 
  Work Description: alanmyrvold commented on issue #5069: [BEAM-4035] 
Disable ResumeFromCheckpointStreamingTest for spark validates runner,…
URL: https://github.com/apache/beam/pull/5069#issuecomment-380279426
 
 
   Found another solution, dropping this


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 89669)
Time Spent: 0.5h  (was: 20m)

> Spark validatesRunner fails, ResumeFromCheckpointStreamingTest > classMethod 
> FAILED java.lang.NoClassDefFoundError: 
> org/apache/zookeeper/server/NIOServerCnxnFactory
> 
>
> Key: BEAM-4035
> URL: https://issues.apache.org/jira/browse/BEAM-4035
> Project: Beam
>  Issue Type: Bug
>  Components: runner-spark
>Reporter: Alan Myrvold
>Assignee: Alan Myrvold
>Priority: Major
>  Time Spent: 0.5h
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work logged] (BEAM-4035) Spark validatesRunner fails, ResumeFromCheckpointStreamingTest > classMethod FAILED java.lang.NoClassDefFoundError: org/apache/zookeeper/server/NIOServerCnxnFactory

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-4035?focusedWorklogId=89670=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-89670
 ]

ASF GitHub Bot logged work on BEAM-4035:


Author: ASF GitHub Bot
Created on: 10/Apr/18 23:30
Start Date: 10/Apr/18 23:30
Worklog Time Spent: 10m 
  Work Description: alanmyrvold closed pull request #5069: [BEAM-4035] 
Disable ResumeFromCheckpointStreamingTest for spark validates runner,…
URL: https://github.com/apache/beam/pull/5069
 
 
   

This is a PR merged from a forked repository.
As GitHub hides the original diff on merge, it is displayed below for
the sake of provenance:

As this is a foreign pull request (from a fork), the diff is supplied
below (as it won't show otherwise due to GitHub magic):

diff --git a/runners/spark/build.gradle b/runners/spark/build.gradle
index 56d1bb105ba..0de896608e0 100644
--- a/runners/spark/build.gradle
+++ b/runners/spark/build.gradle
@@ -126,7 +126,8 @@ task validatesRunnerBatch(type: Test) {
   maxParallelForks 4
   useJUnit {
 includeCategories 'org.apache.beam.sdk.testing.ValidatesRunner'
-includeCategories 'org.apache.beam.runners.spark.UsesCheckpointRecovery'
+// Disabled due to [BEAM-4035].
+excludeCategories 'org.apache.beam.runners.spark.UsesCheckpointRecovery'
 excludeCategories 'org.apache.beam.sdk.testing.UsesSplittableParDo'
 excludeCategories 'org.apache.beam.sdk.testing.UsesAttemptedMetrics'
 excludeCategories 'org.apache.beam.sdk.testing.UsesCommittedMetrics'


 


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 89670)
Time Spent: 40m  (was: 0.5h)

> Spark validatesRunner fails, ResumeFromCheckpointStreamingTest > classMethod 
> FAILED java.lang.NoClassDefFoundError: 
> org/apache/zookeeper/server/NIOServerCnxnFactory
> 
>
> Key: BEAM-4035
> URL: https://issues.apache.org/jira/browse/BEAM-4035
> Project: Beam
>  Issue Type: Bug
>  Components: runner-spark
>Reporter: Alan Myrvold
>Assignee: Alan Myrvold
>Priority: Major
>  Time Spent: 40m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Jenkins build is back to normal : beam_PostCommit_Java_ValidatesRunner_Spark_Gradle #54

[Apache Jenkins Server]

See 

[jira] [Created] (BEAM-4046) Decouple gradle project names and maven artifact ids

[Kenneth Knowles (JIRA)]

Kenneth Knowles created BEAM-4046:
-

 Summary: Decouple gradle project names and maven artifact ids
 Key: BEAM-4046
 URL: https://issues.apache.org/jira/browse/BEAM-4046
 Project: Beam
  Issue Type: Sub-task
  Components: build-system
Reporter: Kenneth Knowles


In our first draft, we had gradle projects like {{":beam-sdks-java-core"}}. It 
is clumsy and requires a hacky settings.gradle that is not idiomatic.

In our second draft, we changed them to names that work well with Gradle, like 
{{":sdks:java:core"}}. This caused Maven artifact IDs to be wonky.

In our third draft, we regressed to the first draft to get the Maven artifact 
ids right.

These should be able to be decoupled. It seems there are many StackOverflow 
questions on the subject.

Since it is unidiomatic and a poor user experience, if it does turn out to be 
mandatory then it needs to be documented inline everywhere - the 
settings.gradle should say why it is so bizarre, and each build.gradle should 
indicate what its project id is.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Updated] (BEAM-3253) Gradle configurations do not declare correct inputs/outputs, requiring --rerun-tasks

[Kenneth Knowles (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-3253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kenneth Knowles updated BEAM-3253:
--
Issue Type: Sub-task  (was: Bug)
Parent: BEAM-4045

> Gradle configurations do not declare correct inputs/outputs, requiring 
> --rerun-tasks
> 
>
> Key: BEAM-3253
> URL: https://issues.apache.org/jira/browse/BEAM-3253
> Project: Beam
>  Issue Type: Sub-task
>  Components: build-system
>Reporter: Luke Cwik
>Priority: Major
>
> Support incremental builds by ensuring all tasks correctly specify their 
> inputs and outputs.
> This is currently not correctly setup for any shell tasks and all code 
> generation tasks.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Updated] (BEAM-3462) Drop parent modules

[Kenneth Knowles (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-3462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kenneth Knowles updated BEAM-3462:
--
Parent Issue: BEAM-4045  (was: BEAM-3249)

> Drop parent modules
> ---
>
> Key: BEAM-3462
> URL: https://issues.apache.org/jira/browse/BEAM-3462
> Project: Beam
>  Issue Type: Sub-task
>  Components: build-system
>Reporter: Kenneth Knowles
>Priority: Minor
>  Labels: starter
>
> We never really needed a parent pom-only module in each directory. It is just 
> a distraction and obfuscates our configuration. It stems partly from the idea 
> that directories "inherit" from their parents, which is not required or 
> necessarily desirable. With a couple exceptions, like global dependency 
> pinning, we should compose configurations instead of inheriting them.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Created] (BEAM-4045) Gradle build improvements

[Kenneth Knowles (JIRA)]

Kenneth Knowles created BEAM-4045:
-

 Summary: Gradle build improvements
 Key: BEAM-4045
 URL: https://issues.apache.org/jira/browse/BEAM-4045
 Project: Beam
  Issue Type: Bug
  Components: build-system
Reporter: Kenneth Knowles


This is an umbrella task to collect Gradle improvements that are nice-to-have 
(maybe _really_ nice to have) but not as urgent as the blockers in BEAM-3249.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Build failed in Jenkins: beam_PostCommit_Python_Verify #4652

[Apache Jenkins Server]

See 


Changes:

[swegner] Disable Gradle agent for Jenkins build jobs.

[swegner] fixup! Add common Gradle switches to remaining jobs

[swegner] fixup! Execute switches on the passed-in context object

[swegner] fixup! Fix stale variable in java precommits

--
[...truncated 1.04 MB...]
copying apache_beam/runners/experimental/python_rpc_direct/server.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/experimental/python_rpc_direct
copying apache_beam/runners/job/__init__.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/job
copying apache_beam/runners/job/manager.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/job
copying apache_beam/runners/job/utils.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/job
copying apache_beam/runners/portability/__init__.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/portability
copying apache_beam/runners/portability/fn_api_runner.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/portability
copying apache_beam/runners/portability/fn_api_runner_test.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/portability
copying apache_beam/runners/portability/universal_local_runner.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/portability
copying apache_beam/runners/portability/universal_local_runner_main.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/portability
copying apache_beam/runners/portability/universal_local_runner_test.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/portability
copying apache_beam/runners/test/__init__.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/test
copying apache_beam/runners/worker/__init__.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/bundle_processor.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/data_plane.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/data_plane_test.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/log_handler.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/log_handler_test.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/logger.pxd -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/logger.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/logger_test.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/opcounters.pxd -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/opcounters.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/opcounters_test.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/operation_specs.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/operations.pxd -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/operations.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/sdk_worker.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/sdk_worker_main.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/sdk_worker_main_test.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/sdk_worker_test.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/sideinputs.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/sideinputs_test.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/statesampler.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/statesampler_fast.pyx -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/statesampler_slow.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/statesampler_test.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/worker_id_interceptor.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/runners/worker/worker_id_interceptor_test.py -> 
apache-beam-2.5.0.dev0/apache_beam/runners/worker
copying apache_beam/testing/__init__.py -> 
apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/pipeline_verifiers.py -> 
apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/pipeline_verifiers_test.py -> 
apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/test_pipeline.py -> 
apache-beam-2.5.0.dev0/apache_beam/testing
copying apache_beam/testing/test_pipeline_test.py -> 

[jira] [Commented] (BEAM-1191) Eliminate OldDoFn from the SDK

[Kenneth Knowles (JIRA)]

[ 
https://issues.apache.org/jira/browse/BEAM-1191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16433148#comment-16433148
 ] 

Kenneth Knowles commented on BEAM-1191:
---

(in https://github.com/apache/beam/pull/3125)

> Eliminate OldDoFn from the SDK
> --
>
> Key: BEAM-1191
> URL: https://issues.apache.org/jira/browse/BEAM-1191
> Project: Beam
>  Issue Type: Improvement
>  Components: sdk-java-core
>Reporter: Kenneth Knowles
>Assignee: Kenneth Knowles
>Priority: Minor
> Fix For: Not applicable
>
>
> We are far enough along that now {{OldDoFn}} is not usable by users and 
> BEAM-498 is closed out. The remaining occurrences are limited to runners and 
> things that should end up in runners-core.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[jira] [Work logged] (BEAM-4044) Take advantage of Calcite DDL

[ASF GitHub Bot (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-4044?focusedWorklogId=89665=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-89665
 ]

ASF GitHub Bot logged work on BEAM-4044:


Author: ASF GitHub Bot
Created on: 10/Apr/18 23:05
Start Date: 10/Apr/18 23:05
Worklog Time Spent: 10m 
  Work Description: akedin commented on a change in pull request #5040: 
[BEAM-4044] [SQL] Refresh DDL from 1.16
URL: https://github.com/apache/beam/pull/5040#discussion_r180593027
 
 

 ##
 File path: sdks/java/extensions/sql/src/main/codegen/includes/parserImpls.ftl
 ##
 @@ -1,106 +1,154 @@
-<#-- Licensed to the Apache Software Foundation (ASF) under one or more 
contributor
-  license agreements. See the NOTICE file distributed with this work for 
additional
-  information regarding copyright ownership. The ASF licenses this file to
-  You under the Apache License, Version 2.0 (the "License"); you may not use
-  this file except in compliance with the License. You may obtain a copy of
-  the License at http://www.apache.org/licenses/LICENSE-2.0 Unless required
-  by applicable law or agreed to in writing, software distributed under the
-  License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS
-  OF ANY KIND, either express or implied. See the License for the specific
-  language governing permissions and limitations under the License. -->
+<#--
+// Licensed to the Apache Software Foundation (ASF) under one or more
+// contributor license agreements.  See the NOTICE file distributed with
+// this work for additional information regarding copyright ownership.
+// The ASF licenses this file to you under the Apache License, Version 2.0
+// (the "License"); you may not use this file except in compliance with
+// the License.  You may obtain a copy of the License at
+//
+// http://www.apache.org/licenses/LICENSE-2.0
+//
+// Unless required by applicable law or agreed to in writing, software
+// distributed under the License is distributed on an "AS IS" BASIS,
+// WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+// See the License for the specific language governing permissions and
+// limitations under the License.
+-->
 
+boolean IfNotExistsOpt() :
 
 Review comment:
   This link is enough, i think. Do we need to update parser tests though?


This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Issue Time Tracking
---

Worklog Id: (was: 89665)
Time Spent: 1h 20m  (was: 1h 10m)

> Take advantage of Calcite DDL
> -
>
> Key: BEAM-4044
> URL: https://issues.apache.org/jira/browse/BEAM-4044
> Project: Beam
>  Issue Type: New Feature
>  Components: dsl-sql
>Reporter: Andrew Pilloud
>Assignee: Andrew Pilloud
>Priority: Major
>  Time Spent: 1h 20m
>  Remaining Estimate: 0h
>
> In Calcite 1.15 support for abstract DDL moved into calcite core. We should 
> take advantage of that.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Build failed in Jenkins: beam_PostCommit_Java_ValidatesRunner_Spark_Gradle #53

[Apache Jenkins Server]

See 


Changes:

[swegner] Disable Gradle agent for Jenkins build jobs.

[swegner] fixup! Add common Gradle switches to remaining jobs

[swegner] fixup! Execute switches on the passed-in context object

[swegner] fixup! Fix stale variable in java precommits

--
[...truncated 1.59 MB...]
at 
org.apache.beam.runners.spark.translation.streaming.SparkRunnerStreamingContextFactory.call(SparkRunnerStreamingContextFactory.java:79)
at 
org.apache.beam.runners.spark.translation.streaming.SparkRunnerStreamingContextFactory.call(SparkRunnerStreamingContextFactory.java:47)
at 
org.apache.spark.streaming.api.java.JavaStreamingContext$$anonfun$7.apply(JavaStreamingContext.scala:627)
at 
org.apache.spark.streaming.api.java.JavaStreamingContext$$anonfun$7.apply(JavaStreamingContext.scala:626)
at scala.Option.getOrElse(Option.scala:121)
at 
org.apache.spark.streaming.StreamingContext$.getOrCreate(StreamingContext.scala:828)
at 
org.apache.spark.streaming.api.java.JavaStreamingContext$.getOrCreate(JavaStreamingContext.scala:626)
at 
org.apache.spark.streaming.api.java.JavaStreamingContext.getOrCreate(JavaStreamingContext.scala)
at org.apache.beam.runners.spark.SparkRunner.run(SparkRunner.java:169)
at 
org.apache.beam.runners.spark.TestSparkRunner.run(TestSparkRunner.java:123)
at 
org.apache.beam.runners.spark.TestSparkRunner.run(TestSparkRunner.java:83)
at org.apache.beam.sdk.Pipeline.run(Pipeline.java:311)
at org.apache.beam.sdk.testing.TestPipeline.run(TestPipeline.java:346)
at org.apache.beam.sdk.testing.TestPipeline.run(TestPipeline.java:328)
at 
org.apache.beam.runners.spark.translation.streaming.CreateStreamTest.testDiscardingMode(CreateStreamTest.java:203)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at 
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
at 
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at 
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
at 
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
at 
org.apache.beam.sdk.testing.TestPipeline$1.evaluate(TestPipeline.java:317)
at 
org.junit.rules.ExpectedException$ExpectedExceptionStatement.evaluate(ExpectedException.java:239)
at org.junit.rules.RunRules.evaluate(RunRules.java:20)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
at 
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
at 
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
at 
org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.runTestClass(JUnitTestClassExecuter.java:114)
at 
org.gradle.api.internal.tasks.testing.junit.JUnitTestClassExecuter.execute(JUnitTestClassExecuter.java:57)
at 
org.gradle.api.internal.tasks.testing.junit.JUnitTestClassProcessor.processTestClass(JUnitTestClassProcessor.java:66)
at 
org.gradle.api.internal.tasks.testing.SuiteTestClassProcessor.processTestClass(SuiteTestClassProcessor.java:51)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at 
org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:35)
at 
org.gradle.internal.dispatch.ReflectionDispatch.dispatch(ReflectionDispatch.java:24)
at 
org.gradle.internal.dispatch.ContextClassLoaderDispatch.dispatch(ContextClassLoaderDispatch.java:32)
at 
org.gradle.internal.dispatch.ProxyDispatchAdapter$DispatchingInvocationHandler.invoke(ProxyDispatchAdapter.java:93)
at 

[jira] [Resolved] (BEAM-1191) Eliminate OldDoFn from the SDK

[Kenneth Knowles (JIRA)]

 [ 
https://issues.apache.org/jira/browse/BEAM-1191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kenneth Knowles resolved BEAM-1191.
---
   Resolution: Fixed
Fix Version/s: Not applicable

> Eliminate OldDoFn from the SDK
> --
>
> Key: BEAM-1191
> URL: https://issues.apache.org/jira/browse/BEAM-1191
> Project: Beam
>  Issue Type: Improvement
>  Components: sdk-java-core
>Reporter: Kenneth Knowles
>Assignee: Kenneth Knowles
>Priority: Minor
> Fix For: Not applicable
>
>
> We are far enough along that now {{OldDoFn}} is not usable by users and 
> BEAM-498 is closed out. The remaining occurrences are limited to runners and 
> things that should end up in runners-core.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)