Build failed in Jenkins: beam_PostCommit_Java_MavenInstall #2922

2017-03-15 Thread Apache Jenkins Server
See 


--
[...truncated 744.92 KB...]
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
2017-03-16T00:10:38.926 [INFO] 

2017-03-16T00:10:38.926 [INFO] Reactor Summary:
2017-03-16T00:10:38.926 [INFO] 
2017-03-16T00:10:38.926 [INFO] Apache Beam :: Parent 
.. SUCCESS [ 22.931 s]
2017-03-16T00:10:38.926 [INFO] Apache Beam :: SDKs :: Java :: Build Tools 
. SUCCESS [ 13.032 s]
2017-03-16T00:10:38.926 [INFO] Apache Beam :: SDKs 
 SUCCESS [  7.162 s]
2017-03-16T00:10:38.926 [INFO] Apache Beam :: SDKs :: Common 
.. SUCCESS [  3.091 s]
2017-03-16T00:10:38.926 [INFO] Apache Beam :: SDKs :: Common :: Fn API 
 SUCCESS [ 27.179 s]
2017-03-16T00:10:38.926 [INFO] Apache Beam :: SDKs :: Common :: Runner API 
 SUCCESS [ 15.904 s]
2017-03-16T00:10:38.926 [INFO] Apache Beam :: SDKs :: Java 
 SUCCESS [  2.065 s]
2017-03-16T00:10:38.926 [INFO] Apache Beam :: SDKs :: Java :: Core 
 SUCCESS [02:27 min]
2017-03-16T00:10:38.926 [INFO] Apache Beam :: Runners 
. SUCCESS [  1.677 s]
2017-03-16T00:10:38.926 [INFO] Apache Beam :: Runners :: Core Java Construction 
... SUCCESS [ 11.541 s]
2017-03-16T00:10:38.926 [INFO] Apache Beam :: Runners :: Core Java 
 SUCCESS [ 43.962 s]
2017-03-16T00:10:38.926 [INFO] Apache Beam :: Runners :: Direct Java 
.. SUCCESS [02:30 min]
2017-03-16T00:10:38.926 [INFO] Apache Beam :: SDKs :: Java :: IO 
.. SUCCESS [  2.078 s]
2017-03-16T00:10:38.926 [INFO] Apache Beam :: SDKs :: Java :: IO :: 
Elasticsearch . SUCCESS [ 29.210 s]
2017-03-16T00:10:38.926 [INFO] Apache Beam :: Runners :: Google Cloud Dataflow 
 SUCCESS [ 25.627 s]
2017-03-16T00:10:38.926 [INFO] Apache Beam :: SDKs :: Java :: IO :: Google 
Cloud Platform FAILURE [ 47.845 s]
2017-03-16T00:10:38.926 [INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop 
Common . SKIPPED
2017-03-16T00:10:38.926 [INFO] Apache Beam :: SDKs :: Java :: IO :: HBase 
. SKIPPED
2017-03-16T00:10:38.926 [INFO] Apache Beam :: SDKs :: Java :: IO :: HDFS 
.. SKIPPED
2017-03-16T00:10:38.927 [INFO] Apache Beam :: SDKs :: Java :: IO :: JDBC 
.. SKIPPED
2017-03-16T00:10:38.927 [INFO] Apache Beam :: SDKs :: Java :: IO :: JMS 
... SKIPPED
2017-03-16T00:10:38.927 [INFO] Apache Beam :: SDKs :: Java :: IO :: Kafka 
. SKIPPED
2017-03-16T00:10:38.927 [INFO] Apache Beam :: SDKs :: Java :: IO :: Kinesis 
... SKIPPED
2017-03-16T00:10:38.927 [INFO] Apache Beam :: SDKs :: Java :: IO :: MongoDB 
... SKIPPED
2017-03-16T00:10:38.927 [INFO] Apache Beam :: SDKs :: Java :: IO :: MQTT 
.. SKIPPED
2017-03-16T00:10:38.927 [INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes 
 SKIPPED
2017-03-16T00:10:38.927 [INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes 
:: Starter SKIPPED
2017-03-16T00:10:38.927 [INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes 
:: Examples SKIPPED
2017-03-16T00:10:38.927 [INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes 
:: Examples - Java 8 SKIPPED
2017-03-16T00:10:38.927 [INFO] Apache Beam :: SDKs :: Java :: Extensions 
.. SKIPPED
2017-03-16T00:10:38.927 [INFO] Apache Beam :: SDKs :: Java :: Extensions :: 
Jackson SKIPPED
2017-03-16T00:10:38.927 [INFO] Apache Beam :: SDKs :: Java :: Extensions :: 
Join library SKIPPED
2017-03-16T00:10:38.927 [INFO] Apache Beam :: SDKs :: Java :: Extensions :: 
Sorter  SKIPPED
2017-03-16T00:10:38.927 [INFO] Apache Beam :: SDKs :: Java :: Harness 
. SKIPPED
2017-03-16T00:10:38.927 [INFO] Apache Beam :: SDKs :: Java :: Java 8 Tests 
 SKIPPED
2017-03-16T00:10:38.927 [INFO] Apache Beam :: SDKs :: Python 
.. SKIPPED
2017-03-16T00:10:38.927 [INFO] Apache Beam :: Runners :: Flink 
 SKIPPED
2017-03-16T00:10:38.927 [INFO] Apache Beam :: 

[jira] [Commented] (BEAM-1732) Window.Assign does not properly populate DisplayData of the enclosing Window transform

2017-03-15 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/BEAM-1732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15927223#comment-15927223
 ] 

ASF GitHub Bot commented on BEAM-1732:
--

GitHub user tgroh opened a pull request:

https://github.com/apache/beam/pull/2258

[BEAM-1732] Populate Display Data in Window.Assign

Be sure to do all of the following to help us incorporate your contribution
quickly and easily:

 - [ ] Make sure the PR title is formatted like:
   `[BEAM-] Description of pull request`
 - [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable
   Travis-CI on your fork and ensure the whole test matrix passes).
 - [ ] Replace `` in the title with the actual Jira issue
   number, if there is one.
 - [ ] If this contribution is large, please file an Apache
   [Individual Contributor License 
Agreement](https://www.apache.org/licenses/icla.txt).

---
This populates the diff between the input and output Windowing
Strategies as the display data of the primitive.

Certain elements are slightly changed, due to implementation details of
Windowing Strategy. All specified elements, regardless of where they
were specified, will be included in the Display Data.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/tgroh/beam window_assign_display_data

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/beam/pull/2258.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #2258


commit fc59cd00dfab866bacd4fb12ddb8e8d5e27f6154
Author: Thomas Groh 
Date:   2017-03-15T23:52:48Z

Populate Display Data in Window.Assign

This populates the diff between the input and output Windowing
Strategies as the display data of the primitive.

Certain elements are slightly changed, due to implementation details of
Windowing Strategy. All specified elements, regardless of where they
were specified, will be included in the Display Data.




> Window.Assign does not properly populate DisplayData of the enclosing Window 
> transform
> --
>
> Key: BEAM-1732
> URL: https://issues.apache.org/jira/browse/BEAM-1732
> Project: Beam
>  Issue Type: Bug
>  Components: sdk-java-core
>Reporter: Thomas Groh
>Assignee: Thomas Groh
>
> This should populate the same display data as the enclosing Window.Bound



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


Build failed in Jenkins: beam_PostCommit_Java_Version_Test » JDK 1.7 (latest),beam #26

2017-03-15 Thread Apache Jenkins Server
See 


--
[...truncated 461.33 KB...]
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.025 sec - in 
org.apache.beam.sdk.transforms.PartitionTest
Running org.apache.beam.sdk.transforms.MaxTest
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.005 sec - in 
org.apache.beam.sdk.transforms.MaxTest
Running org.apache.beam.sdk.transforms.ParDoTest
Tests run: 14, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.125 sec - in 
org.apache.beam.sdk.transforms.ParDoTest
Running org.apache.beam.sdk.transforms.CreateTest
Tests run: 16, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.368 sec - in 
org.apache.beam.sdk.transforms.CreateTest
Running org.apache.beam.sdk.transforms.CombineTest
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.016 sec - in 
org.apache.beam.sdk.transforms.CombineTest
Running org.apache.beam.sdk.util.VarIntTest
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec - in 
org.apache.beam.sdk.util.VarIntTest
Running org.apache.beam.sdk.util.StructsTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec - in 
org.apache.beam.sdk.util.StructsTest
Running org.apache.beam.sdk.util.StreamUtilsTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec - in 
org.apache.beam.sdk.util.StreamUtilsTest
Running org.apache.beam.sdk.util.PubsubTestClientTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec - in 
org.apache.beam.sdk.util.PubsubTestClientTest
Running org.apache.beam.sdk.util.StringUtilsTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.StringUtilsTest
Running org.apache.beam.sdk.util.MutationDetectorsTest
Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.006 sec - in 
org.apache.beam.sdk.util.MutationDetectorsTest
Running org.apache.beam.sdk.util.ValueWithRecordIdTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.009 sec - in 
org.apache.beam.sdk.util.ValueWithRecordIdTest
Running org.apache.beam.sdk.util.ExposedByteArrayOutputStreamTest
Tests run: 24, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.ExposedByteArrayOutputStreamTest
Running org.apache.beam.sdk.util.GcsIOChannelFactoryRegistrarTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.GcsIOChannelFactoryRegistrarTest
Running org.apache.beam.sdk.util.GcpProjectUtilTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.087 sec - in 
org.apache.beam.sdk.util.GcpProjectUtilTest
Running org.apache.beam.sdk.util.ZipFilesTest
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.014 sec - in 
org.apache.beam.sdk.util.ZipFilesTest
Running org.apache.beam.sdk.util.GcsIOChannelFactoryTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec - in 
org.apache.beam.sdk.util.GcsIOChannelFactoryTest
Running org.apache.beam.sdk.util.ApiSurfaceTest
Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.009 sec - in 
org.apache.beam.sdk.util.ApiSurfaceTest
Running org.apache.beam.sdk.util.PubsubClientTest
Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.009 sec - in 
org.apache.beam.sdk.util.PubsubClientTest
Running org.apache.beam.sdk.util.UnownedInputStreamTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec - in 
org.apache.beam.sdk.util.UnownedInputStreamTest
Running org.apache.beam.sdk.util.FileIOChannelFactoryTest
Tests run: 18, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.013 sec - in 
org.apache.beam.sdk.util.FileIOChannelFactoryTest
Running org.apache.beam.sdk.util.ReleaseInfoTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec - in 
org.apache.beam.sdk.util.ReleaseInfoTest
Running org.apache.beam.sdk.util.WindowedValueTest
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.012 sec - in 
org.apache.beam.sdk.util.WindowedValueTest
Running org.apache.beam.sdk.util.common.ReflectHelpersTest
Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.007 sec - in 
org.apache.beam.sdk.util.common.ReflectHelpersTest
Running org.apache.beam.sdk.util.PubsubJsonClientTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.133 sec - in 
org.apache.beam.sdk.util.PubsubJsonClientTest
Running org.apache.beam.sdk.util.DefaultBucketTest
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.025 sec - in 
org.apache.beam.sdk.util.DefaultBucketTest
Running org.apache.beam.sdk.util.GcsUtilTest
Tests run: 28, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.318 sec - in 
org.apache.beam.sdk.util.GcsUtilTest
Running org.apache.beam.sdk.util.WindowingStrategiesTest
Tests run: 3, Failures: 0, Errors: 0, 

Build failed in Jenkins: beam_PostCommit_Java_Version_Test » JDK 1.8 (latest),beam #26

2017-03-15 Thread Apache Jenkins Server
See 


--
[...truncated 461.86 KB...]
Tests run: 14, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.085 sec - in 
org.apache.beam.sdk.transforms.ParDoTest
Running org.apache.beam.sdk.transforms.CreateTest
Tests run: 16, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.305 sec - in 
org.apache.beam.sdk.transforms.CreateTest
Running org.apache.beam.sdk.transforms.CombineTest
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.015 sec - in 
org.apache.beam.sdk.transforms.CombineTest
Running org.apache.beam.sdk.util.VarIntTest
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec - in 
org.apache.beam.sdk.util.VarIntTest
Running org.apache.beam.sdk.util.StructsTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec - in 
org.apache.beam.sdk.util.StructsTest
Running org.apache.beam.sdk.util.StreamUtilsTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.004 sec - in 
org.apache.beam.sdk.util.StreamUtilsTest
Running org.apache.beam.sdk.util.PubsubTestClientTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec - in 
org.apache.beam.sdk.util.PubsubTestClientTest
Running org.apache.beam.sdk.util.StringUtilsTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.StringUtilsTest
Running org.apache.beam.sdk.util.MutationDetectorsTest
Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.006 sec - in 
org.apache.beam.sdk.util.MutationDetectorsTest
Running org.apache.beam.sdk.util.ValueWithRecordIdTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec - in 
org.apache.beam.sdk.util.ValueWithRecordIdTest
Running org.apache.beam.sdk.util.ExposedByteArrayOutputStreamTest
Tests run: 24, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.004 sec - in 
org.apache.beam.sdk.util.ExposedByteArrayOutputStreamTest
Running org.apache.beam.sdk.util.GcsIOChannelFactoryRegistrarTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.GcsIOChannelFactoryRegistrarTest
Running org.apache.beam.sdk.util.GcpProjectUtilTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.09 sec - in 
org.apache.beam.sdk.util.GcpProjectUtilTest
Running org.apache.beam.sdk.util.ZipFilesTest
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.019 sec - in 
org.apache.beam.sdk.util.ZipFilesTest
Running org.apache.beam.sdk.util.GcsIOChannelFactoryTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.GcsIOChannelFactoryTest
Running org.apache.beam.sdk.util.ApiSurfaceTest
Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.028 sec - in 
org.apache.beam.sdk.util.ApiSurfaceTest
Running org.apache.beam.sdk.util.PubsubClientTest
Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.017 sec - in 
org.apache.beam.sdk.util.PubsubClientTest
Running org.apache.beam.sdk.util.UnownedInputStreamTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.UnownedInputStreamTest
Running org.apache.beam.sdk.util.FileIOChannelFactoryTest
Tests run: 18, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.017 sec - in 
org.apache.beam.sdk.util.FileIOChannelFactoryTest
Running org.apache.beam.sdk.util.ReleaseInfoTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.004 sec - in 
org.apache.beam.sdk.util.ReleaseInfoTest
Running org.apache.beam.sdk.util.WindowedValueTest
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.03 sec - in 
org.apache.beam.sdk.util.WindowedValueTest
Running org.apache.beam.sdk.util.common.ReflectHelpersTest
Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.01 sec - in 
org.apache.beam.sdk.util.common.ReflectHelpersTest
Running org.apache.beam.sdk.util.PubsubJsonClientTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.094 sec - in 
org.apache.beam.sdk.util.PubsubJsonClientTest
Running org.apache.beam.sdk.util.DefaultBucketTest
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.02 sec - in 
org.apache.beam.sdk.util.DefaultBucketTest
Running org.apache.beam.sdk.util.GcsUtilTest
Tests run: 28, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.171 sec - in 
org.apache.beam.sdk.util.GcsUtilTest
Running org.apache.beam.sdk.util.WindowingStrategiesTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.235 sec - in 
org.apache.beam.sdk.util.WindowingStrategiesTest
Running org.apache.beam.sdk.util.ExposedByteArrayInputStreamTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.ExposedByteArrayInputStreamTest
Running 

Build failed in Jenkins: beam_PostCommit_Java_Version_Test » OpenJDK 7 (on Ubuntu only),beam #26

2017-03-15 Thread Apache Jenkins Server
See 


--
[...truncated 462.54 KB...]
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.021 sec - in 
org.apache.beam.sdk.transforms.PartitionTest
Running org.apache.beam.sdk.transforms.MaxTest
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec - in 
org.apache.beam.sdk.transforms.MaxTest
Running org.apache.beam.sdk.transforms.ParDoTest
Tests run: 14, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.078 sec - in 
org.apache.beam.sdk.transforms.ParDoTest
Running org.apache.beam.sdk.transforms.CreateTest
Tests run: 16, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.275 sec - in 
org.apache.beam.sdk.transforms.CreateTest
Running org.apache.beam.sdk.transforms.CombineTest
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.016 sec - in 
org.apache.beam.sdk.transforms.CombineTest
Running org.apache.beam.sdk.util.VarIntTest
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.005 sec - in 
org.apache.beam.sdk.util.VarIntTest
Running org.apache.beam.sdk.util.StructsTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec - in 
org.apache.beam.sdk.util.StructsTest
Running org.apache.beam.sdk.util.StreamUtilsTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec - in 
org.apache.beam.sdk.util.StreamUtilsTest
Running org.apache.beam.sdk.util.PubsubTestClientTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec - in 
org.apache.beam.sdk.util.PubsubTestClientTest
Running org.apache.beam.sdk.util.StringUtilsTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.StringUtilsTest
Running org.apache.beam.sdk.util.MutationDetectorsTest
Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.006 sec - in 
org.apache.beam.sdk.util.MutationDetectorsTest
Running org.apache.beam.sdk.util.ValueWithRecordIdTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.005 sec - in 
org.apache.beam.sdk.util.ValueWithRecordIdTest
Running org.apache.beam.sdk.util.ExposedByteArrayOutputStreamTest
Tests run: 24, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec - in 
org.apache.beam.sdk.util.ExposedByteArrayOutputStreamTest
Running org.apache.beam.sdk.util.GcsIOChannelFactoryRegistrarTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.GcsIOChannelFactoryRegistrarTest
Running org.apache.beam.sdk.util.GcpProjectUtilTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.057 sec - in 
org.apache.beam.sdk.util.GcpProjectUtilTest
Running org.apache.beam.sdk.util.ZipFilesTest
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.015 sec - in 
org.apache.beam.sdk.util.ZipFilesTest
Running org.apache.beam.sdk.util.GcsIOChannelFactoryTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.GcsIOChannelFactoryTest
Running org.apache.beam.sdk.util.ApiSurfaceTest
Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.012 sec - in 
org.apache.beam.sdk.util.ApiSurfaceTest
Running org.apache.beam.sdk.util.PubsubClientTest
Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.008 sec - in 
org.apache.beam.sdk.util.PubsubClientTest
Running org.apache.beam.sdk.util.UnownedInputStreamTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec - in 
org.apache.beam.sdk.util.UnownedInputStreamTest
Running org.apache.beam.sdk.util.FileIOChannelFactoryTest
Tests run: 18, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.011 sec - in 
org.apache.beam.sdk.util.FileIOChannelFactoryTest
Running org.apache.beam.sdk.util.ReleaseInfoTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec - in 
org.apache.beam.sdk.util.ReleaseInfoTest
Running org.apache.beam.sdk.util.WindowedValueTest
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.013 sec - in 
org.apache.beam.sdk.util.WindowedValueTest
Running org.apache.beam.sdk.util.common.ReflectHelpersTest
Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.01 sec - in 
org.apache.beam.sdk.util.common.ReflectHelpersTest
Running org.apache.beam.sdk.util.PubsubJsonClientTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.086 sec - in 
org.apache.beam.sdk.util.PubsubJsonClientTest
Running org.apache.beam.sdk.util.DefaultBucketTest
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.016 sec - in 
org.apache.beam.sdk.util.DefaultBucketTest
Running org.apache.beam.sdk.util.GcsUtilTest
Tests run: 28, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.195 sec - in 
org.apache.beam.sdk.util.GcsUtilTest
Running org.apache.beam.sdk.util.WindowingStrategiesTest
Tests run: 3, Failures: 

Build failed in Jenkins: beam_PostCommit_Java_Version_Test » OpenJDK 8 (on Ubuntu only),beam #26

2017-03-15 Thread Apache Jenkins Server
See 


--
[...truncated 462.55 KB...]
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.021 sec - in 
org.apache.beam.sdk.transforms.PartitionTest
Running org.apache.beam.sdk.transforms.MaxTest
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.007 sec - in 
org.apache.beam.sdk.transforms.MaxTest
Running org.apache.beam.sdk.transforms.ParDoTest
Tests run: 14, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.087 sec - in 
org.apache.beam.sdk.transforms.ParDoTest
Running org.apache.beam.sdk.transforms.CreateTest
Tests run: 16, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.317 sec - in 
org.apache.beam.sdk.transforms.CreateTest
Running org.apache.beam.sdk.transforms.CombineTest
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.014 sec - in 
org.apache.beam.sdk.transforms.CombineTest
Running org.apache.beam.sdk.util.VarIntTest
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.004 sec - in 
org.apache.beam.sdk.util.VarIntTest
Running org.apache.beam.sdk.util.StructsTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec - in 
org.apache.beam.sdk.util.StructsTest
Running org.apache.beam.sdk.util.StreamUtilsTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec - in 
org.apache.beam.sdk.util.StreamUtilsTest
Running org.apache.beam.sdk.util.PubsubTestClientTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec - in 
org.apache.beam.sdk.util.PubsubTestClientTest
Running org.apache.beam.sdk.util.StringUtilsTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.StringUtilsTest
Running org.apache.beam.sdk.util.MutationDetectorsTest
Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.005 sec - in 
org.apache.beam.sdk.util.MutationDetectorsTest
Running org.apache.beam.sdk.util.ValueWithRecordIdTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.004 sec - in 
org.apache.beam.sdk.util.ValueWithRecordIdTest
Running org.apache.beam.sdk.util.ExposedByteArrayOutputStreamTest
Tests run: 24, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec - in 
org.apache.beam.sdk.util.ExposedByteArrayOutputStreamTest
Running org.apache.beam.sdk.util.GcsIOChannelFactoryRegistrarTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.GcsIOChannelFactoryRegistrarTest
Running org.apache.beam.sdk.util.GcpProjectUtilTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.056 sec - in 
org.apache.beam.sdk.util.GcpProjectUtilTest
Running org.apache.beam.sdk.util.ZipFilesTest
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.016 sec - in 
org.apache.beam.sdk.util.ZipFilesTest
Running org.apache.beam.sdk.util.GcsIOChannelFactoryTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.GcsIOChannelFactoryTest
Running org.apache.beam.sdk.util.ApiSurfaceTest
Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.009 sec - in 
org.apache.beam.sdk.util.ApiSurfaceTest
Running org.apache.beam.sdk.util.PubsubClientTest
Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.009 sec - in 
org.apache.beam.sdk.util.PubsubClientTest
Running org.apache.beam.sdk.util.UnownedInputStreamTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.UnownedInputStreamTest
Running org.apache.beam.sdk.util.FileIOChannelFactoryTest
Tests run: 18, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.011 sec - in 
org.apache.beam.sdk.util.FileIOChannelFactoryTest
Running org.apache.beam.sdk.util.ReleaseInfoTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec - in 
org.apache.beam.sdk.util.ReleaseInfoTest
Running org.apache.beam.sdk.util.WindowedValueTest
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.012 sec - in 
org.apache.beam.sdk.util.WindowedValueTest
Running org.apache.beam.sdk.util.common.ReflectHelpersTest
Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.008 sec - in 
org.apache.beam.sdk.util.common.ReflectHelpersTest
Running org.apache.beam.sdk.util.PubsubJsonClientTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.093 sec - in 
org.apache.beam.sdk.util.PubsubJsonClientTest
Running org.apache.beam.sdk.util.DefaultBucketTest
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.015 sec - in 
org.apache.beam.sdk.util.DefaultBucketTest
Running org.apache.beam.sdk.util.GcsUtilTest
Tests run: 28, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.257 sec - in 
org.apache.beam.sdk.util.GcsUtilTest
Running org.apache.beam.sdk.util.WindowingStrategiesTest
Tests run: 3, Failures: 0, 

Jenkins build is back to stable : beam_PostCommit_Java_RunnableOnService_Spark #1254

2017-03-15 Thread Apache Jenkins Server
See 




Build failed in Jenkins: beam_PostCommit_Java_MavenInstall #2921

2017-03-15 Thread Apache Jenkins Server
See 


Changes:

[tgroh] Disable Guava Shading in Google Cloud Platform IOs

--
[...truncated 748.66 KB...]
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
[JENKINS] Archiving disabled
2017-03-15T23:47:32.911 [INFO] 

2017-03-15T23:47:32.911 [INFO] Reactor Summary:
2017-03-15T23:47:32.911 [INFO] 
2017-03-15T23:47:32.911 [INFO] Apache Beam :: Parent 
.. SUCCESS [ 21.433 s]
2017-03-15T23:47:32.911 [INFO] Apache Beam :: SDKs :: Java :: Build Tools 
. SUCCESS [ 13.590 s]
2017-03-15T23:47:32.911 [INFO] Apache Beam :: SDKs 
 SUCCESS [  8.244 s]
2017-03-15T23:47:32.911 [INFO] Apache Beam :: SDKs :: Common 
.. SUCCESS [  5.267 s]
2017-03-15T23:47:32.911 [INFO] Apache Beam :: SDKs :: Common :: Fn API 
 SUCCESS [ 16.082 s]
2017-03-15T23:47:32.911 [INFO] Apache Beam :: SDKs :: Common :: Runner API 
 SUCCESS [ 10.678 s]
2017-03-15T23:47:32.911 [INFO] Apache Beam :: SDKs :: Java 
 SUCCESS [  2.266 s]
2017-03-15T23:47:32.912 [INFO] Apache Beam :: SDKs :: Java :: Core 
 SUCCESS [03:06 min]
2017-03-15T23:47:32.912 [INFO] Apache Beam :: Runners 
. SUCCESS [  1.818 s]
2017-03-15T23:47:32.912 [INFO] Apache Beam :: Runners :: Core Java Construction 
... SUCCESS [ 12.004 s]
2017-03-15T23:47:32.912 [INFO] Apache Beam :: Runners :: Core Java 
 SUCCESS [ 52.835 s]
2017-03-15T23:47:32.912 [INFO] Apache Beam :: Runners :: Direct Java 
.. SUCCESS [03:33 min]
2017-03-15T23:47:32.912 [INFO] Apache Beam :: SDKs :: Java :: IO 
.. SUCCESS [  1.775 s]
2017-03-15T23:47:32.912 [INFO] Apache Beam :: SDKs :: Java :: IO :: 
Elasticsearch . SUCCESS [ 43.574 s]
2017-03-15T23:47:32.912 [INFO] Apache Beam :: Runners :: Google Cloud Dataflow 
 SUCCESS [ 39.352 s]
2017-03-15T23:47:32.912 [INFO] Apache Beam :: SDKs :: Java :: IO :: Google 
Cloud Platform FAILURE [01:06 min]
2017-03-15T23:47:32.912 [INFO] Apache Beam :: SDKs :: Java :: IO :: Hadoop 
Common . SKIPPED
2017-03-15T23:47:32.912 [INFO] Apache Beam :: SDKs :: Java :: IO :: HBase 
. SKIPPED
2017-03-15T23:47:32.912 [INFO] Apache Beam :: SDKs :: Java :: IO :: HDFS 
.. SKIPPED
2017-03-15T23:47:32.912 [INFO] Apache Beam :: SDKs :: Java :: IO :: JDBC 
.. SKIPPED
2017-03-15T23:47:32.912 [INFO] Apache Beam :: SDKs :: Java :: IO :: JMS 
... SKIPPED
2017-03-15T23:47:32.912 [INFO] Apache Beam :: SDKs :: Java :: IO :: Kafka 
. SKIPPED
2017-03-15T23:47:32.912 [INFO] Apache Beam :: SDKs :: Java :: IO :: Kinesis 
... SKIPPED
2017-03-15T23:47:32.912 [INFO] Apache Beam :: SDKs :: Java :: IO :: MongoDB 
... SKIPPED
2017-03-15T23:47:32.912 [INFO] Apache Beam :: SDKs :: Java :: IO :: MQTT 
.. SKIPPED
2017-03-15T23:47:32.912 [INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes 
 SKIPPED
2017-03-15T23:47:32.912 [INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes 
:: Starter SKIPPED
2017-03-15T23:47:32.912 [INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes 
:: Examples SKIPPED
2017-03-15T23:47:32.912 [INFO] Apache Beam :: SDKs :: Java :: Maven Archetypes 
:: Examples - Java 8 SKIPPED
2017-03-15T23:47:32.912 [INFO] Apache Beam :: SDKs :: Java :: Extensions 
.. SKIPPED
2017-03-15T23:47:32.912 [INFO] Apache Beam :: SDKs :: Java :: Extensions :: 
Jackson SKIPPED
2017-03-15T23:47:32.912 [INFO] Apache Beam :: SDKs :: Java :: Extensions :: 
Join library SKIPPED
2017-03-15T23:47:32.912 [INFO] Apache Beam :: SDKs :: Java :: Extensions :: 
Sorter  SKIPPED
2017-03-15T23:47:32.912 [INFO] Apache Beam :: SDKs :: Java :: Harness 
. SKIPPED
2017-03-15T23:47:32.912 [INFO] Apache Beam :: SDKs :: Java :: Java 8 Tests 
 SKIPPED
2017-03-15T23:47:32.912 [INFO] Apache Beam :: SDKs :: Python 
.. SKIPPED
2017-03-15T23:47:32.912 [INFO] Apache Beam :: Runners :: 

[jira] [Created] (BEAM-1732) Window.Assign does not properly populate DisplayData of the enclosing Window transform

2017-03-15 Thread Thomas Groh (JIRA)
Thomas Groh created BEAM-1732:
-

 Summary: Window.Assign does not properly populate DisplayData of 
the enclosing Window transform
 Key: BEAM-1732
 URL: https://issues.apache.org/jira/browse/BEAM-1732
 Project: Beam
  Issue Type: Bug
  Components: sdk-java-core
Reporter: Thomas Groh
Assignee: Thomas Groh


This should populate the same display data as the enclosing Window.Bound



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


Build failed in Jenkins: beam_PostCommit_Java_Version_Test » JDK 1.7 (latest),beam #25

2017-03-15 Thread Apache Jenkins Server
See 


Changes:

[tgroh] Disable Guava Shading in Google Cloud Platform IOs

--
[...truncated 461.38 KB...]
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.018 sec - in 
org.apache.beam.sdk.transforms.PartitionTest
Running org.apache.beam.sdk.transforms.MaxTest
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec - in 
org.apache.beam.sdk.transforms.MaxTest
Running org.apache.beam.sdk.transforms.ParDoTest
Tests run: 14, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.088 sec - in 
org.apache.beam.sdk.transforms.ParDoTest
Running org.apache.beam.sdk.transforms.CreateTest
Tests run: 16, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.326 sec - in 
org.apache.beam.sdk.transforms.CreateTest
Running org.apache.beam.sdk.transforms.CombineTest
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.015 sec - in 
org.apache.beam.sdk.transforms.CombineTest
Running org.apache.beam.sdk.util.VarIntTest
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.006 sec - in 
org.apache.beam.sdk.util.VarIntTest
Running org.apache.beam.sdk.util.StructsTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec - in 
org.apache.beam.sdk.util.StructsTest
Running org.apache.beam.sdk.util.StreamUtilsTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec - in 
org.apache.beam.sdk.util.StreamUtilsTest
Running org.apache.beam.sdk.util.PubsubTestClientTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec - in 
org.apache.beam.sdk.util.PubsubTestClientTest
Running org.apache.beam.sdk.util.StringUtilsTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.StringUtilsTest
Running org.apache.beam.sdk.util.MutationDetectorsTest
Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.005 sec - in 
org.apache.beam.sdk.util.MutationDetectorsTest
Running org.apache.beam.sdk.util.ValueWithRecordIdTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.005 sec - in 
org.apache.beam.sdk.util.ValueWithRecordIdTest
Running org.apache.beam.sdk.util.ExposedByteArrayOutputStreamTest
Tests run: 24, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec - in 
org.apache.beam.sdk.util.ExposedByteArrayOutputStreamTest
Running org.apache.beam.sdk.util.GcsIOChannelFactoryRegistrarTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.GcsIOChannelFactoryRegistrarTest
Running org.apache.beam.sdk.util.GcpProjectUtilTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.06 sec - in 
org.apache.beam.sdk.util.GcpProjectUtilTest
Running org.apache.beam.sdk.util.ZipFilesTest
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.013 sec - in 
org.apache.beam.sdk.util.ZipFilesTest
Running org.apache.beam.sdk.util.GcsIOChannelFactoryTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.GcsIOChannelFactoryTest
Running org.apache.beam.sdk.util.ApiSurfaceTest
Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.008 sec - in 
org.apache.beam.sdk.util.ApiSurfaceTest
Running org.apache.beam.sdk.util.PubsubClientTest
Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.005 sec - in 
org.apache.beam.sdk.util.PubsubClientTest
Running org.apache.beam.sdk.util.UnownedInputStreamTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.UnownedInputStreamTest
Running org.apache.beam.sdk.util.FileIOChannelFactoryTest
Tests run: 18, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.012 sec - in 
org.apache.beam.sdk.util.FileIOChannelFactoryTest
Running org.apache.beam.sdk.util.ReleaseInfoTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec - in 
org.apache.beam.sdk.util.ReleaseInfoTest
Running org.apache.beam.sdk.util.WindowedValueTest
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.015 sec - in 
org.apache.beam.sdk.util.WindowedValueTest
Running org.apache.beam.sdk.util.common.ReflectHelpersTest
Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.006 sec - in 
org.apache.beam.sdk.util.common.ReflectHelpersTest
Running org.apache.beam.sdk.util.PubsubJsonClientTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.092 sec - in 
org.apache.beam.sdk.util.PubsubJsonClientTest
Running org.apache.beam.sdk.util.DefaultBucketTest
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.018 sec - in 
org.apache.beam.sdk.util.DefaultBucketTest
Running org.apache.beam.sdk.util.GcsUtilTest
Tests run: 28, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.967 sec - in 
org.apache.beam.sdk.util.GcsUtilTest
Running 

Build failed in Jenkins: beam_PostCommit_Java_Version_Test » OpenJDK 8 (on Ubuntu only),beam #25

2017-03-15 Thread Apache Jenkins Server
See 


Changes:

[tgroh] Disable Guava Shading in Google Cloud Platform IOs

--
[...truncated 462.59 KB...]
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.027 sec - in 
org.apache.beam.sdk.transforms.PartitionTest
Running org.apache.beam.sdk.transforms.MaxTest
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.transforms.MaxTest
Running org.apache.beam.sdk.transforms.ParDoTest
Tests run: 14, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.113 sec - in 
org.apache.beam.sdk.transforms.ParDoTest
Running org.apache.beam.sdk.transforms.CreateTest
Tests run: 16, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.299 sec - in 
org.apache.beam.sdk.transforms.CreateTest
Running org.apache.beam.sdk.transforms.CombineTest
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.022 sec - in 
org.apache.beam.sdk.transforms.CombineTest
Running org.apache.beam.sdk.util.VarIntTest
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.005 sec - in 
org.apache.beam.sdk.util.VarIntTest
Running org.apache.beam.sdk.util.StructsTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec - in 
org.apache.beam.sdk.util.StructsTest
Running org.apache.beam.sdk.util.StreamUtilsTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec - in 
org.apache.beam.sdk.util.StreamUtilsTest
Running org.apache.beam.sdk.util.PubsubTestClientTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec - in 
org.apache.beam.sdk.util.PubsubTestClientTest
Running org.apache.beam.sdk.util.StringUtilsTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.StringUtilsTest
Running org.apache.beam.sdk.util.MutationDetectorsTest
Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.006 sec - in 
org.apache.beam.sdk.util.MutationDetectorsTest
Running org.apache.beam.sdk.util.ValueWithRecordIdTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.005 sec - in 
org.apache.beam.sdk.util.ValueWithRecordIdTest
Running org.apache.beam.sdk.util.ExposedByteArrayOutputStreamTest
Tests run: 24, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec - in 
org.apache.beam.sdk.util.ExposedByteArrayOutputStreamTest
Running org.apache.beam.sdk.util.GcsIOChannelFactoryRegistrarTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.GcsIOChannelFactoryRegistrarTest
Running org.apache.beam.sdk.util.GcpProjectUtilTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.085 sec - in 
org.apache.beam.sdk.util.GcpProjectUtilTest
Running org.apache.beam.sdk.util.ZipFilesTest
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.015 sec - in 
org.apache.beam.sdk.util.ZipFilesTest
Running org.apache.beam.sdk.util.GcsIOChannelFactoryTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.GcsIOChannelFactoryTest
Running org.apache.beam.sdk.util.ApiSurfaceTest
Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.008 sec - in 
org.apache.beam.sdk.util.ApiSurfaceTest
Running org.apache.beam.sdk.util.PubsubClientTest
Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.008 sec - in 
org.apache.beam.sdk.util.PubsubClientTest
Running org.apache.beam.sdk.util.UnownedInputStreamTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.UnownedInputStreamTest
Running org.apache.beam.sdk.util.FileIOChannelFactoryTest
Tests run: 18, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.013 sec - in 
org.apache.beam.sdk.util.FileIOChannelFactoryTest
Running org.apache.beam.sdk.util.ReleaseInfoTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec - in 
org.apache.beam.sdk.util.ReleaseInfoTest
Running org.apache.beam.sdk.util.WindowedValueTest
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.013 sec - in 
org.apache.beam.sdk.util.WindowedValueTest
Running org.apache.beam.sdk.util.common.ReflectHelpersTest
Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.005 sec - in 
org.apache.beam.sdk.util.common.ReflectHelpersTest
Running org.apache.beam.sdk.util.PubsubJsonClientTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.094 sec - in 
org.apache.beam.sdk.util.PubsubJsonClientTest
Running org.apache.beam.sdk.util.DefaultBucketTest
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.023 sec - in 
org.apache.beam.sdk.util.DefaultBucketTest
Running org.apache.beam.sdk.util.GcsUtilTest
Tests run: 28, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.181 sec - in 
org.apache.beam.sdk.util.GcsUtilTest

Build failed in Jenkins: beam_PostCommit_Java_Version_Test » OpenJDK 7 (on Ubuntu only),beam #25

2017-03-15 Thread Apache Jenkins Server
See 


Changes:

[tgroh] Disable Guava Shading in Google Cloud Platform IOs

--
[...truncated 462.54 KB...]
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.029 sec - in 
org.apache.beam.sdk.transforms.PartitionTest
Running org.apache.beam.sdk.transforms.MaxTest
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.006 sec - in 
org.apache.beam.sdk.transforms.MaxTest
Running org.apache.beam.sdk.transforms.ParDoTest
Tests run: 14, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.165 sec - in 
org.apache.beam.sdk.transforms.ParDoTest
Running org.apache.beam.sdk.transforms.CreateTest
Tests run: 16, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.521 sec - in 
org.apache.beam.sdk.transforms.CreateTest
Running org.apache.beam.sdk.transforms.CombineTest
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.021 sec - in 
org.apache.beam.sdk.transforms.CombineTest
Running org.apache.beam.sdk.util.VarIntTest
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.011 sec - in 
org.apache.beam.sdk.util.VarIntTest
Running org.apache.beam.sdk.util.StructsTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec - in 
org.apache.beam.sdk.util.StructsTest
Running org.apache.beam.sdk.util.StreamUtilsTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.007 sec - in 
org.apache.beam.sdk.util.StreamUtilsTest
Running org.apache.beam.sdk.util.PubsubTestClientTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.004 sec - in 
org.apache.beam.sdk.util.PubsubTestClientTest
Running org.apache.beam.sdk.util.StringUtilsTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec - in 
org.apache.beam.sdk.util.StringUtilsTest
Running org.apache.beam.sdk.util.MutationDetectorsTest
Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.022 sec - in 
org.apache.beam.sdk.util.MutationDetectorsTest
Running org.apache.beam.sdk.util.ValueWithRecordIdTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.014 sec - in 
org.apache.beam.sdk.util.ValueWithRecordIdTest
Running org.apache.beam.sdk.util.ExposedByteArrayOutputStreamTest
Tests run: 24, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.006 sec - in 
org.apache.beam.sdk.util.ExposedByteArrayOutputStreamTest
Running org.apache.beam.sdk.util.GcsIOChannelFactoryRegistrarTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.GcsIOChannelFactoryRegistrarTest
Running org.apache.beam.sdk.util.GcpProjectUtilTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.095 sec - in 
org.apache.beam.sdk.util.GcpProjectUtilTest
Running org.apache.beam.sdk.util.ZipFilesTest
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.025 sec - in 
org.apache.beam.sdk.util.ZipFilesTest
Running org.apache.beam.sdk.util.GcsIOChannelFactoryTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.GcsIOChannelFactoryTest
Running org.apache.beam.sdk.util.ApiSurfaceTest
Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.012 sec - in 
org.apache.beam.sdk.util.ApiSurfaceTest
Running org.apache.beam.sdk.util.PubsubClientTest
Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.009 sec - in 
org.apache.beam.sdk.util.PubsubClientTest
Running org.apache.beam.sdk.util.UnownedInputStreamTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.UnownedInputStreamTest
Running org.apache.beam.sdk.util.FileIOChannelFactoryTest
Tests run: 18, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.013 sec - in 
org.apache.beam.sdk.util.FileIOChannelFactoryTest
Running org.apache.beam.sdk.util.ReleaseInfoTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec - in 
org.apache.beam.sdk.util.ReleaseInfoTest
Running org.apache.beam.sdk.util.WindowedValueTest
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.009 sec - in 
org.apache.beam.sdk.util.WindowedValueTest
Running org.apache.beam.sdk.util.common.ReflectHelpersTest
Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.007 sec - in 
org.apache.beam.sdk.util.common.ReflectHelpersTest
Running org.apache.beam.sdk.util.PubsubJsonClientTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.146 sec - in 
org.apache.beam.sdk.util.PubsubJsonClientTest
Running org.apache.beam.sdk.util.DefaultBucketTest
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.026 sec - in 
org.apache.beam.sdk.util.DefaultBucketTest
Running org.apache.beam.sdk.util.GcsUtilTest
Tests run: 28, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.205 sec - in 

[jira] [Commented] (BEAM-1092) Shade commonly used libraries (e.g. Guava) to avoid class conflicts

2017-03-15 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/BEAM-1092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15927178#comment-15927178
 ] 

ASF GitHub Bot commented on BEAM-1092:
--

Github user asfgit closed the pull request at:

https://github.com/apache/beam/pull/2256


> Shade commonly used libraries (e.g. Guava) to avoid class conflicts
> ---
>
> Key: BEAM-1092
> URL: https://issues.apache.org/jira/browse/BEAM-1092
> Project: Beam
>  Issue Type: Bug
>  Components: examples-java, sdk-java-extensions
>Affects Versions: 0.3.0-incubating
>Reporter: Maximilian Michels
>Assignee: Frances Perry
>
> Beam shades away some of its dependencies like Guava to avoid user classes 
> from clashing with these dependencies. Some of the artifacts, e.g. KafkaIO, 
> do not shade any classes and directly depend on potentially conflicting 
> libraries (e.g. Guava). Also, users might manually add such libraries as 
> dependencies.
> Runners who add classes to the classpath (e.g. Hadoop) can run into conflict 
> with multiple versions of the same class. To prevent that, we should adjust 
> the Maven archetypes pom files used for the Quickstart to perform shading of 
> commonly used libraries (again, Guava is often the culprit).
> To prevent the problem in the first place, we should expand the shading of 
> Guava and other libraries to all modules which make use of these. 
> To solve both dimensions of the issue, we need to address:
> 1. Adding shading of commonly used libraries to the archetypes poms
> 2. Properly shade all commonly used libraries in the SDK modules
> 2) seems to be of highest priority since it affects users who simply use the 
> provided IO modules.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[2/2] beam git commit: This closes #2257

2017-03-15 Thread tgroh
This closes #2257

This closes #2256 via preemption


Project: http://git-wip-us.apache.org/repos/asf/beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/db005fff
Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/db005fff
Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/db005fff

Branch: refs/heads/master
Commit: db005fffbb0e6d9bef61841e10769bde1f294ced
Parents: 004d307 71f6e30
Author: Thomas Groh 
Authored: Wed Mar 15 16:33:02 2017 -0700
Committer: Thomas Groh 
Committed: Wed Mar 15 16:33:09 2017 -0700

--
 sdks/java/io/google-cloud-platform/pom.xml | 20 
 1 file changed, 20 insertions(+)
--




[GitHub] beam pull request #2256: [BEAM-1092] Rollback global shading of Guava

2017-03-15 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/beam/pull/2256


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[1/2] beam git commit: Disable Guava Shading in Google Cloud Platform IOs

2017-03-15 Thread tgroh
Repository: beam
Updated Branches:
  refs/heads/master 004d3078f -> db005fffb


Disable Guava Shading in Google Cloud Platform IOs

The guava shading breaks BigtableIO, as Guava is part of the signatures
of the client, and the client JAR and the Beam IO JAR signatures no
longer align.


Project: http://git-wip-us.apache.org/repos/asf/beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/71f6e30f
Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/71f6e30f
Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/71f6e30f

Branch: refs/heads/master
Commit: 71f6e30fa8594b3ba7fab61f2e4962331264d8ad
Parents: 004d307
Author: Thomas Groh 
Authored: Wed Mar 15 16:25:29 2017 -0700
Committer: Thomas Groh 
Committed: Wed Mar 15 16:33:02 2017 -0700

--
 sdks/java/io/google-cloud-platform/pom.xml | 20 
 1 file changed, 20 insertions(+)
--


http://git-wip-us.apache.org/repos/asf/beam/blob/71f6e30f/sdks/java/io/google-cloud-platform/pom.xml
--
diff --git a/sdks/java/io/google-cloud-platform/pom.xml 
b/sdks/java/io/google-cloud-platform/pom.xml
index bd7f0d2..44a1731 100644
--- a/sdks/java/io/google-cloud-platform/pom.xml
+++ b/sdks/java/io/google-cloud-platform/pom.xml
@@ -90,6 +90,26 @@
   
 
   
+  
+org.apache.maven.plugins
+maven-shade-plugin
+
+  
+disable-shading
+package
+
+  shade
+
+
+  
+
+  *
+
+  
+
+  
+
+  
 
   
 



[GitHub] beam pull request #2257: Disable Guava Shading in Google Cloud Platform IOs

2017-03-15 Thread tgroh
GitHub user tgroh opened a pull request:

https://github.com/apache/beam/pull/2257

Disable Guava Shading in Google Cloud Platform IOs

Be sure to do all of the following to help us incorporate your contribution
quickly and easily:

 - [ ] Make sure the PR title is formatted like:
   `[BEAM-] Description of pull request`
 - [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable
   Travis-CI on your fork and ensure the whole test matrix passes).
 - [ ] Replace `` in the title with the actual Jira issue
   number, if there is one.
 - [ ] If this contribution is large, please file an Apache
   [Individual Contributor License 
Agreement](https://www.apache.org/licenses/icla.txt).

---
The guava shading breaks BigtableIO, as Guava is part of the signatures
of the client, and the client JAR and the Beam IO JAR signatures no
longer align.

Taken from https://github.com/apache/beam/pull/2096#issuecomment-286393622

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/tgroh/beam disable_gcp_io_shading

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/beam/pull/2257.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #2257


commit 54cf3db8286ec41d41926cf0f170767d1fbeb43c
Author: Thomas Groh 
Date:   2017-03-15T23:25:29Z

Disable Guava Shading in Google Cloud Platform IOs

The guava shading breaks BigtableIO, as Guava is part of the signatures
of the client, and the client JAR and the Beam IO JAR signatures no
longer align.




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Commented] (BEAM-547) Align Python SDK version with Maven

2017-03-15 Thread Sourabh Bajaj (JIRA)

[ 
https://issues.apache.org/jira/browse/BEAM-547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15927160#comment-15927160
 ] 

Sourabh Bajaj commented on BEAM-547:


We can not read the version directly from pom.xml as that is not part of the 
python package when a user does `pip install apache_beam` so I think we can 
simplify the process by just directly storing the version string in versions.py 
is probably best.

> Align Python SDK version with Maven
> ---
>
> Key: BEAM-547
> URL: https://issues.apache.org/jira/browse/BEAM-547
> Project: Beam
>  Issue Type: New Feature
>  Components: sdk-py
>Affects Versions: 0.3.0-incubating
>Reporter: Sergio Fernández
>Assignee: Frances Perry
>Priority: Minor
>   Original Estimate: 24h
>  Remaining Estimate: 24h
>
> In BEAM-378 we've integrated the Python SDK in the main Maven build. 
> Initially I wanted to also align versions, but after discussing it with 
> [~silv...@google.com] we kept that aside for the moment. 
> Closing [PR #537|https://github.com/apache/incubator-beam/pull/537] [~altay] 
> brings the issue back. So it may make sense to revisit that idea.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #2920

2017-03-15 Thread Apache Jenkins Server
See 




Jenkins build is back to normal : beam_PostCommit_Python_Verify #1520

2017-03-15 Thread Apache Jenkins Server
See 




Jenkins build became unstable: beam_PostCommit_Java_RunnableOnService_Spark #1253

2017-03-15 Thread Apache Jenkins Server
See 




Jenkins build is back to normal : beam_PostCommit_Java_RunnableOnService_Dataflow #2562

2017-03-15 Thread Apache Jenkins Server
See 




Build failed in Jenkins: beam_PostCommit_Java_Version_Test » OpenJDK 8 (on Ubuntu only),beam #24

2017-03-15 Thread Apache Jenkins Server
See 


Changes:

[davor] Increment shade-plugin version back to 3.0.0

[altay] Revert "[BEAM-547] Version should be accessed from pom file"

[altay] Revert "Add ValueProvider class for FileBasedSource I/O Transforms"

[tgroh] A few comment fixups in BigQueryIO

[markliu] fixup! Ignore API tests and Skip Python project build

--
[...truncated 682.02 KB...]
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.NoSuchMethodError: 
com.google.cloud.bigtable.grpc.async.BulkMutation.add(Lcom/google/bigtable/v2/MutateRowRequest;)Lorg/apache/beam/sdks/java/io/google/cloud/platform/repackaged/com/google/common/util/concurrent/ListenableFuture;
at 
org.apache.beam.sdk.io.gcp.bigtable.BigtableServiceImpl$BigtableWriterImpl.writeRecord(BigtableServiceImpl.java:225)
at 
org.apache.beam.sdk.io.gcp.bigtable.BigtableIO$Write$BigtableWriterFn.processElement(BigtableIO.java:606)

at 
org.apache.beam.runners.dataflow.testing.TestDataflowRunner.run(TestDataflowRunner.java:163)
at 
org.apache.beam.runners.dataflow.testing.TestDataflowRunner.run(TestDataflowRunner.java:98)
at 
org.apache.beam.runners.dataflow.testing.TestDataflowRunner.run(TestDataflowRunner.java:59)
at org.apache.beam.sdk.Pipeline.run(Pipeline.java:210)
at 
org.apache.beam.sdk.io.gcp.bigtable.BigtableWriteIT.testE2EBigtableWrite(BigtableWriteIT.java:136)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at 
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
at 
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at 
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
at 
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at 
org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
at 
org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
at 
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
at 
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
at 
org.apache.maven.surefire.junitcore.pc.Scheduler$1.run(Scheduler.java:393)
at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)

Running org.apache.beam.sdk.io.gcp.datastore.V1WriteIT
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 205.588 sec - 
in org.apache.beam.sdk.io.gcp.datastore.V1WriteIT
Running org.apache.beam.sdk.io.gcp.bigtable.BigtableReadIT
Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 14.415 sec <<< 
FAILURE! - in org.apache.beam.sdk.io.gcp.bigtable.BigtableReadIT
testE2EBigtableRead(org.apache.beam.sdk.io.gcp.bigtable.BigtableReadIT)  Time 
elapsed: 14.415 sec  <<< ERROR!
java.lang.NoSuchMethodError: 
com.google.cloud.bigtable.grpc.BigtableDataClient.sampleRowKeys(Lcom/google/bigtable/v2/SampleRowKeysRequest;)Lorg/apache/beam/sdks/java/io/google/cloud/platform/repackaged/com/google/common/collect/ImmutableList;
at 
org.apache.beam.sdk.io.gcp.bigtable.BigtableServiceImpl.getSampleRowKeys(BigtableServiceImpl.java:250)
at 
org.apache.beam.sdk.io.gcp.bigtable.BigtableIO$BigtableSource.getSampleRowKeys(BigtableIO.java:743)
at 
org.apache.beam.sdk.io.gcp.bigtable.BigtableIO$BigtableSource.getEstimatedSizeBytes(BigtableIO.java:843)
at 
org.apache.beam.runners.dataflow.internal.CustomSources.serializeToCloudSource(CustomSources.java:90)
at 
org.apache.beam.runners.dataflow.ReadTranslator.translateReadHelper(ReadTranslator.java:63)
at 
org.apache.beam.runners.dataflow.ReadTranslator.translate(ReadTranslator.java:42)
at 
org.apache.beam.runners.dataflow.ReadTranslator.translate(ReadTranslator.java:39)
at 

Build failed in Jenkins: beam_PostCommit_Java_Version_Test » JDK 1.8 (latest),beam #24

2017-03-15 Thread Apache Jenkins Server
See 


--
[...truncated 677.17 KB...]
testE2EV1ReadWithGQLQueryWithLimit(org.apache.beam.sdk.io.gcp.datastore.V1ReadIT)
  Time elapsed: 213.968 sec  <<< FAILURE!
java.lang.AssertionError: 
(7cd112d6588ae987): com.google.datastore.v1.client.DatastoreException: Lexical 
error at line 1, column 20.  Encountered: "t" (116), after : "-", 
code=INVALID_ARGUMENT
at 
com.google.datastore.v1.client.RemoteRpc.makeException(RemoteRpc.java:126)
at 
com.google.datastore.v1.client.RemoteRpc.makeException(RemoteRpc.java:169)
at com.google.datastore.v1.client.RemoteRpc.call(RemoteRpc.java:89)
at com.google.datastore.v1.client.Datastore.runQuery(Datastore.java:108)
at 
org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read.translateGqlQuery(DatastoreV1.java:435)
at 
org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read.translateGqlQueryWithLimitCheck(DatastoreV1.java:422)
at 
org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read$GqlQueryTranslateFn.processElement(DatastoreV1.java:715)

at 
org.apache.beam.runners.dataflow.testing.TestDataflowRunner.run(TestDataflowRunner.java:168)
at 
org.apache.beam.runners.dataflow.testing.TestDataflowRunner.run(TestDataflowRunner.java:98)
at 
org.apache.beam.runners.dataflow.testing.TestDataflowRunner.run(TestDataflowRunner.java:59)
at org.apache.beam.sdk.Pipeline.run(Pipeline.java:210)
at 
org.apache.beam.sdk.io.gcp.datastore.V1ReadIT.testE2EV1ReadWithGQLQuery(V1ReadIT.java:139)
at 
org.apache.beam.sdk.io.gcp.datastore.V1ReadIT.testE2EV1ReadWithGQLQueryWithLimit(V1ReadIT.java:106)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at 
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
at 
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at 
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
at 
org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
at 
org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26)
at 
org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:325)
at 
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:78)
at 
org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:57)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
at 
org.apache.maven.surefire.junitcore.pc.Scheduler$1.run(Scheduler.java:393)
at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

testE2EV1ReadWithGQLQueryWithNoLimit(org.apache.beam.sdk.io.gcp.datastore.V1ReadIT)
  Time elapsed: 192.399 sec  <<< FAILURE!
java.lang.AssertionError: 
(13149f8e522673dd): com.google.datastore.v1.client.DatastoreException: Lexical 
error at line 1, column 20.  Encountered: "t" (116), after : "-", 
code=INVALID_ARGUMENT
at 
com.google.datastore.v1.client.RemoteRpc.makeException(RemoteRpc.java:126)
at 
com.google.datastore.v1.client.RemoteRpc.makeException(RemoteRpc.java:169)
at com.google.datastore.v1.client.RemoteRpc.call(RemoteRpc.java:89)
at com.google.datastore.v1.client.Datastore.runQuery(Datastore.java:108)
at 
org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read.translateGqlQuery(DatastoreV1.java:435)
at 
org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read.translateGqlQueryWithLimitCheck(DatastoreV1.java:422)
at 
org.apache.beam.sdk.io.gcp.datastore.DatastoreV1$Read$GqlQueryTranslateFn.processElement(DatastoreV1.java:715)

at 
org.apache.beam.runners.dataflow.testing.TestDataflowRunner.run(TestDataflowRunner.java:168)
at 
org.apache.beam.runners.dataflow.testing.TestDataflowRunner.run(TestDataflowRunner.java:98)
at 
org.apache.beam.runners.dataflow.testing.TestDataflowRunner.run(TestDataflowRunner.java:59)
at org.apache.beam.sdk.Pipeline.run(Pipeline.java:210)
at 
org.apache.beam.sdk.io.gcp.datastore.V1ReadIT.testE2EV1ReadWithGQLQuery(V1ReadIT.java:139)
at 

Build failed in Jenkins: beam_PostCommit_Java_Version_Test » JDK 1.7 (latest),beam #24

2017-03-15 Thread Apache Jenkins Server
See 


Changes:

[davor] Increment shade-plugin version back to 3.0.0

[altay] Revert "[BEAM-547] Version should be accessed from pom file"

[altay] Revert "Add ValueProvider class for FileBasedSource I/O Transforms"

[tgroh] A few comment fixups in BigQueryIO

[markliu] fixup! Ignore API tests and Skip Python project build

--
[...truncated 606.41 KB...]
at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:48)
at org.junit.rules.RunRules.evaluate(RunRules.java:20)
at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
at org.junit.runners.Suite.runChild(Suite.java:128)
at org.junit.runners.Suite.runChild(Suite.java:27)
at org.junit.runners.ParentRunner$3.run(ParentRunner.java:290)
at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:71)
at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:288)
at org.junit.runners.ParentRunner.access$000(ParentRunner.java:58)
at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:268)
at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
at org.apache.maven.surefire.junitcore.JUnitCore.run(JUnitCore.java:55)
at 
org.apache.maven.surefire.junitcore.JUnitCoreWrapper.createRequestAndRun(JUnitCoreWrapper.java:137)
at 
org.apache.maven.surefire.junitcore.JUnitCoreWrapper.executeEager(JUnitCoreWrapper.java:107)
at 
org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:83)
at 
org.apache.maven.surefire.junitcore.JUnitCoreWrapper.execute(JUnitCoreWrapper.java:75)
at 
org.apache.maven.surefire.junitcore.JUnitCoreProvider.invoke(JUnitCoreProvider.java:161)
at 
org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:290)
at 
org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:242)
at 
org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:121)
Caused by: 
RemoteTransportException[[beam][127.0.0.1:9301][indices:admin/delete]]; nested: 
IndexNotFoundException[no such index];
Caused by: [beam] IndexNotFoundException[no such index]
at 
org.elasticsearch.cluster.metadata.MetaDataDeleteIndexService$1.execute(MetaDataDeleteIndexService.java:91)
at 
org.elasticsearch.cluster.ClusterStateUpdateTask.execute(ClusterStateUpdateTask.java:45)
at 
org.elasticsearch.cluster.service.InternalClusterService.runTasksForExecutor(InternalClusterService.java:468)
at 
org.elasticsearch.cluster.service.InternalClusterService$UpdateTask.run(InternalClusterService.java:772)
at 
org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.runAndClean(PrioritizedEsThreadPoolExecutor.java:231)
at 
org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.run(PrioritizedEsThreadPoolExecutor.java:194)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)

testRead(org.apache.beam.sdk.io.elasticsearch.ElasticsearchIOTest)  Time 
elapsed: 4.331 sec  <<< FAILURE!
java.lang.AssertionError: 
Count/Flatten.PCollections.out
Expected: <400L>
 but: was <498L>
at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
at org.junit.Assert.assertThat(Assert.java:956)
at 
org.apache.beam.sdk.testing.PAssert$AssertIsEqualTo.apply(PAssert.java:1191)
at 
org.apache.beam.sdk.testing.PAssert$AssertIsEqualTo.apply(PAssert.java:1180)
at 
org.apache.beam.sdk.testing.PAssert$CheckRelationAgainstExpected.apply(PAssert.java:880)
at 
org.apache.beam.sdk.testing.PAssert$CheckRelationAgainstExpected.apply(PAssert.java:860)
at org.apache.beam.sdk.testing.PAssert.doChecks(PAssert.java:1165)
at org.apache.beam.sdk.testing.PAssert.access$900(PAssert.java:106)
at 
org.apache.beam.sdk.testing.PAssert$SideInputCheckerDoFn.processElement(PAssert.java:1105)

testWriteWithMaxBatchSizeBytes(org.apache.beam.sdk.io.elasticsearch.ElasticsearchIOTest)
  Time elapsed: 2.558 sec  <<< ERROR!
[beam] IndexClosedException[closed]
at 
org.elasticsearch.cluster.metadata.IndexNameExpressionResolver.concreteIndices(IndexNameExpressionResolver.java:172)
at 
org.elasticsearch.cluster.metadata.IndexNameExpressionResolver.concreteIndices(IndexNameExpressionResolver.java:113)
at 
org.elasticsearch.action.search.AbstractSearchAsyncAction.(AbstractSearchAsyncAction.java:99)
at 

Build failed in Jenkins: beam_PostCommit_Java_Version_Test » OpenJDK 7 (on Ubuntu only),beam #24

2017-03-15 Thread Apache Jenkins Server
See 


--
[...truncated 615.86 KB...]
at 
org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:290)
at 
org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:242)
at 
org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:121)
Caused by: java.io.IOException: Error writing to Elasticsearch, some elements 
could not be inserted:
Document id AVrUMlFP-wYoNEEEg6N9: blocked by: [FORBIDDEN/4/index closed]; 
(cluster_block_exception)
Document id AVrUMlFP-wYoNEEEg6N_: blocked by: [FORBIDDEN/4/index closed]; 
(cluster_block_exception)
Document id AVrUMlFP-wYoNEEEg6OA: blocked by: [FORBIDDEN/4/index closed]; 
(cluster_block_exception)
Document id AVrUMlFP-wYoNEEEg6OD: blocked by: [FORBIDDEN/4/index closed]; 
(cluster_block_exception)
Document id AVrUMlFP-wYoNEEEg6OF: blocked by: [FORBIDDEN/4/index closed]; 
(cluster_block_exception)
Document id AVrUMlFP-wYoNEEEg6OH: blocked by: [FORBIDDEN/4/index closed]; 
(cluster_block_exception)
Document id AVrUMlFP-wYoNEEEg6OI: blocked by: [FORBIDDEN/4/index closed]; 
(cluster_block_exception)
Document id AVrUMlFP-wYoNEEEg6OJ: blocked by: [FORBIDDEN/4/index closed]; 
(cluster_block_exception)
Document id AVrUMlFP-wYoNEEEg6OK: blocked by: [FORBIDDEN/4/index closed]; 
(cluster_block_exception)
Document id AVrUMlFP-wYoNEEEg6OP: blocked by: [FORBIDDEN/4/index closed]; 
(cluster_block_exception)
Document id AVrUMlFP-wYoNEEEg6OQ: blocked by: [FORBIDDEN/4/index closed]; 
(cluster_block_exception)
Document id AVrUMlFP-wYoNEEEg6OR: blocked by: [FORBIDDEN/4/index closed]; 
(cluster_block_exception)
Document id AVrUMlFP-wYoNEEEg6OS: blocked by: [FORBIDDEN/4/index closed]; 
(cluster_block_exception)
Document id AVrUMlFP-wYoNEEEg6OT: blocked by: [FORBIDDEN/4/index closed]; 
(cluster_block_exception)
at 
org.apache.beam.sdk.io.elasticsearch.ElasticsearchIO$Write$WriteFn.finishBundle(ElasticsearchIO.java:803)

testRead(org.apache.beam.sdk.io.elasticsearch.ElasticsearchIOTest)  Time 
elapsed: 3.745 sec  <<< FAILURE!
java.lang.AssertionError: 
Count/Flatten.PCollections.out
Expected: <400L>
 but: was <498L>
at org.hamcrest.MatcherAssert.assertThat(MatcherAssert.java:20)
at org.junit.Assert.assertThat(Assert.java:956)
at 
org.apache.beam.sdk.testing.PAssert$AssertIsEqualTo.apply(PAssert.java:1191)
at 
org.apache.beam.sdk.testing.PAssert$AssertIsEqualTo.apply(PAssert.java:1180)
at 
org.apache.beam.sdk.testing.PAssert$CheckRelationAgainstExpected.apply(PAssert.java:880)
at 
org.apache.beam.sdk.testing.PAssert$CheckRelationAgainstExpected.apply(PAssert.java:860)
at org.apache.beam.sdk.testing.PAssert.doChecks(PAssert.java:1165)
at org.apache.beam.sdk.testing.PAssert.access$900(PAssert.java:106)
at 
org.apache.beam.sdk.testing.PAssert$SideInputCheckerDoFn.processElement(PAssert.java:1105)

testWriteWithMaxBatchSizeBytes(org.apache.beam.sdk.io.elasticsearch.ElasticsearchIOTest)
  Time elapsed: 0.751 sec  <<< ERROR!
java.io.IOException: 
Error writing to Elasticsearch, some elements could not be inserted:
Document id AVrUMmJi-wYoNEEEg6U-: blocked by: [FORBIDDEN/4/index closed]; 
(cluster_block_exception)
Document id AVrUMmJi-wYoNEEEg6U_: blocked by: [FORBIDDEN/4/index closed]; 
(cluster_block_exception)
Document id AVrUMmJi-wYoNEEEg6VA: blocked by: [FORBIDDEN/4/index closed]; 
(cluster_block_exception)
Document id AVrUMmJi-wYoNEEEg6VB: blocked by: [FORBIDDEN/4/index closed]; 
(cluster_block_exception)
Document id AVrUMmJi-wYoNEEEg6VC: blocked by: [FORBIDDEN/4/index closed]; 
(cluster_block_exception)
Document id AVrUMmJi-wYoNEEEg6VD: blocked by: [FORBIDDEN/4/index closed]; 
(cluster_block_exception)
Document id AVrUMmJi-wYoNEEEg6VE: blocked by: [FORBIDDEN/4/index closed]; 
(cluster_block_exception)
Document id AVrUMmJi-wYoNEEEg6VF: blocked by: [FORBIDDEN/4/index closed]; 
(cluster_block_exception)
Document id AVrUMmJi-wYoNEEEg6VG: blocked by: [FORBIDDEN/4/index closed]; 
(cluster_block_exception)
Document id AVrUMmJi-wYoNEEEg6VH: blocked by: [FORBIDDEN/4/index closed]; 
(cluster_block_exception)
Document id AVrUMmJi-wYoNEEEg6VI: blocked by: [FORBIDDEN/4/index closed]; 
(cluster_block_exception)
Document id AVrUMmJi-wYoNEEEg6VJ: blocked by: [FORBIDDEN/4/index closed]; 
(cluster_block_exception)
Document id AVrUMmJi-wYoNEEEg6VK: blocked by: [FORBIDDEN/4/index closed]; 
(cluster_block_exception)
Document id AVrUMmJi-wYoNEEEg6VL: blocked by: [FORBIDDEN/4/index closed]; 
(cluster_block_exception)
Document id AVrUMmJi-wYoNEEEg6VM: blocked by: [FORBIDDEN/4/index closed]; 
(cluster_block_exception)
Document id AVrUMmJi-wYoNEEEg6VN: blocked by: [FORBIDDEN/4/index closed]; 
(cluster_block_exception)
Document id AVrUMmJi-wYoNEEEg6VO: blocked by: 

Build failed in Jenkins: beam_PostCommit_Java_Version_Test » JDK 1.7 (latest),beam #23

2017-03-15 Thread Apache Jenkins Server
See 


Changes:

[tgroh] A few comment fixups in BigQueryIO

--
[...truncated 2.08 MB...]
Running org.apache.beam.sdk.transforms.MaxTest
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.006 sec - in 
org.apache.beam.sdk.transforms.MaxTest
Running org.apache.beam.sdk.transforms.ParDoTest
Tests run: 14, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.116 sec - in 
org.apache.beam.sdk.transforms.ParDoTest
Running org.apache.beam.sdk.transforms.CreateTest
Tests run: 16, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.348 sec - in 
org.apache.beam.sdk.transforms.CreateTest
Running org.apache.beam.sdk.transforms.CombineTest
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.046 sec - in 
org.apache.beam.sdk.transforms.CombineTest
Running org.apache.beam.sdk.util.VarIntTest
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec - in 
org.apache.beam.sdk.util.VarIntTest
Running org.apache.beam.sdk.util.StructsTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec - in 
org.apache.beam.sdk.util.StructsTest
Running org.apache.beam.sdk.util.StreamUtilsTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.004 sec - in 
org.apache.beam.sdk.util.StreamUtilsTest
Running org.apache.beam.sdk.util.PubsubTestClientTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.004 sec - in 
org.apache.beam.sdk.util.PubsubTestClientTest
Running org.apache.beam.sdk.util.StringUtilsTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.StringUtilsTest
Running org.apache.beam.sdk.util.MutationDetectorsTest
Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.006 sec - in 
org.apache.beam.sdk.util.MutationDetectorsTest
Running org.apache.beam.sdk.util.ValueWithRecordIdTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.004 sec - in 
org.apache.beam.sdk.util.ValueWithRecordIdTest
Running org.apache.beam.sdk.util.ExposedByteArrayOutputStreamTest
Tests run: 24, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec - in 
org.apache.beam.sdk.util.ExposedByteArrayOutputStreamTest
Running org.apache.beam.sdk.util.GcsIOChannelFactoryRegistrarTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.GcsIOChannelFactoryRegistrarTest
Running org.apache.beam.sdk.util.GcpProjectUtilTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.06 sec - in 
org.apache.beam.sdk.util.GcpProjectUtilTest
Running org.apache.beam.sdk.util.ZipFilesTest
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.051 sec - in 
org.apache.beam.sdk.util.ZipFilesTest
Running org.apache.beam.sdk.util.GcsIOChannelFactoryTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.GcsIOChannelFactoryTest
Running org.apache.beam.sdk.util.ApiSurfaceTest
Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.052 sec - in 
org.apache.beam.sdk.util.ApiSurfaceTest
Running org.apache.beam.sdk.util.PubsubClientTest
Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.009 sec - in 
org.apache.beam.sdk.util.PubsubClientTest
Running org.apache.beam.sdk.util.UnownedInputStreamTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.UnownedInputStreamTest
Running org.apache.beam.sdk.util.FileIOChannelFactoryTest
Tests run: 18, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.019 sec - in 
org.apache.beam.sdk.util.FileIOChannelFactoryTest
Running org.apache.beam.sdk.util.ReleaseInfoTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.041 sec - in 
org.apache.beam.sdk.util.ReleaseInfoTest
Running org.apache.beam.sdk.util.WindowedValueTest
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.012 sec - in 
org.apache.beam.sdk.util.WindowedValueTest
Running org.apache.beam.sdk.util.common.ReflectHelpersTest
Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.056 sec - in 
org.apache.beam.sdk.util.common.ReflectHelpersTest
Running org.apache.beam.sdk.util.PubsubJsonClientTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.09 sec - in 
org.apache.beam.sdk.util.PubsubJsonClientTest
Running org.apache.beam.sdk.util.DefaultBucketTest
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.017 sec - in 
org.apache.beam.sdk.util.DefaultBucketTest
Running org.apache.beam.sdk.util.GcsUtilTest
Tests run: 28, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.111 sec - in 
org.apache.beam.sdk.util.GcsUtilTest
Running org.apache.beam.sdk.util.WindowingStrategiesTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.12 sec - in 

Build failed in Jenkins: beam_PostCommit_Java_Version_Test » OpenJDK 7 (on Ubuntu only),beam #23

2017-03-15 Thread Apache Jenkins Server
See 


Changes:

[tgroh] A few comment fixups in BigQueryIO

--
[...truncated 2.08 MB...]
Running org.apache.beam.sdk.transforms.MaxTest
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.011 sec - in 
org.apache.beam.sdk.transforms.MaxTest
Running org.apache.beam.sdk.transforms.ParDoTest
Tests run: 14, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.199 sec - in 
org.apache.beam.sdk.transforms.ParDoTest
Running org.apache.beam.sdk.transforms.CreateTest
Tests run: 16, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.377 sec - in 
org.apache.beam.sdk.transforms.CreateTest
Running org.apache.beam.sdk.transforms.CombineTest
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.187 sec - in 
org.apache.beam.sdk.transforms.CombineTest
Running org.apache.beam.sdk.util.VarIntTest
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.007 sec - in 
org.apache.beam.sdk.util.VarIntTest
Running org.apache.beam.sdk.util.StructsTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.004 sec - in 
org.apache.beam.sdk.util.StructsTest
Running org.apache.beam.sdk.util.StreamUtilsTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.004 sec - in 
org.apache.beam.sdk.util.StreamUtilsTest
Running org.apache.beam.sdk.util.PubsubTestClientTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.019 sec - in 
org.apache.beam.sdk.util.PubsubTestClientTest
Running org.apache.beam.sdk.util.StringUtilsTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.StringUtilsTest
Running org.apache.beam.sdk.util.MutationDetectorsTest
Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.011 sec - in 
org.apache.beam.sdk.util.MutationDetectorsTest
Running org.apache.beam.sdk.util.ValueWithRecordIdTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.006 sec - in 
org.apache.beam.sdk.util.ValueWithRecordIdTest
Running org.apache.beam.sdk.util.ExposedByteArrayOutputStreamTest
Tests run: 24, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec - in 
org.apache.beam.sdk.util.ExposedByteArrayOutputStreamTest
Running org.apache.beam.sdk.util.GcsIOChannelFactoryRegistrarTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.GcsIOChannelFactoryRegistrarTest
Running org.apache.beam.sdk.util.GcpProjectUtilTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.084 sec - in 
org.apache.beam.sdk.util.GcpProjectUtilTest
Running org.apache.beam.sdk.util.ZipFilesTest
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.024 sec - in 
org.apache.beam.sdk.util.ZipFilesTest
Running org.apache.beam.sdk.util.GcsIOChannelFactoryTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.GcsIOChannelFactoryTest
Running org.apache.beam.sdk.util.ApiSurfaceTest
Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.036 sec - in 
org.apache.beam.sdk.util.ApiSurfaceTest
Running org.apache.beam.sdk.util.PubsubClientTest
Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.012 sec - in 
org.apache.beam.sdk.util.PubsubClientTest
Running org.apache.beam.sdk.util.UnownedInputStreamTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.UnownedInputStreamTest
Running org.apache.beam.sdk.util.FileIOChannelFactoryTest
Tests run: 18, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.015 sec - in 
org.apache.beam.sdk.util.FileIOChannelFactoryTest
Running org.apache.beam.sdk.util.ReleaseInfoTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.022 sec - in 
org.apache.beam.sdk.util.ReleaseInfoTest
Running org.apache.beam.sdk.util.WindowedValueTest
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.014 sec - in 
org.apache.beam.sdk.util.WindowedValueTest
Running org.apache.beam.sdk.util.common.ReflectHelpersTest
Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.075 sec - in 
org.apache.beam.sdk.util.common.ReflectHelpersTest
Running org.apache.beam.sdk.util.PubsubJsonClientTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.109 sec - in 
org.apache.beam.sdk.util.PubsubJsonClientTest
Running org.apache.beam.sdk.util.DefaultBucketTest
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.027 sec - in 
org.apache.beam.sdk.util.DefaultBucketTest
Running org.apache.beam.sdk.util.GcsUtilTest
Tests run: 28, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.199 sec - in 
org.apache.beam.sdk.util.GcsUtilTest
Running org.apache.beam.sdk.util.WindowingStrategiesTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.167 sec - in 

Build failed in Jenkins: beam_PostCommit_Java_Version_Test » JDK 1.8 (latest),beam #23

2017-03-15 Thread Apache Jenkins Server
See 


Changes:

[tgroh] A few comment fixups in BigQueryIO

--
[...truncated 2.08 MB...]
Running org.apache.beam.sdk.transforms.CreateTest
Tests run: 16, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.228 sec - in 
org.apache.beam.sdk.transforms.CreateTest
Running org.apache.beam.sdk.transforms.CombineTest
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.016 sec - in 
org.apache.beam.sdk.transforms.CombineTest
Running org.apache.beam.sdk.util.VarIntTest
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.004 sec - in 
org.apache.beam.sdk.util.VarIntTest
Running org.apache.beam.sdk.util.StructsTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec - in 
org.apache.beam.sdk.util.StructsTest
Running org.apache.beam.sdk.util.StreamUtilsTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.005 sec - in 
org.apache.beam.sdk.util.StreamUtilsTest
Running org.apache.beam.sdk.util.PubsubTestClientTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec - in 
org.apache.beam.sdk.util.PubsubTestClientTest
Running org.apache.beam.sdk.util.StringUtilsTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.StringUtilsTest
Running org.apache.beam.sdk.util.MutationDetectorsTest
Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.007 sec - in 
org.apache.beam.sdk.util.MutationDetectorsTest
Running org.apache.beam.sdk.util.ValueWithRecordIdTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.007 sec - in 
org.apache.beam.sdk.util.ValueWithRecordIdTest
Running org.apache.beam.sdk.util.ExposedByteArrayOutputStreamTest
Tests run: 24, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.004 sec - in 
org.apache.beam.sdk.util.ExposedByteArrayOutputStreamTest
Running org.apache.beam.sdk.util.GcsIOChannelFactoryRegistrarTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.GcsIOChannelFactoryRegistrarTest
Running org.apache.beam.sdk.util.GcpProjectUtilTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.064 sec - in 
org.apache.beam.sdk.util.GcpProjectUtilTest
Running org.apache.beam.sdk.util.ZipFilesTest
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.016 sec - in 
org.apache.beam.sdk.util.ZipFilesTest
Running org.apache.beam.sdk.util.GcsIOChannelFactoryTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec - in 
org.apache.beam.sdk.util.GcsIOChannelFactoryTest
Running org.apache.beam.sdk.util.ApiSurfaceTest
Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.011 sec - in 
org.apache.beam.sdk.util.ApiSurfaceTest
Running org.apache.beam.sdk.util.PubsubClientTest
Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.013 sec - in 
org.apache.beam.sdk.util.PubsubClientTest
Running org.apache.beam.sdk.util.UnownedInputStreamTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec - in 
org.apache.beam.sdk.util.UnownedInputStreamTest
Running org.apache.beam.sdk.util.FileIOChannelFactoryTest
Tests run: 18, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.015 sec - in 
org.apache.beam.sdk.util.FileIOChannelFactoryTest
Running org.apache.beam.sdk.util.ReleaseInfoTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec - in 
org.apache.beam.sdk.util.ReleaseInfoTest
Running org.apache.beam.sdk.util.WindowedValueTest
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.009 sec - in 
org.apache.beam.sdk.util.WindowedValueTest
Running org.apache.beam.sdk.util.common.ReflectHelpersTest
Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.006 sec - in 
org.apache.beam.sdk.util.common.ReflectHelpersTest
Running org.apache.beam.sdk.util.PubsubJsonClientTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.091 sec - in 
org.apache.beam.sdk.util.PubsubJsonClientTest
Running org.apache.beam.sdk.util.DefaultBucketTest
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.019 sec - in 
org.apache.beam.sdk.util.DefaultBucketTest
Running org.apache.beam.sdk.util.GcsUtilTest
Tests run: 28, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.104 sec - in 
org.apache.beam.sdk.util.GcsUtilTest
Running org.apache.beam.sdk.util.WindowingStrategiesTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.097 sec - in 
org.apache.beam.sdk.util.WindowingStrategiesTest
Running org.apache.beam.sdk.util.ExposedByteArrayInputStreamTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.ExposedByteArrayInputStreamTest
Running org.apache.beam.sdk.util.BufferedElementCountingOutputStreamTest
Tests run: 14, Failures: 0, 

Build failed in Jenkins: beam_PostCommit_Java_Version_Test » OpenJDK 8 (on Ubuntu only),beam #23

2017-03-15 Thread Apache Jenkins Server
See 


Changes:

[tgroh] A few comment fixups in BigQueryIO

--
[...truncated 2.08 MB...]
Running org.apache.beam.sdk.transforms.MaxTest
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.004 sec - in 
org.apache.beam.sdk.transforms.MaxTest
Running org.apache.beam.sdk.transforms.ParDoTest
Tests run: 14, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.096 sec - in 
org.apache.beam.sdk.transforms.ParDoTest
Running org.apache.beam.sdk.transforms.CreateTest
Tests run: 16, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.357 sec - in 
org.apache.beam.sdk.transforms.CreateTest
Running org.apache.beam.sdk.transforms.CombineTest
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.015 sec - in 
org.apache.beam.sdk.transforms.CombineTest
Running org.apache.beam.sdk.util.VarIntTest
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.004 sec - in 
org.apache.beam.sdk.util.VarIntTest
Running org.apache.beam.sdk.util.StructsTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec - in 
org.apache.beam.sdk.util.StructsTest
Running org.apache.beam.sdk.util.StreamUtilsTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec - in 
org.apache.beam.sdk.util.StreamUtilsTest
Running org.apache.beam.sdk.util.PubsubTestClientTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec - in 
org.apache.beam.sdk.util.PubsubTestClientTest
Running org.apache.beam.sdk.util.StringUtilsTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.StringUtilsTest
Running org.apache.beam.sdk.util.MutationDetectorsTest
Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.005 sec - in 
org.apache.beam.sdk.util.MutationDetectorsTest
Running org.apache.beam.sdk.util.ValueWithRecordIdTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.005 sec - in 
org.apache.beam.sdk.util.ValueWithRecordIdTest
Running org.apache.beam.sdk.util.ExposedByteArrayOutputStreamTest
Tests run: 24, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec - in 
org.apache.beam.sdk.util.ExposedByteArrayOutputStreamTest
Running org.apache.beam.sdk.util.GcsIOChannelFactoryRegistrarTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.GcsIOChannelFactoryRegistrarTest
Running org.apache.beam.sdk.util.GcpProjectUtilTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.062 sec - in 
org.apache.beam.sdk.util.GcpProjectUtilTest
Running org.apache.beam.sdk.util.ZipFilesTest
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.015 sec - in 
org.apache.beam.sdk.util.ZipFilesTest
Running org.apache.beam.sdk.util.GcsIOChannelFactoryTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.GcsIOChannelFactoryTest
Running org.apache.beam.sdk.util.ApiSurfaceTest
Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.01 sec - in 
org.apache.beam.sdk.util.ApiSurfaceTest
Running org.apache.beam.sdk.util.PubsubClientTest
Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.008 sec - in 
org.apache.beam.sdk.util.PubsubClientTest
Running org.apache.beam.sdk.util.UnownedInputStreamTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.UnownedInputStreamTest
Running org.apache.beam.sdk.util.FileIOChannelFactoryTest
Tests run: 18, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.016 sec - in 
org.apache.beam.sdk.util.FileIOChannelFactoryTest
Running org.apache.beam.sdk.util.ReleaseInfoTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec - in 
org.apache.beam.sdk.util.ReleaseInfoTest
Running org.apache.beam.sdk.util.WindowedValueTest
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.013 sec - in 
org.apache.beam.sdk.util.WindowedValueTest
Running org.apache.beam.sdk.util.common.ReflectHelpersTest
Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.008 sec - in 
org.apache.beam.sdk.util.common.ReflectHelpersTest
Running org.apache.beam.sdk.util.PubsubJsonClientTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.111 sec - in 
org.apache.beam.sdk.util.PubsubJsonClientTest
Running org.apache.beam.sdk.util.DefaultBucketTest
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.018 sec - in 
org.apache.beam.sdk.util.DefaultBucketTest
Running org.apache.beam.sdk.util.GcsUtilTest
Tests run: 28, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.089 sec - in 
org.apache.beam.sdk.util.GcsUtilTest
Running org.apache.beam.sdk.util.WindowingStrategiesTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.092 sec - in 

[1/2] beam git commit: This closes #2254

2017-03-15 Thread tgroh
Repository: beam
Updated Branches:
  refs/heads/master 477e789a4 -> 004d3078f


This closes #2254


Project: http://git-wip-us.apache.org/repos/asf/beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/004d3078
Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/004d3078
Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/004d3078

Branch: refs/heads/master
Commit: 004d3078f14c26452ac3c4c4ca13dde894ff42b1
Parents: 477e789 c0b5476
Author: Thomas Groh 
Authored: Wed Mar 15 15:44:11 2017 -0700
Committer: Thomas Groh 
Committed: Wed Mar 15 15:44:11 2017 -0700

--
 .../beam/sdk/io/gcp/bigquery/BigQueryIO.java| 47 
 1 file changed, 19 insertions(+), 28 deletions(-)
--




[GitHub] beam pull request #2254: A few comment fixups in BigQueryIO

2017-03-15 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/beam/pull/2254


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[2/2] beam git commit: A few comment fixups in BigQueryIO

2017-03-15 Thread tgroh
A few comment fixups in BigQueryIO

Some of the comments were lost in a recent cleanup PR.

Some other comments, I just made them shorter and equally or more clear.
(the fact that builder methods don't modify the current object, I
believe, does not need to be spelled out on every builder method
of every transform)


Project: http://git-wip-us.apache.org/repos/asf/beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/c0b5476c
Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/c0b5476c
Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/c0b5476c

Branch: refs/heads/master
Commit: c0b5476c688f73fe5eb77fe0bad62c04a903cfce
Parents: 477e789
Author: Eugene Kirpichov 
Authored: Wed Mar 15 15:01:12 2017 -0700
Committer: Thomas Groh 
Committed: Wed Mar 15 15:44:11 2017 -0700

--
 .../beam/sdk/io/gcp/bigquery/BigQueryIO.java| 47 
 1 file changed, 19 insertions(+), 28 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/beam/blob/c0b5476c/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryIO.java
--
diff --git 
a/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryIO.java
 
b/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryIO.java
index 3e699d2..2ae357e 100644
--- 
a/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryIO.java
+++ 
b/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryIO.java
@@ -513,6 +513,14 @@ public class BigQueryIO {
 
 /**
  * Reads results received after executing the given query.
+ *
+ * By default, the query results will be flattened -- see
+ * "flattenResults" in the https://cloud.google.com/bigquery/docs/reference/v2/jobs;>
+ * Jobs documentation for more information.  To disable flattening, use
+ * {@link BigQueryIO.Read#withoutResultFlattening}.
+ *
+ * By default, the query will use BigQuery's legacy SQL dialect. To use 
the BigQuery
+ * Standard SQL dialect, use {@link BigQueryIO.Read#usingStandardSql}.
  */
 public Read fromQuery(String query) {
   return fromQuery(StaticValueProvider.of(query));
@@ -1500,20 +1508,18 @@ public class BigQueryIO {
 }
 
 /**
- * Creates a write transformation for the given table specification.
- *
- * Refer to {@link #parseTableSpec(String)} for the specification 
format.
+ * Writes to the given table, specified in the format described in {@link 
#parseTableSpec}.
  */
 public Write to(String tableSpec) {
   return to(StaticValueProvider.of(tableSpec));
 }
 
-/** Creates a write transformation for the given table. */
+/** Writes to the given table, specified as a {@link TableReference}. */
 public Write to(TableReference table) {
   return to(StaticValueProvider.of(toTableSpec(table)));
 }
 
-/** Creates a write transformation for the given table. */
+/** Same as {@link #to(String)}, but with a {@link ValueProvider}. */
 public Write to(ValueProvider tableSpec) {
   ensureToNotCalledYet();
   return toBuilder()
@@ -1567,10 +1573,11 @@ public class BigQueryIO {
 }
 
 /**
- * Returns a copy of this write transformation, but using the specified 
schema for rows
- * to be written.
+ * Uses the specified schema for rows to be written.
  *
- * Does not modify this object.
+ * The schema is required only if writing to a table that does 
not already
+ * exist, and {@link CreateDisposition} is set to
+ * {@link CreateDisposition#CREATE_IF_NEEDED}.
  */
 public Write withSchema(TableSchema schema) {
   return toBuilder()
@@ -1587,38 +1594,22 @@ public class BigQueryIO {
   .build();
 }
 
-/**
- * Returns a copy of this write transformation, but using the specified 
create disposition.
- *
- * Does not modify this object.
- */
+/** Specifies whether the table should be created if it does not exist. */
 public Write withCreateDisposition(CreateDisposition createDisposition) {
   return toBuilder().setCreateDisposition(createDisposition).build();
 }
 
-/**
- * Returns a copy of this write transformation, but using the specified 
write disposition.
- *
- * Does not modify this object.
- */
+/** Specifies what to do with existing data in the table, in case the 
table already exists. */
 public Write withWriteDisposition(WriteDisposition writeDisposition) {
   return toBuilder().setWriteDisposition(writeDisposition).build();
 }
 
-/**
- * Returns a copy of this write transformation, but using the specified 

Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #2919

2017-03-15 Thread Apache Jenkins Server
See 




[GitHub] beam pull request #2256: [BEAM-1092] Rollback global shading of Guava

2017-03-15 Thread tgroh
GitHub user tgroh opened a pull request:

https://github.com/apache/beam/pull/2256

[BEAM-1092] Rollback global shading of Guava

Be sure to do all of the following to help us incorporate your contribution
quickly and easily:

 - [ ] Make sure the PR title is formatted like:
   `[BEAM-] Description of pull request`
 - [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable
   Travis-CI on your fork and ensure the whole test matrix passes).
 - [ ] Replace `` in the title with the actual Jira issue
   number, if there is one.
 - [ ] If this contribution is large, please file an Apache
   [Individual Contributor License 
Agreement](https://www.apache.org/licenses/icla.txt).

---
Revert PRs #2096 and #2249 

PR #2096  has caused BigtableITs to fail, as of 
https://builds.apache.org/job/beam_PostCommit_Java_MavenInstall/2906/

The `BigtableDataClient` has methods that return Guava types, e.g. 
`sampleRowKeys` returns an `ImmutableList`, and we rewrite those calls to 
reference the repackaged type, but we don't repackage the actual client 
libraries; as a result when the JVM tries to find the 
`sampleRowKeys(SampleRowKeysRequest) -> ImmutableList` 
it fails.

We can certainly not shade guava in the google-cloud-platform IOs module; I 
believe it is also possible to repackage the appropriate Bigtable libraries to 
ensure the return types of those methods are also repackaged. However, 
`BigtableIO` uses classes that are defined in the `Bigtable` libraries, so we 
would have to force our version on users. 

@davorbonaci @aviemzur 

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/tgroh/beam no_repackage_gcp_io

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/beam/pull/2256.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #2256


commit 506a2cfa0b730d9b1ec8ec07223797c697b061f1
Author: Thomas Groh 
Date:   2017-03-15T22:28:45Z

Revert "Increment shade-plugin version back to 3.0.0"

This reverts commit 8f7c320846b598dc650a7b786182f7cecdd9c601.

commit dcfe32a14318d0daebad7319ba4143a25fc02be4
Author: Thomas Groh 
Date:   2017-03-15T22:28:47Z

Revert "[BEAM-1092] Replace hyphens in artifactId with dots in shading 
relocations"

This reverts commit 2b55e0798f44e3fa644e7df1eaab43898ecf9c46.

commit 12873b9500c31b78d84ec6d52c0d9cf1a68edc39
Author: Thomas Groh 
Date:   2017-03-15T22:28:49Z

Revert "[BEAM-1092] Shade commonly used libraries (e.g. Guava) to avoid 
class conflicts"

This reverts commit 03d78097ba0a2d55a9e8dcbaf11e0f8182f223c1.




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Commented] (BEAM-1092) Shade commonly used libraries (e.g. Guava) to avoid class conflicts

2017-03-15 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/BEAM-1092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15927112#comment-15927112
 ] 

ASF GitHub Bot commented on BEAM-1092:
--

GitHub user tgroh opened a pull request:

https://github.com/apache/beam/pull/2256

[BEAM-1092] Rollback global shading of Guava

Be sure to do all of the following to help us incorporate your contribution
quickly and easily:

 - [ ] Make sure the PR title is formatted like:
   `[BEAM-] Description of pull request`
 - [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable
   Travis-CI on your fork and ensure the whole test matrix passes).
 - [ ] Replace `` in the title with the actual Jira issue
   number, if there is one.
 - [ ] If this contribution is large, please file an Apache
   [Individual Contributor License 
Agreement](https://www.apache.org/licenses/icla.txt).

---
Revert PRs #2096 and #2249 

PR #2096  has caused BigtableITs to fail, as of 
https://builds.apache.org/job/beam_PostCommit_Java_MavenInstall/2906/

The `BigtableDataClient` has methods that return Guava types, e.g. 
`sampleRowKeys` returns an `ImmutableList`, and we rewrite those calls to 
reference the repackaged type, but we don't repackage the actual client 
libraries; as a result when the JVM tries to find the 
`sampleRowKeys(SampleRowKeysRequest) -> ImmutableList` 
it fails.

We can certainly not shade guava in the google-cloud-platform IOs module; I 
believe it is also possible to repackage the appropriate Bigtable libraries to 
ensure the return types of those methods are also repackaged. However, 
`BigtableIO` uses classes that are defined in the `Bigtable` libraries, so we 
would have to force our version on users. 

@davorbonaci @aviemzur 

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/tgroh/beam no_repackage_gcp_io

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/beam/pull/2256.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #2256


commit 506a2cfa0b730d9b1ec8ec07223797c697b061f1
Author: Thomas Groh 
Date:   2017-03-15T22:28:45Z

Revert "Increment shade-plugin version back to 3.0.0"

This reverts commit 8f7c320846b598dc650a7b786182f7cecdd9c601.

commit dcfe32a14318d0daebad7319ba4143a25fc02be4
Author: Thomas Groh 
Date:   2017-03-15T22:28:47Z

Revert "[BEAM-1092] Replace hyphens in artifactId with dots in shading 
relocations"

This reverts commit 2b55e0798f44e3fa644e7df1eaab43898ecf9c46.

commit 12873b9500c31b78d84ec6d52c0d9cf1a68edc39
Author: Thomas Groh 
Date:   2017-03-15T22:28:49Z

Revert "[BEAM-1092] Shade commonly used libraries (e.g. Guava) to avoid 
class conflicts"

This reverts commit 03d78097ba0a2d55a9e8dcbaf11e0f8182f223c1.




> Shade commonly used libraries (e.g. Guava) to avoid class conflicts
> ---
>
> Key: BEAM-1092
> URL: https://issues.apache.org/jira/browse/BEAM-1092
> Project: Beam
>  Issue Type: Bug
>  Components: examples-java, sdk-java-extensions
>Affects Versions: 0.3.0-incubating
>Reporter: Maximilian Michels
>Assignee: Frances Perry
>
> Beam shades away some of its dependencies like Guava to avoid user classes 
> from clashing with these dependencies. Some of the artifacts, e.g. KafkaIO, 
> do not shade any classes and directly depend on potentially conflicting 
> libraries (e.g. Guava). Also, users might manually add such libraries as 
> dependencies.
> Runners who add classes to the classpath (e.g. Hadoop) can run into conflict 
> with multiple versions of the same class. To prevent that, we should adjust 
> the Maven archetypes pom files used for the Quickstart to perform shading of 
> commonly used libraries (again, Guava is often the culprit).
> To prevent the problem in the first place, we should expand the shading of 
> Guava and other libraries to all modules which make use of these. 
> To solve both dimensions of the issue, we need to address:
> 1. Adding shading of commonly used libraries to the archetypes poms
> 2. Properly shade all commonly used libraries in the SDK modules
> 2) seems to be of highest priority since it affects users who simply use the 
> provided IO modules.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (BEAM-547) Align Python SDK version with Maven

2017-03-15 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/BEAM-547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15927094#comment-15927094
 ] 

ASF GitHub Bot commented on BEAM-547:
-

GitHub user sb2nov opened a pull request:

https://github.com/apache/beam/pull/2255

[BEAM-547] [BEAM-1730] Cleanup versions.py and root init has version access

Be sure to do all of the following to help us incorporate your contribution
quickly and easily:

 - [ ] Make sure the PR title is formatted like:
   `[BEAM-] Description of pull request`
 - [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable
   Travis-CI on your fork and ensure the whole test matrix passes).
 - [ ] Replace `` in the title with the actual Jira issue
   number, if there is one.
 - [ ] If this contribution is large, please file an Apache
   [Individual Contributor License 
Agreement](https://www.apache.org/licenses/icla.txt).

---

R: @aaltay PTAL

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/sb2nov/beam BEAM_547-simplify-version-python

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/beam/pull/2255.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #2255


commit f1603256e5a3d662012872378c9c3ae2fd908fd0
Author: Sourabh Bajaj 
Date:   2017-03-15T22:24:20Z

[BEAM-547] [BEAM-1730] Cleanup versions.py




> Align Python SDK version with Maven
> ---
>
> Key: BEAM-547
> URL: https://issues.apache.org/jira/browse/BEAM-547
> Project: Beam
>  Issue Type: New Feature
>  Components: sdk-py
>Affects Versions: 0.3.0-incubating
>Reporter: Sergio Fernández
>Assignee: Frances Perry
>Priority: Minor
>   Original Estimate: 24h
>  Remaining Estimate: 24h
>
> In BEAM-378 we've integrated the Python SDK in the main Maven build. 
> Initially I wanted to also align versions, but after discussing it with 
> [~silv...@google.com] we kept that aside for the moment. 
> Closing [PR #537|https://github.com/apache/incubator-beam/pull/537] [~altay] 
> brings the issue back. So it may make sense to revisit that idea.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[GitHub] beam pull request #2255: [BEAM-547] [BEAM-1730] Cleanup versions.py and root...

2017-03-15 Thread sb2nov
GitHub user sb2nov opened a pull request:

https://github.com/apache/beam/pull/2255

[BEAM-547] [BEAM-1730] Cleanup versions.py and root init has version access

Be sure to do all of the following to help us incorporate your contribution
quickly and easily:

 - [ ] Make sure the PR title is formatted like:
   `[BEAM-] Description of pull request`
 - [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable
   Travis-CI on your fork and ensure the whole test matrix passes).
 - [ ] Replace `` in the title with the actual Jira issue
   number, if there is one.
 - [ ] If this contribution is large, please file an Apache
   [Individual Contributor License 
Agreement](https://www.apache.org/licenses/icla.txt).

---

R: @aaltay PTAL

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/sb2nov/beam BEAM_547-simplify-version-python

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/beam/pull/2255.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #2255


commit f1603256e5a3d662012872378c9c3ae2fd908fd0
Author: Sourabh Bajaj 
Date:   2017-03-15T22:24:20Z

[BEAM-547] [BEAM-1730] Cleanup versions.py




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


Jenkins build is unstable: beam_PostCommit_Java_MavenInstall #2918

2017-03-15 Thread Apache Jenkins Server
See 




Jenkins build is back to normal : beam_PostCommit_Java_RunnableOnService_Apex #774

2017-03-15 Thread Apache Jenkins Server
See 




Jenkins build is back to normal : beam_PostCommit_Java_RunnableOnService_Spark #1251

2017-03-15 Thread Apache Jenkins Server
See 




[GitHub] beam pull request #2254: A few comment fixups in BigQueryIO

2017-03-15 Thread jkff
GitHub user jkff opened a pull request:

https://github.com/apache/beam/pull/2254

A few comment fixups in BigQueryIO

Some of the comments were lost in a recent cleanup PR.

Some other comments, I just made them shorter and equally or more clear.
(the fact that builder methods don't modify the current object, I
believe, does not need to be spelled out on every builder method
of every transform)

R: @tgroh 
CC: @reuvenlax 


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/jkff/incubator-beam bq-comments

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/beam/pull/2254.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #2254


commit f82ac27abc7aad825483e14c8d48b653e3f33bea
Author: Eugene Kirpichov 
Date:   2017-03-15T22:01:12Z

A few comment fixups in BigQueryIO

Some of the comments were lost in a recent cleanup PR.

Some other comments, I just made them shorter and equally or more clear.
(the fact that builder methods don't modify the current object, I
believe, does not need to be spelled out on every builder method
of every transform)




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Commented] (BEAM-1644) IO ITs: shared directory for kubernetes resources and PipelineOptions?

2017-03-15 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/BEAM-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15927060#comment-15927060
 ] 

ASF GitHub Bot commented on BEAM-1644:
--

GitHub user ssisk opened a pull request:

https://github.com/apache/beam/pull/2253

[BEAM-1644] Move PipelineOptions for IO ITs into shared location.

Be sure to do all of the following to help us incorporate your contribution
quickly and easily:

 - [X] Make sure the PR title is formatted like:
   `[BEAM-] Description of pull request`
 - [X] Make sure tests pass via `mvn clean verify`. (Even better, enable
   Travis-CI on your fork and ensure the whole test matrix passes).
 - [X] Replace `` in the title with the actual Jira issue
   number, if there is one.
 - [X] If this contribution is large, please file an Apache
   [Individual Contributor License 
Agreement](https://www.apache.org/licenses/icla.txt).

---
* creates a common directory for IO 
* moves the current pipeline options (which are spread out into separate 
directories) into that common directory.

This is is useful/necessary because:
1. In order to run all the IO ITs in one run, they have to have a shared 
set of pipeline options - options on the command line but not present in the 
PipelineOptions being used to read them will cause an error
2. Data stores may be accessed in different IO modules, but should share 
common command line options - having them in a common directory makes that 
easier.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/ssisk/beam io-test-pipeline-options

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/beam/pull/2253.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #2253


commit c5568417876ed6c8ea2e64c6caa22098f4494d41
Author: Stephen Sisk 
Date:   2017-03-15T21:31:49Z

Move PipelineOptions for IO ITs into shared location.




> IO ITs: shared directory for kubernetes resources and PipelineOptions?
> --
>
> Key: BEAM-1644
> URL: https://issues.apache.org/jira/browse/BEAM-1644
> Project: Beam
>  Issue Type: Bug
>  Components: sdk-java-extensions
>Reporter: Stephen Sisk
>Assignee: Stephen Sisk
>
> It is the case that different IOs will be created that connect to the same 
> data stores - HadoopInputFormat in particular uses ES and cassandra, which 
> are also used in their respective IOs as well. Jdbc is likely to have the 
> same type of overlap.
> It would be nice to share TestPipelineOption and kubernetes/docker scripts so 
> that we don't need to repeat them in each module. 
> As such, we should put them in a shared location. It seems like the best bet 
> is to create a new module for test resources. 
> Proposal: 
> * Create a new module under io, test-common (? I'm not in love with that 
> name) 
> * All the IOs with ITs can put their TestPipelineOption classes there
> * it will have a kubernetes directory with the various kubernetes scripts in 
> sub directories
> Further thoughts:
> If 2 IOs need different configurations of a data store, this would make that 
> harder. In that case, there's nothing stopping us from having two different 
> sets of the kubernetes scripts in the shared location



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[GitHub] beam pull request #2253: [BEAM-1644] Move PipelineOptions for IO ITs into sh...

2017-03-15 Thread ssisk
GitHub user ssisk opened a pull request:

https://github.com/apache/beam/pull/2253

[BEAM-1644] Move PipelineOptions for IO ITs into shared location.

Be sure to do all of the following to help us incorporate your contribution
quickly and easily:

 - [X] Make sure the PR title is formatted like:
   `[BEAM-] Description of pull request`
 - [X] Make sure tests pass via `mvn clean verify`. (Even better, enable
   Travis-CI on your fork and ensure the whole test matrix passes).
 - [X] Replace `` in the title with the actual Jira issue
   number, if there is one.
 - [X] If this contribution is large, please file an Apache
   [Individual Contributor License 
Agreement](https://www.apache.org/licenses/icla.txt).

---
* creates a common directory for IO 
* moves the current pipeline options (which are spread out into separate 
directories) into that common directory.

This is is useful/necessary because:
1. In order to run all the IO ITs in one run, they have to have a shared 
set of pipeline options - options on the command line but not present in the 
PipelineOptions being used to read them will cause an error
2. Data stores may be accessed in different IO modules, but should share 
common command line options - having them in a common directory makes that 
easier.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/ssisk/beam io-test-pipeline-options

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/beam/pull/2253.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #2253


commit c5568417876ed6c8ea2e64c6caa22098f4494d41
Author: Stephen Sisk 
Date:   2017-03-15T21:31:49Z

Move PipelineOptions for IO ITs into shared location.




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


Build failed in Jenkins: beam_PostCommit_Java_Version_Test » OpenJDK 8 (on Ubuntu only),beam #22

2017-03-15 Thread Apache Jenkins Server
See 


Changes:

[altay] Revert "Add ValueProvider class for FileBasedSource I/O Transforms"

--
[...truncated 2.07 MB...]
Running org.apache.beam.sdk.transforms.MaxTest
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.012 sec - in 
org.apache.beam.sdk.transforms.MaxTest
Running org.apache.beam.sdk.transforms.ParDoTest
Tests run: 14, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.215 sec - in 
org.apache.beam.sdk.transforms.ParDoTest
Running org.apache.beam.sdk.transforms.CreateTest
Tests run: 16, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.495 sec - in 
org.apache.beam.sdk.transforms.CreateTest
Running org.apache.beam.sdk.transforms.CombineTest
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.082 sec - in 
org.apache.beam.sdk.transforms.CombineTest
Running org.apache.beam.sdk.util.VarIntTest
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.007 sec - in 
org.apache.beam.sdk.util.VarIntTest
Running org.apache.beam.sdk.util.StructsTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec - in 
org.apache.beam.sdk.util.StructsTest
Running org.apache.beam.sdk.util.StreamUtilsTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec - in 
org.apache.beam.sdk.util.StreamUtilsTest
Running org.apache.beam.sdk.util.PubsubTestClientTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.022 sec - in 
org.apache.beam.sdk.util.PubsubTestClientTest
Running org.apache.beam.sdk.util.StringUtilsTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.StringUtilsTest
Running org.apache.beam.sdk.util.MutationDetectorsTest
Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.017 sec - in 
org.apache.beam.sdk.util.MutationDetectorsTest
Running org.apache.beam.sdk.util.ValueWithRecordIdTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.004 sec - in 
org.apache.beam.sdk.util.ValueWithRecordIdTest
Running org.apache.beam.sdk.util.ExposedByteArrayOutputStreamTest
Tests run: 24, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec - in 
org.apache.beam.sdk.util.ExposedByteArrayOutputStreamTest
Running org.apache.beam.sdk.util.GcsIOChannelFactoryRegistrarTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.GcsIOChannelFactoryRegistrarTest
Running org.apache.beam.sdk.util.GcpProjectUtilTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.111 sec - in 
org.apache.beam.sdk.util.GcpProjectUtilTest
Running org.apache.beam.sdk.util.ZipFilesTest
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.031 sec - in 
org.apache.beam.sdk.util.ZipFilesTest
Running org.apache.beam.sdk.util.GcsIOChannelFactoryTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec - in 
org.apache.beam.sdk.util.GcsIOChannelFactoryTest
Running org.apache.beam.sdk.util.ApiSurfaceTest
Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.056 sec - in 
org.apache.beam.sdk.util.ApiSurfaceTest
Running org.apache.beam.sdk.util.PubsubClientTest
Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.031 sec - in 
org.apache.beam.sdk.util.PubsubClientTest
Running org.apache.beam.sdk.util.UnownedInputStreamTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec - in 
org.apache.beam.sdk.util.UnownedInputStreamTest
Running org.apache.beam.sdk.util.FileIOChannelFactoryTest
Tests run: 18, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.032 sec - in 
org.apache.beam.sdk.util.FileIOChannelFactoryTest
Running org.apache.beam.sdk.util.ReleaseInfoTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.023 sec - in 
org.apache.beam.sdk.util.ReleaseInfoTest
Running org.apache.beam.sdk.util.WindowedValueTest
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.021 sec - in 
org.apache.beam.sdk.util.WindowedValueTest
Running org.apache.beam.sdk.util.common.ReflectHelpersTest
Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.065 sec - in 
org.apache.beam.sdk.util.common.ReflectHelpersTest
Running org.apache.beam.sdk.util.PubsubJsonClientTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.15 sec - in 
org.apache.beam.sdk.util.PubsubJsonClientTest
Running org.apache.beam.sdk.util.DefaultBucketTest
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.036 sec - in 
org.apache.beam.sdk.util.DefaultBucketTest
Running org.apache.beam.sdk.util.GcsUtilTest
Tests run: 28, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.397 sec - in 
org.apache.beam.sdk.util.GcsUtilTest
Running org.apache.beam.sdk.util.WindowingStrategiesTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 

Build failed in Jenkins: beam_PostCommit_Java_Version_Test » JDK 1.7 (latest),beam #22

2017-03-15 Thread Apache Jenkins Server
See 


Changes:

[altay] Revert "Add ValueProvider class for FileBasedSource I/O Transforms"

--
[...truncated 2.07 MB...]
Running org.apache.beam.sdk.transforms.MaxTest
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.005 sec - in 
org.apache.beam.sdk.transforms.MaxTest
Running org.apache.beam.sdk.transforms.ParDoTest
Tests run: 14, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.097 sec - in 
org.apache.beam.sdk.transforms.ParDoTest
Running org.apache.beam.sdk.transforms.CreateTest
Tests run: 16, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.28 sec - in 
org.apache.beam.sdk.transforms.CreateTest
Running org.apache.beam.sdk.transforms.CombineTest
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.014 sec - in 
org.apache.beam.sdk.transforms.CombineTest
Running org.apache.beam.sdk.util.VarIntTest
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.004 sec - in 
org.apache.beam.sdk.util.VarIntTest
Running org.apache.beam.sdk.util.StructsTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec - in 
org.apache.beam.sdk.util.StructsTest
Running org.apache.beam.sdk.util.StreamUtilsTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec - in 
org.apache.beam.sdk.util.StreamUtilsTest
Running org.apache.beam.sdk.util.PubsubTestClientTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec - in 
org.apache.beam.sdk.util.PubsubTestClientTest
Running org.apache.beam.sdk.util.StringUtilsTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.StringUtilsTest
Running org.apache.beam.sdk.util.MutationDetectorsTest
Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.006 sec - in 
org.apache.beam.sdk.util.MutationDetectorsTest
Running org.apache.beam.sdk.util.ValueWithRecordIdTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.005 sec - in 
org.apache.beam.sdk.util.ValueWithRecordIdTest
Running org.apache.beam.sdk.util.ExposedByteArrayOutputStreamTest
Tests run: 24, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec - in 
org.apache.beam.sdk.util.ExposedByteArrayOutputStreamTest
Running org.apache.beam.sdk.util.GcsIOChannelFactoryRegistrarTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.GcsIOChannelFactoryRegistrarTest
Running org.apache.beam.sdk.util.GcpProjectUtilTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.102 sec - in 
org.apache.beam.sdk.util.GcpProjectUtilTest
Running org.apache.beam.sdk.util.ZipFilesTest
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.011 sec - in 
org.apache.beam.sdk.util.ZipFilesTest
Running org.apache.beam.sdk.util.GcsIOChannelFactoryTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.GcsIOChannelFactoryTest
Running org.apache.beam.sdk.util.ApiSurfaceTest
Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.009 sec - in 
org.apache.beam.sdk.util.ApiSurfaceTest
Running org.apache.beam.sdk.util.PubsubClientTest
Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.036 sec - in 
org.apache.beam.sdk.util.PubsubClientTest
Running org.apache.beam.sdk.util.UnownedInputStreamTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.UnownedInputStreamTest
Running org.apache.beam.sdk.util.FileIOChannelFactoryTest
Tests run: 18, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.011 sec - in 
org.apache.beam.sdk.util.FileIOChannelFactoryTest
Running org.apache.beam.sdk.util.ReleaseInfoTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec - in 
org.apache.beam.sdk.util.ReleaseInfoTest
Running org.apache.beam.sdk.util.WindowedValueTest
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.011 sec - in 
org.apache.beam.sdk.util.WindowedValueTest
Running org.apache.beam.sdk.util.common.ReflectHelpersTest
Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.006 sec - in 
org.apache.beam.sdk.util.common.ReflectHelpersTest
Running org.apache.beam.sdk.util.PubsubJsonClientTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.083 sec - in 
org.apache.beam.sdk.util.PubsubJsonClientTest
Running org.apache.beam.sdk.util.DefaultBucketTest
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.015 sec - in 
org.apache.beam.sdk.util.DefaultBucketTest
Running org.apache.beam.sdk.util.GcsUtilTest
Tests run: 28, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.962 sec - in 
org.apache.beam.sdk.util.GcsUtilTest
Running org.apache.beam.sdk.util.WindowingStrategiesTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.095 

Build failed in Jenkins: beam_PostCommit_Java_Version_Test » JDK 1.8 (latest),beam #22

2017-03-15 Thread Apache Jenkins Server
See 


Changes:

[altay] Revert "Add ValueProvider class for FileBasedSource I/O Transforms"

--
[...truncated 2.07 MB...]
Running org.apache.beam.sdk.transforms.CreateTest
Tests run: 16, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.298 sec - in 
org.apache.beam.sdk.transforms.CreateTest
Running org.apache.beam.sdk.transforms.CombineTest
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.014 sec - in 
org.apache.beam.sdk.transforms.CombineTest
Running org.apache.beam.sdk.util.VarIntTest
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec - in 
org.apache.beam.sdk.util.VarIntTest
Running org.apache.beam.sdk.util.StructsTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec - in 
org.apache.beam.sdk.util.StructsTest
Running org.apache.beam.sdk.util.StreamUtilsTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.005 sec - in 
org.apache.beam.sdk.util.StreamUtilsTest
Running org.apache.beam.sdk.util.PubsubTestClientTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec - in 
org.apache.beam.sdk.util.PubsubTestClientTest
Running org.apache.beam.sdk.util.StringUtilsTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec - in 
org.apache.beam.sdk.util.StringUtilsTest
Running org.apache.beam.sdk.util.MutationDetectorsTest
Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.007 sec - in 
org.apache.beam.sdk.util.MutationDetectorsTest
Running org.apache.beam.sdk.util.ValueWithRecordIdTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.005 sec - in 
org.apache.beam.sdk.util.ValueWithRecordIdTest
Running org.apache.beam.sdk.util.ExposedByteArrayOutputStreamTest
Tests run: 24, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.004 sec - in 
org.apache.beam.sdk.util.ExposedByteArrayOutputStreamTest
Running org.apache.beam.sdk.util.GcsIOChannelFactoryRegistrarTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec - in 
org.apache.beam.sdk.util.GcsIOChannelFactoryRegistrarTest
Running org.apache.beam.sdk.util.GcpProjectUtilTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.072 sec - in 
org.apache.beam.sdk.util.GcpProjectUtilTest
Running org.apache.beam.sdk.util.ZipFilesTest
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.02 sec - in 
org.apache.beam.sdk.util.ZipFilesTest
Running org.apache.beam.sdk.util.GcsIOChannelFactoryTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec - in 
org.apache.beam.sdk.util.GcsIOChannelFactoryTest
Running org.apache.beam.sdk.util.ApiSurfaceTest
Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.015 sec - in 
org.apache.beam.sdk.util.ApiSurfaceTest
Running org.apache.beam.sdk.util.PubsubClientTest
Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.018 sec - in 
org.apache.beam.sdk.util.PubsubClientTest
Running org.apache.beam.sdk.util.UnownedInputStreamTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec - in 
org.apache.beam.sdk.util.UnownedInputStreamTest
Running org.apache.beam.sdk.util.FileIOChannelFactoryTest
Tests run: 18, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.049 sec - in 
org.apache.beam.sdk.util.FileIOChannelFactoryTest
Running org.apache.beam.sdk.util.ReleaseInfoTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.014 sec - in 
org.apache.beam.sdk.util.ReleaseInfoTest
Running org.apache.beam.sdk.util.WindowedValueTest
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.019 sec - in 
org.apache.beam.sdk.util.WindowedValueTest
Running org.apache.beam.sdk.util.common.ReflectHelpersTest
Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.029 sec - in 
org.apache.beam.sdk.util.common.ReflectHelpersTest
Running org.apache.beam.sdk.util.PubsubJsonClientTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.126 sec - in 
org.apache.beam.sdk.util.PubsubJsonClientTest
Running org.apache.beam.sdk.util.DefaultBucketTest
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.018 sec - in 
org.apache.beam.sdk.util.DefaultBucketTest
Running org.apache.beam.sdk.util.GcsUtilTest
Tests run: 28, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.052 sec - in 
org.apache.beam.sdk.util.GcsUtilTest
Running org.apache.beam.sdk.util.WindowingStrategiesTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.17 sec - in 
org.apache.beam.sdk.util.WindowingStrategiesTest
Running org.apache.beam.sdk.util.ExposedByteArrayInputStreamTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.ExposedByteArrayInputStreamTest
Running 

Build failed in Jenkins: beam_PostCommit_Java_Version_Test » OpenJDK 7 (on Ubuntu only),beam #22

2017-03-15 Thread Apache Jenkins Server
See 


Changes:

[altay] Revert "Add ValueProvider class for FileBasedSource I/O Transforms"

--
[...truncated 2.07 MB...]
Running org.apache.beam.sdk.transforms.MaxTest
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.004 sec - in 
org.apache.beam.sdk.transforms.MaxTest
Running org.apache.beam.sdk.transforms.ParDoTest
Tests run: 14, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.102 sec - in 
org.apache.beam.sdk.transforms.ParDoTest
Running org.apache.beam.sdk.transforms.CreateTest
Tests run: 16, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.363 sec - in 
org.apache.beam.sdk.transforms.CreateTest
Running org.apache.beam.sdk.transforms.CombineTest
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.018 sec - in 
org.apache.beam.sdk.transforms.CombineTest
Running org.apache.beam.sdk.util.VarIntTest
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.006 sec - in 
org.apache.beam.sdk.util.VarIntTest
Running org.apache.beam.sdk.util.StructsTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec - in 
org.apache.beam.sdk.util.StructsTest
Running org.apache.beam.sdk.util.StreamUtilsTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.005 sec - in 
org.apache.beam.sdk.util.StreamUtilsTest
Running org.apache.beam.sdk.util.PubsubTestClientTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec - in 
org.apache.beam.sdk.util.PubsubTestClientTest
Running org.apache.beam.sdk.util.StringUtilsTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.StringUtilsTest
Running org.apache.beam.sdk.util.MutationDetectorsTest
Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.005 sec - in 
org.apache.beam.sdk.util.MutationDetectorsTest
Running org.apache.beam.sdk.util.ValueWithRecordIdTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.005 sec - in 
org.apache.beam.sdk.util.ValueWithRecordIdTest
Running org.apache.beam.sdk.util.ExposedByteArrayOutputStreamTest
Tests run: 24, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec - in 
org.apache.beam.sdk.util.ExposedByteArrayOutputStreamTest
Running org.apache.beam.sdk.util.GcsIOChannelFactoryRegistrarTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.GcsIOChannelFactoryRegistrarTest
Running org.apache.beam.sdk.util.GcpProjectUtilTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.075 sec - in 
org.apache.beam.sdk.util.GcpProjectUtilTest
Running org.apache.beam.sdk.util.ZipFilesTest
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.018 sec - in 
org.apache.beam.sdk.util.ZipFilesTest
Running org.apache.beam.sdk.util.GcsIOChannelFactoryTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.GcsIOChannelFactoryTest
Running org.apache.beam.sdk.util.ApiSurfaceTest
Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.01 sec - in 
org.apache.beam.sdk.util.ApiSurfaceTest
Running org.apache.beam.sdk.util.PubsubClientTest
Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.009 sec - in 
org.apache.beam.sdk.util.PubsubClientTest
Running org.apache.beam.sdk.util.UnownedInputStreamTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec - in 
org.apache.beam.sdk.util.UnownedInputStreamTest
Running org.apache.beam.sdk.util.FileIOChannelFactoryTest
Tests run: 18, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.015 sec - in 
org.apache.beam.sdk.util.FileIOChannelFactoryTest
Running org.apache.beam.sdk.util.ReleaseInfoTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec - in 
org.apache.beam.sdk.util.ReleaseInfoTest
Running org.apache.beam.sdk.util.WindowedValueTest
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.015 sec - in 
org.apache.beam.sdk.util.WindowedValueTest
Running org.apache.beam.sdk.util.common.ReflectHelpersTest
Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.006 sec - in 
org.apache.beam.sdk.util.common.ReflectHelpersTest
Running org.apache.beam.sdk.util.PubsubJsonClientTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.097 sec - in 
org.apache.beam.sdk.util.PubsubJsonClientTest
Running org.apache.beam.sdk.util.DefaultBucketTest
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.017 sec - in 
org.apache.beam.sdk.util.DefaultBucketTest
Running org.apache.beam.sdk.util.GcsUtilTest
Tests run: 28, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.127 sec - in 
org.apache.beam.sdk.util.GcsUtilTest
Running org.apache.beam.sdk.util.WindowingStrategiesTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, 

Build failed in Jenkins: beam_PostCommit_Python_Verify #1519

2017-03-15 Thread Apache Jenkins Server
See 


Changes:

[altay] Revert "[BEAM-547] Version should be accessed from pom file"

--
[...truncated 342.34 KB...]
test_static_value_provider_positional_argument 
(apache_beam.utils.value_provider_test.ValueProviderTests) ... ok
test_static_value_provider_type_cast 
(apache_beam.utils.value_provider_test.ValueProviderTests) ... ok
test_equality (apache_beam.utils.windowed_value_test.WindowedValueTest) ... ok
test_hash (apache_beam.utils.windowed_value_test.WindowedValueTest) ... ok
test_pickle (apache_beam.utils.windowed_value_test.WindowedValueTest) ... ok
test_timestamps (apache_beam.utils.windowed_value_test.WindowedValueTest) ... ok
test_with_value (apache_beam.utils.windowed_value_test.WindowedValueTest) ... ok
test_context_param (apache_beam.pipeline_test.DoFnTest) ... ok
test_element (apache_beam.pipeline_test.DoFnTest) ... ok
test_side_input_no_tag (apache_beam.pipeline_test.DoFnTest) ... ok
test_side_input_tagged (apache_beam.pipeline_test.DoFnTest) ... ok
test_timestamp_param (apache_beam.pipeline_test.DoFnTest) ... ok
test_window_param (apache_beam.pipeline_test.DoFnTest) ... ok
test_attribute_setting (apache_beam.pipeline_test.PipelineOptionsTest) ... ok
test_defaults (apache_beam.pipeline_test.PipelineOptionsTest) ... ok
test_dir (apache_beam.pipeline_test.PipelineOptionsTest) ... ok
test_flag_parsing (apache_beam.pipeline_test.PipelineOptionsTest) ... ok
test_keyword_parsing (apache_beam.pipeline_test.PipelineOptionsTest) ... ok
test_view_as (apache_beam.pipeline_test.PipelineOptionsTest) ... ok
test_aggregator_empty_input (apache_beam.pipeline_test.PipelineTest) ... ok
test_apply_custom_transform (apache_beam.pipeline_test.PipelineTest) ... ok
test_create (apache_beam.pipeline_test.PipelineTest) ... ok
test_create_singleton_pcollection (apache_beam.pipeline_test.PipelineTest) ... 
ok
test_eager_pipeline (apache_beam.pipeline_test.PipelineTest) ... ok
test_flatmap_builtin (apache_beam.pipeline_test.PipelineTest) ... ok
test_memory_usage (apache_beam.pipeline_test.PipelineTest) ... ok
test_metrics_in_source (apache_beam.pipeline_test.PipelineTest) ... ok
test_pipeline_as_context (apache_beam.pipeline_test.PipelineTest) ... ok
test_read (apache_beam.pipeline_test.PipelineTest) ... ok
test_reuse_cloned_custom_transform_instance 
(apache_beam.pipeline_test.PipelineTest) ... ok
test_reuse_custom_transform_instance (apache_beam.pipeline_test.PipelineTest) 
... 
:195:
 DeprecationWarning: BaseException.message has been deprecated as of Python 2.6
  cm.exception.message,
ok
test_transform_no_super_init (apache_beam.pipeline_test.PipelineTest) ... ok
test_visit_entire_graph (apache_beam.pipeline_test.PipelineTest) ... ok
test_pcollectionview_not_recreated (apache_beam.pvalue_test.PValueTest) ... ok
test_pvalue_expected_arguments (apache_beam.pvalue_test.PValueTest) ... ok
test_append_extra_options (apache_beam.test_pipeline_test.TestPipelineTest) ... 
ok
test_append_verifier_in_extra_opt 
(apache_beam.test_pipeline_test.TestPipelineTest) ... ok
test_create_test_pipeline_options 
(apache_beam.test_pipeline_test.TestPipelineTest) ... ok
test_empty_option_args_parsing 
(apache_beam.test_pipeline_test.TestPipelineTest) ... ok
test_get_option (apache_beam.test_pipeline_test.TestPipelineTest) ... ok
test_option_args_parsing (apache_beam.test_pipeline_test.TestPipelineTest) ... 
ok
test_skip_IT (apache_beam.test_pipeline_test.TestPipelineTest) ... SKIP: IT is 
skipped because --test-pipeline-options is not specified
test_file_checksum_matcher_read_failed 
(apache_beam.tests.pipeline_verifiers_test.PipelineVerifiersTest) ... ok
test_file_checksum_matcher_service_error 
(apache_beam.tests.pipeline_verifiers_test.PipelineVerifiersTest) ... ok
test_file_checksum_matcher_success 
(apache_beam.tests.pipeline_verifiers_test.PipelineVerifiersTest) ... ok
test_pipeline_state_matcher_fails 
(apache_beam.tests.pipeline_verifiers_test.PipelineVerifiersTest)
Test PipelineStateMatcher fails when using default expected state ... ok
test_pipeline_state_matcher_given_state 
(apache_beam.tests.pipeline_verifiers_test.PipelineVerifiersTest)
Test PipelineStateMatcher successes when matches given state ... ok
test_pipeline_state_matcher_success 
(apache_beam.tests.pipeline_verifiers_test.PipelineVerifiersTest)
Test PipelineStateMatcher successes when using default expected state ... ok

--
Ran 1024 tests in 52.289s

OK (skipped=13)
___ summary 
  docs: commands succeeded
  lint: commands succeeded
  py27: commands succeeded
  py27cython: commands succeeded
  py27gcp: commands succeeded
  congratulations :)

# Virtualenv for the rest of the script to run 

[GitHub] beam pull request #2252: Revert "Add ValueProvider class for FileBasedSource...

2017-03-15 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/beam/pull/2252


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Created] (BEAM-1731) RuntimeError when running wordcount with ValueProviders

2017-03-15 Thread Sourabh Bajaj (JIRA)
Sourabh Bajaj created BEAM-1731:
---

 Summary: RuntimeError when running wordcount with ValueProviders
 Key: BEAM-1731
 URL: https://issues.apache.org/jira/browse/BEAM-1731
 Project: Beam
  Issue Type: Bug
  Components: sdk-py
Reporter: Sourabh Bajaj
Assignee: María GH


Running: python -m apache_beam.examples.wordcount

INFO:root:Job 2017-03-15_13_39_59-3092873759767386 is in state JOB_STATE_FAILED
Traceback (most recent call last):
  File 
"/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/runpy.py",
 line 162, in _run_module_as_main
"__main__", fname, loader, pkg_name)
  File 
"/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/runpy.py",
 line 72, in _run_code
exec code in run_globals
  File 
"/Users/sourabhbajaj/Projects/incubator-beam/sdks/python/apache_beam/examples/wordcount.py",
 line 119, in 
run()
  File 
"/Users/sourabhbajaj/Projects/incubator-beam/sdks/python/apache_beam/examples/wordcount.py",
 line 109, in run
result.wait_until_finish()
  File "apache_beam/runners/dataflow/dataflow_runner.py", line 711, in 
wait_until_finish
(self.state, getattr(self._runner, 'last_error_msg', None)), self)
apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow 
pipeline failed. State: FAILED, Error:
(e22fabbb61bfae00): Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", 
line 544, in do_work
work_executor.execute()
  File "dataflow_worker/executor.py", line 1013, in 
dataflow_worker.executor.CustomSourceSplitExecutor.execute 
(dataflow_worker/executor.c:31501)
self.response = self._perform_source_split_considering_api_limits(
  File "dataflow_worker/executor.py", line 1021, in 
dataflow_worker.executor.CustomSourceSplitExecutor._perform_source_split_considering_api_limits
 (dataflow_worker/executor.c:31703)
split_response = self._perform_source_split(source_operation_split_task,
  File "dataflow_worker/executor.py", line 1059, in 
dataflow_worker.executor.CustomSourceSplitExecutor._perform_source_split 
(dataflow_worker/executor.c:32341)
for split in source.split(desired_bundle_size):
  File 
"/usr/local/lib/python2.7/dist-packages/apache_beam/io/filebasedsource.py", 
line 192, in split
return self._get_concat_source().split(
  File 
"/usr/local/lib/python2.7/dist-packages/apache_beam/utils/value_provider.py", 
line 105, in _f
raise RuntimeError('%s not accessible' % obj)
RuntimeError: RuntimeValueProvider(option: input, type: str, default_value: 
'gs://dataflow-samples/shakespeare/kinglear.txt') not accessible




--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[1/2] beam git commit: Revert "Add ValueProvider class for FileBasedSource I/O Transforms"

2017-03-15 Thread altay
Repository: beam
Updated Branches:
  refs/heads/master 88c2fe18d -> 477e789a4


Revert "Add ValueProvider class for FileBasedSource I/O Transforms"

This reverts commit 6d1c9043ab0d929e2cea8a3a68192e47a5cc55cd.


Project: http://git-wip-us.apache.org/repos/asf/beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/02454134
Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/02454134
Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/02454134

Branch: refs/heads/master
Commit: 02454134fbbac2ce28b5b9507a2077ac09348f88
Parents: 88c2fe1
Author: Sourabh Bajaj 
Authored: Wed Mar 15 14:33:19 2017 -0700
Committer: Ahmet Altay 
Committed: Wed Mar 15 14:49:12 2017 -0700

--
 sdks/python/apache_beam/examples/wordcount.py   |  31 ++--
 .../apache_beam/internal/gcp/json_value.py  |   6 -
 sdks/python/apache_beam/io/filebasedsource.py   |  46 ++
 .../apache_beam/io/filebasedsource_test.py  |  28 +---
 sdks/python/apache_beam/io/fileio.py|  44 ++
 sdks/python/apache_beam/io/fileio_test.py   |  45 ++
 sdks/python/apache_beam/transforms/display.py   |   1 -
 .../apache_beam/transforms/display_test.py  |  36 -
 .../apache_beam/utils/pipeline_options.py   |  81 +-
 .../apache_beam/utils/pipeline_options_test.py  |  50 +--
 sdks/python/apache_beam/utils/value_provider.py | 108 --
 .../apache_beam/utils/value_provider_test.py| 146 ---
 12 files changed, 62 insertions(+), 560 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/beam/blob/02454134/sdks/python/apache_beam/examples/wordcount.py
--
diff --git a/sdks/python/apache_beam/examples/wordcount.py 
b/sdks/python/apache_beam/examples/wordcount.py
index 9e47e08..50c0328 100644
--- a/sdks/python/apache_beam/examples/wordcount.py
+++ b/sdks/python/apache_beam/examples/wordcount.py
@@ -19,6 +19,7 @@
 
 from __future__ import absolute_import
 
+import argparse
 import logging
 import re
 
@@ -66,28 +67,24 @@ class WordExtractingDoFn(beam.DoFn):
 
 def run(argv=None):
   """Main entry point; defines and runs the wordcount pipeline."""
-  class WordcountOptions(PipelineOptions):
-@classmethod
-def _add_argparse_args(cls, parser):
-  parser.add_value_provider_argument(
-  '--input',
-  dest='input',
-  default='gs://dataflow-samples/shakespeare/kinglear.txt',
-  help='Input file to process.')
-  parser.add_value_provider_argument(
-  '--output',
-  dest='output',
-  required=True,
-  help='Output file to write results to.')
-  pipeline_options = PipelineOptions(argv)
-  wordcount_options = pipeline_options.view_as(WordcountOptions)
+  parser = argparse.ArgumentParser()
+  parser.add_argument('--input',
+  dest='input',
+  default='gs://dataflow-samples/shakespeare/kinglear.txt',
+  help='Input file to process.')
+  parser.add_argument('--output',
+  dest='output',
+  required=True,
+  help='Output file to write results to.')
+  known_args, pipeline_args = parser.parse_known_args(argv)
   # We use the save_main_session option because one or more DoFn's in this
   # workflow rely on global context (e.g., a module imported at module level).
+  pipeline_options = PipelineOptions(pipeline_args)
   pipeline_options.view_as(SetupOptions).save_main_session = True
   p = beam.Pipeline(options=pipeline_options)
 
   # Read the text file[pattern] into a PCollection.
-  lines = p | 'read' >> ReadFromText(wordcount_options.input)
+  lines = p | 'read' >> ReadFromText(known_args.input)
 
   # Count the occurrences of each word.
   counts = (lines
@@ -102,7 +99,7 @@ def run(argv=None):
 
   # Write the output using a "Write" transform that has side effects.
   # pylint: disable=expression-not-assigned
-  output | 'write' >> WriteToText(wordcount_options.output)
+  output | 'write' >> WriteToText(known_args.output)
 
   # Actually run the pipeline (all operations above are deferred).
   result = p.run()

http://git-wip-us.apache.org/repos/asf/beam/blob/02454134/sdks/python/apache_beam/internal/gcp/json_value.py
--
diff --git a/sdks/python/apache_beam/internal/gcp/json_value.py 
b/sdks/python/apache_beam/internal/gcp/json_value.py
index 4099c1a..c8b5393 100644
--- a/sdks/python/apache_beam/internal/gcp/json_value.py
+++ b/sdks/python/apache_beam/internal/gcp/json_value.py
@@ -25,8 +25,6 @@ except ImportError:
   extra_types = None
 # pylint: enable=wrong-import-order, wrong-import-position
 
-from apache_beam.utils.value_provider import ValueProvider
-
 
 _MAXINT64 = (1 << 63) 

[2/2] beam git commit: This closes #2252

2017-03-15 Thread altay
This closes #2252


Project: http://git-wip-us.apache.org/repos/asf/beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/477e789a
Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/477e789a
Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/477e789a

Branch: refs/heads/master
Commit: 477e789a4f554a23c9a100364c95bee1e01b23f8
Parents: 88c2fe1 0245413
Author: Ahmet Altay 
Authored: Wed Mar 15 14:49:16 2017 -0700
Committer: Ahmet Altay 
Committed: Wed Mar 15 14:49:16 2017 -0700

--
 sdks/python/apache_beam/examples/wordcount.py   |  31 ++--
 .../apache_beam/internal/gcp/json_value.py  |   6 -
 sdks/python/apache_beam/io/filebasedsource.py   |  46 ++
 .../apache_beam/io/filebasedsource_test.py  |  28 +---
 sdks/python/apache_beam/io/fileio.py|  44 ++
 sdks/python/apache_beam/io/fileio_test.py   |  45 ++
 sdks/python/apache_beam/transforms/display.py   |   1 -
 .../apache_beam/transforms/display_test.py  |  36 -
 .../apache_beam/utils/pipeline_options.py   |  81 +-
 .../apache_beam/utils/pipeline_options_test.py  |  50 +--
 sdks/python/apache_beam/utils/value_provider.py | 108 --
 .../apache_beam/utils/value_provider_test.py| 146 ---
 12 files changed, 62 insertions(+), 560 deletions(-)
--




Build failed in Jenkins: beam_PostCommit_Java_Version_Test » OpenJDK 7 (on Ubuntu only),beam #21

2017-03-15 Thread Apache Jenkins Server
See 


Changes:

[altay] Revert "[BEAM-547] Version should be accessed from pom file"

--
[...truncated 2.08 MB...]
Running org.apache.beam.sdk.transforms.MaxTest
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.transforms.MaxTest
Running org.apache.beam.sdk.transforms.ParDoTest
Tests run: 14, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.085 sec - in 
org.apache.beam.sdk.transforms.ParDoTest
Running org.apache.beam.sdk.transforms.CreateTest
Tests run: 16, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.279 sec - in 
org.apache.beam.sdk.transforms.CreateTest
Running org.apache.beam.sdk.transforms.CombineTest
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.015 sec - in 
org.apache.beam.sdk.transforms.CombineTest
Running org.apache.beam.sdk.util.VarIntTest
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.004 sec - in 
org.apache.beam.sdk.util.VarIntTest
Running org.apache.beam.sdk.util.StructsTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.StructsTest
Running org.apache.beam.sdk.util.StreamUtilsTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec - in 
org.apache.beam.sdk.util.StreamUtilsTest
Running org.apache.beam.sdk.util.PubsubTestClientTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec - in 
org.apache.beam.sdk.util.PubsubTestClientTest
Running org.apache.beam.sdk.util.StringUtilsTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.StringUtilsTest
Running org.apache.beam.sdk.util.MutationDetectorsTest
Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.005 sec - in 
org.apache.beam.sdk.util.MutationDetectorsTest
Running org.apache.beam.sdk.util.ValueWithRecordIdTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.005 sec - in 
org.apache.beam.sdk.util.ValueWithRecordIdTest
Running org.apache.beam.sdk.util.ExposedByteArrayOutputStreamTest
Tests run: 24, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec - in 
org.apache.beam.sdk.util.ExposedByteArrayOutputStreamTest
Running org.apache.beam.sdk.util.GcsIOChannelFactoryRegistrarTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.GcsIOChannelFactoryRegistrarTest
Running org.apache.beam.sdk.util.GcpProjectUtilTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.054 sec - in 
org.apache.beam.sdk.util.GcpProjectUtilTest
Running org.apache.beam.sdk.util.ZipFilesTest
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.015 sec - in 
org.apache.beam.sdk.util.ZipFilesTest
Running org.apache.beam.sdk.util.GcsIOChannelFactoryTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.GcsIOChannelFactoryTest
Running org.apache.beam.sdk.util.ApiSurfaceTest
Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.01 sec - in 
org.apache.beam.sdk.util.ApiSurfaceTest
Running org.apache.beam.sdk.util.PubsubClientTest
Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.04 sec - in 
org.apache.beam.sdk.util.PubsubClientTest
Running org.apache.beam.sdk.util.UnownedInputStreamTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.UnownedInputStreamTest
Running org.apache.beam.sdk.util.FileIOChannelFactoryTest
Tests run: 18, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.021 sec - in 
org.apache.beam.sdk.util.FileIOChannelFactoryTest
Running org.apache.beam.sdk.util.ReleaseInfoTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec - in 
org.apache.beam.sdk.util.ReleaseInfoTest
Running org.apache.beam.sdk.util.WindowedValueTest
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.012 sec - in 
org.apache.beam.sdk.util.WindowedValueTest
Running org.apache.beam.sdk.util.common.ReflectHelpersTest
Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.008 sec - in 
org.apache.beam.sdk.util.common.ReflectHelpersTest
Running org.apache.beam.sdk.util.PubsubJsonClientTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.087 sec - in 
org.apache.beam.sdk.util.PubsubJsonClientTest
Running org.apache.beam.sdk.util.DefaultBucketTest
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.017 sec - in 
org.apache.beam.sdk.util.DefaultBucketTest
Running org.apache.beam.sdk.util.GcsUtilTest
Tests run: 28, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.071 sec - in 
org.apache.beam.sdk.util.GcsUtilTest
Running org.apache.beam.sdk.util.WindowingStrategiesTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.096 

Build failed in Jenkins: beam_PostCommit_Java_Version_Test » JDK 1.7 (latest),beam #21

2017-03-15 Thread Apache Jenkins Server
See 


Changes:

[altay] Revert "[BEAM-547] Version should be accessed from pom file"

--
[...truncated 2.07 MB...]
Running org.apache.beam.sdk.transforms.MaxTest
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.005 sec - in 
org.apache.beam.sdk.transforms.MaxTest
Running org.apache.beam.sdk.transforms.ParDoTest
Tests run: 14, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.168 sec - in 
org.apache.beam.sdk.transforms.ParDoTest
Running org.apache.beam.sdk.transforms.CreateTest
Tests run: 16, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.475 sec - in 
org.apache.beam.sdk.transforms.CreateTest
Running org.apache.beam.sdk.transforms.CombineTest
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.027 sec - in 
org.apache.beam.sdk.transforms.CombineTest
Running org.apache.beam.sdk.util.VarIntTest
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.016 sec - in 
org.apache.beam.sdk.util.VarIntTest
Running org.apache.beam.sdk.util.StructsTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.004 sec - in 
org.apache.beam.sdk.util.StructsTest
Running org.apache.beam.sdk.util.StreamUtilsTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.015 sec - in 
org.apache.beam.sdk.util.StreamUtilsTest
Running org.apache.beam.sdk.util.PubsubTestClientTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.004 sec - in 
org.apache.beam.sdk.util.PubsubTestClientTest
Running org.apache.beam.sdk.util.StringUtilsTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec - in 
org.apache.beam.sdk.util.StringUtilsTest
Running org.apache.beam.sdk.util.MutationDetectorsTest
Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.01 sec - in 
org.apache.beam.sdk.util.MutationDetectorsTest
Running org.apache.beam.sdk.util.ValueWithRecordIdTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.015 sec - in 
org.apache.beam.sdk.util.ValueWithRecordIdTest
Running org.apache.beam.sdk.util.ExposedByteArrayOutputStreamTest
Tests run: 24, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.006 sec - in 
org.apache.beam.sdk.util.ExposedByteArrayOutputStreamTest
Running org.apache.beam.sdk.util.GcsIOChannelFactoryRegistrarTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec - in 
org.apache.beam.sdk.util.GcsIOChannelFactoryRegistrarTest
Running org.apache.beam.sdk.util.GcpProjectUtilTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.114 sec - in 
org.apache.beam.sdk.util.GcpProjectUtilTest
Running org.apache.beam.sdk.util.ZipFilesTest
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.023 sec - in 
org.apache.beam.sdk.util.ZipFilesTest
Running org.apache.beam.sdk.util.GcsIOChannelFactoryTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.GcsIOChannelFactoryTest
Running org.apache.beam.sdk.util.ApiSurfaceTest
Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.009 sec - in 
org.apache.beam.sdk.util.ApiSurfaceTest
Running org.apache.beam.sdk.util.PubsubClientTest
Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.009 sec - in 
org.apache.beam.sdk.util.PubsubClientTest
Running org.apache.beam.sdk.util.UnownedInputStreamTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.UnownedInputStreamTest
Running org.apache.beam.sdk.util.FileIOChannelFactoryTest
Tests run: 18, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.011 sec - in 
org.apache.beam.sdk.util.FileIOChannelFactoryTest
Running org.apache.beam.sdk.util.ReleaseInfoTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec - in 
org.apache.beam.sdk.util.ReleaseInfoTest
Running org.apache.beam.sdk.util.WindowedValueTest
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.021 sec - in 
org.apache.beam.sdk.util.WindowedValueTest
Running org.apache.beam.sdk.util.common.ReflectHelpersTest
Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.007 sec - in 
org.apache.beam.sdk.util.common.ReflectHelpersTest
Running org.apache.beam.sdk.util.PubsubJsonClientTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.14 sec - in 
org.apache.beam.sdk.util.PubsubJsonClientTest
Running org.apache.beam.sdk.util.DefaultBucketTest
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.022 sec - in 
org.apache.beam.sdk.util.DefaultBucketTest
Running org.apache.beam.sdk.util.GcsUtilTest
Tests run: 28, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.098 sec - in 
org.apache.beam.sdk.util.GcsUtilTest
Running org.apache.beam.sdk.util.WindowingStrategiesTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.158 

Build failed in Jenkins: beam_PostCommit_Java_Version_Test » OpenJDK 8 (on Ubuntu only),beam #21

2017-03-15 Thread Apache Jenkins Server
See 


Changes:

[altay] Revert "[BEAM-547] Version should be accessed from pom file"

--
[...truncated 2.07 MB...]
Running org.apache.beam.sdk.transforms.MaxTest
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.005 sec - in 
org.apache.beam.sdk.transforms.MaxTest
Running org.apache.beam.sdk.transforms.ParDoTest
Tests run: 14, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.111 sec - in 
org.apache.beam.sdk.transforms.ParDoTest
Running org.apache.beam.sdk.transforms.CreateTest
Tests run: 16, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.294 sec - in 
org.apache.beam.sdk.transforms.CreateTest
Running org.apache.beam.sdk.transforms.CombineTest
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.015 sec - in 
org.apache.beam.sdk.transforms.CombineTest
Running org.apache.beam.sdk.util.VarIntTest
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.006 sec - in 
org.apache.beam.sdk.util.VarIntTest
Running org.apache.beam.sdk.util.StructsTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec - in 
org.apache.beam.sdk.util.StructsTest
Running org.apache.beam.sdk.util.StreamUtilsTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec - in 
org.apache.beam.sdk.util.StreamUtilsTest
Running org.apache.beam.sdk.util.PubsubTestClientTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec - in 
org.apache.beam.sdk.util.PubsubTestClientTest
Running org.apache.beam.sdk.util.StringUtilsTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.StringUtilsTest
Running org.apache.beam.sdk.util.MutationDetectorsTest
Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.006 sec - in 
org.apache.beam.sdk.util.MutationDetectorsTest
Running org.apache.beam.sdk.util.ValueWithRecordIdTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.006 sec - in 
org.apache.beam.sdk.util.ValueWithRecordIdTest
Running org.apache.beam.sdk.util.ExposedByteArrayOutputStreamTest
Tests run: 24, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec - in 
org.apache.beam.sdk.util.ExposedByteArrayOutputStreamTest
Running org.apache.beam.sdk.util.GcsIOChannelFactoryRegistrarTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.GcsIOChannelFactoryRegistrarTest
Running org.apache.beam.sdk.util.GcpProjectUtilTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.082 sec - in 
org.apache.beam.sdk.util.GcpProjectUtilTest
Running org.apache.beam.sdk.util.ZipFilesTest
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.014 sec - in 
org.apache.beam.sdk.util.ZipFilesTest
Running org.apache.beam.sdk.util.GcsIOChannelFactoryTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.GcsIOChannelFactoryTest
Running org.apache.beam.sdk.util.ApiSurfaceTest
Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.009 sec - in 
org.apache.beam.sdk.util.ApiSurfaceTest
Running org.apache.beam.sdk.util.PubsubClientTest
Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.048 sec - in 
org.apache.beam.sdk.util.PubsubClientTest
Running org.apache.beam.sdk.util.UnownedInputStreamTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.UnownedInputStreamTest
Running org.apache.beam.sdk.util.FileIOChannelFactoryTest
Tests run: 18, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.012 sec - in 
org.apache.beam.sdk.util.FileIOChannelFactoryTest
Running org.apache.beam.sdk.util.ReleaseInfoTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec - in 
org.apache.beam.sdk.util.ReleaseInfoTest
Running org.apache.beam.sdk.util.WindowedValueTest
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.015 sec - in 
org.apache.beam.sdk.util.WindowedValueTest
Running org.apache.beam.sdk.util.common.ReflectHelpersTest
Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.012 sec - in 
org.apache.beam.sdk.util.common.ReflectHelpersTest
Running org.apache.beam.sdk.util.PubsubJsonClientTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.106 sec - in 
org.apache.beam.sdk.util.PubsubJsonClientTest
Running org.apache.beam.sdk.util.DefaultBucketTest
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.021 sec - in 
org.apache.beam.sdk.util.DefaultBucketTest
Running org.apache.beam.sdk.util.GcsUtilTest
Tests run: 28, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.044 sec - in 
org.apache.beam.sdk.util.GcsUtilTest
Running org.apache.beam.sdk.util.WindowingStrategiesTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time 

Build failed in Jenkins: beam_PostCommit_Java_Version_Test » JDK 1.8 (latest),beam #21

2017-03-15 Thread Apache Jenkins Server
See 


Changes:

[altay] Revert "[BEAM-547] Version should be accessed from pom file"

--
[...truncated 2.07 MB...]
Running org.apache.beam.sdk.transforms.CreateTest
Tests run: 16, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.218 sec - in 
org.apache.beam.sdk.transforms.CreateTest
Running org.apache.beam.sdk.transforms.CombineTest
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.015 sec - in 
org.apache.beam.sdk.transforms.CombineTest
Running org.apache.beam.sdk.util.VarIntTest
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec - in 
org.apache.beam.sdk.util.VarIntTest
Running org.apache.beam.sdk.util.StructsTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec - in 
org.apache.beam.sdk.util.StructsTest
Running org.apache.beam.sdk.util.StreamUtilsTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec - in 
org.apache.beam.sdk.util.StreamUtilsTest
Running org.apache.beam.sdk.util.PubsubTestClientTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec - in 
org.apache.beam.sdk.util.PubsubTestClientTest
Running org.apache.beam.sdk.util.StringUtilsTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.StringUtilsTest
Running org.apache.beam.sdk.util.MutationDetectorsTest
Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.006 sec - in 
org.apache.beam.sdk.util.MutationDetectorsTest
Running org.apache.beam.sdk.util.ValueWithRecordIdTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec - in 
org.apache.beam.sdk.util.ValueWithRecordIdTest
Running org.apache.beam.sdk.util.ExposedByteArrayOutputStreamTest
Tests run: 24, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec - in 
org.apache.beam.sdk.util.ExposedByteArrayOutputStreamTest
Running org.apache.beam.sdk.util.GcsIOChannelFactoryRegistrarTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.GcsIOChannelFactoryRegistrarTest
Running org.apache.beam.sdk.util.GcpProjectUtilTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.068 sec - in 
org.apache.beam.sdk.util.GcpProjectUtilTest
Running org.apache.beam.sdk.util.ZipFilesTest
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.019 sec - in 
org.apache.beam.sdk.util.ZipFilesTest
Running org.apache.beam.sdk.util.GcsIOChannelFactoryTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.GcsIOChannelFactoryTest
Running org.apache.beam.sdk.util.ApiSurfaceTest
Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.011 sec - in 
org.apache.beam.sdk.util.ApiSurfaceTest
Running org.apache.beam.sdk.util.PubsubClientTest
Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.013 sec - in 
org.apache.beam.sdk.util.PubsubClientTest
Running org.apache.beam.sdk.util.UnownedInputStreamTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec - in 
org.apache.beam.sdk.util.UnownedInputStreamTest
Running org.apache.beam.sdk.util.FileIOChannelFactoryTest
Tests run: 18, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.01 sec - in 
org.apache.beam.sdk.util.FileIOChannelFactoryTest
Running org.apache.beam.sdk.util.ReleaseInfoTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec - in 
org.apache.beam.sdk.util.ReleaseInfoTest
Running org.apache.beam.sdk.util.WindowedValueTest
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.007 sec - in 
org.apache.beam.sdk.util.WindowedValueTest
Running org.apache.beam.sdk.util.common.ReflectHelpersTest
Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.004 sec - in 
org.apache.beam.sdk.util.common.ReflectHelpersTest
Running org.apache.beam.sdk.util.PubsubJsonClientTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.079 sec - in 
org.apache.beam.sdk.util.PubsubJsonClientTest
Running org.apache.beam.sdk.util.DefaultBucketTest
Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.019 sec - in 
org.apache.beam.sdk.util.DefaultBucketTest
Running org.apache.beam.sdk.util.GcsUtilTest
Tests run: 28, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.12 sec - in 
org.apache.beam.sdk.util.GcsUtilTest
Running org.apache.beam.sdk.util.WindowingStrategiesTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.09 sec - in 
org.apache.beam.sdk.util.WindowingStrategiesTest
Running org.apache.beam.sdk.util.ExposedByteArrayInputStreamTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.ExposedByteArrayInputStreamTest
Running org.apache.beam.sdk.util.BufferedElementCountingOutputStreamTest
Tests run: 

[jira] [Commented] (BEAM-547) Align Python SDK version with Maven

2017-03-15 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/BEAM-547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15927047#comment-15927047
 ] 

ASF GitHub Bot commented on BEAM-547:
-

Github user asfgit closed the pull request at:

https://github.com/apache/beam/pull/2250


> Align Python SDK version with Maven
> ---
>
> Key: BEAM-547
> URL: https://issues.apache.org/jira/browse/BEAM-547
> Project: Beam
>  Issue Type: New Feature
>  Components: sdk-py
>Affects Versions: 0.3.0-incubating
>Reporter: Sergio Fernández
>Assignee: Frances Perry
>Priority: Minor
>   Original Estimate: 24h
>  Remaining Estimate: 24h
>
> In BEAM-378 we've integrated the Python SDK in the main Maven build. 
> Initially I wanted to also align versions, but after discussing it with 
> [~silv...@google.com] we kept that aside for the moment. 
> Closing [PR #537|https://github.com/apache/incubator-beam/pull/537] [~altay] 
> brings the issue back. So it may make sense to revisit that idea.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[2/2] beam git commit: This closes #2250

2017-03-15 Thread altay
This closes #2250


Project: http://git-wip-us.apache.org/repos/asf/beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/88c2fe18
Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/88c2fe18
Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/88c2fe18

Branch: refs/heads/master
Commit: 88c2fe18d41d83709bb62f7f10a61119e12554e4
Parents: f8c6836 76a05ac
Author: Ahmet Altay 
Authored: Wed Mar 15 14:43:50 2017 -0700
Committer: Ahmet Altay 
Committed: Wed Mar 15 14:43:50 2017 -0700

--
 sdks/python/apache_beam/__init__.py |  3 --
 .../runners/dataflow/internal/dependency.py |  2 +-
 sdks/python/apache_beam/version.py  | 25 +--
 sdks/python/apache_beam/version_test.py | 32 
 sdks/python/setup.py|  2 +-
 5 files changed, 18 insertions(+), 46 deletions(-)
--




[GitHub] beam pull request #2250: Revert "[BEAM-547] Version should be accessed from ...

2017-03-15 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/beam/pull/2250


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[1/2] beam git commit: Revert "[BEAM-547] Version should be accessed from pom file"

2017-03-15 Thread altay
Repository: beam
Updated Branches:
  refs/heads/master f8c6836ec -> 88c2fe18d


Revert "[BEAM-547] Version should be accessed from pom file"

This reverts commit b43eea47e3b1e842bc28543679500452ceda5a33.


Project: http://git-wip-us.apache.org/repos/asf/beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/76a05acd
Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/76a05acd
Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/76a05acd

Branch: refs/heads/master
Commit: 76a05acd08530b9faf3c5cca0adc9f61dcf656d5
Parents: f8c6836
Author: Sourabh Bajaj 
Authored: Wed Mar 15 12:51:46 2017 -0700
Committer: Ahmet Altay 
Committed: Wed Mar 15 14:42:52 2017 -0700

--
 sdks/python/apache_beam/__init__.py |  3 --
 .../runners/dataflow/internal/dependency.py |  2 +-
 sdks/python/apache_beam/version.py  | 25 +--
 sdks/python/apache_beam/version_test.py | 32 
 sdks/python/setup.py|  2 +-
 5 files changed, 18 insertions(+), 46 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/beam/blob/76a05acd/sdks/python/apache_beam/__init__.py
--
diff --git a/sdks/python/apache_beam/__init__.py 
b/sdks/python/apache_beam/__init__.py
index 2001c80..77c89ad 100644
--- a/sdks/python/apache_beam/__init__.py
+++ b/sdks/python/apache_beam/__init__.py
@@ -77,9 +77,6 @@ import apache_beam.internal.pickler
 from apache_beam import coders
 from apache_beam import io
 from apache_beam import typehints
-from apache_beam import version
 from apache_beam.pipeline import Pipeline
 from apache_beam.transforms import *
 # pylint: enable=wrong-import-position
-
-__version__ = version.get_version()

http://git-wip-us.apache.org/repos/asf/beam/blob/76a05acd/sdks/python/apache_beam/runners/dataflow/internal/dependency.py
--
diff --git a/sdks/python/apache_beam/runners/dataflow/internal/dependency.py 
b/sdks/python/apache_beam/runners/dataflow/internal/dependency.py
index 4e49a4f..902d738 100644
--- a/sdks/python/apache_beam/runners/dataflow/internal/dependency.py
+++ b/sdks/python/apache_beam/runners/dataflow/internal/dependency.py
@@ -476,7 +476,7 @@ def get_sdk_name_and_version():
   # TODO(ccy): Make this check cleaner.
   container_version = get_required_container_version()
   if container_version == BEAM_CONTAINER_VERSION:
-return ('Apache Beam SDK for Python', beam_version.get_version())
+return ('Apache Beam SDK for Python', beam_version.__version__)
   else:
 return ('Google Cloud Dataflow SDK for Python', container_version)
 

http://git-wip-us.apache.org/repos/asf/beam/blob/76a05acd/sdks/python/apache_beam/version.py
--
diff --git a/sdks/python/apache_beam/version.py 
b/sdks/python/apache_beam/version.py
index ef07dbf..e5d61a1 100644
--- a/sdks/python/apache_beam/version.py
+++ b/sdks/python/apache_beam/version.py
@@ -21,17 +21,14 @@
 import re
 
 
-__version__ = None
+__version__ = '0.7.0.dev'
 
 
-def get_version():
-  global __version__
-  if not __version__:
-__version__ = get_version_from_pom()
-  return __version__
+# The following utilities are legacy code from the Maven integration;
+# see BEAM-378 for further details.
 
 
-# Read the version from pom.xml file
+# Reads the actual version from pom.xml file,
 def get_version_from_pom():
   with open('pom.xml', 'r') as f:
 pom = f.read()
@@ -46,5 +43,15 @@ def get_version_from_pom():
 return version
 
 
-if __name__ == '__main__':
-  __version__ = get_version_from_pom()
+# Synchronizes apache_beam.__version__ field for later usage
+def sync_version(version):
+  init_path = 'apache_beam/__init__.py'
+  regex = r'^__version__\s*=\s*".*"'
+  with open(init_path, "r") as f:
+lines = f.readlines()
+  with open(init_path, "w") as f:
+for line in lines:
+  if re.search(regex, line):
+f.write(re.sub(regex, '__version__ = "%s"' % version, line))
+  else:
+f.write(line)

http://git-wip-us.apache.org/repos/asf/beam/blob/76a05acd/sdks/python/apache_beam/version_test.py
--
diff --git a/sdks/python/apache_beam/version_test.py 
b/sdks/python/apache_beam/version_test.py
deleted file mode 100644
index e3c431d..000
--- a/sdks/python/apache_beam/version_test.py
+++ /dev/null
@@ -1,32 +0,0 @@
-#
-# Licensed to the Apache Software Foundation (ASF) under one or more
-# contributor license agreements.  See the NOTICE file distributed with
-# this work for additional information regarding copyright ownership.
-# The ASF licenses this file to You under the Apache License, Version 2.0
-# (the 

[jira] [Commented] (BEAM-547) Align Python SDK version with Maven

2017-03-15 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/BEAM-547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15927031#comment-15927031
 ] 

ASF GitHub Bot commented on BEAM-547:
-

Github user sb2nov closed the pull request at:

https://github.com/apache/beam/pull/2251


> Align Python SDK version with Maven
> ---
>
> Key: BEAM-547
> URL: https://issues.apache.org/jira/browse/BEAM-547
> Project: Beam
>  Issue Type: New Feature
>  Components: sdk-py
>Affects Versions: 0.3.0-incubating
>Reporter: Sergio Fernández
>Assignee: Frances Perry
>Priority: Minor
>   Original Estimate: 24h
>  Remaining Estimate: 24h
>
> In BEAM-378 we've integrated the Python SDK in the main Maven build. 
> Initially I wanted to also align versions, but after discussing it with 
> [~silv...@google.com] we kept that aside for the moment. 
> Closing [PR #537|https://github.com/apache/incubator-beam/pull/537] [~altay] 
> brings the issue back. So it may make sense to revisit that idea.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[GitHub] beam pull request #2251: [BEAM-547] Fix the version picking by removing from...

2017-03-15 Thread sb2nov
Github user sb2nov closed the pull request at:

https://github.com/apache/beam/pull/2251


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Updated] (BEAM-1644) IO ITs: shared directory for kubernetes resources and PipelineOptions?

2017-03-15 Thread Stephen Sisk (JIRA)

 [ 
https://issues.apache.org/jira/browse/BEAM-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Stephen Sisk updated BEAM-1644:
---
Summary: IO ITs: shared directory for kubernetes resources and 
PipelineOptions?  (was: IO ITs: shared directory for kubernetes resources?)

> IO ITs: shared directory for kubernetes resources and PipelineOptions?
> --
>
> Key: BEAM-1644
> URL: https://issues.apache.org/jira/browse/BEAM-1644
> Project: Beam
>  Issue Type: Bug
>  Components: sdk-java-extensions
>Reporter: Stephen Sisk
>Assignee: Stephen Sisk
>
> It is the case that different IOs will be created that connect to the same 
> data stores - HadoopInputFormat in particular uses ES and cassandra, which 
> are also used in their respective IOs as well. Jdbc is likely to have the 
> same type of overlap.
> It would be nice to share TestPipelineOption and kubernetes/docker scripts so 
> that we don't need to repeat them in each module. 
> As such, we should put them in a shared location. It seems like the best bet 
> is to create a new module for test resources. 
> Proposal: 
> * Create a new module under io, test-common (? I'm not in love with that 
> name) 
> * All the IOs with ITs can put their TestPipelineOption classes there
> * it will have a kubernetes directory with the various kubernetes scripts in 
> sub directories
> Further thoughts:
> If 2 IOs need different configurations of a data store, this would make that 
> harder. In that case, there's nothing stopping us from having two different 
> sets of the kubernetes scripts in the shared location



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[GitHub] beam pull request #2252: Revert "Add ValueProvider class for FileBasedSource...

2017-03-15 Thread sb2nov
GitHub user sb2nov opened a pull request:

https://github.com/apache/beam/pull/2252

Revert "Add ValueProvider class for FileBasedSource I/O Transforms"

This reverts commit 6d1c9043ab0d929e2cea8a3a68192e47a5cc55cd.

Be sure to do all of the following to help us incorporate your contribution
quickly and easily:

 - [ ] Make sure the PR title is formatted like:
   `[BEAM-] Description of pull request`
 - [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable
   Travis-CI on your fork and ensure the whole test matrix passes).
 - [ ] Replace `` in the title with the actual Jira issue
   number, if there is one.
 - [ ] If this contribution is large, please file an Apache
   [Individual Contributor License 
Agreement](https://www.apache.org/licenses/icla.txt).

---

R: @aaltay PTAL

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/sb2nov/beam Revert-Value-provider

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/beam/pull/2252.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #2252


commit cb4aaa6983d7aa3ffc0d7c48851196d33404bcad
Author: Sourabh Bajaj 
Date:   2017-03-15T21:33:19Z

Revert "Add ValueProvider class for FileBasedSource I/O Transforms"

This reverts commit 6d1c9043ab0d929e2cea8a3a68192e47a5cc55cd.




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Commented] (BEAM-547) Align Python SDK version with Maven

2017-03-15 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/BEAM-547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15927011#comment-15927011
 ] 

ASF GitHub Bot commented on BEAM-547:
-

GitHub user sb2nov reopened a pull request:

https://github.com/apache/beam/pull/2250

Revert "[BEAM-547] Version should be accessed from pom file"

This reverts commit b43eea47e3b1e842bc28543679500452ceda5a33.

Be sure to do all of the following to help us incorporate your contribution
quickly and easily:

 - [ ] Make sure the PR title is formatted like:
   `[BEAM-] Description of pull request`
 - [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable
   Travis-CI on your fork and ensure the whole test matrix passes).
 - [ ] Replace `` in the title with the actual Jira issue
   number, if there is one.
 - [ ] If this contribution is large, please file an Apache
   [Individual Contributor License 
Agreement](https://www.apache.org/licenses/icla.txt).

---

R: @aaltay PTAL 

Reverting the change while I fix the postcommits

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/sb2nov/beam BEAM-1730-revert-version-issue

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/beam/pull/2250.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #2250


commit 82f0d465c54c6a8cbc21e7b7f528da63e9713436
Author: Sourabh Bajaj 
Date:   2017-03-15T19:51:46Z

Revert "[BEAM-547] Version should be accessed from pom file"

This reverts commit b43eea47e3b1e842bc28543679500452ceda5a33.




> Align Python SDK version with Maven
> ---
>
> Key: BEAM-547
> URL: https://issues.apache.org/jira/browse/BEAM-547
> Project: Beam
>  Issue Type: New Feature
>  Components: sdk-py
>Affects Versions: 0.3.0-incubating
>Reporter: Sergio Fernández
>Assignee: Frances Perry
>Priority: Minor
>   Original Estimate: 24h
>  Remaining Estimate: 24h
>
> In BEAM-378 we've integrated the Python SDK in the main Maven build. 
> Initially I wanted to also align versions, but after discussing it with 
> [~silv...@google.com] we kept that aside for the moment. 
> Closing [PR #537|https://github.com/apache/incubator-beam/pull/537] [~altay] 
> brings the issue back. So it may make sense to revisit that idea.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[GitHub] beam pull request #2250: Revert "[BEAM-547] Version should be accessed from ...

2017-03-15 Thread sb2nov
GitHub user sb2nov reopened a pull request:

https://github.com/apache/beam/pull/2250

Revert "[BEAM-547] Version should be accessed from pom file"

This reverts commit b43eea47e3b1e842bc28543679500452ceda5a33.

Be sure to do all of the following to help us incorporate your contribution
quickly and easily:

 - [ ] Make sure the PR title is formatted like:
   `[BEAM-] Description of pull request`
 - [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable
   Travis-CI on your fork and ensure the whole test matrix passes).
 - [ ] Replace `` in the title with the actual Jira issue
   number, if there is one.
 - [ ] If this contribution is large, please file an Apache
   [Individual Contributor License 
Agreement](https://www.apache.org/licenses/icla.txt).

---

R: @aaltay PTAL 

Reverting the change while I fix the postcommits

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/sb2nov/beam BEAM-1730-revert-version-issue

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/beam/pull/2250.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #2250


commit 82f0d465c54c6a8cbc21e7b7f528da63e9713436
Author: Sourabh Bajaj 
Date:   2017-03-15T19:51:46Z

Revert "[BEAM-547] Version should be accessed from pom file"

This reverts commit b43eea47e3b1e842bc28543679500452ceda5a33.




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


Build failed in Jenkins: beam_PostCommit_Python_Verify #1517

2017-03-15 Thread Apache Jenkins Server
See 


--
GitHub pull request #2244 of commit 08037d289319374401b9189c3a5df27b37b13e33, 
no merge conflicts.
Setting status of 08037d289319374401b9189c3a5df27b37b13e33 to PENDING with url 
https://builds.apache.org/job/beam_PostCommit_Python_Verify/1517/ and message: 
'Build started sha1 is merged.'
Using context: Jenkins: Python SDK PostCommit Tests
[EnvInject] - Loading node environment variables.
Building remotely on beam3 (beam) in workspace 

 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
 > git --version # timeout=10
 > git fetch --tags --progress https://github.com/apache/beam.git 
 > +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*
ERROR: Error fetching remote repo 'origin'
hudson.plugins.git.GitException: Failed to fetch from 
https://github.com/apache/beam.git
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:806)
at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1070)
at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1101)
at hudson.scm.SCM.checkout(SCM.java:495)
at hudson.model.AbstractProject.checkout(AbstractProject.java:1278)
at 
hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:604)
at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86)
at 
hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:529)
at hudson.model.Run.execute(Run.java:1728)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
at hudson.model.ResourceController.execute(ResourceController.java:98)
at hudson.model.Executor.run(Executor.java:404)
Caused by: hudson.plugins.git.GitException: Command "git fetch --tags 
--progress https://github.com/apache/beam.git 
+refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*" 
returned status code 128:
stdout: 
stderr: error: RPC failed; result=7, HTTP code = 0
fatal: The remote end hung up unexpectedly

at 
org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at 
org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at 
org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at 
org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at 
org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at 
org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at 
hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ..remote call to beam3(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at 
org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor756.invoke(Unknown Source)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at 
org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy81.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
 > git --version # timeout=10
 > git fetch --tags --progress https://github.com/apache/beam.git 
 > +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*
 > git rev-parse refs/remotes/origin/pr/2244/merge^{commit} # timeout=10
 > git rev-parse 

[jira] [Commented] (BEAM-547) Align Python SDK version with Maven

2017-03-15 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/BEAM-547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15926981#comment-15926981
 ] 

ASF GitHub Bot commented on BEAM-547:
-

Github user sb2nov closed the pull request at:

https://github.com/apache/beam/pull/2250


> Align Python SDK version with Maven
> ---
>
> Key: BEAM-547
> URL: https://issues.apache.org/jira/browse/BEAM-547
> Project: Beam
>  Issue Type: New Feature
>  Components: sdk-py
>Affects Versions: 0.3.0-incubating
>Reporter: Sergio Fernández
>Assignee: Frances Perry
>Priority: Minor
>   Original Estimate: 24h
>  Remaining Estimate: 24h
>
> In BEAM-378 we've integrated the Python SDK in the main Maven build. 
> Initially I wanted to also align versions, but after discussing it with 
> [~silv...@google.com] we kept that aside for the moment. 
> Closing [PR #537|https://github.com/apache/incubator-beam/pull/537] [~altay] 
> brings the issue back. So it may make sense to revisit that idea.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[GitHub] beam pull request #2250: Revert "[BEAM-547] Version should be accessed from ...

2017-03-15 Thread sb2nov
Github user sb2nov closed the pull request at:

https://github.com/apache/beam/pull/2250


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] beam pull request #2251: [BEAM-547] Fix the version picking by removing from...

2017-03-15 Thread sb2nov
GitHub user sb2nov opened a pull request:

https://github.com/apache/beam/pull/2251

[BEAM-547] Fix the version picking by removing from root init

Be sure to do all of the following to help us incorporate your contribution
quickly and easily:

 - [ ] Make sure the PR title is formatted like:
   `[BEAM-] Description of pull request`
 - [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable
   Travis-CI on your fork and ensure the whole test matrix passes).
 - [ ] Replace `` in the title with the actual Jira issue
   number, if there is one.
 - [ ] If this contribution is large, please file an Apache
   [Individual Contributor License 
Agreement](https://www.apache.org/licenses/icla.txt).

---


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/sb2nov/beam BEAM-547-version-via-pom

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/beam/pull/2251.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #2251


commit f92ad0805cd53175408e8fe8bc49951f1d340816
Author: Sourabh Bajaj 
Date:   2017-03-15T20:52:43Z

Fix the version picking by removing from root init




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


Build failed in Jenkins: beam_PostCommit_Python_Verify #1516

2017-03-15 Thread Apache Jenkins Server
See 


Changes:

[altay] Add ValueProvider class for FileBasedSource I/O Transforms

[davor] Increment shade-plugin version back to 3.0.0

--
[...truncated 338.75 KB...]
test_static_value_provider_type_cast 
(apache_beam.utils.value_provider_test.ValueProviderTests) ... ok
test_equality (apache_beam.utils.windowed_value_test.WindowedValueTest) ... ok
test_hash (apache_beam.utils.windowed_value_test.WindowedValueTest) ... ok
test_pickle (apache_beam.utils.windowed_value_test.WindowedValueTest) ... ok
test_timestamps (apache_beam.utils.windowed_value_test.WindowedValueTest) ... ok
test_with_value (apache_beam.utils.windowed_value_test.WindowedValueTest) ... ok
test_context_param (apache_beam.pipeline_test.DoFnTest) ... ok
test_element (apache_beam.pipeline_test.DoFnTest) ... ok
test_side_input_no_tag (apache_beam.pipeline_test.DoFnTest) ... ok
test_side_input_tagged (apache_beam.pipeline_test.DoFnTest) ... ok
test_timestamp_param (apache_beam.pipeline_test.DoFnTest) ... ok
test_window_param (apache_beam.pipeline_test.DoFnTest) ... ok
test_attribute_setting (apache_beam.pipeline_test.PipelineOptionsTest) ... ok
test_defaults (apache_beam.pipeline_test.PipelineOptionsTest) ... ok
test_dir (apache_beam.pipeline_test.PipelineOptionsTest) ... ok
test_flag_parsing (apache_beam.pipeline_test.PipelineOptionsTest) ... ok
test_keyword_parsing (apache_beam.pipeline_test.PipelineOptionsTest) ... ok
test_view_as (apache_beam.pipeline_test.PipelineOptionsTest) ... ok
test_aggregator_empty_input (apache_beam.pipeline_test.PipelineTest) ... ok
test_apply_custom_transform (apache_beam.pipeline_test.PipelineTest) ... ok
test_create (apache_beam.pipeline_test.PipelineTest) ... ok
test_create_singleton_pcollection (apache_beam.pipeline_test.PipelineTest) ... 
ok
test_eager_pipeline (apache_beam.pipeline_test.PipelineTest) ... ok
test_flatmap_builtin (apache_beam.pipeline_test.PipelineTest) ... ok
test_memory_usage (apache_beam.pipeline_test.PipelineTest) ... ok
test_metrics_in_source (apache_beam.pipeline_test.PipelineTest) ... ok
test_pipeline_as_context (apache_beam.pipeline_test.PipelineTest) ... ok
test_read (apache_beam.pipeline_test.PipelineTest) ... ok
test_reuse_cloned_custom_transform_instance 
(apache_beam.pipeline_test.PipelineTest) ... ok
test_reuse_custom_transform_instance (apache_beam.pipeline_test.PipelineTest) 
... 
:195:
 DeprecationWarning: BaseException.message has been deprecated as of Python 2.6
  cm.exception.message,
ok
test_transform_no_super_init (apache_beam.pipeline_test.PipelineTest) ... ok
test_visit_entire_graph (apache_beam.pipeline_test.PipelineTest) ... ok
test_pcollectionview_not_recreated (apache_beam.pvalue_test.PValueTest) ... ok
test_pvalue_expected_arguments (apache_beam.pvalue_test.PValueTest) ... ok
test_append_extra_options (apache_beam.test_pipeline_test.TestPipelineTest) ... 
ok
test_append_verifier_in_extra_opt 
(apache_beam.test_pipeline_test.TestPipelineTest) ... ok
test_create_test_pipeline_options 
(apache_beam.test_pipeline_test.TestPipelineTest) ... ok
test_empty_option_args_parsing 
(apache_beam.test_pipeline_test.TestPipelineTest) ... ok
test_get_option (apache_beam.test_pipeline_test.TestPipelineTest) ... ok
test_option_args_parsing (apache_beam.test_pipeline_test.TestPipelineTest) ... 
ok
test_skip_IT (apache_beam.test_pipeline_test.TestPipelineTest) ... SKIP: IT is 
skipped because --test-pipeline-options is not specified
test_file_checksum_matcher_read_failed 
(apache_beam.tests.pipeline_verifiers_test.PipelineVerifiersTest) ... ok
test_file_checksum_matcher_service_error 
(apache_beam.tests.pipeline_verifiers_test.PipelineVerifiersTest) ... ok
test_file_checksum_matcher_success 
(apache_beam.tests.pipeline_verifiers_test.PipelineVerifiersTest) ... ok
test_pipeline_state_matcher_fails 
(apache_beam.tests.pipeline_verifiers_test.PipelineVerifiersTest)
Test PipelineStateMatcher fails when using default expected state ... ok
test_pipeline_state_matcher_given_state 
(apache_beam.tests.pipeline_verifiers_test.PipelineVerifiersTest)
Test PipelineStateMatcher successes when matches given state ... ok
test_pipeline_state_matcher_success 
(apache_beam.tests.pipeline_verifiers_test.PipelineVerifiersTest)
Test PipelineStateMatcher successes when using default expected state ... ok
test_version (apache_beam.version_test.Version) ... ok

--
Ran 1025 tests in 44.469s

OK (skipped=13)
___ summary 
  docs: commands succeeded
  lint: commands succeeded
  py27: commands succeeded
  py27cython: commands succeeded
  py27gcp: commands succeeded
  congratulations :)

# Virtualenv for the rest of the script to run setup & 

Build failed in Jenkins: beam_PostCommit_Java_RunnableOnService_Flink #1947

2017-03-15 Thread Apache Jenkins Server
See 


--
Started by GitHub push by asfgit
[EnvInject] - Loading node environment variables.
Building remotely on beam1 (beam) in workspace 

 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
 > git --version # timeout=10
 > git fetch --tags --progress https://github.com/apache/beam.git 
 > +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*
ERROR: Error fetching remote repo 'origin'
hudson.plugins.git.GitException: Failed to fetch from 
https://github.com/apache/beam.git
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:806)
at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1070)
at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1101)
at hudson.scm.SCM.checkout(SCM.java:495)
at hudson.model.AbstractProject.checkout(AbstractProject.java:1278)
at 
hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:604)
at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86)
at 
hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:529)
at hudson.model.Run.execute(Run.java:1728)
at hudson.maven.MavenModuleSetBuild.run(MavenModuleSetBuild.java:544)
at hudson.model.ResourceController.execute(ResourceController.java:98)
at hudson.model.Executor.run(Executor.java:404)
Caused by: hudson.plugins.git.GitException: Command "git fetch --tags 
--progress https://github.com/apache/beam.git 
+refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*" 
returned status code 128:
stdout: 
stderr: fatal: unable to access 'https://github.com/apache/beam.git/': Failed 
to connect to github.com port 443: Connection timed out

at 
org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at 
org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at 
org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at 
org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at 
org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at 
org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at 
hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ..remote call to beam1(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at 
org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor756.invoke(Unknown Source)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at 
org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy81.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
 > git --version # timeout=10
 > git fetch --tags --progress https://github.com/apache/beam.git 
 > +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*
ERROR: Error fetching remote repo 'origin'
hudson.plugins.git.GitException: Failed to fetch from 
https://github.com/apache/beam.git
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:806)
at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1070)
at 

Build failed in Jenkins: beam_PostCommit_Java_Version_Test » JDK 1.8 (latest),beam #20

2017-03-15 Thread Apache Jenkins Server
See 


Changes:

[aljoscha.krettek] [BEAM-1689] Apply changes for Flink's StatefulDoFnRunner to 
the primary

[tgroh] Stop Double-finalizing checkpoints in the DirectRunner

[tgroh] Prevent Double-Close in UnboundedReadEvaluatorFactory

[altay] [BEAM-1694] Fix docstring inaccuracies in Python-SDK

[davor] [BEAM-1092] Shade commonly used libraries (e.g. Guava) to avoid class

[davor] [BEAM-1092] Replace hyphens in artifactId with dots in shading

[tgroh] Remove two unused fields

[tgroh] Condense BigQueryIO.Read.Bound into BigQueryIO.Read

[tgroh] Condense BigQueryIO.Write.Bound into BigQueryIO.Write

[tgroh] Makes NameUtils recognize AutoValue classes

[tgroh] Use AutoValue for BigQueryIO.Read

[tgroh] Use AutoValue for BigQueryIO.Write

[tgroh] Simplify configuration of StreamWithDedup

[tgroh] Replace BigQueryIO.Read.from() with BigQueryIO.read().from()

[tgroh] Replace BigQueryIO.Write.to() with BigQueryIO.write().to()

[jbonofre] [BEAM-1660] Update JdbcIO JavaDoc about withCoder() use to ensure the

[altay] [BEAM-547] Version should be accessed from pom file

[tgroh] Add Create.TimestampedValues.withType

[davor] Add ValueProvider options for DatastoreIO

[altay] Add ValueProvider class for FileBasedSource I/O Transforms

[davor] Increment shade-plugin version back to 3.0.0

--
[...truncated 1.62 MB...]
declare -x NODE_LABELS="beam beam5"
declare -x NODE_NAME="beam5"
declare -x OLDPWD
declare -x 
PATH="/home/jenkins/tools/java/latest1.8/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games"
declare -x 
PWD="
declare -x ROOT_BUILD_CAUSE="SCMTRIGGER"
declare -x ROOT_BUILD_CAUSE_SCMTRIGGER="true"
declare -x 
RUN_CHANGES_DISPLAY_URL="https://builds.apache.org/job/beam_PostCommit_Java_Version_Test/jdk=JDK%201.8%20(latest),label=beam/20/display/redirect?page=changes"
declare -x 
RUN_DISPLAY_URL="https://builds.apache.org/job/beam_PostCommit_Java_Version_Test/jdk=JDK%201.8%20(latest),label=beam/20/display/redirect"
declare -x SHELL="/bin/bash"
declare -x SHLVL="2"
declare -x SPARK_LOCAL_IP="127.0.0.1"
declare -x SSH_CLIENT="140.211.11.14 47418 22"
declare -x SSH_CONNECTION="140.211.11.14 47418 10.128.0.6 22"
declare -x USER="jenkins"
declare -x 
WORKSPACE="
declare -x XDG_RUNTIME_DIR="/run/user/9997"
declare -x XDG_SESSION_ID="5"
declare -x XFILESEARCHPATH="/usr/dt/app-defaults/%L/Dt"
declare -x jdk="JDK 1.8 (latest)"
declare -x label="beam"
declare -x sha1="master"
[beam] $ /home/jenkins/tools/maven/apache-maven-3.3.3/bin/mvn -f pom.xml 
-Dsha1=master "-Djdk=JDK 1.8 (latest)" -Dlabel=beam 
"-Dmaven.repo.local=
 -B -e -P dataflow-runner clean install -DskipITs=false 
'-DintegrationTestPipelineOptions=[ "--project=apache-beam-testing", 
"--tempRoot=gs://temp-storage-for-end-to-end-tests", 
"--runner=org.apache.beam.runners.dataflow.testing.TestDataflowRunner" ]'
/home/jenkins/tools/maven/apache-maven-3.3.3/bin/mvn: 200: local: 1.8: bad 
variable name
2017-03-15\T\20:45:01.476 [INFO] Error stacktraces are turned on.
2017-03-15\T\20:45:01.521 [INFO] Scanning for projects...
2017-03-15\T\20:45:01.834 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom
2017-03-15\T\20:45:02.114 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom (16 KB 
at 53.9 KB/sec)
2017-03-15\T\20:45:02.528 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/kr/motd/maven/os-maven-plugin/1.4.0.Final/os-maven-plugin-1.4.0.Final.pom
2017-03-15\T\20:45:02.562 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/kr/motd/maven/os-maven-plugin/1.4.0.Final/os-maven-plugin-1.4.0.Final.pom
 (7 KB at 177.8 KB/sec)
2017-03-15\T\20:45:02.566 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom
2017-03-15\T\20:45:02.607 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom
 (7 KB at 160.4 KB/sec)
2017-03-15\T\20:45:02.616 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.1/maven-plugin-api-3.2.1.pom
2017-03-15\T\20:45:02.649 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.1/maven-plugin-api-3.2.1.pom
 (4 KB at 100.1 KB/sec)
2017-03-15\T\20:45:02.651 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.1/maven-3.2.1.pom
2017-03-15\T\20:45:02.686 [INFO] Downloaded: 

Build failed in Jenkins: beam_PostCommit_Java_Version_Test » OpenJDK 8 (on Ubuntu only),beam #20

2017-03-15 Thread Apache Jenkins Server
See 


Changes:

[aljoscha.krettek] [BEAM-1689] Apply changes for Flink's StatefulDoFnRunner to 
the primary

[tgroh] Stop Double-finalizing checkpoints in the DirectRunner

[tgroh] Prevent Double-Close in UnboundedReadEvaluatorFactory

[altay] [BEAM-1694] Fix docstring inaccuracies in Python-SDK

[davor] [BEAM-1092] Shade commonly used libraries (e.g. Guava) to avoid class

[davor] [BEAM-1092] Replace hyphens in artifactId with dots in shading

[tgroh] Remove two unused fields

[tgroh] Condense BigQueryIO.Read.Bound into BigQueryIO.Read

[tgroh] Condense BigQueryIO.Write.Bound into BigQueryIO.Write

[tgroh] Makes NameUtils recognize AutoValue classes

[tgroh] Use AutoValue for BigQueryIO.Read

[tgroh] Use AutoValue for BigQueryIO.Write

[tgroh] Simplify configuration of StreamWithDedup

[tgroh] Replace BigQueryIO.Read.from() with BigQueryIO.read().from()

[tgroh] Replace BigQueryIO.Write.to() with BigQueryIO.write().to()

[jbonofre] [BEAM-1660] Update JdbcIO JavaDoc about withCoder() use to ensure the

[altay] [BEAM-547] Version should be accessed from pom file

[tgroh] Add Create.TimestampedValues.withType

[davor] Add ValueProvider options for DatastoreIO

[altay] Add ValueProvider class for FileBasedSource I/O Transforms

[davor] Increment shade-plugin version back to 3.0.0

--
[...truncated 1.62 MB...]
declare -x NODE_NAME="beam4"
declare -x OLDPWD
declare -x 
PATH="/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games"
declare -x 
PWD="
declare -x ROOT_BUILD_CAUSE="SCMTRIGGER"
declare -x ROOT_BUILD_CAUSE_SCMTRIGGER="true"
declare -x 
RUN_CHANGES_DISPLAY_URL="https://builds.apache.org/job/beam_PostCommit_Java_Version_Test/jdk=OpenJDK%208%20(on%20Ubuntu%20only),label=beam/20/display/redirect?page=changes"
declare -x 
RUN_DISPLAY_URL="https://builds.apache.org/job/beam_PostCommit_Java_Version_Test/jdk=OpenJDK%208%20(on%20Ubuntu%20only),label=beam/20/display/redirect"
declare -x SHELL="/bin/bash"
declare -x SHLVL="2"
declare -x SPARK_LOCAL_IP="127.0.0.1"
declare -x SSH_CLIENT="140.211.11.14 51422 22"
declare -x SSH_CONNECTION="140.211.11.14 51422 10.128.0.8 22"
declare -x USER="jenkins"
declare -x 
WORKSPACE="
declare -x XDG_RUNTIME_DIR="/run/user/9997"
declare -x XDG_SESSION_ID="5"
declare -x XFILESEARCHPATH="/usr/dt/app-defaults/%L/Dt"
declare -x jdk="OpenJDK 8 (on Ubuntu only)"
declare -x label="beam"
declare -x sha1="master"
[beam] $ /home/jenkins/tools/maven/apache-maven-3.3.3/bin/mvn -f pom.xml 
-Dsha1=master "-Djdk=OpenJDK 8 (on Ubuntu only)" -Dlabel=beam 
"-Dmaven.repo.local=
 -B -e -P dataflow-runner clean install -DskipITs=false 
'-DintegrationTestPipelineOptions=[ "--project=apache-beam-testing", 
"--tempRoot=gs://temp-storage-for-end-to-end-tests", 
"--runner=org.apache.beam.runners.dataflow.testing.TestDataflowRunner" ]'
/home/jenkins/tools/maven/apache-maven-3.3.3/bin/mvn: 200: local: 8: bad 
variable name
2017-03-15\T\20:41:10.628 [INFO] Error stacktraces are turned on.
2017-03-15\T\20:41:10.671 [INFO] Scanning for projects...
2017-03-15\T\20:41:10.914 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom
2017-03-15\T\20:41:11.142 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom (16 KB 
at 65.9 KB/sec)
2017-03-15\T\20:41:11.498 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/kr/motd/maven/os-maven-plugin/1.4.0.Final/os-maven-plugin-1.4.0.Final.pom
2017-03-15\T\20:41:11.528 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/kr/motd/maven/os-maven-plugin/1.4.0.Final/os-maven-plugin-1.4.0.Final.pom
 (7 KB at 201.5 KB/sec)
2017-03-15\T\20:41:11.532 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom
2017-03-15\T\20:41:11.560 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom
 (7 KB at 229.1 KB/sec)
2017-03-15\T\20:41:11.568 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.1/maven-plugin-api-3.2.1.pom
2017-03-15\T\20:41:11.599 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.1/maven-plugin-api-3.2.1.pom
 (4 KB at 106.5 KB/sec)
2017-03-15\T\20:41:11.601 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.1/maven-3.2.1.pom
2017-03-15\T\20:41:11.635 [INFO] Downloaded: 

Build failed in Jenkins: beam_PostCommit_Java_MavenInstall #2917

2017-03-15 Thread Apache Jenkins Server
See 


Changes:

[davor] Increment shade-plugin version back to 3.0.0

--
Started by GitHub push by asfgit
[EnvInject] - Loading node environment variables.
Building remotely on beam1 (beam) in workspace 

 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
 > git --version # timeout=10
 > git fetch --tags --progress https://github.com/apache/beam.git 
 > +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*
ERROR: Error fetching remote repo 'origin'
hudson.plugins.git.GitException: Failed to fetch from 
https://github.com/apache/beam.git
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:806)
at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1070)
at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1101)
at hudson.scm.SCM.checkout(SCM.java:495)
at hudson.model.AbstractProject.checkout(AbstractProject.java:1278)
at 
hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:604)
at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86)
at 
hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:529)
at hudson.model.Run.execute(Run.java:1728)
at hudson.maven.MavenModuleSetBuild.run(MavenModuleSetBuild.java:544)
at hudson.model.ResourceController.execute(ResourceController.java:98)
at hudson.model.Executor.run(Executor.java:404)
Caused by: hudson.plugins.git.GitException: Command "git fetch --tags 
--progress https://github.com/apache/beam.git 
+refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*" 
returned status code 128:
stdout: 
stderr: error: RPC failed; result=18, HTTP code = 200
fatal: The remote end hung up unexpectedly

at 
org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at 
org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at 
org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at 
org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at 
org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at 
org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at 
hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ..remote call to beam1(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at 
org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor756.invoke(Unknown Source)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at 
org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy81.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
 > git --version # timeout=10
 > git fetch --tags --progress https://github.com/apache/beam.git 
 > +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*
ERROR: Error fetching remote repo 'origin'
hudson.plugins.git.GitException: Failed to fetch from 
https://github.com/apache/beam.git
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:806)
at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1070)
at 

Build failed in Jenkins: beam_PostCommit_Java_Version_Test » OpenJDK 7 (on Ubuntu only),beam #20

2017-03-15 Thread Apache Jenkins Server
See 


Changes:

[aljoscha.krettek] [BEAM-1689] Apply changes for Flink's StatefulDoFnRunner to 
the primary

[tgroh] Stop Double-finalizing checkpoints in the DirectRunner

[tgroh] Prevent Double-Close in UnboundedReadEvaluatorFactory

[altay] [BEAM-1694] Fix docstring inaccuracies in Python-SDK

[davor] [BEAM-1092] Shade commonly used libraries (e.g. Guava) to avoid class

[davor] [BEAM-1092] Replace hyphens in artifactId with dots in shading

[tgroh] Remove two unused fields

[tgroh] Condense BigQueryIO.Read.Bound into BigQueryIO.Read

[tgroh] Condense BigQueryIO.Write.Bound into BigQueryIO.Write

[tgroh] Makes NameUtils recognize AutoValue classes

[tgroh] Use AutoValue for BigQueryIO.Read

[tgroh] Use AutoValue for BigQueryIO.Write

[tgroh] Simplify configuration of StreamWithDedup

[tgroh] Replace BigQueryIO.Read.from() with BigQueryIO.read().from()

[tgroh] Replace BigQueryIO.Write.to() with BigQueryIO.write().to()

[jbonofre] [BEAM-1660] Update JdbcIO JavaDoc about withCoder() use to ensure the

[altay] [BEAM-547] Version should be accessed from pom file

[tgroh] Add Create.TimestampedValues.withType

[davor] Add ValueProvider options for DatastoreIO

[altay] Add ValueProvider class for FileBasedSource I/O Transforms

[davor] Increment shade-plugin version back to 3.0.0

--
[...truncated 1.62 MB...]
-rw-r--r--  1 jenkins jenkins 18985 Mar  9 12:01 combiners.py
-rw-r--r--  1 jenkins jenkins 12917 Mar  9 12:01 combiners_test.py
-rw-r--r--  1 jenkins jenkins 50363 Mar 15 20:39 core.py
-rw-r--r--  1 jenkins jenkins  3073 Mar  9 12:01 cy_combiners.pxd
-rw-r--r--  1 jenkins jenkins  7362 Mar  9 12:01 cy_combiners.py
-rw-r--r--  1 jenkins jenkins 10981 Mar 15 20:39 display.py
-rw-r--r--  1 jenkins jenkins  9351 Mar 15 20:39 display_test.py
-rw-r--r--  1 jenkins jenkins  1077 Mar  9 12:01 __init__.py
-rw-r--r--  1 jenkins jenkins 24237 Mar  9 12:01 ptransform.py
-rw-r--r--  1 jenkins jenkins 76010 Mar  9 12:01 ptransform_test.py
-rw-r--r--  1 jenkins jenkins  7245 Mar  9 12:01 sideinputs.py
-rw-r--r--  1 jenkins jenkins 12953 Mar  9 12:01 sideinputs_test.py
-rw-r--r--  1 jenkins jenkins  4317 Mar  9 12:01 timeutil.py
-rw-r--r--  1 jenkins jenkins 36838 Mar 14 06:00 trigger.py
-rw-r--r--  1 jenkins jenkins 20894 Mar 14 06:00 trigger_test.py
-rw-r--r--  1 jenkins jenkins  6693 Mar  9 12:01 trigger_transcripts.yaml
-rw-r--r--  1 jenkins jenkins  8626 Mar  9 12:01 util.py
-rw-r--r--  1 jenkins jenkins 15668 Mar 14 06:00 window.py
-rw-r--r--  1 jenkins jenkins 10606 Mar 14 06:00 window_test.py
-rw-r--r--  1 jenkins jenkins  4178 Mar  9 12:01 write_ptransform_test.py

./sdks/python/apache_beam/typehints:
total 156
drwxr-xr-x  2 jenkins jenkins  4096 Mar 15 20:39 .
drwxr-xr-x 12 jenkins jenkins  4096 Mar 15 20:39 ..
-rw-r--r--  1 jenkins jenkins 18214 Mar  9 12:01 decorators.py
-rw-r--r--  1 jenkins jenkins   989 Mar  9 12:01 __init__.py
-rw-r--r--  1 jenkins jenkins  7883 Mar  9 12:01 opcodes.py
-rw-r--r--  1 jenkins jenkins 11973 Mar 15 20:39 trivial_inference.py
-rw-r--r--  1 jenkins jenkins  4758 Mar  9 12:01 trivial_inference_test.py
-rw-r--r--  1 jenkins jenkins  6778 Mar  9 12:01 typecheck.py
-rw-r--r--  1 jenkins jenkins  9131 Mar  9 12:01 typed_pipeline_test.py
-rw-r--r--  1 jenkins jenkins 35950 Mar  9 12:01 typehints.py
-rw-r--r--  1 jenkins jenkins 39135 Mar  9 12:01 typehints_test.py

./sdks/python/apache_beam/utils:
total 184
drwxr-xr-x  2 jenkins jenkins  4096 Mar 15 20:39 .
drwxr-xr-x 12 jenkins jenkins  4096 Mar 15 20:39 ..
-rw-r--r--  1 jenkins jenkins  3602 Mar  9 12:01 annotations.py
-rw-r--r--  1 jenkins jenkins  5461 Mar  9 12:01 annotations_test.py
-rw-r--r--  1 jenkins jenkins  1130 Mar  9 12:01 counters.pxd
-rw-r--r--  1 jenkins jenkins  6154 Mar 15 20:39 counters.py
-rw-r--r--  1 jenkins jenkins   975 Mar  9 12:01 __init__.py
-rw-r--r--  1 jenkins jenkins  1948 Mar  9 12:01 path.py
-rw-r--r--  1 jenkins jenkins  2494 Mar  9 12:01 path_test.py
-rw-r--r--  1 jenkins jenkins 23568 Mar 15 20:39 pipeline_options.py
-rw-r--r--  1 jenkins jenkins  9626 Mar 15 20:39 pipeline_options_test.py
-rw-r--r--  1 jenkins jenkins  8096 Mar  9 12:01 pipeline_options_validator.py
-rw-r--r--  1 jenkins jenkins 11571 Mar  9 12:01 
pipeline_options_validator_test.py
-rw-r--r--  1 jenkins jenkins  1679 Mar  9 12:01 processes.py
-rw-r--r--  1 jenkins jenkins  3427 Mar  9 12:01 processes_test.py
-rw-r--r--  1 jenkins jenkins  4624 Mar  9 12:01 profiler.py
-rw-r--r--  1 jenkins jenkins  1548 Mar 14 06:00 proto_utils.py
-rw-r--r--  1 jenkins jenkins  8160 Mar 15 20:39 retry.py
-rw-r--r--  1 jenkins jenkins  7656 Mar  9 12:01 retry_test.py
-rw-r--r--  1 jenkins jenkins  6423 Mar  9 12:01 timestamp.py
-rw-r--r--  1 jenkins jenkins  6806 Mar  9 12:01 timestamp_test.py
-rw-r--r--  1 jenkins jenkins  1122 Mar 14 06:00 urns.py

Build failed in Jenkins: beam_PostCommit_Java_Version_Test » JDK 1.7 (latest),beam #20

2017-03-15 Thread Apache Jenkins Server
See 


Changes:

[aljoscha.krettek] [BEAM-1689] Apply changes for Flink's StatefulDoFnRunner to 
the primary

[tgroh] Stop Double-finalizing checkpoints in the DirectRunner

[tgroh] Prevent Double-Close in UnboundedReadEvaluatorFactory

[altay] [BEAM-1694] Fix docstring inaccuracies in Python-SDK

[davor] [BEAM-1092] Shade commonly used libraries (e.g. Guava) to avoid class

[davor] [BEAM-1092] Replace hyphens in artifactId with dots in shading

[tgroh] Remove two unused fields

[tgroh] Condense BigQueryIO.Read.Bound into BigQueryIO.Read

[tgroh] Condense BigQueryIO.Write.Bound into BigQueryIO.Write

[tgroh] Makes NameUtils recognize AutoValue classes

[tgroh] Use AutoValue for BigQueryIO.Read

[tgroh] Use AutoValue for BigQueryIO.Write

[tgroh] Simplify configuration of StreamWithDedup

[tgroh] Replace BigQueryIO.Read.from() with BigQueryIO.read().from()

[tgroh] Replace BigQueryIO.Write.to() with BigQueryIO.write().to()

[jbonofre] [BEAM-1660] Update JdbcIO JavaDoc about withCoder() use to ensure the

[altay] [BEAM-547] Version should be accessed from pom file

[tgroh] Add Create.TimestampedValues.withType

[davor] Add ValueProvider options for DatastoreIO

[altay] Add ValueProvider class for FileBasedSource I/O Transforms

[davor] Increment shade-plugin version back to 3.0.0

--
[...truncated 1.62 MB...]
declare -x NODE_LABELS="beam beam2"
declare -x NODE_NAME="beam2"
declare -x OLDPWD
declare -x 
PATH="/home/jenkins/tools/java/latest1.7/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games"
declare -x 
PWD="
declare -x ROOT_BUILD_CAUSE="SCMTRIGGER"
declare -x ROOT_BUILD_CAUSE_SCMTRIGGER="true"
declare -x 
RUN_CHANGES_DISPLAY_URL="https://builds.apache.org/job/beam_PostCommit_Java_Version_Test/jdk=JDK%201.7%20(latest),label=beam/20/display/redirect?page=changes"
declare -x 
RUN_DISPLAY_URL="https://builds.apache.org/job/beam_PostCommit_Java_Version_Test/jdk=JDK%201.7%20(latest),label=beam/20/display/redirect"
declare -x SHELL="/bin/bash"
declare -x SHLVL="2"
declare -x SPARK_LOCAL_IP="127.0.0.1"
declare -x SSH_CLIENT="140.211.11.14 48418 22"
declare -x SSH_CONNECTION="140.211.11.14 48418 10.128.0.2 22"
declare -x USER="jenkins"
declare -x 
WORKSPACE="
declare -x XDG_RUNTIME_DIR="/run/user/9997"
declare -x XDG_SESSION_ID="68"
declare -x XFILESEARCHPATH="/usr/dt/app-defaults/%L/Dt"
declare -x jdk="JDK 1.7 (latest)"
declare -x label="beam"
declare -x sha1="master"
[beam] $ /home/jenkins/tools/maven/apache-maven-3.3.3/bin/mvn -f pom.xml 
-Dsha1=master "-Djdk=JDK 1.7 (latest)" -Dlabel=beam 
"-Dmaven.repo.local=
 -B -e -P dataflow-runner clean install -DskipITs=false 
'-DintegrationTestPipelineOptions=[ "--project=apache-beam-testing", 
"--tempRoot=gs://temp-storage-for-end-to-end-tests", 
"--runner=org.apache.beam.runners.dataflow.testing.TestDataflowRunner" ]'
/home/jenkins/tools/maven/apache-maven-3.3.3/bin/mvn: 200: local: 1.7: bad 
variable name
2017-03-15\T\20:39:05.104 [INFO] Error stacktraces are turned on.
2017-03-15\T\20:39:05.152 [INFO] Scanning for projects...
2017-03-15\T\20:39:05.369 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom
2017-03-15\T\20:39:05.661 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom (16 KB 
at 51.7 KB/sec)
2017-03-15\T\20:39:06.116 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/kr/motd/maven/os-maven-plugin/1.4.0.Final/os-maven-plugin-1.4.0.Final.pom
2017-03-15\T\20:39:06.148 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/kr/motd/maven/os-maven-plugin/1.4.0.Final/os-maven-plugin-1.4.0.Final.pom
 (7 KB at 188.9 KB/sec)
2017-03-15\T\20:39:06.152 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom
2017-03-15\T\20:39:06.184 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom
 (7 KB at 200.5 KB/sec)
2017-03-15\T\20:39:06.204 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.1/maven-plugin-api-3.2.1.pom
2017-03-15\T\20:39:06.234 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.1/maven-plugin-api-3.2.1.pom
 (4 KB at 110.1 KB/sec)
2017-03-15\T\20:39:06.236 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.1/maven-3.2.1.pom
2017-03-15\T\20:39:06.275 [INFO] Downloaded: 

Build failed in Jenkins: beam_PostCommit_Java_RunnableOnService_Spark #1250

2017-03-15 Thread Apache Jenkins Server
See 


Changes:

[davor] Increment shade-plugin version back to 3.0.0

--
Started by GitHub push by asfgit
[EnvInject] - Loading node environment variables.
Building remotely on beam3 (beam) in workspace 

 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
 > git --version # timeout=10
 > git fetch --tags --progress https://github.com/apache/beam.git 
 > +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*
ERROR: Error fetching remote repo 'origin'
hudson.plugins.git.GitException: Failed to fetch from 
https://github.com/apache/beam.git
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:806)
at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1070)
at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1101)
at hudson.scm.SCM.checkout(SCM.java:495)
at hudson.model.AbstractProject.checkout(AbstractProject.java:1278)
at 
hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:604)
at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86)
at 
hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:529)
at hudson.model.Run.execute(Run.java:1728)
at hudson.maven.MavenModuleSetBuild.run(MavenModuleSetBuild.java:544)
at hudson.model.ResourceController.execute(ResourceController.java:98)
at hudson.model.Executor.run(Executor.java:404)
Caused by: hudson.plugins.git.GitException: Command "git fetch --tags 
--progress https://github.com/apache/beam.git 
+refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*" 
returned status code 128:
stdout: 
stderr: fatal: unable to access 'https://github.com/apache/beam.git/': Failed 
to connect to github.com port 443: Connection timed out

at 
org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1793)
at 
org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1519)
at 
org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64)
at 
org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315)
at 
org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:153)
at 
org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:146)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at 
hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
at ..remote call to beam3(Native Method)
at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537)
at hudson.remoting.UserResponse.retrieve(UserRequest.java:253)
at hudson.remoting.Channel.call(Channel.java:822)
at 
org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146)
at sun.reflect.GeneratedMethodAccessor756.invoke(Unknown Source)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at 
org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132)
at com.sun.proxy.$Proxy81.execute(Unknown Source)
at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:804)
... 11 more
ERROR: null
Retrying after 10 seconds
 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
 > git --version # timeout=10
 > git fetch --tags --progress https://github.com/apache/beam.git 
 > +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*
 > git rev-parse origin/master^{commit} # timeout=10
Checking out Revision f8c6836ec7ab9b58af4297a30651410944b44a70 (origin/master)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f f8c6836ec7ab9b58af4297a30651410944b44a70
 > 

Build failed in Jenkins: beam_PostCommit_Java_RunnableOnService_Dataflow #2561

2017-03-15 Thread Apache Jenkins Server
See 


Changes:

[davor] Increment shade-plugin version back to 3.0.0

--
[...truncated 1.74 KB...]
maven33-interceptor.jar already up to date
maven3-interceptor-commons.jar already up to date
[beam_PostCommit_Java_RunnableOnService_Dataflow] $ 
/home/jenkins/tools/java/latest1.8/bin/java 
-Dorg.slf4j.simpleLogger.showDateTime=true 
-Dorg.slf4j.simpleLogger.dateTimeFormat=-MM-dd'T'HH:mm:ss.SSS 
-XX:+TieredCompilation -XX:TieredStopAtLevel=1 -cp 
/home/jenkins/jenkins-slave/maven33-agent.jar:/home/jenkins/tools/maven/apache-maven-3.3.3/boot/plexus-classworlds-2.5.2.jar:/home/jenkins/tools/maven/apache-maven-3.3.3/conf/logging
 jenkins.maven3.agent.Maven33Main /home/jenkins/tools/maven/apache-maven-3.3.3 
/home/jenkins/jenkins-slave/slave.jar 
/home/jenkins/jenkins-slave/maven33-interceptor.jar 
/home/jenkins/jenkins-slave/maven3-interceptor-commons.jar 46669
<===[JENKINS REMOTING CAPACITY]===>   channel started
Executing Maven:  -B -f 

 
-Dmaven.repo.local=
 -B -e clean verify -am -pl runners/google-cloud-dataflow-java -DforkCount=0 
-DrunnableOnServicePipelineOptions=[ 
"--runner=org.apache.beam.runners.dataflow.testing.TestDataflowRunner", 
"--project=apache-beam-testing", 
"--tempRoot=gs://temp-storage-for-runnable-on-service-tests/" ]
2017-03-15T20:35:41.527 [INFO] Error stacktraces are turned on.
2017-03-15T20:35:41.593 [INFO] Scanning for projects...
2017-03-15T20:35:42.202 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/kr/motd/maven/os-maven-plugin/1.4.0.Final/os-maven-plugin-1.4.0.Final.pom
2017-03-15T20:35:42.596 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/kr/motd/maven/os-maven-plugin/1.4.0.Final/os-maven-plugin-1.4.0.Final.pom
 (7 KB at 15.2 KB/sec)
2017-03-15T20:35:42.606 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom
2017-03-15T20:35:42.646 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom
 (7 KB at 160.4 KB/sec)
2017-03-15T20:35:42.656 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.1/maven-plugin-api-3.2.1.pom
2017-03-15T20:35:42.695 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.1/maven-plugin-api-3.2.1.pom
 (4 KB at 84.7 KB/sec)
2017-03-15T20:35:42.698 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.1/maven-3.2.1.pom
2017-03-15T20:35:42.754 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.1/maven-3.2.1.pom
 (23 KB at 393.9 KB/sec)
2017-03-15T20:35:42.758 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom
2017-03-15T20:35:42.801 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom
 (32 KB at 740.1 KB/sec)
2017-03-15T20:35:42.805 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom
2017-03-15T20:35:42.839 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom (14 KB 
at 401.4 KB/sec)
2017-03-15T20:35:42.846 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/apache/maven/maven-model/3.2.1/maven-model-3.2.1.pom
2017-03-15T20:35:42.877 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/apache/maven/maven-model/3.2.1/maven-model-3.2.1.pom
 (5 KB at 130.4 KB/sec)
2017-03-15T20:35:42.883 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.0.17/plexus-utils-3.0.17.pom
2017-03-15T20:35:42.916 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.0.17/plexus-utils-3.0.17.pom
 (4 KB at 100.5 KB/sec)
2017-03-15T20:35:42.918 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom
2017-03-15T20:35:42.957 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom
 (20 KB at 525.4 KB/sec)
2017-03-15T20:35:42.960 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom
2017-03-15T20:35:42.990 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom
 (7 KB at 220.0 KB/sec)
2017-03-15T20:35:42.993 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom
2017-03-15T20:35:43.025 [INFO] Downloaded: 
https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom
 (14 KB at 413.8 KB/sec)

Build failed in Jenkins: beam_PostCommit_Java_RunnableOnService_Apex #773

2017-03-15 Thread Apache Jenkins Server
See 


Changes:

[davor] Increment shade-plugin version back to 3.0.0

--
Started by GitHub push by asfgit
[EnvInject] - Loading node environment variables.
Building remotely on beam4 (beam) in workspace 

 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
 > git --version # timeout=10
 > git fetch --tags --progress https://github.com/apache/beam.git 
 > +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*
 > git rev-parse origin/master^{commit} # timeout=10
Checking out Revision f8c6836ec7ab9b58af4297a30651410944b44a70 (origin/master)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f f8c6836ec7ab9b58af4297a30651410944b44a70
 > git rev-list 49c29f1faebddebedb151013cc18c4c4f2237644 # timeout=10
Cleaning workspace
 > git rev-parse --verify HEAD # timeout=10
Resetting working tree
 > git reset --hard # timeout=10
 > git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the 
SCM step.
[EnvInject] - Injecting as environment variables the properties content 
SPARK_LOCAL_IP=127.0.0.1

[EnvInject] - Variables injected successfully.
Parsing POMs
Downloaded artifact 
http://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom
Modules changed, recalculating dependency graph
Established TCP socket on 43168
maven33-agent.jar already up to date
maven33-interceptor.jar already up to date
maven3-interceptor-commons.jar already up to date
[beam_PostCommit_Java_RunnableOnService_Apex] $ 
/home/jenkins/tools/java/latest1.8/bin/java 
-Dorg.slf4j.simpleLogger.showDateTime=true 
-Dorg.slf4j.simpleLogger.dateTimeFormat=-MM-dd'T'HH:mm:ss.SSS 
-XX:+TieredCompilation -XX:TieredStopAtLevel=1 -cp 
/home/jenkins/jenkins-slave/maven33-agent.jar:/home/jenkins/tools/maven/apache-maven-3.3.3/boot/plexus-classworlds-2.5.2.jar:/home/jenkins/tools/maven/apache-maven-3.3.3/conf/logging
 jenkins.maven3.agent.Maven33Main /home/jenkins/tools/maven/apache-maven-3.3.3 
/home/jenkins/jenkins-slave/slave.jar 
/home/jenkins/jenkins-slave/maven33-interceptor.jar 
/home/jenkins/jenkins-slave/maven3-interceptor-commons.jar 43168
<===[JENKINS REMOTING CAPACITY]===>   channel started
Executing Maven:  -B -f 

 
-Dmaven.repo.local=
 clean verify --projects runners/apex --also-make --batch-mode --errors 
--activate-profiles runnable-on-service-tests --activate-profiles 
local-runnable-on-service-tests
2017-03-15T20:35:20.486 [INFO] Error stacktraces are turned on.
2017-03-15T20:35:20.553 [INFO] Scanning for projects...
2017-03-15T20:35:21.182 [INFO] Downloading: 
https://repo.maven.apache.org/maven2/kr/motd/maven/os-maven-plugin/1.4.0.Final/os-maven-plugin-1.4.0.Final.pom
2017-03-15T20:37:28.662 [ERROR] [ERROR] Some problems were encountered while 
processing the POMs:
[WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be 
unique but found duplicate declaration of plugin 
org.codehaus.mojo:build-helper-maven-plugin @ line 1459, column 17
[ERROR] Unresolveable build extension: Plugin 
kr.motd.maven:os-maven-plugin:1.4.0.Final or one of its dependencies could not 
be resolved: Failed to read artifact descriptor for 
kr.motd.maven:os-maven-plugin:jar:1.4.0.Final @ 
 @ 
2017-03-15T20:37:28.665 [ERROR] The build could not read 1 project -> [Help 1]
2017-03-15T20:37:28.665 [ERROR]   
2017-03-15T20:37:28.665 [ERROR]   The project 
org.apache.beam:beam-parent:0.7.0-SNAPSHOT 
(
 has 1 error
2017-03-15T20:37:28.665 [ERROR] Unresolveable build extension: Plugin 
kr.motd.maven:os-maven-plugin:1.4.0.Final or one of its dependencies could not 
be resolved: Failed to read artifact descriptor for 
kr.motd.maven:os-maven-plugin:jar:1.4.0.Final: Could not transfer artifact 
kr.motd.maven:os-maven-plugin:pom:1.4.0.Final from/to central 
(https://repo.maven.apache.org/maven2): Connect to repo.maven.apache.org:443 
[repo.maven.apache.org/151.101.44.215] failed: Connection timed out (Connection 
timed out) -> [Help 2]
2017-03-15T20:37:28.665 [ERROR] 
2017-03-15T20:37:28.665 [ERROR] To see the full stack trace of the errors, 
re-run Maven with the -e switch.
2017-03-15T20:37:28.665 [ERROR] Re-run Maven using the -X switch to enable full 
debug logging.
2017-03-15T20:37:28.665 [ERROR] 
2017-03-15T20:37:28.665 [ERROR] For more information about the errors and 
possible solutions, 

[1/2] beam git commit: Increment shade-plugin version back to 3.0.0

2017-03-15 Thread davor
Repository: beam
Updated Branches:
  refs/heads/master 49c29f1fa -> f8c6836ec


Increment shade-plugin version back to 3.0.0


Project: http://git-wip-us.apache.org/repos/asf/beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/8f7c3208
Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/8f7c3208
Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/8f7c3208

Branch: refs/heads/master
Commit: 8f7c320846b598dc650a7b786182f7cecdd9c601
Parents: 49c29f1
Author: Aviem Zur 
Authored: Wed Mar 15 06:29:09 2017 +0200
Committer: Davor Bonaci 
Committed: Wed Mar 15 13:33:40 2017 -0700

--
 pom.xml | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)
--


http://git-wip-us.apache.org/repos/asf/beam/blob/8f7c3208/pom.xml
--
diff --git a/pom.xml b/pom.xml
index ca04ca0..3df7317 100644
--- a/pom.xml
+++ b/pom.xml
@@ -1317,7 +1317,7 @@
 
   org.apache.maven.plugins
   maven-shade-plugin
-  2.4.3
+  3.0.0
   
 
   bundle-and-repackage



[GitHub] beam pull request #2249: Increment shade-plugin version back to 3.0.0

2017-03-15 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/beam/pull/2249


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[2/2] beam git commit: This closes #2249

2017-03-15 Thread davor
This closes #2249


Project: http://git-wip-us.apache.org/repos/asf/beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/f8c6836e
Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/f8c6836e
Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/f8c6836e

Branch: refs/heads/master
Commit: f8c6836ec7ab9b58af4297a30651410944b44a70
Parents: 49c29f1 8f7c320
Author: Davor Bonaci 
Authored: Wed Mar 15 13:34:00 2017 -0700
Committer: Davor Bonaci 
Committed: Wed Mar 15 13:34:00 2017 -0700

--
 pom.xml | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)
--




[jira] [Commented] (BEAM-1730) Python post commits timing out

2017-03-15 Thread Sourabh Bajaj (JIRA)

[ 
https://issues.apache.org/jira/browse/BEAM-1730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15926928#comment-15926928
 ] 

Sourabh Bajaj commented on BEAM-1730:
-

Reverting the changes in the commit as this needs broader discussion.

> Python post commits timing out
> --
>
> Key: BEAM-1730
> URL: https://issues.apache.org/jira/browse/BEAM-1730
> Project: Beam
>  Issue Type: Bug
>  Components: sdk-py
>Reporter: Ahmet Altay
>Assignee: Sourabh Bajaj
>
> https://builds.apache.org/view/Beam/job/beam_PostCommit_Python_Verify/1514/
> Dataflow worker logs:
> https://pantheon.corp.google.com/logs/viewer?logName=projects%2Fapache-beam-testing%2Flogs%2Fdataflow.googleapis.com%252Fworker-startup=apache-beam-testing=dataflow_step%2Fjob_id%2F2017-03-15_10_30_20-1232538583050549167=0=false=2017-03-15T19:15:33.0Z
> Stack trace:
> I  Executing: /usr/bin/python -m dataflow_worker.start 
> -Djob_id=2017-03-15_10_30_20-1232538583050549167 
> -Dproject_id=apache-beam-testing -Dreporting_enabled=True 
> -Droot_url=https://dataflow.googleapis.com 
> -Dservice_path=https://dataflow.googleapis.com/ 
> -Dtemp_gcs_directory=gs://unused 
> -Dworker_id=py-validatesrunner-148959-03151030-f51b-harness-t79h 
> -Ddataflow.worker.logging.location=/var/log/dataflow/python-dataflow-0-json.log
>  -Dlocal_staging_directory=/var/opt/google/dataflow 
> -Dsdk_pipeline_options={"display_data":[{"key":"requirements_file","namespace":"apache_beam.utils.pipeline_options.PipelineOptions","type":"STRING","value":"postcommit_requirements.txt"},{"key":"sdk_location","namespace":"apache_beam.utils.pipeline_options.PipelineOptions","type":"STRING","value":"dist/apache-beam-0.7.0.dev0.tar.gz"},{"key":"num_workers","namespace":"apache_beam.utils.pipeline_options.PipelineOptions","type":"INTEGER","value":1},{"key":"runner","namespace":"apache_beam.utils.pipeline_options.PipelineOptions","type":"STRING","value":"TestDataflowRunner"},{"key":"staging_location","namespace":"apache_beam.utils.pipeline_options.PipelineOptions","type":"STRING","value":"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/py-validatesrunner-1489599007.1489599009.190097"},{"key":"project","namespace":"apache_beam.utils.pipeline_options.PipelineOptions","type":"STRING","value":"apache-beam-testing"},{"key":"temp_location","namespace":"apache_beam.utils.pipeline_options.PipelineOptions","type":"STRING","value":"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/py-validatesrunner-1489599007.1489599009.190097"},{"key":"job_name","namespace":"apache_beam.utils.pipeline_options.PipelineOptions","type":"STRING","value":"py-validatesrunner-1489599007"}],"options":{"autoscalingAlgorithm":"NONE","dataflowJobId":"2017-03-15_10_30_20-1232538583050549167","dataflow_endpoint":"https://dataflow.googleapis.com","direct_runner_use_stacked_bundle":true,"gcpTempLocation":"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/py-validatesrunner-1489599007.1489599009.190097","job_name":"py-validatesrunner-1489599007","male":false,"maxNumWorkers":0,"mock_flag":false,"no_auth":false,"numWorkers":1,"num_workers":1,"pipeline_type_check":true,"profile_cpu":false,"profile_memory":false,"project":"apache-beam-testing","requirements_file":"postcommit_requirements.txt","runner":"TestDataflowRunner","runtime_type_check":false,"save_main_session":false,"sdk_location":"dist/apache-beam-0.7.0.dev0.tar.gz","staging_location":"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/py-validatesrunner-1489599007.1489599009.190097","streaming":false,"style":"scrambled","temp_location":"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/py-validatesrunner-1489599007.1489599009.190097","type_check_strictness":"DEFAULT_TO_ANY"}}
>  
> I  Traceback (most recent call last): 
> IFile "/usr/lib/python2.7/runpy.py", line 162, in _run_module_as_main 
> I   
> I  "__main__", fname, loader, pkg_name) 
> IFile "/usr/lib/python2.7/runpy.py", line 72, in _run_code 
> I   
> I  exec code in run_globals 
> IFile "/usr/local/lib/python2.7/dist-packages/dataflow_worker/start.py", 
> line 26, in  
> I   
> I  from dataflow_worker import batchworker 
> IFile 
> "/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 
> 51, in  
> I   
> I  from apache_beam.internal import pickler 
> IFile "/usr/local/lib/python2.7/dist-packages/apache_beam/__init__.py", 
> line 85, in  
> I   
> I  __version__ = version.get_version() 
> IFile "/usr/local/lib/python2.7/dist-packages/apache_beam/version.py", 
> line 30, in get_version 
> I   
> I  __version__ = get_version_from_pom() 
> IFile "/usr/local/lib/python2.7/dist-packages/apache_beam/version.py", 
> line 36, in get_version_from_pom 
> I   
> I  with open('pom.xml', 'r') 

Build failed in Jenkins: beam_PostCommit_Java_RunnableOnService_Dataflow #2560

2017-03-15 Thread Apache Jenkins Server
See 


Changes:

[altay] Add ValueProvider class for FileBasedSource I/O Transforms

--
Started by GitHub push by asfgit
[EnvInject] - Loading node environment variables.
Building remotely on beam7 (beam) in workspace 

 > git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10
Fetching upstream changes from https://github.com/apache/beam.git
 > git --version # timeout=10
 > git fetch --tags --progress https://github.com/apache/beam.git 
 > +refs/heads/*:refs/remotes/origin/* +refs/pull/*:refs/remotes/origin/pr/*
 > git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 49c29f1faebddebedb151013cc18c4c4f2237644 (origin/master)
 > git config core.sparsecheckout # timeout=10
 > git checkout -f 49c29f1faebddebedb151013cc18c4c4f2237644
 > git rev-list 04c6ef4c74d47b9858c6dce088ce8b8d1d34c7db # timeout=10
Cleaning workspace
 > git rev-parse --verify HEAD # timeout=10
Resetting working tree
 > git reset --hard # timeout=10
 > git clean -fdx # timeout=10
[EnvInject] - Executing scripts and injecting environment variables after the 
SCM step.
[EnvInject] - Injecting as environment variables the properties content 
SPARK_LOCAL_IP=127.0.0.1

[EnvInject] - Variables injected successfully.
Parsing POMs
Failed to transfer Could not transfer artifact org.apache:apache:pom:18 from/to 
central (http://repo.maven.apache.org/maven2): Connect to 
repo.maven.apache.org:80 [repo.maven.apache.org/151.101.44.215] failed: 
Connection timed out
ERROR: Failed to parse POMs
java.io.IOException: remote file operation failed: 

 at hudson.remoting.Channel@7219e5d6:beam7: hudson.remoting.ProxyException: 
hudson.maven.MavenModuleSetBuild$MavenExecutionException: 
org.apache.maven.project.ProjectBuildingException: Some problems were 
encountered while processing the POMs:
[WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be 
unique but found duplicate declaration of plugin 
org.codehaus.mojo:build-helper-maven-plugin @ line 1459, column 17
[FATAL] Non-resolvable parent POM: Could not transfer artifact 
org.apache:apache:pom:18 from/to central (http://repo.maven.apache.org/maven2): 
Connect to repo.maven.apache.org:80 [repo.maven.apache.org/151.101.44.215] 
failed: Connection timed out and 'parent.relativePath' points at wrong local 
POM @ line 22, column 11

at hudson.FilePath.act(FilePath.java:992)
at hudson.FilePath.act(FilePath.java:974)
at 
hudson.maven.MavenModuleSetBuild$MavenModuleSetBuildExecution.parsePoms(MavenModuleSetBuild.java:980)
at 
hudson.maven.MavenModuleSetBuild$MavenModuleSetBuildExecution.doRun(MavenModuleSetBuild.java:692)
at 
hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:534)
at hudson.model.Run.execute(Run.java:1728)
at hudson.maven.MavenModuleSetBuild.run(MavenModuleSetBuild.java:544)
at hudson.model.ResourceController.execute(ResourceController.java:98)
at hudson.model.Executor.run(Executor.java:404)
Caused by: hudson.remoting.ProxyException: 
hudson.maven.MavenModuleSetBuild$MavenExecutionException: 
org.apache.maven.project.ProjectBuildingException: Some problems were 
encountered while processing the POMs:
[WARNING] 'build.pluginManagement.plugins.plugin.(groupId:artifactId)' must be 
unique but found duplicate declaration of plugin 
org.codehaus.mojo:build-helper-maven-plugin @ line 1459, column 17
[FATAL] Non-resolvable parent POM: Could not transfer artifact 
org.apache:apache:pom:18 from/to central (http://repo.maven.apache.org/maven2): 
Connect to repo.maven.apache.org:80 [repo.maven.apache.org/151.101.44.215] 
failed: Connection timed out and 'parent.relativePath' points at wrong local 
POM @ line 22, column 11

at 
hudson.maven.MavenModuleSetBuild$PomParser.invoke(MavenModuleSetBuild.java:1384)
at 
hudson.maven.MavenModuleSetBuild$PomParser.invoke(MavenModuleSetBuild.java:1118)
at hudson.FilePath$FileCallableWrapper.call(FilePath.java:2731)
at hudson.remoting.UserRequest.perform(UserRequest.java:153)
at hudson.remoting.UserRequest.perform(UserRequest.java:50)
at hudson.remoting.Request$2.run(Request.java:336)
at 
hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at 

[jira] [Commented] (BEAM-547) Align Python SDK version with Maven

2017-03-15 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/BEAM-547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15926845#comment-15926845
 ] 

ASF GitHub Bot commented on BEAM-547:
-

GitHub user sb2nov opened a pull request:

https://github.com/apache/beam/pull/2250

Revert "[BEAM-547] Version should be accessed from pom file"

This reverts commit b43eea47e3b1e842bc28543679500452ceda5a33.

Be sure to do all of the following to help us incorporate your contribution
quickly and easily:

 - [ ] Make sure the PR title is formatted like:
   `[BEAM-] Description of pull request`
 - [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable
   Travis-CI on your fork and ensure the whole test matrix passes).
 - [ ] Replace `` in the title with the actual Jira issue
   number, if there is one.
 - [ ] If this contribution is large, please file an Apache
   [Individual Contributor License 
Agreement](https://www.apache.org/licenses/icla.txt).

---

R: @aaltay PTAL 

Reverting the change while I fix the postcommits

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/sb2nov/beam BEAM-1730-revert-version-issue

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/beam/pull/2250.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #2250


commit 82f0d465c54c6a8cbc21e7b7f528da63e9713436
Author: Sourabh Bajaj 
Date:   2017-03-15T19:51:46Z

Revert "[BEAM-547] Version should be accessed from pom file"

This reverts commit b43eea47e3b1e842bc28543679500452ceda5a33.




> Align Python SDK version with Maven
> ---
>
> Key: BEAM-547
> URL: https://issues.apache.org/jira/browse/BEAM-547
> Project: Beam
>  Issue Type: New Feature
>  Components: sdk-py
>Affects Versions: 0.3.0-incubating
>Reporter: Sergio Fernández
>Assignee: Frances Perry
>Priority: Minor
>   Original Estimate: 24h
>  Remaining Estimate: 24h
>
> In BEAM-378 we've integrated the Python SDK in the main Maven build. 
> Initially I wanted to also align versions, but after discussing it with 
> [~silv...@google.com] we kept that aside for the moment. 
> Closing [PR #537|https://github.com/apache/incubator-beam/pull/537] [~altay] 
> brings the issue back. So it may make sense to revisit that idea.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #2916

2017-03-15 Thread Apache Jenkins Server
See 




[GitHub] beam pull request #2250: Revert "[BEAM-547] Version should be accessed from ...

2017-03-15 Thread sb2nov
GitHub user sb2nov opened a pull request:

https://github.com/apache/beam/pull/2250

Revert "[BEAM-547] Version should be accessed from pom file"

This reverts commit b43eea47e3b1e842bc28543679500452ceda5a33.

Be sure to do all of the following to help us incorporate your contribution
quickly and easily:

 - [ ] Make sure the PR title is formatted like:
   `[BEAM-] Description of pull request`
 - [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable
   Travis-CI on your fork and ensure the whole test matrix passes).
 - [ ] Replace `` in the title with the actual Jira issue
   number, if there is one.
 - [ ] If this contribution is large, please file an Apache
   [Individual Contributor License 
Agreement](https://www.apache.org/licenses/icla.txt).

---

R: @aaltay PTAL 

Reverting the change while I fix the postcommits

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/sb2nov/beam BEAM-1730-revert-version-issue

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/beam/pull/2250.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #2250


commit 82f0d465c54c6a8cbc21e7b7f528da63e9713436
Author: Sourabh Bajaj 
Date:   2017-03-15T19:51:46Z

Revert "[BEAM-547] Version should be accessed from pom file"

This reverts commit b43eea47e3b1e842bc28543679500452ceda5a33.




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


Build failed in Jenkins: beam_PostCommit_Java_Version_Test » JDK 1.7 (latest),beam #19

2017-03-15 Thread Apache Jenkins Server
See 


Changes:

[aljoscha.krettek] [BEAM-1689] Apply changes for Flink's StatefulDoFnRunner to 
the primary

[tgroh] Stop Double-finalizing checkpoints in the DirectRunner

[tgroh] Prevent Double-Close in UnboundedReadEvaluatorFactory

[altay] [BEAM-1694] Fix docstring inaccuracies in Python-SDK

[davor] [BEAM-1092] Shade commonly used libraries (e.g. Guava) to avoid class

[davor] [BEAM-1092] Replace hyphens in artifactId with dots in shading

[tgroh] Remove two unused fields

[tgroh] Condense BigQueryIO.Read.Bound into BigQueryIO.Read

[tgroh] Condense BigQueryIO.Write.Bound into BigQueryIO.Write

[tgroh] Makes NameUtils recognize AutoValue classes

[tgroh] Use AutoValue for BigQueryIO.Read

[tgroh] Use AutoValue for BigQueryIO.Write

[tgroh] Simplify configuration of StreamWithDedup

[tgroh] Replace BigQueryIO.Read.from() with BigQueryIO.read().from()

[tgroh] Replace BigQueryIO.Write.to() with BigQueryIO.write().to()

[jbonofre] [BEAM-1660] Update JdbcIO JavaDoc about withCoder() use to ensure the

[altay] [BEAM-547] Version should be accessed from pom file

[tgroh] Add Create.TimestampedValues.withType

[davor] Add ValueProvider options for DatastoreIO

[altay] Add ValueProvider class for FileBasedSource I/O Transforms

[markliu] fixup! add env inspecting command and clean maven command

--
[...truncated 2.07 MB...]
Running org.apache.beam.sdk.transforms.MaxTest
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.transforms.MaxTest
Running org.apache.beam.sdk.transforms.ParDoTest
Tests run: 14, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.132 sec - in 
org.apache.beam.sdk.transforms.ParDoTest
Running org.apache.beam.sdk.transforms.CreateTest
Tests run: 16, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.319 sec - in 
org.apache.beam.sdk.transforms.CreateTest
Running org.apache.beam.sdk.transforms.CombineTest
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.016 sec - in 
org.apache.beam.sdk.transforms.CombineTest
Running org.apache.beam.sdk.util.VarIntTest
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.004 sec - in 
org.apache.beam.sdk.util.VarIntTest
Running org.apache.beam.sdk.util.StructsTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec - in 
org.apache.beam.sdk.util.StructsTest
Running org.apache.beam.sdk.util.StreamUtilsTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec - in 
org.apache.beam.sdk.util.StreamUtilsTest
Running org.apache.beam.sdk.util.PubsubTestClientTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec - in 
org.apache.beam.sdk.util.PubsubTestClientTest
Running org.apache.beam.sdk.util.StringUtilsTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.StringUtilsTest
Running org.apache.beam.sdk.util.MutationDetectorsTest
Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.004 sec - in 
org.apache.beam.sdk.util.MutationDetectorsTest
Running org.apache.beam.sdk.util.ValueWithRecordIdTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.004 sec - in 
org.apache.beam.sdk.util.ValueWithRecordIdTest
Running org.apache.beam.sdk.util.ExposedByteArrayOutputStreamTest
Tests run: 24, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec - in 
org.apache.beam.sdk.util.ExposedByteArrayOutputStreamTest
Running org.apache.beam.sdk.util.GcsIOChannelFactoryRegistrarTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.GcsIOChannelFactoryRegistrarTest
Running org.apache.beam.sdk.util.GcpProjectUtilTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.059 sec - in 
org.apache.beam.sdk.util.GcpProjectUtilTest
Running org.apache.beam.sdk.util.ZipFilesTest
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.014 sec - in 
org.apache.beam.sdk.util.ZipFilesTest
Running org.apache.beam.sdk.util.GcsIOChannelFactoryTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.GcsIOChannelFactoryTest
Running org.apache.beam.sdk.util.ApiSurfaceTest
Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.008 sec - in 
org.apache.beam.sdk.util.ApiSurfaceTest
Running org.apache.beam.sdk.util.PubsubClientTest
Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.043 sec - in 
org.apache.beam.sdk.util.PubsubClientTest
Running org.apache.beam.sdk.util.UnownedInputStreamTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.UnownedInputStreamTest
Running org.apache.beam.sdk.util.FileIOChannelFactoryTest
Tests run: 18, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.012 sec - in 

Build failed in Jenkins: beam_PostCommit_Java_Version_Test » OpenJDK 8 (on Ubuntu only),beam #19

2017-03-15 Thread Apache Jenkins Server
See 


Changes:

[aljoscha.krettek] [BEAM-1689] Apply changes for Flink's StatefulDoFnRunner to 
the primary

[tgroh] Stop Double-finalizing checkpoints in the DirectRunner

[tgroh] Prevent Double-Close in UnboundedReadEvaluatorFactory

[altay] [BEAM-1694] Fix docstring inaccuracies in Python-SDK

[davor] [BEAM-1092] Shade commonly used libraries (e.g. Guava) to avoid class

[davor] [BEAM-1092] Replace hyphens in artifactId with dots in shading

[tgroh] Remove two unused fields

[tgroh] Condense BigQueryIO.Read.Bound into BigQueryIO.Read

[tgroh] Condense BigQueryIO.Write.Bound into BigQueryIO.Write

[tgroh] Makes NameUtils recognize AutoValue classes

[tgroh] Use AutoValue for BigQueryIO.Read

[tgroh] Use AutoValue for BigQueryIO.Write

[tgroh] Simplify configuration of StreamWithDedup

[tgroh] Replace BigQueryIO.Read.from() with BigQueryIO.read().from()

[tgroh] Replace BigQueryIO.Write.to() with BigQueryIO.write().to()

[jbonofre] [BEAM-1660] Update JdbcIO JavaDoc about withCoder() use to ensure the

[altay] [BEAM-547] Version should be accessed from pom file

[tgroh] Add Create.TimestampedValues.withType

[davor] Add ValueProvider options for DatastoreIO

[altay] Add ValueProvider class for FileBasedSource I/O Transforms

[markliu] fixup! add env inspecting command and clean maven command

--
[...truncated 2.08 MB...]
Running org.apache.beam.sdk.transforms.MaxTest
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.005 sec - in 
org.apache.beam.sdk.transforms.MaxTest
Running org.apache.beam.sdk.transforms.ParDoTest
Tests run: 14, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.086 sec - in 
org.apache.beam.sdk.transforms.ParDoTest
Running org.apache.beam.sdk.transforms.CreateTest
Tests run: 16, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.271 sec - in 
org.apache.beam.sdk.transforms.CreateTest
Running org.apache.beam.sdk.transforms.CombineTest
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.017 sec - in 
org.apache.beam.sdk.transforms.CombineTest
Running org.apache.beam.sdk.util.VarIntTest
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.004 sec - in 
org.apache.beam.sdk.util.VarIntTest
Running org.apache.beam.sdk.util.StructsTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec - in 
org.apache.beam.sdk.util.StructsTest
Running org.apache.beam.sdk.util.StreamUtilsTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.004 sec - in 
org.apache.beam.sdk.util.StreamUtilsTest
Running org.apache.beam.sdk.util.PubsubTestClientTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec - in 
org.apache.beam.sdk.util.PubsubTestClientTest
Running org.apache.beam.sdk.util.StringUtilsTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.StringUtilsTest
Running org.apache.beam.sdk.util.MutationDetectorsTest
Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.004 sec - in 
org.apache.beam.sdk.util.MutationDetectorsTest
Running org.apache.beam.sdk.util.ValueWithRecordIdTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.004 sec - in 
org.apache.beam.sdk.util.ValueWithRecordIdTest
Running org.apache.beam.sdk.util.ExposedByteArrayOutputStreamTest
Tests run: 24, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec - in 
org.apache.beam.sdk.util.ExposedByteArrayOutputStreamTest
Running org.apache.beam.sdk.util.GcsIOChannelFactoryRegistrarTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.GcsIOChannelFactoryRegistrarTest
Running org.apache.beam.sdk.util.GcpProjectUtilTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.056 sec - in 
org.apache.beam.sdk.util.GcpProjectUtilTest
Running org.apache.beam.sdk.util.ZipFilesTest
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.013 sec - in 
org.apache.beam.sdk.util.ZipFilesTest
Running org.apache.beam.sdk.util.GcsIOChannelFactoryTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.GcsIOChannelFactoryTest
Running org.apache.beam.sdk.util.ApiSurfaceTest
Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.009 sec - in 
org.apache.beam.sdk.util.ApiSurfaceTest
Running org.apache.beam.sdk.util.PubsubClientTest
Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.008 sec - in 
org.apache.beam.sdk.util.PubsubClientTest
Running org.apache.beam.sdk.util.UnownedInputStreamTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.UnownedInputStreamTest
Running org.apache.beam.sdk.util.FileIOChannelFactoryTest
Tests run: 18, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.011 

Build failed in Jenkins: beam_PostCommit_Java_Version_Test » JDK 1.8 (latest),beam #19

2017-03-15 Thread Apache Jenkins Server
See 


Changes:

[aljoscha.krettek] [BEAM-1689] Apply changes for Flink's StatefulDoFnRunner to 
the primary

[tgroh] Stop Double-finalizing checkpoints in the DirectRunner

[tgroh] Prevent Double-Close in UnboundedReadEvaluatorFactory

[altay] [BEAM-1694] Fix docstring inaccuracies in Python-SDK

[davor] [BEAM-1092] Shade commonly used libraries (e.g. Guava) to avoid class

[davor] [BEAM-1092] Replace hyphens in artifactId with dots in shading

[tgroh] Remove two unused fields

[tgroh] Condense BigQueryIO.Read.Bound into BigQueryIO.Read

[tgroh] Condense BigQueryIO.Write.Bound into BigQueryIO.Write

[tgroh] Makes NameUtils recognize AutoValue classes

[tgroh] Use AutoValue for BigQueryIO.Read

[tgroh] Use AutoValue for BigQueryIO.Write

[tgroh] Simplify configuration of StreamWithDedup

[tgroh] Replace BigQueryIO.Read.from() with BigQueryIO.read().from()

[tgroh] Replace BigQueryIO.Write.to() with BigQueryIO.write().to()

[jbonofre] [BEAM-1660] Update JdbcIO JavaDoc about withCoder() use to ensure the

[altay] [BEAM-547] Version should be accessed from pom file

[tgroh] Add Create.TimestampedValues.withType

[davor] Add ValueProvider options for DatastoreIO

[altay] Add ValueProvider class for FileBasedSource I/O Transforms

[markliu] fixup! add env inspecting command and clean maven command

--
[...truncated 2.07 MB...]
Running org.apache.beam.sdk.transforms.CreateTest
Tests run: 16, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.263 sec - in 
org.apache.beam.sdk.transforms.CreateTest
Running org.apache.beam.sdk.transforms.CombineTest
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.015 sec - in 
org.apache.beam.sdk.transforms.CombineTest
Running org.apache.beam.sdk.util.VarIntTest
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec - in 
org.apache.beam.sdk.util.VarIntTest
Running org.apache.beam.sdk.util.StructsTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.StructsTest
Running org.apache.beam.sdk.util.StreamUtilsTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec - in 
org.apache.beam.sdk.util.StreamUtilsTest
Running org.apache.beam.sdk.util.PubsubTestClientTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.PubsubTestClientTest
Running org.apache.beam.sdk.util.StringUtilsTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.StringUtilsTest
Running org.apache.beam.sdk.util.MutationDetectorsTest
Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec - in 
org.apache.beam.sdk.util.MutationDetectorsTest
Running org.apache.beam.sdk.util.ValueWithRecordIdTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec - in 
org.apache.beam.sdk.util.ValueWithRecordIdTest
Running org.apache.beam.sdk.util.ExposedByteArrayOutputStreamTest
Tests run: 24, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.ExposedByteArrayOutputStreamTest
Running org.apache.beam.sdk.util.GcsIOChannelFactoryRegistrarTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.GcsIOChannelFactoryRegistrarTest
Running org.apache.beam.sdk.util.GcpProjectUtilTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.055 sec - in 
org.apache.beam.sdk.util.GcpProjectUtilTest
Running org.apache.beam.sdk.util.ZipFilesTest
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.044 sec - in 
org.apache.beam.sdk.util.ZipFilesTest
Running org.apache.beam.sdk.util.GcsIOChannelFactoryTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.GcsIOChannelFactoryTest
Running org.apache.beam.sdk.util.ApiSurfaceTest
Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.016 sec - in 
org.apache.beam.sdk.util.ApiSurfaceTest
Running org.apache.beam.sdk.util.PubsubClientTest
Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.012 sec - in 
org.apache.beam.sdk.util.PubsubClientTest
Running org.apache.beam.sdk.util.UnownedInputStreamTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec - in 
org.apache.beam.sdk.util.UnownedInputStreamTest
Running org.apache.beam.sdk.util.FileIOChannelFactoryTest
Tests run: 18, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.015 sec - in 
org.apache.beam.sdk.util.FileIOChannelFactoryTest
Running org.apache.beam.sdk.util.ReleaseInfoTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec - in 
org.apache.beam.sdk.util.ReleaseInfoTest
Running org.apache.beam.sdk.util.WindowedValueTest
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.014 sec - in 

Build failed in Jenkins: beam_PostCommit_Java_Version_Test » OpenJDK 7 (on Ubuntu only),beam #19

2017-03-15 Thread Apache Jenkins Server
See 


Changes:

[aljoscha.krettek] [BEAM-1689] Apply changes for Flink's StatefulDoFnRunner to 
the primary

[tgroh] Stop Double-finalizing checkpoints in the DirectRunner

[tgroh] Prevent Double-Close in UnboundedReadEvaluatorFactory

[altay] [BEAM-1694] Fix docstring inaccuracies in Python-SDK

[davor] [BEAM-1092] Shade commonly used libraries (e.g. Guava) to avoid class

[davor] [BEAM-1092] Replace hyphens in artifactId with dots in shading

[tgroh] Remove two unused fields

[tgroh] Condense BigQueryIO.Read.Bound into BigQueryIO.Read

[tgroh] Condense BigQueryIO.Write.Bound into BigQueryIO.Write

[tgroh] Makes NameUtils recognize AutoValue classes

[tgroh] Use AutoValue for BigQueryIO.Read

[tgroh] Use AutoValue for BigQueryIO.Write

[tgroh] Simplify configuration of StreamWithDedup

[tgroh] Replace BigQueryIO.Read.from() with BigQueryIO.read().from()

[tgroh] Replace BigQueryIO.Write.to() with BigQueryIO.write().to()

[jbonofre] [BEAM-1660] Update JdbcIO JavaDoc about withCoder() use to ensure the

[altay] [BEAM-547] Version should be accessed from pom file

[tgroh] Add Create.TimestampedValues.withType

[davor] Add ValueProvider options for DatastoreIO

[altay] Add ValueProvider class for FileBasedSource I/O Transforms

[markliu] fixup! add env inspecting command and clean maven command

--
[...truncated 2.07 MB...]
Running org.apache.beam.sdk.transforms.MaxTest
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec - in 
org.apache.beam.sdk.transforms.MaxTest
Running org.apache.beam.sdk.transforms.ParDoTest
Tests run: 14, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.103 sec - in 
org.apache.beam.sdk.transforms.ParDoTest
Running org.apache.beam.sdk.transforms.CreateTest
Tests run: 16, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.272 sec - in 
org.apache.beam.sdk.transforms.CreateTest
Running org.apache.beam.sdk.transforms.CombineTest
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.012 sec - in 
org.apache.beam.sdk.transforms.CombineTest
Running org.apache.beam.sdk.util.VarIntTest
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.005 sec - in 
org.apache.beam.sdk.util.VarIntTest
Running org.apache.beam.sdk.util.StructsTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec - in 
org.apache.beam.sdk.util.StructsTest
Running org.apache.beam.sdk.util.StreamUtilsTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec - in 
org.apache.beam.sdk.util.StreamUtilsTest
Running org.apache.beam.sdk.util.PubsubTestClientTest
Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec - in 
org.apache.beam.sdk.util.PubsubTestClientTest
Running org.apache.beam.sdk.util.StringUtilsTest
Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.StringUtilsTest
Running org.apache.beam.sdk.util.MutationDetectorsTest
Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.004 sec - in 
org.apache.beam.sdk.util.MutationDetectorsTest
Running org.apache.beam.sdk.util.ValueWithRecordIdTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec - in 
org.apache.beam.sdk.util.ValueWithRecordIdTest
Running org.apache.beam.sdk.util.ExposedByteArrayOutputStreamTest
Tests run: 24, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec - in 
org.apache.beam.sdk.util.ExposedByteArrayOutputStreamTest
Running org.apache.beam.sdk.util.GcsIOChannelFactoryRegistrarTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.GcsIOChannelFactoryRegistrarTest
Running org.apache.beam.sdk.util.GcpProjectUtilTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.051 sec - in 
org.apache.beam.sdk.util.GcpProjectUtilTest
Running org.apache.beam.sdk.util.ZipFilesTest
Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.011 sec - in 
org.apache.beam.sdk.util.ZipFilesTest
Running org.apache.beam.sdk.util.GcsIOChannelFactoryTest
Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.GcsIOChannelFactoryTest
Running org.apache.beam.sdk.util.ApiSurfaceTest
Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.007 sec - in 
org.apache.beam.sdk.util.ApiSurfaceTest
Running org.apache.beam.sdk.util.PubsubClientTest
Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.008 sec - in 
org.apache.beam.sdk.util.PubsubClientTest
Running org.apache.beam.sdk.util.UnownedInputStreamTest
Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec - in 
org.apache.beam.sdk.util.UnownedInputStreamTest
Running org.apache.beam.sdk.util.FileIOChannelFactoryTest
Tests run: 18, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.011 

[jira] [Created] (BEAM-1730) Python post commits timing out

2017-03-15 Thread Ahmet Altay (JIRA)
Ahmet Altay created BEAM-1730:
-

 Summary: Python post commits timing out
 Key: BEAM-1730
 URL: https://issues.apache.org/jira/browse/BEAM-1730
 Project: Beam
  Issue Type: Bug
  Components: sdk-py
Reporter: Ahmet Altay
Assignee: Sourabh Bajaj


https://builds.apache.org/view/Beam/job/beam_PostCommit_Python_Verify/1514/

Dataflow worker logs:
https://pantheon.corp.google.com/logs/viewer?logName=projects%2Fapache-beam-testing%2Flogs%2Fdataflow.googleapis.com%252Fworker-startup=apache-beam-testing=dataflow_step%2Fjob_id%2F2017-03-15_10_30_20-1232538583050549167=0=false=2017-03-15T19:15:33.0Z

Stack trace:
I  Executing: /usr/bin/python -m dataflow_worker.start 
-Djob_id=2017-03-15_10_30_20-1232538583050549167 
-Dproject_id=apache-beam-testing -Dreporting_enabled=True 
-Droot_url=https://dataflow.googleapis.com 
-Dservice_path=https://dataflow.googleapis.com/ 
-Dtemp_gcs_directory=gs://unused 
-Dworker_id=py-validatesrunner-148959-03151030-f51b-harness-t79h 
-Ddataflow.worker.logging.location=/var/log/dataflow/python-dataflow-0-json.log 
-Dlocal_staging_directory=/var/opt/google/dataflow 
-Dsdk_pipeline_options={"display_data":[{"key":"requirements_file","namespace":"apache_beam.utils.pipeline_options.PipelineOptions","type":"STRING","value":"postcommit_requirements.txt"},{"key":"sdk_location","namespace":"apache_beam.utils.pipeline_options.PipelineOptions","type":"STRING","value":"dist/apache-beam-0.7.0.dev0.tar.gz"},{"key":"num_workers","namespace":"apache_beam.utils.pipeline_options.PipelineOptions","type":"INTEGER","value":1},{"key":"runner","namespace":"apache_beam.utils.pipeline_options.PipelineOptions","type":"STRING","value":"TestDataflowRunner"},{"key":"staging_location","namespace":"apache_beam.utils.pipeline_options.PipelineOptions","type":"STRING","value":"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/py-validatesrunner-1489599007.1489599009.190097"},{"key":"project","namespace":"apache_beam.utils.pipeline_options.PipelineOptions","type":"STRING","value":"apache-beam-testing"},{"key":"temp_location","namespace":"apache_beam.utils.pipeline_options.PipelineOptions","type":"STRING","value":"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/py-validatesrunner-1489599007.1489599009.190097"},{"key":"job_name","namespace":"apache_beam.utils.pipeline_options.PipelineOptions","type":"STRING","value":"py-validatesrunner-1489599007"}],"options":{"autoscalingAlgorithm":"NONE","dataflowJobId":"2017-03-15_10_30_20-1232538583050549167","dataflow_endpoint":"https://dataflow.googleapis.com","direct_runner_use_stacked_bundle":true,"gcpTempLocation":"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/py-validatesrunner-1489599007.1489599009.190097","job_name":"py-validatesrunner-1489599007","male":false,"maxNumWorkers":0,"mock_flag":false,"no_auth":false,"numWorkers":1,"num_workers":1,"pipeline_type_check":true,"profile_cpu":false,"profile_memory":false,"project":"apache-beam-testing","requirements_file":"postcommit_requirements.txt","runner":"TestDataflowRunner","runtime_type_check":false,"save_main_session":false,"sdk_location":"dist/apache-beam-0.7.0.dev0.tar.gz","staging_location":"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/py-validatesrunner-1489599007.1489599009.190097","streaming":false,"style":"scrambled","temp_location":"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/py-validatesrunner-1489599007.1489599009.190097","type_check_strictness":"DEFAULT_TO_ANY"}}
 
I  Traceback (most recent call last): 
IFile "/usr/lib/python2.7/runpy.py", line 162, in _run_module_as_main 
I   
I  "__main__", fname, loader, pkg_name) 
IFile "/usr/lib/python2.7/runpy.py", line 72, in _run_code 
I   
I  exec code in run_globals 
IFile "/usr/local/lib/python2.7/dist-packages/dataflow_worker/start.py", 
line 26, in  
I   
I  from dataflow_worker import batchworker 
IFile 
"/usr/local/lib/python2.7/dist-packages/dataflow_worker/batchworker.py", line 
51, in  
I   
I  from apache_beam.internal import pickler 
IFile "/usr/local/lib/python2.7/dist-packages/apache_beam/__init__.py", 
line 85, in  
I   
I  __version__ = version.get_version() 
IFile "/usr/local/lib/python2.7/dist-packages/apache_beam/version.py", line 
30, in get_version 
I   
I  __version__ = get_version_from_pom() 
IFile "/usr/local/lib/python2.7/dist-packages/apache_beam/version.py", line 
36, in get_version_from_pom 
I   
I  with open('pom.xml', 'r') as f: 
I  IOError 
I
I  [Errno 2] No such file or directory: 'pom.xml' 




--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Created] (BEAM-1729) Make Jenkins timeouts a failure

2017-03-15 Thread Ahmet Altay (JIRA)
Ahmet Altay created BEAM-1729:
-

 Summary: Make Jenkins timeouts a failure
 Key: BEAM-1729
 URL: https://issues.apache.org/jira/browse/BEAM-1729
 Project: Beam
  Issue Type: Bug
  Components: testing
Reporter: Ahmet Altay
Assignee: Jason Kuster


It is hard to notice timeouts because they do not send an email:

Example:
https://builds.apache.org/view/Beam/job/beam_PostCommit_Python_Verify/1514/



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Created] (BEAM-1728) Hava job ids in ValidatesRunner tests

2017-03-15 Thread Ahmet Altay (JIRA)
Ahmet Altay created BEAM-1728:
-

 Summary: Hava job ids in ValidatesRunner tests
 Key: BEAM-1728
 URL: https://issues.apache.org/jira/browse/BEAM-1728
 Project: Beam
  Issue Type: Bug
  Components: sdk-py
Reporter: Ahmet Altay
Assignee: Mark Liu
Priority: Minor


It is hard to find the job id for failing/timed out tests.

Print the job id (runner output) to test log before running the job. Example:

https://builds.apache.org/view/Beam/job/beam_PostCommit_Python_Verify/1514/console



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (BEAM-802) Support Dynamic PipelineOptions for python

2017-03-15 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/BEAM-802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15926781#comment-15926781
 ] 

ASF GitHub Bot commented on BEAM-802:
-

Github user asfgit closed the pull request at:

https://github.com/apache/beam/pull/1945


> Support Dynamic PipelineOptions for python
> --
>
> Key: BEAM-802
> URL: https://issues.apache.org/jira/browse/BEAM-802
> Project: Beam
>  Issue Type: New Feature
>  Components: sdk-py
>Reporter: María GH
>Assignee: María GH
>Priority: Minor
>   Original Estimate: 1,680h
>  Remaining Estimate: 1,680h
>
> Goal:  Enable users to run pipelines from templates filled via CL (pipeline 
> options)
> Background: Currently, the Runner creates the JSON pipeline description which 
> can be sent to the worker as is, since everything is already defined there 
> (with links to gs:// for input and binaries). With the parametrized approach, 
> those descriptions are empty and filled by the user or defaulted, so the 
> pipeline needs to be stored somewhere first until the values become available.
> Tasks:
> 1- Create template-style pipeline description (TemplateRunner)
> The graph description is now a template (some parts are not filled) that 
> needs to be saved.
> 2- Define values to inject to the template (ValueProviders API)
> The placeholders can be filled with default values (static) or with dynamic 
> key/value pairs provided at runtime (dynamic)



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[GitHub] beam pull request #1945: [BEAM-802] Add ValueProvider class for FileBasedSou...

2017-03-15 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/beam/pull/1945


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[1/2] beam git commit: Add ValueProvider class for FileBasedSource I/O Transforms

2017-03-15 Thread altay
Repository: beam
Updated Branches:
  refs/heads/master 04c6ef4c7 -> 49c29f1fa


Add ValueProvider class for FileBasedSource I/O Transforms

Incorporate a BeamArgumentParser (argparse.ArgumentParser + ValueProviders).
Add StaticValueProvider and RuntimeValueProvider derived from ValueProvider.
Add serialization for ValueProvider objects.
Add testing for ValueProvider objects.
Modify FileBasedSource and FileSink to accept ValueProvider objects.


Project: http://git-wip-us.apache.org/repos/asf/beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/6d1c9043
Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/6d1c9043
Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/6d1c9043

Branch: refs/heads/master
Commit: 6d1c9043ab0d929e2cea8a3a68192e47a5cc55cd
Parents: 04c6ef4
Author: Maria Garcia Herrero 
Authored: Tue Jan 17 22:57:22 2017 -0800
Committer: Ahmet Altay 
Committed: Wed Mar 15 11:50:23 2017 -0700

--
 sdks/python/apache_beam/examples/wordcount.py   |  31 ++--
 .../apache_beam/internal/gcp/json_value.py  |   6 +
 sdks/python/apache_beam/io/filebasedsource.py   |  46 --
 .../apache_beam/io/filebasedsource_test.py  |  28 +++-
 sdks/python/apache_beam/io/fileio.py|  44 --
 sdks/python/apache_beam/io/fileio_test.py   |  45 --
 sdks/python/apache_beam/transforms/display.py   |   1 +
 .../apache_beam/transforms/display_test.py  |  36 +
 .../apache_beam/utils/pipeline_options.py   |  81 +-
 .../apache_beam/utils/pipeline_options_test.py  |  50 ++-
 sdks/python/apache_beam/utils/value_provider.py | 108 ++
 .../apache_beam/utils/value_provider_test.py| 146 +++
 12 files changed, 560 insertions(+), 62 deletions(-)
--


http://git-wip-us.apache.org/repos/asf/beam/blob/6d1c9043/sdks/python/apache_beam/examples/wordcount.py
--
diff --git a/sdks/python/apache_beam/examples/wordcount.py 
b/sdks/python/apache_beam/examples/wordcount.py
index 50c0328..9e47e08 100644
--- a/sdks/python/apache_beam/examples/wordcount.py
+++ b/sdks/python/apache_beam/examples/wordcount.py
@@ -19,7 +19,6 @@
 
 from __future__ import absolute_import
 
-import argparse
 import logging
 import re
 
@@ -67,24 +66,28 @@ class WordExtractingDoFn(beam.DoFn):
 
 def run(argv=None):
   """Main entry point; defines and runs the wordcount pipeline."""
-  parser = argparse.ArgumentParser()
-  parser.add_argument('--input',
-  dest='input',
-  default='gs://dataflow-samples/shakespeare/kinglear.txt',
-  help='Input file to process.')
-  parser.add_argument('--output',
-  dest='output',
-  required=True,
-  help='Output file to write results to.')
-  known_args, pipeline_args = parser.parse_known_args(argv)
+  class WordcountOptions(PipelineOptions):
+@classmethod
+def _add_argparse_args(cls, parser):
+  parser.add_value_provider_argument(
+  '--input',
+  dest='input',
+  default='gs://dataflow-samples/shakespeare/kinglear.txt',
+  help='Input file to process.')
+  parser.add_value_provider_argument(
+  '--output',
+  dest='output',
+  required=True,
+  help='Output file to write results to.')
+  pipeline_options = PipelineOptions(argv)
+  wordcount_options = pipeline_options.view_as(WordcountOptions)
   # We use the save_main_session option because one or more DoFn's in this
   # workflow rely on global context (e.g., a module imported at module level).
-  pipeline_options = PipelineOptions(pipeline_args)
   pipeline_options.view_as(SetupOptions).save_main_session = True
   p = beam.Pipeline(options=pipeline_options)
 
   # Read the text file[pattern] into a PCollection.
-  lines = p | 'read' >> ReadFromText(known_args.input)
+  lines = p | 'read' >> ReadFromText(wordcount_options.input)
 
   # Count the occurrences of each word.
   counts = (lines
@@ -99,7 +102,7 @@ def run(argv=None):
 
   # Write the output using a "Write" transform that has side effects.
   # pylint: disable=expression-not-assigned
-  output | 'write' >> WriteToText(known_args.output)
+  output | 'write' >> WriteToText(wordcount_options.output)
 
   # Actually run the pipeline (all operations above are deferred).
   result = p.run()

http://git-wip-us.apache.org/repos/asf/beam/blob/6d1c9043/sdks/python/apache_beam/internal/gcp/json_value.py
--
diff --git a/sdks/python/apache_beam/internal/gcp/json_value.py 
b/sdks/python/apache_beam/internal/gcp/json_value.py
index c8b5393..4099c1a 100644
--- a/sdks/python/apache_beam/internal/gcp/json_value.py
+++ 

[2/2] beam git commit: This closes #1945

2017-03-15 Thread altay
This closes #1945


Project: http://git-wip-us.apache.org/repos/asf/beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/49c29f1f
Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/49c29f1f
Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/49c29f1f

Branch: refs/heads/master
Commit: 49c29f1faebddebedb151013cc18c4c4f2237644
Parents: 04c6ef4 6d1c904
Author: Ahmet Altay 
Authored: Wed Mar 15 11:50:32 2017 -0700
Committer: Ahmet Altay 
Committed: Wed Mar 15 11:50:32 2017 -0700

--
 sdks/python/apache_beam/examples/wordcount.py   |  31 ++--
 .../apache_beam/internal/gcp/json_value.py  |   6 +
 sdks/python/apache_beam/io/filebasedsource.py   |  46 --
 .../apache_beam/io/filebasedsource_test.py  |  28 +++-
 sdks/python/apache_beam/io/fileio.py|  44 --
 sdks/python/apache_beam/io/fileio_test.py   |  45 --
 sdks/python/apache_beam/transforms/display.py   |   1 +
 .../apache_beam/transforms/display_test.py  |  36 +
 .../apache_beam/utils/pipeline_options.py   |  81 +-
 .../apache_beam/utils/pipeline_options_test.py  |  50 ++-
 sdks/python/apache_beam/utils/value_provider.py | 108 ++
 .../apache_beam/utils/value_provider_test.py| 146 +++
 12 files changed, 560 insertions(+), 62 deletions(-)
--




  1   2   >