[GitHub] incubator-beam pull request #1651: Forward port DataflowJavaSDK/pull/512

2016-12-16 Thread sammcveety
GitHub user sammcveety opened a pull request:

https://github.com/apache/incubator-beam/pull/1651

Forward port DataflowJavaSDK/pull/512

R: @dhalperi 

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/sammcveety/incubator-beam sgmc/fwd_512

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam/pull/1651.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1651


commit 0ca434f1c043635e18156a06ddef823f91290718
Author: Sam McVeety <s...@google.com>
Date:   2016-12-17T02:10:28Z

Forward port DataflowJavaSDK/pull/512




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-beam pull request #1590: [BEAM-1071] Allow for streaming tables wi...

2016-12-12 Thread sammcveety
GitHub user sammcveety opened a pull request:

https://github.com/apache/incubator-beam/pull/1590

[BEAM-1071] Allow for streaming tables with CREATE_NEVER disposition



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/sammcveety/incubator-beam 
sgmc/never_disposition

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam/pull/1590.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1590


commit 76240403cc3a14d413d597d24b8871832a3b7192
Author: Sam McVeety <s...@google.com>
Date:   2016-12-13T02:47:20Z

Allow for BQ tables never




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-beam pull request #1348: Update subnetwork documentation

2016-12-12 Thread sammcveety
Github user sammcveety closed the pull request at:

https://github.com/apache/incubator-beam/pull/1348


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-beam pull request #1576: [BEAM-551] Fix toString for FileBasedSour...

2016-12-10 Thread sammcveety
GitHub user sammcveety opened a pull request:

https://github.com/apache/incubator-beam/pull/1576

[BEAM-551] Fix toString for FileBasedSource



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/sammcveety/incubator-beam 
sgmc/fix_file_based_source_to_string

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam/pull/1576.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1576


commit 015477df98f0378b3ff51a2126e156c7f28d0477
Author: Sam McVeety <s...@google.com>
Date:   2016-12-10T23:59:54Z

[BEAM-551] Fix toString for FileBasedSource




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-beam pull request #1575: [BEAM-551] Fix handling of default values...

2016-12-10 Thread sammcveety
GitHub user sammcveety opened a pull request:

https://github.com/apache/incubator-beam/pull/1575

[BEAM-551] Fix handling of default values for RVPs

Found a bug here, fixed an added a regression test.

R: @dhalperi 

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/sammcveety/incubator-beam 
sgmc/fix_rvp_default_handling

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam/pull/1575.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1575


commit 9dd250c726e6bfee93d77c67e155faa771d4a526
Author: Sam McVeety <s...@google.com>
Date:   2016-12-10T17:16:57Z

[BEAM-551] Fix handling of default for VP




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-beam pull request #1513: [BEAM-551] Add support for BigQueryIO.Wri...

2016-12-09 Thread sammcveety
Github user sammcveety closed the pull request at:

https://github.com/apache/incubator-beam/pull/1513


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-beam pull request #1513: [BEAM-551] Add support for BigQueryIO.Wri...

2016-12-09 Thread sammcveety
Github user sammcveety closed the pull request at:

https://github.com/apache/incubator-beam/pull/1513


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-beam pull request #1513: [BEAM-551] Add support for BigQueryIO.Wri...

2016-12-09 Thread sammcveety
GitHub user sammcveety reopened a pull request:

https://github.com/apache/incubator-beam/pull/1513

[BEAM-551] Add support for BigQueryIO.Write

R: @davorbonaci 

Based on https://github.com/apache/incubator-beam/pull/1238

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/sammcveety/incubator-beam sgmc/bq_write

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam/pull/1513.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1513


commit 29ab056136e36204140ded78a4fbf9ac51afca4c
Author: Sam McVeety <s...@google.com>
Date:   2016-12-04T22:16:23Z

Add schema parameterization

commit 5bd20ae13d17be7e810f7e03065b8e6b5c8cc8d5
Author: Sam McVeety <s...@google.com>
Date:   2016-12-05T23:12:14Z

update bq

commit e530f1fed2b3ab457f55964755668522d2fc450f
Author: Sam McVeety <s...@google.com>
Date:   2016-12-05T23:38:04Z

Fixes

commit 911911fda79cbb5b54b4af5e8d888c0279830211
Author: Sam McVeety <s...@google.com>
Date:   2016-12-06T01:54:48Z

Fix issue with overriding project

commit fec3ce58f7f382c7f717da96af3d68cc63fb9521
Author: Sam McVeety <s...@google.com>
Date:   2016-12-07T05:06:18Z

Fix serialization

commit 5dbfeb1590248dfd566a16f220adcfe1d3cd67ea
Author: Sam McVeety <s...@google.com>
Date:   2016-12-09T17:58:08Z

Minor fixups

commit 58fcfa44d164d651e4b49f28aaeebbface9f33a0
Author: Sam McVeety <s...@google.com>
Date:   2016-12-09T18:33:21Z

Add more tests and fix merge issues

commit a0098357d605521ac59215c5effd6b7ae55a8e03
Author: Sam McVeety <s...@google.com>
Date:   2016-12-09T19:18:22Z

Fix style




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-beam pull request #1238: [BEAM-551] BigqueryIO.Read support for Va...

2016-12-09 Thread sammcveety
Github user sammcveety closed the pull request at:

https://github.com/apache/incubator-beam/pull/1238


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-beam pull request #1549: Fix handling of null ValueProviders in Di...

2016-12-07 Thread sammcveety
GitHub user sammcveety opened a pull request:

https://github.com/apache/incubator-beam/pull/1549

Fix handling of null ValueProviders in DisplayData

R: @swegner 

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/sammcveety/incubator-beam sgmc/dd_null

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam/pull/1549.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1549


commit 6542b8f77e311be75706aab2f17c78a0aef4d0ef
Author: Sam McVeety <s...@google.com>
Date:   2016-12-07T23:31:52Z

Fix handling of null ValueProviders in DisplayData




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-beam pull request #1545: [BEAM-551] Fix handling of TextIO.Sink

2016-12-07 Thread sammcveety
GitHub user sammcveety opened a pull request:

https://github.com/apache/incubator-beam/pull/1545

[BEAM-551] Fix handling of TextIO.Sink

R: @dhalperi 

Directory needs to be parameterized.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/sammcveety/incubator-beam sgmc/text_io_write

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam/pull/1545.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1545


commit d017fde2d063765a73b290e1b1e1b849f147910f
Author: Sam McVeety <s...@google.com>
Date:   2016-12-07T21:27:53Z

[BEAM-551] Fix handling of TextIO.Sink

commit 9309c9389d9e9fa2cae3f7378692d0484ddc54b2
Author: Sam McVeety <s...@google.com>
Date:   2016-12-07T22:09:41Z

Fix test




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-beam pull request #1506: Improve BigQuery load error message

2016-12-07 Thread sammcveety
Github user sammcveety closed the pull request at:

https://github.com/apache/incubator-beam/pull/1506


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-beam pull request #1238: [BEAM-551] BigqueryIO.Read support for Va...

2016-12-06 Thread sammcveety
GitHub user sammcveety reopened a pull request:

https://github.com/apache/incubator-beam/pull/1238

[BEAM-551] BigqueryIO.Read support for ValueProvider 

R: @dhalperi 

This is the serialization issue I was referencing, where I think the issue 
is that there is a deferred translation from String -> TableRef -> String, 
causing a serialization error.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/sammcveety/incubator-beam sgmc/bq_vp

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam/pull/1238.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1238


commit ced1073597e3fbcc826f10a417e810803c7317ce
Author: Sam McVeety <s...@google.com>
Date:   2016-10-30T18:58:44Z

Add BQ VP code

BQ VP

Fix most tests

Make serializable

Fix BQ tests

Fix tests

Update API

Fix validation case

Fix one more query reference

commit 2d05f107499ce94bb35f05a4c386625e66fe660c
Author: Sam McVeety <s...@google.com>
Date:   2016-12-06T05:24:20Z

Minor fixes

commit 1ca49af0659fd32ffa06e4e5778e3e4f90d85be6
Author: Sam McVeety <s...@google.com>
Date:   2016-12-06T05:31:34Z

Address serialization issue




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-beam pull request #1238: [BEAM-551] BigqueryIO.Read support for Va...

2016-12-06 Thread sammcveety
Github user sammcveety closed the pull request at:

https://github.com/apache/incubator-beam/pull/1238


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-beam pull request #1513: [BEAM-551] Add support for BigQueryIO.Wri...

2016-12-05 Thread sammcveety
GitHub user sammcveety opened a pull request:

https://github.com/apache/incubator-beam/pull/1513

[BEAM-551] Add support for BigQueryIO.Write

R: @davorbonaci 

Based on https://github.com/apache/incubator-beam/pull/1238

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/sammcveety/incubator-beam sgmc/bq_write

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam/pull/1513.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1513


commit e06fd8ce238971d1b235ce01f527f7cedb058127
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-10-20T16:29:04Z

Add NestedValueProvider

commit 2e2aa465295dd141577639098522fdbae359126a
Author: Sam McVeety <s...@google.com>
Date:   2016-10-30T18:58:44Z

Add BQ VP code

commit 6fed9071be77b6b12506ca223a8fb68032887f5e
Author: Sam McVeety <s...@google.com>
Date:   2016-10-31T17:39:10Z

BQ VP

commit b8974403bae0bf50da841f526f01085d99f89f97
Author: Sam McVeety <s...@google.com>
Date:   2016-11-01T23:35:59Z

Merge branch 'master' into sgmc/bq_vp

commit 61b220f30b0e9fd67f688de7df50fd8909c58a01
Author: Sam McVeety <s...@google.com>
Date:   2016-11-01T23:57:39Z

Fix most tests

commit 053267a41ffe78180c0bcef8046258314f8970d9
Author: Sam McVeety <s...@google.com>
Date:   2016-11-29T18:16:25Z

Make serializable

commit 73d248e3e3fdf0d1b15abf60a1763c41e2054940
Author: Sam McVeety <s...@google.com>
Date:   2016-12-01T21:39:39Z

Fix BQ tests

commit 407ee12e8f454889bc335bf17bb9c37dc0df33e5
Author: Sam McVeety <s...@google.com>
Date:   2016-12-02T23:12:56Z

Merge branch 'master' into sgmc/bq_vp

commit 4958f8634298e1078a4e20b920dc158e630d6633
Author: Sam McVeety <s...@google.com>
Date:   2016-12-02T23:23:48Z

Fix tests

commit 9a44144c475e19afa33103c3247672c71f7034be
Author: Sam McVeety <s...@google.com>
Date:   2016-12-03T01:29:40Z

Update API

commit 9c13496df5e4630476925032ce596797471fd396
Author: Sam McVeety <s...@google.com>
Date:   2016-12-03T02:11:19Z

BQ Write

commit aacb0281fe714e94658001746c97edf37049dd55
Author: Sam McVeety <s...@google.com>
Date:   2016-12-04T22:16:23Z

Add schema parameterization

commit 99fc371a34ec24e6ee59f852db9a6d327bf5589b
Author: Sam McVeety <s...@google.com>
Date:   2016-12-05T23:12:14Z

update bq

commit a5230670b3f893a0a97ee4eba434eb3bd7ca9ff0
Author: Sam McVeety <s...@google.com>
Date:   2016-12-05T23:38:04Z

Fixes




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-beam pull request #1459: [BEAM-551] Changes to BigQuery validation...

2016-12-05 Thread sammcveety
Github user sammcveety closed the pull request at:

https://github.com/apache/incubator-beam/pull/1459


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-beam pull request #1506: Improve BigQuery load error message

2016-12-04 Thread sammcveety
GitHub user sammcveety opened a pull request:

https://github.com/apache/incubator-beam/pull/1506

Improve BigQuery load error message

R: @davorbonaci 

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/sammcveety/incubator-beam sgmc/fix_load_error

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam/pull/1506.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1506


commit d49e13b141af8111f71c6736f129e243e5834669
Author: Sam McVeety <s...@google.com>
Date:   2016-12-04T22:28:39Z

Improve BigQuery load error message




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-beam pull request #1504: [BEAM-551] Add support for native PubSubI...

2016-12-03 Thread sammcveety
GitHub user sammcveety opened a pull request:

https://github.com/apache/incubator-beam/pull/1504

[BEAM-551] Add support for native PubSubIO

R: @dhalperi 

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/sammcveety/incubator-beam sgmc/pubsub_native

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam/pull/1504.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1504


commit 21d6e45aef7d8d9f93b79e7573952cff68357199
Author: Sam McVeety <s...@google.com>
Date:   2016-12-03T21:40:38Z

[BEAM-551] Add support for native PubSubIO




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-beam pull request #1503: [BEAM-551] Add DisplayData handling of Va...

2016-12-03 Thread sammcveety
GitHub user sammcveety opened a pull request:

https://github.com/apache/incubator-beam/pull/1503

[BEAM-551] Add DisplayData handling of ValueProvider

R: @dhalperi 

Notes:
- An alternative would be to accept ValueProvider and call T.toString() 
if isAccessible
- The parameter is not marked @Nullable because the DisplayData code calls 
checkNotNull


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/sammcveety/incubator-beam sgmc/vp_displaydata

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam/pull/1503.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1503


commit 9d4efdec6932e2f0f840d84734cc7dc89f614581
Author: Sam McVeety <s...@google.com>
Date:   2016-12-03T21:20:24Z

[BEAM-551] Add DisplayData handling of ValueProvider




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-beam pull request #1229: [Ignore] Add a template for PubSub -> Big...

2016-12-02 Thread sammcveety
Github user sammcveety closed the pull request at:

https://github.com/apache/incubator-beam/pull/1229


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-beam pull request #1475: [BEAM-551] Add TextIO.Write support for V...

2016-11-30 Thread sammcveety
GitHub user sammcveety opened a pull request:

https://github.com/apache/incubator-beam/pull/1475

[BEAM-551] Add TextIO.Write support for ValueProvider

R: @dhalperi 

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/sammcveety/incubator-beam sgmc/textio

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam/pull/1475.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1475


commit 18d3ee531c45bf972ca5da701ede0ad43c4760f7
Author: Sam McVeety <s...@google.com>
Date:   2016-11-30T22:06:59Z

Add TextIO.Write support




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-beam pull request #1459: [BEAM-551] Changes to BigQuery validation...

2016-11-29 Thread sammcveety
GitHub user sammcveety opened a pull request:

https://github.com/apache/incubator-beam/pull/1459

[BEAM-551] Changes to BigQuery validation to support dynamic values

R: @dhalperi 

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/sammcveety/incubator-beam sgmc/bqstream

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam/pull/1459.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1459


commit e8d5e82748bfa1c2801cd06291c73f7d12799cc8
Author: Sam McVeety <s...@google.com>
Date:   2016-11-30T00:55:48Z

Fix tests




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-beam pull request #1452: [BEAM-551] Add a test to demonstrate NVP ...

2016-11-29 Thread sammcveety
GitHub user sammcveety opened a pull request:

https://github.com/apache/incubator-beam/pull/1452

[BEAM-551] Add a test to demonstrate NVP serialization

R: @dhalperi 


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/sammcveety/incubator-beam sgmc/nvp_repro

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam/pull/1452.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1452


commit c9a5f8d8bfbe48921b1327acb4d2bfe8fa31f12e
Author: Sam McVeety <s...@google.com>
Date:   2016-11-02T00:58:16Z

Demonstrate serializing issue

commit 29932b2fa1798df16d7114ed3dd915e0dcf50d93
Author: Sam McVeety <s...@google.com>
Date:   2016-11-29T17:45:10Z

Update test




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-beam pull request #1441: Fix double-close bug

2016-11-28 Thread sammcveety
GitHub user sammcveety opened a pull request:

https://github.com/apache/incubator-beam/pull/1441

Fix double-close bug

The WritableByteChannel returned for GCS locations has a bug where calling 
close twice throws an Exception, so we cannot safely use AutoCloseable here.

R: @davorbonaci 

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/sammcveety/incubator-beam patch-2

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam/pull/1441.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1441


commit 701c3b46c0d1224e513da2278fd4cbe354cdfa5c
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-11-28T19:26:19Z

Fix double-close bug

The WritableByteChannel returned for GCS locations has a bug where calling 
close twice throws an Exception, so we cannot safely use AutoCloseable here.




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-beam pull request #1230: [BEAM-551] PubsubIO with ValueProvider

2016-11-19 Thread sammcveety
Github user sammcveety closed the pull request at:

https://github.com/apache/incubator-beam/pull/1230


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-beam pull request #1230: [BEAM-551] PubsubIO with ValueProvider

2016-11-19 Thread sammcveety
GitHub user sammcveety reopened a pull request:

https://github.com/apache/incubator-beam/pull/1230

[BEAM-551] PubsubIO with ValueProvider


R: @davorbonaci  


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/sammcveety/incubator-beam sgmc/pubsub_new

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam/pull/1230.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1230


commit e06fd8ce238971d1b235ce01f527f7cedb058127
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-10-20T16:29:04Z

Add NestedValueProvider

commit 54af0b970701115ba3843d02f85cb25086101734
Author: Sam McVeety <s...@google.com>
Date:   2016-10-30T02:02:51Z

Demonstrate PubsubIO with NVP

commit a3730dcf3c7072e11fe6340dd3b757bf64b18f52
Author: Sam McVeety <s...@google.com>
Date:   2016-10-30T03:47:42Z

Fix null pointer issues

commit 4a2d2637a4c09049500b22231674536e4ae20706
Author: Sam McVeety <s...@google.com>
Date:   2016-11-01T20:42:11Z

Merge branch 'master' into sgmc/pubsub_new

commit 6cb4822e18e1f6850e855b0f7ce2d9737cc73002
Author: Sam McVeety <s...@google.com>
Date:   2016-11-01T21:07:36Z

Fix up tests

commit 57e52a23b46b76a3e45884c33c52a0331f0d4e8a
Author: Sam McVeety <s...@google.com>
Date:   2016-11-02T15:48:48Z

Address comments.

commit a94526af16465be54a9792a41a5ead9162e7c3c7
Author: Sam McVeety <s...@google.com>
Date:   2016-11-03T22:26:06Z

Address comments

commit a8811ace2cce6f685bb4875562355a8e664fa5bd
Author: Sam McVeety <s...@google.com>
Date:   2016-11-14T19:17:50Z

Address builder comments




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-beam pull request #1354: Add IP configuration to Python SDK

2016-11-18 Thread sammcveety
Github user sammcveety closed the pull request at:

https://github.com/apache/incubator-beam/pull/1354


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-beam pull request #1354: Add IP configuration to Python SDK

2016-11-11 Thread sammcveety
GitHub user sammcveety opened a pull request:

https://github.com/apache/incubator-beam/pull/1354

Add IP configuration to Python SDK

R: @chamikaramj 

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/sammcveety/incubator-beam sgmc/private_ip

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam/pull/1354.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1354


commit e8a188ef37bb837e3c9b4253464f5d5375442ce6
Author: Sam McVeety <s...@google.com>
Date:   2016-11-12T03:56:34Z

Add IP configuration to Python SDK




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-beam pull request #1348: Update subnetwork documentation

2016-11-11 Thread sammcveety
GitHub user sammcveety opened a pull request:

https://github.com/apache/incubator-beam/pull/1348

Update subnetwork documentation

R: @davorbonaci 

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/sammcveety/incubator-beam patch-1

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam/pull/1348.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1348


commit b5a857f97bbb5684572c6c71798be90414a469c7
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-11-11T18:42:22Z

Update subnetwork documentation




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-beam pull request #1266: [BEAM-551] Add better toString methods fo...

2016-11-02 Thread sammcveety
GitHub user sammcveety opened a pull request:

https://github.com/apache/incubator-beam/pull/1266

[BEAM-551] Add better toString methods for VPs

R: @dhalperi 

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/sammcveety/incubator-beam sgmc/rvp_string

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam/pull/1266.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1266


commit 5a7954cfdc5f4bd6954790f9a0ed501451050e33
Author: Sam McVeety <s...@google.com>
Date:   2016-11-02T21:05:04Z

[BEAM-551] Add better toString methods for VPs




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-beam pull request #1249: [BEAM-551] Add --templateRunner option to...

2016-11-01 Thread sammcveety
GitHub user sammcveety opened a pull request:

https://github.com/apache/incubator-beam/pull/1249

[BEAM-551] Add --templateRunner option to Dataflow

This provides the DataflowRunner with a means of creating templates for use 
with ValueProvider. 

R: @dhalperi 

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/sammcveety/incubator-beam sgmc/template_runner

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam/pull/1249.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1249


commit 4707450f65b40851918205dd27f0eb0d1cb7348d
Author: Sam McVeety <s...@google.com>
Date:   2016-11-01T16:27:44Z

Add templateRunner option to Dataflow runner




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-beam pull request #1238: (Do not submit) Initial BigqueryIO work f...

2016-10-31 Thread sammcveety
GitHub user sammcveety opened a pull request:

https://github.com/apache/incubator-beam/pull/1238

(Do not submit) Initial BigqueryIO work for ValueProvider 

R: @dhalperi 

This is the serialization issue I was referencing, where I think the issue 
is that there is a deferred translation from String -> TableRef -> String, 
causing a serialization error.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/sammcveety/incubator-beam sgmc/bq_vp

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam/pull/1238.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1238


commit e06fd8ce238971d1b235ce01f527f7cedb058127
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-10-20T16:29:04Z

Add NestedValueProvider

commit 2e2aa465295dd141577639098522fdbae359126a
Author: Sam McVeety <s...@google.com>
Date:   2016-10-30T18:58:44Z

Add BQ VP code

commit 6fed9071be77b6b12506ca223a8fb68032887f5e
Author: Sam McVeety <s...@google.com>
Date:   2016-10-31T17:39:10Z

BQ VP




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-beam pull request #1230: POC for using NestedValueProvider with Pu...

2016-10-30 Thread sammcveety
GitHub user sammcveety opened a pull request:

https://github.com/apache/incubator-beam/pull/1230

POC for using NestedValueProvider with PubsubIO

Based on https://github.com/apache/incubator-beam/pull/1146.  Demonstrating 
the utility of NVP in the context of PubsubIO.  If this looks good, I can 
expand to the rest of the relevant parameters.

R: @dhalperi 

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/sammcveety/incubator-beam sgmc/pubsub_new

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam/pull/1230.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1230


commit e06fd8ce238971d1b235ce01f527f7cedb058127
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-10-20T16:29:04Z

Add NestedValueProvider

commit 54af0b970701115ba3843d02f85cb25086101734
Author: Sam McVeety <s...@google.com>
Date:   2016-10-30T02:02:51Z

Demonstrate PubsubIO with NVP

commit a3730dcf3c7072e11fe6340dd3b757bf64b18f52
Author: Sam McVeety <s...@google.com>
Date:   2016-10-30T03:47:42Z

Fix null pointer issues




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-beam pull request #1229: Add a template for PubSub -> BigQuery

2016-10-29 Thread sammcveety
GitHub user sammcveety opened a pull request:

https://github.com/apache/incubator-beam/pull/1229

Add a template for PubSub -> BigQuery

Create a simple proof-of-concept template for BigQuery streaming.  Once 
PubsubIO uses ValueProvider, this should be a one-line change to fully 
templatize.

R: @dhalperi 

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/sammcveety/incubator-beam sgmc/bq_template

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam/pull/1229.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1229


commit d62c7ee58c424cfe092a24f66377a23974a971ec
Author: Sam McVeety <s...@google.com>
Date:   2016-10-29T17:28:51Z

Add a new template




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-beam pull request #1134: [BEAM-551] Allow TextIO to accept ValuePr...

2016-10-27 Thread sammcveety
GitHub user sammcveety reopened a pull request:

https://github.com/apache/incubator-beam/pull/1134

[BEAM-551] Allow TextIO to accept ValueProvider

Thinking about testing, is it worth having something sub-integration-test 
level?  We'd likely want to add some convenience methods to RVP for that, then.

R: @dhalperi

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/sammcveety/incubator-beam sgmc/vp_textio

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam/pull/1134.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1134


commit 7310c1f5e77f042aa21db046c91ccdb18edec1d8
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-10-16T22:37:51Z

VP for TextIO

commit 37b89c063b2e24507dfd6725cf89668b135b9774
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-10-17T12:31:51Z

Add alternate VP getter

commit 9dcf6bfac552737586fc8b0416f1ab0d46291f4b
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-10-17T12:56:41Z

Add surface methods for VP

commit 9492444b44f331cedd0b8e1a4faec6dc0528d4e2
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-10-19T13:40:07Z

Further improvements to VP handling.

commit 9f4022a9ed30ac906415789a0a1d72764df117c9
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-10-24T15:49:01Z

Address comments.

commit 4a7067dc5ba5f9dd785b3a7a3aec9d32f19aca2f
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-10-24T17:27:03Z

Fix parameter passing




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-beam pull request #1134: [BEAM-551] Allow TextIO to accept ValuePr...

2016-10-27 Thread sammcveety
Github user sammcveety closed the pull request at:

https://github.com/apache/incubator-beam/pull/1134


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-beam pull request #1163: Add experimental ServiceAccount option to...

2016-10-22 Thread sammcveety
GitHub user sammcveety opened a pull request:

https://github.com/apache/incubator-beam/pull/1163

Add experimental ServiceAccount option to Dataflow runner

R: @davorbonaci 

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/sammcveety/incubator-beam sgmc/service_account

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam/pull/1163.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1163


commit f8a0f16a9d19d79ac54859fc9b0908123fa2d3f6
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-10-22T14:27:53Z

Add experimental ServiceAccount option




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-beam pull request #1156: [BEAM-551] Add method to output runtime o...

2016-10-21 Thread sammcveety
GitHub user sammcveety opened a pull request:

https://github.com/apache/incubator-beam/pull/1156

[BEAM-551] Add method to output runtime options

Add a method that outputs the dynamic options from PipelineOptions, so an 
interested consumer could write these to a metadata storage location in order 
to more intelligently provide information about the parameters that a template 
supports.

R: @dhalperi 

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/sammcveety/incubator-beam sgmc/vp_meta

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam/pull/1156.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1156


commit 1dcce68db8c2627b96de4e17f91916a79217e098
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-10-21T16:50:01Z

Add method to output runtime options




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-beam pull request #1146: [BEAM-551] Add NestedValueProvider

2016-10-20 Thread sammcveety
GitHub user sammcveety opened a pull request:

https://github.com/apache/incubator-beam/pull/1146

[BEAM-551] Add NestedValueProvider

Wrote this up based on some nascent thoughts, and looking ahead to 
PubsubIO, which uses a bunch of wrapper classes instead of String.  This allows 
us to nicely turn those into VP instead of deferring all the 
translation code into the caller, which would be gross.

R: @dhalperi 

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/sammcveety/incubator-beam sgmc/nested_vp

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam/pull/1146.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1146


commit e06fd8ce238971d1b235ce01f527f7cedb058127
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-10-20T16:29:04Z

Add NestedValueProvider




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-beam pull request #1134: [BEAM-551] Allow TextIO to accept ValuePr...

2016-10-19 Thread sammcveety
GitHub user sammcveety opened a pull request:

https://github.com/apache/incubator-beam/pull/1134

[BEAM-551] Allow TextIO to accept ValueProvider

Thinking about testing, is it worth having something sub-integration-test 
level?  We'd likely want to add some convenience methods to RVP for that, then.

R: @dhalperi

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/sammcveety/incubator-beam sgmc/vp_textio

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam/pull/1134.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1134


commit 7310c1f5e77f042aa21db046c91ccdb18edec1d8
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-10-16T22:37:51Z

VP for TextIO

commit 37b89c063b2e24507dfd6725cf89668b135b9774
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-10-17T12:31:51Z

Add alternate VP getter

commit 9dcf6bfac552737586fc8b0416f1ab0d46291f4b
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-10-17T12:56:41Z

Add surface methods for VP

commit 9492444b44f331cedd0b8e1a4faec6dc0528d4e2
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-10-19T13:40:07Z

Further improvements to VP handling.




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-beam pull request #1107: [BEAM-551] Add property name to RuntimeVa...

2016-10-14 Thread sammcveety
GitHub user sammcveety opened a pull request:

https://github.com/apache/incubator-beam/pull/1107

[BEAM-551] Add property name to RuntimeValueProvider

The intention here is to allow Native IO to perform the same substitution 
that would otherwise take place at job execution time.

R: @dhalperi 

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/sammcveety/incubator-beam prop_name

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam/pull/1107.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1107


commit e84cb0911129757e42716cce5c75b1d64e619e31
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-10-14T17:41:33Z

Add property name to RuntimeValueProvider




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-beam pull request #1105: [BEAM-551] Add utility to handle JSON opt...

2016-10-14 Thread sammcveety
GitHub user sammcveety opened a pull request:

https://github.com/apache/incubator-beam/pull/1105

[BEAM-551] Add utility to handle JSON option manipulation

Provide a utility to be used with RuntimeValueProviders that allows runners 
to manipulate PipelineOptions by interleaving runtime parameters.

Green travis: https://travis-ci.org/sammcveety/incubator-beam/jobs/167702097

R: @dhalperi

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/sammcveety/incubator-beam sgmc/json_test

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam/pull/1105.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1105


commit 83230a2c47b533162cdbf45580daf59896149487
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-10-14T17:06:08Z

Add utility to handle JSON option manipulation




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-beam pull request #1041: Add a default bucket to Dataflow runner

2016-10-04 Thread sammcveety
GitHub user sammcveety opened a pull request:

https://github.com/apache/incubator-beam/pull/1041

Add a default bucket to Dataflow runner

There is a dependency failure that I'm not sure how to debug; all other 
tests pass.

@tgroh could you please take a look?
---



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/sammcveety/incubator-beam sgmc/bucket_staging

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam/pull/1041.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1041


commit 28e935efb72b209da48981f55e4349f37597f34a
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-10-03T18:21:41Z

Add a default bucket to Dataflow runner.




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-beam pull request #1014: Add initial scaffolding for default bucke...

2016-09-26 Thread sammcveety
GitHub user sammcveety opened a pull request:

https://github.com/apache/incubator-beam/pull/1014

Add initial scaffolding for default bucket (take 2)

@tgroh, could you please take a look?

- Provide a hook for determining the project number associated with a bucket
- Provide an API for looking up the project number from a project ID

Re-opened because the other PR wasn't clearing the extra commit history, 
despite the branch being correct.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/sammcveety/incubator-beam sgmc/default_bucket

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam/pull/1014.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1014


commit bb87b3a735e87eac3105f15294c4e2e782ae1870
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-09-18T01:19:53Z

Add initial bucket stuff.

commit f6b4616d9f19b5f484bf573a36c90d075a155cb7
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-09-18T01:45:39Z

Basic CRM client.

commit b7e93be0501cf26092456c757fdf7affa71cdd2f
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-09-18T02:08:05Z

Fix some compilation errors and update pom.

commit 4077ef3d7b9d906dbfbb4c4189fde1ac81a0e8f9
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-09-18T02:22:48Z

Minor updates.

commit dab7ec2f6aaf19dc5cf382b926bd1766861d8127
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-09-18T02:36:38Z

Add options.

commit 0ab2a1f11364b0db707eccaeaa7342479b24a594
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-09-18T02:39:35Z

Fix more things.

commit b005d0f80c73c1dca78d64f057731e4bd91420cf
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-09-18T03:04:40Z

Actually include file.

commit a5a616a74b33074ce22d26efc12d3b19867f8d7b
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-09-18T03:17:26Z

Checkstyle fixes.

commit 9a7f10605bdc6cd635b0475b383914acdcd94575
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-09-23T22:03:10Z

Address many comments, add some tests.

commit b0588d9cfb6c5cb2d7951cc09556eca6f66487fe
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-09-23T22:12:07Z

Finish testing work.

commit d61496589939af2cfead0f053e9e4af930d7e164
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-09-23T22:29:59Z

Add more tests.

commit 8b07be20b9a505428419d05f062f6f87a2ecaeea
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-09-23T23:48:03Z

Fix compilation errors.

commit 0c3a3cd8a018bdfdffe32d57632bf305a7252eab
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-09-24T00:20:24Z

Fix more tests.

commit e00e0911b335e150dbedbfde7309f28edcae5417
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-09-24T00:26:06Z

Actually check project number in test.

commit 3c5c63ea52390db08c9eef90cb8ff97947d30964
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-09-24T04:57:44Z

Switch API to use Bucket instead of narrower parameters.

commit 02f4c726359630da46b0159a7fc49056b21ab84c
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-09-18T01:19:53Z

    Add initial bucket stuff.

commit 95e99a911bd3d57f2d471fc5c6497ea3b99f4700
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-09-18T01:45:39Z

Basic CRM client.

commit 7dcae41501abdb456a8e94a250810c16710ad412
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-09-18T02:08:05Z

Fix some compilation errors and update pom.

commit cb77c8bcc5379cdbab055a7be25be7905f120552
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-09-18T02:22:48Z

Minor updates.

commit 56027f6877c6a78fb1a2a90c2fc7a9f13a1b869b
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-09-18T02:36:38Z

Add options.

commit 79fc17d29a0e766a580ac81079fe5bad2e2d2371
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-09-18T02:39:35Z

Fix more things.

commit f47ce9c9a0d7463c6b95e7c58a2d0733ceb9b32f
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-09-18T03:04:40Z

Actually include file.

commit b5ea40db57aa261c23123935d38696d3eaa23cf0
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-09-18T03:17:26Z

Checkstyle fixes.

commit ca4fc641a08a82160ebf75b52677e189743f59c2
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-09-23T22:03:10Z

Address many comments, add some tests.

commit 3ee37012372eb3beab49fb8845faa1cf7eda1519
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-09-23T22:12:07Z

Finish testing work.

commit 83e641ecec95a7a25c66cd08dc24db728786a157
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-09-23T22:29:59Z

Add more tests.


[GitHub] incubator-beam pull request #988: Add initial scaffolding for default bucket

2016-09-26 Thread sammcveety
Github user sammcveety closed the pull request at:

https://github.com/apache/incubator-beam/pull/988


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-beam pull request #1009: [BEAM-551] Add ValueProvider class (Take ...

2016-09-26 Thread sammcveety
GitHub user sammcveety opened a pull request:

https://github.com/apache/incubator-beam/pull/1009

[BEAM-551] Add ValueProvider class (Take 2)

My branch had become a dumpster fire, so I'm opening a fresh PR (history is 
here: https://github.com/apache/incubator-beam/pull/827).

Add a basic implementation of StaticValueProvider and DynamicValueProvider.

@dhalperi , could you please take a look?  Hoping the jackson API surface 
test failures are easy to fix. 

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/sammcveety/incubator-beam sgmc/vp2

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam/pull/1009.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1009


commit 3e55e508ede87b92f0d78bc960803bc546a8a354
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-09-26T22:27:15Z

Reset of ValueProvider PR.

commit 562baf6ec7a9a77dad797c5a40df1f5122e5d1b8
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-09-26T22:46:05Z

Fix checkstyle, etc., failures.




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-beam pull request #827: [BEAM-551] Add ValueProvider class

2016-09-26 Thread sammcveety
Github user sammcveety closed the pull request at:

https://github.com/apache/incubator-beam/pull/827


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-beam pull request #988: Add initial scaffolding for default bucket

2016-09-24 Thread sammcveety
GitHub user sammcveety reopened a pull request:

https://github.com/apache/incubator-beam/pull/988

Add initial scaffolding for default bucket

@tgroh, could you please take a look?

Before reviewing further, I was hoping to get clarity on whether the travis 
failures I'm seeing are related to this PR:

[ERROR] 
/Users/travis/build/sammcveety/incubator-beam/sdks/java/core/target/generated-sources/annotations/org/apache/beam/sdk/testing/AutoValue_TestStream_ElementEvent.java:[8,7]
 duplicate class: org.apache.beam.sdk.testing.AutoValue_TestStream_ElementEvent
[ERROR] 
/Users/travis/build/sammcveety/incubator-beam/sdks/java/core/target/generated-sources/annotations/org/apache/beam/sdk/testing/AutoValue_TestStream_WatermarkEvent.java:[8,7]
 duplicate class: 
org.apache.beam.sdk.testing.AutoValue_TestStream_WatermarkEvent
[ERROR] 
/Users/travis/build/sammcveety/incubator-beam/sdks/java/core/target/generated-sources/annotations/org/apache/beam/sdk/testing/AutoValue_TestStream_ProcessingTimeEvent.java:[8,7]
 duplicate class: 
org.apache.beam.sdk.testing.AutoValue_TestStream_ProcessingTimeEvent
[ERROR] 
/Users/travis/build/sammcveety/incubator-beam/sdks/java/core/target/generated-sources/annotations/org/apache/beam/sdk/transforms/display/AutoValue_DisplayData_Item.java:[7,7]
 duplicate class: 
org.apache.beam.sdk.transforms.display.AutoValue_DisplayData_Item
[ERROR] 
/Users/travis/build/sammcveety/incubator-beam/sdks/java/core/target/generated-sources/annotations/org/apache/beam/sdk/options/AutoValue_PipelineOptionSpec.java:[8,7]
 duplicate class: org.apache.beam.sdk.options.AutoValue_PipelineOptionSpec
[ERROR] 
/Users/travis/build/sammcveety/incubator-beam/sdks/java/core/target/generated-sources/annotations/org/apache/beam/sdk/options/AutoValue_ProxyInvocationHandler_BoundValue.java:[7,7]
 duplicate class: 
org.apache.beam.sdk.options.AutoValue_ProxyInvocationHandler_BoundValue
[ERROR] 
/Users/travis/build/sammcveety/incubator-beam/sdks/java/core/target/generated-sources/annotations/org/apache/beam/sdk/transforms/reflect/AutoValue_DoFnSignature.java:[8,7]
 duplicate class: org.apache.beam.sdk.transforms.reflect.AutoValue_DoFnSignature
[ERROR] 
/Users/travis/build/sammcveety/incubator-beam/sdks/java/core/target/generated-sources/annotations/org/apache/beam/sdk/transforms/reflect/AutoValue_DoFnSignature_ProcessElementMethod.java:[9,7]
 duplicate class: 
org.apache.beam.sdk.transforms.reflect.AutoValue_DoFnSignature_ProcessElementMethod
[ERROR] 
/Users/travis/build/sammcveety/incubator-beam/sdks/java/core/target/generated-sources/annotations/org/apache/beam/sdk/transforms/reflect/AutoValue_DoFnSignature_BundleMethod.java:[8,7]
 duplicate class: 
org.apache.beam.sdk.transforms.reflect.AutoValue_DoFnSignature_BundleMethod
[ERROR] 
/Users/travis/build/sammcveety/incubator-beam/sdks/java/core/target/generated-sources/annotations/org/apache/beam/sdk/transforms/reflect/AutoValue_DoFnSignature_LifecycleMethod.java:[8,7]
 duplicate class: 
org.apache.beam.sdk.transforms.reflect.AutoValue_DoFnSignature_LifecycleMethod

- Provide a hook for determining the project number associated with a bucket
- Provide an API for looking up the project number from a project ID

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/sammcveety/incubator-beam sgmc/default_bucket

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam/pull/988.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #988


commit bb87b3a735e87eac3105f15294c4e2e782ae1870
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-09-18T01:19:53Z

Add initial bucket stuff.

commit f6b4616d9f19b5f484bf573a36c90d075a155cb7
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-09-18T01:45:39Z

Basic CRM client.

commit b7e93be0501cf26092456c757fdf7affa71cdd2f
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-09-18T02:08:05Z

Fix some compilation errors and update pom.

commit 4077ef3d7b9d906dbfbb4c4189fde1ac81a0e8f9
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-09-18T02:22:48Z

Minor updates.

commit dab7ec2f6aaf19dc5cf382b926bd1766861d8127
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-09-18T02:36:38Z

Add options.

commit 0ab2a1f11364b0db707eccaeaa7342479b24a594
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-09-18T02:39:35Z

Fix more things.

commit b005d0f80c73c1dca78d64f057731e4bd91420cf
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-09-18T03:04:40Z

Actually include file.

commit a5a616a74b33074ce22d26efc12d3b19867f8d7b
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-09-18T03:17:26Z

Checkstyle fixes.

commit 287061b75ddaf6908dc14726876059443083f62c
A

[GitHub] incubator-beam pull request #988: Add initial scaffolding for default bucket

2016-09-24 Thread sammcveety
Github user sammcveety closed the pull request at:

https://github.com/apache/incubator-beam/pull/988


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-beam pull request #852: Correctly type collections in PipelineOpti...

2016-09-23 Thread sammcveety
Github user sammcveety closed the pull request at:

https://github.com/apache/incubator-beam/pull/852


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-beam pull request #852: Correctly type collections in PipelineOpti...

2016-09-23 Thread sammcveety
GitHub user sammcveety reopened a pull request:

https://github.com/apache/incubator-beam/pull/852

Correctly type collections in PipelineOptions.

@bjchambers @lukecwik I would expect this to work, but the cast to 
ParameterizedType fails.  Luke, were you suggesting something else?

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/sammcveety/incubator-beam sgmc/fix_generic

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam/pull/852.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #852


commit bbb8e5a704564b989c8a19941b610e14c685e3c5
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-08-19T00:49:05Z

Correctly type collections in PipelineOptions.

commit 9dc397915d2055b8be89abb92ccb2c8c7872a294
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-08-19T00:53:29Z

Minor fix.

commit 77c77f0010142c65f896aa4a431bd50ab7e45f96
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-08-19T00:54:16Z

Minor fix.

commit 4c273142a8b7cd6fcee7e094db6ddb94fa99fef4
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-08-19T14:19:05Z

Demonstrate how to fix generic issue.

commit be772844864486a2d60b9362b0d45890bdc5c920
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-08-19T14:35:40Z

Fix handling of typed collections.

commit 7126afdf40ae5a83191394e330a85f4f1157eb67
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-08-19T17:26:06Z

Add more tests and remove redundant logic.

commit 42e2c620bb1f9e6cbcc9f6135d9a69ff9173e613
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-08-19T17:28:43Z

Update comment.

commit 2b843bdea4b4998549c2975265b17b5f7ad9caa2
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-08-19T17:32:32Z

Make empty non-strings an error.

commit a3b236c064e0a44c2c11c6185ee0b2f2fcde6e4f
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-08-19T17:46:45Z

Use allInterfaceMethods logic.

commit 4ed34403f56198d7596812358037b2f28f374dab
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-08-19T19:40:30Z

Use allInterfaceMethods instead of bean class.

commit ecd360d1c5f5d627404924f0007ea14167db80e1
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-09-22T18:48:01Z

Incorporate diffs.

commit 2fa42004d9a125419fc479e05ba4200759882df4
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-09-22T18:56:30Z

Add test for conflicting types.

commit bb013aa2f6f9b356f8f44b8e919ba11d4fcfafb6
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-09-22T20:16:43Z

Commit latest changes.

commit ea47ac6a560c3dff9769182a5b47a8e623ad99c7
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-09-22T20:18:41Z

    Latest changes.

commit 9de21e91743a8683302c292b65f8228bfe6def2e
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-09-22T20:47:57Z

Add exotic tests.

commit f0aa12fe248b1b0cdc67b995b8262985e361a1e3
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-09-22T21:05:37Z

    Fix tests and style issues.

commit 87a2641d759124e20209943ae5e4def72857c751
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-09-22T23:27:25Z

Fix issue with multiple property definitions.

commit 025831de62f450146f17531f1795c0208b8d2bcf
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-09-22T23:55:49Z

Disable bean test temporarily.

commit 85bd9c24c3bfae5a73989fa83316225bfc6bf51e
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-09-23T04:43:07Z

Fix handling of non-bean methods to remove false positives but still be 
useful.

commit 551c69348f59c20899c3a07194929543f3b50875
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-09-23T06:09:31Z

Update PipelineOptionsFactoryTest.java




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-beam pull request #988: Add initial scaffolding for default bucket

2016-09-22 Thread sammcveety
GitHub user sammcveety opened a pull request:

https://github.com/apache/incubator-beam/pull/988

Add initial scaffolding for default bucket

@tgroh, could you please take a look?

Before reviewing further, I was hoping to get clarity on whether the travis 
failures I'm seeing are related to this PR:

[ERROR] 
/Users/travis/build/sammcveety/incubator-beam/sdks/java/core/target/generated-sources/annotations/org/apache/beam/sdk/testing/AutoValue_TestStream_ElementEvent.java:[8,7]
 duplicate class: org.apache.beam.sdk.testing.AutoValue_TestStream_ElementEvent
[ERROR] 
/Users/travis/build/sammcveety/incubator-beam/sdks/java/core/target/generated-sources/annotations/org/apache/beam/sdk/testing/AutoValue_TestStream_WatermarkEvent.java:[8,7]
 duplicate class: 
org.apache.beam.sdk.testing.AutoValue_TestStream_WatermarkEvent
[ERROR] 
/Users/travis/build/sammcveety/incubator-beam/sdks/java/core/target/generated-sources/annotations/org/apache/beam/sdk/testing/AutoValue_TestStream_ProcessingTimeEvent.java:[8,7]
 duplicate class: 
org.apache.beam.sdk.testing.AutoValue_TestStream_ProcessingTimeEvent
[ERROR] 
/Users/travis/build/sammcveety/incubator-beam/sdks/java/core/target/generated-sources/annotations/org/apache/beam/sdk/transforms/display/AutoValue_DisplayData_Item.java:[7,7]
 duplicate class: 
org.apache.beam.sdk.transforms.display.AutoValue_DisplayData_Item
[ERROR] 
/Users/travis/build/sammcveety/incubator-beam/sdks/java/core/target/generated-sources/annotations/org/apache/beam/sdk/options/AutoValue_PipelineOptionSpec.java:[8,7]
 duplicate class: org.apache.beam.sdk.options.AutoValue_PipelineOptionSpec
[ERROR] 
/Users/travis/build/sammcveety/incubator-beam/sdks/java/core/target/generated-sources/annotations/org/apache/beam/sdk/options/AutoValue_ProxyInvocationHandler_BoundValue.java:[7,7]
 duplicate class: 
org.apache.beam.sdk.options.AutoValue_ProxyInvocationHandler_BoundValue
[ERROR] 
/Users/travis/build/sammcveety/incubator-beam/sdks/java/core/target/generated-sources/annotations/org/apache/beam/sdk/transforms/reflect/AutoValue_DoFnSignature.java:[8,7]
 duplicate class: org.apache.beam.sdk.transforms.reflect.AutoValue_DoFnSignature
[ERROR] 
/Users/travis/build/sammcveety/incubator-beam/sdks/java/core/target/generated-sources/annotations/org/apache/beam/sdk/transforms/reflect/AutoValue_DoFnSignature_ProcessElementMethod.java:[9,7]
 duplicate class: 
org.apache.beam.sdk.transforms.reflect.AutoValue_DoFnSignature_ProcessElementMethod
[ERROR] 
/Users/travis/build/sammcveety/incubator-beam/sdks/java/core/target/generated-sources/annotations/org/apache/beam/sdk/transforms/reflect/AutoValue_DoFnSignature_BundleMethod.java:[8,7]
 duplicate class: 
org.apache.beam.sdk.transforms.reflect.AutoValue_DoFnSignature_BundleMethod
[ERROR] 
/Users/travis/build/sammcveety/incubator-beam/sdks/java/core/target/generated-sources/annotations/org/apache/beam/sdk/transforms/reflect/AutoValue_DoFnSignature_LifecycleMethod.java:[8,7]
 duplicate class: 
org.apache.beam.sdk.transforms.reflect.AutoValue_DoFnSignature_LifecycleMethod

- Provide a hook for determining the project number associated with a bucket
- Provide an API for looking up the project number from a project ID

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/sammcveety/incubator-beam sgmc/default_bucket

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam/pull/988.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #988


commit bb87b3a735e87eac3105f15294c4e2e782ae1870
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-09-18T01:19:53Z

Add initial bucket stuff.

commit f6b4616d9f19b5f484bf573a36c90d075a155cb7
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-09-18T01:45:39Z

Basic CRM client.

commit b7e93be0501cf26092456c757fdf7affa71cdd2f
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-09-18T02:08:05Z

Fix some compilation errors and update pom.

commit 4077ef3d7b9d906dbfbb4c4189fde1ac81a0e8f9
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-09-18T02:22:48Z

Minor updates.

commit dab7ec2f6aaf19dc5cf382b926bd1766861d8127
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-09-18T02:36:38Z

Add options.

commit 0ab2a1f11364b0db707eccaeaa7342479b24a594
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-09-18T02:39:35Z

Fix more things.

commit b005d0f80c73c1dca78d64f057731e4bd91420cf
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-09-18T03:04:40Z

Actually include file.

commit a5a616a74b33074ce22d26efc12d3b19867f8d7b
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-09-18T03:17:26Z

Checkstyle fixes.




---
If your project is set up for it, you ca

[GitHub] incubator-beam pull request #852: Correctly type collections in PipelineOpti...

2016-08-18 Thread sammcveety
GitHub user sammcveety opened a pull request:

https://github.com/apache/incubator-beam/pull/852

Correctly type collections in PipelineOptions.

@bjchambers @lukecwik I would expect this to work, but the cast to 
ParameterizedType fails.  Luke, were you suggesting something else?

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/sammcveety/incubator-beam sgmc/fix_generic

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam/pull/852.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #852


commit bbb8e5a704564b989c8a19941b610e14c685e3c5
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-08-19T00:49:05Z

Correctly type collections in PipelineOptions.

commit 9dc397915d2055b8be89abb92ccb2c8c7872a294
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-08-19T00:53:29Z

Minor fix.

commit 77c77f0010142c65f896aa4a431bd50ab7e45f96
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-08-19T00:54:16Z

Minor fix.




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-beam pull request #850: Incorporate Private IP change to Beam

2016-08-18 Thread sammcveety
GitHub user sammcveety opened a pull request:

https://github.com/apache/incubator-beam/pull/850

Incorporate Private IP change to Beam

@dhalperi , please take a look
---


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/sammcveety/incubator-beam sgmc/pip

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam/pull/850.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #850


commit 32e72da9e4682dfed781a0e9d3ce6b03adf5e88a
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-08-18T22:02:06Z

Update pom.xml

commit c967ca3c4967a097d5f47635a8319594e6d95fa3
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-08-18T22:02:52Z

Update DataflowPipelineWorkerPoolOptions.java

commit a9989ecc8c8d7b566c3337df7adc4afaa0e63071
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-08-18T22:03:50Z

Update DataflowPipelineTranslator.java




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-beam pull request #827: [BEAM-551] Add ValueProvider class

2016-08-15 Thread sammcveety
GitHub user sammcveety opened a pull request:

https://github.com/apache/incubator-beam/pull/827

[BEAM-551] Add ValueProvider class

Hi @lukecwik , can you please take a look?

Currently implemented for ValueProvider only.  Tests demonstrate 
intended functionality, once the questions below are answered:

- What's the best way to avoid threading issues with the static options in 
test?
- Is it reasonable to continue down the road of special-casing 
getter/setter validation for this class?
- What would be the preferred way to annotate T for ValueProvider to 
work around type erasure?

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/sammcveety/incubator-beam sgmc/valueprovider

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam/pull/827.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #827


commit 867a080b98f585db2687d9aaf7d42de8c813
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-08-14T00:45:58Z

Merge pull request #1 from apache/master

Update my fork.

commit bb7aea8db07b3a7ae988f75888716dd865e07e08
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-08-14T00:48:18Z

Create ValueProvider.java

commit 5330800d9d5b54b897c53cb8ea40c6331fe3c36a
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-08-14T00:48:54Z

Update ValueProvider.java

commit 9b9b17c2338612b4030d1c4a36f8fb4c5c179c2e
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-08-14T00:50:56Z

Update ProxyInvocationHandler.java

commit b54832bd0c28691d1e6087b4901fb6ae11ebd2c9
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-08-14T00:54:33Z

Create ValueProviderTest.java

commit e2d16a7ad66676a099d4160ecd4c31c369acd46e
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-08-14T00:56:41Z

Update ValueProviderTest.java

commit afbe8157f711fca00ed37afbe461edd4ac78e30f
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-08-14T16:34:23Z

Update ProxyInvocationHandler.java

commit e111045ae1125ed49ea1f26cdde31b3c1583ed2d
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-08-14T16:58:29Z

Update ValueProviderTest.java

commit 0bff463a71c4f4b3ad13edd924fd03226a915a61
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-08-14T20:11:49Z

Add tests.

commit c4f3acc427b828f0f0254f83e84690b14c0a0f98
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-08-14T21:42:56Z

Iterations on tests.

commit f19435b688fed41d873b85ac7750d923025256a9
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-08-15T01:32:37Z

Proposal for how to handle getters/setters.




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-beam pull request #824: Sgmc/valueprovider

2016-08-13 Thread sammcveety
GitHub user sammcveety opened a pull request:

https://github.com/apache/incubator-beam/pull/824

Sgmc/valueprovider

Be sure to do all of the following to help us incorporate your contribution
quickly and easily:

 - [ ] Make sure the PR title is formatted like:
   `[BEAM-] Description of pull request`
 - [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable
   Travis-CI on your fork and ensure the whole test matrix passes).
 - [ ] Replace `` in the title with the actual Jira issue
   number, if there is one.
 - [ ] If this contribution is large, please file an Apache
   [Individual Contributor License 
Agreement](https://www.apache.org/licenses/icla.txt).

---


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/sammcveety/incubator-beam sgmc/valueprovider

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam/pull/824.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #824


commit 867a080b98f585db2687d9aaf7d42de8c813
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-08-14T00:45:58Z

Merge pull request #1 from apache/master

Update my fork.

commit bb7aea8db07b3a7ae988f75888716dd865e07e08
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-08-14T00:48:18Z

Create ValueProvider.java

commit 5330800d9d5b54b897c53cb8ea40c6331fe3c36a
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-08-14T00:48:54Z

Update ValueProvider.java

commit 9b9b17c2338612b4030d1c4a36f8fb4c5c179c2e
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-08-14T00:50:56Z

Update ProxyInvocationHandler.java

commit b54832bd0c28691d1e6087b4901fb6ae11ebd2c9
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-08-14T00:54:33Z

Create ValueProviderTest.java

commit e2d16a7ad66676a099d4160ecd4c31c369acd46e
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-08-14T00:56:41Z

Update ValueProviderTest.java




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-beam pull request #824: Sgmc/valueprovider

2016-08-13 Thread sammcveety
Github user sammcveety closed the pull request at:

https://github.com/apache/incubator-beam/pull/824


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-beam pull request: Add wildcard to checkstyle ordering

2016-05-05 Thread sammcveety
GitHub user sammcveety opened a pull request:

https://github.com/apache/incubator-beam/pull/292

Add wildcard to checkstyle ordering

Add wildcard to checkstyle, to handle unexpected package prefixes.  These 
should still be ordered before the sun and java packages.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/sammcveety/incubator-beam patch-1

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam/pull/292.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #292


commit e31f1a696475ea110d3d3b3dca382b64d12c582b
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-05-05T19:15:24Z

Add wildcard to checkstyle ordering

Add wildcard to checkstyle, to handle unexpected package prefixes.  These 
should still be ordered before the sun and java packages.




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-beam pull request: Update subnetwork comment to specify ...

2016-04-06 Thread sammcveety
GitHub user sammcveety opened a pull request:

https://github.com/apache/incubator-beam/pull/137

Update subnetwork comment to specify region instead of zone

R: @dhalperi

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/sammcveety/incubator-beam subnet

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam/pull/137.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #137


commit 64b7713dfd76bfc48ebbed3bb34c7df11951f153
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-04-06T18:18:36Z

Merge pull request #1 from apache/master

Update my branch.

commit 781413a7051488a1cd4e69d8535574b0366d
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-04-06T18:22:02Z

Update DataflowPipelineWorkerPoolOptions.java

commit 3036bca1fd326b703eb823b6c9d1a356c65ec4c4
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-04-06T18:22:35Z

Update DataflowPipelineTranslatorTest.java




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-beam pull request: Update AutoComplete.java

2016-03-22 Thread sammcveety
GitHub user sammcveety opened a pull request:

https://github.com/apache/incubator-beam/pull/67

Update AutoComplete.java

Allow for the Datastore dependency of this test to be in a different 
project than the main project for the job.

R: @dhalperi

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/sammcveety/incubator-beam autocomplete

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam/pull/67.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #67


commit da288ad045ec096c2cc345e0f2a4d95645d433c7
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-03-22T18:58:19Z

Update AutoComplete.java

Allow for the Datastore dependency of this test to be in a different 
project than the main project for the job.




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-beam pull request: Update my branch

2016-03-22 Thread sammcveety
Github user sammcveety closed the pull request at:

https://github.com/apache/incubator-beam/pull/66


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-beam pull request: Update my branch

2016-03-22 Thread sammcveety
GitHub user sammcveety opened a pull request:

https://github.com/apache/incubator-beam/pull/66

Update my branch



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/sammcveety/incubator-beam master

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam/pull/66.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #66


commit 2fee23e295c19413a7d26e28c3bad1a84a574f49
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-03-03T05:27:08Z

Update pom.xml

commit dad3ae08c57b331848d25ba4eb7a0221b4785e54
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-03-03T05:27:25Z

Merge pull request #1 from sammcveety/sammcveety-patch-1

Update pom.xml

commit 0063d2a09af45cbffd37370032888e1a568ce62b
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-03-03T05:29:29Z

Update DataflowPipelineWorkerPoolOptions.java

commit b0fd6cab0cc97e00c00f3bc6c41b57b1277bb6e0
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-03-03T05:30:19Z

Update DataflowPipelineTranslator.java

commit f6f07606e752c65c723477e04acf8eb482c464c2
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-03-03T05:31:01Z

Update DataflowPipelineTranslatorTest.java

commit a8b42d4e63bec0a9e4fda19cf42a85d3b1be18bb
Author: sammcveety <sam.mcve...@gmail.com>
Date:   2016-03-04T04:28:36Z

Update DataflowPipelineWorkerPoolOptions.java




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] incubator-beam pull request: [BEAM-93] Add subnetwork support and ...

2016-03-03 Thread sammcveety
GitHub user sammcveety opened a pull request:

https://github.com/apache/incubator-beam/pull/16

[BEAM-93] Add subnetwork support and increment Dataflow API dependency

Add subnetwork to the Dataflow runner through a new option.  This support 
was added in the newest API release, so increment the API dependency as well.

Still need to run tests, but otherwise, so far so good?  @davorbonaci 

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/sammcveety/incubator-beam master

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/incubator-beam/pull/16.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #16






---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---