[GitHub] beam pull request #3802: [BEAM-2822] Add fn API progress reporting protos

2017-09-01 Thread vikkyrk
GitHub user vikkyrk opened a pull request: https://github.com/apache/beam/pull/3802 [BEAM-2822] Add fn API progress reporting protos Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA issue](https

[GitHub] beam pull request #3784: [BEAM-2822] Enable progress request handling in pyt...

2017-08-29 Thread vikkyrk
GitHub user vikkyrk opened a pull request: https://github.com/apache/beam/pull/3784 [BEAM-2822] Enable progress request handling in python SDK harness Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA

[GitHub] beam pull request #3586: Increase the gRPC message size to max value

2017-07-18 Thread vikkyrk
GitHub user vikkyrk opened a pull request: https://github.com/apache/beam/pull/3586 Increase the gRPC message size to max value Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA issue](https

[GitHub] beam pull request #3559: Retry on Datastore client python socket errors

2017-07-13 Thread vikkyrk
GitHub user vikkyrk opened a pull request: https://github.com/apache/beam/pull/3559 Retry on Datastore client python socket errors Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted

[GitHub] beam pull request #3445: [BEAM-2509}] Enable grpc controller in fn_api_runne...

2017-06-26 Thread vikkyrk
GitHub user vikkyrk opened a pull request: https://github.com/apache/beam/pull/3445 [BEAM-2509}] Enable grpc controller in fn_api_runner Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title

[GitHub] beam pull request #3431: Fix python fn API data plane remote grpc port acces...

2017-06-23 Thread vikkyrk
GitHub user vikkyrk opened a pull request: https://github.com/apache/beam/pull/3431 Fix python fn API data plane remote grpc port access Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title

[GitHub] beam pull request #3393: Fix Dataflow runner test to call pipeline.run inste...

2017-06-19 Thread vikkyrk
GitHub user vikkyrk opened a pull request: https://github.com/apache/beam/pull/3393 Fix Dataflow runner test to call pipeline.run instead of runner.run Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure

[GitHub] beam pull request #3385: Add dry run option to DataflowRunner in python SDK

2017-06-16 Thread vikkyrk
GitHub user vikkyrk opened a pull request: https://github.com/apache/beam/pull/3385 Add dry run option to DataflowRunner in python SDK Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title

[GitHub] beam pull request #3350: Fix WindowValueCoder for large timestamps

2017-06-13 Thread vikkyrk
GitHub user vikkyrk opened a pull request: https://github.com/apache/beam/pull/3350 Fix WindowValueCoder for large timestamps Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like

[GitHub] beam pull request #3317: python pubsub io fixes for streaming

2017-06-07 Thread vikkyrk
GitHub user vikkyrk opened a pull request: https://github.com/apache/beam/pull/3317 python pubsub io fixes for streaming Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like

[GitHub] beam pull request #3316: Make BytesCoder to be a known type

2017-06-07 Thread vikkyrk
GitHub user vikkyrk opened a pull request: https://github.com/apache/beam/pull/3316 Make BytesCoder to be a known type Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like

[GitHub] beam pull request #3155: Use built-in cmp python function in comparing Datas...

2017-05-15 Thread vikkyrk
GitHub user vikkyrk opened a pull request: https://github.com/apache/beam/pull/3155 Use built-in cmp python function in comparing Datastore paths Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR

[GitHub] beam pull request #3098: Fix lint error in fake_datastore.py

2017-05-11 Thread vikkyrk
GitHub user vikkyrk opened a pull request: https://github.com/apache/beam/pull/3098 Fix lint error in fake_datastore.py Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like

[GitHub] beam pull request #3088: Mark internal modules in python datastoreio

2017-05-11 Thread vikkyrk
GitHub user vikkyrk opened a pull request: https://github.com/apache/beam/pull/3088 Mark internal modules in python datastoreio Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted

[GitHub] beam pull request #3083: Cherry-pick #3072: Remove protobuf and http-client ...

2017-05-11 Thread vikkyrk
GitHub user vikkyrk opened a pull request: https://github.com/apache/beam/pull/3083 Cherry-pick #3072: Remove protobuf and http-client dependency from runners/google-cloud-dataflow Be sure to do all of the following to help us incorporate your contribution quickly

[GitHub] beam pull request #3072: Remove protobuf and http-client dependency from Dat...

2017-05-10 Thread vikkyrk
GitHub user vikkyrk opened a pull request: https://github.com/apache/beam/pull/3072 Remove protobuf and http-client dependency from Dataflow runner runners/google-cloud-dataflow Be sure to do all of the following to help us incorporate your contribution quickly

[GitHub] beam pull request #3028: Shade protobuf-java in runners/google-cloud-dataflo...

2017-05-10 Thread vikkyrk
Github user vikkyrk closed the pull request at: https://github.com/apache/beam/pull/3028 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] beam pull request #3063: Fix a typo in TestDataflowRunnerTest

2017-05-10 Thread vikkyrk
GitHub user vikkyrk opened a pull request: https://github.com/apache/beam/pull/3063 Fix a typo in TestDataflowRunnerTest Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like

[GitHub] beam pull request #3062: Skip generating empty jars for parent poms

2017-05-10 Thread vikkyrk
GitHub user vikkyrk opened a pull request: https://github.com/apache/beam/pull/3062 Skip generating empty jars for parent poms Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like

[GitHub] beam pull request #3026: Include sun.reflect in allowed api surface packages...

2017-05-09 Thread vikkyrk
Github user vikkyrk closed the pull request at: https://github.com/apache/beam/pull/3026 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] beam pull request #3028: Shade protobuf-java in runners/google-cloud-dataflo...

2017-05-09 Thread vikkyrk
GitHub user vikkyrk opened a pull request: https://github.com/apache/beam/pull/3028 Shade protobuf-java in runners/google-cloud-dataflow-java Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title

[GitHub] beam pull request #3026: Include sun.reflect in allowed api surface packages...

2017-05-09 Thread vikkyrk
GitHub user vikkyrk opened a pull request: https://github.com/apache/beam/pull/3026 Include sun.reflect in allowed api surface packages for GcpCoreApiSurfaceTest Be sure to do all of the following to help us incorporate your contribution quickly and easily

[GitHub] beam pull request #3009: Fix checkstyle issue in ApiSurface

2017-05-09 Thread vikkyrk
GitHub user vikkyrk opened a pull request: https://github.com/apache/beam/pull/3009 Fix checkstyle issue in ApiSurface Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like

[GitHub] beam pull request #3004: [BEAM-1871] [BEAM-1019 ] Cherry-pick: Shade depende...

2017-05-09 Thread vikkyrk
GitHub user vikkyrk opened a pull request: https://github.com/apache/beam/pull/3004 [BEAM-1871] [BEAM-1019 ] Cherry-pick: Shade dependencies in sdks/coreShade dependencies in sdks/core Be sure to do all of the following to help us incorporate your contribution quickly

[GitHub] beam pull request #2996: [BEAM-1871] [BEAM-1019 ] Shade dependencies in sdks...

2017-05-09 Thread vikkyrk
Github user vikkyrk closed the pull request at: https://github.com/apache/beam/pull/2996 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] beam pull request #2996: [BEAM-1871] [BEAM-1019 ] Shade dependencies in sdks...

2017-05-09 Thread vikkyrk
GitHub user vikkyrk opened a pull request: https://github.com/apache/beam/pull/2996 [BEAM-1871] [BEAM-1019 ] Shade dependencies in sdks/core Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title

[GitHub] beam pull request #2982: [BEAM-1871] Remove google api BackOff usage from sd...

2017-05-08 Thread vikkyrk
GitHub user vikkyrk opened a pull request: https://github.com/apache/beam/pull/2982 [BEAM-1871] Remove google api BackOff usage from sdks/core Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title

[GitHub] beam pull request #2937: [BEAM-1871] Remote google api client from sdks/core

2017-05-05 Thread vikkyrk
GitHub user vikkyrk opened a pull request: https://github.com/apache/beam/pull/2937 [BEAM-1871] Remote google api client from sdks/core Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title

[GitHub] beam pull request #2907: [BEAM-2143]: Fix default temp location for Dataflow...

2017-05-04 Thread vikkyrk
GitHub user vikkyrk opened a pull request: https://github.com/apache/beam/pull/2907 [BEAM-2143]: Fix default temp location for DataflowRunner Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title

[GitHub] beam pull request #2889: [BEAM-59] Remove IOChannelUtil/Factory from BigQuer...

2017-05-03 Thread vikkyrk
GitHub user vikkyrk opened a pull request: https://github.com/apache/beam/pull/2889 [BEAM-59] Remove IOChannelUtil/Factory from BigQueryIO Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title

[GitHub] beam pull request #2873: [BEAM-828] BigQueryIO: Remove tempLocation usage at...

2017-05-03 Thread vikkyrk
GitHub user vikkyrk opened a pull request: https://github.com/apache/beam/pull/2873 [BEAM-828] BigQueryIO: Remove tempLocation usage at pipeline construction time Be sure to do all of the following to help us incorporate your contribution quickly and easily

[GitHub] beam pull request #2865: [BEAM-1902] Retry on correct error codes for datast...

2017-05-03 Thread vikkyrk
GitHub user vikkyrk opened a pull request: https://github.com/apache/beam/pull/2865 [BEAM-1902] Retry on correct error codes for datastoreio Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title

[GitHub] beam pull request #2849: Trigger for Java SDK post submit tests

2017-05-02 Thread vikkyrk
GitHub user vikkyrk opened a pull request: https://github.com/apache/beam/pull/2849 Trigger for Java SDK post submit tests Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like

[GitHub] beam pull request #2846: [BEAM-2128] Remove job name usages from BigQueryIO ...

2017-05-02 Thread vikkyrk
GitHub user vikkyrk opened a pull request: https://github.com/apache/beam/pull/2846 [BEAM-2128] Remove job name usages from BigQueryIO at pipeline construction time Be sure to do all of the following to help us incorporate your contribution quickly and easily

[GitHub] beam pull request #2798: [BEAM-59] Remove IOChannelUtils from BigQuery Table...

2017-05-01 Thread vikkyrk
GitHub user vikkyrk opened a pull request: https://github.com/apache/beam/pull/2798 [BEAM-59] Remove IOChannelUtils from BigQuery TableRowWriter Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title

[GitHub] beam pull request #2775: [BEAM-59] Remove IOChannelUtils from PackageUtil

2017-04-28 Thread vikkyrk
GitHub user vikkyrk opened a pull request: https://github.com/apache/beam/pull/2775 [BEAM-59] Remove IOChannelUtils from PackageUtil Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title

[GitHub] beam pull request #2768: [BEAM-59] Remove IOChannelUtils from a few ITs

2017-04-28 Thread vikkyrk
GitHub user vikkyrk opened a pull request: https://github.com/apache/beam/pull/2768 [BEAM-59] Remove IOChannelUtils from a few ITs Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted

[GitHub] beam pull request #2754: [Beam-59] Add getFilename method to ResourceId

2017-04-27 Thread vikkyrk
GitHub user vikkyrk opened a pull request: https://github.com/apache/beam/pull/2754 [Beam-59] Add getFilename method to ResourceId Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted

[GitHub] beam pull request #2749: [Beam-59] Remove IOChannelFactory usage from Number...

2017-04-27 Thread vikkyrk
GitHub user vikkyrk opened a pull request: https://github.com/apache/beam/pull/2749 [Beam-59] Remove IOChannelFactory usage from NumberedShardedFile Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR

[GitHub] beam pull request #2688: [BEAM-2080]: Add a custom enforcer rule to check fo...

2017-04-25 Thread vikkyrk
GitHub user vikkyrk opened a pull request: https://github.com/apache/beam/pull/2688 [BEAM-2080]: Add a custom enforcer rule to check for banned classes. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure

[GitHub] beam pull request #2639: Change dataflow Job log from info to debug

2017-04-21 Thread vikkyrk
GitHub user vikkyrk opened a pull request: https://github.com/apache/beam/pull/2639 Change dataflow Job log from info to debug Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like

[GitHub] beam pull request #2604: Remove bigshuffle from python examples

2017-04-19 Thread vikkyrk
GitHub user vikkyrk opened a pull request: https://github.com/apache/beam/pull/2604 Remove bigshuffle from python examples Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like

[GitHub] beam pull request #2543: [BEAM-1956] Modify types for input PCollections of ...

2017-04-14 Thread vikkyrk
GitHub user vikkyrk opened a pull request: https://github.com/apache/beam/pull/2543 [BEAM-1956] Modify types for input PCollections of Flatten transform Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure

[GitHub] beam pull request #2470: [BEAM-1865]: Fix GroupByKeyInputVisitor for Direct ...

2017-04-07 Thread vikkyrk
GitHub user vikkyrk opened a pull request: https://github.com/apache/beam/pull/2470 [BEAM-1865]: Fix GroupByKeyInputVisitor for Direct Runner Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title

[GitHub] beam pull request #2446: [BEAM-1895] Python Create as a custom source

2017-04-05 Thread vikkyrk
GitHub user vikkyrk opened a pull request: https://github.com/apache/beam/pull/2446 [BEAM-1895] Python Create as a custom source Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted

[GitHub] beam pull request #2409: [BEAM-1865]: Replace Any type with a KV type for in...

2017-04-03 Thread vikkyrk
GitHub user vikkyrk opened a pull request: https://github.com/apache/beam/pull/2409 [BEAM-1865]: Replace Any type with a KV type for inputs of a GroupByKey step Be sure to do all of the following to help us incorporate your contribution quickly and easily: - Relying

[GitHub] beam pull request #2385: Add request number of splits to display data in Dat...

2017-03-30 Thread vikkyrk
GitHub user vikkyrk opened a pull request: https://github.com/apache/beam/pull/2385 Add request number of splits to display data in DatastoreIO Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title

[GitHub] beam pull request #2376: Annotate output type for python CoGroupByKey

2017-03-30 Thread vikkyrk
Github user vikkyrk closed the pull request at: https://github.com/apache/beam/pull/2376 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] beam pull request #2376: Annotate output type for python CoGroupByKey

2017-03-30 Thread vikkyrk
GitHub user vikkyrk opened a pull request: https://github.com/apache/beam/pull/2376 Annotate output type for python CoGroupByKey Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted

[GitHub] beam pull request #2297: [BEAM-1590]: Roll forward #2140

2017-03-22 Thread vikkyrk
GitHub user vikkyrk opened a pull request: https://github.com/apache/beam/pull/2297 [BEAM-1590]: Roll forward #2140 …I based jobs"" This reverts commit b31be1caef6a691006082e3e440d0b42ff1d4165. Be sure to do all of the following to help us incorp

[GitHub] beam pull request #2260: Use underscore instead of hypen in Datastore kind n...

2017-03-16 Thread vikkyrk
GitHub user vikkyrk opened a pull request: https://github.com/apache/beam/pull/2260 Use underscore instead of hypen in Datastore kind name. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title

[GitHub] beam pull request #1724: [BEAM-991] Flush Datastore writes at max byte batch...

2017-03-16 Thread vikkyrk
Github user vikkyrk closed the pull request at: https://github.com/apache/beam/pull/1724 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] beam pull request #2128: Update output stream cython declaration

2017-02-28 Thread vikkyrk
GitHub user vikkyrk opened a pull request: https://github.com/apache/beam/pull/2128 Update output stream cython declaration Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like

[GitHub] beam pull request #2081: [BEAM-1539]: Support unkown length iterables for It...

2017-02-22 Thread vikkyrk
GitHub user vikkyrk opened a pull request: https://github.com/apache/beam/pull/2081 [BEAM-1539]: Support unkown length iterables for IterableCoder in python SDK Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make

[GitHub] beam pull request #2028: [BEAM-1504] Parameterized tests for standard coders...

2017-02-16 Thread vikkyrk
GitHub user vikkyrk opened a pull request: https://github.com/apache/beam/pull/2028 [BEAM-1504] Parameterized tests for standard coders in Python SDK Be sure to do all of the following to help us incorporate your contribution quickly and easily: `python setup.py test -s

[GitHub] beam pull request #2018: [BEAM-1467] dd cross-SDK implementations and tests ...

2017-02-15 Thread vikkyrk
GitHub user vikkyrk opened a pull request: https://github.com/apache/beam/pull/2018 [BEAM-1467] dd cross-SDK implementations and tests of WindowedValueCoder Be sure to do all of the following to help us incorporate your contribution quickly and easily: - Tests

[GitHub] beam pull request #2004: Add unsigned 64 bit int read/write methods to cytho...

2017-02-14 Thread vikkyrk
GitHub user vikkyrk opened a pull request: https://github.com/apache/beam/pull/2004 Add unsigned 64 bit int read/write methods to cythonized stream Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR

[GitHub] beam pull request #1996: Add cross-sdk tests for IterableCoder

2017-02-13 Thread vikkyrk
GitHub user vikkyrk opened a pull request: https://github.com/apache/beam/pull/1996 Add cross-sdk tests for IterableCoder Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like

[GitHub] incubator-beam pull request #1682: Add experiments alias for DebugOptions

2016-12-21 Thread vikkyrk
GitHub user vikkyrk opened a pull request: https://github.com/apache/incubator-beam/pull/1682 Add experiments alias for DebugOptions Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title