[GitHub] incubator-beam pull request #729: [BEAM-480] Move createTable() from BigQuer...

2016-12-19 Thread peihe
Github user peihe closed the pull request at: https://github.com/apache/incubator-beam/pull/729 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] incubator-beam pull request #1637: [BEAM-1153] GcsUtil: use non-batch API fo...

2016-12-15 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1637 [BEAM-1153] GcsUtil: use non-batch API for single file size requests. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make

[GitHub] incubator-beam pull request #1611: [BEAM-1153] GcsUtil: use non-batch API fo...

2016-12-13 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1611 [BEAM-1153] GcsUtil: use non-batch API for single file size requests. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make

[GitHub] incubator-beam pull request #1608: GcsUtil: set timeout and retry for BatchR...

2016-12-13 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1608 GcsUtil: set timeout and retry for BatchRequest with HttpRequestInitializer. Be sure to do all of the following to help us incorporate your contribution quickly and easily

[GitHub] incubator-beam pull request #1589: FileBasedSinkTest: fix tests in Windows O...

2016-12-12 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1589 FileBasedSinkTest: fix tests in Windows OS by using IOChannelUtils.resolve(). Be sure to do all of the following to help us incorporate your contribution quickly and easily

[GitHub] incubator-beam pull request #1587: [BEAM-863] FileBasedSink: ignore exceptio...

2016-12-12 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1587 [BEAM-863] FileBasedSink: ignore exceptions when removing temp output files for issues in Windows OS. Be sure to do all of the following to help us incorporate your contribution quickly

[GitHub] incubator-beam pull request #1558: [BEAM-59] initial interfaces and classes ...

2016-12-08 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1558 [BEAM-59] initial interfaces and classes of Beam FileSystem. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure

[GitHub] incubator-beam pull request #1426: [BEAM-1065] FileBasedSource: replace Seek...

2016-12-07 Thread peihe
Github user peihe closed the pull request at: https://github.com/apache/incubator-beam/pull/1426 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so

[GitHub] incubator-beam pull request #1057: [BEAM-641] Travis: verify the generated e...

2016-11-30 Thread peihe
Github user peihe closed the pull request at: https://github.com/apache/incubator-beam/pull/1057 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so

[GitHub] incubator-beam pull request #1222: [Ignore, PR for discussion] Replace IOCha...

2016-11-28 Thread peihe
Github user peihe closed the pull request at: https://github.com/apache/incubator-beam/pull/1222 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so

[GitHub] incubator-beam pull request #1448: [BEAM-1009] Update to Mockito 2 with mock...

2016-11-28 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1448 [BEAM-1009] Update to Mockito 2 with mockito-core module. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR

[GitHub] incubator-beam pull request #1277: [BEAM-894] Using @Teardown to remove temp...

2016-11-28 Thread peihe
Github user peihe closed the pull request at: https://github.com/apache/incubator-beam/pull/1277 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so

[GitHub] incubator-beam pull request #1445: [BEAM-1009] Upgrade byte-buddy version to...

2016-11-28 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1445 [BEAM-1009] Upgrade byte-buddy version to 1.5.5. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title

[GitHub] incubator-beam pull request #1434: [BEAM-1047] Update dataflow runner code t...

2016-11-23 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1434 [BEAM-1047] Update dataflow runner code to use DataflowClient wrapper. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make

[GitHub] incubator-beam pull request #1426: FileBasedSource: replace SeekableByteChan...

2016-11-22 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1426 FileBasedSource: replace SeekableByteChannel with open with startingPosition. Be sure to do all of the following to help us incorporate your contribution quickly and easily

[GitHub] incubator-beam pull request #1412: [BEAM-951] IOChannelFactory: replace toPa...

2016-11-21 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1412 [BEAM-951] IOChannelFactory: replace toPath() with resolveSibling() t… Be sure to do all of the following to help us incorporate your contribution quickly and easily

[GitHub] incubator-beam pull request #1407: Beam archetypes: enable snapshot reposito...

2016-11-21 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1407 Beam archetypes: enable snapshot repositories. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title

[GitHub] incubator-beam pull request #1388: Move PerKeyCombineFnRunners to runners/co...

2016-11-18 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1388 Move PerKeyCombineFnRunners to runners/core. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title

[GitHub] incubator-beam pull request #1359: [BEAM-978] Support bulk get file size in ...

2016-11-14 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1359 [BEAM-978] Support bulk get file size in GcsUtil. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title

[GitHub] incubator-beam pull request #1351: WordCountIT: uses input file with fewer k...

2016-11-11 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1351 WordCountIT: uses input file with fewer keys. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title

[GitHub] incubator-beam pull request #1341: Simplify FileOperations interface by refa...

2016-11-10 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1341 Simplify FileOperations interface by refactoring removeDirectoryAndFiles() into FileBasedSink. Be sure to do all of the following to help us incorporate your contribution quickly

[GitHub] incubator-beam pull request #1340: [BEAM-962] Fix games example pipeline opt...

2016-11-10 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1340 [BEAM-962] Fix games example pipeline options default values conflicts. Be sure to do all of the following to help us incorporate your contribution quickly and easily

[GitHub] incubator-beam pull request #1331: [BEAM-954] FileBasedSink: remove unused c...

2016-11-09 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1331 [BEAM-954] FileBasedSink: remove unused code of TemporaryFileRetention. Be sure to do all of the following to help us incorporate your contribution quickly and easily

[GitHub] incubator-beam pull request #1328: [BEAM-951] FileBasedSink: merge FileOpera...

2016-11-09 Thread peihe
Github user peihe closed the pull request at: https://github.com/apache/incubator-beam/pull/1328 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so

[GitHub] incubator-beam pull request #1329: [BEAM-951] FileBasedSink: merge FileOpera...

2016-11-09 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1329 [BEAM-951] FileBasedSink: merge FileOperations into IOChannelFactory. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make

[GitHub] incubator-beam pull request #1328: [BEAM-951] FileBasedSink: merge FileOpera...

2016-11-09 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1328 [BEAM-951] FileBasedSink: merge FileOperations into IOChannelFactory. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make

[GitHub] incubator-beam pull request #1289: [BEAM-917] ExpectedLogs: clear saved reco...

2016-11-04 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1289 [BEAM-917] ExpectedLogs: clear saved records after each test. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure

[GitHub] incubator-beam pull request #1280: [BEAM-895] Allow empty GCP credential for...

2016-11-03 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1280 [BEAM-895] Allow empty GCP credential for pipelines that only access to public data. Be sure to do all of the following to help us incorporate your contribution quickly and easily

[GitHub] incubator-beam pull request #1277: [BEAM-894] Using @Teardown to remove temp...

2016-11-03 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1277 [BEAM-894] Using @Teardown to remove temp files from failed bundles in Write.WriteBundles. Be sure to do all of the following to help us incorporate your contribution quickly and easily

[GitHub] incubator-beam pull request #1259: Upgrade google-api-services-dataflow to v...

2016-11-02 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1259 Upgrade google-api-services-dataflow to v1b3-rev43-1.22.0 Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR

[GitHub] incubator-beam pull request #1255: [BEAM-59] Use ServiceLoader to register I...

2016-11-01 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1255 [BEAM-59] Use ServiceLoader to register IOChannelFactories. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure

[GitHub] incubator-beam pull request #1222: [Ignore, PR for discussion] Replace IOCha...

2016-10-28 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1222 [Ignore, PR for discussion] Replace IOChannelFactory with IOChannelFactoryV2 Be sure to do all of the following to help us incorporate your contribution quickly and easily

[GitHub] incubator-beam pull request #1160: Remove checked exceptions from PipelineRe...

2016-10-21 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1160 Remove checked exceptions from PipelineResult.waitUntilFinish interface. You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator

[GitHub] incubator-beam pull request #1159: [BEAM-790] Validate PipelineOptions Defau...

2016-10-21 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1159 [BEAM-790] Validate PipelineOptions Default annotation. You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam validate

[GitHub] incubator-beam pull request #1151: [BEAM-790] Refactor PipelineOptionsFactor...

2016-10-20 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1151 [BEAM-790] Refactor PipelineOptionsFactory validation. You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam validate

[GitHub] incubator-beam pull request #1120: [BEAM-764] Remove cloneAs from PipelineOp...

2016-10-18 Thread peihe
Github user peihe closed the pull request at: https://github.com/apache/incubator-beam/pull/1120 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so

[GitHub] incubator-beam pull request #1120: [BEAM-764] Remove cloneAs from PipelineOp...

2016-10-17 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1120 [BEAM-764] Remove cloneAs from PipelineOptions Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure the PR title

[GitHub] incubator-beam pull request #1119: [BEAM-763] Update BigQueryIOTest.testBuil...

2016-10-17 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1119 [BEAM-763] Update BigQueryIOTest.testBuildSourceWithTableAndSqlDialect to NeedsRunner tests You can merge this pull request into a Git repository by running: $ git pull https

[GitHub] incubator-beam pull request #1097: [BEAM-443] Update Beam batch examples to ...

2016-10-13 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1097 [BEAM-443] Update Beam batch examples to call waitUntilFinish() You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator

[GitHub] incubator-beam pull request #1096: [BEAM-595] avoid throwing Exception in wa...

2016-10-13 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1096 [BEAM-595] avoid throwing Exception in waitUntilFinish in SparkRunner You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator

[GitHub] incubator-beam pull request #1079: [BEAM-739] Log exceptions full stack trac...

2016-10-10 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1079 [BEAM-739] Log exceptions full stack track in IT tests R: @lukecwik @jasonkuster You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe

[GitHub] incubator-beam pull request #1078: [BEAM-736] Fix BigQueryTornadoesIT, broke...

2016-10-10 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1078 [BEAM-736] Fix BigQueryTornadoesIT, broken by PR-1039 R: @lukecwik You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam

[GitHub] incubator-beam pull request #1057: Ignore: test travis

2016-10-05 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1057 Ignore: test travis You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam travis-test-archetype Alternatively you can

[GitHub] incubator-beam pull request #1042: BigQueryIO: port trivial fixes from Dataf...

2016-10-04 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1042 BigQueryIO: port trivial fixes from Dataflow version. Will rebase once PR-1039 is merged You can merge this pull request into a Git repository by running: $ git pull https://github.com

[GitHub] incubator-beam pull request #1039: Forward port Dataflow PR-431 to Beam

2016-10-03 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1039 Forward port Dataflow PR-431 to Beam Forward port: https://github.com/GoogleCloudPlatform/DataflowJavaSDK/pull/431 You can merge this pull request into a Git repository by running

[GitHub] incubator-beam pull request #997: Support BigQuery DATETIME and TIME types

2016-09-23 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/997 Support BigQuery DATETIME and TIME types You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam bq-new-types

[GitHub] incubator-beam pull request #995: In BigQueryIOTest, changes tests who expec...

2016-09-23 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/995 In BigQueryIOTest, changes tests who expect failure to be NeedsRunner tests You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe

[GitHub] incubator-beam pull request #985: Support BigQuery DATE type

2016-09-21 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/985 Support BigQuery DATE type You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam bq-new-types Alternatively you can

[GitHub] incubator-beam pull request #977: Support BigQuery BYTES type

2016-09-19 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/977 Support BigQuery BYTES type You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam bq-new-types Alternatively you can

[GitHub] incubator-beam pull request #957: Remove PubsubFileInjector and IntraBundleP...

2016-09-13 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/957 Remove PubsubFileInjector and IntraBundleParallelization You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam

[GitHub] incubator-beam pull request #948: Simple streaming text sink with windowing

2016-09-13 Thread peihe
Github user peihe closed the pull request at: https://github.com/apache/incubator-beam/pull/948 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] incubator-beam pull request #952: Forward port DataflowJavaSDK-351 to Beam

2016-09-12 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/952 Forward port DataflowJavaSDK-351 to Beam You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam forward-port-2

[GitHub] incubator-beam pull request #950: Port DataflowJavaSDK-337 to Beam

2016-09-12 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/950 Port DataflowJavaSDK-337 to Beam Port PR "User friendly message for tempLocation." to Beam https://github.com/GoogleCloudPlatform/DataflowJavaSDK/pull/337 You can merge this pu

[GitHub] incubator-beam pull request #948: Simple streaming text sink with windowing

2016-09-12 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/948 Simple streaming text sink with windowing mvn exec:java -Dexec.mainClass=org.apache.beam.examples.WordCount -Dexec.args="--output=./streaming-output-0 --runner=DirectRunner"

[GitHub] incubator-beam pull request #936: Update Beam examples archetypes

2016-09-08 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/936 Update Beam examples archetypes You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam archetypes Alternatively you can

[GitHub] incubator-beam pull request #885: Remove the DataflowRunner instructions fro...

2016-08-25 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/885 Remove the DataflowRunner instructions from examples You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam examples

[GitHub] incubator-beam pull request #880: Cleanup some javadoc that refers Dataflow

2016-08-24 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/880 Cleanup some javadoc that refers Dataflow You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam examples-cleanup

[GitHub] incubator-beam pull request #828: [BEAM-554] Set Gcs upload buffer size to 1...

2016-08-15 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/828 [BEAM-554] Set Gcs upload buffer size to 1M in DataflowRunner streaming mode This PR solves OOMs when DataflowRunner streaming mode writes hundreds files in parallel. You can merge this pull

[GitHub] incubator-beam pull request #533: Make beam-examples run with spark runner

2016-08-04 Thread peihe
Github user peihe closed the pull request at: https://github.com/apache/incubator-beam/pull/533 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] incubator-beam pull request #762: [BEAM-443] Remove BlockingDataflowRunner

2016-07-29 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/762 [BEAM-443] Remove BlockingDataflowRunner You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam rm-blocking-runner

[GitHub] incubator-beam pull request #643: [BEAM-444] Promote isBlockOnRun to Pipelin...

2016-07-29 Thread peihe
Github user peihe closed the pull request at: https://github.com/apache/incubator-beam/pull/643 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] incubator-beam pull request #742: [BEAM-433] Remove references to DataflowPi...

2016-07-27 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/742 [BEAM-433] Remove references to DataflowPipelineOptions You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam rm-dataflow

[GitHub] incubator-beam pull request #301: [BEAM-433] Remove Dataflow references in E...

2016-07-27 Thread peihe
Github user peihe closed the pull request at: https://github.com/apache/incubator-beam/pull/301 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] incubator-beam pull request #729: [BEAM-480] Move createTable() from BigQuer...

2016-07-25 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/729 [BEAM-480] Move createTable() from BigQueryTableInserter to BigQueryServices You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe

[GitHub] incubator-beam pull request #720: Remove overrides of isStreaming() and getA...

2016-07-22 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/720 Remove overrides of isStreaming() and getAppName() in SparkPipelineOptions isStreaming() is already default to false implicitly, since it is not set. getAppName() defaults to the name

[GitHub] incubator-beam pull request #719: [BEAM-483] Moves NormalizedUniqueName to A...

2016-07-22 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/719 [BEAM-483] Moves NormalizedUniqueName to ApplicationNameOptions, and uses it in runners. You can merge this pull request into a Git repository by running: $ git pull https

[GitHub] incubator-beam pull request #717: [BEAM-480] Move insertAll() from BigQueryT...

2016-07-22 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/717 [BEAM-480] Move insertAll() from BigQueryTableInserter to BigQueryServices You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe

[GitHub] incubator-beam pull request #704: [BEAM-386] Remove StreamingCreate in Dataf...

2016-07-20 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/704 [BEAM-386] Remove StreamingCreate in DataflowRunner Create is based on BoundedSource, and which is supported through UnboundedReadFromBoundedSource. You can merge this pull request

[GitHub] incubator-beam pull request #643: Promote isBlockOnRun to PipelineOptions

2016-07-12 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/643 Promote isBlockOnRun to PipelineOptions You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam blocking-options

[GitHub] incubator-beam pull request #642: [BEAM-443] Add waitToFinish() and cancel()...

2016-07-12 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/642 [BEAM-443] Add waitToFinish() and cancel() in PipelineResult. You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam

[GitHub] incubator-beam pull request #637: Remove getDataflowClient() from DataflowPi...

2016-07-11 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/637 Remove getDataflowClient() from DataflowPipelineJob You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam PipelineResult

[GitHub] incubator-beam pull request #634: [BEAM-433] Remove references to JobName in...

2016-07-11 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/634 [BEAM-433] Remove references to JobName in examples pipeline options. You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator

[GitHub] incubator-beam pull request #631: [BEAM-433] Change the ExampleUtils constru...

2016-07-11 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/631 [BEAM-433] Change the ExampleUtils constructor takes PipelineOptions You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator

[GitHub] incubator-beam pull request #612: Remove isUnbounded option, and the corresp...

2016-07-08 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/612 Remove isUnbounded option, and the corresponding ExampleUtils constructor You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator

[GitHub] incubator-beam pull request #605: Rename DataflowExampleUtils and DataflowEx...

2016-07-07 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/605 Rename DataflowExampleUtils and DataflowExampleOptions You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam renaming

[GitHub] incubator-beam pull request #594: remove runInjectorPipeline from DataflowEx...

2016-07-06 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/594 remove runInjectorPipeline from DataflowExampleUtils You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam streaming

[GitHub] incubator-beam pull request #582: Replace PubsubIO and injector with TextIO ...

2016-07-01 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/582 Replace PubsubIO and injector with TextIO in AutoComplete and TriggerExample You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe

[GitHub] incubator-beam pull request #579: Replace PubsubIO and injector with TextIO ...

2016-07-01 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/579 Replace PubsubIO and injector with TextIO in traffic examples You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam

[GitHub] incubator-beam pull request #559: [BEAM-389] Provide equals and hashCode in ...

2016-06-29 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/559 [BEAM-389] Provide equals and hashCode in DelegateCoder You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam fix-delegate

[GitHub] incubator-beam pull request #555: Replacing BigQuery direct calls with BigQu...

2016-06-28 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/555 Replacing BigQuery direct calls with BigQueryServices abstraction You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam

[GitHub] incubator-beam pull request #550: Copy and use UnboundedReadFromBoundedSourc...

2016-06-28 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/550 Copy and use UnboundedReadFromBoundedSource in dataflow runner and remove the injector pipeline from StreamingWordExtract You can merge this pull request into a Git repository by running

[GitHub] incubator-beam pull request #549: Increase the MESSAGES_POLLING_ATTEMPTS for...

2016-06-28 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/549 Increase the MESSAGES_POLLING_ATTEMPTS for slow backend starts You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam patch

[GitHub] incubator-beam pull request #546: Fix NPE in UnboundedReadFromBoundedSource

2016-06-27 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/546 Fix NPE in UnboundedReadFromBoundedSource You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam fix-unbounded-read

[GitHub] incubator-beam pull request #533: Make beam-examples run with spark runner

2016-06-24 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/533 Make beam-examples run with spark runner You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam spark-examples

[GitHub] incubator-beam pull request #516: Enable dependency-plugin at global level.

2016-06-21 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/516 Enable dependency-plugin at global level. Create the PR to trigger tests. It is not ready for review yet, since it will likely break the build. You can merge this pull request into a Git

[GitHub] incubator-beam pull request #511: Fix a typo in FlinkRunner.toString

2016-06-21 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/511 Fix a typo in FlinkRunner.toString R: @tgroh @kennknowles You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam patch-1

[GitHub] incubator-beam pull request #502: Move allowsDynamicSplitting to Reader, and...

2016-06-20 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/502 Move allowsDynamicSplitting to Reader, and set it in CompressedSource. You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe

[GitHub] incubator-beam pull request #486: Remove references to javax.servlet.

2016-06-17 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/486 Remove references to javax.servlet. You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam rm-javax Alternatively you can

[GitHub] incubator-beam pull request #482: Turn on failOnWarning and ignore unused ru...

2016-06-16 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/482 Turn on failOnWarning and ignore unused runners modules in example. You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator

[GitHub] incubator-beam pull request #478: Remove the beam.examples dependency from f...

2016-06-16 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/478 Remove the beam.examples dependency from flink You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam fix-flink-dep

[GitHub] incubator-beam pull request #455: Set trimStackTrace to false for WordCountI...

2016-06-14 Thread peihe
Github user peihe closed the pull request at: https://github.com/apache/incubator-beam/pull/455 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] incubator-beam pull request #455: Set trimStackTrace to false for WordCountI...

2016-06-13 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/455 Set trimStackTrace to false for WordCountIT You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam set-trim Alternatively

[GitHub] incubator-beam pull request #454: Replace GcsPath by IOChannelFactory in Wor...

2016-06-13 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/454 Replace GcsPath by IOChannelFactory in WordCount. You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam fix-wc

[GitHub] incubator-beam pull request #438: Temp location

2016-06-08 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/438 Temp location You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam temp-location Alternatively you can review and apply

[GitHub] incubator-beam pull request: Verify in unit test that BigQuery exe...

2016-05-23 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/376 Verify in unit test that BigQuery executing project is used. You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam unit

[GitHub] incubator-beam pull request: Code cleanup in BigQueryIO

2016-05-20 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/369 Code cleanup in BigQueryIO 1. Use toJsonString() to avoid try catch 2. add getTableWithDefaultProject in BigQuery.Write You can merge this pull request into a Git repository by running

[GitHub] incubator-beam pull request: [Ignore this PR, trigger tests in a c...

2016-05-20 Thread peihe
Github user peihe closed the pull request at: https://github.com/apache/incubator-beam/pull/358 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] incubator-beam pull request: [Ignore this PR, trigger test in a cl...

2016-05-20 Thread peihe
Github user peihe closed the pull request at: https://github.com/apache/incubator-beam/pull/359 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] incubator-beam pull request: [Ignore this PR, trigger test in a cl...

2016-05-19 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/359 [Ignore this PR, trigger test in a clean repo] UnboundedRead from a Bounded Source You can merge this pull request into a Git repository by running: $ git pull https://github.com

[GitHub] incubator-beam pull request: [Ignore this PR, trigger tests in a c...

2016-05-19 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/358 [Ignore this PR, trigger tests in a clean repo] Add BigQueryTornadoes integration test You can merge this pull request into a Git repository by running: $ git pull https://github.com

  1   2   >