[GitHub] incubator-beam pull request #729: [BEAM-480] Move createTable() from BigQuer...
Github user peihe closed the pull request at: https://github.com/apache/incubator-beam/pull/729 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #1637: [BEAM-1153] GcsUtil: use non-batch API fo...
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1637 [BEAM-1153] GcsUtil: use non-batch API for single file size requests. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like: `[BEAM-] Description of pull request` - [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable Travis-CI on your fork and ensure the whole test matrix passes). - [ ] Replace `` in the title with the actual Jira issue number, if there is one. - [ ] If this contribution is large, please file an Apache [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.txt). --- You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam release-0.4.0-incubating Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/1637.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1637 commit 58601f8c69b97dbdd9087b27c356c50bca7a1c8b Author: Pei He <pe...@google.com> Date: 2016-12-14T02:29:17Z [BEAM-1153] GcsUtil: use non-batch API for single file size requests. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #1611: [BEAM-1153] GcsUtil: use non-batch API fo...
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1611 [BEAM-1153] GcsUtil: use non-batch API for single file size requests. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like: `[BEAM-] Description of pull request` - [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable Travis-CI on your fork and ensure the whole test matrix passes). - [ ] Replace `` in the title with the actual Jira issue number, if there is one. - [ ] If this contribution is large, please file an Apache [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.txt). --- You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam fix-pr-1359 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/1611.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1611 commit a42055ec58c0f458a1939f4682d0c77bac9127bb Author: Pei He <pe...@google.com> Date: 2016-12-14T02:29:17Z [BEAM-1153] GcsUtil: use non-batch API for single file size requests. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #1608: GcsUtil: set timeout and retry for BatchR...
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1608 GcsUtil: set timeout and retry for BatchRequest with HttpRequestInitializer. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like: `[BEAM-] Description of pull request` - [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable Travis-CI on your fork and ensure the whole test matrix passes). - [ ] Replace `` in the title with the actual Jira issue number, if there is one. - [ ] If this contribution is large, please file an Apache [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.txt). --- You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam gsutil-timeout Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/1608.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1608 commit fecac4e5265373dd90d1b7cf4d11ea7d7f61a44a Author: peihe <hepeim...@gmail.com> Date: 2016-12-14T00:56:32Z GcsUtil: set timeout and retry for BatchRequest with HttpRequestInitializer. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #1589: FileBasedSinkTest: fix tests in Windows O...
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1589 FileBasedSinkTest: fix tests in Windows OS by using IOChannelUtils.resolve(). Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like: `[BEAM-] Description of pull request` - [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable Travis-CI on your fork and ensure the whole test matrix passes). - [ ] Replace `` in the title with the actual Jira issue number, if there is one. - [ ] If this contribution is large, please file an Apache [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.txt). --- You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam files-resolve Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/1589.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1589 commit c91425065c9a2dee1beab077dc5450858e44c47a Author: Pei He <pe...@google.com> Date: 2016-12-13T01:52:07Z FileBasedSinkTest: fix tests in Windows OS by using IOChannelUtils.resolve(). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #1587: [BEAM-863] FileBasedSink: ignore exceptio...
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1587 [BEAM-863] FileBasedSink: ignore exceptions when removing temp output files for issues in Windows OS. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like: `[BEAM-] Description of pull request` - [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable Travis-CI on your fork and ensure the whole test matrix passes). - [ ] Replace `` in the title with the actual Jira issue number, if there is one. - [ ] If this contribution is large, please file an Apache [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.txt). --- You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam windows-os-path Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/1587.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1587 commit 1ef4eb68f5e9a8550bd45630190ac39d29e3e405 Author: Pei He <pe...@google.com> Date: 2016-12-12T23:43:14Z FileBasedSink: ignore exceptions when removing temp output files for issues in Windows OS. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #1558: [BEAM-59] initial interfaces and classes ...
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1558 [BEAM-59] initial interfaces and classes of Beam FileSystem. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like: `[BEAM-] Description of pull request` - [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable Travis-CI on your fork and ensure the whole test matrix passes). - [ ] Replace `` in the title with the actual Jira issue number, if there is one. - [ ] If this contribution is large, please file an Apache [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.txt). --- You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam file-system-init Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/1558.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1558 commit 05ae42bb728c3a3314b5df47c13d0121d7e31444 Author: Pei He <pe...@google.com> Date: 2016-12-08T01:35:23Z [BEAM-59] initial interfaces and classes of Beam FileSystem. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #1426: [BEAM-1065] FileBasedSource: replace Seek...
Github user peihe closed the pull request at: https://github.com/apache/incubator-beam/pull/1426 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #1057: [BEAM-641] Travis: verify the generated e...
Github user peihe closed the pull request at: https://github.com/apache/incubator-beam/pull/1057 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #1222: [Ignore, PR for discussion] Replace IOCha...
Github user peihe closed the pull request at: https://github.com/apache/incubator-beam/pull/1222 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #1448: [BEAM-1009] Update to Mockito 2 with mock...
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1448 [BEAM-1009] Update to Mockito 2 with mockito-core module. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like: `[BEAM-] Description of pull request` - [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable Travis-CI on your fork and ensure the whole test matrix passes). - [ ] Replace `` in the title with the actual Jira issue number, if there is one. - [ ] If this contribution is large, please file an Apache [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.txt). --- You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam mockito-2-upgrade Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/1448.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1448 commit cc7cc5a516eb213873d9a286c3da97a91f3b4125 Author: Pei He <pe...@google.com> Date: 2016-11-28T22:11:32Z [BEAM-1009] Update to Mockito 2 with mockito-core module. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #1277: [BEAM-894] Using @Teardown to remove temp...
Github user peihe closed the pull request at: https://github.com/apache/incubator-beam/pull/1277 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #1445: [BEAM-1009] Upgrade byte-buddy version to...
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1445 [BEAM-1009] Upgrade byte-buddy version to 1.5.5. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like: `[BEAM-] Description of pull request` - [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable Travis-CI on your fork and ensure the whole test matrix passes). - [ ] Replace `` in the title with the actual Jira issue number, if there is one. - [ ] If this contribution is large, please file an Apache [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.txt). --- You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam mockito-2 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/1445.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1445 commit 1e448e78ee971067606b0b88c71ad1bd00d19cff Author: Pei He <pe...@google.com> Date: 2016-11-28T20:52:14Z [BEAM-1009] Upgrade byte-buddy version to 1.5.5. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #1434: [BEAM-1047] Update dataflow runner code t...
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1434 [BEAM-1047] Update dataflow runner code to use DataflowClient wrapper. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like: `[BEAM-] Description of pull request` - [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable Travis-CI on your fork and ensure the whole test matrix passes). - [ ] Replace `` in the title with the actual Jira issue number, if there is one. - [ ] If this contribution is large, please file an Apache [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.txt). --- You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam region Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/1434.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1434 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #1426: FileBasedSource: replace SeekableByteChan...
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1426 FileBasedSource: replace SeekableByteChannel with open with startingPosition. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like: `[BEAM-] Description of pull request` - [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable Travis-CI on your fork and ensure the whole test matrix passes). - [ ] Replace `` in the title with the actual Jira issue number, if there is one. - [ ] If this contribution is large, please file an Apache [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.txt). --- You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam io-channel-open-channel Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/1426.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1426 commit 714a81399fa61c1f8f4795af9da1bd23d4ce294b Author: Pei He <pe...@google.com> Date: 2016-11-23T05:04:36Z FileBasedSource: replace SeekableByteChannel with open with startingPosition. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #1412: [BEAM-951] IOChannelFactory: replace toPa...
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1412 [BEAM-951] IOChannelFactory: replace toPath() with resolveSibling() t⦠Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like: `[BEAM-] Description of pull request` - [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable Travis-CI on your fork and ensure the whole test matrix passes). - [ ] Replace `` in the title with the actual Jira issue number, if there is one. - [ ] If this contribution is large, please file an Apache [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.txt). --- â¦o tighten the interface. You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam io-channel-factory-to-path Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/1412.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1412 commit aabea4aef0a4369ebd2c90ed44e6a60443019e70 Author: Pei He <pe...@google.com> Date: 2016-11-22T07:20:59Z [BEAM-951] IOChannelFactory: replace toPath() with resolveSibling() to tighten the interface. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #1407: Beam archetypes: enable snapshot reposito...
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1407 Beam archetypes: enable snapshot repositories. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like: `[BEAM-] Description of pull request` - [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable Travis-CI on your fork and ensure the whole test matrix passes). - [ ] Replace `` in the title with the actual Jira issue number, if there is one. - [ ] If this contribution is large, please file an Apache [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.txt). --- You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam quick-start-nightly Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/1407.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1407 commit 6e67c76a1b90d73a498a7b340d0bec4e962b7eb2 Author: Pei He <pe...@google.com> Date: 2016-11-22T01:19:27Z Beam archetypes: enable snapshot repositories. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #1388: Move PerKeyCombineFnRunners to runners/co...
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1388 Move PerKeyCombineFnRunners to runners/core. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like: `[BEAM-] Description of pull request` - [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable Travis-CI on your fork and ensure the whole test matrix passes). - [ ] Replace `` in the title with the actual Jira issue number, if there is one. - [ ] If this contribution is large, please file an Apache [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.txt). --- You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam rm-keyed-combine-runners Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/1388.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1388 commit fcfcdd6ed7315c1a47864c09433b0aec02d6a21c Author: Pei He <pe...@google.com> Date: 2016-11-14T22:15:35Z Move PerKeyCombineFnRunners to runners/core. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #1359: [BEAM-978] Support bulk get file size in ...
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1359 [BEAM-978] Support bulk get file size in GcsUtil. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like: `[BEAM-] Description of pull request` - [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable Travis-CI on your fork and ensure the whole test matrix passes). - [ ] Replace `` in the title with the actual Jira issue number, if there is one. - [ ] If this contribution is large, please file an Apache [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.txt). --- You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam bulk-size Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/1359.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1359 commit 259f4ac3d709637cd140baf7b30ab8632b04fee3 Author: Pei He <pe...@google.com> Date: 2016-11-11T05:53:57Z [BEAM-978] Support bulk get file size in GcsUtil. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #1351: WordCountIT: uses input file with fewer k...
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1351 WordCountIT: uses input file with fewer keys. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like: `[BEAM-] Description of pull request` - [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable Travis-CI on your fork and ensure the whole test matrix passes). - [ ] Replace `` in the title with the actual Jira issue number, if there is one. - [ ] If this contribution is large, please file an Apache [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.txt). --- You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam small-file Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/1351.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1351 commit 7b2ec3964bc47ac605b22ff8da022510f045af44 Author: Pei He <pe...@google.com> Date: 2016-11-11T22:13:02Z WordCountIT: uses input with fewer keys. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #1341: Simplify FileOperations interface by refa...
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1341 Simplify FileOperations interface by refactoring removeDirectoryAndFiles() into FileBasedSink. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like: `[BEAM-] Description of pull request` - [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable Travis-CI on your fork and ensure the whole test matrix passes). - [ ] Replace `` in the title with the actual Jira issue number, if there is one. - [ ] If this contribution is large, please file an Apache [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.txt). --- You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam file-operations-refactor Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/1341.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1341 commit 29e6106d1a9c0d913770312dbaef0ab7accd5717 Author: Pei He <pe...@google.com> Date: 2016-11-10T20:50:16Z Simplify FileOperations interface by refactoring removeDirectoryAndFiles() into FileBasedSink. commit d28bd06e9972ceb05c162708431eead0c5ec40e0 Author: Pei He <pe...@google.com> Date: 2016-11-10T21:03:38Z FileIOChannelFactory.match() returns empty list instead of throw. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #1340: [BEAM-962] Fix games example pipeline opt...
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1340 [BEAM-962] Fix games example pipeline options default values conflicts. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like: `[BEAM-] Description of pull request` - [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable Travis-CI on your fork and ensure the whole test matrix passes). - [ ] Replace `` in the title with the actual Jira issue number, if there is one. - [ ] If this contribution is large, please file an Apache [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.txt). --- You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam leader-board Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/1340.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1340 commit b8b5aa2872a062f09ea9df5e1b67101079f6b8f8 Author: Pei He <pe...@google.com> Date: 2016-11-10T21:52:52Z [BEAM-962] Fix games example pipeline options default values conflicts. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #1331: [BEAM-954] FileBasedSink: remove unused c...
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1331 [BEAM-954] FileBasedSink: remove unused code of TemporaryFileRetention. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like: `[BEAM-] Description of pull request` - [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable Travis-CI on your fork and ensure the whole test matrix passes). - [ ] Replace `` in the title with the actual Jira issue number, if there is one. - [ ] If this contribution is large, please file an Apache [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.txt). --- You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam rm-retention Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/1331.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1331 commit 6871feaf22da2384b37ed09ac9c5a47a9a5dced6 Author: Pei He <pe...@google.com> Date: 2016-11-10T04:12:24Z [BEAM-954] FileBasedSink: remove unused code of TemporaryFileRetention. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #1328: [BEAM-951] FileBasedSink: merge FileOpera...
Github user peihe closed the pull request at: https://github.com/apache/incubator-beam/pull/1328 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #1329: [BEAM-951] FileBasedSink: merge FileOpera...
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1329 [BEAM-951] FileBasedSink: merge FileOperations into IOChannelFactory. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like: `[BEAM-] Description of pull request` - [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable Travis-CI on your fork and ensure the whole test matrix passes). - [ ] Replace `` in the title with the actual Jira issue number, if there is one. - [ ] If this contribution is large, please file an Apache [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.txt). --- You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam rm-file-operations Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/1329.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1329 commit 53fb4dbd8b102a807e4a70bb0c13d7a2496fbf22 Author: Pei He <pe...@google.com> Date: 2016-11-10T01:09:13Z [BEAM-951] FileBasedSink: merge FileOperations into IOChannelFactory. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #1328: [BEAM-951] FileBasedSink: merge FileOpera...
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1328 [BEAM-951] FileBasedSink: merge FileOperations into IOChannelFactory. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure the PR title is formatted like: `[BEAM-] Description of pull request` - [x] Make sure tests pass via `mvn clean verify`. (Even better, enable Travis-CI on your fork and ensure the whole test matrix passes). - [ ] Replace `` in the title with the actual Jira issue number, if there is one. - [ ] If this contribution is large, please file an Apache [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.txt). --- You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam io-channel-rename Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/1328.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1328 commit 8018fb50604d4ab97144edb00cb4a3913c7786e4 Author: Pei He <pe...@google.com> Date: 2016-11-02T22:38:27Z Add rename() to IOChannelFactory. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #1289: [BEAM-917] ExpectedLogs: clear saved reco...
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1289 [BEAM-917] ExpectedLogs: clear saved records after each test. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like: `[BEAM-] Description of pull request` - [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable Travis-CI on your fork and ensure the whole test matrix passes). - [ ] Replace `` in the title with the actual Jira issue number, if there is one. - [ ] If this contribution is large, please file an Apache [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.txt). --- You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam fix-expected-logger Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/1289.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1289 commit 9c09c352466b55b0a3fd67d72d44fc97fcbbc096 Author: Pei He <pe...@google.com> Date: 2016-11-05T01:45:47Z [BEAM-917] ExpectedLogs: clear saved records after each test. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #1280: [BEAM-895] Allow empty GCP credential for...
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1280 [BEAM-895] Allow empty GCP credential for pipelines that only access to public data. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like: `[BEAM-] Description of pull request` - [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable Travis-CI on your fork and ensure the whole test matrix passes). - [ ] Replace `` in the title with the actual Jira issue number, if there is one. - [ ] If this contribution is large, please file an Apache [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.txt). --- You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam validation Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/1280.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1280 commit a134d91e12b50e2a05aff2b2a9bc4c1dadb66c5f Author: Pei He <pe...@google.com> Date: 2016-11-03T20:47:45Z [BEAM-895] Allow empty GCP credential for pipelines that access to public data. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #1277: [BEAM-894] Using @Teardown to remove temp...
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1277 [BEAM-894] Using @Teardown to remove temp files from failed bundles in Write.WriteBundles. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like: `[BEAM-] Description of pull request` - [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable Travis-CI on your fork and ensure the whole test matrix passes). - [ ] Replace `` in the title with the actual Jira issue number, if there is one. - [ ] If this contribution is large, please file an Apache [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.txt). --- You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam write-teardown Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/1277.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1277 commit f420978a5bd17d26cc85be3bf7d6e841527c972e Author: Pei He <pe...@google.com> Date: 2016-11-03T19:56:35Z [BEAM-894] Using @Teardown to remove temp files from failed bundles in Write.WriteBundles --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #1259: Upgrade google-api-services-dataflow to v...
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1259 Upgrade google-api-services-dataflow to v1b3-rev43-1.22.0 Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like: `[BEAM-] Description of pull request` - [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable Travis-CI on your fork and ensure the whole test matrix passes). - [ ] Replace `` in the title with the actual Jira issue number, if there is one. - [ ] If this contribution is large, please file an Apache [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.txt). --- You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam patch-1 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/1259.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1259 commit 3eb4b95a2471253b6f8f1faf2023b9abf35a23f4 Author: peihe <pe...@users.noreply.github.com> Date: 2016-11-02T17:44:58Z Upgrade google-api-services-dataflow to v1b3-rev43-1.22.0 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #1255: [BEAM-59] Use ServiceLoader to register I...
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1255 [BEAM-59] Use ServiceLoader to register IOChannelFactories. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like: `[BEAM-] Description of pull request` - [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable Travis-CI on your fork and ensure the whole test matrix passes). - [ ] Replace `` in the title with the actual Jira issue number, if there is one. - [ ] If this contribution is large, please file an Apache [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.txt). --- You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam io-channel-register Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/1255.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1255 commit 18e204b7a0b90705e4b0fb41093a15341bffb996 Author: Pei He <pe...@google.com> Date: 2016-11-01T00:58:31Z [BEAM-59] Add use Factory interface in Gcs/File/IOChannelFactory. commit fd940fa32cc96933c85b2cf93306b6572b783d1a Author: Pei He <pe...@google.com> Date: 2016-11-01T01:01:41Z [BEAM-59] Create IOChannelFactoryFactoryRegistrar interface and its gcs/file implementations. commit f8b30dda94555e9dada829e7d626a2d3da952804 Author: Pei He <pe...@google.com> Date: 2016-11-01T01:02:49Z [BEAM-59] Use ServiceLoader to register IOChannelFactories in IOChannelUtils. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #1222: [Ignore, PR for discussion] Replace IOCha...
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1222 [Ignore, PR for discussion] Replace IOChannelFactory with IOChannelFactoryV2 Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like: `[BEAM-] Description of pull request` - [ ] Make sure tests pass via `mvn clean verify`. (Even better, enable Travis-CI on your fork and ensure the whole test matrix passes). - [ ] Replace `` in the title with the actual Jira issue number, if there is one. - [ ] If this contribution is large, please file an Apache [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.txt). --- You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam io-channel Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/1222.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1222 commit e8e70a1dc53ebfacecff63901e5d00d79b942ba7 Author: Pei He <pe...@google.com> Date: 2016-10-28T19:53:23Z Replace IOChannelFactory with IOChannelFactoryV2 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #1160: Remove checked exceptions from PipelineRe...
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1160 Remove checked exceptions from PipelineResult.waitUntilFinish interface. You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam update-waitUntilFinish Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/1160.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1160 commit 0add5895c271daef1bcf62c4c90a7e6408120a0f Author: Pei He <pe...@google.com> Date: 2016-10-22T00:38:21Z Remove checked exceptions from PipelineResult.waitUntilFinish interface. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #1159: [BEAM-790] Validate PipelineOptions Defau...
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1159 [BEAM-790] Validate PipelineOptions Default annotation. You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam validate-default-2 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/1159.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1159 commit 0e3d98128759148e789176c2f953b26878099014 Author: Pei He <pe...@google.com> Date: 2016-10-21T01:07:35Z [BEAM-790] Validate PipelineOptions Default annotation. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #1151: [BEAM-790] Refactor PipelineOptionsFactor...
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1151 [BEAM-790] Refactor PipelineOptionsFactory validation. You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam validate-default Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/1151.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1151 commit 9e097c9f7aff0a462289602b0439a8f3e9340681 Author: Pei He <pe...@google.com> Date: 2016-10-20T23:32:45Z [BEAM-790] Refactor PipelineOptionsFactory validation. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #1120: [BEAM-764] Remove cloneAs from PipelineOp...
Github user peihe closed the pull request at: https://github.com/apache/incubator-beam/pull/1120 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #1120: [BEAM-764] Remove cloneAs from PipelineOp...
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1120 [BEAM-764] Remove cloneAs from PipelineOptions Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure the PR title is formatted like: `[BEAM-] Description of pull request` - [x] Make sure tests pass via `mvn clean verify`. (Even better, enable Travis-CI on your fork and ensure the whole test matrix passes). - [x] Replace `` in the title with the actual Jira issue number, if there is one. - [ ] If this contribution is large, please file an Apache [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.txt). --- You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam rm-clone-as Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/1120.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1120 commit 044b47f0a9c91c92785f86d9879dbfba834c0276 Author: Pei He <pe...@google.com> Date: 2016-10-17T21:13:42Z [BEAM-764] Remove cloneAs from PipelineOptions --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #1119: [BEAM-763] Update BigQueryIOTest.testBuil...
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1119 [BEAM-763] Update BigQueryIOTest.testBuildSourceWithTableAndSqlDialect to NeedsRunner tests You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam change-bq-tests-to-needsRunners Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/1119.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1119 commit 3965dbdb184075333086a87448b2f153e66654e2 Author: Pei He <pe...@google.com> Date: 2016-10-17T20:13:52Z [BEAM-763] Update BigQueryIOTest.testBuildSourceWithTableAndSqlDialect to NeedsRunner tests. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #1097: [BEAM-443] Update Beam batch examples to ...
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1097 [BEAM-443] Update Beam batch examples to call waitUntilFinish() You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam waitInExample Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/1097.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1097 commit 6ac9e9930208dfdf0789a066243048e5a01c9f5e Author: Pei He <pe...@google.com> Date: 2016-10-13T21:44:13Z [BEAM-443] Update Beam batch examples to call waitUntilFinish() --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #1096: [BEAM-595] avoid throwing Exception in wa...
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1096 [BEAM-595] avoid throwing Exception in waitUntilFinish in SparkRunner You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam avoid-throw Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/1096.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1096 commit f7bf497e8cb035bb3b89f3dca64998f28720704f Author: Pei He <pe...@google.com> Date: 2016-10-13T21:14:15Z [BEAM-595] avoid throwing Exception in waitUntilFinish in SparkRunner --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #1079: [BEAM-739] Log exceptions full stack trac...
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1079 [BEAM-739] Log exceptions full stack track in IT tests R: @lukecwik @jasonkuster You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam log-stack-trace Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/1079.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1079 commit 3f70aeb2ba6a66b1b445253f5aba34e4074be6e8 Author: Pei He <pe...@google.com> Date: 2016-10-10T21:39:55Z [BEAM-739] Log exceptions full stack track in IT tests --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #1078: [BEAM-736] Fix BigQueryTornadoesIT, broke...
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1078 [BEAM-736] Fix BigQueryTornadoesIT, broken by PR-1039 R: @lukecwik You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam fix-test Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/1078.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1078 commit 72efd95df6bc89648f8c758092cf6e9229fda186 Author: Pei He <pe...@google.com> Date: 2016-10-10T21:30:30Z [BEAM-736] Fix BigQueryTornadoesIT, broken by PR-1039 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #1057: Ignore: test travis
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1057 Ignore: test travis You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam travis-test-archetype Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/1057.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1057 commit 06c28bbdec6537d672e2bd27ca71e483bd16a72c Author: Pei He <pe...@google.com> Date: 2016-10-05T22:52:57Z test travis --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #1042: BigQueryIO: port trivial fixes from Dataf...
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1042 BigQueryIO: port trivial fixes from Dataflow version. Will rebase once PR-1039 is merged You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam bq-beam-dataflow-consistency Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/1042.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1042 commit 95cbdea9f55395fa60f5795d88e1178804e22865 Author: Pei He <pe...@google.com> Date: 2016-10-04T02:37:02Z Forward port Dataflow PR-431 to Beam commit e42a4df4a414284a201a150bc7754570740ed644 Author: Pei He <pe...@google.com> Date: 2016-10-04T03:39:32Z Forward port Dataflow PR-454 to Beam commit 3659e99e46ee0420347de84ae6661c0fad410d94 Author: Pei He <pe...@google.com> Date: 2016-10-04T04:05:44Z Forward port Dataflow PR-453 to Beam commit 6c69d05352427586817af51e6e5221b9ac1d7890 Author: Pei He <pe...@google.com> Date: 2016-10-04T04:19:37Z BigQueryIO: port trivial fixes from Dataflow version. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #1039: Forward port Dataflow PR-431 to Beam
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1039 Forward port Dataflow PR-431 to Beam Forward port: https://github.com/GoogleCloudPlatform/DataflowJavaSDK/pull/431 You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam forward-port-111 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/1039.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #1039 commit c2bf18eecb57e3beff832972344434d7fb636f31 Author: Pei He <pe...@google.com> Date: 2016-10-04T02:37:02Z Forward port Dataflow PR-431 to Beam --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #997: Support BigQuery DATETIME and TIME types
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/997 Support BigQuery DATETIME and TIME types You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam bq-new-types Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/997.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #997 commit 0d22125f738d3fb03f54ff2528588cbc4d997885 Author: Pei He <pe...@google.com> Date: 2016-09-24T01:11:06Z Support BigQuery DATETIME and TIME types --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #995: In BigQueryIOTest, changes tests who expec...
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/995 In BigQueryIOTest, changes tests who expect failure to be NeedsRunner tests You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam BigQueryIOTest Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/995.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #995 commit 852c5942c9025af4cfc5c2bbf548acc34e09417b Author: Pei He <pe...@google.com> Date: 2016-09-23T23:11:24Z Update BigQueryIO tests who expect failure to be NeedsRunner tests --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #985: Support BigQuery DATE type
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/985 Support BigQuery DATE type You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam bq-new-types Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/985.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #985 commit 6c998f1b9e91dc0dfbd4cdf9cc4bf46bae9ca1bd Author: Pei He <pe...@google.com> Date: 2016-09-22T02:56:01Z Support BigQuery DATE type --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #977: Support BigQuery BYTES type
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/977 Support BigQuery BYTES type You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam bq-new-types Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/977.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #977 commit 274d228488a51ccf698aa7a1cb587f1fba43a8b6 Author: Pei He <pe...@google.com> Date: 2016-09-13T18:08:34Z Support BigQuery BYTES type --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #957: Remove PubsubFileInjector and IntraBundleP...
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/957 Remove PubsubFileInjector and IntraBundleParallelization You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam archetypes Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/957.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #957 commit fc96474804cdcd950663e7eaea5c140652a07c8e Author: peihe <hepeim...@gmail.com> Date: 2016-09-14T04:29:13Z Remove PubsubFileInjector and IntraBundleParallelization --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #948: Simple streaming text sink with windowing
Github user peihe closed the pull request at: https://github.com/apache/incubator-beam/pull/948 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #952: Forward port DataflowJavaSDK-351 to Beam
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/952 Forward port DataflowJavaSDK-351 to Beam You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam forward-port-2 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/952.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #952 commit 31bd5ba4bc44862c8042cdf6a79be8a6ebda49a4 Author: Pei He <pe...@google.com> Date: 2016-09-13T03:38:28Z Forward port DataflowJavaSDK-337 to Beam commit 0cca7beff337cbd3745dfb5d46ac253f86e45ff0 Author: Pei He <pe...@google.com> Date: 2016-09-13T04:02:35Z Forward port DataflowJavaSDK-351 to Beam --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #950: Port DataflowJavaSDK-337 to Beam
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/950 Port DataflowJavaSDK-337 to Beam Port PR "User friendly message for tempLocation." to Beam https://github.com/GoogleCloudPlatform/DataflowJavaSDK/pull/337 You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam forward-port Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/950.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #950 commit 5cef95db217edc4bfe34f212bdc8af8eeaf004be Author: Pei He <pe...@google.com> Date: 2016-09-13T03:38:28Z Forward port DataflowJavaSDK-337 to Beam --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #948: Simple streaming text sink with windowing
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/948 Simple streaming text sink with windowing mvn exec:java -Dexec.mainClass=org.apache.beam.examples.WordCount -Dexec.args="--output=./streaming-output-0 --runner=DirectRunner" It reads from unbounded counting source, groups inputs to one minute window, and writes each window to a file under ./streaming-output-0 . You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam streaming-write Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/948.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #948 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #936: Update Beam examples archetypes
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/936 Update Beam examples archetypes You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam archetypes Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/936.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #936 commit e25fb28b36d8f6acc3ff9c48e7a1d82a321c101e Author: Pei He <pe...@google.com> Date: 2016-09-09T02:16:12Z Update Beam examples archetypes --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #885: Remove the DataflowRunner instructions fro...
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/885 Remove the DataflowRunner instructions from examples You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam examples-cleanup-10 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/885.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #885 commit 69c35355d2665b442be7c453ecb3b16bd4cb2f5e Author: Pei He <pe...@google.com> Date: 2016-08-25T21:20:30Z Remove the DataflowRunner instructions from examples --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #880: Cleanup some javadoc that refers Dataflow
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/880 Cleanup some javadoc that refers Dataflow You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam examples-cleanup Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/880.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #880 commit c0844cff5002b64a63194f364985d3124049a128 Author: Pei He <pe...@google.com> Date: 2016-08-24T21:47:11Z Cleanup some javadoc that referring Dataflow --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #828: [BEAM-554] Set Gcs upload buffer size to 1...
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/828 [BEAM-554] Set Gcs upload buffer size to 1M in DataflowRunner streaming mode This PR solves OOMs when DataflowRunner streaming mode writes hundreds files in parallel. You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam gcs-buffer-size Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/828.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #828 commit ee88e16d74d3e8e4ea566243769ae9ecc587c47c Author: Pei He <pe...@google.com> Date: 2016-08-15T19:22:11Z Set Gcs upload buffer size to 1M in streaming mode in DataflowRunner --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #533: Make beam-examples run with spark runner
Github user peihe closed the pull request at: https://github.com/apache/incubator-beam/pull/533 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #762: [BEAM-443] Remove BlockingDataflowRunner
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/762 [BEAM-443] Remove BlockingDataflowRunner You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam rm-blocking-runner Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/762.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #762 commit c5850d0593f0c0fd6c64f9992f335b8eb42e7a66 Author: Pei He <pe...@google.com> Date: 2016-07-29T22:40:07Z Remove BlockingDataflowRunner --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #643: [BEAM-444] Promote isBlockOnRun to Pipelin...
Github user peihe closed the pull request at: https://github.com/apache/incubator-beam/pull/643 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #742: [BEAM-433] Remove references to DataflowPi...
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/742 [BEAM-433] Remove references to DataflowPipelineOptions You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam rm-dataflow-options Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/742.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #742 commit 9aad5c6ec034a10ded8c07e251f69213a0b0bdc8 Author: Pei He <pe...@google.com> Date: 2016-07-27T19:29:44Z [BEAM-433] Remove references to DataflowPipelineOptions --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #301: [BEAM-433] Remove Dataflow references in E...
Github user peihe closed the pull request at: https://github.com/apache/incubator-beam/pull/301 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #729: [BEAM-480] Move createTable() from BigQuer...
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/729 [BEAM-480] Move createTable() from BigQueryTableInserter to BigQueryServices You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam bq-services Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/729.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #729 commit fffb3d98f16132771c9a5e5de7699f7cacdb84f7 Author: Pei He <pe...@google.com> Date: 2016-07-25T18:02:10Z [BEAM-480] Move createTable() to BigQueryServices --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #720: Remove overrides of isStreaming() and getA...
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/720 Remove overrides of isStreaming() and getAppName() in SparkPipelineOptions isStreaming() is already default to false implicitly, since it is not set. getAppName() defaults to the name of the class that constructs the PipelineOptions via the PipelineOptionsFactory. I think both should work in Spark. And, I see no reason to override them. You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam spark-app-name Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/720.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #720 commit 7bbfef844caf31c14e3d0255d3073bec1d987476 Author: Pei He <pe...@google.com> Date: 2016-07-22T23:49:34Z Remove overrides of isStreaming() and getAppName() in SparkPipelineOptions --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #719: [BEAM-483] Moves NormalizedUniqueName to A...
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/719 [BEAM-483] Moves NormalizedUniqueName to ApplicationNameOptions, and uses it in runners. You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam job-name Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/719.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #719 commit e597582da820016f97709c847329237841a3ddd6 Author: Pei He <pe...@google.com> Date: 2016-07-22T23:40:54Z [BEAM-483] Move NormalizedUniqueName to ApplicationNameOptions --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #717: [BEAM-480] Move insertAll() from BigQueryT...
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/717 [BEAM-480] Move insertAll() from BigQueryTableInserter to BigQueryServices You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam log-request Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/717.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #717 commit 2d998bd8dd99c2c03420a70fbed0194b2df95d23 Author: Pei He <pe...@google.com> Date: 2016-07-22T22:03:38Z [BEAM-480] Move insertAll() to BigQueryServices --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #704: [BEAM-386] Remove StreamingCreate in Dataf...
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/704 [BEAM-386] Remove StreamingCreate in DataflowRunner Create is based on BoundedSource, and which is supported through UnboundedReadFromBoundedSource. You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam rm-streaming-create Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/704.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #704 commit 2e3fe2f7e13858f382090e2572f406b5f35da964 Author: Pei He <pe...@google.com> Date: 2016-07-20T22:47:05Z Remove StreamingCreate --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #643: Promote isBlockOnRun to PipelineOptions
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/643 Promote isBlockOnRun to PipelineOptions You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam blocking-options Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/643.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #643 commit 62bcb11940d5afa81b2effd9643deeaa2d33f4da Author: Pei He <pe...@google.com> Date: 2016-07-12T22:08:03Z Promote isBlockOnRun to PipelineOptions --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #642: [BEAM-443] Add waitToFinish() and cancel()...
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/642 [BEAM-443] Add waitToFinish() and cancel() in PipelineResult. You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam cancel-job Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/642.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #642 commit a42899098bd889e4649fe4a67a0c017733148b41 Author: Pei He <pe...@google.com> Date: 2016-07-12T02:42:02Z [BEAM-443] Add waitToFinish() and cancel() in PipelineResult. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #637: Remove getDataflowClient() from DataflowPi...
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/637 Remove getDataflowClient() from DataflowPipelineJob You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam PipelineResult-fixup Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/637.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #637 commit 23637cbd1d0fa008851829e46b392de84352c10a Author: Pei He <pe...@google.com> Date: 2016-07-12T04:29:26Z Remove getDataflowClient() from DataflowPipelineJob --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #634: [BEAM-433] Remove references to JobName in...
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/634 [BEAM-433] Remove references to JobName in examples pipeline options. You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam cleanup-examples-utils Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/634.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #634 commit 21e9918b14a6cff069c2e5857e31c69e0ab48447 Author: Pei He <pe...@google.com> Date: 2016-07-11T21:22:15Z [BEAM-433] Change the ExampleUtils constructor takes PipelineOptions commit 1ebb06781bd3e08c949e0516a81eb842d81e5eda Author: Pei He <pe...@google.com> Date: 2016-07-11T21:05:46Z [BEAM-433] Remove reference to JobName in examples pipeline options. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #631: [BEAM-433] Change the ExampleUtils constru...
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/631 [BEAM-433] Change the ExampleUtils constructor takes PipelineOptions You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam cleanup-examples-utils-0 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/631.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #631 commit 21e9918b14a6cff069c2e5857e31c69e0ab48447 Author: Pei He <pe...@google.com> Date: 2016-07-11T21:22:15Z [BEAM-433] Change the ExampleUtils constructor takes PipelineOptions --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #612: Remove isUnbounded option, and the corresp...
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/612 Remove isUnbounded option, and the corresponding ExampleUtils constructor You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam rm-unbounded-options Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/612.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #612 commit 72f3574de23b8c4ce16f0ffb6cfafc370c8e2ca1 Author: Pei He <pe...@google.com> Date: 2016-07-08T19:46:27Z Remove isUnbounded option, and the corresponding ExampleUtils constructor --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #605: Rename DataflowExampleUtils and DataflowEx...
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/605 Rename DataflowExampleUtils and DataflowExampleOptions You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam renaming Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/605.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #605 commit e1af028eed98e3b06b926f947494d46df0d9df36 Author: Pei He <pe...@google.com> Date: 2016-07-07T20:45:24Z Rename DataflowExampleUtils and DataflowExampleOptions --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #594: remove runInjectorPipeline from DataflowEx...
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/594 remove runInjectorPipeline from DataflowExampleUtils You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam streaming-examples-6 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/594.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #594 commit 05e6158debe9f4429404eb638cdf70150255667a Author: Pei He <pe...@google.com> Date: 2016-07-02T00:45:37Z Replace PubsubIO and injector with TextIO in AutoComplete and TriggerExample commit 0ea77d5382c1b023d8914eba56b5319fb813f7c3 Author: Pei He <pe...@google.com> Date: 2016-07-06T20:24:45Z remove runInjectorPipeline from DataflowExampleUtils --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #582: Replace PubsubIO and injector with TextIO ...
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/582 Replace PubsubIO and injector with TextIO in AutoComplete and TriggerExample You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam streaming-examples-5 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/582.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #582 commit 0408790eccfe440458519e9018d93b038d4c66d7 Author: Pei He <pe...@google.com> Date: 2016-07-02T00:45:37Z Replace PubsubIO and injector with TextIO in AutoComplete and TriggerExample --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #579: Replace PubsubIO and injector with TextIO ...
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/579 Replace PubsubIO and injector with TextIO in traffic examples You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam streaming-examples-4 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/579.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #579 commit 46b21045185aaf88d95a93d72b42ea37cfd088da Author: Pei He <pe...@google.com> Date: 2016-07-01T21:45:43Z Replace PubsubIO and injector with TextIO in traffic examples --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #559: [BEAM-389] Provide equals and hashCode in ...
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/559 [BEAM-389] Provide equals and hashCode in DelegateCoder You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam fix-delegate-coder-equals Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/559.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #559 commit c46f3bb7810d26fcd8964f0141ed121c72f926a1 Author: Pei He <pe...@google.com> Date: 2016-06-29T21:21:42Z Provide equals and hashCode in DelegateCoder --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #555: Replacing BigQuery direct calls with BigQu...
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/555 Replacing BigQuery direct calls with BigQueryServices abstraction You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam replace-bq-direct-calls Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/555.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #555 commit 7174de78bb2a255180d41a0c3b5b016ee730e053 Author: Pei He <pe...@google.com> Date: 2016-06-29T00:49:52Z Replacing BigQuery direct calls with BigQueryServices abstraction --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #550: Copy and use UnboundedReadFromBoundedSourc...
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/550 Copy and use UnboundedReadFromBoundedSource in dataflow runner and remove the injector pipeline from StreamingWordExtract You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam streaming-examples Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/550.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #550 commit 6f4ef7d009788cd024232832103ea501350f4caa Author: Pei He <pe...@google.com> Date: 2016-06-28T00:29:14Z Copy and use UnboundedReadFromBoundedSource in dataflow runner and remove the injector pipeline from StreamingWordExtract --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #549: Increase the MESSAGES_POLLING_ATTEMPTS for...
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/549 Increase the MESSAGES_POLLING_ATTEMPTS for slow backend starts You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam patch-2 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/549.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #549 commit 3478eae8e014f8fc7e7c360184b6e1ece61ef95d Author: peihe <pe...@users.noreply.github.com> Date: 2016-06-28T18:10:47Z Increase the MESSAGES_POLLING_ATTEMPTS for slow backend starts --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #546: Fix NPE in UnboundedReadFromBoundedSource
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/546 Fix NPE in UnboundedReadFromBoundedSource You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam fix-unbounded-read Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/546.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #546 commit bb59187d1ec63f0e016286d926245a0ef440eec9 Author: Pei He <pe...@google.com> Date: 2016-06-28T01:21:37Z Fix NPE in UnboundedReadFromBoundedSource --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #533: Make beam-examples run with spark runner
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/533 Make beam-examples run with spark runner You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam spark-examples Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/533.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #533 commit 2ac58283a90d0cd01b28038b63491f7e50bd6314 Author: Pei He <pe...@google.com> Date: 2016-06-24T22:22:59Z Make beam-examples run with spark runner --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #516: Enable dependency-plugin at global level.
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/516 Enable dependency-plugin at global level. Create the PR to trigger tests. It is not ready for review yet, since it will likely break the build. You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam fix-spark-dep Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/516.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #516 commit 3809d314f1c06094070d071c836c8fec09334963 Author: Pei He <pe...@google.com> Date: 2016-06-21T22:25:06Z Enable dependency-plugin at global level. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #511: Fix a typo in FlinkRunner.toString
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/511 Fix a typo in FlinkRunner.toString R: @tgroh @kennknowles You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam patch-1 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/511.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #511 commit a43aa7afc28c6f4e4daf014025cb6bc960badc99 Author: peihe <pe...@users.noreply.github.com> Date: 2016-06-21T18:05:46Z Fix a typo in FlinkRunner.toString --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #502: Move allowsDynamicSplitting to Reader, and...
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/502 Move allowsDynamicSplitting to Reader, and set it in CompressedSource. You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam compression Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/502.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #502 commit bff7dea2fa6184c6778c9bf046cbbcd080a79f2e Author: Pei He <pe...@google.com> Date: 2016-06-18T01:24:06Z Move allowsDynamicSplitting to Reader, and set it in CompressedSource. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #486: Remove references to javax.servlet.
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/486 Remove references to javax.servlet. You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam rm-javax Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/486.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #486 commit cdfab9ba95c3d0b32a8a46aa24b4895a9d261904 Author: Pei He <pe...@google.com> Date: 2016-06-17T20:02:58Z Remove references to javax.servlet. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #482: Turn on failOnWarning and ignore unused ru...
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/482 Turn on failOnWarning and ignore unused runners modules in example. You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam fix-example-pom Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/482.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #482 commit 107be094f783f95f3452f8f13db21f7c73378c57 Author: Pei He <pe...@google.com> Date: 2016-06-16T22:50:21Z Turn on failOnWarning and ignore unused runners modules in example. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #478: Remove the beam.examples dependency from f...
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/478 Remove the beam.examples dependency from flink You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam fix-flink-dep Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/478.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #478 commit 7e23753504270dfcd9792720dc1e4da6c77d3e76 Author: Pei He <pe...@google.com> Date: 2016-06-16T18:38:51Z Remove the beam.examples dependency from flink --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #455: Set trimStackTrace to false for WordCountI...
Github user peihe closed the pull request at: https://github.com/apache/incubator-beam/pull/455 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #455: Set trimStackTrace to false for WordCountI...
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/455 Set trimStackTrace to false for WordCountIT You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam set-trim Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/455.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #455 commit f3b46109085e86c058bd5378b15a0fe1bed1555d Author: Pei He <pe...@google.com> Date: 2016-06-13T23:47:59Z Set trimStackTrace to false for WordCountIT --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #454: Replace GcsPath by IOChannelFactory in Wor...
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/454 Replace GcsPath by IOChannelFactory in WordCount. You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam fix-wc Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/454.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #454 commit b8c79e70804e4c612b0e6fc0187254cada41a8c5 Author: Pei He <pe...@google.com> Date: 2016-06-13T23:58:01Z Replace GcsPath by IOChannelFactory in WordCount. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request #438: Temp location
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/438 Temp location You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam temp-location Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/438.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #438 commit 34d2055910f561c8d37d3bd4c3b406e783232f3a Author: Pei He <pe...@google.com> Date: 2016-06-08T23:46:14Z Remove defaulting tempLocation to stagingLocation commit 14f2a6f0f863ade9fb5bad104e984355769a0f50 Author: Pei He <pe...@google.com> Date: 2016-06-08T23:47:05Z Add GcpTempLocation, and use it as the default stagingLocation commit b51c56630a6c346650dbb61ad429f22e048c9108 Author: Pei He <pe...@google.com> Date: 2016-06-08T23:48:14Z Add BigQueryTempLocation --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request: Verify in unit test that BigQuery exe...
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/376 Verify in unit test that BigQuery executing project is used. You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam unit-test Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/376.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #376 commit 3a0f82dc875da8f4cca5af5d3659f28b11b6203b Author: Pei He <pe...@google.com> Date: 2016-05-23T21:57:59Z Verify in unit test that BigQuery executing project is used. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request: Code cleanup in BigQueryIO
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/369 Code cleanup in BigQueryIO 1. Use toJsonString() to avoid try catch 2. add getTableWithDefaultProject in BigQuery.Write You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/incubator-beam bq-cleanup Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/369.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #369 commit 6938a61345580cfb718b5f0e81e6f0ed5a25647e Author: Pei He <pe...@google.com> Date: 2016-05-21T00:16:58Z Code cleanup in BigQueryIO 1. Use toJsonString() to avoid try catch 2. add getTableWithDefaultProject in BigQuery.Write --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request: [Ignore this PR, trigger tests in a c...
Github user peihe closed the pull request at: https://github.com/apache/incubator-beam/pull/358 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request: [Ignore this PR, trigger test in a cl...
Github user peihe closed the pull request at: https://github.com/apache/incubator-beam/pull/359 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request: [Ignore this PR, trigger test in a cl...
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/359 [Ignore this PR, trigger test in a clean repo] UnboundedRead from a Bounded Source You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe-organization/incubator-beam test-unbounded-read Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/359.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #359 commit 3244795bb9b99c8125a6f5305cf5867650a3fe53 Author: Pei He <pe...@google.com> Date: 2016-05-09T22:59:58Z Add toUnbounded() to get a Unbounded Read from a Bounded Read. commit 0f901a76f0338c35d134007b834bed0d520b56a9 Author: Pei He <pe...@google.com> Date: 2016-05-16T21:38:13Z fixup: addressed feedback commit 06a738f767561bb5e6269ec99ebd6682c343aa95 Author: Pei He <pe...@google.com> Date: 2016-05-18T21:02:29Z fixup: addressed feedback commit e2b95133913248648fbf4f8ef94be61631f5f4a0 Author: Pei He <pe...@google.com> Date: 2016-05-18T23:11:30Z fixup: addressed feedback --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-beam pull request: [Ignore this PR, trigger tests in a c...
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/358 [Ignore this PR, trigger tests in a clean repo] Add BigQueryTornadoes integration test You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe-organization/incubator-beam run-test Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-beam/pull/358.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #358 commit 742fa3d44785e4d619771063919f6edc290aaa50 Author: Pei He <pe...@google.com> Date: 2016-05-19T00:46:24Z Add BigQueryTornadoes integration test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
