[GitHub] beam pull request #1900: [BEAM-59] Beam FileSystem: ResourceIdentifier and i...

2017-02-01 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/beam/pull/1900 [BEAM-59] Beam FileSystem: ResourceIdentifier and its local and gcs implementation. Be sure to do all of the following to help us incorporate your contribution quickly and easily

[GitHub] beam pull request #1911: Fix broken licenses check for in jenkins files.

2017-02-02 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/beam/pull/1911 Fix broken licenses check for in jenkins files. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted

[GitHub] beam pull request #1825: [BEAM-1258] Improve logging in BigQueryIO.verifyTab...

2017-01-23 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/beam/pull/1825 [BEAM-1258] Improve logging in BigQueryIO.verifyTableEmpty(). Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title

[GitHub] beam pull request #1823: [BEAM-1235] BigQueryIO.Write: log failed load/copy ...

2017-01-23 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/beam/pull/1823 [BEAM-1235] BigQueryIO.Write: log failed load/copy jobs. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title

[GitHub] beam pull request #1826: [BEAM-59] Beam FileSystem.setDefaultConfig: remove ...

2017-01-23 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/beam/pull/1826 [BEAM-59] Beam FileSystem.setDefaultConfig: remove scheme from the signature. Be sure to do all of the following to help us incorporate your contribution quickly and easily

[GitHub] beam pull request #1862: Upgrade google-auto-value to 1.3

2017-01-27 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/beam/pull/1862 Upgrade google-auto-value to 1.3 Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like

[GitHub] beam pull request #1808: [BEAM-59] Beam FileSystem: initial implementation.

2017-01-20 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/beam/pull/1808 [BEAM-59] Beam FileSystem: initial implementation. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title

[GitHub] beam pull request #1838: Refactor BigQueryServices to have TableReference in...

2017-01-24 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/beam/pull/1838 Refactor BigQueryServices to have TableReference in methods signatures. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure

[GitHub] beam pull request #1448: [BEAM-1009] Update to Mockito 2 with mockito-core m...

2017-02-13 Thread peihe
Github user peihe closed the pull request at: https://github.com/apache/beam/pull/1448 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] beam pull request #1968: [BEAM-1453] LocalResourceIdTest: disable unicode te...

2017-02-09 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/beam/pull/1968 [BEAM-1453] LocalResourceIdTest: disable unicode tests. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title

[GitHub] beam pull request #1977: [BEAM-59] GcsUtil: refactor and expose getObject() ...

2017-02-10 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/beam/pull/1977 [BEAM-59] GcsUtil: refactor and expose getObject() and listObjects() APIs. Be sure to do all of the following to help us incorporate your contribution quickly and easily

[GitHub] beam pull request #2022: [BEAM-59] Beam GcsFileSystem: implementation of mat...

2017-02-16 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/beam/pull/2022 [BEAM-59] Beam GcsFileSystem: implementation of match(). Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title

[GitHub] beam pull request #1759: [BEAM-1258] DONT_RETRY_NOT_FOUND in BigQueryService...

2017-01-10 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/beam/pull/1759 [BEAM-1258] DONT_RETRY_NOT_FOUND in BigQueryServicesImpl.isTableEmpty(). Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure

[GitHub] beam pull request #1760: [BEAM-1258] BigQueryServicesImpl.getTable() returns...

2017-01-10 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/beam/pull/1760 [BEAM-1258] BigQueryServicesImpl.getTable() returns null when tables not found. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make

[GitHub] beam-site pull request #191: Change peihe company affiliation to Alibaba.

2017-03-19 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/beam-site/pull/191 Change peihe company affiliation to Alibaba. You can merge this pull request into a Git repository by running: $ git pull https://github.com/peihe/beam-site asf-site Alternatively you can

[GitHub] beam pull request #2262: [BEAM-1739] fix IndexOutOfBoundsException when inde...

2017-03-17 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/beam/pull/2262 [BEAM-1739] fix IndexOutOfBoundsException when index in Create overflows. Two fixes includes: 1. Avoid integer overflow in Create. 2. Stop calling advance() in UnboundedReadFromBoundedSource

[GitHub] beam pull request #2628: Start jstorm runner moduel in feature branch with e...

2017-04-21 Thread peihe
Github user peihe closed the pull request at: https://github.com/apache/beam/pull/2628 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] beam pull request #2175: [BEAM-59] Beam FileSystems: add match(), copy(), re...

2017-03-06 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/beam/pull/2175 [BEAM-59] Beam FileSystems: add match(), copy(), rename(), delete() utilities. Be sure to do all of the following to help us incorporate your contribution quickly and easily

[GitHub] beam pull request #2457: Start jstorm runner moduel in feature branch with e...

2017-04-06 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/beam/pull/2457 Start jstorm runner moduel in feature branch with empty runner implementation. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make

[GitHub] beam pull request #3582: [BEAM-2630] TestPipeline: construct job/app names b...

2017-07-17 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/beam/pull/3582 [BEAM-2630] TestPipeline: construct job/app names based on Description in junit TestRule. Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make

[GitHub] beam pull request #3593: ReshuffleTest: replace Iterable equal tests with ma...

2017-07-19 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/beam/pull/3593 ReshuffleTest: replace Iterable equal tests with matchers. Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA issue](https

[GitHub] beam pull request #2672: Merge branch 'master' upto commit 686b774 into jsto...

2017-04-25 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/beam/pull/2672 Merge branch 'master' upto commit 686b774 into jstorm-runner Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title

[GitHub] beam pull request #3705: [BEAM-165] Initial implementation of the MapReduce ...

2017-08-08 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/beam/pull/3705 [BEAM-165] Initial implementation of the MapReduce runner. Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA issue](https

[GitHub] beam pull request #3734: to merge Pr-3624 with fixups

2017-08-18 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/beam/pull/3734 to merge Pr-3624 with fixups Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA issue](https://issues.apache.org/jira

[GitHub] beam pull request #3117: [BEAM-2280] Remove generated archetype folders.

2017-05-13 Thread peihe
Github user peihe closed the pull request at: https://github.com/apache/beam/pull/3117 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] beam pull request #3117: [BEAM-2280] Remove generated archetype folders.

2017-05-12 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/beam/pull/3117 [BEAM-2280] Remove generated archetype folders. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted

[GitHub] beam pull request #3446: [BEAM-210] WindowingStrategy: add OnTimeBehavior to...

2017-06-26 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/beam/pull/3446 [BEAM-210] WindowingStrategy: add OnTimeBehavior to control whether to emit empty ON_TIME pane. Be sure to do all of the following to help us incorporate your contribution quickly and easily

[GitHub] beam pull request #3245: Flink runner: specify CheckpointingMode and Checkpo...

2017-05-27 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/beam/pull/3245 Flink runner: specify CheckpointingMode and CheckpointingTimeout through PipelineOptions. Be sure to do all of the following to help us incorporate your contribution quickly and easily

[GitHub] beam pull request #3234: fix FlinkAccumulatorCombiningStateWithContext read ...

2017-05-26 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/beam/pull/3234 fix FlinkAccumulatorCombiningStateWithContext read null accum bug Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR

[GitHub] beam pull request #3235: Backport 2

2017-05-26 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/beam/pull/3235 Backport 2 Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like: `[BEAM-] Description

[GitHub] beam pull request #3289: Flink runner: support MapState in FlinkStateInterna...

2017-06-04 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/beam/pull/3289 Flink runner: support MapState in FlinkStateInternals. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title

[GitHub] beam pull request #3276: Flink runner: support per transform parallelism thr...

2017-06-01 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/beam/pull/3276 Flink runner: support per transform parallelism through PipelineOptions. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure

[GitHub] beam pull request #3275: Flink runner: refactor the translator into two phas...

2017-06-01 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/beam/pull/3275 Flink runner: refactor the translator into two phases: rewriting and translating. Be sure to do all of the following to help us incorporate your contribution quickly and easily

[GitHub] beam pull request #2823: Add JStormPipelineTranslator, TransformTranslator a...

2017-05-02 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/beam/pull/2823 Add JStormPipelineTranslator, TransformTranslator and TranslatorRegistry. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure

[GitHub] beam pull request #2823: Add JStormPipelineTranslator, TransformTranslator a...

2017-06-28 Thread peihe
Github user peihe closed the pull request at: https://github.com/apache/beam/pull/2823 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] beam pull request #3812: jstorm-runner: support SourceMetrics, distribution ...

2017-09-05 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/beam/pull/3812 jstorm-runner: support SourceMetrics, distribution metrics, and saves MetricsResults after cancelling. Follow this checklist to help us incorporate your contribution quickly and easily

[GitHub] beam pull request #3812: jstorm-runner: support SourceMetrics, distribution ...

2017-09-08 Thread peihe
Github user peihe closed the pull request at: https://github.com/apache/beam/pull/3812 ---

[GitHub] beam pull request #3792: [BEAM-2824]: support PipelineResult.waitUntilFinish...

2017-08-30 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/beam/pull/3792 [BEAM-2824]: support PipelineResult.waitUntilFinish() in JStormRunner local mode and uses it in TestJStormRunner. Follow this checklist to help us incorporate your contribution quickly and easily

[GitHub] beam pull request #3791: [BEAM-2824] support gauge and PipelineResults.metri...

2017-08-30 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/beam/pull/3791 [BEAM-2824] support gauge and PipelineResults.metrics() in local mode. Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA

[GitHub] beam pull request #3834: mr-runner: add mapreduce-runner profile for example...

2017-09-11 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/beam/pull/3834 mr-runner: add mapreduce-runner profile for examples, archetypes and … …IT tests. Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make

[GitHub] beam pull request #3807: [BEAM-1763] Ensure run waitUntilFinish in TestPipel...

2017-09-04 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/beam/pull/3807 [BEAM-1763] Ensure run waitUntilFinish in TestPipeline. Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA issue](https

[GitHub] beam pull request #3841: flink-runner: constructs exception string only when...

2017-09-12 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/beam/pull/3841 flink-runner: constructs exception string only when neccessary, it re… …duces per-element expensive calls(String.format and getSimpleName) in FlinkAssignContext. Follow this checklist

[GitHub] beam pull request #3806: jstorm-runner: handle UserCodeException in TestJSto...

2017-09-07 Thread peihe
Github user peihe closed the pull request at: https://github.com/apache/beam/pull/3806 ---

[GitHub] beam pull request #3739: [Ignore, Test] spark-runner: upgrade to spark 2.0.2...

2017-08-21 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/beam/pull/3739 [Ignore, Test] spark-runner: upgrade to spark 2.0.2. Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA issue](https

[GitHub] beam pull request #3705: [BEAM-165] Initial implementation of the MapReduce ...

2017-08-30 Thread peihe
GitHub user peihe reopened a pull request: https://github.com/apache/beam/pull/3705 [BEAM-165] Initial implementation of the MapReduce runner. Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA issue](https

[GitHub] beam pull request #3705: [BEAM-165] Initial implementation of the MapReduce ...

2017-08-30 Thread peihe
Github user peihe closed the pull request at: https://github.com/apache/beam/pull/3705 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] beam pull request #4091: Merge branch 'master' upto commit 269bf89 into mr-r...

2017-11-06 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/beam/pull/4091 Merge branch 'master' upto commit 269bf89 into mr-runner Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA issue](https

[GitHub] beam pull request #4107: Merge branch 'master' into jstorm-runner at commit ...

2017-11-08 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/beam/pull/4107 Merge branch 'master' into jstorm-runner at commit 727253e Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA issue](https