GitHub user manuzhang opened a pull request: https://github.com/apache/beam/pull/3292
[BEAM-79] Merge master into gearpump-runner Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like: `[BEAM-<Jira issue #>] Description of pull request` - [ ] Make sure tests pass via `mvn clean verify`. - [ ] Replace `<Jira issue #>` in the title with the actual Jira issue number, if there is one. - [ ] If this contribution is large, please file an Apache [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.pdf). --- You can merge this pull request into a Git repository by running: $ git pull https://github.com/manuzhang/beam sync-master Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/3292.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #3292 ---- commit 66e564e507b1ad5b9e379e043a193b556e1f3e76 Author: Borisa Zivkovic <borisa.zivko...@huawei.com> Date: 2017-05-15T08:24:10Z [BEAM-1702] Document how to use BigtableIO with local emulator commit 8ef812defc5237934f4f3efa6bd8c4c4240cd7d0 Author: Dan Halperin <dhalp...@google.com> Date: 2017-05-18T20:07:13Z This closes #3141 commit a8d2125e5783a556056e88dad8fe3c0a397920d5 Author: huafengw <fvunic...@gmail.com> Date: 2017-05-09T03:21:44Z [BEAM-659] WindowFn#isCompatible should provide a meaningful reason commit 8c572ef0b998a4fa529e2f4ba0e622b3db9f4ec6 Author: Kenneth Knowles <k...@google.com> Date: 2017-05-18T20:27:59Z This closes #2985: WindowFn#isCompatible should provide a meaningful reason commit 26a615e885b39f92dc81d383c8115906c280187a Author: Andrew Martin <andrewsmartin...@gmail.com> Date: 2017-05-18T19:52:09Z Remove incorrect `Message` bound on writeAvros commit 6a7eeeb932ffb33c876c0d11d7f325c47606d8de Author: Eugene Kirpichov <kirpic...@google.com> Date: 2017-05-18T20:52:33Z This closes #3176: Remove incorrect `Message` bound on writeAvros commit 790e7fe6653b926044d3dfecdccbc2fda9c998f0 Author: Thomas Groh <tg...@google.com> Date: 2017-03-21T22:06:58Z Add ParDos Add ParDoPayloadTranslator to PTransformTranslator commit 2e0cf008303ff5ed48268550b9fe3cd1aa748c15 Author: Thomas Groh <tg...@google.com> Date: 2017-05-18T22:41:17Z This closes #2597 commit 7a2e829c849d3828353994b8eddca4784a900aca Author: Eugene Kirpichov <kirpic...@google.com> Date: 2017-05-15T22:54:03Z Splits SplittableParDo into a core-construction part and a KWI-related part commit c93b3aa3d2081558a776fa12c564efb5f15090ab Author: Eugene Kirpichov <kirpic...@google.com> Date: 2017-05-18T23:15:00Z This closes #3156 commit 54808be14ff2e86088807adc3c0dc0965c8a6f03 Author: Dan Halperin <dhalp...@google.com> Date: 2017-05-18T22:43:31Z [BEAM-2318] Ensure that tables that don't exist are not created We use the same test table name in two tests: one that expects the table not to exist, another that creates the table. Obviously, the correctness of this will depend on the order in which unit tests are executed. Fix the flake by using different and more explicit test names. commit f458065dad0429ba2639510ea460cf7f2679ed36 Author: Dan Halperin <dhalp...@google.com> Date: 2017-05-18T23:41:41Z This closes #3179 commit 1da8da79dcc623c53b35d97419566b736447f6b6 Author: Dan Halperin <dhalp...@google.com> Date: 2017-05-18T20:19:29Z [BEAM-2391] Clone Scan in HBaseReader commit 49245080ad6393b5678077caa047f7a6ef0efffc Author: Ismaël MejÃa <ieme...@apache.org> Date: 2017-05-19T08:50:06Z This closes #3178 commit f969ea443c90345cf8c33f953c399e46223e8d03 Author: Luke Cwik <lc...@google.com> Date: 2017-05-15T20:39:12Z [BEAM-2252] Use pluginManagement instead of redefining maven-shade-plugin to inherit build order from root pom.xml commit ea5b9dabbfb55ff47a4f5983a8cbf04b0949c77c Author: Luke Cwik <lc...@google.com> Date: 2017-05-19T17:37:10Z [BEAM-2252] Use pluginManagement instead of redefining maven-shade-plugin to inherit build order from root pom.xml This closes #3152 commit 3efb34b8322ac5933d9d71255d67e99d8e8361d7 Author: Ahmet Altay <al...@google.com> Date: 2017-05-19T02:00:00Z update dataflow python container commit a58275a2f904ab1304de7ca5295f27a4f6df6f1d Author: Ahmet Altay <al...@google.com> Date: 2017-05-19T17:43:15Z This closes #3182 commit bac7bde5f878e6b2104c2e7cf3d01894a8f1b71d Author: Mark Liu <mark...@google.com> Date: 2017-05-17T21:24:25Z [BEAM-2164] Fix generate-sources.sh if directory contains space commit ce00d2466a9495f4eb262b5f7d2afec5788fcfe2 Author: Kenneth Knowles <k...@google.com> Date: 2017-05-19T17:44:54Z This closes #3171: [BEAM-2164] Fix generate-sources.sh if directory contains space commit c7bd2b43ddf726248291a653f8d7d796a51800a0 Author: Kenneth Knowles <k...@google.com> Date: 2017-05-19T18:40:20Z Move snappy-java version to dependencyManagement commit c4d14f8be7bb72fd653f1ab8e8080fc2b65f6672 Author: Colin Phipps <c...@moria.org.uk> Date: 2017-04-25T15:28:28Z Comply with byte limit for Datastore Commit. commit dcf405644e2b51303e1d2c12592fe82ee01eb32f Author: Colin Phipps <fi...@google.com> Date: 2017-05-09T09:40:50Z End-to-end test for large entity writes. commit de95c7f5bf3b8391486b898b0ffb1a0a05338725 Author: Colin Phipps <fi...@google.com> Date: 2017-05-09T15:07:51Z Make the large entities test neater. commit 9a6baefcd8668b145e86140f64b9d18c1c21890c Author: Eugene Kirpichov <kirpic...@google.com> Date: 2017-05-19T20:11:50Z This closes #2948: [BEAM-991] Comply with byte limit for Datastore Commit. commit 383329d6c35e50c8d907ac97522a64236bb98dd0 Author: Luke Cwik <lc...@google.com> Date: 2017-05-12T23:44:10Z [BEAM-1345] Remove FileSystems.setDefaultConfigInWorkers since Dataflow no longer depends on this commit 086148fa9bbdd53fb9684cbbf37346df5a0ec4df Author: Luke Cwik <lc...@google.com> Date: 2017-05-19T20:29:31Z [BEAM-1345] Remove FileSystems.setDefaultConfigInWorkers since Dataflow no longer depends on this This closes #3134 commit 6c6d7877620af5265ed5ca14dd2ed7cd905b7404 Author: wtanaka.com <wtan...@yahoo.com> Date: 2017-05-19T06:42:46Z [BEAM-2293] Rename Top.{Largest,Smallest=>Natural,Reversed} - [x] Make sure the PR title is formatted like: `[BEAM-<Jira issue #>] Description of pull request` - [x] Make sure tests pass via `mvn clean verify`. (Even better, enable Travis-CI on your fork and ensure the whole test matrix passes). - [x] Replace `<Jira issue #>` in the title with the actual Jira issue number, if there is one. - [x] If this contribution is large, please file an Apache [Individual Contributor License Agreement](https://www.apache.org/licenses/icla.pdf). --- commit 64cea06b1c1cbb1413b0ec570d675975bbbc20ba Author: Luke Cwik <lc...@google.com> Date: 2017-05-19T21:11:02Z [BEAM-2293] Rename Top.{Largest,Smallest=>Natural,Reversed} This closes #3139 commit 2ed68f7f49a6f84921b0de03a57b0bbe61d263a7 Author: Luke Cwik <lc...@google.com> Date: 2017-05-15T22:43:00Z [BEAM-2253] Use resource transformer plugin to use versions defined in root pom.xml within maven archetype poms ---- --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---