[GitHub] beam pull request #3250: [Beam-2010] expose programming interface

2017-05-27 Thread XuMingmin
GitHub user XuMingmin opened a pull request: https://github.com/apache/beam/pull/3250 [Beam-2010] expose programming interface It's the DSL implementation described in [Apache Beam: design of DSL SQL interface](https://docs.google.com/docum

[GitHub] beam pull request #3250: [BEAM-2010] expose programming interface

2017-06-05 Thread XuMingmin
Github user XuMingmin closed the pull request at: https://github.com/apache/beam/pull/3250 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] beam pull request #3314: sync-up DSL_SQL from Master

2017-06-07 Thread XuMingmin
GitHub user XuMingmin opened a pull request: https://github.com/apache/beam/pull/3314 sync-up DSL_SQL from Master pull latest code from `master` branch to `DSL_SQL` branch. You can merge this pull request into a Git repository by running: $ git pull https://github.com/apache

[GitHub] beam pull request #3323: upgrade to 2.1.0-SNAPSHOT

2017-06-07 Thread XuMingmin
GitHub user XuMingmin opened a pull request: https://github.com/apache/beam/pull/3323 upgrade to 2.1.0-SNAPSHOT upgrade to version 2.1.0-SNAPSHOT in branch `DSL_SQL`. You can merge this pull request into a Git repository by running: $ git pull https://github.com/XuMingmin/beam

[GitHub] beam pull request #3340: [BEAM-2433] unify SQL/Sql words in class name

2017-06-09 Thread XuMingmin
GitHub user XuMingmin opened a pull request: https://github.com/apache/beam/pull/3340 [BEAM-2433] unify SQL/Sql words in class name Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted

[GitHub] beam pull request #3342: [BEAM-2436] table is not regeisted in BeamSql.query

2017-06-10 Thread XuMingmin
GitHub user XuMingmin opened a pull request: https://github.com/apache/beam/pull/3342 [BEAM-2436] table is not regeisted in BeamSql.query R: @takidau @xumingming CC: @lukecwik You can merge this pull request into a Git repository by running: $ git pull https://github.com

[GitHub] beam pull request #3340: [BEAM-2433] unify SQL/Sql words in class name

2017-06-12 Thread XuMingmin
Github user XuMingmin closed the pull request at: https://github.com/apache/beam/pull/3340 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] beam pull request #3342: [BEAM-2436] table is not regeisted in BeamSql.query

2017-06-13 Thread XuMingmin
Github user XuMingmin closed the pull request at: https://github.com/apache/beam/pull/3342 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] beam pull request #3371: [BEAM-2452] Update filter/project/aggregation tests...

2017-06-15 Thread XuMingmin
GitHub user XuMingmin opened a pull request: https://github.com/apache/beam/pull/3371 [BEAM-2452] Update filter/project/aggregation tests with BeamSql R: @xumingming @takidau You can merge this pull request into a Git repository by running: $ git pull https://github.com

[GitHub] beam pull request #3372: [BEAM-2446] restrict scope of BeamSqlEnv in dsl que...

2017-06-15 Thread XuMingmin
GitHub user XuMingmin opened a pull request: https://github.com/apache/beam/pull/3372 [BEAM-2446] restrict scope of BeamSqlEnv in dsl query R: @xumingming @takidau You can merge this pull request into a Git repository by running: $ git pull https://github.com/XuMingmin/beam

[GitHub] beam pull request #3371: [BEAM-2452] Update filter/project/aggregation tests...

2017-06-16 Thread XuMingmin
Github user XuMingmin closed the pull request at: https://github.com/apache/beam/pull/3371 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] beam pull request #2482: [BEAM-1922] DataSource in JdbcIO is not closed

2017-04-10 Thread XuMingmin
GitHub user XuMingmin opened a pull request: https://github.com/apache/beam/pull/2482 [BEAM-1922] DataSource in JdbcIO is not closed add `close()` for `BasicDataSource`. When user call with `DataSourceConfiguration.create(dataSource)`, it's not available as no `close()` meth

[GitHub] beam pull request #2479: [BEAM-301] Add a Beam SQL DSL

2017-04-12 Thread XuMingmin
Github user XuMingmin closed the pull request at: https://github.com/apache/beam/pull/2479 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] beam pull request #2530: [BEAM-301] Add a Beam SQL DSL

2017-04-13 Thread XuMingmin
GitHub user XuMingmin opened a pull request: https://github.com/apache/beam/pull/2530 [BEAM-301] Add a Beam SQL DSL 1. add `checkstyle` to `dsls` module, and update as indicated; 2. correct the package name from `org.beam.dsls.sql` to `org.apache.beam.dsls.sql`; You can merge

[GitHub] beam-site pull request #195: [BEAM-1797] add CoGroupByKey to chapter 'Using ...

2017-04-17 Thread XuMingmin
Github user XuMingmin closed the pull request at: https://github.com/apache/beam-site/pull/195 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] beam pull request #2458: [Beam-1705]: add method in Pipeline to visualize th...

2017-04-18 Thread XuMingmin
Github user XuMingmin closed the pull request at: https://github.com/apache/beam/pull/2458 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] beam pull request #2603: [BEAM-2019] Count.globally() requires default value...

2017-04-19 Thread XuMingmin
GitHub user XuMingmin opened a pull request: https://github.com/apache/beam/pull/2603 [BEAM-2019] Count.globally() requires default values for non-GlobalWindows fix below error of Count.globally() when not using `GlobalWindows`: ``` Exception in thread "

[GitHub] beam pull request #2622: [BEAM-1917] add 'equal' function to Filter

2017-04-20 Thread XuMingmin
GitHub user XuMingmin opened a pull request: https://github.com/apache/beam/pull/2622 [BEAM-1917] add 'equal' function to Filter a minor change to add `equal` in [Filter.java](https://github.com/apache/beam/blob/master/sdks/java/core/src/main/java/org/apache/beam/sdk/

[GitHub] beam pull request #2656: [BEAM-2018] refine expression of Calcite method/fun...

2017-04-22 Thread XuMingmin
GitHub user XuMingmin opened a pull request: https://github.com/apache/beam/pull/2656 [BEAM-2018] refine expression of Calcite method/function In this PR, `BeamSQLFnExecutor` is introduced to replace `BeamSQLSpELExecutor`, as the executor of `SqlOperator` expressions

[GitHub] beam pull request #3633: [BEAM-2676] move BeamSqlRow and BeamSqlRowType to s...

2017-07-24 Thread XuMingmin
GitHub user XuMingmin opened a pull request: https://github.com/apache/beam/pull/3633 [BEAM-2676] move BeamSqlRow and BeamSqlRowType to sdk/java/core It contains two parts: 1. remove SQL word in the name, `BeamSqlRow` --> `BeamRow` `BeamSqlRowType` --> `BeamR

[GitHub] beam pull request #3648: sync-up from master branch

2017-07-26 Thread XuMingmin
GitHub user XuMingmin opened a pull request: https://github.com/apache/beam/pull/3648 sync-up from master branch BEAM-2672 requires a new function added in #3628 You can merge this pull request into a Git repository by running: $ git pull https://github.com/apache/beam master

[GitHub] beam pull request #3633: [BEAM-2676] move BeamSqlRow and BeamSqlRowType to s...

2017-08-02 Thread XuMingmin
Github user XuMingmin closed the pull request at: https://github.com/apache/beam/pull/3633 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] beam pull request #3675: [BEAM-2676] move BeamSqlRow and BeamSqlRowType to s...

2017-08-02 Thread XuMingmin
GitHub user XuMingmin opened a pull request: https://github.com/apache/beam/pull/3675 [BEAM-2676] move BeamSqlRow and BeamSqlRowType to sdk/java/core create a new PR to get rid of the huge rebase work after #3666. Following the discussion in [BEAM-2676](https

[GitHub] beam pull request #3675: [BEAM-2676] move BeamSqlRow and BeamSqlRowType to s...

2017-08-04 Thread XuMingmin
Github user XuMingmin closed the pull request at: https://github.com/apache/beam/pull/3675 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] beam pull request #3689: [BEAM-2722] Remove redundant windowing information ...

2017-08-04 Thread XuMingmin
GitHub user XuMingmin opened a pull request: https://github.com/apache/beam/pull/3689 [BEAM-2722] Remove redundant windowing information from the BeamRecord itself R: @robertwb You can merge this pull request into a Git repository by running: $ git pull https://github.com

[GitHub] beam pull request #3691: [BEAM-2725] remove nullFields in BeamRecord

2017-08-04 Thread XuMingmin
GitHub user XuMingmin opened a pull request: https://github.com/apache/beam/pull/3691 [BEAM-2725] remove nullFields in BeamRecord R: @robertwb You can merge this pull request into a Git repository by running: $ git pull https://github.com/XuMingmin/beam BEAM-2725

[GitHub] beam pull request #3692: [BEAM-2730] make BeamRecord an immutable type

2017-08-04 Thread XuMingmin
GitHub user XuMingmin opened a pull request: https://github.com/apache/beam/pull/3692 [BEAM-2730] make BeamRecord an immutable type @robertwb Ps, some lines are expected to delete with #3691 and #3689 You can merge this pull request into a Git repository by running

[GitHub] beam pull request #3692: [BEAM-2730] make BeamRecord an immutable type

2017-08-08 Thread XuMingmin
Github user XuMingmin closed the pull request at: https://github.com/apache/beam/pull/3692 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] beam pull request #3706: [BEAM-2749] update BeamSqlExample

2017-08-08 Thread XuMingmin
GitHub user XuMingmin opened a pull request: https://github.com/apache/beam/pull/3706 [BEAM-2749] update BeamSqlExample R: @takidau You can merge this pull request into a Git repository by running: $ git pull https://github.com/XuMingmin/beam BEAM-2749 Alternatively you can

[GitHub] beam pull request #3707: [BEAM-2748] accept SerializableFunction as UDF

2017-08-08 Thread XuMingmin
GitHub user XuMingmin opened a pull request: https://github.com/apache/beam/pull/3707 [BEAM-2748] accept SerializableFunction as UDF R: @takidau @xumingming You can merge this pull request into a Git repository by running: $ git pull https://github.com/XuMingmin/beam BEAM

[GitHub] beam pull request #3706: [BEAM-2749] update BeamSqlExample

2017-08-09 Thread XuMingmin
Github user XuMingmin closed the pull request at: https://github.com/apache/beam/pull/3706 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] beam pull request #3710: [BEAM-2741] update JavaDoc for BeamRecord

2017-08-09 Thread XuMingmin
GitHub user XuMingmin opened a pull request: https://github.com/apache/beam/pull/3710 [BEAM-2741] update JavaDoc for BeamRecord R: @takidau @xumingming Ps, the change of `BeamSqlUdfExpression` is to address the question in #3707 You can merge this pull request into a Git

[GitHub] beam pull request #3707: [BEAM-2748] accept SerializableFunction as UDF

2017-08-09 Thread XuMingmin
Github user XuMingmin closed the pull request at: https://github.com/apache/beam/pull/3707 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] beam pull request #3710: [BEAM-2741] update JavaDoc for BeamRecord

2017-08-10 Thread XuMingmin
Github user XuMingmin closed the pull request at: https://github.com/apache/beam/pull/3710 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] beam pull request #3716: [BEAM-2747] accept CombineFn as UDAF

2017-08-10 Thread XuMingmin
GitHub user XuMingmin opened a pull request: https://github.com/apache/beam/pull/3716 [BEAM-2747] accept CombineFn as UDAF Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA issue](https://issues.apache.org

[GitHub] beam pull request #3716: [BEAM-2747] accept CombineFn as UDAF

2017-08-11 Thread XuMingmin
Github user XuMingmin closed the pull request at: https://github.com/apache/beam/pull/3716 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] beam pull request #3648: sync-up from master branch

2017-08-16 Thread XuMingmin
Github user XuMingmin closed the pull request at: https://github.com/apache/beam/pull/3648 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] beam pull request #3606: [BEAM-301] Merge DSL_SQL to Master

2017-08-16 Thread XuMingmin
Github user XuMingmin closed the pull request at: https://github.com/apache/beam/pull/3606 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] beam pull request #3752: [BEAM-2798] rename simpleQuery to query and query t...

2017-08-23 Thread XuMingmin
GitHub user XuMingmin opened a pull request: https://github.com/apache/beam/pull/3752 [BEAM-2798] rename simpleQuery to query and query to queryMulti R: @takidau @xumingming You can merge this pull request into a Git repository by running: $ git pull https://github.com

[GitHub] beam-site pull request #224: [BEAM-2078] add BeamSQL feature branch in site

2017-04-25 Thread XuMingmin
GitHub user XuMingmin opened a pull request: https://github.com/apache/beam-site/pull/224 [BEAM-2078] add BeamSQL feature branch in site You can merge this pull request into a Git repository by running: $ git pull https://github.com/XuMingmin/beam-site BEAM-2078

[GitHub] beam pull request #2784: [BEAM-2125] update JavaDoc of BoundedWindow

2017-04-29 Thread XuMingmin
GitHub user XuMingmin opened a pull request: https://github.com/apache/beam/pull/2784 [BEAM-2125] update JavaDoc of BoundedWindow Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted

[GitHub] beam-site pull request #226: [BEAM-2078] add BeamSQL feature branch in site

2017-04-29 Thread XuMingmin
GitHub user XuMingmin opened a pull request: https://github.com/apache/beam-site/pull/226 [BEAM-2078] add BeamSQL feature branch in site create a new PR as previous #224 edited the wrong file. You can merge this pull request into a Git repository by running: $ git pull https

[GitHub] beam pull request #2837: [BEAM-2134] expose AUTO_COMMIT to KafkaIO.read()

2017-05-02 Thread XuMingmin
GitHub user XuMingmin opened a pull request: https://github.com/apache/beam/pull/2837 [BEAM-2134] expose AUTO_COMMIT to KafkaIO.read() …e visible. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure

[GitHub] beam pull request #2339: [BEAM-1805] a new option `asInnerJoin` for CoGroupB...

2017-05-02 Thread XuMingmin
Github user XuMingmin closed the pull request at: https://github.com/apache/beam/pull/2339 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] beam pull request #2878: Forward integrate from `master` to `DSL_SQL`

2017-05-03 Thread XuMingmin
GitHub user XuMingmin opened a pull request: https://github.com/apache/beam/pull/2878 Forward integrate from `master` to `DSL_SQL` To fix the unit test failure `org.apache.beam.examples.WordCountIT.testE2EWordCount` You can merge this pull request into a Git repository by running

[GitHub] beam pull request #2656: [BEAM-2018] refine expression of Calcite method/fun...

2017-05-04 Thread XuMingmin
Github user XuMingmin closed the pull request at: https://github.com/apache/beam/pull/2656 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] beam pull request #2903: [BEAM-2006] window support

2017-05-04 Thread XuMingmin
GitHub user XuMingmin opened a pull request: https://github.com/apache/beam/pull/2903 [BEAM-2006] window support Add support for aggregation: global, `HOP`, `TUMBLE`, `SESSION`, only aggregation function `COUNT` Some other changes: 1. upgrade to Apache Calcite 1.12.0

[GitHub] beam pull request #3372: [BEAM-2446] restrict scope of BeamSqlEnv in dsl que...

2017-06-22 Thread XuMingmin
Github user XuMingmin closed the pull request at: https://github.com/apache/beam/pull/3372 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] beam pull request #3427: [BEAM-2503] use static table name in BeamSql.simple...

2017-06-22 Thread XuMingmin
GitHub user XuMingmin opened a pull request: https://github.com/apache/beam/pull/3427 [BEAM-2503] use static table name in BeamSql.simpleQuery R: @takidau As discussed in #3372, here's the part to use fixed table name `PCOLLECTION` in `BeamSql.simpleQuery`. You can

[GitHub] beam pull request #3447: [BEAM-2287] UDAF support

2017-06-26 Thread XuMingmin
GitHub user XuMingmin opened a pull request: https://github.com/apache/beam/pull/3447 [BEAM-2287] UDAF support R: @xumingming @takidau add an abstract class `BeamSqlUdaf` following the UDAF definition in Calcite, also COUNT/SUM/AVG/MAX/MIN/ are rewritten with this new

[GitHub] beam pull request #3477: [BEAM-2527] Test queries on unbounded PCollections ...

2017-06-29 Thread XuMingmin
GitHub user XuMingmin opened a pull request: https://github.com/apache/beam/pull/3477 [BEAM-2527] Test queries on unbounded PCollections with BeamSql dsl API R: @xumingming @takidau You can merge this pull request into a Git repository by running: $ git pull https

[GitHub] beam pull request #3447: [BEAM-2287] UDAF support

2017-06-30 Thread XuMingmin
Github user XuMingmin closed the pull request at: https://github.com/apache/beam/pull/3447 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] beam pull request #3491: [BEAM-2520] add UDF/UDAF in BeamSql.query/simpleQue...

2017-07-02 Thread XuMingmin
GitHub user XuMingmin opened a pull request: https://github.com/apache/beam/pull/3491 [BEAM-2520] add UDF/UDAF in BeamSql.query/simpleQuery You can merge this pull request into a Git repository by running: $ git pull https://github.com/XuMingmin/beam BEAM-2520 Alternatively

[GitHub] beam pull request #3527: [BEAM-2204] support TUMBLE/HOP/SESSION_START

2017-07-09 Thread XuMingmin
GitHub user XuMingmin opened a pull request: https://github.com/apache/beam/pull/3527 [BEAM-2204] support TUMBLE/HOP/SESSION_START *_START function is supported for TUMBLE/HOP/SESSION window, however *_END is not available due to some issue with Calcite relational expressions, need

[GitHub] beam pull request #3530: [BEAM-2574] test unsupported/invalid cases in DSL

2017-07-09 Thread XuMingmin
GitHub user XuMingmin opened a pull request: https://github.com/apache/beam/pull/3530 [BEAM-2574] test unsupported/invalid cases in DSL R: @xumingming @takidau You can merge this pull request into a Git repository by running: $ git pull https://github.com/XuMingmin/beam BEAM

[GitHub] beam pull request #3530: [BEAM-2574] test unsupported/invalid cases in DSL

2017-07-11 Thread XuMingmin
Github user XuMingmin closed the pull request at: https://github.com/apache/beam/pull/3530 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] beam pull request #3477: [BEAM-2527] Test queries on unbounded PCollections ...

2017-07-12 Thread XuMingmin
Github user XuMingmin closed the pull request at: https://github.com/apache/beam/pull/3477 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] beam pull request #3527: [BEAM-2204] support TUMBLE/HOP/SESSION_START

2017-07-12 Thread XuMingmin
Github user XuMingmin closed the pull request at: https://github.com/apache/beam/pull/3527 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] beam pull request #3552: [BEAM-2585] add math function RAND_INTEGER and RAND

2017-07-12 Thread XuMingmin
GitHub user XuMingmin opened a pull request: https://github.com/apache/beam/pull/3552 [BEAM-2585] add math function RAND_INTEGER and RAND R: @xumingming @takidau You can merge this pull request into a Git repository by running: $ git pull https://github.com/XuMingmin/beam

[GitHub] beam pull request #3491: [BEAM-2520] add UDF/UDAF in BeamSql.query/simpleQue...

2017-07-12 Thread XuMingmin
Github user XuMingmin closed the pull request at: https://github.com/apache/beam/pull/3491 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] beam pull request #3553: [BEAM-2610] upgrade to version 2.2.0

2017-07-12 Thread XuMingmin
GitHub user XuMingmin opened a pull request: https://github.com/apache/beam/pull/3553 [BEAM-2610] upgrade to version 2.2.0 As described in task [BEAM-2610](https://issues.apache.org/jira/browse/BEAM-2610), this is the first PR to do the job. Feel free to merge it if no mis

[GitHub] beam pull request #3554: [BEAM-2610] upgrade to version 2.2.0

2017-07-12 Thread XuMingmin
GitHub user XuMingmin opened a pull request: https://github.com/apache/beam/pull/3554 [BEAM-2610] upgrade to version 2.2.0 placeholder for 2nd PR, may need update after #3553 You can merge this pull request into a Git repository by running: $ git pull https://github.com

[GitHub] beam pull request #3553: [BEAM-2610] upgrade to version 2.2.0

2017-07-12 Thread XuMingmin
Github user XuMingmin closed the pull request at: https://github.com/apache/beam/pull/3553 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] beam pull request #3560: [BEAM-2562] Add integration test for logical operat...

2017-07-13 Thread XuMingmin
GitHub user XuMingmin opened a pull request: https://github.com/apache/beam/pull/3560 [BEAM-2562] Add integration test for logical operators R: @xumingming @takidau @jbonofre You can merge this pull request into a Git repository by running: $ git pull https://github.com

[GitHub] beam pull request #3553: [BEAM-2610] upgrade to version 2.2.0

2017-07-13 Thread XuMingmin
GitHub user XuMingmin reopened a pull request: https://github.com/apache/beam/pull/3553 [BEAM-2610] upgrade to version 2.2.0 As described in task [BEAM-2610](https://issues.apache.org/jira/browse/BEAM-2610), this is the first PR to do the job. Feel free to merge it if no mis

[GitHub] beam pull request #3553: [BEAM-2610] upgrade to version 2.2.0

2017-07-13 Thread XuMingmin
Github user XuMingmin closed the pull request at: https://github.com/apache/beam/pull/3553 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] beam pull request #3561: [BEAM-2609] refine UDF interface

2017-07-13 Thread XuMingmin
GitHub user XuMingmin opened a pull request: https://github.com/apache/beam/pull/3561 [BEAM-2609] refine UDF interface A proposal solution for UDF interface. You can merge this pull request into a Git repository by running: $ git pull https://github.com/XuMingmin/beam BEAM

[GitHub] beam pull request #3569: [BEAM-2563] Add integration test for math operators

2017-07-16 Thread XuMingmin
GitHub user XuMingmin opened a pull request: https://github.com/apache/beam/pull/3569 [BEAM-2563] Add integration test for math operators Add integration test for built-in MATH functions, Misc: 1. no SQRT in Calcite, converted to POWER; 2. add DECIMAL in

[GitHub] beam pull request #3560: [BEAM-2562] Add integration test for logical operat...

2017-07-17 Thread XuMingmin
Github user XuMingmin closed the pull request at: https://github.com/apache/beam/pull/3560 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] beam pull request #3552: [BEAM-2585] add math function RAND_INTEGER and RAND

2017-07-18 Thread XuMingmin
Github user XuMingmin closed the pull request at: https://github.com/apache/beam/pull/3552 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] beam pull request #3569: [BEAM-2563] Add integration test for math operators

2017-07-19 Thread XuMingmin
Github user XuMingmin closed the pull request at: https://github.com/apache/beam/pull/3569 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] beam pull request #3602: Revert "[BEAM-2610] This closes #3553"

2017-07-20 Thread XuMingmin
GitHub user XuMingmin opened a pull request: https://github.com/apache/beam/pull/3602 Revert "[BEAM-2610] This closes #3553" This reverts commit ec494f675aa73fbdc7929f9592f33951941962b0, reversing changes made to d89d1ee1a3085269cdf44ec50e29a95c8f43757b. F

[GitHub] beam pull request #3603: redo PR 3553

2017-07-20 Thread XuMingmin
GitHub user XuMingmin opened a pull request: https://github.com/apache/beam/pull/3603 redo PR 3553 Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA issue](https://issues.apache.org/jira/projects/BEAM

[GitHub] beam pull request #3605: [BEAM-2555] add README page in dsl/sql

2017-07-20 Thread XuMingmin
GitHub user XuMingmin opened a pull request: https://github.com/apache/beam/pull/3605 [BEAM-2555] add README page in dsl/sql 1. remove README.md to keep align with other BEAM modules; 2. update usages in BeamSqlExample; You can merge this pull request into a Git repository by

[GitHub] beam pull request #3606: Merge DSL_SQL to Master

2017-07-20 Thread XuMingmin
GitHub user XuMingmin opened a pull request: https://github.com/apache/beam/pull/3606 Merge DSL_SQL to Master Merge DSL_SQL feature branch back to master branch, with Beam SQL DSL function is ready to use. Resources: 1. thread in apache-beam-dev mail-list https

[GitHub] beam pull request #3614: [BEAM-2652] cleanup pom.xml

2017-07-21 Thread XuMingmin
GitHub user XuMingmin opened a pull request: https://github.com/apache/beam/pull/3614 [BEAM-2652] cleanup pom.xml R: @kennknowles @rangadi @rangadi I also update pom.xml in kafka-io as now kafka-client is shared in multiple modules. You can merge this pull request into a

[GitHub] beam pull request #3039: [BEAM-2006] window support

2017-05-09 Thread XuMingmin
GitHub user XuMingmin opened a pull request: https://github.com/apache/beam/pull/3039 [BEAM-2006] window support Add support for aggregation: _global_, _HOP_, _TUMBLE_, _SESSION_, only aggregation function `COUNT` You can merge this pull request into a Git repository by running

[GitHub] beam pull request #2903: [BEAM-2006] window support

2017-05-10 Thread XuMingmin
Github user XuMingmin closed the pull request at: https://github.com/apache/beam/pull/2903 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] beam pull request #3067: [BEAM-2008] aggregation functions support

2017-05-10 Thread XuMingmin
GitHub user XuMingmin opened a pull request: https://github.com/apache/beam/pull/3067 [BEAM-2008] aggregation functions support Support common-used aggregation functions in SQL, including: `COUNT`, `SUM`, `AVG`, `MAX`, `MIN` Be sure to do all of the following to help

[GitHub] beam pull request #3135: [BEAM-2234] expose PCollection of each RelNode

2017-05-12 Thread XuMingmin
GitHub user XuMingmin opened a pull request: https://github.com/apache/beam/pull/3135 [BEAM-2234] expose PCollection of each RelNode Change the return of `buildBeamPipeline` to `PCollection`, this helps to: 1). donot need to manage the upstream-downstream in

[GitHub] beam pull request #3136: [BEAM-2196] support UDF

2017-05-13 Thread XuMingmin
GitHub user XuMingmin opened a pull request: https://github.com/apache/beam/pull/3136 [BEAM-2196] support UDF Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like: `[BEAM

[GitHub] beam pull request #3135: [BEAM-2234] expose PCollection of each RelNode

2017-05-13 Thread XuMingmin
Github user XuMingmin closed the pull request at: https://github.com/apache/beam/pull/3135 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] beam pull request #3137: [BEAM-2288] Refine DSL interface

2017-05-14 Thread XuMingmin
GitHub user XuMingmin opened a pull request: https://github.com/apache/beam/pull/3137 [BEAM-2288] Refine DSL interface Refine DSL interface as design doc of BEAM-2010: 1. rename BeamSqlRunner to BeamSQLEnvironment; 2. Move pipeline as external parameter, to integrate with

[GitHub] beam pull request #3138: [BEAM-2292] PCollection as a Table

2017-05-14 Thread XuMingmin
GitHub user XuMingmin opened a pull request: https://github.com/apache/beam/pull/3138 [BEAM-2292] PCollection as a Table add BeamPCollectionTable to create table from PCollection Note that it changes the interface of `BaseBeamTable`, as a `BeamPCollectionTable` doesn&#

[GitHub] beam pull request #3137: [BEAM-2288] Refine DSL interface

2017-05-17 Thread XuMingmin
Github user XuMingmin closed the pull request at: https://github.com/apache/beam/pull/3137 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] beam pull request #3138: [BEAM-2292] PCollection as a Table

2017-05-21 Thread XuMingmin
Github user XuMingmin closed the pull request at: https://github.com/apache/beam/pull/3138 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] beam pull request #3767: [BEAM-2809] update JavaDoc of BeamSortRel

2017-08-25 Thread XuMingmin
GitHub user XuMingmin opened a pull request: https://github.com/apache/beam/pull/3767 [BEAM-2809] update JavaDoc of BeamSortRel R: @xumingming @takidau You can merge this pull request into a Git repository by running: $ git pull https://github.com/XuMingmin/beam BEAM-2809

[GitHub] beam pull request #3782: [BEAM-301] merge branch DSL_SQL to master

2017-08-29 Thread XuMingmin
GitHub user XuMingmin opened a pull request: https://github.com/apache/beam/pull/3782 [BEAM-301] merge branch DSL_SQL to master Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA issue](https

[GitHub] beam pull request #3794: [TEST PR] to verify [BEAM-301]

2017-08-30 Thread XuMingmin
GitHub user XuMingmin opened a pull request: https://github.com/apache/beam/pull/3794 [TEST PR] to verify [BEAM-301] Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA issue](https://issues.apache.org/jira

[GitHub] beam pull request #3803: [BEAM-2833] TestPipeline fail to get Coder

2017-09-01 Thread XuMingmin
GitHub user XuMingmin opened a pull request: https://github.com/apache/beam/pull/3803 [BEAM-2833] TestPipeline fail to get Coder add option for toProto/fromProto translations in `DirectRunner`, _disabled_ by default. You can merge this pull request into a Git repository by

[GitHub] beam pull request #3794: [TEST PR] to verify [BEAM-301]

2017-09-11 Thread XuMingmin
Github user XuMingmin closed the pull request at: https://github.com/apache/beam/pull/3794 ---

[GitHub] beam pull request #3848: [BEAM-2954] update shade configurations in extensio...

2017-09-13 Thread XuMingmin
GitHub user XuMingmin opened a pull request: https://github.com/apache/beam/pull/3848 [BEAM-2954] update shade configurations in extension/sql Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA issue](https

[GitHub] beam pull request #4101: [BEAM-3161] Cannot output with timestamp XXXX

2017-11-08 Thread XuMingmin
GitHub user XuMingmin opened a pull request: https://github.com/apache/beam/pull/4101 [BEAM-3161] Cannot output with timestamp R: @xumingming CC: @takidau You can merge this pull request into a Git repository by running: $ git pull https://github.com/XuMingmin/beam

[GitHub] beam pull request #4115: [BEAM-3170] support topicPartition in BeamKafkaTabl...

2017-11-10 Thread XuMingmin
GitHub user XuMingmin opened a pull request: https://github.com/apache/beam/pull/4115 [BEAM-3170] support topicPartition in BeamKafkaTable Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA issue](https

[GitHub] beam pull request #2044: [BEAM-1407] Support multiple Kafka client in KakaIO

2017-02-17 Thread XuMingmin
GitHub user XuMingmin opened a pull request: https://github.com/apache/beam/pull/2044 [BEAM-1407] Support multiple Kafka client in KakaIO PR for *[Solution 3. Rewrite Consumer method call at runtime].* SpEL is used to hide the difference of Kafka client 0.9/0.10

[GitHub] beam pull request #2069: BEAM-307: Upgrade/Test to Kafka 0.10

2017-02-21 Thread XuMingmin
GitHub user XuMingmin opened a pull request: https://github.com/apache/beam/pull/2069 BEAM-307: Upgrade/Test to Kafka 0.10 Run *KafkaIOTest.java* with `mvn test -Dkafka.clients.version=0.10.1.1`, or `mvn test -Dkafka.clients.version=0.9.0.1` for either Kafka client version

[GitHub] beam pull request #2134: Beam 1514

2017-02-28 Thread XuMingmin
GitHub user XuMingmin opened a pull request: https://github.com/apache/beam/pull/2134 Beam 1514 Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like: `[BEAM-] Description

[GitHub] beam pull request #2134: Beam 1514

2017-02-28 Thread XuMingmin
Github user XuMingmin closed the pull request at: https://github.com/apache/beam/pull/2134 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] beam pull request #2135: BEAM-1514: change default timestamp in KafkaIO

2017-02-28 Thread XuMingmin
GitHub user XuMingmin opened a pull request: https://github.com/apache/beam/pull/2135 BEAM-1514: change default timestamp in KafkaIO I use Java reflection here to check if timestamp is available and get the value, based on the performance test as below. As the function is called

[GitHub] beam pull request #2203: BEAM-1660 withCoder() error in JdbcIO JavaDoc examp...

2017-03-08 Thread XuMingmin
GitHub user XuMingmin opened a pull request: https://github.com/apache/beam/pull/2203 BEAM-1660 withCoder() error in JdbcIO JavaDoc example Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is

  1   2   >