GitHub user XuMingmin opened a pull request:
https://github.com/apache/beam/pull/3606
Merge DSL_SQL to Master
Merge DSL_SQL feature branch back to master branch, with Beam SQL DSL
function is ready to use.
Resources:
1. thread in apache-beam-dev mail-list
https://www.mail-archive.com/[email protected]/msg02064.html
2. JIRA tasks
https://issues.apache.org/jira/browse/BEAM-2621?jql=labels%20%3D%20dsl_sql_merge
3. Task burndown doc
https://docs.google.com/document/d/1EHZgSu4Jd75iplYpYT_K_JwSZxL2DWG8kv_EmQzNXFc/edit?usp=sharing
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/apache/beam DSL_SQL
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/beam/pull/3606.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #3606
----
commit bd99528af89450b44d94abc42a8b884e00cbc26e
Author: Tyler Akidau <[email protected]>
Date: 2017-06-27T00:36:58Z
[BEAM-2503] This closes #3427
commit 32fbc9cec1d0d86e04e3f453b0d75f2ff0e61b56
Author: Ismaël MejÃa <[email protected]>
Date: 2017-06-26T14:37:51Z
Small fixes to make the example run in a runner agnostic way:
- Add direct runner default profile
- Add findbugs validation and fix existing findbugs issues
- Validate division by zero on arithmetic expression + other minor fixes
- Update Calcite version to 1.13
commit ab4b118869070e94a4205744d6d60525d3fa2882
Author: Tyler Akidau <[email protected]>
Date: 2017-06-28T01:25:56Z
This closes #3439
commit 928cec597175c363d444331b35ac8793297a242b
Author: James Xu <[email protected]>
Date: 2017-05-29T03:11:34Z
[BEAM-2193] Implement FULL, INNER, and OUTER JOIN:
- FULL and INNER supported on all variations of unbounded/bounded joins.
- OUTER JOIN supported when outer side is unbounded.
- Unbounded/bounded joins implemented via side inputs.
commit 2096da25e85d97ab52850453c2130ff706d7bcdf
Author: Tyler Akidau <[email protected]>
Date: 2017-06-29T23:34:45Z
[BEAM-2193] This closes #3277
commit a13fce98f61867fcb5adb52c80f1cfd3eecfc436
Author: mingmxu <[email protected]>
Date: 2017-06-26T23:03:51Z
UDAF support:
- Adds an abstract class BeamSqlUdaf for defining Calcite SQL UDAFs.
- Updates built-in COUNT/SUM/AVG/MAX/MIN accumulators to use this new class.
commit 7ba77dd435eefd697fd0a452b07e0154dd1cd1b2
Author: Tyler Akidau <[email protected]>
Date: 2017-06-30T22:40:05Z
[BEAM-2287] This closes #3447
commit 21497194db3ddce37a4747b3de2714b02684c57e
Author: James Xu <[email protected]>
Date: 2017-06-27T02:42:40Z
BeamSql: refactor the MockedBeamSqlTable and related tests
commit bc66698e6880c7788bcea78006c67bfca66b17ce
Author: James Xu <[email protected]>
Date: 2017-06-30T06:54:26Z
MockedBeamSqlTable -> MockedBoundedTable
commit ca2bc723dc00f0a5bf3e6157f8cd79ef4297093b
Author: Luke Cwik <[email protected]>
Date: 2017-07-05T16:34:17Z
[BEAM-2515] BeamSql: refactor the MockedBeamSqlTable and related tests
This closes #3478
commit 794f1901dcf5fb520a849adce7ce436e8b2f8535
Author: mingmxu <[email protected]>
Date: 2017-07-10T05:26:29Z
Test unsupported/invalid cases in DSL tests.
commit b8fa0addc86d2249cd2fbbce3d8ad98d27e04604
Author: Tyler Akidau <[email protected]>
Date: 2017-07-12T04:05:15Z
[BEAM-2574] This closes #3530
commit e9dc5ea81cbbde39bf11ee183e5403b869d21f50
Author: James Xu <[email protected]>
Date: 2017-07-06T03:29:41Z
[BEAM-2550] add UnitTest for JOIN in DSL
commit aa265e62a6c807ee941b1fc9379411f736754bf5
Author: Tyler Akidau <[email protected]>
Date: 2017-07-12T06:47:49Z
[BEAM-2550] This closes #3506
commit eb589fb943a45388e4118bb221e52009eb92d1c1
Author: mingmxu <[email protected]>
Date: 2017-07-09T07:52:23Z
support TUMBLE/HOP/SESSION _START function
commit a96c3a01f18826b4e43ad7e8f26e94c02903acd9
Author: Tyler Akidau <[email protected]>
Date: 2017-07-12T16:49:59Z
[BEAM-2204] This closes #3527
commit 0580e8b639ef77c7a6534b7b91ecad493950a3aa
Author: mingmxu <[email protected]>
Date: 2017-07-12T07:08:35Z
Test queries on unbounded PCollections with BeamSql DSL API.
Also add getTYPE(fieldName) overrides to BeamSqlRow.
commit 8defe6f21524b4ca00dd984176260c1bd0739774
Author: Tyler Akidau <[email protected]>
Date: 2017-07-12T17:03:28Z
[BEAM-2527] This closes #3477
commit 3a170744861dec12a33a19358f9ce89dbd64491c
Author: James Xu <[email protected]>
Date: 2017-07-10T11:58:21Z
[BEAM-2564] add integration test for string functions
commit 53d27e6c45ab7bbd6877c6674868e8a2e3f9a971
Author: Tyler Akidau <[email protected]>
Date: 2017-07-12T17:07:39Z
[BEAM-2564] This closes #3532
commit 39eedd566c3a1825ec3e9be0aa4490cfd824cb30
Author: tarushapptech <[email protected]>
Date: 2017-06-17T07:50:02Z
CAST operator supporting numeric, date and timestamp types
commit 125cef14453d625f1758aef5b129182cb13d829c
Author: Tyler Akidau <[email protected]>
Date: 2017-07-12T17:34:36Z
[BEAM-2424] This closes #3386
commit 556c48c805cba2e2fe8b349fca55bead1a0a7ef2
Author: tarushapptech <[email protected]>
Date: 2017-06-09T16:02:39Z
POWER function
commit 25fea4e1e28c7cbcdb25edb0dfb4839885e0c4b8
Author: Tyler Akidau <[email protected]>
Date: 2017-07-12T17:44:39Z
[BEAM-2171] This closes #3336
commit 5ca54e956e80f3059a9e67bf9b3d34af08569ff1
Author: mingmxu <[email protected]>
Date: 2017-07-03T04:24:07Z
support UDF/UDAF in BeamSql
commit d89d1ee1a3085269cdf44ec50e29a95c8f43757b
Author: Tyler Akidau <[email protected]>
Date: 2017-07-12T22:57:53Z
[BEAM-2520] This closes #3491
commit 89b2e7b13d5ecff0e23300f74267f2796d4b198e
Author: Charles Chen <[email protected]>
Date: 2017-06-08T00:00:57Z
Remove support for NativeSinks from the Python DirectRunner
commit fc42dd021e1c6e2e70481ef0406e871a1c385504
Author: Seshadri Chakkravarthy <[email protected]>
Date: 2017-05-18T19:07:01Z
Implements HCatalogIO
commit f788416f9dd8c949dbf055ba9dbbd1600bca5ddb
Author: Kenneth Knowles <[email protected]>
Date: 2017-05-25T13:29:09Z
Add Runner API oriented PTransformMatchers for DirectRunner overrides
commit 97162dff899422fbfff78c482151fc75842a7751
Author: Kenneth Knowles <[email protected]>
Date: 2017-05-25T13:31:16Z
DirectRunner override matchers using Runner API
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
