GitHub user XuMingmin opened a pull request: https://github.com/apache/beam/pull/3606
Merge DSL_SQL to Master Merge DSL_SQL feature branch back to master branch, with Beam SQL DSL function is ready to use. Resources: 1. thread in apache-beam-dev mail-list https://www.mail-archive.com/dev@beam.apache.org/msg02064.html 2. JIRA tasks https://issues.apache.org/jira/browse/BEAM-2621?jql=labels%20%3D%20dsl_sql_merge 3. Task burndown doc https://docs.google.com/document/d/1EHZgSu4Jd75iplYpYT_K_JwSZxL2DWG8kv_EmQzNXFc/edit?usp=sharing You can merge this pull request into a Git repository by running: $ git pull https://github.com/apache/beam DSL_SQL Alternatively you can review and apply these changes as the patch at: https://github.com/apache/beam/pull/3606.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #3606 ---- commit bd99528af89450b44d94abc42a8b884e00cbc26e Author: Tyler Akidau <taki...@apache.org> Date: 2017-06-27T00:36:58Z [BEAM-2503] This closes #3427 commit 32fbc9cec1d0d86e04e3f453b0d75f2ff0e61b56 Author: Ismaël MejÃa <ieme...@gmail.com> Date: 2017-06-26T14:37:51Z Small fixes to make the example run in a runner agnostic way: - Add direct runner default profile - Add findbugs validation and fix existing findbugs issues - Validate division by zero on arithmetic expression + other minor fixes - Update Calcite version to 1.13 commit ab4b118869070e94a4205744d6d60525d3fa2882 Author: Tyler Akidau <taki...@apache.org> Date: 2017-06-28T01:25:56Z This closes #3439 commit 928cec597175c363d444331b35ac8793297a242b Author: James Xu <xumingmi...@gmail.com> Date: 2017-05-29T03:11:34Z [BEAM-2193] Implement FULL, INNER, and OUTER JOIN: - FULL and INNER supported on all variations of unbounded/bounded joins. - OUTER JOIN supported when outer side is unbounded. - Unbounded/bounded joins implemented via side inputs. commit 2096da25e85d97ab52850453c2130ff706d7bcdf Author: Tyler Akidau <taki...@apache.org> Date: 2017-06-29T23:34:45Z [BEAM-2193] This closes #3277 commit a13fce98f61867fcb5adb52c80f1cfd3eecfc436 Author: mingmxu <ming...@ebay.com> Date: 2017-06-26T23:03:51Z UDAF support: - Adds an abstract class BeamSqlUdaf for defining Calcite SQL UDAFs. - Updates built-in COUNT/SUM/AVG/MAX/MIN accumulators to use this new class. commit 7ba77dd435eefd697fd0a452b07e0154dd1cd1b2 Author: Tyler Akidau <taki...@apache.org> Date: 2017-06-30T22:40:05Z [BEAM-2287] This closes #3447 commit 21497194db3ddce37a4747b3de2714b02684c57e Author: James Xu <xumingmi...@gmail.com> Date: 2017-06-27T02:42:40Z BeamSql: refactor the MockedBeamSqlTable and related tests commit bc66698e6880c7788bcea78006c67bfca66b17ce Author: James Xu <xumingmi...@gmail.com> Date: 2017-06-30T06:54:26Z MockedBeamSqlTable -> MockedBoundedTable commit ca2bc723dc00f0a5bf3e6157f8cd79ef4297093b Author: Luke Cwik <lc...@google.com> Date: 2017-07-05T16:34:17Z [BEAM-2515] BeamSql: refactor the MockedBeamSqlTable and related tests This closes #3478 commit 794f1901dcf5fb520a849adce7ce436e8b2f8535 Author: mingmxu <ming...@ebay.com> Date: 2017-07-10T05:26:29Z Test unsupported/invalid cases in DSL tests. commit b8fa0addc86d2249cd2fbbce3d8ad98d27e04604 Author: Tyler Akidau <taki...@apache.org> Date: 2017-07-12T04:05:15Z [BEAM-2574] This closes #3530 commit e9dc5ea81cbbde39bf11ee183e5403b869d21f50 Author: James Xu <xumingmi...@gmail.com> Date: 2017-07-06T03:29:41Z [BEAM-2550] add UnitTest for JOIN in DSL commit aa265e62a6c807ee941b1fc9379411f736754bf5 Author: Tyler Akidau <taki...@apache.org> Date: 2017-07-12T06:47:49Z [BEAM-2550] This closes #3506 commit eb589fb943a45388e4118bb221e52009eb92d1c1 Author: mingmxu <ming...@ebay.com> Date: 2017-07-09T07:52:23Z support TUMBLE/HOP/SESSION _START function commit a96c3a01f18826b4e43ad7e8f26e94c02903acd9 Author: Tyler Akidau <taki...@apache.org> Date: 2017-07-12T16:49:59Z [BEAM-2204] This closes #3527 commit 0580e8b639ef77c7a6534b7b91ecad493950a3aa Author: mingmxu <ming...@ebay.com> Date: 2017-07-12T07:08:35Z Test queries on unbounded PCollections with BeamSql DSL API. Also add getTYPE(fieldName) overrides to BeamSqlRow. commit 8defe6f21524b4ca00dd984176260c1bd0739774 Author: Tyler Akidau <taki...@apache.org> Date: 2017-07-12T17:03:28Z [BEAM-2527] This closes #3477 commit 3a170744861dec12a33a19358f9ce89dbd64491c Author: James Xu <xumingmi...@gmail.com> Date: 2017-07-10T11:58:21Z [BEAM-2564] add integration test for string functions commit 53d27e6c45ab7bbd6877c6674868e8a2e3f9a971 Author: Tyler Akidau <taki...@apache.org> Date: 2017-07-12T17:07:39Z [BEAM-2564] This closes #3532 commit 39eedd566c3a1825ec3e9be0aa4490cfd824cb30 Author: tarushapptech <tarushappt...@gmail.com> Date: 2017-06-17T07:50:02Z CAST operator supporting numeric, date and timestamp types commit 125cef14453d625f1758aef5b129182cb13d829c Author: Tyler Akidau <taki...@apache.org> Date: 2017-07-12T17:34:36Z [BEAM-2424] This closes #3386 commit 556c48c805cba2e2fe8b349fca55bead1a0a7ef2 Author: tarushapptech <tarushappt...@gmail.com> Date: 2017-06-09T16:02:39Z POWER function commit 25fea4e1e28c7cbcdb25edb0dfb4839885e0c4b8 Author: Tyler Akidau <taki...@apache.org> Date: 2017-07-12T17:44:39Z [BEAM-2171] This closes #3336 commit 5ca54e956e80f3059a9e67bf9b3d34af08569ff1 Author: mingmxu <ming...@ebay.com> Date: 2017-07-03T04:24:07Z support UDF/UDAF in BeamSql commit d89d1ee1a3085269cdf44ec50e29a95c8f43757b Author: Tyler Akidau <taki...@apache.org> Date: 2017-07-12T22:57:53Z [BEAM-2520] This closes #3491 commit 89b2e7b13d5ecff0e23300f74267f2796d4b198e Author: Charles Chen <c...@google.com> Date: 2017-06-08T00:00:57Z Remove support for NativeSinks from the Python DirectRunner commit fc42dd021e1c6e2e70481ef0406e871a1c385504 Author: Seshadri Chakkravarthy <sesh...@gmail.com> Date: 2017-05-18T19:07:01Z Implements HCatalogIO commit f788416f9dd8c949dbf055ba9dbbd1600bca5ddb Author: Kenneth Knowles <k...@google.com> Date: 2017-05-25T13:29:09Z Add Runner API oriented PTransformMatchers for DirectRunner overrides commit 97162dff899422fbfff78c482151fc75842a7751 Author: Kenneth Knowles <k...@google.com> Date: 2017-05-25T13:31:16Z DirectRunner override matchers using Runner API ---- --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---