GitHub user yhuai opened a pull request:
https://github.com/apache/spark/pull/12117
[WIP] [SQL] Handle CreateFunction/DropFunction
## What changes were proposed in this pull request?
TODO
## How was this patch tested?
TODO
## TODO
[ ] A detailed description
[ ] Self-review
[ ] Cleanup
[ ] More tests for create/drop functions (we need to more tests for
permanent functions).
[ ] File JIRAs for all TODOs
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/yhuai/spark function
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/12117.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #12117
----
commit 7d001843f6a161298702aaf20079f1611b18141b
Author: Liang-Chi Hsieh <[email protected]>
Date: 2016-03-27T13:15:54Z
init import.
commit 9af70af9cd2dfdac0fa36b2a1440dc14b88d9ddc
Author: Liang-Chi Hsieh <[email protected]>
Date: 2016-03-29T04:14:40Z
Merge remote-tracking branch 'upstream/master' into native-ddl-function
commit 35ad7ae14ebff693a8e15dd231eb69be7061402f
Author: Liang-Chi Hsieh <[email protected]>
Date: 2016-03-29T12:10:19Z
Fix hive temp function feature.
commit cb29f0fb9d66b3bf3774dd9f76a82af365c39deb
Author: Liang-Chi Hsieh <[email protected]>
Date: 2016-03-29T13:08:37Z
Fix scala style.
commit 77848c910a78165416e7c069b25eaaee1b9c5a93
Author: Liang-Chi Hsieh <[email protected]>
Date: 2016-03-29T14:02:27Z
Use HiveFunctionRegistry to find Generator function in HiveSqlParser.
commit b8dda845dde32202c60db668270e73a0d3513309
Author: Liang-Chi Hsieh <[email protected]>
Date: 2016-03-29T15:34:50Z
Fix describe function problem.
commit ee957db463300c0b3f9e5194d9400d598b29509d
Author: Liang-Chi Hsieh <[email protected]>
Date: 2016-03-29T23:10:54Z
Fix scala style.
commit 133ce1a35d5d7f0f7461be723fbc8bf6db73a5f2
Author: Liang-Chi Hsieh <[email protected]>
Date: 2016-03-30T02:34:56Z
Fix test.
commit 6b769801108d64711fad899e48d08b53903a5f3f
Author: Liang-Chi Hsieh <[email protected]>
Date: 2016-03-30T02:41:36Z
Merge remote-tracking branch 'upstream/master' into native-ddl-function
Conflicts:
sql/core/src/main/scala/org/apache/spark/sql/execution/command/ddl.scala
commit e05b108f9aeedf5d8e3fb5c7145940619811a858
Author: Liang-Chi Hsieh <[email protected]>
Date: 2016-03-30T03:21:25Z
Address some comments.
commit 314c4db851da5e832fb995f5538e66d4c1ddc89a
Author: Liang-Chi Hsieh <[email protected]>
Date: 2016-03-30T04:00:24Z
Add resources to CatalogFunction.
commit c370c479b388606226b91e19da791f328014559e
Author: Liang-Chi Hsieh <[email protected]>
Date: 2016-03-30T09:51:47Z
Let Spark load Hive permanent function and create expression.
commit acf9299a79684dbb063efa035323726c753c682d
Author: Liang-Chi Hsieh <[email protected]>
Date: 2016-03-30T10:05:34Z
A little refactoring.
commit 2cab41cdc254764ed976842475ce2c2547b0ddcc
Author: Liang-Chi Hsieh <[email protected]>
Date: 2016-03-31T09:32:07Z
Refactoring.
commit 65d9dbdfbb26c0a1e917767aae08f73df4f9763c
Author: Liang-Chi Hsieh <[email protected]>
Date: 2016-03-31T10:22:31Z
Fix compilation error.
commit 05709f09cfa5fb171e926c839929135b1cda112e
Author: Liang-Chi Hsieh <[email protected]>
Date: 2016-03-31T23:48:22Z
Merge remote-tracking branch 'upstream/master' into native-ddl-function
Conflicts:
sql/core/src/main/scala/org/apache/spark/sql/execution/SparkQl.scala
commit 67df04f70d2f6edb9a670aaa6cf749c8c86f6695
Author: Yin Huai <[email protected]>
Date: 2016-04-01T02:35:06Z
Rename alias to className
commit b67c4448b23aff65d6d153c9f4fdcf1bc6a26712
Author: Yin Huai <[email protected]>
Date: 2016-04-01T03:26:37Z
Make SessionCatalog handle makeFunctionBuilder and remove
HiveFunctionRegistry
commit 1753cac2a09da47fd5ac439656d0f49f8866f841
Author: Yin Huai <[email protected]>
Date: 2016-04-01T03:27:28Z
functionClassName => className
commit a2d588ffed2dda19f48270d9b42999ea0585ceb5
Author: Yin Huai <[email protected]>
Date: 2016-04-01T04:21:59Z
Put loadFunctionResources to SessionCatalog
commit 51b72dd028a73276ad374b9560223e27c60cbbd5
Author: Yin Huai <[email protected]>
Date: 2016-04-01T05:25:02Z
SessionCatalog loads permanent function instead of letting function
registry loads permanent function.
commit 66c5261a5638dd05322b5b1a45af9b591a328233
Author: Yin Huai <[email protected]>
Date: 2016-04-01T17:02:15Z
Take care UnresolvedGenerator and cleanup.
commit 2aa3725dd42c3e62e7326ba87ea411be0d308569
Author: Yin Huai <[email protected]>
Date: 2016-04-01T20:25:26Z
If we cannot find a function in Spark's FunctionRegistry. We will also try
Hive's.
commit e34308761cb773b8bf63b75e691a6d39ee797bbe
Author: Yin Huai <[email protected]>
Date: 2016-04-01T20:26:22Z
Merge remote-tracking branch 'upstream/master' into function
commit 81543596860c8ec45fc9fd54154501c8690e2cfd
Author: Yin Huai <[email protected]>
Date: 2016-04-01T21:52:38Z
Fix tests and pre-load two Hive's builtin functions.
commit e0570cdacda5b3cc81efa3b317e75882186f2d97
Author: Yin Huai <[email protected]>
Date: 2016-04-01T21:53:15Z
Merge remote-tracking branch 'upstream/master' into function
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
