pengzhiwei2018 opened a new pull request #2645:
URL: https://github.com/apache/hudi/pull/2645
## What is the purpose of the pull request
Basic implement for spark sql integrates with Hoodie.
## Brief change log
Main functions:
- Support create table for hoodie.
- Support CTAS.
- Support Insert for hoodie. Including dynamic partition and static
partition insert.
- Support MergeInto for hoodie.
Main changes:
- Add sql parser for spark2.
- Add HoodieAnalysis for sql resolve and logical plan rewrite.
- Add commands implementation for CREATE TABLE、INSERT、MERGE INTO & CTAS.
- Add `WRITE_SCHEMA` config to `HoodieWriteConfig` to pass the write schema
for `MergeIntoHoodieTableCommand`.
We made some modifications for HoodieWriteHandler to support specify
write schema.
## Verify this pull request
- Add CreateTableTest for test create hoodie tables.
- Add InsertTableTest for test insert hoodie tables.
- Add MergeIntoTest for test merge hoodie tables.
## Committer checklist
- [ ] Has a corresponding JIRA in PR title & commit
- [ ] Commit message is descriptive of the change
- [ ] CI is green
- [ ] Necessary doc changes done or have another open PR
- [ ] For large changes, please consider breaking it into sub-tasks under
an umbrella JIRA.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
