This is an automated email from the ASF dual-hosted git repository. vinoth pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/incubator-hudi-site.git
commit 3a9ffadfe436897a68b83315c162e60e68268773 Author: Vinoth Chandar <[email protected]> AuthorDate: Wed Mar 13 15:36:37 2019 -0700 Minor edits --- docs/community.md | 14 +++++++++++--- docs/quickstart.md | 11 ++++++----- 2 files changed, 17 insertions(+), 8 deletions(-) diff --git a/docs/community.md b/docs/community.md index dd6d8ea..fd39c0f 100644 --- a/docs/community.md +++ b/docs/community.md @@ -13,9 +13,9 @@ There are several ways to get in touch with the Hudi community. | When? | Channel to use | |-------|--------| | For any general questions, user support, development discussions | Dev Mailing list ([Subscribe](mailto:[email protected]), [Unsubscribe](mailto:[email protected]), [Archives](https://lists.apache.org/[email protected])). Empty email works for subscribe/unsubscribe. Please use [gists](https://gist.github.com) to share code/stacktraces on the email. | -| For reporting bugs or issues or discover known issues | Please use [ASF Hudi JIRA](https://issues.apache.org/jira/projects/HUDI/summary) | +| For reporting bugs or issues or discover known issues | Please use [ASF Hudi JIRA](https://issues.apache.org/jira/projects/HUDI/summary). See [#here](#accounts) for access | | For quick pings & 1-1 chats | Join our [slack group](https://join.slack.com/t/apache-hudi/signup) | -| For proposing large features, changes | Start a Hudi Improvement Process (HIP). Instructions coming soon.| +| For proposing large features, changes | Start a Hudi Improvement Process (HIP). Instructions coming soon. See [#here](#accounts) for access | | For stream of commits, pull requests etc | Commits Mailing list ([Subscribe](mailto:[email protected]), [Unsubscribe](mailto:[email protected]), [Archives](https://lists.apache.org/[email protected])) | If you wish to report a security vulnerability, please contact [[email protected]](mailto:[email protected]). @@ -35,7 +35,15 @@ Here are few ways, you can get involved. - Share new ideas/directions to pursue or propose a new HIP - Contributing code to the project ([newbie JIRAs](https://issues.apache.org/jira/issues/?jql=project+%3D+HUDI+AND+component+%3D+newbie)) -#### Code Contributions +### Code Contributions Useful resources for contributing can be found under the "Developers" top menu. Specifically, please refer to the detailed [contribution guide](contributing.html). + +## Accounts {#accounts} + +It's useful to obtain few accounts to be able to effectively contribute to Hudi. + + - Github account is needed to send pull requests to Hudi + - Sign-up/in to the Apache [JIRA](https://issues.apache.org/jira). Then please email the dev mailing list with your username, asking to be added as a contributor to the project. This enables you to assign/be-assigned tickets and comment on them. + - Sign-up/in to the Apache [cWiki](https://cwiki.apache.org/confluence/signup.action), to be able to contribute to the wiki pages/HIPs. \ No newline at end of file diff --git a/docs/quickstart.md b/docs/quickstart.md index ff33184..317bb17 100644 --- a/docs/quickstart.md +++ b/docs/quickstart.md @@ -23,8 +23,7 @@ $ mvn clean install -DskipTests -DskipITs -Dhive11 ``` {% include callout.html content="You might want to add your spark jars folder to project dependencies under 'Module Setttings', to be able to run Spark from IDE. -Setup your local hadoop/hive test environment, so you can play with entire ecosystem. -See [this](http://www.bytearray.io/2016/05/setting-up-hadoopyarnsparkhive-on-mac.html) for reference" type="info" %} +Setup your local hadoop/hive test environment, so you can play with entire ecosystem." type="info" %} <br/>Please refer to [migration guide](migration_guide.html), for recommended ways to migrate your existing dataset to Hudi. @@ -264,7 +263,7 @@ You can also use the sample queries in __hoodie-utilities/src/test/java/HoodieSp Checkout the 'master' branch on OSS Presto, build it, and place your installation somewhere. -* Copy the hoodie-hadoop-mr-* jar into $PRESTO_INSTALL/plugin/hive-hadoop2/ +* Copy the hudi/packaging/hoodie-presto-bundle/target/hoodie-presto-bundle-*.jar into $PRESTO_INSTALL/plugin/hive-hadoop2/ * Startup your server and you should be able to query the same Hive table via Presto ``` @@ -923,10 +922,12 @@ No rows affected (0.009 seconds) 0: jdbc:hive2://hiveserver:10000> set hoodie.stock_ticks_cow.consume.max.commits=3; No rows affected (0.009 seconds) 0: jdbc:hive2://hiveserver:10000> set hoodie.stock_ticks_cow.consume.start.timestamp=20180924064621; +``` -# With the above setting, file-ids that do not have any updates from the commit 20180924065039 is filtered out without scanning. -# Here is the incremental query : +With the above setting, file-ids that do not have any updates from the commit 20180924065039 is filtered out without scanning. +Here is the incremental query : +``` 0: jdbc:hive2://hiveserver:10000> 0: jdbc:hive2://hiveserver:10000> select `_hoodie_commit_time`, symbol, ts, volume, open, close from stock_ticks_cow where symbol = 'GOOG' and `_hoodie_commit_time` > '20180924064621'; +----------------------+---------+----------------------+---------+------------+-----------+--+
