Re: 回复:Is Drill query execution processing model just the same idea with the Spark whole-stage codegen improvement

2018-08-11 Thread Ted Dunning
Actually, I would strongly disagree that a central metadata repository is a good thing for distributed data. HDFS is a great example of how centralized metadata turns into a major reliability and consistency nightmare. It would be much, much better to keep the metadata distributed near the data.

Re: 回复:Is Drill query execution processing model just the same idea with the Spark whole-stage codegen improvement

2018-08-11 Thread Vitalii Diravka
Hi all! I agree with Paul and Parth, Hive Metastore with it's RDMBS is the easiest way to manage metadata and statistics in better way than now. And it can be used not only for Parquet, so it will be good enhancement for Drill. Of course Drill will have own API for Metastore, so later other tools

[GitHub] Agirish commented on a change in pull request #1430: DRILL-6680: Expose show files command into INFORMATION_SCHEMA

2018-08-11 Thread GitBox
Agirish commented on a change in pull request #1430: DRILL-6680: Expose show files command into INFORMATION_SCHEMA URL: https://github.com/apache/drill/pull/1430#discussion_r209430632 ## File path: exec/java-exec/src/main/resources/drill-module.conf ## @@ -605,4 +605,5 @@

[GitHub] Agirish commented on a change in pull request #1430: DRILL-6680: Expose show files command into INFORMATION_SCHEMA

2018-08-11 Thread GitBox
Agirish commented on a change in pull request #1430: DRILL-6680: Expose show files command into INFORMATION_SCHEMA URL: https://github.com/apache/drill/pull/1430#discussion_r209430462 ## File path: exec/java-exec/src/main/resources/drill-module.conf ## @@ -605,4 +605,5 @@

[GitHub] asfgit closed pull request #1426: DRILL-6671: Multi level lateral unnest join is throwing an exception …

2018-08-11 Thread GitBox
asfgit closed pull request #1426: DRILL-6671: Multi level lateral unnest join is throwing an exception … URL: https://github.com/apache/drill/pull/1426 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of

[GitHub] asfgit closed pull request #1421: DRILL-6649: Query with unnest of column from nested star subquery fails

2018-08-11 Thread GitBox
asfgit closed pull request #1421: DRILL-6649: Query with unnest of column from nested star subquery fails URL: https://github.com/apache/drill/pull/1421 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of