DRILL-4013:JDBC/ODBC Warnings Design Proposal

2015-11-13 Thread Abhijit Pol
posted initial design proposal for https://issues.apache.org/jira/browse/DRILL-4013 direct link: https://docs.google.com/document/d/14d0t6XW6iLKqFpdzmYqpbrHR6-X-jHgM-VjTQwYybao/ please review and provide feedback/comments on the doc.

[jira] [Created] (DRILL-4086) No planning created

2015-11-13 Thread boris chmiel (JIRA)
boris chmiel created DRILL-4086: --- Summary: No planning created Key: DRILL-4086 URL: https://issues.apache.org/jira/browse/DRILL-4086 Project: Apache Drill Issue Type: Bug

[GitHub] drill pull request: DRILL-4047: Select with options

2015-11-13 Thread jacques-n
Github user jacques-n commented on a diff in the pull request: https://github.com/apache/drill/pull/246#discussion_r44821281 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/store/dfs/WorkspaceSchemaFactory.java --- @@ -148,12 +175,427 @@ private Path

[GitHub] drill pull request: DRILL-3786: Query with window function fails w...

2015-11-13 Thread parthchandra
Github user parthchandra commented on the pull request: https://github.com/apache/drill/pull/239#issuecomment-156506328 +1. Looks good. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

Re: drill accumulo

2015-11-13 Thread Jeff Downton
Hi, I've done a little investigating, began by taking the HBase storage plugin and started converting it to work with Accumulo. Haven't gone too far with it other than understanding the process flow and exploring what functions on the Accumulo side would be needed to fill the gaps. Whereas on

Re: comparing drill and presto

2015-11-13 Thread Jacques Nadeau
You're asking a community of Drill experts so we know Drill a lot better than we know Presto. Drill is focused on a couple of things: - Extreme flexibility: for example being able to read json & mongo with no upfront setup or sampling required. - Extreme performance: runtime compilation,

Re: Java graphical application being launched during the Drill build?

2015-11-13 Thread Steven Phillips
I actually see it when running without tests as well. On Fri, Nov 13, 2015 at 10:55 AM, Hsuan Yi Chu wrote: > Not bad feature, which gives the visualization of unit test completion. > > On Fri, Nov 13, 2015 at 10:27 AM, Parth Chandra wrote: > > > Yes I

Re: Java graphical application being launched during the Drill build?

2015-11-13 Thread Julien Le Dem
adding -Djava.awt.headless=true to the mvn command line gets rid of it. I suspect something depends on an awt class that triggers the graphical interface. I've seen this before with a library that generated images using awt. even if it was not displaying anything, that would trigger initializing

[GitHub] drill pull request: DRILL-4047: Select with options

2015-11-13 Thread jacques-n
Github user jacques-n commented on a diff in the pull request: https://github.com/apache/drill/pull/246#discussion_r44822446 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/store/dfs/WorkspaceSchemaFactory.java --- @@ -148,12 +175,427 @@ private Path

[jira] [Created] (DRILL-4087) Error parsing JSON - Invalid numeric value: Leading zeroes not allowed

2015-11-13 Thread Shankar (JIRA)
Shankar created DRILL-4087: -- Summary: Error parsing JSON - Invalid numeric value: Leading zeroes not allowed Key: DRILL-4087 URL: https://issues.apache.org/jira/browse/DRILL-4087 Project: Apache Drill

[GitHub] drill pull request: DRILL-4047: Select with options

2015-11-13 Thread jacques-n
Github user jacques-n commented on a diff in the pull request: https://github.com/apache/drill/pull/246#discussion_r44821481 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/store/dfs/WorkspaceSchemaFactory.java --- @@ -148,12 +175,427 @@ private Path

Re: Java graphical application being launched during the Drill build?

2015-11-13 Thread Hsuan Yi Chu
Not bad feature, which gives the visualization of unit test completion. On Fri, Nov 13, 2015 at 10:27 AM, Parth Chandra wrote: > Yes I see it too. Just a minor annoyance I thought. > > On Mon, Nov 9, 2015 at 2:59 PM, Sudheesh Katkam > wrote: > > > I

[GitHub] drill pull request: DRILL-4082: Better error message when multiple...

2015-11-13 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/drill/pull/252 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

Re: Drill + Kudu Hackathon: Nov 19 @ 10:30am

2015-11-13 Thread Timothy Chen
How long is the Hackathon? I'm interested in coming. Tim > On Nov 13, 2015, at 2:59 PM, Jacques Nadeau wrote: > > Hey Guys, > > We're going to do a hackathon on integrating Drill and Kudu next week. > We'll be starting at 10:30 and going until late afternoon. We'll be

[GitHub] drill pull request: DRILL-3791: MySQL tests for JDBC plugin

2015-11-13 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/drill/pull/251 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

Re: Avro deserialization bug - 1.3-SNAPSHOT

2015-11-13 Thread Stefán Baxter
So, Could someone point me to the appropriate place in the Drill code to start investigating this (We would love to contribute but getting up to speed is a bit much). I realize that there are many good things happening and that v. 1.3 is around the corner but it seems that I incorrectly assumed

[GitHub] drill pull request: DRILL-4083: ScanPrel's CPU cost should not be ...

2015-11-13 Thread jinfengni
Github user jinfengni commented on a diff in the pull request: https://github.com/apache/drill/pull/253#discussion_r44845244 --- Diff: contrib/storage-hive/core/src/test/java/org/apache/drill/exec/hive/TestHiveStorage.java --- @@ -36,6 +36,19 @@ public static void setupOptions()

[GitHub] drill pull request: DRILL-3765: Move partitioning pruning to HepPl...

2015-11-13 Thread jinfengni
GitHub user jinfengni opened a pull request: https://github.com/apache/drill/pull/255 DRILL-3765: Move partitioning pruning to HepPlanner to avoid the perf… …ormance overhead for redundant rule execution. Add fall back option in planner. Run the regression/unit

[GitHub] drill pull request: DRILL-4083: ScanPrel's CPU cost should not be ...

2015-11-13 Thread jinfengni
Github user jinfengni commented on the pull request: https://github.com/apache/drill/pull/253#issuecomment-156584940 Overall LGTM. In case that only constants are used and no column is required from scan operator, the scan operator still has to go through the data source; the

Build failed in Jenkins: drill-scm #590

2015-11-13 Thread Apache Jenkins Server
See Changes: [altekrusejason] DRILL-3791: MySQL tests for JDBC plugin [altekrusejason] DRILL-4082: Better error message when multiple versions of the same -- [...truncated 84899 lines...]

[GitHub] drill pull request: DRILL-3786: Query with window function fails w...

2015-11-13 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/drill/pull/239 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

maven error when running unit tests on master

2015-11-13 Thread Abdel Hakim Deneche
If I run mvn clean install -DskipTests > mvn test I get the following error when I run the tests: [INFO] > > [INFO] Reactor Summary: > [INFO] > [INFO] Apache Drill Root POM .. SUCCESS [ > 4.593

[GitHub] drill pull request: DRILL-4053: Reduce metadata cache file size. S...

2015-11-13 Thread StevenMPhillips
Github user StevenMPhillips commented on the pull request: https://github.com/apache/drill/pull/254#issuecomment-156576322 Do you have any numbers to illustrate how much of a performance improvement this change provides? --- If your project is set up for it, you can reply to this

Re: Avro deserialization bug - 1.3-SNAPSHOT

2015-11-13 Thread Jason Altekruse
Stefan, I took a look at the issue and I think I have a fix for the corruption you are seeing. There have been a number of substantial commits to master including a refactoring of a number of modules, so I applied this change on top of the 1.3 branch for you to build and try out. I would like to

Build failed in Jenkins: drill-scm #592

2015-11-13 Thread Apache Jenkins Server
See Changes: [jni] DRILL-4083: ScanPrel's CPU cost should not be zero even if column count -- [...truncated 3952 lines...] [INFO] [INFO] --- maven-enforcer-plugin:1.3.1:enforce

[GitHub] drill pull request: DRILL-4053: Reduce metadata cache file size. S...

2015-11-13 Thread jacques-n
Github user jacques-n commented on the pull request: https://github.com/apache/drill/pull/254#issuecomment-156589798 You're currently using an alternative file name for this. I think it would be better if we use the version field and continue to use the same file name. I assume we'll

[GitHub] drill pull request: DRILL-4053: Reduce metadata cache file size. S...

2015-11-13 Thread parthchandra
Github user parthchandra commented on the pull request: https://github.com/apache/drill/pull/254#issuecomment-156603019 Your question suggests that Jackson can take care of deserializing into the correct Java objects based on version. I just may not have spent enough time figuring it

Build failed in Jenkins: drill-scm #591

2015-11-13 Thread Apache Jenkins Server
See Changes: [asinha] DRILL-2601: log the query text and query id right at the beginning of -- [...truncated 4014 lines...] Audit done. [INFO] [INFO] --- maven-enforcer-plugin:1.3.1:enforce

[GitHub] drill pull request: DRILL-4053: Reduce metadata cache file size. S...

2015-11-13 Thread jacques-n
Github user jacques-n commented on the pull request: https://github.com/apache/drill/pull/254#issuecomment-156605047 As Steven said, one of the design goals I tasked Steven with was to multiple versions through Jackson and I believe we structured the file to support that effectively.

Re: Drill + Kudu Hackathon: Nov 19 @ 10:30am

2015-11-13 Thread Jacques Nadeau
Currently planning to go until 4pm. -- Jacques Nadeau CTO and Co-Founder, Dremio On Fri, Nov 13, 2015 at 3:08 PM, Timothy Chen wrote: > How long is the Hackathon? I'm interested in coming. > > Tim > > > > On Nov 13, 2015, at 2:59 PM, Jacques Nadeau

[GitHub] drill pull request: DRILL-4083: ScanPrel's CPU cost should not be ...

2015-11-13 Thread hsuanyi
Github user hsuanyi commented on the pull request: https://github.com/apache/drill/pull/253#issuecomment-156594216 Addressed reviewer's comment --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not

[GitHub] drill pull request: DRILL-4053: Reduce metadata cache file size. S...

2015-11-13 Thread StevenMPhillips
Github user StevenMPhillips commented on the pull request: https://github.com/apache/drill/pull/254#issuecomment-156603625 Yes, that is true, it is able to deserialize based on version, similar to what we do when deserializing physical plans or storage plugin configurations. See

[GitHub] drill pull request: DRILL-4053: Reduce metadata cache file size. S...

2015-11-13 Thread parthchandra
Github user parthchandra commented on the pull request: https://github.com/apache/drill/pull/254#issuecomment-156589078 The last perf run was on 400K parquet files in a 2-layer directory hierarchy: root_dir/ 2015-10-01/ d_01/ . . . 2015-10-31/

Re: drill accumulo

2015-11-13 Thread Zen 98052
@Steven: Yes, I am thinking to work on it during my spare time on x-mas holidays. @Jeff: I am thinking the same approach too, looking at HBase storage plugin (though I never used HBase, but Accumulo should have similar concept) From: Jeff Downton

[GitHub] drill pull request: DRILL-4053: Reduce metadata cache file size. S...

2015-11-13 Thread StevenMPhillips
Github user StevenMPhillips commented on the pull request: https://github.com/apache/drill/pull/254#issuecomment-156602190 Why do you need to know the version before reading the file? --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] drill pull request: DRILL-4053: Reduce metadata cache file size. S...

2015-11-13 Thread parthchandra
Github user parthchandra commented on the pull request: https://github.com/apache/drill/pull/254#issuecomment-156605210 OK. No problem. I'll put both versions in. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] drill pull request: DRILL-3623: Use shorter query path for LIMIT 0...

2015-11-13 Thread jacques-n
Github user jacques-n commented on a diff in the pull request: https://github.com/apache/drill/pull/193#discussion_r44852176 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/planner/logical/DrillDirectScanRel.java --- @@ -0,0 +1,111 @@ +/** + * Licensed to the

[GitHub] drill pull request: DRILL-4083: ScanPrel's CPU cost should not be ...

2015-11-13 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/drill/pull/253 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

Re: select from table with options

2015-11-13 Thread Julien Le Dem
Here you go: https://issues.apache.org/jira/browse/CALCITE-967 I was planning on providing patch for both master and the fork, but I haven't started yet. On Thu, Nov 12, 2015 at 8:34 PM, Julian Hyde wrote: > You’re hitting the grammar ambiguity I expected. > > I think that

drill accumulo

2015-11-13 Thread Zen 98052
Hi, Is there already Drill driver talk to Apache Accumulo? If not, do you know if someone is actively working on it? Thanks, Z