Parth Chandra created DRILL-5818:
Summary: Querying from system options is broken
Key: DRILL-5818
URL: https://issues.apache.org/jira/browse/DRILL-5818
Project: Apache Drill
Issue Type: Bug
Hi Max,
Not via Drill, but you can find the data types of Parquet file(s) by
using the parquet-tools (see
https://github.com/apache/parquet-mr/tree/master/parquet-tools )
See example below,
-- Boaz
$ cd ~/parquet-mr/parquet-tools
$ java -jar
Github user Ben-Zvi closed the pull request at:
https://github.com/apache/drill/pull/938
---
Github user kkhatua commented on a diff in the pull request:
https://github.com/apache/drill/pull/953#discussion_r140927942
--- Diff: exec/java-exec/src/main/resources/rest/profile/list.ftl ---
@@ -37,7 +37,15 @@
No running queries.
- Completed
Github user paul-rogers commented on a diff in the pull request:
https://github.com/apache/drill/pull/958#discussion_r140939339
--- Diff:
exec/memory/base/src/main/java/org/apache/drill/exec/memory/Accountant.java ---
@@ -22,16 +22,55 @@
import
Github user paul-rogers commented on a diff in the pull request:
https://github.com/apache/drill/pull/958#discussion_r140939608
--- Diff:
exec/memory/base/src/main/java/org/apache/drill/exec/memory/Accountant.java ---
@@ -80,6 +119,23 @@ public Accountant(Accountant parent, long
Github user paul-rogers commented on a diff in the pull request:
https://github.com/apache/drill/pull/958#discussion_r140939480
--- Diff:
exec/memory/base/src/main/java/org/apache/drill/exec/memory/Accountant.java ---
@@ -22,16 +22,55 @@
import
Github user paul-rogers commented on the issue:
https://github.com/apache/drill/pull/959
The change looks benign. I wonder; do we have a test case that exercises
the hash functions so we can be certain that the fix actually solves the
original problem?
---
Github user paul-rogers commented on the issue:
https://github.com/apache/drill/pull/957
Thanks for the changes.
+1
---
Github user Ben-Zvi commented on a diff in the pull request:
https://github.com/apache/drill/pull/958#discussion_r140870691
--- Diff:
exec/memory/base/src/main/java/org/apache/drill/exec/memory/Accountant.java ---
@@ -22,16 +22,55 @@
import
Github user Ben-Zvi commented on a diff in the pull request:
https://github.com/apache/drill/pull/958#discussion_r140869257
--- Diff:
exec/memory/base/src/main/java/org/apache/drill/exec/memory/Accountant.java ---
@@ -22,16 +22,55 @@
import
Github user Ben-Zvi commented on a diff in the pull request:
https://github.com/apache/drill/pull/958#discussion_r140938324
--- Diff:
exec/memory/base/src/main/java/org/apache/drill/exec/memory/Accountant.java ---
@@ -80,6 +119,23 @@ public Accountant(Accountant parent, long
Prasad Nagaraj Subramanya created DRILL-5819:
Summary: Default value of security.admin.user_groups and
security.admin.users is "true"
Key: DRILL-5819
URL:
Github user paul-rogers commented on a diff in the pull request:
https://github.com/apache/drill/pull/957#discussion_r140936258
--- Diff:
common/src/test/java/org/apache/drill/testutils/DirTestWatcher.java ---
@@ -0,0 +1,61 @@
+/**
+ * Licensed to the Apache Software
Github user paul-rogers commented on a diff in the pull request:
https://github.com/apache/drill/pull/957#discussion_r140935951
--- Diff:
common/src/test/java/org/apache/drill/testutils/DirTestWatcher.java ---
@@ -0,0 +1,61 @@
+/**
--- End diff --
For copyright,
Github user paul-rogers commented on a diff in the pull request:
https://github.com/apache/drill/pull/957#discussion_r140936230
--- Diff:
common/src/test/java/org/apache/drill/testutils/DirTestWatcher.java ---
@@ -0,0 +1,61 @@
+/**
+ * Licensed to the Apache Software
Github user paul-rogers commented on a diff in the pull request:
https://github.com/apache/drill/pull/957#discussion_r140936344
--- Diff:
exec/java-exec/src/main/java/org/apache/drill/exec/server/options/PersistedOptionValue.java
---
@@ -0,0 +1,310 @@
+/**
+ * Licensed to
Github user paul-rogers commented on a diff in the pull request:
https://github.com/apache/drill/pull/957#discussion_r140936539
--- Diff:
exec/java-exec/src/test/java/org/apache/drill/exec/server/options/OptionValueTest.java
---
@@ -0,0 +1,72 @@
+/**
--- End diff --
Github user paul-rogers commented on a diff in the pull request:
https://github.com/apache/drill/pull/957#discussion_r140936016
--- Diff:
common/src/test/java/org/apache/drill/testutils/DirTestWatcher.java ---
@@ -0,0 +1,61 @@
+/**
+ * Licensed to the Apache Software
Github user paul-rogers commented on a diff in the pull request:
https://github.com/apache/drill/pull/957#discussion_r140936558
--- Diff:
exec/java-exec/src/test/java/org/apache/drill/exec/server/options/PersistedOptionValueTest.java
---
@@ -0,0 +1,226 @@
+/**
--- End
Github user paul-rogers commented on a diff in the pull request:
https://github.com/apache/drill/pull/957#discussion_r140936599
--- Diff:
exec/java-exec/src/test/java/org/apache/drill/exec/server/options/PersistedOptionValueTest.java
---
@@ -0,0 +1,226 @@
+/**
+ *
Github user paul-rogers commented on a diff in the pull request:
https://github.com/apache/drill/pull/957#discussion_r140936303
--- Diff:
exec/java-exec/src/main/java/org/apache/drill/exec/server/options/PersistedOptionValue.java
---
@@ -0,0 +1,310 @@
+/**
--- End diff --
GitHub user paul-rogers opened a pull request:
https://github.com/apache/drill/pull/960
DRILL-5815: Option to set query memory as percent of total
This PR provides an alternative way to set the memory per query as a
percent of system memory.
### Background
Drill
Github user ilooner commented on the issue:
https://github.com/apache/drill/pull/957
@paul-rogers Applied comments and did a few other changes. Unit tests cover
backward compatability. I manually tested forward compatability locally by
saving some options with the new version using
Github user kkhatua commented on a diff in the pull request:
https://github.com/apache/drill/pull/954#discussion_r140957231
--- Diff:
exec/java-exec/src/main/java/org/apache/drill/exec/server/rest/profile/ProfileWrapper.java
---
@@ -75,24 +75,31 @@ public ProfileWrapper(final
Hello,
A few format handled by Drill enable to work with document, meaning
nested and repeated structure instead of just tables. Json and Parquet
are the two that come to my mind right now. Document modeling is a great
way to express complex object and is used a lot in my company. Drill is
Github user asfgit closed the pull request at:
https://github.com/apache/drill/pull/942
---
Github user ilooner commented on the issue:
https://github.com/apache/drill/pull/957
@paul-rogers Applied comments and squashed commits
---
Github user paul-rogers commented on the issue:
https://github.com/apache/drill/pull/805
I'm probably confused. Our goal with the Parquet metadata versioning was
that new Drill versions can read old files. Here we have a case in which I was
running with old versions of the file,
Github user asfgit closed the pull request at:
https://github.com/apache/drill/pull/948
---
Github user asfgit closed the pull request at:
https://github.com/apache/drill/pull/951
---
Github user asfgit closed the pull request at:
https://github.com/apache/drill/pull/952
---
Github user asfgit closed the pull request at:
https://github.com/apache/drill/pull/956
---
Dechang Gu created DRILL-5817:
-
Summary: deprecated sys options should be deleted from old
zookeeper setting
Key: DRILL-5817
URL: https://issues.apache.org/jira/browse/DRILL-5817
Project: Apache Drill
Github user parthchandra commented on a diff in the pull request:
https://github.com/apache/drill/pull/950#discussion_r140608922
--- Diff:
exec/java-exec/src/main/java/org/apache/drill/exec/ssl/SSLConfig.java ---
@@ -0,0 +1,325 @@
+/*
+ * Licensed to the Apache Software
Github user parthchandra commented on a diff in the pull request:
https://github.com/apache/drill/pull/950#discussion_r140605580
--- Diff:
exec/java-exec/src/main/java/org/apache/drill/exec/rpc/user/UserServer.java ---
@@ -70,22 +78,80 @@
private static final
Github user parthchandra commented on a diff in the pull request:
https://github.com/apache/drill/pull/950#discussion_r140621612
--- Diff: exec/rpc/src/main/java/org/apache/drill/exec/rpc/BasicClient.java
---
@@ -100,6 +103,8 @@ protected void initChannel(SocketChannel ch) throws
Github user parthchandra commented on a diff in the pull request:
https://github.com/apache/drill/pull/950#discussion_r140601290
--- Diff: contrib/native/client/readme.linux ---
@@ -84,6 +84,21 @@ OR
ln -svf libboost_filesystem.a libboost_filesystem-mt.a
ln -svf
Github user parthchandra commented on a diff in the pull request:
https://github.com/apache/drill/pull/950#discussion_r140603757
--- Diff:
exec/java-exec/src/main/java/org/apache/drill/exec/rpc/user/UserConnectionConfig.java
---
@@ -75,10 +76,20 @@
} else {
Github user parthchandra commented on a diff in the pull request:
https://github.com/apache/drill/pull/950#discussion_r140612371
--- Diff:
exec/jdbc/src/main/java/org/apache/drill/jdbc/impl/DrillConnectionImpl.java ---
@@ -140,12 +140,12 @@ protected DrillConnectionImpl(DriverImpl
Github user parthchandra commented on the issue:
https://github.com/apache/drill/pull/946
+1. Thanks for the fix.
---
Github user parthchandra commented on a diff in the pull request:
https://github.com/apache/drill/pull/950#discussion_r140608117
--- Diff:
exec/java-exec/src/main/java/org/apache/drill/exec/ssl/SSLConfig.java ---
@@ -0,0 +1,325 @@
+/*
+ * Licensed to the Apache Software
Github user parthchandra commented on a diff in the pull request:
https://github.com/apache/drill/pull/950#discussion_r140601254
--- Diff:
common/src/main/java/org/apache/drill/common/config/DrillConfig.java ---
@@ -110,8 +110,8 @@ public static DrillConfig create() {
*
Github user parthchandra commented on a diff in the pull request:
https://github.com/apache/drill/pull/950#discussion_r140602937
--- Diff: distribution/src/resources/drill-override-example.conf ---
@@ -222,7 +222,35 @@ drill.exec: {
# Full workspace name should be indicated
Github user parthchandra commented on a diff in the pull request:
https://github.com/apache/drill/pull/950#discussion_r140608891
--- Diff:
exec/java-exec/src/main/java/org/apache/drill/exec/ssl/SSLConfig.java ---
@@ -0,0 +1,325 @@
+/*
+ * Licensed to the Apache Software
Github user parthchandra commented on a diff in the pull request:
https://github.com/apache/drill/pull/950#discussion_r140612241
--- Diff:
exec/java-exec/src/main/java/org/apache/drill/exec/ssl/SSLConfigClient.java ---
@@ -0,0 +1,229 @@
+/*
+ * Licensed to the Apache
Github user parthchandra commented on a diff in the pull request:
https://github.com/apache/drill/pull/950#discussion_r140602783
--- Diff: distribution/src/resources/drill-override-example.conf ---
@@ -222,7 +222,35 @@ drill.exec: {
# Full workspace name should be indicated
Github user parthchandra commented on a diff in the pull request:
https://github.com/apache/drill/pull/950#discussion_r140611290
--- Diff:
exec/java-exec/src/main/java/org/apache/drill/exec/ssl/SSLConfigBuilder.java ---
@@ -0,0 +1,86 @@
+/*
+ * Licensed to the Apache
Github user parthchandra commented on a diff in the pull request:
https://github.com/apache/drill/pull/950#discussion_r140621780
--- Diff: exec/rpc/src/main/java/org/apache/drill/exec/rpc/BasicClient.java
---
@@ -120,6 +125,25 @@ protected void initChannel(SocketChannel ch) throws
Github user parthchandra commented on a diff in the pull request:
https://github.com/apache/drill/pull/950#discussion_r140610830
--- Diff:
exec/java-exec/src/main/java/org/apache/drill/exec/ssl/SSLConfig.java ---
@@ -0,0 +1,325 @@
+/*
+ * Licensed to the Apache Software
Github user parthchandra commented on a diff in the pull request:
https://github.com/apache/drill/pull/950#discussion_r140603400
--- Diff:
exec/java-exec/src/main/java/org/apache/drill/exec/ExecConstants.java ---
@@ -126,10 +138,10 @@
String HTTP_SESSION_MEMORY_RESERVATION
Github user parthchandra commented on a diff in the pull request:
https://github.com/apache/drill/pull/950#discussion_r140621875
--- Diff: exec/rpc/src/main/java/org/apache/drill/exec/rpc/BasicServer.java
---
@@ -203,6 +226,9 @@ public void close() throws IOException {
Github user parthchandra commented on a diff in the pull request:
https://github.com/apache/drill/pull/950#discussion_r140603240
--- Diff:
exec/java-exec/src/main/java/org/apache/drill/exec/ExecConstants.java ---
@@ -110,6 +110,18 @@
String HASHAGG_FALLBACK_ENABLED_KEY =
Github user parthchandra commented on a diff in the pull request:
https://github.com/apache/drill/pull/950#discussion_r140611274
--- Diff:
exec/java-exec/src/main/java/org/apache/drill/exec/ssl/SSLConfigBuilder.java ---
@@ -0,0 +1,86 @@
+/*
+ * Licensed to the Apache
Damien,
thanks for initiating the discussion..indeed this would be a very useful
enhancement. Currently, Drill provides repeated_contains() for filtering
and repeated_count() for count aggregates on arrays but not the general
purpose intra-document operations that you need based on your example.
Github user vvysotskyi commented on the issue:
https://github.com/apache/drill/pull/805
This my bad habit to regenerate metadata left from the times before fix
DRILL-5660. These functional test failures are the result of the mistake that I
have made when resolving merge conflicts
Github user ilooner commented on a diff in the pull request:
https://github.com/apache/drill/pull/957#discussion_r140946604
--- Diff:
common/src/test/java/org/apache/drill/testutils/DirTestWatcher.java ---
@@ -0,0 +1,61 @@
+/**
+ * Licensed to the Apache Software
Github user vvysotskyi commented on a diff in the pull request:
https://github.com/apache/drill/pull/905#discussion_r140730762
--- Diff:
exec/java-exec/src/main/java/org/apache/drill/exec/planner/cost/DrillRelMdMaxRowCount.java
---
@@ -0,0 +1,71 @@
+/*
+* Licensed to the
Github user vvysotskyi commented on the issue:
https://github.com/apache/drill/pull/805
@paul-rogers, test data should be regenerated (using the Drill version with
this fix) before running functional tests since these tests use metadata cache
files.
Regarding unit test failures:
Github user vvysotskyi commented on the issue:
https://github.com/apache/drill/pull/905
Since Drill does not have enough information about tables in the planning
time to avoid this OOM and since without using the `getMaxRowCount()` for
`ScanPrel`, current approach could not be used
Github user weijietong commented on a diff in the pull request:
https://github.com/apache/drill/pull/889#discussion_r140756869
--- Diff:
exec/java-exec/src/main/java/org/apache/drill/exec/planner/cost/DrillRelMdMaxRowCount.java
---
@@ -0,0 +1,42 @@
+/*
+ * Licensed to the
Github user vvysotskyi commented on the issue:
https://github.com/apache/drill/pull/905
@jinfengni it was an inflated example, but considering the case of multiple
joins and when tables have several repeated values, the result will be the
same.
---
Github user vvysotskyi closed the pull request at:
https://github.com/apache/drill/pull/905
---
63 matches
Mail list logo