Re: Parquet Metadata table on Rolling window

No, it does not. We rebuild metadata for all directories under mydata when you query /mydata. If new files get added anywhere in the whole hierarchy, metadata gets regenerated for all of them. However, if you query only /mydata/3 and nothing is changed under 3, no metadata is generated.

[jira] [Created] (DRILL-5883) Support escape syntax for an outer join

second88 created DRILL-5883: --- Summary: Support escape syntax for an outer join Key: DRILL-5883 URL: https://issues.apache.org/jira/browse/DRILL-5883 Project: Apache Drill Issue Type: New Feature

[GitHub] drill pull request #991: DRILL-5876: Remove netty-tcnative dependency from j...

Github user vrozov commented on a diff in the pull request: https://github.com/apache/drill/pull/991#discussion_r145008784 --- Diff: exec/java-exec/pom.xml --- @@ -701,18 +707,21 @@ - -kr.motd.maven -os-maven-plugin -

[jira] [Created] (DRILL-5882) C++ Client: [Threat Modeling] Drillbit may be spoofed by an attacker and this may lead to data being written to the attacker's target instead of Drillbit

Sorabh Hamirwasia created DRILL-5882: Summary: C++ Client: [Threat Modeling] Drillbit may be spoofed by an attacker and this may lead to data being written to the attacker's target instead of Drillbit Key: DRILL-5882

[jira] [Created] (DRILL-5881) Java Client: [Threat Modeling] Drillbit may be spoofed by an attacker and this may lead to data being written to the attacker's target instead of Drillbit

Sorabh Hamirwasia created DRILL-5881: Summary: Java Client: [Threat Modeling] Drillbit may be spoofed by an attacker and this may lead to data being written to the attacker's target instead of Drillbit Key: DRILL-5881

[GitHub] drill issue #992: DRILL-5873: (C++ Client) Improve SASL error reporting.

Github user sohami commented on the issue: https://github.com/apache/drill/pull/992 +1 LGTM. Thanks a lot for the changes. ---

Jenkins build is back to normal : drill-scm #899

See

[jira] [Resolved] (DRILL-5877) Fix Travis build

[ https://issues.apache.org/jira/browse/DRILL-5877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Parth Chandra resolved DRILL-5877. -- Resolution: Fixed > Fix Travis build > - > > Key: DRILL-5877 >

[GitHub] drill pull request #995: DRILL-5877: - Fix travis build. Add *.pem and *.p12...

Github user asfgit closed the pull request at: https://github.com/apache/drill/pull/995 ---

[GitHub] drill issue #949: DRILL-5795: Parquet Filter push down at rowgroup level

Github user priteshm commented on the issue: https://github.com/apache/drill/pull/949 @paul-rogers, @kkhatua can you provide some more information on the test case that failed? Hopefully, @dprofeta can replicate it in his environment. ---

[GitHub] drill pull request #992: DRILL-5873: (C++ Client) Improve SASL error reporti...

Github user sohami commented on a diff in the pull request: https://github.com/apache/drill/pull/992#discussion_r144977545 --- Diff: contrib/native/client/src/clientlib/drillClientImpl.cpp --- @@ -678,7 +678,10 @@ connectionStatus_t DrillClientImpl::handleAuthentication(const

Re: Possible submission for BI tools documentation

Hi, My company blog post is ready. https://support.sisense.com/hc/en-us/community/posts/ 115007865387-Leveraging-Cloud-File-Storage-Data-Sources-AWS- s3-Azure-Blob-Storage-Google-Cloud-Storage-in-Sisense-using-Apache-Drill I'm looking to adapt it for the section on BI connectors. I'm not that

[jira] [Created] (DRILL-5880) java.sql.SQLException: UNSUPPORTED_OPERATION ERROR: This query cannot be planned possibly due to either a cartesian join or an inequality join

Prasad Nagaraj Subramanya created DRILL-5880: Summary: java.sql.SQLException: UNSUPPORTED_OPERATION ERROR: This query cannot be planned possibly due to either a cartesian join or an inequality join Key: DRILL-5880

[jira] [Created] (DRILL-5879) Optimize "Like" operator

salim achouche created DRILL-5879: - Summary: Optimize "Like" operator Key: DRILL-5879 URL: https://issues.apache.org/jira/browse/DRILL-5879 Project: Apache Drill Issue Type: Improvement

[GitHub] drill pull request #996: DRILL-5878: TableNotFound exception is being report...

GitHub user HanumathRao opened a pull request: https://github.com/apache/drill/pull/996 DRILL-5878: TableNotFound exception is being reported for a wrong sto… …rage plugin. @paul-rogers @chunhui-shi Please review these changes. These changes are for reporting a

[jira] [Created] (DRILL-5878) TableNotFound exception is being reported for a wrong storage plugin.

Hanumath Rao Maduri created DRILL-5878: -- Summary: TableNotFound exception is being reported for a wrong storage plugin. Key: DRILL-5878 URL: https://issues.apache.org/jira/browse/DRILL-5878

[GitHub] drill pull request #991: DRILL-5876: Remove netty-tcnative dependency from j...

Github user parthchandra commented on a diff in the pull request: https://github.com/apache/drill/pull/991#discussion_r144960078 --- Diff: exec/java-exec/pom.xml --- @@ -701,18 +707,21 @@ - -kr.motd.maven -os-maven-plugin -

[jira] [Resolved] (DRILL-5815) Provide option to set query memory as percent of total

[ https://issues.apache.org/jira/browse/DRILL-5815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Rogers resolved DRILL-5815. Resolution: Fixed > Provide option to set query memory as percent of total >

[jira] [Resolved] (DRILL-5743) Using order by clause in a select * query on hbase table returns only the row_key and order by field(s)

[ https://issues.apache.org/jira/browse/DRILL-5743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Rogers resolved DRILL-5743. Resolution: Fixed Reviewer: Paul Rogers Fix Version/s: 1.12.0 > Using order by

Build failed in Jenkins: drill-scm #898

See Changes: [progers] DRILL-5815: Option to set query memory as percent of total [progers] DRILL-5838: Fix MaprDB filter pushdown for the case of nested field [progers] DRILL-5743: Handling column family and column

[GitHub] drill pull request #989: DRILL-5790: PCAP format explicitly opens local file

Github user asfgit closed the pull request at: https://github.com/apache/drill/pull/989 ---

[GitHub] drill pull request #975: DRILL-5743: Handling column family and column scan ...

Github user asfgit closed the pull request at: https://github.com/apache/drill/pull/975 ---

[GitHub] drill pull request #979: DRILL-5853 : Update Calcite to get NULL direction f...

Github user asfgit closed the pull request at: https://github.com/apache/drill/pull/979 ---

[GitHub] drill pull request #960: DRILL-5815: Option to set query memory as percent o...

Github user asfgit closed the pull request at: https://github.com/apache/drill/pull/960 ---

[GitHub] drill pull request #972: DRILL-5838: Fix MaprDB filter pushdown for the case...

Github user asfgit closed the pull request at: https://github.com/apache/drill/pull/972 ---

Re: Parquet Metadata table on Rolling window

Thanks Padma, Would we benefits at all from running metadata on directories that we know we will never modify? We would end up with: /mydata/3/(Metadata generated...) /mydata/4/(Metadata generated...) /mydata/.../(Metadata generated...) /mydata/109/(Metadata generated...) /mydata/110/(Current

[GitHub] drill pull request #985: DRILL-5862 Update project parent pom xml to the lat...

Github user vrozov commented on a diff in the pull request: https://github.com/apache/drill/pull/985#discussion_r144937286 --- Diff: pom.xml --- @@ -15,7 +15,8 @@ org.apache apache -14 +18 --- End diff -- @paul-rogers This is

[GitHub] drill pull request #995: DRILL-5877: - Fix travis build. Add *.pem and *.p12...

GitHub user parthchandra opened a pull request: https://github.com/apache/drill/pull/995 DRILL-5877: - Fix travis build. Add *.pem and *.p12 files to rat excl… …usions. These files are binary files used in ssl tests. You can merge this pull request into a Git repository by

RE: [HANGOUT] Oct 17 2017. Talk by Salim + usual topic discussions.

For Salim's talk ( https://issues.apache.org/jira/browse/DRILL-5846 ) , it would be nice if folks who have previously worked on the Parquet Reader attend and give their inputs. The folks whom I see from the commit history with relevant contributions to the Parquet reader are: 1. Parth Chandra

[HANGOUT] Oct 17 2017. Talk by Salim + usual topic discussions.

Hi, We will have a Drill hangout tomorrow (Tuesday Oct 17) at 10 AM Pacific Time. Talk: Salim will talk about his attempts to explore Parquet Scanner performance enhancements opportunities (JIRA-5846). Discussions: Please suggest topics by replying to this thread or bring them up during the

[GitHub] drill pull request #993: DRILL-5874: NPE in AnonWebUserConnection.cleanupSes...

Github user paul-rogers commented on a diff in the pull request: https://github.com/apache/drill/pull/993#discussion_r144930316 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/server/rest/WebUserConnection.java --- @@ -124,6 +124,13 @@ public void

[GitHub] drill pull request #993: DRILL-5874: NPE in AnonWebUserConnection.cleanupSes...

Github user paul-rogers commented on a diff in the pull request: https://github.com/apache/drill/pull/993#discussion_r144930573 --- Diff: exec/java-exec/src/test/java/org/apache/drill/exec/server/rest/WebSessionResourcesTest.java --- @@ -0,0 +1,146 @@ +/* + * Licensed to

[GitHub] drill pull request #993: DRILL-5874: NPE in AnonWebUserConnection.cleanupSes...

Github user paul-rogers commented on a diff in the pull request: https://github.com/apache/drill/pull/993#discussion_r144929270 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/server/rest/DrillRestServer.java --- @@ -260,8 +282,14 @@ public WebUserConnection

[GitHub] drill pull request #993: DRILL-5874: NPE in AnonWebUserConnection.cleanupSes...

Github user paul-rogers commented on a diff in the pull request: https://github.com/apache/drill/pull/993#discussion_r144929150 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/server/rest/DrillRestServer.java --- @@ -204,9 +217,15 @@ public WebUserConnection

[GitHub] drill pull request #993: DRILL-5874: NPE in AnonWebUserConnection.cleanupSes...

Github user paul-rogers commented on a diff in the pull request: https://github.com/apache/drill/pull/993#discussion_r144928933 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/server/rest/DrillRestServer.java --- @@ -204,9 +217,15 @@ public WebUserConnection

[GitHub] drill pull request #993: DRILL-5874: NPE in AnonWebUserConnection.cleanupSes...

Github user paul-rogers commented on a diff in the pull request: https://github.com/apache/drill/pull/993#discussion_r144929812 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/server/rest/WebSessionResources.java --- @@ -68,16 +68,19 @@ public SocketAddress

[GitHub] drill issue #889: DRILL-5691: enhance scalar sub queries checking for the ca...

Github user paul-rogers commented on the issue: https://github.com/apache/drill/pull/889 @arina-ielchiieva, @amansinha100 can you take another look at this one and see if your concerns have been addressed? ---

[GitHub] drill issue #904: DRILL-5717: change some date time test cases with specific...

Github user paul-rogers commented on the issue: https://github.com/apache/drill/pull/904 @vvysotskyi, can you take a look at the revisions and see if it looks OK? ---

[jira] [Created] (DRILL-5877) Fix Travis build

Parth Chandra created DRILL-5877: Summary: Fix Travis build Key: DRILL-5877 URL: https://issues.apache.org/jira/browse/DRILL-5877 Project: Apache Drill Issue Type: Bug Reporter:

[GitHub] drill pull request #960: DRILL-5815: Option to set query memory as percent o...

Github user paul-rogers commented on a diff in the pull request: https://github.com/apache/drill/pull/960#discussion_r144926648 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/util/MemoryAllocationUtilities.java --- @@ -56,30 +59,90 @@ public static void

[GitHub] drill pull request #970: DRILL-5832: Migrate OperatorFixture to use SystemOp...

Github user paul-rogers commented on a diff in the pull request: https://github.com/apache/drill/pull/970#discussion_r144924587 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/store/parquet2/DrillParquetReader.java --- @@ -84,14 +82,7 @@ private RecordReader

[GitHub] drill pull request #970: DRILL-5832: Migrate OperatorFixture to use SystemOp...

Github user paul-rogers commented on a diff in the pull request: https://github.com/apache/drill/pull/970#discussion_r144924491 --- Diff: exec/java-exec/src/test/java/org/apache/drill/exec/physical/impl/writer/TestParquetWriter.java --- @@ -184,25 +183,26 @@ public void

[GitHub] drill issue #979: DRILL-5853 : Update Calcite to get NULL direction for sort...

Github user amansinha100 commented on the issue: https://github.com/apache/drill/pull/979 +1 ---

[GitHub] drill pull request #976: DRILL-5797: Choose parquet reader from read columns

Github user paul-rogers commented on a diff in the pull request: https://github.com/apache/drill/pull/976#discussion_r144074677 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/store/parquet/ParquetScanBatchCreator.java --- @@ -156,20 +161,46 @@ public ScanBatch

[GitHub] drill issue #979: DRILL-5853 : Update Calcite to get NULL direction for sort...

Github user paul-rogers commented on the issue: https://github.com/apache/drill/pull/979 @amansinha100, this is a one-liner; do you have time for a quick review? Thanks. ---

[GitHub] drill pull request #985: DRILL-5862 Update project parent pom xml to the lat...

Github user paul-rogers commented on a diff in the pull request: https://github.com/apache/drill/pull/985#discussion_r144915659 --- Diff: pom.xml --- @@ -15,7 +15,8 @@ org.apache apache -14 +18 --- End diff -- Never noticed

[GitHub] drill pull request #987: DRILL-5863: Sortable table incorrectly sorts fragme...

Github user paul-rogers commented on a diff in the pull request: https://github.com/apache/drill/pull/987#discussion_r144914422 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/server/rest/profile/OperatorWrapper.java --- @@ -76,12 +77,14 @@ public String getId() {

[GitHub] drill pull request #987: DRILL-5863: Sortable table incorrectly sorts fragme...

Github user paul-rogers commented on a diff in the pull request: https://github.com/apache/drill/pull/987#discussion_r144914493 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/server/rest/profile/FragmentWrapper.java --- @@ -244,7 +248,8 @@ public String getContent()

[GitHub] drill pull request #987: DRILL-5863: Sortable table incorrectly sorts fragme...

Github user paul-rogers commented on a diff in the pull request: https://github.com/apache/drill/pull/987#discussion_r144914241 --- Diff: exec/java-exec/src/main/java/org/apache/drill/exec/server/rest/profile/OperatorWrapper.java --- @@ -76,12 +77,14 @@ public String getId() {

[GitHub] drill issue #976: DRILL-5797: Choose parquet reader from read columns

Github user dprofeta commented on the issue: https://github.com/apache/drill/pull/976 here is the updated PR. Yes, I also wanted to add group without repetition. It is only a matter of naming so it should not be hard but when I tested, the fast reader was not able to handle it.

Re: Newbie: Join queries in MySQL.

I can try that, thanks a lot! On Fri, Oct 13, 2017 at 11:06 PM, Kunal Khatua wrote: > You could try creating simple views (with different column names) on those > tables. That way, you don’t have to try changing the column names in the > table itself. > > -Original