Re: how to represent and optimize a query over partitioned storage

2021-12-11 Thread Alessandro Solimando
Do you have any code pointer for achieving that, Jacques? My main concern is how to estimate the new cost. Do you leverage the estimation of predicate selectivity over the partitioning expression maybe? Il Dom 12 Dic 2021, 05:48 Jacques Nadeau ha scritto: > What we have done in the past is

Re: Druid test hangs?

2021-12-11 Thread Alessandro Solimando
I started noticing that intermittently around a month ago, I had a quick look back then but I could not pinpoint the root cause. I don't think it is expected, and I guess it comes from test infra setup rather than the Calcite code itself. Il Dom 12 Dic 2021, 05:43 Jacques Nadeau ha scritto: >

Re: how to represent and optimize a query over partitioned storage

2021-12-11 Thread Jacques Nadeau
What we have done in the past is push filters into a scan and alter the costing (and estimated row count). In cases where the filter or portions of the filter can be applied against partitioning columns, you prune partitions and use a new row count estimate/cost estimate based on the reduced

Druid test hangs?

2021-12-11 Thread Jacques Nadeau
I see a couple of recent builds with Druid tests hanging. Is that a normal thing or something that has started recently. Examples: https://github.com/apache/calcite/runs/4487013505?check_suite_focus=true https://github.com/jacques-n/calcite/runs/4494836558?check_suite_focus=true

[CANCEL] [VOTE] Release apache-calcite-avatica-1.20.0 (release candidate 0)

2021-12-11 Thread Julian Hyde
Vote canceled due to https://issues.apache.org/jira/browse/CALCITE-4935.

Re: [VOTE] Release apache-calcite-avatica-1.20.0 (release candidate 0)

2021-12-11 Thread Julian Hyde
OK, CALCITE-4935 is a blocker. I'll cancel the vote. The .trash directory was due to poor hygiene in my sandbox environment. I'll do better next time. Thanks for finding this, Stamatis, and thanks for all who took the time on a weekend to vote. On Sat, Dec 11, 2021 at 2:13 PM Stamatis

[jira] [Created] (CALCITE-4936) Using LogicalCalc in ProjectCalcMergeRule and FilterCalcMergeRule

2021-12-11 Thread Maksim Gramin (Jira)
Maksim Gramin created CALCITE-4936: -- Summary: Using LogicalCalc in ProjectCalcMergeRule and FilterCalcMergeRule Key: CALCITE-4936 URL: https://issues.apache.org/jira/browse/CALCITE-4936 Project:

Re: [VOTE] Release apache-calcite-avatica-1.20.0 (release candidate 0)

2021-12-11 Thread Stamatis Zampetakis
It seems that the log4j relocation problem is a breaking change and probably a blocker. Logged CALCITE-4935 with more information. On Sat, Dec 11, 2021 at 10:49 PM Stamatis Zampetakis wrote: > Thanks for preparing this RC so quickly Julian! > > Ubuntu 20.04.3 LTS, jdk1.8.0_261, Gradle wrapper,

[jira] [Created] (CALCITE-4935) Avatica standalone-server shades log4j without relocation

2021-12-11 Thread Stamatis Zampetakis (Jira)
Stamatis Zampetakis created CALCITE-4935: Summary: Avatica standalone-server shades log4j without relocation Key: CALCITE-4935 URL: https://issues.apache.org/jira/browse/CALCITE-4935 Project:

Re: [VOTE] Release apache-calcite-avatica-1.20.0 (release candidate 0)

2021-12-11 Thread Stamatis Zampetakis
Thanks for preparing this RC so quickly Julian! Ubuntu 20.04.3 LTS, jdk1.8.0_261, Gradle wrapper, Gradle 6.8.3 * Checked signatures and checksums OK * Went over release note OK * Built from git tag and run tests (./gradlew clean build) OK * Built from source artifacts and run tests (gradle

Re: [VOTE] Release apache-calcite-avatica-1.20.0 (release candidate 0)

2021-12-11 Thread Jacques Nadeau
+1 (binding) Checked sig, checksum. Built and tested on macos/jdk8b302/gradle6.8.1. Thanks for being RM Julian. On Sat, Dec 11, 2021 at 1:30 PM Francis Chuang wrote: > Thanks for being RM, Julian! > > My vote is: +1 > > - Verified GPG signature - OK > - Verified SHA512 - OK > - Checked

Re: [VOTE] Release apache-calcite-avatica-1.20.0 (release candidate 0)

2021-12-11 Thread Francis Chuang
Thanks for being RM, Julian! My vote is: +1 - Verified GPG signature - OK - Verified SHA512 - OK - Checked release notes on stage branch (https://github.com/apache/calcite-avatica/blob/stage/site/_docs/history.md) - OK - Ran tests (gradle test) - OK - Spot checked Nexus artifacts - OK

[VOTE] Release apache-calcite-avatica-1.20.0 (release candidate 0)

2021-12-11 Thread Julian Hyde
Hi all, I have created a build for Apache Calcite Avatica 1.20.0, release candidate 0. Thanks to everyone who has contributed to this release. You can read the release notes here: https://gitbox.apache.org/repos/asf/calcite-avatica-site-preview.git/avatica/docs/history.html The commit to be

[jira] [Created] (CALCITE-4934) Deploy snapshot releases to Apache snapshot repo

2021-12-11 Thread Jacques Nadeau (Jira)
Jacques Nadeau created CALCITE-4934: --- Summary: Deploy snapshot releases to Apache snapshot repo Key: CALCITE-4934 URL: https://issues.apache.org/jira/browse/CALCITE-4934 Project: Calcite

[jira] [Created] (CALCITE-4933) Release avatica 1.20

2021-12-11 Thread Josh Elser (Jira)
Josh Elser created CALCITE-4933: --- Summary: Release avatica 1.20 Key: CALCITE-4933 URL: https://issues.apache.org/jira/browse/CALCITE-4933 Project: Calcite Issue Type: Task

[jira] [Created] (CALCITE-4932) Deprecate JdbcCalc and JdbcCalcRule

2021-12-11 Thread Francesco Gini (Jira)
Francesco Gini created CALCITE-4932: --- Summary: Deprecate JdbcCalc and JdbcCalcRule Key: CALCITE-4932 URL: https://issues.apache.org/jira/browse/CALCITE-4932 Project: Calcite Issue Type: