[
https://issues.apache.org/jira/browse/CALCITE-5615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17736290#comment-17736290
]
Mihai Budiu commented on CALCITE-5615:
--------------------------------------
There are 156 files with 0 failures.
Most files have ~ 10 failures.
There are 21 files with more than 100 failures each.
The largest number of failures in a file is 362.
I am thinking to have a log of this form:
test/random/aggregates/slt_good_84.test:9118:8
test/random/aggregates/slt_good_85.test:9106:26
test/random/aggregates/slt_good_86.test:9045:21
Where the two numbers are passing tests and failing tests respectively. This
file has almost 622 rows. This is what we would check in.
The file does not have exactly 622 rows due to 2 reasons:
* 5 tests fail in DDL statements, since they are unsupported by HSQL, e.g.,
CREATE TRIGGER xxx UPDATE
* 2 tests timeout, seemingly getting into an infinite loop
I have added these 7 tests to a deny list.
I hope to submit this PR for review today.
> Run SQLLogicTests using Calcite
> -------------------------------
>
> Key: CALCITE-5615
> URL: https://issues.apache.org/jira/browse/CALCITE-5615
> Project: Calcite
> Issue Type: Improvement
> Components: core
> Affects Versions: 1.34.0
> Reporter: Mihai Budiu
> Assignee: Mihai Budiu
> Priority: Minor
> Labels: pull-request-available
> Time Spent: 1h 20m
> Remaining Estimate: 0h
>
> Sqllogictest is a program designed to verify that an SQL database engine
> computes correct results by comparing the results to identical queries from
> other SQL database engines.
> https://www.sqlite.org/sqllogictest/doc/trunk/about.wiki
> The nice thing about SLT is that it contains more than 7 million tests. The
> tests only cover the core of SQL, ideally the portable part across all
> engines. They only test integers, doubles, and strings. So they could
> probably be part of the Calcite slow tests.
> The tests should be structured so that any query execution engine can be used.
> I plan to contribute such an implementation if people think it is useful, but
> I haven't yet worked out all the details.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
