[
https://issues.apache.org/jira/browse/DRILL-7306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16876075#comment-16876075
]
ASF GitHub Bot commented on DRILL-7306:
---------------------------------------
arina-ielchiieva commented on issue #1813: DRILL-7306: Disable schema-only
batch for new scan framework
URL: https://github.com/apache/drill/pull/1813#issuecomment-507203793
@paul-rogers re-ran full tests suit for the updated branch. Previous
failures have been fixed but new were added:
```
/root/drillAutomation/drill-test-framework/framework/resources/Advanced/tpch/tpch_sf1/smoke/parquet/union02.sql
/root/drillAutomation/drill-test-framework/framework/resources/Advanced/tpch/tpch_sf1/smoke/parquet/join08-merge.sql
/root/drillAutomation/drill-test-framework/framework/resources/Advanced/tpch/tpch_sf1/original/parquet/query4.sql
/root/drillAutomation/drill-test-framework/framework/resources/Advanced/tpch/tpch_sf1/smoke/parquet/join09-hash.sql
/root/drillAutomation/drill-test-framework/framework/resources/Advanced/tpch/tpch_sf1/smoke/parquet/join08-hash.sql
/root/drillAutomation/drill-test-framework/framework/resources/Advanced/tpch/tpch_sf1/smoke/parquet/union01.sql
/root/drillAutomation/drill-test-framework/framework/resources/Advanced/tpch/tpch_sf1/smoke/parquet/filter01.sql
/root/drillAutomation/drill-test-framework/framework/resources/Advanced/tpch/tpch_sf1/smoke/parquet/join01-hash.sql
/root/drillAutomation/drill-test-framework/framework/resources/Advanced/tpch/tpch_sf1/smoke/parquet/join09-merge.sql
/root/drillAutomation/drill-test-framework/framework/resources/Advanced/tpch/tpch_sf1/smoke/parquet/failed04.sql
/root/drillAutomation/drill-test-framework/framework/resources/Advanced/tpch/tpch_sf1/smoke/parquet/union03.sql
```
Looks like queries started to return zero results:
```
Data Verification Failures:
Query:
/root/drillAutomation/drill-test-framework/framework/resources/Advanced/tpch/tpch_sf1/smoke/parquet/union02.sql
SELECT C_CUSTKEY, C_NATIONKEY FROM customer C WHERE C_ACCTBAL BETWEEN 1000
AND 1200 AND C_NATIONKEY IN (1, 3)
Baseline:
/root/drillAutomation/drill-test-framework/framework/resources/Advanced/tpch/tpch_sf1/smoke/parquet/union02.e_tsv
Expected number of rows: 208
Actual number of rows from Drill: 0
Number of matching rows: 0
Number of rows missing: 208
Number of rows unexpected: 0
These rows are missing (first 10):
12282 3 (1 occurence(s))
6151 1 (1 occurence(s))
30727 1 (1 occurence(s))
110087 3 (1 occurence(s))
70662 3 (1 occurence(s))
101382 3 (1 occurence(s))
144393 1 (1 occurence(s))
95255 3 (1 occurence(s))
98331 1 (1 occurence(s))
122904 3 (1 occurence(s))
Query:
/root/drillAutomation/drill-test-framework/framework/resources/Advanced/tpch/tpch_sf1/smoke/parquet/join08-merge.sql
SELECT COUNT(*)
FROM (SELECT L.L_ORDERKEY AS X, C.C_CUSTKEY AS Y
FROM lineitem L
LEFT OUTER JOIN customer C
ON L.L_ORDERKEY = C.C_CUSTKEY) AS FOO
WHERE X < 10000
Baseline:
/root/drillAutomation/drill-test-framework/framework/resources/Advanced/tpch/tpch_sf1/smoke/parquet/join08-merge.e_tsv
Expected number of rows: 1
Actual number of rows from Drill: 1
Number of matching rows: 0
Number of rows missing: 1
Number of rows unexpected: 1
These rows are not expected (first 10):
0
These rows are missing (first 10):
9965 (1 occurence(s))
Query:
/root/drillAutomation/drill-test-framework/framework/resources/Advanced/tpch/tpch_sf1/original/parquet/query4.sql
SELECT
O.O_ORDERPRIORITY,
COUNT(*) AS ORDER_COUNT
FROM
orders O
WHERE
O.O_ORDERDate >= DATE '1996-10-01'
AND O.O_ORDERDate < DATE '1996-10-01' + INTERVAL '3' MONTH
AND
EXISTS (
SELECT
*
FROM
lineitem L
WHERE
L.L_ORDERKEY = O.O_ORDERKEY
AND L.L_COMMITDate < L.L_RECEIPTDate
)
GROUP BY
O.O_ORDERPRIORITY
ORDER BY
O.O_ORDERPRIORITY
Baseline:
/root/drillAutomation/drill-test-framework/framework/resources/Advanced/tpch/tpch_sf1/original/parquet/query4.e_tsv
Expected number of rows: 5
Actual number of rows from Drill: 0
Number of matching rows: 0
Number of rows missing: 5
Number of rows unexpected: 0
These rows are missing (first 10):
1-URGENT 10611 (1 occurence(s))
2-HIGH 10538 (1 occurence(s))
3-MEDIUM 10574 (1 occurence(s))
4-NOT SPECIFIED 10511 (1 occurence(s))
5-LOW 10568 (1 occurence(s))
Query:
/root/drillAutomation/drill-test-framework/framework/resources/Advanced/tpch/tpch_sf1/smoke/parquet/join09-hash.sql
SELECT COUNT(*)
FROM (SELECT L.L_ORDERKEY AS X, C.C_CUSTKEY AS Y
FROM lineitem L
LEFT OUTER JOIN customer C
ON L.L_ORDERKEY = C.C_CUSTKEY) AS FOO
WHERE Y < 10000
Baseline:
/root/drillAutomation/drill-test-framework/framework/resources/Advanced/tpch/tpch_sf1/smoke/parquet/join09-hash.e_tsv
Expected number of rows: 1
Actual number of rows from Drill: 1
Number of matching rows: 0
Number of rows missing: 1
Number of rows unexpected: 1
These rows are not expected (first 10):
0
These rows are missing (first 10):
9965 (1 occurence(s))
Query:
/root/drillAutomation/drill-test-framework/framework/resources/Advanced/tpch/tpch_sf1/smoke/parquet/join08-hash.sql
SELECT COUNT(*)
FROM (SELECT L.L_ORDERKEY AS X, C.C_CUSTKEY AS Y
FROM lineitem L
LEFT OUTER JOIN customer C
ON L.L_ORDERKEY = C.C_CUSTKEY) AS FOO
WHERE X < 10000
Baseline:
/root/drillAutomation/drill-test-framework/framework/resources/Advanced/tpch/tpch_sf1/smoke/parquet/join08-hash.e_tsv
Expected number of rows: 1
Actual number of rows from Drill: 1
Number of matching rows: 0
Number of rows missing: 1
Number of rows unexpected: 1
These rows are not expected (first 10):
0
These rows are missing (first 10):
9965 (1 occurence(s))
Query:
/root/drillAutomation/drill-test-framework/framework/resources/Advanced/tpch/tpch_sf1/smoke/parquet/union01.sql
SELECT C_CUSTKEY, C_NATIONKEY FROM customer C WHERE C_ACCTBAL BETWEEN 1000
AND 1200 AND C_NATIONKEY IN (2, 4)
Baseline:
/root/drillAutomation/drill-test-framework/framework/resources/Advanced/tpch/tpch_sf1/smoke/parquet/union01.e_tsv
Expected number of rows: 228
Actual number of rows from Drill: 0
Number of matching rows: 0
Number of rows missing: 228
Number of rows unexpected: 0
These rows are missing (first 10):
139771 4 (1 occurence(s))
40446 2 (1 occurence(s))
106495 2 (1 occurence(s))
60929 4 (1 occurence(s))
92676 4 (1 occurence(s))
58372 4 (1 occurence(s))
43532 4 (1 occurence(s))
47628 4 (1 occurence(s))
8207 2 (1 occurence(s))
108047 4 (1 occurence(s))
Query:
/root/drillAutomation/drill-test-framework/framework/resources/Advanced/tpch/tpch_sf1/smoke/parquet/filter01.sql
SELECT C_CUSTKEY, C_NATIONKEY
FROM customer C
WHERE C_ACCTBAL BETWEEN 1000 AND 1200
AND C_NATIONKEY < 10
OR C_NATIONKEY IN (20, 30)
AND (C_CUSTKEY < 500 OR C_CUSTKEY > 1000)
ORDER BY C_CUSTKEY, C_NATIONKEY
Baseline:
/root/drillAutomation/drill-test-framework/framework/resources/Advanced/tpch/tpch_sf1/smoke/parquet/filter01.e_tsv
Expected number of rows: 6975
Actual number of rows from Drill: 0
Number of matching rows: 0
Number of rows missing: 6975
Number of rows unexpected: 0
These rows are missing (first 10):
114665 20 (1 occurence(s))
65517 20 (1 occurence(s))
49136 20 (1 occurence(s))
131069 5 (1 occurence(s))
32754 20 (1 occurence(s))
65528 20 (1 occurence(s))
32765 20 (1 occurence(s))
16383 20 (1 occurence(s))
49152 20 (1 occurence(s))
147457 20 (1 occurence(s))
Query:
/root/drillAutomation/drill-test-framework/framework/resources/Advanced/tpch/tpch_sf1/smoke/parquet/join01-hash.sql
SELECT P.P_PARTKEY
FROM part P, partsupp PS
WHERE P.P_PARTKEY = PS.PS_PARTKEY
AND P.P_SIZE = 41
ORDER BY P.P_PARTKEY
LIMIT 20
Baseline:
/root/drillAutomation/drill-test-framework/framework/resources/Advanced/tpch/tpch_sf1/smoke/parquet/join01-hash.e_tsv
Expected number of rows: 20
Actual number of rows from Drill: 0
Number of matching rows: 0
Number of rows missing: 20
Number of rows unexpected: 0
These rows are missing (first 10):
114 (4 occurence(s))
87 (4 occurence(s))
8 (4 occurence(s))
251 (4 occurence(s))
108 (4 occurence(s))
Query:
/root/drillAutomation/drill-test-framework/framework/resources/Advanced/tpch/tpch_sf1/smoke/parquet/join09-merge.sql
SELECT COUNT(*)
FROM (SELECT L.L_ORDERKEY AS X, C.C_CUSTKEY AS Y
FROM lineitem L
LEFT OUTER JOIN customer C
ON L.L_ORDERKEY = C.C_CUSTKEY) AS FOO
WHERE Y < 10000
Baseline:
/root/drillAutomation/drill-test-framework/framework/resources/Advanced/tpch/tpch_sf1/smoke/parquet/join09-merge.e_tsv
Expected number of rows: 1
Actual number of rows from Drill: 1
Number of matching rows: 0
Number of rows missing: 1
Number of rows unexpected: 1
These rows are not expected (first 10):
0
These rows are missing (first 10):
9965 (1 occurence(s))
Query:
/root/drillAutomation/drill-test-framework/framework/resources/Advanced/tpch/tpch_sf1/smoke/parquet/failed04.sql
SELECT PS.PS_PARTKEY, COUNT(*) FROM lineitem L, partsupp PS
WHERE L.L_PARTKEY = PS.PS_PARTKEY AND PS.PS_PARTKEY = 30 GROUP BY
PS.PS_PARTKEY
Baseline:
/root/drillAutomation/drill-test-framework/framework/resources/Advanced/tpch/tpch_sf1/smoke/parquet/failed04.e_tsv
Expected number of rows: 1
Actual number of rows from Drill: 0
Number of matching rows: 0
Number of rows missing: 1
Number of rows unexpected: 0
These rows are missing (first 10):
30 124 (1 occurence(s))
Query:
/root/drillAutomation/drill-test-framework/framework/resources/Advanced/tpch/tpch_sf1/smoke/parquet/union03.sql
SELECT C_CUSTKEY, C_NATIONKEY FROM customer C WHERE C_ACCTBAL BETWEEN 1000
AND 1200 AND C_NATIONKEY IN (2, 5)
Baseline:
/root/drillAutomation/drill-test-framework/framework/resources/Advanced/tpch/tpch_sf1/smoke/parquet/union03.e_tsv
Expected number of rows: 208
Actual number of rows from Drill: 0
Number of matching rows: 0
Number of rows missing: 208
Number of rows unexpected: 0
These rows are missing (first 10):
100857 5 (1 occurence(s))
40446 2 (1 occurence(s))
106495 2 (1 occurence(s))
131069 5 (1 occurence(s))
58368 5 (1 occurence(s))
8207 2 (1 occurence(s))
138765 5 (1 occurence(s))
140301 5 (1 occurence(s))
139283 5 (1 occurence(s))
55830 2 (1 occurence(s))
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
> Disable "fast schema" batch for new scan framework
> --------------------------------------------------
>
> Key: DRILL-7306
> URL: https://issues.apache.org/jira/browse/DRILL-7306
> Project: Apache Drill
> Issue Type: Bug
> Affects Versions: 1.16.0
> Reporter: Paul Rogers
> Assignee: Paul Rogers
> Priority: Major
> Labels: ready-to-commit
> Fix For: 1.17.0
>
>
> The EVF framework is set up to return a "fast schema" empty batch with only
> schema as its first batch because, when the code was written, it seemed
> that's how we wanted operators to work. However, DRILL-7305 notes that many
> operators cannot handle empty batches.
> Since the empty-batch bugs show that Drill does not, in fact, provide a "fast
> schema" batch, this ticket asks to disable the feature in the new scan
> framework. The feature is disabled with a config option; it can be re-enabled
> if ever it is needed.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
