[
https://issues.apache.org/jira/browse/IMPALA-8849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16903342#comment-16903342
]
Tim Armstrong commented on IMPALA-8849:
---------------------------------------
{noformat}
[nightly6x-unsecure-1.nightly6x-unsecure.root.hwx.site:21000] default> describe
tpcds.customer;
Query: describe tpcds.customer
+------------------------+-------------+---------+
| name | type | comment |
+------------------------+-------------+---------+
| c_customer_sk | int | |
| c_customer_id | varchar(16) | |
| c_current_cdemo_sk | int | |
| c_current_hdemo_sk | int | |
| c_current_addr_sk | int | |
| c_first_shipto_date_sk | int | |
| c_first_sales_date_sk | int | |
| c_salutation | varchar(10) | |
| c_first_name | varchar(20) | |
| c_last_name | varchar(30) | |
| c_preferred_cust_flag | varchar(1) | |
| c_birth_day | int | |
| c_birth_month | int | |
| c_birth_year | int | |
| c_birth_country | varchar(20) | |
| c_login | varchar(13) | |
| c_email_address | varchar(50) | |
| c_last_review_date_sk | int | |
+------------------------+-------------+---------+
Fetched 18 row(s) in 0.01s
[nightly6x-unsecure-1.nightly6x-unsecure.root.hwx.site:21000] default> explain
select c_customer_id from tpcds.customer;
Query: explain select c_customer_id from tpcds.customer
+------------------------------------------------------------+
| Explain String |
+------------------------------------------------------------+
| Max Per-Host Resource Reservation: Memory=8.00MB Threads=3 |
| Per-Host Resource Estimates: Memory=48MB |
| |
| PLAN-ROOT SINK |
| | |
| 01:EXCHANGE [UNPARTITIONED] |
| | |
| 00:SCAN HDFS [tpcds.customer] |
| HDFS partitions=1/1 files=1 size=12.50MB |
| row-size=-1B cardinality=100.00K |
+------------------------------------------------------------+
Fetched 10 row(s) in 0.02s
[nightly6x-unsecure-1.nightly6x-unsecure.root.hwx.site:21000] default> show
column stats tpcds.customer;
Query: show column stats tpcds.customer
+------------------------+-------------+------------------+--------+----------+-------------------+
| Column | Type | #Distinct Values | #Nulls | Max Size |
Avg Size |
+------------------------+-------------+------------------+--------+----------+-------------------+
| c_customer_sk | INT | 100000 | 0 | 4 |
4 |
| c_customer_id | VARCHAR(16) | 100000 | 0 | 16 |
16 |
| c_current_cdemo_sk | INT | 91558 | 3438 | 4 |
4 |
| c_current_hdemo_sk | INT | 7376 | 3431 | 4 |
4 |
| c_current_addr_sk | INT | 42003 | 0 | 4 |
4 |
| c_first_shipto_date_sk | INT | 3754 | 3443 | 4 |
4 |
| c_first_sales_date_sk | INT | 3734 | 3518 | 4 |
4 |
| c_salutation | VARCHAR(10) | 6 | 3410 | 4 |
3.241400003433228 |
| c_first_name | VARCHAR(20) | 4013 | 3492 | 11 |
5.839499950408936 |
| c_last_name | VARCHAR(30) | 4951 | 3497 | 13 |
6.124800205230713 |
| c_preferred_cust_flag | VARCHAR(1) | 2 | 3426 | 1 |
1 |
| c_birth_day | INT | 31 | 3461 | 4 |
4 |
| c_birth_month | INT | 12 | 3449 | 4 |
4 |
| c_birth_year | INT | 67 | 3453 | 4 |
4 |
| c_birth_country | VARCHAR(20) | 207 | 3439 | 20 |
8.708800315856934 |
| c_login | VARCHAR(13) | 0 | 100000 | 0 |
0 |
| c_email_address | VARCHAR(50) | 100000 | 3521 | 46 |
27.45219993591309 |
| c_last_review_date_sk | INT | 350 | 3484 | 4 |
4 |
+------------------------+-------------+------------------+--------+----------+-------------------+
{noformat}
{noformat}
I0808 21:17:32.400616 125341 SingleNodePlanner.java:149]
ae41fb6634771650:c91d6d4d00000000] desctbl: tuples:
TupleDescriptor{id=0, name=BaseTableRef tpcds.customer, tbl=tpcds.customer,
byte_size=0, is_materialized=true, slots=[SlotDescriptor{id=0,
path=tpcds.customer.c_customer_id, label=c_customer_id, type=VARCHAR(16),
materialized=true, byteSize=0, byteOffset=-1, nullable=true,
nullIndicatorByte=0, nullIndicatorBit=0, slotIdx=0,
stats=ColumnStats{avgSerializedSize_=-1.0, maxSize_=16, numDistinct_=100000,
numNulls_=0}}]}
{noformat}
> IllegalStateException in HashJoinNode because of missing memory estimate
> ------------------------------------------------------------------------
>
> Key: IMPALA-8849
> URL: https://issues.apache.org/jira/browse/IMPALA-8849
> Project: IMPALA
> Issue Type: Bug
> Components: Frontend
> Affects Versions: Impala 3.3.0
> Reporter: Tim Armstrong
> Assignee: Tim Armstrong
> Priority: Blocker
> Attachments: query4.sql
>
>
> [~grahn] reports the below error when running the attached TPC-DS query on
> uncompressed text with stats.
> {noformat}
> I0808 03:27:16.621085 150090 jni-util.cc:288]
> 8945e9f76f33dca0:8bf31c4700000000] java.lang.IllegalStateException: Mem
> estimate must be set
> at com.google.common.base.Preconditions.checkState(Preconditions.java:149)
> at
> org.apache.impala.planner.ResourceProfileBuilder.build(ResourceProfileBuilder.java:73)
> at
> org.apache.impala.planner.HashJoinNode.computeNodeResourceProfile(HashJoinNode.java:252)
> at
> org.apache.impala.planner.PlanFragment.computeResourceProfile(PlanFragment.java:238)
> at org.apache.impala.planner.Planner.computeResourceReqs(Planner.java:416)
> at
> org.apache.impala.service.Frontend.createExecRequest(Frontend.java:1162)
> at
> org.apache.impala.service.Frontend.getPlannedExecRequest(Frontend.java:1477)
> at
> org.apache.impala.service.Frontend.doCreateExecRequest(Frontend.java:1341)
> at org.apache.impala.service.Frontend.getTExecRequest(Frontend.java:1236)
> at
> org.apache.impala.service.Frontend.createExecRequest(Frontend.java:1206)
> at
> org.apache.impala.service.JniFrontend.createExecRequest(JniFrontend.java:154)
> I0808 03:27:16.621861 150090 status.cc:124]
> 8945e9f76f33dca0:8bf31c4700000000] IllegalStateException: Mem estimate must
> be set
> @ 0xb9af99
> @ 0x11f785e
> @ 0x10ab9a3
> @ 0x10d0f54
> @ 0x10e2a2c
> @ 0x1125f8d
> @ 0x1458c54
> @ 0x145810c
> @ 0xb68769
> @ 0xf91ca0
> @ 0xf8791e
> @ 0xf887b1
> @ 0x127cd2f
> @ 0x127d8d9
> @ 0x1ac0709
> @ 0x7f11ea4d7dd4
> @ 0x7f11e6f1e02c
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
