[
https://issues.apache.org/jira/browse/IMPALA-7055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16487993#comment-16487993
]
Tim Armstrong commented on IMPALA-7055:
---------------------------------------
Here are the log lines with the query id. It ran on the coordinator only.
{noformat}
I0519 00:25:19.680714 38345 admission-controller.cc:508] Schedule for
id=4d4d0db68525d9ff:3bea3eee00000000 in pool_name=default-pool
cluster_mem_needed=10.00 MB PoolConfig: max_requests=-1 max_queued=200
max_mem=-1.00 B
I0519 00:25:19.680757 38345 admission-controller.cc:529] Admitted query
id=4d4d0db68525d9ff:3bea3eee00000000
I0519 00:25:19.680784 38345 coordinator.cc:90] Exec()
query_id=4d4d0db68525d9ff:3bea3eee00000000 stmt=insert into __avro_write select
1, "b", 2.2
I0519 00:25:19.681054 38345 coordinator.cc:335] starting execution on 1
backends for query_id=4d4d0db68525d9ff:3bea3eee00000000
I0519 00:25:19.681506 124530 impala-internal-service.cc:44]
ExecQueryFInstances(): query_id=4d4d0db68525d9ff:3bea3eee00000000
I0519 00:25:19.681530 124530 query-exec-mgr.cc:46] StartQueryFInstances()
query_id=4d4d0db68525d9ff:3bea3eee00000000 coord=ip-172-31-9-142:22000
I0519 00:25:19.681543 124530 query-state.cc:178] Buffer pool limit for
4d4d0db68525d9ff:3bea3eee00000000: 10307921510
I0519 00:25:19.681646 124530 initial-reservations.cc:60] Successfully claimed
initial reservations (0) for query 4d4d0db68525d9ff:3bea3eee00000000
I0519 00:25:19.693480 41165 query-state.cc:300] StartFInstances():
query_id=4d4d0db68525d9ff:3bea3eee00000000 #instances=1
I0519 00:25:19.693578 41165 query-state.cc:313] descriptor table for
query=4d4d0db68525d9ff:3bea3eee00000000
I0519 00:25:19.693596 38345 coordinator.cc:348] started execution on 1 backends
for query_id=4d4d0db68525d9ff:3bea3eee00000000
I0519 00:25:19.701475 41169 query-state.cc:395] Executing instance.
instance_id=4d4d0db68525d9ff:3bea3eee00000000 fragment_idx=0
per_fragment_instance_idx=0 coord_state_idx=0 #in-flight=11
I0519 00:25:19.702011 41170 coordinator.cc:585] Coordinator waiting for
backends to finish, 1 remaining. query_id=4d4d0db68525d9ff:3bea3eee00000000
I0519 00:25:19.713778 41165 query-exec-mgr.cc:155] ReleaseQueryState():
query_id=4d4d0db68525d9ff:3bea3eee00000000 refcnt=3
I0519 00:25:19.915730 41170 coordinator.cc:554] Finalizing query:
4d4d0db68525d9ff:3bea3eee00000000
I0519 00:25:19.915823 41170 coordinator.cc:576] Removing staging directory:
hdfs://localhost:20500/test-warehouse/functional.db/__avro_write/_impala_insert_staging/4d4d0db68525d9ff_3bea3eee00000000/
I0519 00:25:19.916484 41170 coordinator.cc:454] ExecState: query
id=4d4d0db68525d9ff:3bea3eee00000000 execution completed
I0519 00:25:19.916503 41170 coordinator.cc:763] Release admission control
resources for query_id=4d4d0db68525d9ff:3bea3eee00000000
I0519 00:25:19.917029 41170 client-request-state.cc:928] No partitions altered,
not updating metastore (query id: 4d4d0db68525d9ff:3bea3eee00000000)
I0519 00:25:19.915721 76770 coordinator.cc:684] Backend completed:
host=ip-172-31-9-142:22000 remaining=0
query_id=4d4d0db68525d9ff:3bea3eee00000000
I0519 00:25:19.917754 76770 coordinator.cc:495] ExecState: query
id=4d4d0db68525d9ff:3bea3eee00000000
finstance=4d4d0db68525d9ff:3bea3eee00000000 on host=ip-172-31-9-142:22000
(RETURNED_RESULTS -> RETURNED_RESULTS) status=Writing to table format AVRO is
not supported. Use query option ALLOW_UNSUPPORTED_FORMATS to override.
I0519 00:25:19.918164 41169 query-state.cc:416] Cancel:
query_id=4d4d0db68525d9ff:3bea3eee00000000
I0519 00:25:19.918174 41169 krpc-data-stream-mgr.cc:324] cancelling all streams
for fragment_instance_id=4d4d0db68525d9ff:3bea3eee00000000
I0519 00:25:19.918341 41169 query-state.cc:403] Instance completed.
instance_id=4d4d0db68525d9ff:3bea3eee00000000 #in-flight=8 status=GENERAL:
Writing to table format AVRO is not supported. Use query option
ALLOW_UNSUPPORTED_FORMATS to override.
I0519 00:25:19.918355 41169 query-state.cc:416] Cancel:
query_id=4d4d0db68525d9ff:3bea3eee00000000
I0519 00:25:19.918377 41169 query-exec-mgr.cc:155] ReleaseQueryState():
query_id=4d4d0db68525d9ff:3bea3eee00000000 refcnt=2
I0519 00:25:19.960108 38345 impala-beeswax-server.cc:355] CloseInsert():
query_id=4d4d0db68525d9ff:3bea3eee00000000
I0519 00:25:19.960124 38345 impala-server.cc:1010] UnregisterQuery():
query_id=4d4d0db68525d9ff:3bea3eee00000000
I0519 00:25:19.960130 38345 impala-server.cc:1097] Cancel():
query_id=4d4d0db68525d9ff:3bea3eee00000000
I0519 00:25:19.962421 38345 query-exec-mgr.cc:155] ReleaseQueryState():
query_id=4d4d0db68525d9ff:3bea3eee00000000 refcnt=1
{noformat}
> test_avro_writer failing on upstream Jenkins (Expected exception: "Writing to
> table format AVRO is not supported")
> ------------------------------------------------------------------------------------------------------------------
>
> Key: IMPALA-7055
> URL: https://issues.apache.org/jira/browse/IMPALA-7055
> Project: IMPALA
> Issue Type: Bug
> Components: Backend
> Affects Versions: Impala 3.0
> Reporter: David Knupp
> Assignee: Tim Armstrong
> Priority: Major
> Labels: flaky
>
> This failure occurred while verifying https://gerrit.cloudera.org/c/10455/,
> but it is not related to that patch. The failing build is
> https://jenkins.impala.io/job/gerrit-verify-dryrun/2511/
> (https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/2232/)
> Test appears to be (from
> [avro-writer.test|https://github.com/apache/impala/blob/master/testdata/workloads/functional-query/queries/QueryTest/avro-writer.test]):
> {noformat}
> ---- QUERY
> SET ALLOW_UNSUPPORTED_FORMATS=0;
> insert into __avro_write select 1, "b", 2.2;
> ---- CATCH
> Writing to table format AVRO is not supported. Use query option
> ALLOW_UNSUPPORTED_FORMATS
> {noformat}
> Error output:
> {noformat}
> 01:50:18 ] FAIL
> query_test/test_compressed_formats.py::TestTableWriters::()::test_avro_writer[exec_option:
> {'batch_size': 0, 'num_nodes': 0, 'disable_codegen_rows_threshold': 5000,
> 'disable_codegen': False, 'abort_on_error': 1, 'debug_action': None,
> 'exec_single_node_rows_threshold': 0} | table_format: text/none]
> 01:50:18 ] =================================== FAILURES
> ===================================
> 01:50:18 ] TestTableWriters.test_avro_writer[exec_option: {'batch_size': 0,
> 'num_nodes': 0, 'disable_codegen_rows_threshold': 5000, 'disable_codegen':
> False, 'abort_on_error': 1, 'debug_action': None,
> 'exec_single_node_rows_threshold': 0} | table_format: text/none]
> 01:50:18 ] [gw9] linux2 -- Python 2.7.12
> /home/ubuntu/Impala/bin/../infra/python/env/bin/python
> 01:50:18 ] query_test/test_compressed_formats.py:189: in test_avro_writer
> 01:50:18 ] self.run_test_case('QueryTest/avro-writer', vector)
> 01:50:18 ] common/impala_test_suite.py:420: in run_test_case
> 01:50:18 ] assert False, "Expected exception: %s" % expected_str
> 01:50:18 ] E AssertionError: Expected exception: Writing to table format
> AVRO is not supported. Use query option ALLOW_UNSUPPORTED_FORMATS
> 01:50:18 ] ---------------------------- Captured stderr setup
> -----------------------------
> 01:50:18 ] -- connecting to: localhost:21000
> 01:50:18 ] ----------------------------- Captured stderr call
> -----------------------------
> 01:50:18 ] -- executing against localhost:21000
> 01:50:18 ] use functional;
> 01:50:18 ]
> 01:50:18 ] SET batch_size=0;
> 01:50:18 ] SET num_nodes=0;
> 01:50:18 ] SET disable_codegen_rows_threshold=5000;
> 01:50:18 ] SET disable_codegen=False;
> 01:50:18 ] SET abort_on_error=1;
> 01:50:18 ] SET exec_single_node_rows_threshold=0;
> 01:50:18 ] -- executing against localhost:21000
> 01:50:18 ] drop table if exists __avro_write;
> 01:50:18 ]
> 01:50:18 ] -- executing against localhost:21000
> 01:50:18 ] SET COMPRESSION_CODEC=NONE;
> 01:50:18 ]
> 01:50:18 ] -- executing against localhost:21000
> 01:50:18 ]
> 01:50:18 ] create table __avro_write (i int, s string, d double)
> 01:50:18 ] stored as AVRO
> 01:50:18 ] TBLPROPERTIES ('avro.schema.literal'='{
> 01:50:18 ] "name": "my_record",
> 01:50:18 ] "type": "record",
> 01:50:18 ] "fields": [
> 01:50:18 ] {"name":"i", "type":["int", "null"]},
> 01:50:18 ] {"name":"s", "type":["string", "null"]},
> 01:50:18 ] {"name":"d", "type":["double", "null"]}]}');
> 01:50:18 ]
> 01:50:18 ] -- executing against localhost:21000
> 01:50:18 ] SET COMPRESSION_CODEC="";
> 01:50:18 ]
> 01:50:18 ] -- executing against localhost:21000
> 01:50:18 ] SET COMPRESSION_CODEC=NONE;
> 01:50:18 ]
> 01:50:18 ] -- executing against localhost:21000
> 01:50:18 ]
> 01:50:18 ] SET ALLOW_UNSUPPORTED_FORMATS=1;
> 01:50:18 ]
> 01:50:18 ] -- executing against localhost:21000
> 01:50:18 ]
> 01:50:18 ] insert into __avro_write select 0, "a", 1.1;
> 01:50:18 ]
> 01:50:18 ] -- executing against localhost:21000
> 01:50:18 ] SET COMPRESSION_CODEC="";
> 01:50:18 ]
> 01:50:18 ] -- executing against localhost:21000
> 01:50:18 ] SET ALLOW_UNSUPPORTED_FORMATS="0";
> 01:50:18 ]
> 01:50:18 ] -- executing against localhost:21000
> 01:50:18 ] SET COMPRESSION_CODEC=SNAPPY;
> 01:50:18 ]
> 01:50:18 ] -- executing against localhost:21000
> 01:50:18 ]
> 01:50:18 ] SET ALLOW_UNSUPPORTED_FORMATS=1;
> 01:50:18 ]
> 01:50:18 ] -- executing against localhost:21000
> 01:50:18 ]
> 01:50:18 ] insert into __avro_write select 1, "b", 2.2;
> 01:50:18 ]
> 01:50:18 ] -- executing against localhost:21000
> 01:50:18 ] SET COMPRESSION_CODEC="";
> 01:50:18 ]
> 01:50:18 ] -- executing against localhost:21000
> 01:50:18 ] SET ALLOW_UNSUPPORTED_FORMATS="0";
> 01:50:18 ]
> 01:50:18 ] -- executing against localhost:21000
> 01:50:18 ] select * from __avro_write;
> 01:50:18 ]
> 01:50:18 ] -- executing against localhost:21000
> 01:50:18 ] SET ALLOW_UNSUPPORTED_FORMATS=0;
> 01:50:18 ]
> 01:50:18 ] -- executing against localhost:21000
> 01:50:18 ]
> 01:50:18 ] insert into __avro_write select 1, "b", 2.2;
> 01:50:18 ]
> 01:50:18 ] -- executing against localhost:21000
> 01:50:18 ] SET ALLOW_UNSUPPORTED_FORMATS="0";
> 01:50:18 ]
> 01:50:18 ] = 1 failed, 1939 passed, 80 skipped, 44 xfailed, 1 xpassed in
> 2025.77 seconds =={noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
