[
https://issues.apache.org/jira/browse/IMPALA-8121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16826486#comment-16826486
]
Tim Armstrong commented on IMPALA-8121:
---------------------------------------
Here's the full list of failed tests:
{noformat}
metadata.test_compute_stats.TestComputeStats.test_compute_stats[protocol:
beeswax | exec_option: {'batch_size': 0, 'num_nodes': 0,
'disable_codegen_rows_threshold': 5000, 'disable_codegen': False,
'abort_on_error': 1, 'exec_single_node_rows_threshold': 0} | table_format:
text/none]
metadata.test_compute_stats.TestComputeStats.test_pull_stats_profile[protocol:
beeswax | exec_option: {'batch_size': 0, 'num_nodes': 0,
'disable_codegen_rows_threshold': 5000, 'disable_codegen': False,
'abort_on_error': 1, 'exec_single_node_rows_threshold': 0} | table_format:
text/none]
metadata.test_ddl.TestDdlStatements.test_alter_set_column_stats[protocol:
beeswax | exec_option: {'sync_ddl': 0, 'batch_size': 0, 'num_nodes': 0,
'disable_codegen_rows_threshold': 0, 'disable_codegen': False,
'abort_on_error': 1, 'exec_single_node_rows_threshold': 0} | table_format:
text/none-unique_database0]
metadata.test_ddl.TestDdlStatements.test_alter_table[protocol: beeswax |
exec_option: {'sync_ddl': 0, 'batch_size': 0, 'num_nodes': 0,
'disable_codegen_rows_threshold': 0, 'disable_codegen': False,
'abort_on_error': 1, 'exec_single_node_rows_threshold': 0} | table_format:
text/none-unique_database0]
metadata.test_hdfs_permissions.TestHdfsPermissions.test_insert_into_read_only_table[protocol:
beeswax | exec_option: {'batch_size': 0, 'num_nodes': 0,
'disable_codegen_rows_threshold': 5000, 'disable_codegen': False,
'abort_on_error': 1, 'exec_single_node_rows_threshold': 0} | table_format:
text/none]
metadata.test_ddl.TestDdlStatements.test_partition_ddl_predicates[protocol:
beeswax | exec_option: {'sync_ddl': 0, 'batch_size': 0, 'num_nodes': 0,
'disable_codegen_rows_threshold': 0, 'disable_codegen': False,
'abort_on_error': 1, 'exec_single_node_rows_threshold': 0} | table_format:
text/none-unique_database0]
query_test.test_avro_schema_resolution.TestAvroSchemaResolution.test_avro_schema_changes[protocol:
beeswax | exec_option: {'batch_size': 0, 'num_nodes': 0,
'disable_codegen_rows_threshold': 0, 'disable_codegen': False,
'abort_on_error': 1, 'exec_single_node_rows_threshold': 0} | table_format:
avro/snap/block]
query_test.test_kudu.TestImpalaKuduIntegration.test_delete_external_kudu_table
query_test.test_kudu.TestImpalaKuduIntegration.test_delete_managed_kudu_table
query_test.test_insert_behaviour.TestInsertBehaviour.test_insert_file_permissions
query_test.test_insert_behaviour.TestInsertBehaviour.test_mixed_partition_permissions
query_test.test_insert_behaviour.TestInsertBehaviour.test_readonly_table_dir
query_test.test_insert_behaviour.TestInsertBehaviour.test_load_permissions
query_test.test_queries.TestQueriesTextTables.test_data_source_tables[protocol:
beeswax | exec_option: {'batch_size': 0, 'num_nodes': 0,
'disable_codegen_rows_threshold': 0, 'disable_codegen': False,
'abort_on_error': 1, 'exec_single_node_rows_threshold': 0} | table_format:
text/none]
query_test.test_kudu.TestKuduOperations.test_kudu_col_changed
query_test.test_kudu.TestKuduOperations.test_kudu_col_not_null_changed
query_test.test_kudu.TestKuduOperations.test_kudu_col_null_changed
query_test.test_kudu.TestKuduOperations.test_kudu_col_added
query_test.test_scanners.TestTextScanRangeLengths.test_text_scanner_with_header[protocol:
beeswax | exec_option: {'batch_size': 0, 'num_nodes': 0,
'disable_codegen_rows_threshold': 0, 'disable_codegen': False,
'abort_on_error': 1, 'exec_single_node_rows_threshold': 0} | table_format:
text/none]
query_test.test_udfs.TestUdfTargeted.test_udf_update_via_drop[protocol:
beeswax | exec_option: {'batch_size': 0, 'num_nodes': 0,
'disable_codegen_rows_threshold': 0, 'disable_codegen': False,
'abort_on_error': 1, 'exec_single_node_rows_threshold': 0} | table_format:
text/none]
query_test.test_udfs.TestUdfTargeted.test_udf_update_via_create[protocol:
beeswax | exec_option: {'batch_size': 0, 'num_nodes': 0,
'disable_codegen_rows_threshold': 0, 'disable_codegen': False,
'abort_on_error': 1, 'exec_single_node_rows_threshold': 0} | table_format:
text/none]
webserver.test_web_pages.TestWebPage.test_catalog
catalog_service.test_hms_failure.TestHiveMetaStoreFailure.test_hms_service_dies[protocol:
beeswax | exec_option: {'batch_size': 0, 'num_nodes': 0,
'disable_codegen_rows_threshold': 5000, 'disable_codegen': False,
'abort_on_error': 1, 'exec_single_node_rows_threshold': 0} | table_format:
parquet/none]
metadata.test_ddl.TestLibCache.test_create_drop_data_src[protocol: beeswax
| exec_option: {'batch_size': 0, 'num_nodes': 0,
'disable_codegen_rows_threshold': 5000, 'disable_codegen': False,
'abort_on_error': 1, 'exec_single_node_rows_threshold': 0} | table_format:
text/none]
metadata.test_hms_integration.TestHmsIntegrationSanity.test_sanity[protocol:
beeswax | exec_option: {'batch_size': 0, 'num_nodes': 0,
'disable_codegen_rows_threshold': 5000, 'disable_codegen': False,
'abort_on_error': 1, 'exec_single_node_rows_threshold': 0} | table_format:
text/none]
metadata.test_metadata_query_statements.TestMetadataQueryStatements.test_show_data_sources[protocol:
beeswax | exec_option: {'sync_ddl': 0, 'batch_size': 0, 'num_nodes': 0,
'disable_codegen_rows_threshold': 0, 'disable_codegen': False,
'abort_on_error': 1, 'exec_single_node_rows_threshold': 0} | table_format:
text/none]
metadata.test_metadata_query_statements.TestMetadataQueryStatements.test_describe_db[protocol:
beeswax | exec_option: {'sync_ddl': 0, 'batch_size': 0, 'num_nodes': 0,
'disable_codegen_rows_threshold': 0, 'disable_codegen': False,
'abort_on_error': 1, 'exec_single_node_rows_threshold': 0} | table_format:
text/none]
query_test.test_hdfs_caching.TestHdfsCachingDdl.test_caching_ddl[protocol:
beeswax | exec_option: {'batch_size': 0, 'num_nodes': 0,
'disable_codegen_rows_threshold': 5000, 'disable_codegen': False,
'abort_on_error': 1, 'exec_single_node_rows_threshold': 0} | table_format:
text/none]
query_test.test_hdfs_caching.TestHdfsCachingDdl.test_caching_ddl_drop_database[protocol:
beeswax | exec_option: {'batch_size': 0, 'num_nodes': 0,
'disable_codegen_rows_threshold': 5000, 'disable_codegen': False,
'abort_on_error': 1, 'exec_single_node_rows_threshold': 0} | table_format:
text/none]
query_test.test_hdfs_caching.TestHdfsCachingDdl.test_cache_reload_validation[protocol:
beeswax | exec_option: {'batch_size': 0, 'num_nodes': 0,
'disable_codegen_rows_threshold': 5000, 'disable_codegen': False,
'abort_on_error': 1, 'exec_single_node_rows_threshold': 0} | table_format:
text/none]
query_test.test_hdfs_caching.TestHdfsCachingDdl.test_external_drop
shell.test_shell_interactive.TestImpalaShellInteractive.test_reconnect
org.apache.impala.service.JdbcTest.testMetaDataGetTables
org.apache.impala.service.JdbcTest.testMetaDataGetColumnComments
{noformat}
> Pick better default flags in containers
> ---------------------------------------
>
> Key: IMPALA-8121
> URL: https://issues.apache.org/jira/browse/IMPALA-8121
> Project: IMPALA
> Issue Type: Sub-task
> Components: Infrastructure
> Reporter: Tim Armstrong
> Assignee: Tim Armstrong
> Priority: Major
> Labels: docker
>
> There are some new features of Impala that are done but disabled by default
> because they are not strictly better than the previous versions. E.g. the
> various metadata improvements. Containerised Impala is likely to be new
> deployments, so it is easier to make potentially disruptive changes to
> defaults now.
> h2. Metadata V2 Flags
> Catalogd:
> --catalog_topic_mode=minimal
> Impalad:
> --use_local_catalog=true
> I think we *may* also want to configure automatic invalidations of tables
> from the catalogd so that changes to the underlying storage cluster are
> eventually reflected in the compute cluster. There's a better solution in the
> pipeline that uses HMS notifications
> (https://issues.apache.org/jira/browse/IMPALA-7970), but in the meantime
> invalidation is time-based.
> Catalogd:
> --invalidate_tables_timeout_s=3600
> Once IMPALA-7970 goes in, we probably also want automatic invalidation by
> default (TBD - how to handle older HMS that doesn't support those APIs).
> Catalogd:
> --hms_event_polling_interval_s=???
> We probably want to enable HDFS preads for remote reads: -use_hdfs_pread
> We may want to have an I/O cache enabled
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
