[
https://issues.apache.org/jira/browse/IMPALA-9684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Tim Armstrong updated IMPALA-9684:
----------------------------------
Component/s: Backend
> Update query option levels
> --------------------------
>
> Key: IMPALA-9684
> URL: https://issues.apache.org/jira/browse/IMPALA-9684
> Project: IMPALA
> Issue Type: Task
> Components: Backend
> Reporter: Tim Armstrong
> Priority: Critical
>
> We've accumulated a lot of options and many of them are labelled as more
> important than they really are.
> * The basic level should only include options that change user-facing
> behaviour. Query tuning, e.g. anything related to runtime filters, should be
> in advanced.
> * "Chicken bits" for stable features should be moved to DEPRECATED. E.g.
> PARQUET_READ_PAGE_INDEX
> * Tuning options that are not commonly used should be moved to deprecated or
> development (depending on whether we might want to remove it, or whether we
> might retain it for new features). E.g. PREFETCH_MODE
> {noformat}
> Query options (defaults shown in []):
> ABORT_ON_ERROR: [0]
> COMPRESSION_CODEC: []
> DEFAULT_FILE_FORMAT: [TEXT]
> DEFAULT_HINTS_INSERT_STATEMENT: []
> DISABLE_CODEGEN: [0]
> DISABLE_HDFS_NUM_ROWS_ESTIMATE: [0]
> DISABLE_ROW_RUNTIME_FILTERING: [0]
> DISABLE_STREAMING_PREAGGREGATIONS: [0]
> DISABLE_UNSAFE_SPILLS: [0]
> EXEC_TIME_LIMIT_S: [0]
> EXPLAIN_LEVEL: [STANDARD]
> IDLE_SESSION_TIMEOUT: [0]
> MAX_ROW_SIZE: [524288]
> MAX_STATEMENT_LENGTH_BYTES: [16777216]
> MEM_LIMIT: [0]
> MT_DOP: []
> NUM_SCANNER_THREADS: [0]
> OPTIMIZE_PARTITION_KEY_SCANS: [0]
> PARQUET_ARRAY_RESOLUTION: [THREE_LEVEL]
> PARQUET_FALLBACK_SCHEMA_RESOLUTION: [POSITION]
> QUERY_TIMEOUT_S: [0]
> REQUEST_POOL: []
> RUNTIME_FILTER_MODE: [GLOBAL]
> RUNTIME_FILTER_WAIT_TIME_MS: [0]
> S3_SKIP_INSERT_STAGING: [1]
> SCRATCH_LIMIT: [-1]
> STATEMENT_EXPRESSION_LIMIT: [250000]
> SYNC_DDL: [0]
> THREAD_RESERVATION_AGGREGATE_LIMIT: [0]
> THREAD_RESERVATION_LIMIT: [3000]
> TIMEZONE: [America/Los_Angeles]
> Advanced Query Options:
> APPX_COUNT_DISTINCT: [0]
> BROADCAST_BYTES_LIMIT: [34359738368]
> BUFFER_POOL_LIMIT: []
> CLIENT_IDENTIFIER: Impala Shell v4.0.0-SNAPSHOT (494418c) built on Mon
> Apr 20 22:53:57 PDT 2020
> COMPUTE_STATS_MIN_SAMPLE_SIZE: [1073741824]
> DEFAULT_JOIN_DISTRIBUTION_MODE: [BROADCAST]
> DEFAULT_SPILLABLE_BUFFER_SIZE: [2097152]
> DEFAULT_TRANSACTIONAL_TYPE: [NONE]
> DISABLE_CODEGEN_ROWS_THRESHOLD: [50000]
> DISABLE_DATA_CACHE: [0]
> DISABLE_HBASE_NUM_ROWS_ESTIMATE: [0]
> ENABLE_CNF_REWRITES: [0]
> ENABLE_EXPR_REWRITES: [1]
> EXEC_SINGLE_NODE_ROWS_THRESHOLD: [100]
> FETCH_ROWS_TIMEOUT_MS: [10000]
> HBASE_CACHE_BLOCKS: [0]
> HBASE_CACHING: [0]
> KUDU_READ_MODE: [DEFAULT]
> KUDU_SNAPSHOT_READ_TIMESTAMP_MICROS: [0]
> MAX_CNF_EXPRS: [0]
> MAX_ERRORS: [100]
> MAX_MEM_ESTIMATE_FOR_ADMISSION: [0]
> MAX_NUM_RUNTIME_FILTERS: [10]
> MIN_SPILLABLE_BUFFER_SIZE: [65536]
> NUM_REMOTE_EXECUTOR_CANDIDATES: [3]
> NUM_ROWS_PRODUCED_LIMIT: [0]
> PARQUET_ANNOTATE_STRINGS_UTF8: [0]
> PARQUET_DICTIONARY_FILTERING: [1]
> PARQUET_FILE_SIZE: [0]
> PARQUET_OBJECT_STORE_SPLIT_SIZE: [268435456]
> PARQUET_PAGE_ROW_COUNT_LIMIT: []
> PARQUET_READ_PAGE_INDEX: [1]
> PARQUET_READ_STATISTICS: [1]
> PARQUET_WRITE_PAGE_INDEX: [1]
> PREAGG_BYTES_LIMIT: [-1]
> PREFETCH_MODE: [HT_BUCKET]
> REPLICA_PREFERENCE: [CACHE_LOCAL]
> RESOURCE_TRACE_RATIO: [0.000000]
> RUNTIME_BLOOM_FILTER_SIZE: [1048576]
> RUNTIME_FILTER_MAX_SIZE: [16777216]
> RUNTIME_FILTER_MIN_SIZE: [1048576]
> SCAN_BYTES_LIMIT: [0]
> SCHEDULE_RANDOM_REPLICA: [0]
> SHUFFLE_DISTINCT_EXPRS: [1]
> SUPPORT_START_OVER: [false]
> TOPN_BYTES_LIMIT: [536870912]
> Shell Options
> WRITE_DELIMITED: False
> VERBOSE: True
> LIVE_SUMMARY: False
> OUTPUT_FILE: None
> DELIMITER: \t
> LIVE_PROGRESS: False
> Variables:
> No variables defined.
> {noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
