[7/8] incubator-impala git commit: Removing testdata/bin/run-hive.sh.

2017-11-28 Thread mikeb
Removing testdata/bin/run-hive.sh. I can't find any uses of it. Change-Id: Ibdb65f8390efec8559cea59da0a48584a383cb24 Reviewed-on: http://gerrit.cloudera.org:8080/8503 Reviewed-by: Michael Brown Tested-by: Impala Public Jenkins Project:

[1/8] incubator-impala git commit: IMPALA-6092: avoid drop/create function interactions in e2e tests

2017-11-28 Thread mikeb
Repository: incubator-impala Updated Branches: refs/heads/master a86cc7a3d -> d3afe3075 IMPALA-6092: avoid drop/create function interactions in e2e tests The e2e unit tests for udfs can interact via the backend lib_cache, causing test flakes. IMPALA-6215 explains a race between the lib_cache

[3/8] incubator-impala git commit: IMPALA-6225: Part 1: Query profile date-time strings should have ns precision.

2017-11-28 Thread mikeb
IMPALA-6225: Part 1: Query profile date-time strings should have ns precision. IMPALA-5599 changed the precision of query start and end time date-time string representations to microseconds. This ended up breaking compatibility with some API clients. This patch restores the precision to

[2/8] incubator-impala git commit: IMPALA-4591: Bound Kudu client error mem usage

2017-11-28 Thread mikeb
IMPALA-4591: Bound Kudu client error mem usage Previously, Kudu client errors could grow in size unbounded, potentially causing the process to be killed. This patch sets a bound on the mem that can be used for these error messages, with the size determined by the flag 'kudu_error_buffer_size'.

[8/8] incubator-impala git commit: IMPALA-6001: Part 1: Increase log level during catalog update processing

2017-11-28 Thread mikeb
IMPALA-6001: Part 1: Increase log level during catalog update processing This commit changes the default log level in CatalogUpdateCallback() to help diagnosing issues like IMPALA-6001. Change-Id: I24459bd99baf072abeadc03b654b24a0021db97c Reviewed-on: http://gerrit.cloudera.org:8080/8650

[6/8] incubator-impala git commit: IMPALA-6201: Fix test_basic_filters on ASAN

2017-11-28 Thread mikeb
IMPALA-6201: Fix test_basic_filters on ASAN TestRuntimeFilters.test_basic_filters is flaky on ASAN as sometimes the runtime filters aren't recieved within the specified RUNTIME_FILTER_WAIT_TIME_MS. This patch increases the timeout for ASAN builds. Change-Id:

[5/8] incubator-impala git commit: Revert "IMPALA-6068: Fix dataload for complextypes_fileformat"

2017-11-28 Thread mikeb
Revert "IMPALA-6068: Fix dataload for complextypes_fileformat" This reverts commit e4f585240ac8f478e25402806f4ea38531b4bf84. Among other things, that commit replaced hdfs command line calls with "LOAD DATA LOCAL INPATH" using Hive. However, doing so presumes that the minicluster is the only test

[4/8] incubator-impala git commit: IMPALA-2181: Add query option levels for display

2017-11-28 Thread mikeb
IMPALA-2181: Add query option levels for display Four display levels are introduced for each query option: REGULAR, ADVANCED, DEVELOPMENT and DEPRECATED. When the query options are displayed in Impala shell using SET then only the REGULAR and ADVANCED options are shown. A new command called SET

[1/6] impala git commit: IMPALA-5948: Change Kudu RPC port to 27000

2017-12-18 Thread mikeb
Repository: impala Updated Branches: refs/heads/master bfbcd1fe8 -> 8047b1dcb IMPALA-5948: Change Kudu RPC port to 27000 The current default for krpc_port is 29000, which conflicts with Sentry's WebUI. This changes the default to 27000, which is currently free. Core tests pass with this

[4/6] impala git commit: IMPALA-3887: Wait for HDFS replication in data loading

2017-12-18 Thread mikeb
IMPALA-3887: Wait for HDFS replication in data loading When the data loading finishes, it is possible for some HDFS blocks to be under replicated. If impala gets the metadata before the replication is done, some tests may fail. This patch adds a replication waiting step in the data loading

[2/4] impala git commit: IMPALA-4506: Do not display some intro message if --quiet is set

2017-12-01 Thread mikeb
IMPALA-4506: Do not display some intro message if --quiet is set Change-Id: I19c6d00dfbbe805ee9c525b72eb5703840e2f582 Reviewed-on: http://gerrit.cloudera.org:8080/8613 Reviewed-by: Jim Apple Tested-by: Impala Public Jenkins Project:

[4/4] impala git commit: IMPALA-6255: Add device names to DiskIoMgr thread names

2017-12-01 Thread mikeb
IMPALA-6255: Add device names to DiskIoMgr thread names This change adds device names to the DiskIoMgr thread names. It will make them easier to identify during debugging. Change-Id: I30faeda6db8846e4aad64ce29ca811366d84910b Reviewed-on: http://gerrit.cloudera.org:8080/8669 Reviewed-by: Lars

[3/4] impala git commit: IMPALA-5940: Avoid stack tracing and log spew with Status::Expected()

2017-12-01 Thread mikeb
IMPALA-5940: Avoid stack tracing and log spew with Status::Expected() This change converts some callers of Status() to Status::Expected() in the DataStreamMgr to avoid log spew and unnecessary overhead of stack tracing. Change-Id: Ie1f7d16e60f7859d662e87642d0f82e1d74183ad Reviewed-on:

impala git commit: IMPALA-6272: Update external Hadoop ecosystem versions

2017-12-06 Thread mikeb
Repository: impala Updated Branches: refs/heads/master 9303b0aed -> ae6ecf51e IMPALA-6272: Update external Hadoop ecosystem versions Updates from 5.14.0-SNAPSHOT to 5.15.0-SNAPSHOT. I did this like so: $perl -pi -e 's/5.14.0-SNAP/5.15.0-SNAP/' $(git grep -l 5.14.0-SNAP) Change-Id:

impala git commit: IMPALA-6070: Further improvements to test-with-docker.

2018-04-27 Thread mikeb
Repository: impala Updated Branches: refs/heads/master 25422c74b -> 2e6a63e31 IMPALA-6070: Further improvements to test-with-docker. This commit tackles a few additions and improvements to test-with-docker. In general, I'm adding workloads (e.g., exhaustive, rat-check), tuning memory setting

impala git commit: IMPALA-6314: Add run time scalar subquery check for uncorrelated subqueries

2018-04-27 Thread mikeb
Repository: impala Updated Branches: refs/heads/master 2e6a63e31 -> 1e79f1479 IMPALA-6314: Add run time scalar subquery check for uncorrelated subqueries If a scalar subquery is used with a binary predicate, or, used in an arithmetic expression, it must return only one row/column to be valid.

impala git commit: IMPALA-6892: CheckHashAndDecrypt() includes file and host

2018-04-27 Thread mikeb
Repository: impala Updated Branches: refs/heads/2.x a84053ddf -> 2c893f46b IMPALA-6892: CheckHashAndDecrypt() includes file and host The error text with AES-GCM enabled looks like: Error reading 44 bytes from scratch file '/tmp/impala-scratch/0:0_d43635d0-8f55-485e-8899-907af289ac86' on

[24/51] [partial] impala git commit: [DOCS] Impala doc site update for 3.0

2018-05-09 Thread mikeb
http://git-wip-us.apache.org/repos/asf/impala/blob/fae51ec2/docs/build3x/html/topics/impala_langref_unsupported.html -- diff --git a/docs/build3x/html/topics/impala_langref_unsupported.html

[35/51] [partial] impala git commit: [DOCS] Impala doc site update for 3.0

2018-05-09 Thread mikeb
http://git-wip-us.apache.org/repos/asf/impala/blob/fae51ec2/docs/build3x/html/topics/impala_describe.html -- diff --git a/docs/build3x/html/topics/impala_describe.html b/docs/build3x/html/topics/impala_describe.html new file mode

[39/51] [partial] impala git commit: [DOCS] Impala doc site update for 3.0

2018-05-09 Thread mikeb
http://git-wip-us.apache.org/repos/asf/impala/blob/fae51ec2/docs/build3x/html/topics/impala_create_table.html -- diff --git a/docs/build3x/html/topics/impala_create_table.html b/docs/build3x/html/topics/impala_create_table.html

[48/51] [partial] impala git commit: [DOCS] Impala doc site update for 3.0

2018-05-09 Thread mikeb
http://git-wip-us.apache.org/repos/asf/impala/blob/fae51ec2/docs/build3x/html/topics/impala_analytic_functions.html -- diff --git a/docs/build3x/html/topics/impala_analytic_functions.html

[41/51] [partial] impala git commit: [DOCS] Impala doc site update for 3.0

2018-05-09 Thread mikeb
http://git-wip-us.apache.org/repos/asf/impala/blob/fae51ec2/docs/build3x/html/topics/impala_conditional_functions.html -- diff --git a/docs/build3x/html/topics/impala_conditional_functions.html

[11/51] [partial] impala git commit: [DOCS] Impala doc site update for 3.0

2018-05-09 Thread mikeb
http://git-wip-us.apache.org/repos/asf/impala/blob/fae51ec2/docs/build3x/html/topics/impala_proxy.html -- diff --git a/docs/build3x/html/topics/impala_proxy.html b/docs/build3x/html/topics/impala_proxy.html new file mode 100644

[20/51] [partial] impala git commit: [DOCS] Impala doc site update for 3.0

2018-05-09 Thread mikeb
http://git-wip-us.apache.org/repos/asf/impala/blob/fae51ec2/docs/build3x/html/topics/impala_new_features.html -- diff --git a/docs/build3x/html/topics/impala_new_features.html b/docs/build3x/html/topics/impala_new_features.html

[44/51] [partial] impala git commit: [DOCS] Impala doc site update for 3.0

2018-05-09 Thread mikeb
http://git-wip-us.apache.org/repos/asf/impala/blob/fae51ec2/docs/build3x/html/topics/impala_breakpad.html -- diff --git a/docs/build3x/html/topics/impala_breakpad.html b/docs/build3x/html/topics/impala_breakpad.html new file mode

[12/51] [partial] impala git commit: [DOCS] Impala doc site update for 3.0

2018-05-09 Thread mikeb
http://git-wip-us.apache.org/repos/asf/impala/blob/fae51ec2/docs/build3x/html/topics/impala_planning.html -- diff --git a/docs/build3x/html/topics/impala_planning.html b/docs/build3x/html/topics/impala_planning.html new file mode

[30/51] [partial] impala git commit: [DOCS] Impala doc site update for 3.0

2018-05-09 Thread mikeb
http://git-wip-us.apache.org/repos/asf/impala/blob/fae51ec2/docs/build3x/html/topics/impala_hbase.html -- diff --git a/docs/build3x/html/topics/impala_hbase.html b/docs/build3x/html/topics/impala_hbase.html new file mode 100644

[43/51] [partial] impala git commit: [DOCS] Impala doc site update for 3.0

2018-05-09 Thread mikeb
http://git-wip-us.apache.org/repos/asf/impala/blob/fae51ec2/docs/build3x/html/topics/impala_complex_types.html -- diff --git a/docs/build3x/html/topics/impala_complex_types.html

[38/51] [partial] impala git commit: [DOCS] Impala doc site update for 3.0

2018-05-09 Thread mikeb
http://git-wip-us.apache.org/repos/asf/impala/blob/fae51ec2/docs/build3x/html/topics/impala_datatypes.html -- diff --git a/docs/build3x/html/topics/impala_datatypes.html b/docs/build3x/html/topics/impala_datatypes.html new file

[14/51] [partial] impala git commit: [DOCS] Impala doc site update for 3.0

2018-05-09 Thread mikeb
http://git-wip-us.apache.org/repos/asf/impala/blob/fae51ec2/docs/build3x/html/topics/impala_perf_hdfs_caching.html -- diff --git a/docs/build3x/html/topics/impala_perf_hdfs_caching.html

[34/51] [partial] impala git commit: [DOCS] Impala doc site update for 3.0

2018-05-09 Thread mikeb
http://git-wip-us.apache.org/repos/asf/impala/blob/fae51ec2/docs/build3x/html/topics/impala_distinct.html -- diff --git a/docs/build3x/html/topics/impala_distinct.html b/docs/build3x/html/topics/impala_distinct.html new file mode

[49/51] [partial] impala git commit: [DOCS] Impala doc site update for 3.0

2018-05-09 Thread mikeb
http://git-wip-us.apache.org/repos/asf/impala/blob/fae51ec2/docs/build3x/html/topics/impala_aggregate_functions.html -- diff --git a/docs/build3x/html/topics/impala_aggregate_functions.html

[50/51] [partial] impala git commit: [DOCS] Impala doc site update for 3.0

2018-05-09 Thread mikeb
http://git-wip-us.apache.org/repos/asf/impala/blob/fae51ec2/docs/build3x/html/topics/impala_adls.html -- diff --git a/docs/build3x/html/topics/impala_adls.html b/docs/build3x/html/topics/impala_adls.html new file mode 100644

[47/51] [partial] impala git commit: [DOCS] Impala doc site update for 3.0

2018-05-09 Thread mikeb
http://git-wip-us.apache.org/repos/asf/impala/blob/fae51ec2/docs/build3x/html/topics/impala_appx_median.html -- diff --git a/docs/build3x/html/topics/impala_appx_median.html b/docs/build3x/html/topics/impala_appx_median.html new

[05/51] [partial] impala git commit: [DOCS] Impala doc site update for 3.0

2018-05-09 Thread mikeb
http://git-wip-us.apache.org/repos/asf/impala/blob/fae51ec2/docs/build3x/html/topics/impala_security_files.html -- diff --git a/docs/build3x/html/topics/impala_security_files.html

[01/51] [partial] impala git commit: [DOCS] Impala doc site update for 3.0

2018-05-09 Thread mikeb
Repository: impala Updated Branches: refs/heads/asf-site 52b8807de -> fae51ec24 http://git-wip-us.apache.org/repos/asf/impala/blob/fae51ec2/docs/build3x/html/topics/impala_string_functions.html -- diff --git

[04/51] [partial] impala git commit: [DOCS] Impala doc site update for 3.0

2018-05-09 Thread mikeb
http://git-wip-us.apache.org/repos/asf/impala/blob/fae51ec2/docs/build3x/html/topics/impala_shell_options.html -- diff --git a/docs/build3x/html/topics/impala_shell_options.html

[19/51] [partial] impala git commit: [DOCS] Impala doc site update for 3.0

2018-05-09 Thread mikeb
http://git-wip-us.apache.org/repos/asf/impala/blob/fae51ec2/docs/build3x/html/topics/impala_num_nodes.html -- diff --git a/docs/build3x/html/topics/impala_num_nodes.html b/docs/build3x/html/topics/impala_num_nodes.html new file

[27/51] [partial] impala git commit: [DOCS] Impala doc site update for 3.0

2018-05-09 Thread mikeb
http://git-wip-us.apache.org/repos/asf/impala/blob/fae51ec2/docs/build3x/html/topics/impala_invalidate_metadata.html -- diff --git a/docs/build3x/html/topics/impala_invalidate_metadata.html

[46/51] [partial] impala git commit: [DOCS] Impala doc site update for 3.0

2018-05-09 Thread mikeb
http://git-wip-us.apache.org/repos/asf/impala/blob/fae51ec2/docs/build3x/html/topics/impala_authorization.html -- diff --git a/docs/build3x/html/topics/impala_authorization.html

[13/51] [partial] impala git commit: [DOCS] Impala doc site update for 3.0

2018-05-09 Thread mikeb
http://git-wip-us.apache.org/repos/asf/impala/blob/fae51ec2/docs/build3x/html/topics/impala_perf_stats.html -- diff --git a/docs/build3x/html/topics/impala_perf_stats.html b/docs/build3x/html/topics/impala_perf_stats.html new

[36/51] [partial] impala git commit: [DOCS] Impala doc site update for 3.0

2018-05-09 Thread mikeb
http://git-wip-us.apache.org/repos/asf/impala/blob/fae51ec2/docs/build3x/html/topics/impala_ddl.html -- diff --git a/docs/build3x/html/topics/impala_ddl.html b/docs/build3x/html/topics/impala_ddl.html new file mode 100644 index

[31/51] [partial] impala git commit: [DOCS] Impala doc site update for 3.0

2018-05-09 Thread mikeb
http://git-wip-us.apache.org/repos/asf/impala/blob/fae51ec2/docs/build3x/html/topics/impala_float.html -- diff --git a/docs/build3x/html/topics/impala_float.html b/docs/build3x/html/topics/impala_float.html new file mode 100644

[37/51] [partial] impala git commit: [DOCS] Impala doc site update for 3.0

2018-05-09 Thread mikeb
http://git-wip-us.apache.org/repos/asf/impala/blob/fae51ec2/docs/build3x/html/topics/impala_datetime_functions.html -- diff --git a/docs/build3x/html/topics/impala_datetime_functions.html

[03/51] [partial] impala git commit: [DOCS] Impala doc site update for 3.0

2018-05-09 Thread mikeb
http://git-wip-us.apache.org/repos/asf/impala/blob/fae51ec2/docs/build3x/html/topics/impala_show.html -- diff --git a/docs/build3x/html/topics/impala_show.html b/docs/build3x/html/topics/impala_show.html new file mode 100644

[15/51] [partial] impala git commit: [DOCS] Impala doc site update for 3.0

2018-05-09 Thread mikeb
http://git-wip-us.apache.org/repos/asf/impala/blob/fae51ec2/docs/build3x/html/topics/impala_parquet_fallback_schema_resolution.html -- diff --git a/docs/build3x/html/topics/impala_parquet_fallback_schema_resolution.html

[32/51] [partial] impala git commit: [DOCS] Impala doc site update for 3.0

2018-05-09 Thread mikeb
http://git-wip-us.apache.org/repos/asf/impala/blob/fae51ec2/docs/build3x/html/topics/impala_fixed_issues.html -- diff --git a/docs/build3x/html/topics/impala_fixed_issues.html b/docs/build3x/html/topics/impala_fixed_issues.html

[10/51] [partial] impala git commit: [DOCS] Impala doc site update for 3.0

2018-05-09 Thread mikeb
http://git-wip-us.apache.org/repos/asf/impala/blob/fae51ec2/docs/build3x/html/topics/impala_replica_preference.html -- diff --git a/docs/build3x/html/topics/impala_replica_preference.html

[51/51] [partial] impala git commit: [DOCS] Impala doc site update for 3.0

2018-05-09 Thread mikeb
[DOCS] Impala doc site update for 3.0 Add Impala docs from branch master. Commit hash: f20415755401d56103df7f16348cea8ed12fb3d8 Change-Id: Icf5927efa7baa965095a3ff2fd4ec7411313342d Reviewed-on: http://gerrit.cloudera.org:8080/10322 Reviewed-by: Michael Brown Tested-by: Alex

[17/51] [partial] impala git commit: [DOCS] Impala doc site update for 3.0

2018-05-09 Thread mikeb
http://git-wip-us.apache.org/repos/asf/impala/blob/fae51ec2/docs/build3x/html/topics/impala_optimize_partition_key_scans.html -- diff --git a/docs/build3x/html/topics/impala_optimize_partition_key_scans.html

[45/51] [partial] impala git commit: [DOCS] Impala doc site update for 3.0

2018-05-09 Thread mikeb
http://git-wip-us.apache.org/repos/asf/impala/blob/fae51ec2/docs/build3x/html/topics/impala_avro.html -- diff --git a/docs/build3x/html/topics/impala_avro.html b/docs/build3x/html/topics/impala_avro.html new file mode 100644

[2/3] impala git commit: IMPALA-7033/IMPALA-7030: Backout suspected change leading to crash

2018-05-16 Thread mikeb
IMPALA-7033/IMPALA-7030: Backout suspected change leading to crash Revert "IMPALA-5384, part 2: Simplify Coordinator locking and clarify state" This reverts commit 6ca87e46736a1e591ed7d7d5fee05b4b4d2fbb50. Change-Id: Idc63006e6e04130b2873a6a9730e434c563327c5 Reviewed-on:

[1/3] impala git commit: IMPALA-6645: Enable disk spill encryption by default

2018-05-16 Thread mikeb
Repository: impala Updated Branches: refs/heads/2.x 0ce9056a1 -> bee907c5f IMPALA-6645: Enable disk spill encryption by default Perf: Targeted benchmarks with a heavily spilling query on a machine with PCLMULQDQ support show < 5% of CPU time spent in encryption and decryption. PCLMULQDQ was

[3/3] impala git commit: IMPALA-7022: TestQueries.test_subquery: Subquery must not return more than one row

2018-05-16 Thread mikeb
IMPALA-7022: TestQueries.test_subquery: Subquery must not return more than one row TestQueries.test_subquery sometimes fails during exhaustive tests. In the tests we expect to catch an exception that is prefixed by the "Query aborted:" string. The prefix is usually added by

impala git commit: IMPALA-6983: stress: don't write a null runtime profile

2018-05-16 Thread mikeb
Repository: impala Updated Branches: refs/heads/master 75a10a3dd -> fcbbae495 IMPALA-6983: stress: don't write a null runtime profile This patch fixes a problem in which the writing of profiles always assumed profiles would be collected during binary. That's not the case when queries are too

[3/5] impala git commit: [DOCS] SHOW TBLPROPERTIES not supported in impala

2018-06-04 Thread mikeb
[DOCS] SHOW TBLPROPERTIES not supported in impala Change-Id: I4643a6d759e334854b955bae75596ac43aa33b97 Reviewed-on: http://gerrit.cloudera.org:8080/10564 Reviewed-by: Bharath Vissapragada Tested-by: Impala Public Jenkins Project: http://git-wip-us.apache.org/repos/asf/impala/repo Commit:

[5/5] impala git commit: IMPALA-6020: [DOCS] REFRESH statement cannot detect HDFS block movement

2018-06-04 Thread mikeb
IMPALA-6020: [DOCS] REFRESH statement cannot detect HDFS block movement Change-Id: Ib6de1469e0f375511fd415e79074f4ec72cf109b Reviewed-on: http://gerrit.cloudera.org:8080/10470 Reviewed-by: Bharath Vissapragada Tested-by: Impala Public Jenkins Project:

[1/5] impala git commit: IMPALA-7099: xfail test on affected filesystems

2018-06-04 Thread mikeb
Repository: impala Updated Branches: refs/heads/2.x 64820211a -> c2186c752 IMPALA-7099: xfail test on affected filesystems As a stopgap, let's xfail the test on filesystems where this is known to be broken. Testing: Tested that the test succeeded and xfailed without and with an fs prefix,

[2/5] impala git commit: IMPALA-7104: test_bloom_wait_time failing with timeout on asan

2018-06-04 Thread mikeb
IMPALA-7104: test_bloom_wait_time failing with timeout on asan test_bloom_wait_time checks that its query runs in less than a certain amount of time, to ensure we aren't waiting on bloom filters that will never arrive. The test sometimes goes slightly over the timeout and fails on ASAN. This

[3/3] impala git commit: IMPALA-6020: [DOCS] REFRESH statement cannot detect HDFS block movement

2018-06-04 Thread mikeb
IMPALA-6020: [DOCS] REFRESH statement cannot detect HDFS block movement Change-Id: Ib6de1469e0f375511fd415e79074f4ec72cf109b Reviewed-on: http://gerrit.cloudera.org:8080/10470 Reviewed-by: Bharath Vissapragada Tested-by: Impala Public Jenkins Project:

[4/5] impala git commit: [DOCS] Not able to create new tables when the statestore is offline

2018-06-04 Thread mikeb
[DOCS] Not able to create new tables when the statestore is offline Change-Id: I41216fcf60f94f596dae0109a5730ce792b28244 Reviewed-on: http://gerrit.cloudera.org:8080/10481 Reviewed-by: Vuk Ercegovac Tested-by: Impala Public Jenkins Project: http://git-wip-us.apache.org/repos/asf/impala/repo

[1/3] impala git commit: [DOCS] SHOW TBLPROPERTIES not supported in impala

2018-06-04 Thread mikeb
Repository: impala Updated Branches: refs/heads/master 7a41f5874 -> 4fda68a59 [DOCS] SHOW TBLPROPERTIES not supported in impala Change-Id: I4643a6d759e334854b955bae75596ac43aa33b97 Reviewed-on: http://gerrit.cloudera.org:8080/10564 Reviewed-by: Bharath Vissapragada Tested-by: Impala Public

[2/3] impala git commit: [DOCS] Not able to create new tables when the statestore is offline

2018-06-04 Thread mikeb
[DOCS] Not able to create new tables when the statestore is offline Change-Id: I41216fcf60f94f596dae0109a5730ce792b28244 Reviewed-on: http://gerrit.cloudera.org:8080/10481 Reviewed-by: Vuk Ercegovac Tested-by: Impala Public Jenkins Project: http://git-wip-us.apache.org/repos/asf/impala/repo

impala git commit: IMPALA-7150: fixes jni frame scope

2018-06-20 Thread mikeb
Repository: impala Updated Branches: refs/heads/master 11aaa6caa -> 2b1970abe IMPALA-7150: fixes jni frame scope A previous change (https://gerrit.cloudera.org/#/c/9968/) reduced the time that a lib-cache entry was held when initializing a udf. It did so by introducing a new scope. However,

impala git commit: Adding issues-all mailing list.

2018-05-01 Thread mikeb
Repository: impala Updated Branches: refs/heads/asf-site 27e1a39dd -> 47532c3e8 Adding issues-all mailing list. Thanks to INFRA-16440, we now have a mailing list with all Apache JIRA notifications, not just creations and removals. Adding it to the website. Change-Id:

[10/15] impala git commit: [DOCS] Add Impala docs from branch 2.x

2018-05-01 Thread mikeb
http://git-wip-us.apache.org/repos/asf/impala/blob/592fd85d/docs/build/html/topics/impala_float.html -- diff --git a/docs/build/html/topics/impala_float.html b/docs/build/html/topics/impala_float.html index 1981a33..f4a6293

[13/15] impala git commit: [DOCS] Add Impala docs from branch 2.x

2018-05-01 Thread mikeb
http://git-wip-us.apache.org/repos/asf/impala/blob/592fd85d/docs/build/html/topics/impala_compute_stats_min_sample_size.html -- diff --git a/docs/build/html/topics/impala_compute_stats_min_sample_size.html

[02/15] impala git commit: [DOCS] Add Impala docs from branch 2.x

2018-05-01 Thread mikeb
http://git-wip-us.apache.org/repos/asf/impala/blob/592fd85d/docs/build/html/topics/impala_smallint.html -- diff --git a/docs/build/html/topics/impala_smallint.html b/docs/build/html/topics/impala_smallint.html index

[01/15] impala git commit: [DOCS] Add Impala docs from branch 2.x

2018-05-01 Thread mikeb
Repository: impala Updated Branches: refs/heads/asf-site 47532c3e8 -> 592fd85d7 http://git-wip-us.apache.org/repos/asf/impala/blob/592fd85d/docs/build/html/topics/impala_tutorial.html -- diff --git

[08/15] impala git commit: [DOCS] Add Impala docs from branch 2.x

2018-05-01 Thread mikeb
http://git-wip-us.apache.org/repos/asf/impala/blob/592fd85d/docs/build/html/topics/impala_known_issues.html -- diff --git a/docs/build/html/topics/impala_known_issues.html b/docs/build/html/topics/impala_known_issues.html index

[06/15] impala git commit: [DOCS] Add Impala docs from branch 2.x

2018-05-01 Thread mikeb
http://git-wip-us.apache.org/repos/asf/impala/blob/592fd85d/docs/build/html/topics/impala_new_features.html -- diff --git a/docs/build/html/topics/impala_new_features.html b/docs/build/html/topics/impala_new_features.html index

[14/15] impala git commit: [DOCS] Add Impala docs from branch 2.x

2018-05-01 Thread mikeb
http://git-wip-us.apache.org/repos/asf/impala/blob/592fd85d/docs/build/html/topics/impala_analytic_functions.html -- diff --git a/docs/build/html/topics/impala_analytic_functions.html

[05/15] impala git commit: [DOCS] Add Impala docs from branch 2.x

2018-05-01 Thread mikeb
http://git-wip-us.apache.org/repos/asf/impala/blob/592fd85d/docs/build/html/topics/impala_perf_stats.html -- diff --git a/docs/build/html/topics/impala_perf_stats.html b/docs/build/html/topics/impala_perf_stats.html index

[12/15] impala git commit: [DOCS] Add Impala docs from branch 2.x

2018-05-01 Thread mikeb
http://git-wip-us.apache.org/repos/asf/impala/blob/592fd85d/docs/build/html/topics/impala_disable_streaming_preaggregations.html -- diff --git a/docs/build/html/topics/impala_disable_streaming_preaggregations.html

impala git commit: IMPALA-6802 (part 1): Clean up authorization tests

2018-05-01 Thread mikeb
Repository: impala Updated Branches: refs/heads/master 167ed627f -> 671de258f IMPALA-6802 (part 1): Clean up authorization tests The first patch of this patch is to introduce a new mechanism of testing authorization that tests authorization at every hierarchy. This patch rewrites the

impala git commit: ignore Hadoop 3-related commits in 2.x

2018-05-01 Thread mikeb
Repository: impala Updated Branches: refs/heads/2.x 955ad0833 -> 65072f604 ignore Hadoop 3-related commits in 2.x These commits are about Hadoop 3 and should have had the special "not for 2.x" header. They were missing them, so we must ignore them. Testing: python -m json.tool

impala git commit: IMPALA-6951: Revert "Warn about Hadoop / Java version incompatibility"

2018-04-30 Thread mikeb
Repository: impala Updated Branches: refs/heads/master 418c70578 -> 8a609b351 IMPALA-6951: Revert "Warn about Hadoop / Java version incompatibility" This reverts commit 22c7ded07eb2710aba3e1aa07ed7ec1a448f7c61. Change-Id: I41a9afb1a1bc9be1cae687edc06ca3b554a32c7b Reviewed-on:

[3/3] impala git commit: IMPALA-6215: Removes race when using LibCache.

2018-01-30 Thread mikeb
IMPALA-6215: Removes race when using LibCache. LibCache's api to provide access to locally cached files has a race. Currently, the client of the cache accesses the locally cached path as a string, but nothing guarantees that the associated file is not removed before the client is done using it.

impala git commit: IMPALA-6512: Fix test_exchange_delays for KRPC

2018-02-15 Thread mikeb
Repository: impala Updated Branches: refs/heads/master 19ab465b3 -> 9d3702192 IMPALA-6512: Fix test_exchange_delays for KRPC The sender timed out error message diverges between Thrift and KRPC slightly due to the source address being not readily available with Thrift RPC implementation. This

[5/7] impala git commit: IMPALA-7381: Prevent build failure after switching to new CDH_BUILD_NUMBER

2018-08-03 Thread mikeb
IMPALA-7381: Prevent build failure after switching to new CDH_BUILD_NUMBER Switching to a new CDH_BUILD_NUMBER requires downloading new CDH components as well as forcing Maven to update its local repository. This patch updates the CDH_COMPONENTS_HOME to include the CDH_BUILD_NUMBER which will

[1/7] impala git commit: IMPALA-5542: Impala cannot scan Parquet decimal stored as int64_t/int32_t

2018-08-03 Thread mikeb
Repository: impala Updated Branches: refs/heads/master a76ea5c2e -> 2b4d06710 IMPALA-5542: Impala cannot scan Parquet decimal stored as int64_t/int32_t The Decimal type in Parquet is a logical type. That means the Parquet file stores some physical/primitive type that is annotated by the

[6/7] impala git commit: IMPALA-7362: Add query option to set timezone

2018-08-03 Thread mikeb
IMPALA-7362: Add query option to set timezone This change adds a new query option "timezone" which defines the timezone used for utc<->local conversions. The main goal is to simplify testing, but I think that some users may also find it useful so it is added as a "general" query option.

[2/7] impala git commit: IMPALA-7347: Update tests to accomodate HIVE-18118

2018-08-03 Thread mikeb
IMPALA-7347: Update tests to accomodate HIVE-18118 HIVE-18118 adds 'numFilesErasureCoded' to table properties. This patch addes it to test_show_create_table to work with the latest Hive. Change-Id: I6aae402dd38374de90b35c32166a9507e6eb29f9 Reviewed-on: http://gerrit.cloudera.org:8080/11108

[4/7] impala git commit: [DOCS] Added the part 1 of IMPALA-5607 to the upgrade guide

2018-08-03 Thread mikeb
[DOCS] Added the part 1 of IMPALA-5607 to the upgrade guide Change-Id: Ib0e53959bef4c629a31868e16b03b6abc11c9f8d Reviewed-on: http://gerrit.cloudera.org:8080/11051 Tested-by: Impala Public Jenkins Reviewed-by: Tim Armstrong Project: http://git-wip-us.apache.org/repos/asf/impala/repo Commit:

[7/7] impala git commit: IMPALA-7377: Update Sentry for the object ownership feature

2018-08-03 Thread mikeb
IMPALA-7377: Update Sentry for the object ownership feature Update CDH_BUILD_NUMBER to 506967, especially for the new Sentry update with the object owership feature (IMPALA-7075). This patch updates the Sentry package names and Sentry Maven dependencies. Testing: - Ran core tests Change-Id:

[3/7] impala git commit: IMPALA-3330: [DOCS] TRANSLATE function updated

2018-08-03 Thread mikeb
IMPALA-3330: [DOCS] TRANSLATE function updated - Better description - Examples Change-Id: Ica33ecbb7118e3034f95c5705eed19d169dc16cb Reviewed-on: http://gerrit.cloudera.org:8080/11074 Tested-by: Impala Public Jenkins Reviewed-by: Jim Apple Project:

[2/3] impala git commit: IMPALA-7325: Incorrect SHOW CREATE VIEW with built-in functions

2018-08-04 Thread mikeb
IMPALA-7325: Incorrect SHOW CREATE VIEW with built-in functions In the prior code, the authorization checker for the masked privilege requests skips the check for system database access. As a result, certain commands, such as SHOW CREATE VIEW that references built-in database requires permission

[3/3] impala git commit: IMPALA-7394: Don't print stack trace in ExpireSessions()

2018-08-04 Thread mikeb
IMPALA-7394: Don't print stack trace in ExpireSessions() When sessions expire, ExpireSessions() may create excessive amount of log spew due to printing of the stack traces esp when there are a massive amount of sessions expiring at the same time. This stack crawling also unnecessarily extends the

impala git commit: IMPALA-7428: Fix flaky test_shell_command_line::test_large_sql

2018-08-14 Thread mikeb
Repository: impala Updated Branches: refs/heads/master ea615d1d8 -> c0ff4fe8f IMPALA-7428: Fix flaky test_shell_command_line::test_large_sql This patch fixes the flaky test by rewriting the test to perform a large query from a non-existent table instead since the test focuses on Impala shell

[1/2] impala git commit: [DOCS] A typo fixed in titles

2018-08-16 Thread mikeb
Repository: impala Updated Branches: refs/heads/master 29905d1ea -> 864be3e60 [DOCS] A typo fixed in titles Change-Id: Iefcec53a6272a9221800678b9ed1ef52a898ed42 Reviewed-on: http://gerrit.cloudera.org:8080/11242 Reviewed-by: Alex Rodoni Tested-by: Impala Public Jenkins Project:

[2/2] impala git commit: IMPALA-7452: fix file check for test_disable_catalog_data_ops test

2018-08-16 Thread mikeb
IMPALA-7452: fix file check for test_disable_catalog_data_ops test The test's regex did not handle s3 paths. The fix loosens the check to allow for these paths. Change-Id: I7408bc233714620f502af3b8c19400aa3bb1666c Reviewed-on: http://gerrit.cloudera.org:8080/11243 Reviewed-by: Impala Public

[2/2] impala git commit: IMPALA-7398: Add logged_in_user alias for effective_user

2018-08-13 Thread mikeb
IMPALA-7398: Add logged_in_user alias for effective_user This patch adds an alias to the effective_user function so that views created in Hive using the logged_in_user function will work in Impala. Example: CREATE VIEW foo.view1 AS SELECT * FROM foo.table1 WHERE name=logged_in_user(); Tests: -

[4/4] impala git commit: IMPALA-7140 fix: fix NDV calculation for partition columns in LocalFsTable

2018-08-17 Thread mikeb
IMPALA-7140 fix: fix NDV calculation for partition columns in LocalFsTable For partition columns, we were previously calculating the NDV by adding the count of partitions plus the count of null-partitions. However, all of the null partitions have the same value (NULL) so they only contribute one

[1/4] impala git commit: IMPALA-7399: Remove third-party dependencies from junit xml script

2018-08-17 Thread mikeb
Repository: impala Updated Branches: refs/heads/master 7ccf73690 -> 199c0f2f9 IMPALA-7399: Remove third-party dependencies from junit xml script The original patch for this Jira relied on a third party python lib for generating Junit XML output, That proved to be limiting because setting up

[3/4] impala git commit: IMPALA-7439. CREATE DATABASE creates a catalog entry with missing location

2018-08-17 Thread mikeb
IMPALA-7439. CREATE DATABASE creates a catalog entry with missing location Previously, when creating a new database, the CatalogOpExecutor would create an HMS Database object, issue the HMS createDatabase call, and then create a Catalog entry from that same Database object. The resulting Catalog

impala git commit: IMPALA-7460 part 2: upgrade Paramiko and Fabric in extended test env

2018-08-23 Thread mikeb
Repository: impala Updated Branches: refs/heads/master 1d84d6855 -> 063d2c9d5 IMPALA-7460 part 2: upgrade Paramiko and Fabric in extended test env Upgrade Paramiko to the latest, 2.4.1. Paramiko drastically changed its dependencies in Paramiko 2, dropping defunct Pycrypto and using

impala git commit: update Flask to latest (1.0.2)

2018-08-27 Thread mikeb
Repository: impala Updated Branches: refs/heads/master c285ab979 -> c6ce735d1 update Flask to latest (1.0.2) Similar to Fabric and Paramiko, make Flask part of extended test requirements and upgrade it to its latest. Testing: - Impala builds, can do a full data load. - Change works in my

[4/7] impala git commit: IMPALA-7447. Evict LocalCatalog cache entries based on size

2018-08-22 Thread mikeb
IMPALA-7447. Evict LocalCatalog cache entries based on size This pulls in the 'sizeof' library from ehcache (Apache-licensed) and uses it to implement size-based eviction of cache entries in LocalCatalog. This is difficult to test without being quite fragile to small changes in the cached

[5/7] impala git commit: IMPALA-6709: Simplify tests that copy local files to tables

2018-08-22 Thread mikeb
IMPALA-6709: Simplify tests that copy local files to tables We had quite a few tests that created a table and used "hdfs dfs -copyFromLocal" to copy data files to the warehouse directory for this table. This operation needs some boilerplate code that I refactored to the new functions called

[7/7] impala git commit: IMPALA-7344: Restrict ALTER DATABASE/TABLE SET OWNER statements

2018-08-22 Thread mikeb
IMPALA-7344: Restrict ALTER DATABASE/TABLE SET OWNER statements Prior to this patch, any user with ALTER privilege could alter the database/table ownership from one user/role to another user/role. This is undesirable because altering an object ownership means giving a full access to that object.

  1   2   >