[2/5] impala git commit: IMPALA-6781: expand ORDER BY in some TPCH queries

2018-05-10 Thread joemcdonnell
IMPALA-6781: expand ORDER BY in some TPCH queries Fix determinism in TPCH Q3, Q10, Q18 by adding another column to the queries' ORDER BY to guarantee deterministic results. With TPCH 1 these queries were producing differing results across stress test runs. They were all valid, but the LIMIT wi

[3/5] impala git commit: IMPALA-6819: Add new queries to targeted-perf workload

2018-05-10 Thread joemcdonnell
http://git-wip-us.apache.org/repos/asf/impala/blob/59ccbbd7/testdata/workloads/targeted-perf/queries/primitive_shuffle_1mb_rows.test -- diff --git a/testdata/workloads/targeted-perf/queries/primitive_shuffle_1mb_rows.test b/testd

[5/5] impala git commit: IMPALA-6948, IMPALA-6962: add end-to-end tests

2018-05-10 Thread joemcdonnell
IMPALA-6948,IMPALA-6962: add end-to-end tests Adds end-to-end tests to validate that following various metadata operations, the catalog state in catalogd and impalads is the same. For IMPALA-6962, catalogd process restart for tests is fixed. Change-Id: Ic6c5b39e29b2885cd30fede18833cbf23fb755f5 R

[1/5] impala git commit: IMPALA-6980: [DOCS] You can add or change column comment in ALTER TABLE

2018-05-10 Thread joemcdonnell
Repository: impala Updated Branches: refs/heads/2.x 4337c1092 -> 59ccbbd70 IMPALA-6980: [DOCS] You can add or change column comment in ALTER TABLE Change-Id: Ia317a4b74d96aa064d375f6afc114f2cc8d30bf4 Reviewed-on: http://gerrit.cloudera.org:8080/10317 Reviewed-by: Fredy Wijaya Reviewed-by: Ale

[4/5] impala git commit: IMPALA-6819: Add new queries to targeted-perf workload

2018-05-10 Thread joemcdonnell
IMPALA-6819: Add new queries to targeted-perf workload Description: Adding new queries to the targeted-perf workload that is used by Impala performance tests run via $IMPALA_HOME/bin/run-workload.py Testing: Ran the performance tests for the targeted-perf workload and all the tests passed Change

[3/4] impala git commit: IMPALA-6972: Disable parallel dataload on MINICLUSTER_PROFILE=2

2018-05-10 Thread joemcdonnell
IMPALA-6972: Disable parallel dataload on MINICLUSTER_PROFILE=2 There is a Hive bug in Hive 1.1.0 that can result in a NullPointerException when doing parallel Hive operations (see IMPALA-6532). Since dataload goes parallel on Hive loads starting with IMPALA-6372, dataload can hit this error on Hi

[2/4] impala git commit: IMPALA-6819: Add new queries to targeted-perf workload

2018-05-10 Thread joemcdonnell
IMPALA-6819: Add new queries to targeted-perf workload Description: Adding new queries to the targeted-perf workload that is used by Impala performance tests run via $IMPALA_HOME/bin/run-workload.py Testing: Ran the performance tests for the targeted-perf workload and all the tests passed Change

[1/4] impala git commit: IMPALA-6819: Add new queries to targeted-perf workload

2018-05-10 Thread joemcdonnell
Repository: impala Updated Branches: refs/heads/master 28c1f7652 -> 3e7364503 http://git-wip-us.apache.org/repos/asf/impala/blob/c35ec6c9/testdata/workloads/targeted-perf/queries/primitive_shuffle_1mb_rows.test -- diff --git a

[4/4] impala git commit: Fix diagnostics path to not include the parent dir structure

2018-05-10 Thread joemcdonnell
Fix diagnostics path to not include the parent dir structure Without the fix, the diagnostics tar file included the entire directory structure of the diagnostics root dir. Before: === $ tar tf /tmp/impala-diagnostics-2018-05-08-11-59-39-spv8Eh.tar.gz tmp/impala-diagnostics-2018-05-08-11-59-39

[2/8] impala git commit: IMPALA-6999: Upgrade to sqlparse-0.1.19 for Impala shell

2018-05-10 Thread joemcdonnell
http://git-wip-us.apache.org/repos/asf/impala/blob/49413d9c/shell/ext-py/sqlparse-0.1.19/tests/test_regressions.py -- diff --git a/shell/ext-py/sqlparse-0.1.19/tests/test_regressions.py b/shell/ext-py/sqlparse-0.1.19/tests/test_re

[8/8] impala git commit: IMPALA-6999: Upgrade to sqlparse-0.1.19 for Impala shell

2018-05-10 Thread joemcdonnell
IMPALA-6999: Upgrade to sqlparse-0.1.19 for Impala shell sqlparse-0.1.19 is the last version of sqlparse that supports Python 2.6. Testing: - Ran all end-to-end tests Change-Id: Ide51ef3ac52d25a96b0fa832e29b6535197d23cb Reviewed-on: http://gerrit.cloudera.org:8080/10354 Reviewed-by: David Knupp

[6/8] impala git commit: IMPALA-6999: Upgrade to sqlparse-0.1.19 for Impala shell

2018-05-10 Thread joemcdonnell
http://git-wip-us.apache.org/repos/asf/impala/blob/49413d9c/shell/ext-py/sqlparse-0.1.14/sqlparse/utils.py -- diff --git a/shell/ext-py/sqlparse-0.1.14/sqlparse/utils.py b/shell/ext-py/sqlparse-0.1.14/sqlparse/utils.py deleted fil

[1/8] impala git commit: Update version to 3.1.0-SNAPSHOT

2018-05-10 Thread joemcdonnell
Repository: impala Updated Branches: refs/heads/master 3e7364503 -> 49413d9c5 Update version to 3.1.0-SNAPSHOT Change-Id: Ia2e2df73d27fa332d17fec4e9aa469ea91b14167 Reviewed-on: http://gerrit.cloudera.org:8080/10360 Reviewed-by: Michael Brown Tested-by: Impala Public Jenkins Project: http:/

impala git commit: IMPALA-6972: Disable parallel dataload on MINICLUSTER_PROFILE=2

2018-05-10 Thread joemcdonnell
Repository: impala Updated Branches: refs/heads/2.x 59ccbbd70 -> 3bfee642d IMPALA-6972: Disable parallel dataload on MINICLUSTER_PROFILE=2 There is a Hive bug in Hive 1.1.0 that can result in a NullPointerException when doing parallel Hive operations (see IMPALA-6532). Since dataload goes para

[5/8] impala git commit: IMPALA-6999: Upgrade to sqlparse-0.1.19 for Impala shell

2018-05-10 Thread joemcdonnell
http://git-wip-us.apache.org/repos/asf/impala/blob/49413d9c/shell/ext-py/sqlparse-0.1.14/tests/test_tokenize.py -- diff --git a/shell/ext-py/sqlparse-0.1.14/tests/test_tokenize.py b/shell/ext-py/sqlparse-0.1.14/tests/test_tokenize

[3/8] impala git commit: IMPALA-6999: Upgrade to sqlparse-0.1.19 for Impala shell

2018-05-10 Thread joemcdonnell
http://git-wip-us.apache.org/repos/asf/impala/blob/49413d9c/shell/ext-py/sqlparse-0.1.19/sqlparse/tokens.py -- diff --git a/shell/ext-py/sqlparse-0.1.19/sqlparse/tokens.py b/shell/ext-py/sqlparse-0.1.19/sqlparse/tokens.py new file

[7/8] impala git commit: IMPALA-6999: Upgrade to sqlparse-0.1.19 for Impala shell

2018-05-10 Thread joemcdonnell
http://git-wip-us.apache.org/repos/asf/impala/blob/49413d9c/shell/ext-py/sqlparse-0.1.14/sqlparse/filters.py -- diff --git a/shell/ext-py/sqlparse-0.1.14/sqlparse/filters.py b/shell/ext-py/sqlparse-0.1.14/sqlparse/filters.py delet

impala git commit: IMPALA-6966: sort table memory by size in catalogd web UI

2018-05-10 Thread abehm
Repository: impala Updated Branches: refs/heads/master 49413d9c5 -> ea4715fd7 IMPALA-6966: sort table memory by size in catalogd web UI This patch fix the sorting order in "Top-K Tables with Highest Memory Requirements" in which "Estimated memory" column is sorted as strings. Values got from