[2/3] impala git commit: IMPALA-6635: Add DECIMAL type to Kudu predicates

2018-03-13 Thread tarmstrong
IMPALA-6635: Add DECIMAL type to Kudu predicates This patch enables pushing scan predicates on DECIMAL columns down to Kudu. Testing: - Added Planner decimal predicate test to kudu.test - Added Planner decimal in-list test to kudu-selectivity.test Change-Id:

[6/6] impala git commit: IMPALA-6638: Reduce file handle cache lock contention

2018-03-13 Thread tarmstrong
IMPALA-6638: Reduce file handle cache lock contention FileHandleCache::OpenFileHandle() currently holds the lock while opening a file handle. This lengthens the duration holding the lock considerably, causing contention when a lot of file handles are being opened (i.e. when the cache is cold).

[3/3] impala git commit: IMPALA-5315: Cast to timestamp fails for YYYY-M-D format

2018-03-13 Thread tarmstrong
IMPALA-5315: Cast to timestamp fails for -M-D format This change allows casting of a string in 'lazy' date/time format to timestamp. The supported lazy date formats are: -[M]M-[d]d -[M]M-[d]d [H]H:[m]m:[s]s[.S] [H]H:[m]m:[s]s[.S] We will incur a SCAN performance

[5/6] impala git commit: IMPALA-6576: Add metrics for data stream service memory usage

2018-03-13 Thread tarmstrong
IMPALA-6576: Add metrics for data stream service memory usage This change adds metrics for the data stream service memory usage. Both current and peak usage are exposed. It adds a test to test_krpc_metrics.py to make sure that the expected metrics are present and that the peak usage shows a

[1/3] impala git commit: IMPALA-6638: Reduce file handle cache lock contention

2018-03-13 Thread tarmstrong
Repository: impala Updated Branches: refs/heads/master 8283081bf -> 0d7787fe4 IMPALA-6638: Reduce file handle cache lock contention FileHandleCache::OpenFileHandle() currently holds the lock while opening a file handle. This lengthens the duration holding the lock considerably, causing

[1/6] impala git commit: IMPALA-6405: Error when string to decimal cast overflows

2018-03-13 Thread tarmstrong
Repository: impala Updated Branches: refs/heads/2.x 0ba181e5b -> 6d3fdee3f IMPALA-6405: Error when string to decimal cast overflows Before this patch, when there was an error when converting a string to a decimal, a NULL was returned. In this patch, we change this behavior so that an error is

[3/6] impala git commit: IMPALA-6609: Fix ownership of class members in KrpcDataStreamRecvr

2018-03-13 Thread tarmstrong
IMPALA-6609: Fix ownership of class members in KrpcDataStreamRecvr A KrpcDataStreamRecvr is co-owned by the singleton KrpcDataStreamMgr and an exchange node. It's possible that some threads (e.g. RPC service threads) may still retain reference to the KrpcDataStreamRecvr after its owning exchange

[2/6] impala git commit: IMPALA-6341, IMPALA-5917: Reduce mem-limit for start-impala-cluster.

2018-03-13 Thread tarmstrong
IMPALA-6341, IMPALA-5917: Reduce mem-limit for start-impala-cluster. We've observed empirically that giving Impala 80% of system memory doesn't leave enough room for the minicluster and ASAN overhead, leading to the OOM killer striking during test runs (sometimes). This commit reduces the