[jira] [Commented] (IMPALA-7220) primitive_shuffle_1mb_rows fails at low scale factors

2018-06-28 Thread Jim Apple (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-7220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16527142#comment-16527142 ] Jim Apple commented on IMPALA-7220: --- https://jenkins.impala.io/view/Experimental/job/perf-AB-test/200/ 

[jira] [Resolved] (IMPALA-7205) Respond to ReportExecStatus() RPC with CANCELLED whenever query execution has terminated

2018-06-28 Thread Dan Hecht (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-7205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Hecht resolved IMPALA-7205. --- Resolution: Fixed Fix Version/s: Impala 3.1.0 commit

[jira] [Commented] (IMPALA-7221) While reading from object store S3/ADLS at +500MB/sec TypeArrayKlass::allocate_common becomes a CPU bottleneck

2018-06-28 Thread Dan Hecht (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-7221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16526957#comment-16526957 ] Dan Hecht commented on IMPALA-7221: --- I think this is because S3A doesn't support the DirectByteBuffer

[jira] [Assigned] (IMPALA-7221) While reading from object store S3/ADLS at fast rates +500MB/sec TypeArrayKlass::allocate_common becomes a CPU bottleneck

2018-06-28 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-7221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mostafa Mokhtar reassigned IMPALA-7221: --- Assignee: Sailesh Mukil > While reading from object store S3/ADLS at fast rates

[jira] [Updated] (IMPALA-7221) While reading from object store S3/ADLS at +500MB/sec TypeArrayKlass::allocate_common becomes a CPU bottleneck

2018-06-28 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-7221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mostafa Mokhtar updated IMPALA-7221: Summary: While reading from object store S3/ADLS at +500MB/sec

[jira] [Updated] (IMPALA-7221) While reading from object store S3/ADLS at fast rates +500MB/sec TypeArrayKlass::allocate_common becomes a CPU bottleneck

2018-06-28 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-7221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mostafa Mokhtar updated IMPALA-7221: Attachment: s3_alloc_expensive_2_ps.txt s3_alloc_expensive_1_js.txt >

[jira] [Created] (IMPALA-7221) While reading from object store S3/ADLS at fast rates +500MB/sec TypeArrayKlass::allocate_common becomes a CPU bottleneck

2018-06-28 Thread Mostafa Mokhtar (JIRA)
Mostafa Mokhtar created IMPALA-7221: --- Summary: While reading from object store S3/ADLS at fast rates +500MB/sec TypeArrayKlass::allocate_common becomes a CPU bottleneck Key: IMPALA-7221 URL:

[jira] [Created] (IMPALA-7220) primitive_shuffle_1mb_rows fails at low scale factors

2018-06-28 Thread Jim Apple (JIRA)
Jim Apple created IMPALA-7220: - Summary: primitive_shuffle_1mb_rows fails at low scale factors Key: IMPALA-7220 URL: https://issues.apache.org/jira/browse/IMPALA-7220 Project: IMPALA Issue Type:

[jira] [Created] (IMPALA-7219) 7.5% of Catalog Server heap wasted by empty HashMaps and ArrayLists

2018-06-28 Thread Misha Dmitriev (JIRA)
Misha Dmitriev created IMPALA-7219: -- Summary: 7.5% of Catalog Server heap wasted by empty HashMaps and ArrayLists Key: IMPALA-7219 URL: https://issues.apache.org/jira/browse/IMPALA-7219 Project:

[jira] [Resolved] (IMPALA-2712) Investigate increasing batch size

2018-06-28 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-2712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mostafa Mokhtar resolved IMPALA-2712. - Resolution: Won't Fix > Investigate increasing batch size >

[jira] [Assigned] (IMPALA-2564) Introduce mechanism to limit query fan-out

2018-06-28 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-2564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mostafa Mokhtar reassigned IMPALA-2564: --- Assignee: (was: Mostafa Mokhtar) > Introduce mechanism to limit query fan-out

[jira] [Resolved] (IMPALA-6657) Investigate why memory allocation in Exchange receiver node takes a long time

2018-06-28 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-6657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mostafa Mokhtar resolved IMPALA-6657. - Resolution: Fixed Turns out tcmalloc is reason, issue fixe in 2.12 > Investigate why

[jira] [Resolved] (IMPALA-2682) Address exchange operator CPU bottlenecks in Thrift

2018-06-28 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-2682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mostafa Mokhtar resolved IMPALA-2682. - Resolution: Fixed Fixed in 2.13 > Address exchange operator CPU bottlenecks in Thrift

[jira] [Resolved] (IMPALA-7215) Implement a templatized CountingBarrier

2018-06-28 Thread Sailesh Mukil (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-7215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sailesh Mukil resolved IMPALA-7215. --- Resolution: Fixed > Implement a templatized CountingBarrier >

[jira] [Assigned] (IMPALA-1226) need better cancellation tests

2018-06-28 Thread Dan Hecht (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-1226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dan Hecht reassigned IMPALA-1226: - Assignee: Dan Hecht (was: Mostafa Mokhtar) > need better cancellation tests >

[jira] [Closed] (IMPALA-6976) Script to Parse Query Profiles

2018-06-28 Thread nithya (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-6976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nithya closed IMPALA-6976. -- Resolution: Won't Do > Script to Parse Query Profiles > -- > >

[jira] [Resolved] (IMPALA-6819) Add new performance test workloads

2018-06-28 Thread nithya (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-6819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nithya resolved IMPALA-6819. Resolution: Fixed [https://gerrit.cloudera.org/#/c/9973/] [https://gerrit.cloudera.org/#/c/9979/] > Add

[jira] [Closed] (IMPALA-6819) Add new performance test workloads

2018-06-28 Thread nithya (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-6819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nithya closed IMPALA-6819. -- > Add new performance test workloads > --- > > Key: IMPALA-6819

[jira] [Commented] (IMPALA-5119) Don't make RPCs from Coordinator::UpdateBackendExecStatus()

2018-06-28 Thread Michael Ho (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-5119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16526633#comment-16526633 ] Michael Ho commented on IMPALA-5119: With KRPC, we can consider scheduling a callback to be executed

[jira] [Created] (IMPALA-7218) Impala 3.1 Doc: Allow Column Definitions in ALTER VIEW

2018-06-28 Thread Alex Rodoni (JIRA)
Alex Rodoni created IMPALA-7218: --- Summary: Impala 3.1 Doc: Allow Column Definitions in ALTER VIEW Key: IMPALA-7218 URL: https://issues.apache.org/jira/browse/IMPALA-7218 Project: IMPALA Issue

[jira] [Commented] (IMPALA-7173) [DOCS] load balancer config should add "check" in more places

2018-06-28 Thread Michael Brown (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-7173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16526433#comment-16526433 ] Michael Brown commented on IMPALA-7173: --- Misunderstood [~SudarshanS]; adjusted summary and

[jira] [Updated] (IMPALA-7173) [DOCS] load balancer config should add "check" in more places

2018-06-28 Thread Michael Brown (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-7173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Brown updated IMPALA-7173: -- Summary: [DOCS] load balancer config should add "check" in more places (was: [DOCS] Update

[jira] [Reopened] (IMPALA-7173) [DOCS] load balancer config should add "check" in more places

2018-06-28 Thread Michael Brown (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-7173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Brown reopened IMPALA-7173: --- > [DOCS] load balancer config should add "check" in more places >

[jira] [Comment Edited] (IMPALA-5050) Add support to read TIMESTAMP_MILLIS and TIMESTAMP_MICROS to the parquet scanner

2018-06-28 Thread Csaba Ringhofer (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-5050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16526270#comment-16526270 ] Csaba Ringhofer edited comment on IMPALA-5050 at 6/28/18 12:53 PM: ---

[jira] [Commented] (IMPALA-5050) Add support to read TIMESTAMP_MILLIS and TIMESTAMP_MICROS to the parquet scanner

2018-06-28 Thread Csaba Ringhofer (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-5050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16526270#comment-16526270 ] Csaba Ringhofer commented on IMPALA-5050: - [~lv] [~zi] I have started a prototype implementation

[jira] [Assigned] (IMPALA-5050) Add support to read TIMESTAMP_MILLIS and TIMESTAMP_MICROS to the parquet scanner

2018-06-28 Thread Csaba Ringhofer (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-5050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Csaba Ringhofer reassigned IMPALA-5050: --- Assignee: Csaba Ringhofer > Add support to read TIMESTAMP_MILLIS and

[jira] [Assigned] (IMPALA-5051) Add support to write TIMESTAMP_MICROS timestamps to the parquet writer

2018-06-28 Thread Csaba Ringhofer (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-5051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Csaba Ringhofer reassigned IMPALA-5051: --- Assignee: Csaba Ringhofer > Add support to write TIMESTAMP_MICROS timestamps to