[jira] [Commented] (IMPALA-7047) REFRESH on unpartitioned tables calls getBlockLocations on every file

2018-05-17 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-7047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16480133#comment-16480133 ] Todd Lipcon commented on IMPALA-7047: - On a relatively small table with 374 files, REFRESH spends

[jira] [Created] (IMPALA-7047) REFRESH on unpartitioned tables calls getBlockLocations on every file

2018-05-17 Thread Todd Lipcon (JIRA)
Todd Lipcon created IMPALA-7047: --- Summary: REFRESH on unpartitioned tables calls getBlockLocations on every file Key: IMPALA-7047 URL: https://issues.apache.org/jira/browse/IMPALA-7047 Project: IMPALA

[jira] [Created] (IMPALA-7054) "Top-25 tables with highest memory requirements" sorts incorrectly

2018-05-21 Thread Todd Lipcon (JIRA)
Todd Lipcon created IMPALA-7054: --- Summary: "Top-25 tables with highest memory requirements" sorts incorrectly Key: IMPALA-7054 URL: https://issues.apache.org/jira/browse/IMPALA-7054 Project: IMPALA

[jira] [Updated] (IMPALA-7034) Increase scalability of metadata handling

2018-05-23 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-7034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated IMPALA-7034: Component/s: Catalog > Increase scalability of metadata handling >

[jira] [Updated] (IMPALA-4979) Port CatalogService to KRPC

2018-05-23 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-4979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated IMPALA-4979: Component/s: Catalog > Port CatalogService to KRPC > --- > >

[jira] [Commented] (IMPALA-6729) Provide startup option to disable file and block location cache

2018-05-23 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-6729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16488108#comment-16488108 ] Todd Lipcon commented on IMPALA-6729: - Hi [~stiga-huang], I just caught up on the discussion here. It

[jira] [Commented] (IMPALA-7066) Provide option to build impalad with native-toolchain dependencies linked statically

2018-05-23 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-7066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16488251#comment-16488251 ] Todd Lipcon commented on IMPALA-7066: - The difficulty with libkudu_client specifically is that it has

[jira] [Created] (IMPALA-7077) Add a configuration for the maximum number of partitions to load

2018-05-25 Thread Todd Lipcon (JIRA)
Todd Lipcon created IMPALA-7077: --- Summary: Add a configuration for the maximum number of partitions to load Key: IMPALA-7077 URL: https://issues.apache.org/jira/browse/IMPALA-7077 Project: IMPALA

[jira] [Commented] (IMPALA-7054) "Top-25 tables with highest memory requirements" sorts incorrectly

2018-05-21 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-7054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16483180#comment-16483180 ] Todd Lipcon commented on IMPALA-7054: - Ah, it seems so. I was looking at a release rather than the

[jira] [Resolved] (IMPALA-7054) "Top-25 tables with highest memory requirements" sorts incorrectly

2018-05-21 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-7054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved IMPALA-7054. - Resolution: Duplicate > "Top-25 tables with highest memory requirements" sorts incorrectly >

[jira] [Commented] (IMPALA-7093) Tables briefly appear to not exist after INVALIDATE METADATA or catalog restart

2018-05-30 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-7093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16495543#comment-16495543 ] Todd Lipcon commented on IMPALA-7093: - Been digging a bit more. This seems to affect one cluster

[jira] [Updated] (IMPALA-6843) Responses to prioritizedLoad() requests should be returned directly and not via the statestore

2018-05-29 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-6843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated IMPALA-6843: Summary: Responses to prioritizedLoad() requests should be returned directly and not via the

[jira] [Created] (IMPALA-7105) Some fe tests fail when run standalone

2018-05-31 Thread Todd Lipcon (JIRA)
Todd Lipcon created IMPALA-7105: --- Summary: Some fe tests fail when run standalone Key: IMPALA-7105 URL: https://issues.apache.org/jira/browse/IMPALA-7105 Project: IMPALA Issue Type: Bug

[jira] [Created] (IMPALA-7110) Minor FE fixes suggested by error-prone

2018-06-01 Thread Todd Lipcon (JIRA)
Todd Lipcon created IMPALA-7110: --- Summary: Minor FE fixes suggested by error-prone Key: IMPALA-7110 URL: https://issues.apache.org/jira/browse/IMPALA-7110 Project: IMPALA Issue Type: Bug

[jira] [Created] (IMPALA-7127) Catalog implementation without catalogd

2018-06-05 Thread Todd Lipcon (JIRA)
Todd Lipcon created IMPALA-7127: --- Summary: Catalog implementation without catalogd Key: IMPALA-7127 URL: https://issues.apache.org/jira/browse/IMPALA-7127 Project: IMPALA Issue Type: New

[jira] [Created] (IMPALA-7140) Build out support for HDFS tables and views in LocalCatalog

2018-06-06 Thread Todd Lipcon (JIRA)
Todd Lipcon created IMPALA-7140: --- Summary: Build out support for HDFS tables and views in LocalCatalog Key: IMPALA-7140 URL: https://issues.apache.org/jira/browse/IMPALA-7140 Project: IMPALA

[jira] [Commented] (IMPALA-6204) Remove DataSourceScanNode at next compatibility breaking point

2018-06-06 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-6204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16503628#comment-16503628 ] Todd Lipcon commented on IMPALA-6204: - Supporting external data sources without catalogd will

[jira] [Created] (IMPALA-7131) Support external data sources without catalogd

2018-06-06 Thread Todd Lipcon (JIRA)
Todd Lipcon created IMPALA-7131: --- Summary: Support external data sources without catalogd Key: IMPALA-7131 URL: https://issues.apache.org/jira/browse/IMPALA-7131 Project: IMPALA Issue Type:

[jira] [Created] (IMPALA-7224) UpdateCatalogMetrics very slow when there are many tables

2018-06-29 Thread Todd Lipcon (JIRA)
Todd Lipcon created IMPALA-7224: --- Summary: UpdateCatalogMetrics very slow when there are many tables Key: IMPALA-7224 URL: https://issues.apache.org/jira/browse/IMPALA-7224 Project: IMPALA

[jira] [Assigned] (IMPALA-7224) UpdateCatalogMetrics very slow when there are many tables

2018-06-29 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-7224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon reassigned IMPALA-7224: --- Assignee: Todd Lipcon > UpdateCatalogMetrics very slow when there are many tables >

[jira] [Resolved] (IMPALA-7135) Skeleton implementation of LocalCatalog

2018-06-22 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-7135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved IMPALA-7135. - Resolution: Fixed Assignee: Todd Lipcon Fix Version/s: Impala 3.1.0

[jira] [Resolved] (IMPALA-7141) Extract interfaces for partition pruning prior to fetching partitions

2018-06-22 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-7141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved IMPALA-7141. - Resolution: Fixed Fix Version/s: Impala 3.1.0 Resolved in

[jira] [Created] (IMPALA-7201) Support DDL in LocalCatalog using existing catalogd

2018-06-22 Thread Todd Lipcon (JIRA)
Todd Lipcon created IMPALA-7201: --- Summary: Support DDL in LocalCatalog using existing catalogd Key: IMPALA-7201 URL: https://issues.apache.org/jira/browse/IMPALA-7201 Project: IMPALA Issue

[jira] [Created] (IMPALA-7203) Support functions in LocalCatalog

2018-06-22 Thread Todd Lipcon (JIRA)
Todd Lipcon created IMPALA-7203: --- Summary: Support functions in LocalCatalog Key: IMPALA-7203 URL: https://issues.apache.org/jira/browse/IMPALA-7203 Project: IMPALA Issue Type: Sub-task

[jira] [Resolved] (IMPALA-7340) Clarify which fields belong in "descriptor" vs "full" catalog thrift objects

2018-07-25 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-7340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved IMPALA-7340. - Resolution: Fixed Fix Version/s: Impala 3.1.0 > Clarify which fields belong in

[jira] [Commented] (IMPALA-6671) Metadata operations that modify a table blocks topic updates for other unrelated operations

2018-07-31 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-6671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16563974#comment-16563974 ] Todd Lipcon commented on IMPALA-6671: - Been brainstorming a possible route to fixing this...

[jira] [Commented] (IMPALA-6671) Metadata operations that modify a table blocks topic updates for other unrelated operations

2018-08-01 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-6671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16565698#comment-16565698 ] Todd Lipcon commented on IMPALA-6671: - bq. Instead of table.pendingWriteVersion =

[jira] [Commented] (IMPALA-7309) Prevent the addition of Avro schemas to non-Avro tables with incompatible schema

2018-08-01 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-7309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16565820#comment-16565820 ] Todd Lipcon commented on IMPALA-7309: - Another weird thing to note: the current behavior seems to be

[jira] [Updated] (IMPALA-7309) Prevent the addition of Avro partitions to non-Avro tables with incompatible schema

2018-08-01 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-7309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated IMPALA-7309: Summary: Prevent the addition of Avro partitions to non-Avro tables with incompatible schema

[jira] [Created] (IMPALA-7386) CatalogObjectVersionQueue should not be a queue

2018-08-01 Thread Todd Lipcon (JIRA)
Todd Lipcon created IMPALA-7386: --- Summary: CatalogObjectVersionQueue should not be a queue Key: IMPALA-7386 URL: https://issues.apache.org/jira/browse/IMPALA-7386 Project: IMPALA Issue Type:

[jira] [Created] (IMPALA-7388) JNI THROW_IF_ERROR macros use local scope variables which likely conflict

2018-08-02 Thread Todd Lipcon (JIRA)
Todd Lipcon created IMPALA-7388: --- Summary: JNI THROW_IF_ERROR macros use local scope variables which likely conflict Key: IMPALA-7388 URL: https://issues.apache.org/jira/browse/IMPALA-7388 Project:

[jira] [Resolved] (IMPALA-7276) Support CREATE TABLE AS SELECT with LocalCatalog

2018-07-25 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-7276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved IMPALA-7276. - Resolution: Fixed Fix Version/s: Impala 3.1.0 > Support CREATE TABLE AS SELECT with

[jira] [Resolved] (IMPALA-7257) Support querying Kudu tables in LocalCatalog

2018-07-25 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-7257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved IMPALA-7257. - Resolution: Fixed Fix Version/s: Impala 3.1.0 > Support querying Kudu tables in

[jira] [Resolved] (IMPALA-7277) Support for INSERT and LOAD DATA in LocalCatalog

2018-07-25 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-7277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved IMPALA-7277. - Resolution: Fixed Fix Version/s: Impala 3.1.0 > Support for INSERT and LOAD DATA in

[jira] [Resolved] (IMPALA-7386) CatalogObjectVersionQueue should not be a queue

2018-08-08 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-7386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved IMPALA-7386. - Resolution: Fixed Fix Version/s: Impala 3.1.0 > CatalogObjectVersionQueue should not be

[jira] [Commented] (IMPALA-7386) CatalogObjectVersionQueue should not be a queue

2018-08-08 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-7386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16573929#comment-16573929 ] Todd Lipcon commented on IMPALA-7386: - Yea I think the extra memory cost of having the two data

[jira] [Resolved] (IMPALA-7413) test_incompatible_avro_partition_in_non_avro_table breaks in local mode

2018-08-08 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-7413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved IMPALA-7413. - Resolution: Duplicate oops, I had filed IMPALA-7414 for the same issue. >

[jira] [Commented] (IMPALA-7406) Flatbuffer wrappers use almost as much memory as underlying data

2018-08-08 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-7406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16573925#comment-16573925 ] Todd Lipcon commented on IMPALA-7406: - I filed https://github.com/google/flatbuffers/issues/4865

[jira] [Resolved] (IMPALA-7311) INSERT with specified target partition fails if any other partition is missing write permissions

2018-08-07 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-7311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved IMPALA-7311. - Resolution: Fixed Fix Version/s: Impala 3.1.0 > INSERT with specified target partition

[jira] [Created] (IMPALA-7409) CatalogObjectVersionSet should not allow duplicate items

2018-08-07 Thread Todd Lipcon (JIRA)
Todd Lipcon created IMPALA-7409: --- Summary: CatalogObjectVersionSet should not allow duplicate items Key: IMPALA-7409 URL: https://issues.apache.org/jira/browse/IMPALA-7409 Project: IMPALA

[jira] [Updated] (IMPALA-7127) Fetch-on-demand metadata for the impalad-side catalog

2018-08-07 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-7127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated IMPALA-7127: Summary: Fetch-on-demand metadata for the impalad-side catalog (was: Catalog implementation

[jira] [Resolved] (IMPALA-7201) Support DDL in LocalCatalog using existing catalogd

2018-08-07 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-7201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved IMPALA-7201. - Resolution: Fixed Fix Version/s: Impala 3.1.0 > Support DDL in LocalCatalog using

[jira] [Resolved] (IMPALA-6335) Remove the unnecessary decorator "pytest.mark.execute_serially" from tests which can be run in parallel

2018-08-07 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-6335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved IMPALA-6335. - Resolution: Fixed Fix Version/s: Impala 3.1.0 > Remove the unnecessary decorator

[jira] [Created] (IMPALA-7406) Flatbuffer wrappers use almost as much memory as underlying data

2018-08-07 Thread Todd Lipcon (JIRA)
Todd Lipcon created IMPALA-7406: --- Summary: Flatbuffer wrappers use almost as much memory as underlying data Key: IMPALA-7406 URL: https://issues.apache.org/jira/browse/IMPALA-7406 Project: IMPALA

[jira] [Resolved] (IMPALA-7307) Support TABLESAMPLE and stats extrapolation in LocalCatalog

2018-08-07 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-7307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved IMPALA-7307. - Resolution: Fixed Fix Version/s: Impala 3.1.0 > Support TABLESAMPLE and stats

[jira] [Resolved] (IMPALA-7140) Build out support for HDFS tables and views in LocalCatalog

2018-08-07 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-7140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved IMPALA-7140. - Resolution: Fixed Fix Version/s: Impala 3.1.0 > Build out support for HDFS tables and

[jira] [Resolved] (IMPALA-7308) Support Avro tables in LocalCatalog

2018-08-07 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-7308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved IMPALA-7308. - Resolution: Fixed Fix Version/s: Impala 3.1.0 > Support Avro tables in LocalCatalog >

[jira] [Resolved] (IMPALA-7258) Support querying HBase tables in LocalCatalog

2018-08-07 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-7258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved IMPALA-7258. - Resolution: Fixed Fix Version/s: Impala 3.1.0 > Support querying HBase tables in

[jira] [Commented] (IMPALA-7414) Recently added tests fail on localfs build

2018-08-08 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-7414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16573571#comment-16573571 ] Todd Lipcon commented on IMPALA-7414: - Following tests failed:

[jira] [Created] (IMPALA-7414) Recently added tests fail on localfs build

2018-08-08 Thread Todd Lipcon (JIRA)
Todd Lipcon created IMPALA-7414: --- Summary: Recently added tests fail on localfs build Key: IMPALA-7414 URL: https://issues.apache.org/jira/browse/IMPALA-7414 Project: IMPALA Issue Type: Bug

[jira] [Assigned] (IMPALA-7406) Flatbuffer wrappers use almost as much memory as underlying data

2018-08-15 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-7406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon reassigned IMPALA-7406: --- Assignee: Todd Lipcon > Flatbuffer wrappers use almost as much memory as underlying data >

[jira] [Created] (IMPALA-7453) Intern HdfsStorageDescriptors

2018-08-15 Thread Todd Lipcon (JIRA)
Todd Lipcon created IMPALA-7453: --- Summary: Intern HdfsStorageDescriptors Key: IMPALA-7453 URL: https://issues.apache.org/jira/browse/IMPALA-7453 Project: IMPALA Issue Type: Improvement

[jira] [Resolved] (IMPALA-7388) JNI THROW_IF_ERROR macros use local scope variables which likely conflict

2018-08-13 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-7388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved IMPALA-7388. - Resolution: Fixed Fix Version/s: Impala 3.1.0 > JNI THROW_IF_ERROR macros use local

[jira] [Created] (IMPALA-7436) Fetch table and partition metadata from catalogd

2018-08-14 Thread Todd Lipcon (JIRA)
Todd Lipcon created IMPALA-7436: --- Summary: Fetch table and partition metadata from catalogd Key: IMPALA-7436 URL: https://issues.apache.org/jira/browse/IMPALA-7436 Project: IMPALA Issue Type:

[jira] [Created] (IMPALA-7437) Simple granular caching of partition metadata in impalad

2018-08-14 Thread Todd Lipcon (JIRA)
Todd Lipcon created IMPALA-7437: --- Summary: Simple granular caching of partition metadata in impalad Key: IMPALA-7437 URL: https://issues.apache.org/jira/browse/IMPALA-7437 Project: IMPALA

[jira] [Created] (IMPALA-7438) Automated test for concurrent DDL and metadata queries

2018-08-14 Thread Todd Lipcon (JIRA)
Todd Lipcon created IMPALA-7438: --- Summary: Automated test for concurrent DDL and metadata queries Key: IMPALA-7438 URL: https://issues.apache.org/jira/browse/IMPALA-7438 Project: IMPALA Issue

[jira] [Assigned] (IMPALA-7439) CREATE DATABASE creates a catalog entry with empty location field

2018-08-14 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-7439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon reassigned IMPALA-7439: --- Assignee: Todd Lipcon > CREATE DATABASE creates a catalog entry with empty location field

[jira] [Created] (IMPALA-7439) CREATE DATABASE creates a catalog entry with empty location field

2018-08-14 Thread Todd Lipcon (JIRA)
Todd Lipcon created IMPALA-7439: --- Summary: CREATE DATABASE creates a catalog entry with empty location field Key: IMPALA-7439 URL: https://issues.apache.org/jira/browse/IMPALA-7439 Project: IMPALA

[jira] [Created] (IMPALA-7447) Size-based eviction for LocalCatalog LRU cache

2018-08-14 Thread Todd Lipcon (JIRA)
Todd Lipcon created IMPALA-7447: --- Summary: Size-based eviction for LocalCatalog LRU cache Key: IMPALA-7447 URL: https://issues.apache.org/jira/browse/IMPALA-7447 Project: IMPALA Issue Type:

[jira] [Commented] (IMPALA-7321) Write permissions checks for insert into multi-level partitioned table are incorrect

2018-08-14 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-7321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16580685#comment-16580685 ] Todd Lipcon commented on IMPALA-7321: - Another data point against this: if the partition directories

[jira] [Assigned] (IMPALA-7047) REFRESH on unpartitioned tables calls getBlockLocations on every file

2018-08-14 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-7047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon reassigned IMPALA-7047: --- Assignee: Todd Lipcon > REFRESH on unpartitioned tables calls getBlockLocations on every

[jira] [Created] (IMPALA-7450) catalogd should use thread names to make jstack more readable

2018-08-15 Thread Todd Lipcon (JIRA)
Todd Lipcon created IMPALA-7450: --- Summary: catalogd should use thread names to make jstack more readable Key: IMPALA-7450 URL: https://issues.apache.org/jira/browse/IMPALA-7450 Project: IMPALA

[jira] [Created] (IMPALA-7457) Allow StateStore subscribers to filter keys by a prefix

2018-08-16 Thread Todd Lipcon (JIRA)
Todd Lipcon created IMPALA-7457: --- Summary: Allow StateStore subscribers to filter keys by a prefix Key: IMPALA-7457 URL: https://issues.apache.org/jira/browse/IMPALA-7457 Project: IMPALA Issue

[jira] [Created] (IMPALA-7421) Static methods called with wrong JNI function

2018-08-09 Thread Todd Lipcon (JIRA)
Todd Lipcon created IMPALA-7421: --- Summary: Static methods called with wrong JNI function Key: IMPALA-7421 URL: https://issues.apache.org/jira/browse/IMPALA-7421 Project: IMPALA Issue Type: Bug

[jira] [Commented] (IMPALA-7414) Recently added tests fail on localfs build

2018-08-08 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-7414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16573602#comment-16573602 ] Todd Lipcon commented on IMPALA-7414: - Looks like the decimal-related test failures were already

[jira] [Resolved] (IMPALA-7406) Flatbuffer wrappers use almost as much memory as underlying data

2018-08-17 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-7406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved IMPALA-7406. - Resolution: Fixed Fix Version/s: Impala 3.1.0 > Flatbuffer wrappers use almost as much

[jira] [Created] (IMPALA-7469) Invalidate local catalog cache based on topic updates

2018-08-20 Thread Todd Lipcon (JIRA)
Todd Lipcon created IMPALA-7469: --- Summary: Invalidate local catalog cache based on topic updates Key: IMPALA-7469 URL: https://issues.apache.org/jira/browse/IMPALA-7469 Project: IMPALA Issue

[jira] [Created] (IMPALA-7489) Run tests with -Xcheck:jni enabled for debug mode

2018-08-24 Thread Todd Lipcon (JIRA)
Todd Lipcon created IMPALA-7489: --- Summary: Run tests with -Xcheck:jni enabled for debug mode Key: IMPALA-7489 URL: https://issues.apache.org/jira/browse/IMPALA-7489 Project: IMPALA Issue Type:

[jira] [Reopened] (IMPALA-7127) Fetch-on-demand metadata for the impalad-side catalog

2018-08-28 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-7127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon reopened IMPALA-7127: - Oops, didn't mean to close this one > Fetch-on-demand metadata for the impalad-side catalog >

[jira] [Resolved] (IMPALA-7436) Fetch table and partition metadata from catalogd

2018-08-28 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-7436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved IMPALA-7436. - Resolution: Fixed Assignee: Todd Lipcon Fix Version/s: Impala 3.1.0 > Fetch

[jira] [Resolved] (IMPALA-7127) Fetch-on-demand metadata for the impalad-side catalog

2018-08-28 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-7127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved IMPALA-7127. - Resolution: Fixed Fix Version/s: Impala 3.1.0 > Fetch-on-demand metadata for the

[jira] [Created] (IMPALA-7498) impalad should wait for catalogd during start up

2018-08-28 Thread Todd Lipcon (JIRA)
Todd Lipcon created IMPALA-7498: --- Summary: impalad should wait for catalogd during start up Key: IMPALA-7498 URL: https://issues.apache.org/jira/browse/IMPALA-7498 Project: IMPALA Issue Type:

[jira] [Created] (IMPALA-7501) Slim down metastore Partition objects in LocalCatalog cache

2018-08-28 Thread Todd Lipcon (JIRA)
Todd Lipcon created IMPALA-7501: --- Summary: Slim down metastore Partition objects in LocalCatalog cache Key: IMPALA-7501 URL: https://issues.apache.org/jira/browse/IMPALA-7501 Project: IMPALA

[jira] [Created] (IMPALA-7506) Support INVALIDATE METADATA with SYNC_DDL on fetch-on-demand impalad

2018-08-29 Thread Todd Lipcon (JIRA)
Todd Lipcon created IMPALA-7506: --- Summary: Support INVALIDATE METADATA with SYNC_DDL on fetch-on-demand impalad Key: IMPALA-7506 URL: https://issues.apache.org/jira/browse/IMPALA-7506 Project: IMPALA

[jira] [Updated] (IMPALA-7506) Support global INVALIDATE METADATA on fetch-on-demand impalad

2018-08-29 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-7506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated IMPALA-7506: Description: There is some complexity with how this is implemented in the original code: it

[jira] [Created] (IMPALA-7507) Clean up user-facing error messages in LocalCatalog mode

2018-08-29 Thread Todd Lipcon (JIRA)
Todd Lipcon created IMPALA-7507: --- Summary: Clean up user-facing error messages in LocalCatalog mode Key: IMPALA-7507 URL: https://issues.apache.org/jira/browse/IMPALA-7507 Project: IMPALA

[jira] [Resolved] (IMPALA-7447) Size-based eviction for LocalCatalog LRU cache

2018-08-22 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-7447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved IMPALA-7447. - Resolution: Fixed Assignee: Todd Lipcon Fix Version/s: Impala 3.1.0 >

[jira] [Resolved] (IMPALA-7437) Simple granular caching of partition metadata in impalad

2018-08-22 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-7437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved IMPALA-7437. - Resolution: Fixed Assignee: Todd Lipcon Fix Version/s: Impala 3.1.0 > Simple

[jira] [Commented] (IMPALA-7321) Write permissions checks for insert into multi-level partitioned table are incorrect

2018-07-18 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-7321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16548675#comment-16548675 ] Todd Lipcon commented on IMPALA-7321: - This probably isn't a really big deal, since it's a corner

[jira] [Created] (IMPALA-7320) Loading HDFS tables calls getFileStatus on each partition serially

2018-07-18 Thread Todd Lipcon (JIRA)
Todd Lipcon created IMPALA-7320: --- Summary: Loading HDFS tables calls getFileStatus on each partition serially Key: IMPALA-7320 URL: https://issues.apache.org/jira/browse/IMPALA-7320 Project: IMPALA

[jira] [Created] (IMPALA-7321) Write permissions checks for insert into multi-level partitioned table are incorrect

2018-07-18 Thread Todd Lipcon (JIRA)
Todd Lipcon created IMPALA-7321: --- Summary: Write permissions checks for insert into multi-level partitioned table are incorrect Key: IMPALA-7321 URL: https://issues.apache.org/jira/browse/IMPALA-7321

[jira] [Created] (IMPALA-7311) INSERT with specified target partition fails if any other partition is missing write permissions

2018-07-17 Thread Todd Lipcon (JIRA)
Todd Lipcon created IMPALA-7311: --- Summary: INSERT with specified target partition fails if any other partition is missing write permissions Key: IMPALA-7311 URL: https://issues.apache.org/jira/browse/IMPALA-7311

[jira] [Resolved] (IMPALA-7294) TABLESAMPLE clause allocates arrays based on total file count instead of selected partitions

2018-07-17 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-7294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved IMPALA-7294. - Resolution: Fixed Fix Version/s: Impala 3.1.0 > TABLESAMPLE clause allocates arrays

[jira] [Created] (IMPALA-7313) LOAD DATA does not create partitions on-demand (inconsistent with INSERT)

2018-07-17 Thread Todd Lipcon (JIRA)
Todd Lipcon created IMPALA-7313: --- Summary: LOAD DATA does not create partitions on-demand (inconsistent with INSERT) Key: IMPALA-7313 URL: https://issues.apache.org/jira/browse/IMPALA-7313 Project:

[jira] [Assigned] (IMPALA-7252) Backport rate limiting of fadvise calls into toolchain glog

2018-07-17 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-7252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon reassigned IMPALA-7252: --- Assignee: Tianyi Wang (was: Todd Lipcon) I think [~tianyiwang] was actually working on

[jira] [Created] (IMPALA-7307) Support TABLESAMPLE and stats extrapolation in LocalCatalog

2018-07-16 Thread Todd Lipcon (JIRA)
Todd Lipcon created IMPALA-7307: --- Summary: Support TABLESAMPLE and stats extrapolation in LocalCatalog Key: IMPALA-7307 URL: https://issues.apache.org/jira/browse/IMPALA-7307 Project: IMPALA

[jira] [Created] (IMPALA-7308) Support Avro tables in LocalCatalog

2018-07-16 Thread Todd Lipcon (JIRA)
Todd Lipcon created IMPALA-7308: --- Summary: Support Avro tables in LocalCatalog Key: IMPALA-7308 URL: https://issues.apache.org/jira/browse/IMPALA-7308 Project: IMPALA Issue Type: Sub-task

[jira] [Assigned] (IMPALA-7308) Support Avro tables in LocalCatalog

2018-07-16 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-7308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon reassigned IMPALA-7308: --- Assignee: Todd Lipcon > Support Avro tables in LocalCatalog >

[jira] [Created] (IMPALA-7309) Prevent the addition of Avro schemas to non-Avro tables with incompatible schema

2018-07-16 Thread Todd Lipcon (JIRA)
Todd Lipcon created IMPALA-7309: --- Summary: Prevent the addition of Avro schemas to non-Avro tables with incompatible schema Key: IMPALA-7309 URL: https://issues.apache.org/jira/browse/IMPALA-7309

[jira] [Created] (IMPALA-7340) Clarify which fields belong in "descriptor" vs "full" catalog thrift objects

2018-07-23 Thread Todd Lipcon (JIRA)
Todd Lipcon created IMPALA-7340: --- Summary: Clarify which fields belong in "descriptor" vs "full" catalog thrift objects Key: IMPALA-7340 URL: https://issues.apache.org/jira/browse/IMPALA-7340 Project:

[jira] [Work started] (IMPALA-7330) Make the table metadata refresh after "LOAD" commands incremental

2018-07-23 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-7330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on IMPALA-7330 started by Todd Lipcon. --- > Make the table metadata refresh after "LOAD" commands incremental >

[jira] [Assigned] (IMPALA-7330) Make the table metadata refresh after "LOAD" commands incremental

2018-07-23 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-7330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon reassigned IMPALA-7330: --- Assignee: Todd Lipcon Actually I will take a look. > Make the table metadata refresh

[jira] [Commented] (IMPALA-7234) Non-deterministic majority format for a table with equal partition instances

2018-07-24 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-7234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16554614#comment-16554614 ] Todd Lipcon commented on IMPALA-7234: - Should this function actually take into account the total

[jira] [Resolved] (IMPALA-7330) Make the table metadata refresh after "LOAD" commands incremental

2018-07-24 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-7330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved IMPALA-7330. - Resolution: Fixed Fix Version/s: Impala 3.1.0 > Make the table metadata refresh after

[jira] [Assigned] (IMPALA-6335) Remove the unnecessary decorator "pytest.mark.execute_serially" from tests which can be run in parallel

2018-07-24 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-6335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon reassigned IMPALA-6335: --- Assignee: Todd Lipcon > Remove the unnecessary decorator "pytest.mark.execute_serially"

[jira] [Commented] (IMPALA-6335) Remove the unnecessary decorator "pytest.mark.execute_serially" from tests which can be run in parallel

2018-07-24 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-6335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16554939#comment-16554939 ] Todd Lipcon commented on IMPALA-6335: - It seems test_strip_leading_comment and test_malformed_query

[jira] [Resolved] (IMPALA-7439) CREATE DATABASE creates a catalog entry with empty location field

2018-08-30 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-7439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved IMPALA-7439. - Resolution: Fixed Fix Version/s: Impala 3.1.0 > CREATE DATABASE creates a catalog entry

[jira] [Created] (IMPALA-7517) Hung scanner when soft memory limit exceeded

2018-08-30 Thread Todd Lipcon (JIRA)
Todd Lipcon created IMPALA-7517: --- Summary: Hung scanner when soft memory limit exceeded Key: IMPALA-7517 URL: https://issues.apache.org/jira/browse/IMPALA-7517 Project: IMPALA Issue Type: Bug

[jira] [Updated] (IMPALA-7517) Hung scanner when soft memory limit exceeded

2018-08-30 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-7517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated IMPALA-7517: Description: As reported on the mailing list, this is a regression due to IMPALA-7096

[jira] [Resolved] (IMPALA-7453) Intern HdfsStorageDescriptors

2018-08-29 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-7453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved IMPALA-7453. - Resolution: Fixed Fix Version/s: Impala 3.1.0 > Intern HdfsStorageDescriptors >

  1   2   3   >