[jira] [Commented] (IMPALA-9782) KuduPartitionExpr is not thread-safe

2020-06-02 Thread Todd Lipcon (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-9782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124304#comment-17124304 ] Todd Lipcon commented on IMPALA-9782: - I seem to recall that Impala code has some faciltiies for

[jira] [Commented] (IMPALA-3189) Address scalability issue with N^2 KDC requests on cluster startup

2019-12-06 Thread Todd Lipcon (Jira)
[ https://issues.apache.org/jira/browse/IMPALA-3189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16990091#comment-16990091 ] Todd Lipcon commented on IMPALA-3189: - This should be largely better with KRPC since we maintain

[jira] [Commented] (IMPALA-8739) FileMetadataLoader skips empty directories

2019-07-08 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-8739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16880769#comment-16880769 ] Todd Lipcon commented on IMPALA-8739: - [~gopalv] how does Hive handle this case? The presence of an

[jira] [Resolved] (IMPALA-8681) null ValidWriteIdLists written into profile

2019-07-08 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-8681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved IMPALA-8681. - Resolution: Fixed Fix Version/s: Impala 3.3.0 > null ValidWriteIdLists written into

[jira] [Resolved] (IMPALA-8681) null ValidWriteIdLists written into profile

2019-07-08 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-8681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved IMPALA-8681. - Resolution: Fixed Fix Version/s: Impala 3.3.0 > null ValidWriteIdLists written into

[jira] [Commented] (IMPALA-7539) Support HDFS permissions checks with LocalCatalog

2019-07-01 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-7539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16876527#comment-16876527 ] Todd Lipcon commented on IMPALA-7539: - One consideration about this: this is actually a big

[jira] [Resolved] (IMPALA-7438) Automated test for concurrent DDL and metadata queries

2019-07-01 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-7438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved IMPALA-7438. - Resolution: Fixed Fix Version/s: Impala 3.1.0 > Automated test for concurrent DDL and

[jira] [Commented] (IMPALA-7438) Automated test for concurrent DDL and metadata queries

2019-07-01 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-7438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16876523#comment-16876523 ] Todd Lipcon commented on IMPALA-7438: - I think this is more or less covered by

[jira] [Resolved] (IMPALA-7438) Automated test for concurrent DDL and metadata queries

2019-07-01 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-7438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved IMPALA-7438. - Resolution: Fixed Fix Version/s: Impala 3.1.0 > Automated test for concurrent DDL and

[jira] [Commented] (IMPALA-8685) Evaluate default configuration of NUM_REMOTE_EXECUTOR_CANDIDATES

2019-06-21 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-8685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16869735#comment-16869735 ] Todd Lipcon commented on IMPALA-8685: - If we set it to 1 and it does cause scheduling skew, is there

[jira] [Assigned] (IMPALA-8681) null ValidWriteIdLists written into profile

2019-06-21 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-8681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon reassigned IMPALA-8681: --- Assignee: Yongzhi Chen Hey Yongzhi, mind taking a look? > null ValidWriteIdLists written

[jira] [Resolved] (IMPALA-8667) Remove --pull_incremental_statistics flag (on by default)

2019-06-21 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-8667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved IMPALA-8667. - Resolution: Fixed Fix Version/s: Impala 3.3.0 > Remove --pull_incremental_statistics

[jira] [Resolved] (IMPALA-8667) Remove --pull_incremental_statistics flag (on by default)

2019-06-21 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-8667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved IMPALA-8667. - Resolution: Fixed Fix Version/s: Impala 3.3.0 > Remove --pull_incremental_statistics

[jira] [Assigned] (IMPALA-8606) GET_TABLES performance in local catalog mode

2019-06-20 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-8606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon reassigned IMPALA-8606: --- Assignee: (was: Todd Lipcon) > GET_TABLES performance in local catalog mode >

[jira] [Updated] (IMPALA-8606) GET_TABLES performance in local catalog mode

2019-06-20 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-8606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated IMPALA-8606: Priority: Blocker (was: Critical) > GET_TABLES performance in local catalog mode >

[jira] [Updated] (IMPALA-7935) /catalog_object end point broken in LocalCatalog mode

2019-06-20 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-7935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated IMPALA-7935: Priority: Minor (was: Major) > /catalog_object end point broken in LocalCatalog mode >

[jira] [Resolved] (IMPALA-8567) Many random catalog consistency issues with catalog v2/event processor

2019-06-20 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-8567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved IMPALA-8567. - Resolution: Fixed Fix Version/s: Impala 3.3.0 Think this should be fixed now > Many

[jira] [Resolved] (IMPALA-7534) Handle invalidation races in CatalogdMetaProvider cache

2019-06-20 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-7534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved IMPALA-7534. - Resolution: Fixed > Handle invalidation races in CatalogdMetaProvider cache >

[jira] [Resolved] (IMPALA-8567) Many random catalog consistency issues with catalog v2/event processor

2019-06-20 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-8567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved IMPALA-8567. - Resolution: Fixed Fix Version/s: Impala 3.3.0 Think this should be fixed now > Many

[jira] [Resolved] (IMPALA-7534) Handle invalidation races in CatalogdMetaProvider cache

2019-06-20 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-7534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved IMPALA-7534. - Resolution: Fixed > Handle invalidation races in CatalogdMetaProvider cache >

[jira] [Created] (IMPALA-8681) null ValidWriteIdLists written into profile

2019-06-19 Thread Todd Lipcon (JIRA)
Todd Lipcon created IMPALA-8681: --- Summary: null ValidWriteIdLists written into profile Key: IMPALA-8681 URL: https://issues.apache.org/jira/browse/IMPALA-8681 Project: IMPALA Issue Type: Bug

[jira] [Created] (IMPALA-8681) null ValidWriteIdLists written into profile

2019-06-19 Thread Todd Lipcon (JIRA)
Todd Lipcon created IMPALA-8681: --- Summary: null ValidWriteIdLists written into profile Key: IMPALA-8681 URL: https://issues.apache.org/jira/browse/IMPALA-8681 Project: IMPALA Issue Type: Bug

[jira] [Commented] (IMPALA-7615) Partition metadata mismatch should be handled gracefully in local catalog mode.

2019-06-18 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-7615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16867118#comment-16867118 ] Todd Lipcon commented on IMPALA-7615: - How can this happen? It seems like the request to load the

[jira] [Resolved] (IMPALA-8455) GET_TABLE failed with InvalidStorageDescriptorException

2019-06-18 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-8455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved IMPALA-8455. - Resolution: Fixed Assignee: bharath v Fix Version/s: Impala 3.3.0 > GET_TABLE

[jira] [Created] (IMPALA-8675) Remove db/table count metrics from impalad in LocalCatalog mode

2019-06-18 Thread Todd Lipcon (JIRA)
Todd Lipcon created IMPALA-8675: --- Summary: Remove db/table count metrics from impalad in LocalCatalog mode Key: IMPALA-8675 URL: https://issues.apache.org/jira/browse/IMPALA-8675 Project: IMPALA

[jira] [Created] (IMPALA-8675) Remove db/table count metrics from impalad in LocalCatalog mode

2019-06-18 Thread Todd Lipcon (JIRA)
Todd Lipcon created IMPALA-8675: --- Summary: Remove db/table count metrics from impalad in LocalCatalog mode Key: IMPALA-8675 URL: https://issues.apache.org/jira/browse/IMPALA-8675 Project: IMPALA

[jira] [Work stopped] (IMPALA-8631) Ensure that cached data is always up to date to avoid reads based on stale metadata for transactional read only tables

2019-06-18 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-8631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on IMPALA-8631 stopped by Todd Lipcon. --- > Ensure that cached data is always up to date to avoid reads based on stale >

[jira] [Work started] (IMPALA-8667) Remove --pull_incremental_statistics flag (on by default)

2019-06-18 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-8667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on IMPALA-8667 started by Todd Lipcon. --- > Remove --pull_incremental_statistics flag (on by default) >

[jira] [Work started] (IMPALA-8567) Many random catalog consistency issues with catalog v2/event processor

2019-06-18 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-8567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on IMPALA-8567 started by Todd Lipcon. --- > Many random catalog consistency issues with catalog v2/event processor >

[jira] [Work started] (IMPALA-7534) Handle invalidation races in CatalogdMetaProvider cache

2019-06-18 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-7534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on IMPALA-7534 started by Todd Lipcon. --- > Handle invalidation races in CatalogdMetaProvider cache >

[jira] [Assigned] (IMPALA-8667) Remove --pull_incremental_statistics flag (on by default)

2019-06-18 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-8667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon reassigned IMPALA-8667: --- Assignee: Todd Lipcon > Remove --pull_incremental_statistics flag (on by default) >

[jira] [Assigned] (IMPALA-7506) Support global INVALIDATE METADATA on fetch-on-demand impalad

2019-06-18 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-7506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon reassigned IMPALA-7506: --- Assignee: Todd Lipcon (was: Vuk Ercegovac) > Support global INVALIDATE METADATA on

[jira] [Commented] (IMPALA-6876) Entries in CatalogUsageMonitor are not cleared after invalidation

2019-06-18 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-6876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16866898#comment-16866898 ] Todd Lipcon commented on IMPALA-6876: - Looked at this a few minutes today. There are a few more

[jira] [Resolved] (IMPALA-8459) Cannot delete impala/kudu table if backing kudu table dropped with local catalog

2019-06-18 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-8459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved IMPALA-8459. - Resolution: Fixed Fix Version/s: Impala 3.3.0 > Cannot delete impala/kudu table if

[jira] [Resolved] (IMPALA-8459) Cannot delete impala/kudu table if backing kudu table dropped with local catalog

2019-06-18 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-8459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved IMPALA-8459. - Resolution: Fixed Fix Version/s: Impala 3.3.0 > Cannot delete impala/kudu table if

[jira] [Resolved] (IMPALA-8542) Access trace collection for data cache

2019-06-18 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-8542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved IMPALA-8542. - Resolution: Fixed Fix Version/s: Impala 3.3.0 > Access trace collection for data cache >

[jira] [Resolved] (IMPALA-8542) Access trace collection for data cache

2019-06-18 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-8542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved IMPALA-8542. - Resolution: Fixed Fix Version/s: Impala 3.3.0 > Access trace collection for data cache >

[jira] [Assigned] (IMPALA-8567) Many random catalog consistency issues with catalog v2/event processor

2019-06-17 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-8567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon reassigned IMPALA-8567: --- Assignee: Todd Lipcon (was: Vihang Karajgaonkar) > Many random catalog consistency issues

[jira] [Commented] (IMPALA-7534) Handle invalidation races in CatalogdMetaProvider cache

2019-06-17 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-7534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16866066#comment-16866066 ] Todd Lipcon commented on IMPALA-7534: - Reading back over Paul's analysis here, I think the missing

[jira] [Reopened] (IMPALA-7534) Handle invalidation races in CatalogdMetaProvider cache

2019-06-17 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-7534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon reopened IMPALA-7534: - Assignee: Todd Lipcon (was: Paul Rogers) I think the analysis here wasn't quite right and

[jira] [Assigned] (IMPALA-8489) TestRecoverPartitions.test_post_invalidate fails with IllegalStateException when HMS polling is enabled

2019-06-14 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-8489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon reassigned IMPALA-8489: --- Assignee: Vihang Karajgaonkar (was: Todd Lipcon) I think Vihang was going to look at

[jira] [Resolved] (IMPALA-2649) improve incremental stats scalability

2019-06-14 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-2649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved IMPALA-2649. - Resolution: Fixed I'm inclined to call this one fixed after a number of changes last year: -

[jira] [Resolved] (IMPALA-2649) improve incremental stats scalability

2019-06-14 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-2649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved IMPALA-2649. - Resolution: Fixed I'm inclined to call this one fixed after a number of changes last year: -

[jira] [Resolved] (IMPALA-8514) CatalogException: Error initializing Catalog

2019-06-14 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-8514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved IMPALA-8514. - Resolution: Not A Bug Please direct questions to the Impala user mailing list >

[jira] [Resolved] (IMPALA-8514) CatalogException: Error initializing Catalog

2019-06-14 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-8514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved IMPALA-8514. - Resolution: Not A Bug Please direct questions to the Impala user mailing list >

[jira] [Assigned] (IMPALA-6536) CREATE TABLE on S3 takes a very long time

2019-06-14 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-6536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon reassigned IMPALA-6536: --- Assignee: (was: Todd Lipcon) > CREATE TABLE on S3 takes a very long time >

[jira] [Resolved] (IMPALA-8282) Impala Catalog 'Failed to load metadata for table' and 'GC overhead limit exceeded'

2019-06-14 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-8282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved IMPALA-8282. - Resolution: Invalid Please use the mailing list for questions like this. > Impala Catalog

[jira] [Resolved] (IMPALA-8282) Impala Catalog 'Failed to load metadata for table' and 'GC overhead limit exceeded'

2019-06-14 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-8282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved IMPALA-8282. - Resolution: Invalid Please use the mailing list for questions like this. > Impala Catalog

[jira] [Commented] (IMPALA-8630) Consistent remote placement should include partition information when calculating placement

2019-06-14 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-8630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16864358#comment-16864358 ] Todd Lipcon commented on IMPALA-8630: - bq. It would be nice to avoid reconstructing the path and

[jira] [Created] (IMPALA-8667) Remove --pull_incremental_statistics flag (on by default)

2019-06-14 Thread Todd Lipcon (JIRA)
Todd Lipcon created IMPALA-8667: --- Summary: Remove --pull_incremental_statistics flag (on by default) Key: IMPALA-8667 URL: https://issues.apache.org/jira/browse/IMPALA-8667 Project: IMPALA

[jira] [Created] (IMPALA-8667) Remove --pull_incremental_statistics flag (on by default)

2019-06-14 Thread Todd Lipcon (JIRA)
Todd Lipcon created IMPALA-8667: --- Summary: Remove --pull_incremental_statistics flag (on by default) Key: IMPALA-8667 URL: https://issues.apache.org/jira/browse/IMPALA-8667 Project: IMPALA

[jira] [Commented] (IMPALA-8661) Create randomized tests for stressing the event processor

2019-06-13 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-8661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16863411#comment-16863411 ] Todd Lipcon commented on IMPALA-8661: - I think I would lean towards actually issuing Hive queries to

[jira] [Created] (IMPALA-8653) Detect Kudu integration status based on HMS UUID instead of URIs

2019-06-11 Thread Todd Lipcon (JIRA)
Todd Lipcon created IMPALA-8653: --- Summary: Detect Kudu integration status based on HMS UUID instead of URIs Key: IMPALA-8653 URL: https://issues.apache.org/jira/browse/IMPALA-8653 Project: IMPALA

[jira] [Created] (IMPALA-8653) Detect Kudu integration status based on HMS UUID instead of URIs

2019-06-11 Thread Todd Lipcon (JIRA)
Todd Lipcon created IMPALA-8653: --- Summary: Detect Kudu integration status based on HMS UUID instead of URIs Key: IMPALA-8653 URL: https://issues.apache.org/jira/browse/IMPALA-8653 Project: IMPALA

[jira] [Resolved] (IMPALA-8635) Kudu HMS integration check should not fetch metastore URIs configuration from metastore

2019-06-10 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-8635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved IMPALA-8635. - Resolution: Fixed Fix Version/s: Impala 3.3.0 > Kudu HMS integration check should not

[jira] [Resolved] (IMPALA-8635) Kudu HMS integration check should not fetch metastore URIs configuration from metastore

2019-06-10 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-8635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved IMPALA-8635. - Resolution: Fixed Fix Version/s: Impala 3.3.0 > Kudu HMS integration check should not

[jira] [Work started] (IMPALA-8459) Cannot delete impala/kudu table if backing kudu table dropped with local catalog

2019-06-07 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-8459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on IMPALA-8459 started by Todd Lipcon. --- > Cannot delete impala/kudu table if backing kudu table dropped with local >

[jira] [Commented] (IMPALA-8606) GET_TABLES performance in local catalog mode

2019-06-07 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-8606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16858405#comment-16858405 ] Todd Lipcon commented on IMPALA-8606: - Seems we need to add some interface like

[jira] [Assigned] (IMPALA-8606) GET_TABLES performance in local catalog mode

2019-06-07 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-8606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon reassigned IMPALA-8606: --- Assignee: Todd Lipcon > GET_TABLES performance in local catalog mode >

[jira] [Created] (IMPALA-8635) Kudu HMS integration check should not fetch metastore URIs configuration from metastore

2019-06-07 Thread Todd Lipcon (JIRA)
Todd Lipcon created IMPALA-8635: --- Summary: Kudu HMS integration check should not fetch metastore URIs configuration from metastore Key: IMPALA-8635 URL: https://issues.apache.org/jira/browse/IMPALA-8635

[jira] [Created] (IMPALA-8635) Kudu HMS integration check should not fetch metastore URIs configuration from metastore

2019-06-07 Thread Todd Lipcon (JIRA)
Todd Lipcon created IMPALA-8635: --- Summary: Kudu HMS integration check should not fetch metastore URIs configuration from metastore Key: IMPALA-8635 URL: https://issues.apache.org/jira/browse/IMPALA-8635

[jira] [Commented] (IMPALA-8459) Cannot delete impala/kudu table if backing kudu table dropped with local catalog

2019-05-31 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-8459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16853445#comment-16853445 ] Todd Lipcon commented on IMPALA-8459: - One possibility for a workaround: could you alter the storage

[jira] [Updated] (IMPALA-8489) TestRecoverPartitions.test_post_invalidate fails with IllegalStateException when HMS polling is enabled

2019-05-29 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-8489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated IMPALA-8489: Summary: TestRecoverPartitions.test_post_invalidate fails with IllegalStateException when HMS

[jira] [Commented] (IMPALA-8489) TestRecoverPartitions.test_post_invalidate fails with IllegalStateException with local catalog

2019-05-29 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-8489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16851376#comment-16851376 ] Todd Lipcon commented on IMPALA-8489: - Ah, it seems this is due to --hms_event_polling_interval_s=1

[jira] [Commented] (IMPALA-8594) Support drop table for external kudu tables that are dropped in kudu

2019-05-29 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-8594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16851017#comment-16851017 ] Todd Lipcon commented on IMPALA-8594: - Did you hit this with LocalCatalog enabled or without?

[jira] [Resolved] (IMPALA-8383) Bump toolchain version

2019-05-28 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-8383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved IMPALA-8383. - Resolution: Won't Fix > Bump toolchain version > -- > >

[jira] [Resolved] (IMPALA-8458) Can't set numNull/maxSize/avgSize column stats with local catalog without also setting NDV

2019-05-22 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-8458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved IMPALA-8458. - Resolution: Fixed Fix Version/s: Impala 3.3.0 > Can't set numNull/maxSize/avgSize column

[jira] [Resolved] (IMPALA-8458) Can't set numNull/maxSize/avgSize column stats with local catalog without also setting NDV

2019-05-22 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-8458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved IMPALA-8458. - Resolution: Fixed Fix Version/s: Impala 3.3.0 > Can't set numNull/maxSize/avgSize column

[jira] [Resolved] (IMPALA-8215) Don't set numTrue = 1

2019-05-22 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-8215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved IMPALA-8215. - Resolution: Fixed Assignee: Todd Lipcon (was: wuchang) Fix Version/s: Impala

[jira] [Created] (IMPALA-8569) Periodically scrub deleted files from the file handle cache

2019-05-21 Thread Todd Lipcon (JIRA)
Todd Lipcon created IMPALA-8569: --- Summary: Periodically scrub deleted files from the file handle cache Key: IMPALA-8569 URL: https://issues.apache.org/jira/browse/IMPALA-8569 Project: IMPALA

[jira] [Created] (IMPALA-8569) Periodically scrub deleted files from the file handle cache

2019-05-21 Thread Todd Lipcon (JIRA)
Todd Lipcon created IMPALA-8569: --- Summary: Periodically scrub deleted files from the file handle cache Key: IMPALA-8569 URL: https://issues.apache.org/jira/browse/IMPALA-8569 Project: IMPALA

[jira] [Commented] (IMPALA-8544) Expose additional S3A / S3Guard metrics

2019-05-21 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-8544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16845479#comment-16845479 ] Todd Lipcon commented on IMPALA-8544: - I think the problem with using the global metrics is that

[jira] [Resolved] (IMPALA-8566) COMPUTE INCREMENTAL STATS sets num_nulls off-by-one

2019-05-21 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-8566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved IMPALA-8566. - Resolution: Fixed Fix Version/s: Impala 3.3.0 > COMPUTE INCREMENTAL STATS sets num_nulls

[jira] [Resolved] (IMPALA-8566) COMPUTE INCREMENTAL STATS sets num_nulls off-by-one

2019-05-21 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-8566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved IMPALA-8566. - Resolution: Fixed Fix Version/s: Impala 3.3.0 > COMPUTE INCREMENTAL STATS sets num_nulls

[jira] [Updated] (IMPALA-6876) Entries in CatalogUsageMonitor are not cleared after invalidation

2019-05-21 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-6876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated IMPALA-6876: Labels: memory-leak ramp-up (was: memory-leak) > Entries in CatalogUsageMonitor are not cleared

[jira] [Commented] (IMPALA-6876) Entries in CatalogUsageMonitor are not cleared after invalidation

2019-05-21 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-6876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16844538#comment-16844538 ] Todd Lipcon commented on IMPALA-6876: - Seems like the simplest fix here would be to use weak

[jira] [Commented] (IMPALA-8383) Bump toolchain version

2019-05-21 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-8383?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16844536#comment-16844536 ] Todd Lipcon commented on IMPALA-8383: - [~hacosta] is this still an issue? Seems it's been bumped

[jira] [Resolved] (IMPALA-8529) ccache is ignored when using ninja generator

2019-05-21 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-8529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved IMPALA-8529. - Resolution: Fixed Fix Version/s: Impala 3.3.0 Seems this works now after we upgraded to

[jira] [Resolved] (IMPALA-8529) ccache is ignored when using ninja generator

2019-05-21 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-8529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved IMPALA-8529. - Resolution: Fixed Fix Version/s: Impala 3.3.0 Seems this works now after we upgraded to

[jira] [Commented] (IMPALA-7799) Store periodic snapshots of Impalad metrics

2019-05-20 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-7799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16844526#comment-16844526 ] Todd Lipcon commented on IMPALA-7799: - Before reinventing this wheel please take a look at

[jira] [Commented] (IMPALA-8544) Expose additional S3A / S3Guard metrics

2019-05-20 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-8544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16844525#comment-16844525 ] Todd Lipcon commented on IMPALA-8544: - [~mackrorysd] is there any way we could enhance these stats

[jira] [Commented] (IMPALA-8566) COMPUTE INCREMENTAL STATS sets num_nulls off-by-one

2019-05-20 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-8566?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16844274#comment-16844274 ] Todd Lipcon commented on IMPALA-8566: - The issue is the intialization of PerColumnStats here:

[jira] [Updated] (IMPALA-8566) COMPUTE INCREMENTAL STATS sets num_nulls off-by-one

2019-05-20 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-8566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon updated IMPALA-8566: Description: IMPALA-7659 added the population of NULL counts while computing stats, but this

[jira] [Created] (IMPALA-8566) COMPUTE INCREMENTAL STATS does not set num_nulls

2019-05-20 Thread Todd Lipcon (JIRA)
Todd Lipcon created IMPALA-8566: --- Summary: COMPUTE INCREMENTAL STATS does not set num_nulls Key: IMPALA-8566 URL: https://issues.apache.org/jira/browse/IMPALA-8566 Project: IMPALA Issue Type:

[jira] [Created] (IMPALA-8566) COMPUTE INCREMENTAL STATS does not set num_nulls

2019-05-20 Thread Todd Lipcon (JIRA)
Todd Lipcon created IMPALA-8566: --- Summary: COMPUTE INCREMENTAL STATS does not set num_nulls Key: IMPALA-8566 URL: https://issues.apache.org/jira/browse/IMPALA-8566 Project: IMPALA Issue Type:

[jira] [Comment Edited] (IMPALA-8458) Can't set numNull/maxSize/avgSize column stats with local catalog without also setting NDV

2019-05-20 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-8458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16844229#comment-16844229 ] Todd Lipcon edited comment on IMPALA-8458 at 5/20/19 7:21 PM: -- I paged this

[jira] [Commented] (IMPALA-8458) Can't set numNull/maxSize/avgSize column stats with local catalog without also setting NDV

2019-05-20 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-8458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16844229#comment-16844229 ] Todd Lipcon commented on IMPALA-8458: - I paged this code back into my head and remember why we had

[jira] [Assigned] (IMPALA-7131) Support external data sources without catalogd

2019-05-20 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-7131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon reassigned IMPALA-7131: --- Assignee: (was: Todd Lipcon) Not actively working on this. This seems like a very

[jira] [Resolved] (IMPALA-8438) List valid writeIds for a ACID table

2019-05-20 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-8438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved IMPALA-8438. - Resolution: Fixed Fix Version/s: Impala 3.3.0 > List valid writeIds for a ACID table >

[jira] [Resolved] (IMPALA-8438) List valid writeIds for a ACID table

2019-05-20 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-8438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved IMPALA-8438. - Resolution: Fixed Fix Version/s: Impala 3.3.0 > List valid writeIds for a ACID table >

[jira] [Assigned] (IMPALA-7957) UNION ALL query returns incorrect results

2019-05-20 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-7957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon reassigned IMPALA-7957: --- Assignee: Quanlong Huang (was: Paul Rogers) > UNION ALL query returns incorrect results >

[jira] [Commented] (IMPALA-8562) Data cache should skip scan range with mtime == -1

2019-05-17 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-8562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16842400#comment-16842400 ] Todd Lipcon commented on IMPALA-8562: - Perhaps we should add a CHECK_GE(mtime, 0) to try to prevent

[jira] [Commented] (IMPALA-8489) TestRecoverPartitions.test_post_invalidate fails with IllegalStateException with local catalog

2019-05-15 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-8489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16840713#comment-16840713 ] Todd Lipcon commented on IMPALA-8489: - I'm having trouble reproducing this. Was this flaky for you?

[jira] [Commented] (IMPALA-8533) Impala daemon crash on sort

2019-05-15 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-8533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16840659#comment-16840659 ] Todd Lipcon commented on IMPALA-8533: - Interestingly, a UNION ALL with all constants produces a

[jira] [Commented] (IMPALA-8533) Impala daemon crash on sort

2019-05-15 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-8533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16840648#comment-16840648 ] Todd Lipcon commented on IMPALA-8533: - The problem here seems to be that the sorter is getting

[jira] [Commented] (IMPALA-8533) Impala daemon crash on sort

2019-05-15 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-8533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16840646#comment-16840646 ] Todd Lipcon commented on IMPALA-8533: - A bit more minimized crasher: ```WITH base_10 AS ( SELECT

[jira] [Assigned] (IMPALA-8533) Impala daemon crash on sort

2019-05-15 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-8533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon reassigned IMPALA-8533: --- Assignee: Todd Lipcon > Impala daemon crash on sort > --- > >

[jira] [Created] (IMPALA-8551) GRANT gives confusing error message

2019-05-15 Thread Todd Lipcon (JIRA)
Todd Lipcon created IMPALA-8551: --- Summary: GRANT gives confusing error message Key: IMPALA-8551 URL: https://issues.apache.org/jira/browse/IMPALA-8551 Project: IMPALA Issue Type: Bug

[jira] [Created] (IMPALA-8551) GRANT gives confusing error message

2019-05-15 Thread Todd Lipcon (JIRA)
Todd Lipcon created IMPALA-8551: --- Summary: GRANT gives confusing error message Key: IMPALA-8551 URL: https://issues.apache.org/jira/browse/IMPALA-8551 Project: IMPALA Issue Type: Bug

[jira] [Resolved] (IMPALA-2029) Impala in CDH 5.2.0 fails to compile with hadoop 2.7

2019-05-13 Thread Todd Lipcon (JIRA)
[ https://issues.apache.org/jira/browse/IMPALA-2029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved IMPALA-2029. - Resolution: Fixed Fix Version/s: Impala 3.3.0 > Impala in CDH 5.2.0 fails to compile

  1   2   3   4   >