[jira] [Updated] (HIVE-14050) Hive attempts to 'chgrp' files on s3a://

2016-09-30 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HIVE-14050: - Assignee: (was: Chris Nauroth) I'm not actively working on this, so I'm unassigning. > Hive

[jira] [Commented] (HIVE-14050) Hive attempts to 'chgrp' files on s3a://

2016-09-30 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15536067#comment-15536067 ] Chris Nauroth commented on HIVE-14050: -- Linking to HADOOP-13309, which will document the current

[jira] [Commented] (HIVE-14739) Replace runnables directly added to runtime shutdown hooks to avoid deadlock

2016-09-12 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15486315#comment-15486315 ] Chris Nauroth commented on HIVE-14739: -- [~prasanth_j], thank you for the updated patch. +1

[jira] [Commented] (HIVE-14739) Replace runnables directly added to runtime shutdown hooks to avoid deadlock

2016-09-12 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15485485#comment-15485485 ] Chris Nauroth commented on HIVE-14739: -- [~prasanth_j], thank you for sharing this patch. It's

[jira] [Commented] (HIVE-14423) S3: Fetching partition sizes from FS can be expensive when stats are not available in metastore

2016-08-05 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15409639#comment-15409639 ] Chris Nauroth commented on HIVE-14423: -- [~rajesh.balamohan], thank you for patch 2. This looks good

[jira] [Commented] (HIVE-14423) S3: Fetching partition sizes from FS can be expensive when stats are not available in metastore

2016-08-04 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15408281#comment-15408281 ] Chris Nauroth commented on HIVE-14423: -- Hello [~rajesh.balamohan]. Thank you for the patch. This

[jira] [Commented] (HIVE-14270) Write temporary data to HDFS when doing inserts on tables located on S3

2016-07-28 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15397859#comment-15397859 ] Chris Nauroth commented on HIVE-14270: -- Separating development of a richer Hive-on-S3 integration

[jira] [Commented] (HIVE-14270) Write temporary data to HDFS when doing inserts on tables located on S3

2016-07-27 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15396090#comment-15396090 ] Chris Nauroth commented on HIVE-14270: -- Any approach that involves matching on scheme is going to be

[jira] [Commented] (HIVE-14323) Reduce number of FS permissions and redundant FS operations

2016-07-26 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15394202#comment-15394202 ] Chris Nauroth commented on HIVE-14323: -- +1 (non-binding) from me too. Thank you, Rajesh. > Reduce

[jira] [Commented] (HIVE-14323) Reduce number of FS permissions and redundant FS operations

2016-07-25 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15392555#comment-15392555 ] Chris Nauroth commented on HIVE-14323: -- [~rajesh.balamohan], thank you for the patch. Is the change

[jira] [Commented] (HIVE-14271) FileSinkOperator should not rename files to final paths when S3 is the default destination

2016-07-22 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15389835#comment-15389835 ] Chris Nauroth commented on HIVE-14271: -- If I understand correctly, then approach b) sounds like the

[jira] [Commented] (HIVE-14301) insert overwrite fails for nonpartitioned tables in s3

2016-07-21 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15388554#comment-15388554 ] Chris Nauroth commented on HIVE-14301: -- [~ayousufi], thank you for pointing out the issue with rename

[jira] [Commented] (HIVE-13990) Client should not check dfs.namenode.acls.enabled to determine if extended ACLs are supported

2016-07-18 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15382878#comment-15382878 ] Chris Nauroth commented on HIVE-13990: -- [~thejas], is this possibly a duplicate of HIVE-9182? There

[jira] [Commented] (HIVE-13008) WebHcat DDL commands in secure mode NPE when default FileSystem doesn't support delegation tokens

2016-02-05 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15134432#comment-15134432 ] Chris Nauroth commented on HIVE-13008: -- +1 (non-binding), pending pre-commit run. This is the right

[jira] [Commented] (HIVE-9736) StorageBasedAuthProvider should batch namenode-calls where possible.

2015-05-06 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14531961#comment-14531961 ] Chris Nauroth commented on HIVE-9736: - I apologize for missing this in my code review.

[jira] [Commented] (HIVE-9736) StorageBasedAuthProvider should batch namenode-calls where possible.

2015-05-05 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14528724#comment-14528724 ] Chris Nauroth commented on HIVE-9736: - [~sushanth], thank you for your review and the

[jira] [Commented] (HIVE-9736) StorageBasedAuthProvider should batch namenode-calls where possible.

2015-05-04 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14527362#comment-14527362 ] Chris Nauroth commented on HIVE-9736: - Just as a reminder, we were asked to check the

[jira] [Commented] (HIVE-9736) StorageBasedAuthProvider should batch namenode-calls where possible.

2015-05-04 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14527506#comment-14527506 ] Chris Nauroth commented on HIVE-9736: - I verified with both {{-Phadoop-2}} and

[jira] [Commented] (HIVE-9736) StorageBasedAuthProvider should batch namenode-calls where possible.

2015-05-04 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14527348#comment-14527348 ] Chris Nauroth commented on HIVE-9736: - I figured we could make

[jira] [Commented] (HIVE-10151) insert into A select from B is broken when both A and B are Acid tables and bucketed the same way

2015-05-01 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14524506#comment-14524506 ] Chris Nauroth commented on HIVE-10151: -- This patch introduced a call to

[jira] [Updated] (HIVE-10444) HIVE-10223 breaks hadoop-1 build

2015-05-01 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HIVE-10444: - Attachment: HIVE-10444.addendum.3.patch [~prasanth_j], thank you for the commit! bq. Build is

[jira] [Commented] (HIVE-10444) HIVE-10223 breaks hadoop-1 build

2015-04-30 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522333#comment-14522333 ] Chris Nauroth commented on HIVE-10444: -- [~apivovarov], thank you for the review. I

[jira] [Updated] (HIVE-10444) HIVE-10223 breaks hadoop-1 build

2015-04-29 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HIVE-10444: - Assignee: Chris Nauroth (was: Gunther Hagleitner) Sorry for the HIVE-10223 breakage. I'll pick

[jira] [Commented] (HIVE-10066) Hive on Tez job submission through WebHCat doesn't ship Tez artifacts

2015-04-29 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520152#comment-14520152 ] Chris Nauroth commented on HIVE-10066: -- FYI, this patch's call to

[jira] [Updated] (HIVE-10444) HIVE-10223 breaks hadoop-1 build

2015-04-29 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HIVE-10444: - Attachment: HIVE-10444.1.patch I also found one occurrence of the same problem that was not

[jira] [Commented] (HIVE-9736) StorageBasedAuthProvider should batch namenode-calls where possible.

2015-04-29 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520892#comment-14520892 ] Chris Nauroth commented on HIVE-9736: - I have one remaining comment in Review Board

[jira] [Updated] (HIVE-10444) HIVE-10223 breaks hadoop-1 build

2015-04-29 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HIVE-10444: - Attachment: HIVE-10444.2.patch [~apivovarov], thank you for your review. I'm attaching patch v2.

[jira] [Commented] (HIVE-9736) StorageBasedAuthProvider should batch namenode-calls where possible.

2015-04-28 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14518695#comment-14518695 ] Chris Nauroth commented on HIVE-9736: - Hi [~mithun]. Thank you for uploading a new

[jira] [Commented] (HIVE-9736) StorageBasedAuthProvider should batch namenode-calls where possible.

2015-04-13 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14492966#comment-14492966 ] Chris Nauroth commented on HIVE-9736: - Thank you for the rebased patch. It looks great

[jira] [Commented] (HIVE-9182) avoid FileSystem.getAclStatus rpc call for filesystems that don't support acl

2015-04-10 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14490555#comment-14490555 ] Chris Nauroth commented on HIVE-9182: - Is {{setFullFileStatus}} always called in

[jira] [Commented] (HIVE-9736) StorageBasedAuthProvider should batch namenode-calls where possible.

2015-04-08 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14486193#comment-14486193 ] Chris Nauroth commented on HIVE-9736: - Hi [~mithun]. Great ideas in this patch! I'd

[jira] [Commented] (HIVE-10223) Consolidate several redundant FileSystem API calls.

2015-04-07 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14483649#comment-14483649 ] Chris Nauroth commented on HIVE-10223: -- [~hagleitn], thanks for confirming the tests

[jira] [Updated] (HIVE-10223) Consolidate several redundant FileSystem API calls.

2015-04-06 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HIVE-10223: - Attachment: HIVE-10223.1.patch Consolidate several redundant FileSystem API calls.

[jira] [Commented] (HIVE-9182) avoid FileSystem.getAclStatus rpc call for filesystems that don't support acl

2015-03-02 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14344206#comment-14344206 ] Chris Nauroth commented on HIVE-9182: - Hi [~ashettia] and [~thejas]. Do you think