[jira] [Commented] (HIVE-1662) Add file pruning into Hive.

[ https://issues.apache.org/jira/browse/HIVE-1662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13595482#comment-13595482 ] Joydeep Sen Sarma commented on HIVE-1662: - question - Utilities.getInputSummary()

[jira] [Commented] (HIVE-3874) Create a new Optimized Row Columnar file format for Hive

[ https://issues.apache.org/jira/browse/HIVE-3874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13556977#comment-13556977 ] Joydeep Sen Sarma commented on HIVE-3874: - couple of observations: - one use case

[jira] [Commented] (HIVE-3275) Fix autolocal1.q testcase failure when building hive on hadoop0.23 MR2

[ https://issues.apache.org/jira/browse/HIVE-3275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13418029#comment-13418029 ] Joydeep Sen Sarma commented on HIVE-3275: - that sounds like a reasonable approach.

[jira] [Assigned] (HIVE-2125) alter table concatenate fails and deletes data

[ https://issues.apache.org/jira/browse/HIVE-2125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joydeep Sen Sarma reassigned HIVE-2125: --- Assignee: He Yongqiang alter table concatenate fails and deletes data

[jira] [Created] (HIVE-2125) alter table concatenate fails and deletes data

alter table concatenate fails and deletes data -- Key: HIVE-2125 URL: https://issues.apache.org/jira/browse/HIVE-2125 Project: Hive Issue Type: Bug Reporter: Joydeep Sen Sarma

[jira] [Commented] (HIVE-2051) getInputSummary() to call FileSystem.getContentSummary() in parallel

[ https://issues.apache.org/jira/browse/HIVE-2051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13009426#comment-13009426 ] Joydeep Sen Sarma commented on HIVE-2051: - committed - thanks Siying

[jira] [Commented] (HIVE-2052) PostHook and PreHook API to add flag to indicate it is pre or post hook plus cache for content summary

[ https://issues.apache.org/jira/browse/HIVE-2052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13009427#comment-13009427 ] Joydeep Sen Sarma commented on HIVE-2052: - committed - thanks Siying! PostHook

[jira] Commented: (HIVE-2051) getInputSummary() to call FileSystem.getContentSummary() in parallel

[ https://issues.apache.org/jira/browse/HIVE-2051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13008903#comment-13008903 ] Joydeep Sen Sarma commented on HIVE-2051: - based on:

[jira] Commented: (HIVE-2052) PostHook and PreHook API to add flag to indicate it is pre or post hook plus cache for content summary

[ https://issues.apache.org/jira/browse/HIVE-2052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13008238#comment-13008238 ] Joydeep Sen Sarma commented on HIVE-2052: - small nits: -

[jira] Commented: (HIVE-2051) getInputSummary() to call FileSystem.getContentSummary() in parallel

[ https://issues.apache.org/jira/browse/HIVE-2051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13007323#comment-13007323 ] Joydeep Sen Sarma commented on HIVE-2051: - looked at the latest patch from Carl.

[jira] Commented: (HIVE-2037) Merge result file size should honor hive.merge.size.per.task

[ https://issues.apache.org/jira/browse/HIVE-2037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13004802#comment-13004802 ] Joydeep Sen Sarma commented on HIVE-2037: - looks ok - please run the tests and i

[jira] Commented: (HIVE-2037) Merge result file size should honor hive.merge.size.per.task

[ https://issues.apache.org/jira/browse/HIVE-2037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13004866#comment-13004866 ] Joydeep Sen Sarma commented on HIVE-2037: - committed. thanks Ning. Merge result

[jira] Updated: (HIVE-2037) Merge result file size should honor hive.merge.size.per.task

[ https://issues.apache.org/jira/browse/HIVE-2037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joydeep Sen Sarma updated HIVE-2037: Resolution: Fixed Fix Version/s: 0.8.0 Status: Resolved (was: Patch

[jira] Created: (HIVE-2039) remove hadoop version check from hive cli shell script

remove hadoop version check from hive cli shell script -- Key: HIVE-2039 URL: https://issues.apache.org/jira/browse/HIVE-2039 Project: Hive Issue Type: Improvement Components:

[jira] Resolved: (HIVE-2039) remove hadoop version check from hive cli shell script

[ https://issues.apache.org/jira/browse/HIVE-2039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joydeep Sen Sarma resolved HIVE-2039. - Resolution: Invalid never mind. looks like it's already gone and i am looking at old

[jira] Updated: (HIVE-2039) remove hadoop version check from hive cli shell script

[ https://issues.apache.org/jira/browse/HIVE-2039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joydeep Sen Sarma updated HIVE-2039: Attachment: HIVE-2039.1.patch skip hadoop version check via hadoop subcommand if version is

[jira] Updated: (HIVE-2039) remove hadoop version check from hive cli shell script

[ https://issues.apache.org/jira/browse/HIVE-2039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joydeep Sen Sarma updated HIVE-2039: Fix Version/s: 0.8.0 Release Note: hive startup shell script allows bypassing running

[jira] Commented: (HIVE-1833) Task-cleanup task should be disabled

[ https://issues.apache.org/jira/browse/HIVE-1833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13002165#comment-13002165 ] Joydeep Sen Sarma commented on HIVE-1833: - committed - thanks Scott! Task-cleanup

[jira] Resolved: (HIVE-1833) Task-cleanup task should be disabled

[ https://issues.apache.org/jira/browse/HIVE-1833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joydeep Sen Sarma resolved HIVE-1833. - Resolution: Fixed Fix Version/s: 0.8.0 Task-cleanup task should be disabled

[jira] Commented: (HIVE-1833) Task-cleanup task should be disabled

[ https://issues.apache.org/jira/browse/HIVE-1833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13000609#comment-13000609 ] Joydeep Sen Sarma commented on HIVE-1833: - can you also make this change in:

[jira] Created: (HIVE-1968) data corruption with multi-table insert

data corruption with multi-table insert --- Key: HIVE-1968 URL: https://issues.apache.org/jira/browse/HIVE-1968 Project: Hive Issue Type: Bug Components: Query Processor Affects Versions:

[jira] Commented: (HIVE-1852) Reduce unnecessary DFSClient.rename() calls

[ https://issues.apache.org/jira/browse/HIVE-1852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12973883#action_12973883 ] Joydeep Sen Sarma commented on HIVE-1852: - Hive..java:1564 - this should read

[jira] Commented: (HIVE-1852) Reduce unnecessary DFSClient.rename() calls

[ https://issues.apache.org/jira/browse/HIVE-1852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12973353#action_12973353 ] Joydeep Sen Sarma commented on HIVE-1852: - cool - the fsshell removal sounds good

[jira] Resolved: (HIVE-1846) change hive assumption that local mode mappers/reducers always run in same jvm

[ https://issues.apache.org/jira/browse/HIVE-1846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joydeep Sen Sarma resolved HIVE-1846. - Resolution: Fixed committed the new patch. thanks Ram. change hive assumption that

[jira] Commented: (HIVE-1852) Reduce unnecessary DFSClient.rename() calls

[ https://issues.apache.org/jira/browse/HIVE-1852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12971893#action_12971893 ] Joydeep Sen Sarma commented on HIVE-1852: - are u sure this is ok? it seems we have

[jira] Commented: (HIVE-1852) Reduce unnecessary DFSClient.rename() calls

[ https://issues.apache.org/jira/browse/HIVE-1852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12971920#action_12971920 ] Joydeep Sen Sarma commented on HIVE-1852: - old code rename src/item_i to

[jira] Commented: (HIVE-1852) Reduce unnecessary DFSClient.rename() calls

[ https://issues.apache.org/jira/browse/HIVE-1852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12971922#action_12971922 ] Joydeep Sen Sarma commented on HIVE-1852: - u need a test where src is a directory.

[jira] Commented: (HIVE-1852) Reduce unnecessary DFSClient.rename() calls

[ https://issues.apache.org/jira/browse/HIVE-1852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12971926#action_12971926 ] Joydeep Sen Sarma commented on HIVE-1852: - oh - sorry - my previous comment was

[jira] Commented: (HIVE-1852) Reduce unnecessary DFSClient.rename() calls

[ https://issues.apache.org/jira/browse/HIVE-1852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12971991#action_12971991 ] Joydeep Sen Sarma commented on HIVE-1852: - what happens when there are multiple

[jira] Commented: (HIVE-1675) SAXParseException on plan.xml during local mode.

[ https://issues.apache.org/jira/browse/HIVE-1675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12970201#action_12970201 ] Joydeep Sen Sarma commented on HIVE-1675: - the combination of auto local and

[jira] Resolved: (HIVE-1846) change hive assumption that local mode mappers/reducers always run in same jvm

[ https://issues.apache.org/jira/browse/HIVE-1846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joydeep Sen Sarma resolved HIVE-1846. - Resolution: Fixed Fix Version/s: 0.7.0 committed - thanks Ram. change hive

[jira] Updated: (HIVE-1846) change hive assumption that local mode mappers/reducers always run in same jvm

[ https://issues.apache.org/jira/browse/HIVE-1846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joydeep Sen Sarma updated HIVE-1846: Assignee: Ramkumar Vadali (was: Joydeep Sen Sarma) change hive assumption that local mode

[jira] Created: (HIVE-1846) change hive assumption that local mode mappers/reducers always run in same jvm

change hive assumption that local mode mappers/reducers always run in same jvm --- Key: HIVE-1846 URL: https://issues.apache.org/jira/browse/HIVE-1846 Project: Hive

[jira] Commented: (HIVE-1778) simultaneously launched queries collide on hive intermediate directories

[ https://issues.apache.org/jira/browse/HIVE-1778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12968859#action_12968859 ] Joydeep Sen Sarma commented on HIVE-1778: - whatever works - we could pass in hash

[jira] Updated: (HIVE-1776) parallel execution and auto-local mode combine to place plan file in wrong file system

[ https://issues.apache.org/jira/browse/HIVE-1776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joydeep Sen Sarma updated HIVE-1776: Attachment: HIVE-1776.1.patch the problem is that tasks are trying to modify the shared

[jira] Commented: (HIVE-1776) parallel execution and auto-local mode combine to place plan file in wrong file system

[ https://issues.apache.org/jira/browse/HIVE-1776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12930368#action_12930368 ] Joydeep Sen Sarma commented on HIVE-1776: - yeah it was - but shoot - i forgot to

[jira] Created: (HIVE-1776) parallel execution and auto-local mode combine to place plan file in wrong file system

parallel execution and auto-local mode combine to place plan file in wrong file system -- Key: HIVE-1776 URL: https://issues.apache.org/jira/browse/HIVE-1776

[jira] Commented: (HIVE-1721) use bloom filters to improve the performance of joins

[ https://issues.apache.org/jira/browse/HIVE-1721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12927555#action_12927555 ] Joydeep Sen Sarma commented on HIVE-1721: - @Siyin - that's a good question. I don't

[jira] Commented: (HIVE-1721) use bloom filters to improve the performance of map joins

[ https://issues.apache.org/jira/browse/HIVE-1721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12922154#action_12922154 ] Joydeep Sen Sarma commented on HIVE-1721: - i am not so sure about this. consider a