[jira] [Commented] (HIVE-15546) Optimize Utilities.getInputPaths() so each listStatus of a partition is done in parallel

2017-01-24 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15836769#comment-15836769 ] Sahil Takiar commented on HIVE-15546: - [~spena] can this be merged? > Optimize

[jira] [Updated] (HIVE-16003) Blobstores should use fs.listFiles(path, recursive=true) rather than FileUtils.listStatusRecursively

2017-02-21 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-16003: Description: {{FileUtils.listStatusRecursively}} can be slow on blobstores because {{listStatus}}

[jira] [Assigned] (HIVE-16003) Blobstores should use fs.listFiles(path, recursive=true) rather than FileUtils.listStatusRecursively

2017-02-21 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar reassigned HIVE-16003: --- > Blobstores should use fs.listFiles(path, recursive=true) rather than >

[jira] [Commented] (HIVE-15867) Add blobstore tests for import/export

2017-02-21 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15876650#comment-15876650 ] Sahil Takiar commented on HIVE-15867: - [~poeppt] is this still on your radar? If not I'm happy to help

[jira] [Updated] (HIVE-15948) Failing test: TestCliDriver, TestSparkCliDriver join31

2017-02-20 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-15948: Attachment: HIVE-15948.txt > Failing test: TestCliDriver, TestSparkCliDriver join31 >

[jira] [Assigned] (HIVE-15948) Failing test: TestCliDriver, TestSparkCliDriver join31

2017-02-20 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar reassigned HIVE-15948: --- Assignee: Sahil Takiar > Failing test: TestCliDriver, TestSparkCliDriver join31 >

[jira] [Updated] (HIVE-15948) Failing test: TestCliDriver, TestSparkCliDriver join31

2017-02-20 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-15948: Status: Patch Available (was: Open) > Failing test: TestCliDriver, TestSparkCliDriver join31 >

[jira] [Commented] (HIVE-15948) Failing test: TestCliDriver, TestSparkCliDriver join31

2017-02-20 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15875199#comment-15875199 ] Sahil Takiar commented on HIVE-15948: - [~thejas], [~ashutoshc] could you review? Quick fix, just

[jira] [Updated] (HIVE-15948) Failing test: TestCliDriver, TestSparkCliDriver join31

2017-02-20 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-15948: Attachment: HIVE-15948.1.txt > Failing test: TestCliDriver, TestSparkCliDriver join31 >

[jira] [Commented] (HIVE-15948) Failing test: TestCliDriver, TestSparkCliDriver join31

2017-02-20 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15875314#comment-15875314 ] Sahil Takiar commented on HIVE-15948: - [~lirui] yes good point. I have posted an update patch. I

[jira] [Commented] (HIVE-15856) Hive export/import (hive.exim.uri.scheme.whitelist) to support s3a

2017-02-17 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15872039#comment-15872039 ] Sahil Takiar commented on HIVE-15856: - [~jzhuge] yes I can {{adl}} to the whitelist, can you help in

[jira] [Commented] (HIVE-15882) HS2 generating high memory pressure with many partitions and concurrent queries

2017-02-23 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881203#comment-15881203 ] Sahil Takiar commented on HIVE-15882: - [~mi...@cloudera.com] you mentioned this earlier, but it would

[jira] [Commented] (HIVE-16014) HiveMetastoreChecker should use hive.metastore.fshandler.threads instead of hive.mv.files.thread for pool size

2017-02-23 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881182#comment-15881182 ] Sahil Takiar commented on HIVE-16014: - [~vihangk1] - the config METASTORE_FS_HANDLER_THREADS_COUNT

[jira] [Updated] (HIVE-14864) Distcp is not called from MoveTask when src is a directory

2017-02-24 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-14864: Attachment: HIVE-14864.3.patch [~spena] comments addressed, rebased the patch. While writes to S3

[jira] [Commented] (HIVE-16014) HiveMetastoreChecker should use hive.metastore.fshandler.threads instead of hive.mv.files.thread for pool size

2017-02-23 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15881002#comment-15881002 ] Sahil Takiar commented on HIVE-16014: - [~vihangk1] slightly orthogonal comment. Why do we need to list

[jira] [Assigned] (HIVE-15991) Flaky Test: TestEncryptedHDFSCliDriver encryption_join_with_different_encryption_keys

2017-02-21 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar reassigned HIVE-15991: --- Assignee: Sahil Takiar > Flaky Test: TestEncryptedHDFSCliDriver >

[jira] [Commented] (HIVE-15867) Add blobstore tests for import/export

2017-02-21 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15876820#comment-15876820 ] Sahil Takiar commented on HIVE-15867: - No worries, just checking in, thanks for the update! > Add

[jira] [Updated] (HIVE-15991) Flaky Test: TestEncryptedHDFSCliDriver encryption_join_with_different_encryption_keys

2017-02-21 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-15991: Attachment: HIVE-15991.txt > Flaky Test: TestEncryptedHDFSCliDriver >

[jira] [Updated] (HIVE-15991) Flaky Test: TestEncryptedHDFSCliDriver encryption_join_with_different_encryption_keys

2017-02-21 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-15991: Description: I ran a git-bisect and seems HIVE-15703 started causing this failure. Not entirely

[jira] [Commented] (HIVE-15991) Flaky Test: TestEncryptedHDFSCliDriver encryption_join_with_different_encryption_keys

2017-02-22 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15879816#comment-15879816 ] Sahil Takiar commented on HIVE-15991: - [~pxiong] yeah I had some trouble with this test. Try running

[jira] [Commented] (HIVE-15856) Hive export/import (hive.exim.uri.scheme.whitelist) to support s3a

2017-02-09 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15860153#comment-15860153 ] Sahil Takiar commented on HIVE-15856: - [~zyork] it seems that HIVE-13463 fixes issues when trying to

[jira] [Comment Edited] (HIVE-15856) Hive export/import (hive.exim.uri.scheme.whitelist) to support s3a

2017-02-09 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15860153#comment-15860153 ] Sahil Takiar edited comment on HIVE-15856 at 2/9/17 8:36 PM: - [~zyork] it

[jira] [Commented] (HIVE-15856) Hive export/import (hive.exim.uri.scheme.whitelist) to support s3a

2017-02-09 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15860197#comment-15860197 ] Sahil Takiar commented on HIVE-15856: - Yes, add them by default, and add qtests for them to the

[jira] [Commented] (HIVE-15856) Hive export/import (hive.exim.uri.scheme.whitelist) to support s3a

2017-02-09 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15860388#comment-15860388 ] Sahil Takiar commented on HIVE-15856: - Hey [~poeppt], sounds good. I haven't done much for writing the

[jira] [Commented] (HIVE-15881) Use new thread count variable name instead of mapred.dfsclient.parallelism.max

2017-02-10 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15862099#comment-15862099 ] Sahil Takiar commented on HIVE-15881: - As far as I can tell, this config *is only used by Hive* across

[jira] [Commented] (HIVE-15546) Optimize Utilities.getInputPaths() so each listStatus of a partition is done in parallel

2017-01-18 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15829006#comment-15829006 ] Sahil Takiar commented on HIVE-15546: - According to the code, dummy files are added to empty

[jira] [Updated] (HIVE-15546) Optimize Utilities.getInputPaths() so each listStatus of a partition is done in parallel

2017-01-18 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-15546: Attachment: HIVE-15546.5.patch > Optimize Utilities.getInputPaths() so each listStatus of a

[jira] [Updated] (HIVE-15546) Optimize Utilities.getInputPaths() so each listStatus of a partition is done in parallel

2017-01-17 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-15546: Attachment: HIVE-15546.4.patch > Optimize Utilities.getInputPaths() so each listStatus of a

[jira] [Commented] (HIVE-15546) Optimize Utilities.getInputPaths() so each listStatus of a partition is done in parallel

2017-01-17 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15827365#comment-15827365 ] Sahil Takiar commented on HIVE-15546: - Thanks [~sershe] I'll take a look into those classes. [~spena]

[jira] [Commented] (HIVE-16024) MSCK Repair Requires nonstrict hive.mapred.mode

2017-02-28 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15888596#comment-15888596 ] Sahil Takiar commented on HIVE-16024: - We could do something similar to what the {{DDLTask.dropTable}}

[jira] [Updated] (HIVE-16080) Add parquet to possible values for hive.default.fileformat and hive.default.fileformat.managed

2017-03-01 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-16080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-16080: Attachment: HIVE-16080.patch > Add parquet to possible values for hive.default.fileformat and >

[jira] [Commented] (HIVE-14864) Distcp is not called from MoveTask when src is a directory

2017-03-01 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15891510#comment-15891510 ] Sahil Takiar commented on HIVE-14864: - [~spena] am trying to write some qtests for this, do you know

[jira] [Commented] (HIVE-14606) Beeline fails if quoted string ends with \\

2016-08-22 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15431891#comment-15431891 ] Sahil Takiar commented on HIVE-14606: - Patch is pretty minor. The approach taken in HIVE-12646 to

[jira] [Updated] (HIVE-14606) Beeline fails if quoted string ends with \\

2016-08-22 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-14606: Summary: Beeline fails if quoted string ends with \\ (was: Beeline fails if quoted string begins

[jira] [Updated] (HIVE-14606) Beeline fails if quoted string begins with \\

2016-08-22 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-14606: Description: The following query fails {code} select '\\' as literal; {code} Exception: {code}

[jira] [Updated] (HIVE-14606) Beeline fails if quoted string begins with \\

2016-08-22 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-14606: Description: The following query fails in Beeline {code} select '\\' as literal; {code}

[jira] [Updated] (HIVE-14606) Beeline fails if quoted string ends with \\

2016-08-22 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-14606: Attachment: HIVE-14606.1.patch > Beeline fails if quoted string ends with \\ >

[jira] [Commented] (HIVE-14705) Hive outer queries is not picking up the right column from subqueries

2016-09-05 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15465410#comment-15465410 ] Sahil Takiar commented on HIVE-14705: - Details about the fix and the bug are below: *Background:*

[jira] [Commented] (HIVE-14705) Hive outer queries is not picking up the right column from subqueries

2016-09-05 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14705?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15465412#comment-15465412 ] Sahil Takiar commented on HIVE-14705: - Leaving this open in case we want to backport a fix to the

[jira] [Updated] (HIVE-7224) Set incremental printing to true by default in Beeline

2016-09-05 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-7224: --- Attachment: HIVE-7224.5.patch Rebasing patch > Set incremental printing to true by default in Beeline

[jira] [Updated] (HIVE-7224) Set incremental printing to true by default in Beeline

2016-09-05 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-7224: --- Attachment: HIVE-7224.4.patch > Set incremental printing to true by default in Beeline >

[jira] [Commented] (HIVE-7224) Set incremental printing to true by default in Beeline

2016-09-05 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15465960#comment-15465960 ] Sahil Takiar commented on HIVE-7224: [~thejas] and [~vgumashta] the subtasks we discussed for this JIRA

[jira] [Commented] (HIVE-14170) Beeline IncrementalRows should buffer rows and incrementally re-calculate width if TableOutputFormat is used

2016-08-30 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15449562#comment-15449562 ] Sahil Takiar commented on HIVE-14170: - Thanks Sergio! > Beeline IncrementalRows should buffer rows

[jira] [Commented] (HIVE-14170) Beeline IncrementalRows should buffer rows and incrementally re-calculate width if TableOutputFormat is used

2016-08-29 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15447093#comment-15447093 ] Sahil Takiar commented on HIVE-14170: - You can test this locally by: * Applying the patch locally *

[jira] [Comment Edited] (HIVE-14170) Beeline IncrementalRows should buffer rows and incrementally re-calculate width if TableOutputFormat is used

2016-08-29 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15447093#comment-15447093 ] Sahil Takiar edited comment on HIVE-14170 at 8/29/16 9:26 PM: -- You can test

[jira] [Commented] (HIVE-14029) Update Spark version to 2.0.0

2016-09-21 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15510656#comment-15510656 ] Sahil Takiar commented on HIVE-14029: - [~Ferd] overall this looks good to me. It would be nice if you

[jira] [Commented] (HIVE-14240) HoS itests shouldn't depend on a Spark distribution

2016-09-21 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15510628#comment-15510628 ] Sahil Takiar commented on HIVE-14240: - [~Ferd], [~lirui] yes I forgot that there are two ways qtests

[jira] [Commented] (HIVE-14240) HoS itests shouldn't depend on a Spark distribution

2016-09-20 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507644#comment-15507644 ] Sahil Takiar commented on HIVE-14240: - Hey [~Ferd] I haven't had time to look into this, although it

[jira] [Commented] (HIVE-14029) Update Spark version to 2.0.0

2016-09-20 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507641#comment-15507641 ] Sahil Takiar commented on HIVE-14029: - [~Ferd] how was the

[jira] [Commented] (HIVE-14240) HoS itests shouldn't depend on a Spark distribution

2016-09-20 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15508218#comment-15508218 ] Sahil Takiar commented on HIVE-14240: - I looked into this today and tried to get something working,

[jira] [Comment Edited] (HIVE-14240) HoS itests shouldn't depend on a Spark distribution

2016-09-20 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15508218#comment-15508218 ] Sahil Takiar edited comment on HIVE-14240 at 9/21/16 12:16 AM: --- I looked

[jira] [Commented] (HIVE-14606) Beeline fails if quoted string ends with \\

2016-08-23 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15433514#comment-15433514 ] Sahil Takiar commented on HIVE-14606: - Hive QA results look good. [~spena] and [~vihangk1] can you

[jira] [Commented] (HIVE-14170) Beeline IncrementalRows should buffer rows and incrementally re-calculate width if TableOutputFormat is used

2016-08-23 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15433518#comment-15433518 ] Sahil Takiar commented on HIVE-14170: - [~spena] any chance you could take another look at this patch?

[jira] [Updated] (HIVE-14606) Beeline fails if quoted string ends with \\

2016-08-22 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-14606: Status: Patch Available (was: Open) > Beeline fails if quoted string ends with \\ >

[jira] [Commented] (HIVE-14082) Multi-Insert Query Fails with GROUP BY, DISTINCT, and WHERE clauses

2016-09-28 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531236#comment-15531236 ] Sahil Takiar commented on HIVE-14082: - Ping, anyone have any idea on this? > Multi-Insert Query Fails

[jira] [Commented] (HIVE-14029) Update Spark version to 2.0.0

2016-09-28 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531017#comment-15531017 ] Sahil Takiar commented on HIVE-14029: - [~Ferd] can you also add an "Incompatible Change" Flag to this

[jira] [Commented] (HIVE-7224) Set incremental printing to true by default in Beeline

2016-09-28 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15531225#comment-15531225 ] Sahil Takiar commented on HIVE-7224: Hey [~leftylev] could you grant me permission to edit the wiki

[jira] [Commented] (HIVE-7224) Set incremental printing to true by default in Beeline

2016-09-27 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15527624#comment-15527624 ] Sahil Takiar commented on HIVE-7224: [~spena] can this be merged? The change simply sets Beeline's

[jira] [Commented] (HIVE-14029) Update Spark version to 2.0.0

2016-10-03 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15542999#comment-15542999 ] Sahil Takiar commented on HIVE-14029: - We probably don't need a shim loader right now. I don't know of

[jira] [Commented] (HIVE-14827) Micro benchmark for Parquet vectorized reader

2016-10-03 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15543817#comment-15543817 ] Sahil Takiar commented on HIVE-14827: - Could we use JMH

[jira] [Commented] (HIVE-15093) For S3-to-S3 renames, files should be moved individually rather than at a directory level

2016-10-28 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15616344#comment-15616344 ] Sahil Takiar commented on HIVE-15093: - [~poeppt], [~spena] I agree that ideally this should be fixed

[jira] [Updated] (HIVE-15093) For S3-to-S3 renames, files should be moved individually rather than at a directory level

2016-10-28 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-15093: Status: Patch Available (was: Open) > For S3-to-S3 renames, files should be moved individually

[jira] [Updated] (HIVE-15093) For S3-to-S3 renames, files should be moved individually rather than at a directory level

2016-10-28 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-15093: Attachment: HIVE-15093.1.patch > For S3-to-S3 renames, files should be moved individually rather

[jira] [Updated] (HIVE-15093) S3-to-S3 Renames: Files should be moved individually rather than at a directory level

2016-11-07 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-15093: Attachment: HIVE-15093.8.patch > S3-to-S3 Renames: Files should be moved individually rather than

[jira] [Commented] (HIVE-15093) S3-to-S3 Renames: Files should be moved individually rather than at a directory level

2016-11-07 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15645575#comment-15645575 ] Sahil Takiar commented on HIVE-15093: - [~spena] comments addressed. Added some q tests also. >

[jira] [Commented] (HIVE-14271) FileSinkOperator should not rename files to final paths when S3 is the default destination

2016-11-08 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15649356#comment-15649356 ] Sahil Takiar commented on HIVE-14271: - We might want to consider re-opening this ticket, but changing

[jira] [Updated] (HIVE-15121) Last MR job in Hive should be able to write to a different scratch directory

2016-11-04 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-15121: Attachment: HIVE-15121.WIP.2.patch > Last MR job in Hive should be able to write to a different

[jira] [Commented] (HIVE-15114) Remove extra MoveTask operators

2016-11-04 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15637548#comment-15637548 ] Sahil Takiar commented on HIVE-15114: - [~spena] thanks for the detailed explanation. I think your

[jira] [Commented] (HIVE-14271) FileSinkOperator should not rename files to final paths when S3 is the default destination

2016-11-09 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15651862#comment-15651862 ] Sahil Takiar commented on HIVE-14271: - Yes, agree with Steve. Sergio summarized it well. Sounds like

[jira] [Commented] (HIVE-15114) Remove extra MoveTask operators

2016-11-09 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15651741#comment-15651741 ] Sahil Takiar commented on HIVE-15114: - [~spena] should we "Submit Patch" so we can some test results

[jira] [Commented] (HIVE-15093) S3-to-S3 Renames: Files should be moved individually rather than at a directory level

2016-11-09 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15651540#comment-15651540 ] Sahil Takiar commented on HIVE-15093: - [~steve_l] thanks for your input. I'm happy to start looking

[jira] [Updated] (HIVE-15121) Last MR job in Hive should be able to write to a different scratch directory

2016-11-07 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-15121: Attachment: HIVE-15121.1.patch Adding qtest. > Last MR job in Hive should be able to write to a

[jira] [Updated] (HIVE-15093) S3-to-S3 Renames: Files should be moved individually rather than at a directory level

2016-11-07 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-15093: Attachment: HIVE-15093.9.patch > S3-to-S3 Renames: Files should be moved individually rather than

[jira] [Commented] (HIVE-15121) Last MR job in Hive should be able to write to a different scratch directory

2016-11-07 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15645989#comment-15645989 ] Sahil Takiar commented on HIVE-15121: - [~spena] added qtests, and tested locally. Ready for review. RB

[jira] [Updated] (HIVE-15121) Last MR job in Hive should be able to write to a different scratch directory

2016-11-04 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-15121: Attachment: HIVE-15121.patch > Last MR job in Hive should be able to write to a different scratch

[jira] [Assigned] (HIVE-15121) Last MR job in Hive should be able to write to a different scratch directory

2016-11-04 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar reassigned HIVE-15121: --- Assignee: Sahil Takiar > Last MR job in Hive should be able to write to a different scratch

[jira] [Commented] (HIVE-15093) S3-to-S3 Renames: Files should be moved individually rather than at a directory level

2016-11-04 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15638075#comment-15638075 ] Sahil Takiar commented on HIVE-15093: - [~spena] yes one possibility is to just make this optimization

[jira] [Commented] (HIVE-15121) Last MR job in Hive should be able to write to a different scratch directory

2016-11-04 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15638062#comment-15638062 ] Sahil Takiar commented on HIVE-15121: - Cleaned up the patch, and tested it more thoroughly. Test

[jira] [Updated] (HIVE-14971) Hive returns incorrect result when NOT used with <=> (null safe equals) operator

2016-10-14 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-14971: Description: Hive returns incorrect results when using a <=> inside a NOT operator: {code} create

[jira] [Commented] (HIVE-14971) Hive returns incorrect result when NOT used with <=> (null safe equals) operator

2016-10-14 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15576940#comment-15576940 ] Sahil Takiar commented on HIVE-14971: - Note I ran the same queries in MySQL and it returns the correct

[jira] [Updated] (HIVE-14864) Distcp is not called from MoveTask when src is a directory

2016-10-14 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-14864: Attachment: HIVE-14864.2.patch > Distcp is not called from MoveTask when src is a directory >

[jira] [Commented] (HIVE-14271) FileSinkOperator should not rename files to final paths when S3 is the default destination

2016-10-23 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15600134#comment-15600134 ] Sahil Takiar commented on HIVE-14271: - Thanks [~ste...@apache.org] that does make sense. >

[jira] [Commented] (HIVE-14535) add micromanaged tables to Hive (metastore keeps track of the files)

2016-10-23 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15600119#comment-15600119 ] Sahil Takiar commented on HIVE-14535: - Thanks [~gopalv] and [~sershe] that helps a ton! > add

[jira] [Commented] (HIVE-14271) FileSinkOperator should not rename files to final paths when S3 is the default destination

2016-10-20 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15593020#comment-15593020 ] Sahil Takiar commented on HIVE-14271: - [~cnauroth], we were actually thinking of implementing a

[jira] [Commented] (HIVE-14535) add micromanaged tables to Hive (metastore keeps track of the files)

2016-10-20 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15593030#comment-15593030 ] Sahil Takiar commented on HIVE-14535: - Hey [~sershe], Very interesting feature. I think this could

[jira] [Commented] (HIVE-14535) add micromanaged tables to Hive (metastore keeps track of the files)

2016-10-20 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15593127#comment-15593127 ] Sahil Takiar commented on HIVE-14535: - Thanks a ton [~gopalv]! Definitely helps a lot, don't want to

[jira] [Comment Edited] (HIVE-14971) Hive returns incorrect result when NOT used with <=> (null safe equals) operator

2016-10-19 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15589255#comment-15589255 ] Sahil Takiar edited comment on HIVE-14971 at 10/19/16 4:58 PM: --- These

[jira] [Commented] (HIVE-14971) Hive returns incorrect result when NOT used with <=> (null safe equals) operator

2016-10-19 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15589255#comment-15589255 ] Sahil Takiar commented on HIVE-14971: - These queries doesn't work either: * {{select not(2 <=>

[jira] [Commented] (HIVE-14271) FileSinkOperator should not rename files to final paths when S3 is the default destination

2016-11-14 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15665533#comment-15665533 ] Sahil Takiar commented on HIVE-14271: - [~spena] looked more into what we discussed this morning, you

[jira] [Commented] (HIVE-15114) Remove extra MoveTask operators from the ConditionalTask

2016-11-23 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15691499#comment-15691499 ] Sahil Takiar commented on HIVE-15114: - +1 > Remove extra MoveTask operators from the ConditionalTask

[jira] [Commented] (HIVE-15114) Remove extra MoveTask operators from the ConditionalTask

2016-11-25 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15696655#comment-15696655 ] Sahil Takiar commented on HIVE-15114: - With all the changes to {{MoveTask}}s in this JIRA and

[jira] [Commented] (HIVE-15280) Hive.mvFile() misses the "." char when joining the filename + extension

2016-11-25 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15696638#comment-15696638 ] Sahil Takiar commented on HIVE-15280: - Should we add some unit tests for this? > Hive.mvFile() misses

[jira] [Updated] (HIVE-15121) Last MR job in Hive should be able to write to a different scratch directory

2016-11-21 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-15121: Attachment: HIVE-15121.2.patch > Last MR job in Hive should be able to write to a different scratch

[jira] [Updated] (HIVE-15121) Last MR job in Hive should be able to write to a different scratch directory

2016-11-22 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-15121: Description: Hive should be able to configure all intermediate MR jobs to write to HDFS, but the

[jira] [Commented] (HIVE-15199) INSERT INTO data on S3 is replacing the old rows with the new ones

2016-11-22 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15687963#comment-15687963 ] Sahil Takiar commented on HIVE-15199: - [~yalovyyi] what other problems with S3 do you think this would

[jira] [Commented] (HIVE-15266) Edit test output of negative blobstore tests to match HIVE-15226

2016-11-22 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15687686#comment-15687686 ] Sahil Takiar commented on HIVE-15266: - +1 but need a committer to take a look. > Edit test output of

[jira] [Updated] (HIVE-15121) Last MR job in Hive should be able to write to a different scratch directory

2016-11-22 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated HIVE-15121: Attachment: HIVE-15121.3.patch > Last MR job in Hive should be able to write to a different scratch

[jira] [Commented] (HIVE-15121) Last MR job in Hive should be able to write to a different scratch directory

2016-11-21 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15684823#comment-15684823 ] Sahil Takiar commented on HIVE-15121: - [~spena] test failures look unrelated, could you review? >

[jira] [Commented] (HIVE-15121) Last MR job in Hive should be able to write to a different scratch directory

2016-11-22 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15688185#comment-15688185 ] Sahil Takiar commented on HIVE-15121: - [~spena] test failures look unrelated, and the tests are

[jira] [Commented] (HIVE-15280) Hive.mvFile() misses the "." char when joining the filename + extension

2016-11-28 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-15280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15703202#comment-15703202 ] Sahil Takiar commented on HIVE-15280: - +1 Just to clarify the {{Mockito.spy}} usage, the code is

<    1   2   3   4   5   6   7   8   9   10   >