[jira] [Commented] (HIVE-14797) reducer number estimating may lead to data skew

2016-09-20 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15508829#comment-15508829 ] Hive QA commented on HIVE-14797: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-14797) reducer number estimating may lead to data skew

2016-09-20 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15508805#comment-15508805 ] Rui Li commented on HIVE-14797: --- [~roncenzhao] your solution seems also OK and simpler. Would like to know

[jira] [Comment Edited] (HIVE-14797) reducer number estimating may lead to data skew

2016-09-20 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15508789#comment-15508789 ] Rui Li edited comment on HIVE-14797 at 9/21/16 5:16 AM: Hmm random prime won't

[jira] [Comment Edited] (HIVE-14797) reducer number estimating may lead to data skew

2016-09-20 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15508789#comment-15508789 ] Rui Li edited comment on HIVE-14797 at 9/21/16 5:15 AM: Hmm random prime won't

[jira] [Commented] (HIVE-14797) reducer number estimating may lead to data skew

2016-09-20 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15508789#comment-15508789 ] Rui Li commented on HIVE-14797: --- Hmm random prime won't work because we need to make sure same rows always

[jira] [Commented] (HIVE-14797) reducer number estimating may lead to data skew

2016-09-20 Thread roncenzhao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15508756#comment-15508756 ] roncenzhao commented on HIVE-14797: --- Or we can use the follow way: Let the seed have two options: 31 and

[jira] [Commented] (HIVE-14803) S3: Stats gathering for insert queries can be expensive for partitioned dataset

2016-09-20 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15508650#comment-15508650 ] Hive QA commented on HIVE-14803: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-14797) reducer number estimating may lead to data skew

2016-09-20 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15508643#comment-15508643 ] Rui Li commented on HIVE-14797: --- If user specifies #reducers to be 31, we shouldn't change it. Is it

[jira] [Commented] (HIVE-14029) Update Spark version to 2.0.0

2016-09-20 Thread Ferdinand Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15508636#comment-15508636 ] Ferdinand Xu commented on HIVE-14029: - Hi [~lirui] bq. Is there any other way we can track the read

[jira] [Commented] (HIVE-14793) Allow ptest branch to be specified, PROFILE override

2016-09-20 Thread Lefty Leverenz (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15508625#comment-15508625 ] Lefty Leverenz commented on HIVE-14793: --- Should this be documented now, or wait and do it with the

[jira] [Updated] (HIVE-14029) Update Spark version to 2.0.0

2016-09-20 Thread Ferdinand Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ferdinand Xu updated HIVE-14029: Attachment: HIVE-14029.2.patch > Update Spark version to 2.0.0 > - > >

[jira] [Commented] (HIVE-14782) Improve runtime of NegativeMinimrCliDriver

2016-09-20 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15508520#comment-15508520 ] Hive QA commented on HIVE-14782: Here are the results of testing the latest attachment:

[jira] [Updated] (HIVE-14412) Add a timezone-aware timestamp

2016-09-20 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li updated HIVE-14412: -- Attachment: (was: HIVE-14412.5.patch) > Add a timezone-aware timestamp > -- > >

[jira] [Commented] (HIVE-14412) Add a timezone-aware timestamp

2016-09-20 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15508499#comment-15508499 ] Rui Li commented on HIVE-14412: --- Most of the recent failures are because "TIME" is added as a new key word

[jira] [Commented] (HIVE-14029) Update Spark version to 2.0.0

2016-09-20 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15508437#comment-15508437 ] Rui Li commented on HIVE-14029: --- I agree to move this forward. HIVE-14240 can be done in parallel, if it

[jira] [Commented] (HIVE-14714) Finishing Hive on Spark causes "java.io.IOException: Stream closed"

2016-09-20 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15508419#comment-15508419 ] Rui Li commented on HIVE-14714: --- +1 Thanks for the update [~gszadovszky]. I'll commit this shortly if no one

[jira] [Updated] (HIVE-14797) reducer number estimating may lead to data skew

2016-09-20 Thread roncenzhao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] roncenzhao updated HIVE-14797: -- Status: Patch Available (was: Open) > reducer number estimating may lead to data skew >

[jira] [Commented] (HIVE-14797) reducer number estimating may lead to data skew

2016-09-20 Thread roncenzhao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15508405#comment-15508405 ] roncenzhao commented on HIVE-14797: --- Yes, we can not hard code the number (31). But we cannot know which

[jira] [Commented] (HIVE-14240) HoS itests shouldn't depend on a Spark distribution

2016-09-20 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15508403#comment-15508403 ] Rui Li commented on HIVE-14240: --- We have two kinds of test for HoS - TestSparkCliDriver runs on

[jira] [Updated] (HIVE-14782) Improve runtime of NegativeMinimrCliDriver

2016-09-20 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-14782: - Attachment: HIVE-14782.2.patch All test cases just reference src table so reusing

[jira] [Updated] (HIVE-14803) S3: Stats gathering for insert queries can be expensive for partitioned dataset

2016-09-20 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-14803: Target Version/s: 2.2.0 Status: Patch Available (was: Open) > S3: Stats

[jira] [Updated] (HIVE-14782) Improve runtime of NegativeMinimrCliDriver

2016-09-20 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-14782: - Description: NegativeMinimrCliDriver is one of the slowest test batch. The actual

[jira] [Updated] (HIVE-14782) Improve runtime of NegativeMinimrCliDriver

2016-09-20 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth Jayachandran updated HIVE-14782: - Summary: Improve runtime of NegativeMinimrCliDriver (was: Remove

[jira] [Commented] (HIVE-14240) HoS itests shouldn't depend on a Spark distribution

2016-09-20 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15508363#comment-15508363 ] liyunzhang_intel commented on HIVE-14240: - [~Ferd]: bq. In Pig, they don't require Spark

[jira] [Comment Edited] (HIVE-14029) Update Spark version to 2.0.0

2016-09-20 Thread Dapeng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15508353#comment-15508353 ] Dapeng Sun edited comment on HIVE-14029 at 9/21/16 1:24 AM: [~Ferd] Yes, I

[jira] [Commented] (HIVE-14029) Update Spark version to 2.0.0

2016-09-20 Thread Dapeng Sun (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15508353#comment-15508353 ] Dapeng Sun commented on HIVE-14029: --- Yes, I used this command > Update Spark version to 2.0.0 >

[jira] [Commented] (HIVE-14029) Update Spark version to 2.0.0

2016-09-20 Thread Ferdinand Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15508350#comment-15508350 ] Ferdinand Xu commented on HIVE-14029: - Hi [~spena], I think we should move it forwards since

[jira] [Comment Edited] (HIVE-14029) Update Spark version to 2.0.0

2016-09-20 Thread Ferdinand Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15508316#comment-15508316 ] Ferdinand Xu edited comment on HIVE-14029 at 9/21/16 1:16 AM: -- Hi [~stakiar],

[jira] [Commented] (HIVE-14240) HoS itests shouldn't depend on a Spark distribution

2016-09-20 Thread Ferdinand Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15508335#comment-15508335 ] Ferdinand Xu commented on HIVE-14240: - Thanks [~stakiar] for your input. AFAIK, TestSparkCliDriver

[jira] [Updated] (HIVE-14803) S3: Stats gathering for insert queries can be expensive for partitioned dataset

2016-09-20 Thread Rajesh Balamohan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Balamohan updated HIVE-14803: Attachment: HIVE-14803.1.patch Observed 12% improvement in runtime with 100 partition

[jira] [Commented] (HIVE-14029) Update Spark version to 2.0.0

2016-09-20 Thread Ferdinand Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15508316#comment-15508316 ] Ferdinand Xu commented on HIVE-14029: - Hi [~stakiar], the tgz was built via the following commands:

[jira] [Commented] (HIVE-14240) HoS itests shouldn't depend on a Spark distribution

2016-09-20 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15508218#comment-15508218 ] Sahil Takiar commented on HIVE-14240: - I looked into this today and tried to get something working,

[jira] [Comment Edited] (HIVE-14240) HoS itests shouldn't depend on a Spark distribution

2016-09-20 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15508218#comment-15508218 ] Sahil Takiar edited comment on HIVE-14240 at 9/21/16 12:16 AM: --- I looked

[jira] [Commented] (HIVE-14801) improve TestPartitionNameWhitelistValidation stability

2016-09-20 Thread Daniel Dai (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15508203#comment-15508203 ] Daniel Dai commented on HIVE-14801: --- +1 > improve TestPartitionNameWhitelistValidation stability >

[jira] [Commented] (HIVE-14801) improve TestPartitionNameWhitelistValidation stability

2016-09-20 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15508086#comment-15508086 ] Hive QA commented on HIVE-14801: Here are the results of testing the latest attachment:

[jira] [Commented] (HIVE-14801) improve TestPartitionNameWhitelistValidation stability

2016-09-20 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15508063#comment-15508063 ] Thejas M Nair commented on HIVE-14801: -- [~sseth] Looking at mvn outputs, yes, the difference looks

[jira] [Commented] (HIVE-13853) Add X-XSRF-Header filter to HS2 HTTP mode and WebHCat

2016-09-20 Thread Sushanth Sowmyan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15508057#comment-15508057 ] Sushanth Sowmyan commented on HIVE-13853: - That is how I had started testing, but HS2 has some

[jira] [Resolved] (HIVE-14793) Allow ptest branch to be specified, PROFILE override

2016-09-20 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth resolved HIVE-14793. --- Resolution: Fixed Fix Version/s: 2.2.0 Committed to master. Precommit not required,

[jira] [Updated] (HIVE-14793) Allow ptest branch to be specified, PROFILE override

2016-09-20 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-14793: -- Attachment: HIVE-14793.03.patch Updated. > Allow ptest branch to be specified, PROFILE

[jira] [Commented] (HIVE-14793) Allow ptest branch to be specified, PROFILE override

2016-09-20 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15508003#comment-15508003 ] Siddharth Seth commented on HIVE-14793: --- Oops. I'll generate it again properly. The diff is because

[jira] [Commented] (HIVE-14800) Handle off by 3 in ORC split generation based on split strategy used

2016-09-20 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507998#comment-15507998 ] Siddharth Seth commented on HIVE-14800: --- They are valid splits - however, it should be possible to

[jira] [Commented] (HIVE-14793) Allow ptest branch to be specified, PROFILE override

2016-09-20 Thread JIRA
[ https://issues.apache.org/jira/browse/HIVE-14793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507954#comment-15507954 ] Sergio Peña commented on HIVE-14793: Patch looks good. +1 However, I see the outputDir change in the

[jira] [Comment Edited] (HIVE-14793) Allow ptest branch to be specified, PROFILE override

2016-09-20 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507755#comment-15507755 ] Siddharth Seth edited comment on HIVE-14793 at 9/20/16 9:58 PM: bq. 1. Can

[jira] [Comment Edited] (HIVE-14793) Allow ptest branch to be specified, PROFILE override

2016-09-20 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507755#comment-15507755 ] Siddharth Seth edited comment on HIVE-14793 at 9/20/16 9:57 PM: bq. 1. Can

[jira] [Updated] (HIVE-14793) Allow ptest branch to be specified, PROFILE override

2016-09-20 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-14793: -- Attachment: HIVE-14793.02.patch Updated patch, which removes the change to target/. [~spena] -

[jira] [Commented] (HIVE-14801) improve TestPartitionNameWhitelistValidation stability

2016-09-20 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507855#comment-15507855 ] Siddharth Seth commented on HIVE-14801: --- [~thejas] - you may want to look at mvn test output, rather

[jira] [Commented] (HIVE-14801) improve TestPartitionNameWhitelistValidation stability

2016-09-20 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507845#comment-15507845 ] Thejas M Nair commented on HIVE-14801: -- Overall around 5 seconds saved - cc [~sseth] Before - {code}

[jira] [Updated] (HIVE-14801) improve TestPartitionNameWhitelistValidation stability

2016-09-20 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thejas M Nair updated HIVE-14801: - Attachment: HIVE-14801.2.patch 2.patch - Moving the setup to a one time setup saves at least

[jira] [Commented] (HIVE-13853) Add X-XSRF-Header filter to HS2 HTTP mode and WebHCat

2016-09-20 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507830#comment-15507830 ] Siddharth Seth commented on HIVE-13853: --- Can this be written as a unit test instead of a test which

[jira] [Commented] (HIVE-14713) LDAP Authentication Provider should be covered with unit tests

2016-09-20 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507799#comment-15507799 ] Hive QA commented on HIVE-14713: Here are the results of testing the latest attachment:

[jira] [Updated] (HIVE-14801) improve TestPartitionNameWhitelistValidation stability

2016-09-20 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thejas M Nair updated HIVE-14801: - Status: Patch Available (was: Open) > improve TestPartitionNameWhitelistValidation stability >

[jira] [Updated] (HIVE-14801) improve TestPartitionNameWhitelistValidation stability

2016-09-20 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thejas M Nair updated HIVE-14801: - Description: TestPartitionNameWhitelistValidation uses remote metastore. However, there can be

[jira] [Updated] (HIVE-14801) improve TestPartitionNameWhitelistValidation stability

2016-09-20 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thejas M Nair updated HIVE-14801: - Attachment: HIVE-14801.1.patch > improve TestPartitionNameWhitelistValidation stability >

[jira] [Comment Edited] (HIVE-14793) Allow ptest branch to be specified, PROFILE override

2016-09-20 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507755#comment-15507755 ] Siddharth Seth edited comment on HIVE-14793 at 9/20/16 8:49 PM: bq. 1. Can

[jira] [Commented] (HIVE-14793) Allow ptest branch to be specified, PROFILE override

2016-09-20 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507755#comment-15507755 ] Siddharth Seth commented on HIVE-14793: --- bq. 1. Can we create a new function that checks and/or

[jira] [Comment Edited] (HIVE-14461) Investigate HBaseMinimrCliDriver tests

2016-09-20 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507714#comment-15507714 ] Siddharth Seth edited comment on HIVE-14461 at 9/20/16 8:32 PM: Yes.

[jira] [Commented] (HIVE-14461) Investigate HBaseMinimrCliDriver tests

2016-09-20 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507714#comment-15507714 ] Siddharth Seth commented on HIVE-14461: --- Yes. > Investigate HBaseMinimrCliDriver tests >

[jira] [Commented] (HIVE-14240) HoS itests shouldn't depend on a Spark distribution

2016-09-20 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507644#comment-15507644 ] Sahil Takiar commented on HIVE-14240: - Hey [~Ferd] I haven't had time to look into this, although it

[jira] [Commented] (HIVE-14029) Update Spark version to 2.0.0

2016-09-20 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507641#comment-15507641 ] Sahil Takiar commented on HIVE-14029: - [~Ferd] how was the

[jira] [Commented] (HIVE-13853) Add X-XSRF-Header filter to HS2 HTTP mode and WebHCat

2016-09-20 Thread Sushanth Sowmyan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507612#comment-15507612 ] Sushanth Sowmyan commented on HIVE-13853: - [~sseth], I've been looking at some other tests, and I

[jira] [Commented] (HIVE-14713) LDAP Authentication Provider should be covered with unit tests

2016-09-20 Thread Illya Yalovyy (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507583#comment-15507583 ] Illya Yalovyy commented on HIVE-14713: -- I have updated Patch and CR with a fixed version. > LDAP

[jira] [Updated] (HIVE-14713) LDAP Authentication Provider should be covered with unit tests

2016-09-20 Thread Illya Yalovyy (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Illya Yalovyy updated HIVE-14713: - Status: Open (was: Patch Available) > LDAP Authentication Provider should be covered with unit

[jira] [Updated] (HIVE-14713) LDAP Authentication Provider should be covered with unit tests

2016-09-20 Thread Illya Yalovyy (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Illya Yalovyy updated HIVE-14713: - Attachment: HIVE-14713.2.patch > LDAP Authentication Provider should be covered with unit tests >

[jira] [Updated] (HIVE-14713) LDAP Authentication Provider should be covered with unit tests

2016-09-20 Thread Illya Yalovyy (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Illya Yalovyy updated HIVE-14713: - Status: Patch Available (was: Open) > LDAP Authentication Provider should be covered with unit

[jira] [Commented] (HIVE-14800) Handle off by 3 in ORC split generation based on split strategy used

2016-09-20 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507454#comment-15507454 ] Gopal V commented on HIVE-14800: They are both valid splits, so unlikely to need changes there - the only

[jira] [Updated] (HIVE-14624) LLAP: Use FQDN when submitting work to LLAP

2016-09-20 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-14624: Resolution: Fixed Status: Resolved (was: Patch Available) Committed to master >

[jira] [Commented] (HIVE-14461) Investigate HBaseMinimrCliDriver tests

2016-09-20 Thread Prasanth Jayachandran (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507343#comment-15507343 ] Prasanth Jayachandran commented on HIVE-14461: -- I don't see test report for

[jira] [Commented] (HIVE-14680) retain consistent splits /during/ (as opposed to across) LLAP failures on top of HIVE-14589

2016-09-20 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507337#comment-15507337 ] Siddharth Seth commented on HIVE-14680: --- Really think we're better off fixing this within Orc itself

[jira] [Commented] (HIVE-7926) long-lived daemons for query fragment execution, I/O and caching

2016-09-20 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507333#comment-15507333 ] Siddharth Seth commented on HIVE-7926: -- bq. In the sentence: “The initial stage of the query is pushed

[jira] [Commented] (HIVE-13853) Add X-XSRF-Header filter to HS2 HTTP mode and WebHCat

2016-09-20 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-13853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507317#comment-15507317 ] Siddharth Seth commented on HIVE-13853: --- The test added in this patch - TestXSRFFilter - runs for

[jira] [Assigned] (HIVE-14461) Investigate HBaseMinimrCliDriver tests

2016-09-20 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth reassigned HIVE-14461: - Assignee: Siddharth Seth > Investigate HBaseMinimrCliDriver tests >

[jira] [Updated] (HIVE-14651) Add a local cluster for Tez and LLAP

2016-09-20 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Seth updated HIVE-14651: -- Resolution: Fixed Fix Version/s: 2.2.0 Status: Resolved (was: Patch

[jira] [Updated] (HIVE-14798) MSCK REPAIR TABLE throws null pointer exception

2016-09-20 Thread Anbu Cheeralan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anbu Cheeralan updated HIVE-14798: -- Description: MSCK REPAIR TABLE statement throws null pointer exception in Hive 2.1 I have

[jira] [Updated] (HIVE-14798) MSCK REPAIR TABLE throws null pointer exception

2016-09-20 Thread Anbu Cheeralan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anbu Cheeralan updated HIVE-14798: -- Description: MSCK REPAIR TABLE statement throws null pointer exception in Hive 2.1 I have

[jira] [Resolved] (HIVE-14787) Ability to access DistributedCache from UDFs via Java API

2016-09-20 Thread Ilya Bystrov (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ilya Bystrov resolved HIVE-14787. - Resolution: Invalid > Ability to access DistributedCache from UDFs via Java API >

[jira] [Updated] (HIVE-14787) Ability to access DistributedCache from UDFs via Java API

2016-09-20 Thread Ilya Bystrov (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ilya Bystrov updated HIVE-14787: Description: I'm trying to create custom function {{create function geoip as

[jira] [Commented] (HIVE-14412) Add a timezone-aware timestamp

2016-09-20 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507121#comment-15507121 ] Hive QA commented on HIVE-14412: Here are the results of testing the latest attachment:

[jira] [Updated] (HIVE-9423) HiveServer2: Implement some admission control mechanism for graceful degradation when resources are exhausted

2016-09-20 Thread Peter Vary (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Vary updated HIVE-9423: - Attachment: HIVE-9423.patch THRIFT-2046 handles connection overflow with closing the connection without

[jira] [Commented] (HIVE-14797) reducer number estimating may lead to data skew

2016-09-20 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15506967#comment-15506967 ] Xuefu Zhang commented on HIVE-14797: This seems making sense, but can we not hard code the number

[jira] [Commented] (HIVE-14029) Update Spark version to 2.0.0

2016-09-20 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15506942#comment-15506942 ] Hive QA commented on HIVE-14029: Here are the results of testing the latest attachment:

[jira] [Updated] (HIVE-14775) Investigate IOException usage in Metrics APIs

2016-09-20 Thread Barna Zsombor Klara (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Barna Zsombor Klara updated HIVE-14775: --- Description: A large number of metrics APIs seem to declare to throw IOExceptions

[jira] [Assigned] (HIVE-9423) HiveServer2: Implement some admission control mechanism for graceful degradation when resources are exhausted

2016-09-20 Thread Peter Vary (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Vary reassigned HIVE-9423: Assignee: Peter Vary > HiveServer2: Implement some admission control mechanism for graceful >

[jira] [Commented] (HIVE-14029) Update Spark version to 2.0.0

2016-09-20 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15506839#comment-15506839 ] Rui Li commented on HIVE-14029: --- My understanding is spark needs hive libraries only for SparkSQL, which is

[jira] [Commented] (HIVE-14029) Update Spark version to 2.0.0

2016-09-20 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15506833#comment-15506833 ] Rui Li commented on HIVE-14029: --- bq. some APIs are changed in Spark side Is there any other way we can track

[jira] [Work started] (HIVE-9530) constant * column is null interpreted as constant * boolean

2016-09-20 Thread Miklos Csanady (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HIVE-9530 started by Miklos Csanady. > constant * column is null interpreted as constant * boolean >

[jira] [Updated] (HIVE-14798) MSCK REPAIR TABLE throws null pointer exception

2016-09-20 Thread Anbu Cheeralan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anbu Cheeralan updated HIVE-14798: -- Description: MSCK REPAIR TABLE statement throws null pointer exception in Hive 2.1 I have

[jira] [Commented] (HIVE-14029) Update Spark version to 2.0.0

2016-09-20 Thread JIRA
[ https://issues.apache.org/jira/browse/HIVE-14029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15506772#comment-15506772 ] Sergio Peña commented on HIVE-14029: Sure. [~stakiar] Let me know if the below statements are correct,

[jira] [Updated] (HIVE-14798) MSCK REPAIR TABLE throws null pointer exception

2016-09-20 Thread Anbu Cheeralan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anbu Cheeralan updated HIVE-14798: -- Description: MSKC REPAIR TABLE statement throws null pointer exception in Hive 2.1 I have

[jira] [Commented] (HIVE-1555) JDBC Storage Handler

2016-09-20 Thread Dmitry Zagorulkin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15506789#comment-15506789 ] Dmitry Zagorulkin commented on HIVE-1555: - Actually it works fine with mysql and postgres. For

[jira] [Assigned] (HIVE-9530) constant * column is null interpreted as constant * boolean

2016-09-20 Thread Miklos Csanady (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Csanady reassigned HIVE-9530: Assignee: Miklos Csanady > constant * column is null interpreted as constant * boolean >

[jira] [Commented] (HIVE-9530) constant * column is null interpreted as constant * boolean

2016-09-20 Thread Miklos Csanady (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15506778#comment-15506778 ] Miklos Csanady commented on HIVE-9530: -- Use brackets to prevent this error. Your command it is

[jira] [Updated] (HIVE-14412) Add a timezone-aware timestamp

2016-09-20 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li updated HIVE-14412: -- Attachment: HIVE-14412.5.patch > Add a timezone-aware timestamp > -- > >

[jira] [Commented] (HIVE-14240) HoS itests shouldn't depend on a Spark distribution

2016-09-20 Thread Ferdinand Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15506745#comment-15506745 ] Ferdinand Xu commented on HIVE-14240: - Hi [~stakiar], do you have any updates for this ticket? I am

[jira] [Commented] (HIVE-14029) Update Spark version to 2.0.0

2016-09-20 Thread Ferdinand Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15506738#comment-15506738 ] Ferdinand Xu commented on HIVE-14029: - Hi [~spena], I am not quite sure why assembly tar.gz will

[jira] [Commented] (HIVE-12266) When client exists abnormally, it doesn't release ACID locks

2016-09-20 Thread Chaoyu Tang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-12266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15506736#comment-15506736 ] Chaoyu Tang commented on HIVE-12266: [~wzheng], To my understand, this JIRA could only address the

[jira] [Commented] (HIVE-14029) Update Spark version to 2.0.0

2016-09-20 Thread JIRA
[ https://issues.apache.org/jira/browse/HIVE-14029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15506716#comment-15506716 ] Sergio Peña commented on HIVE-14029: [~Ferd] I think we should try to fix HIVE-14240 first to avoid

[jira] [Commented] (HIVE-9423) HiveServer2: Implement some admission control mechanism for graceful degradation when resources are exhausted

2016-09-20 Thread Peter Vary (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15506729#comment-15506729 ] Peter Vary commented on HIVE-9423: -- I have investigated the issue, and here is what I found: - There was

[jira] [Updated] (HIVE-14029) Update Spark version to 2.0.0

2016-09-20 Thread Ferdinand Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ferdinand Xu updated HIVE-14029: Attachment: HIVE-14029.1.patch https://builds.apache.org/job/PreCommit-HIVE-Build/1239 was failed.

[jira] [Updated] (HIVE-14029) Update Spark version to 2.0.0

2016-09-20 Thread Ferdinand Xu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-14029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ferdinand Xu updated HIVE-14029: Attachment: (was: HIVE-14029.1.patch) > Update Spark version to 2.0.0 >

[jira] [Comment Edited] (HIVE-10701) Escape apostrophe not work properly

2016-09-20 Thread Miklos Csanady (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-10701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15506651#comment-15506651 ] Miklos Csanady edited comment on HIVE-10701 at 9/20/16 2:11 PM: According

  1   2   >