[jira] [Updated] (HIVE-9178) Create a separate API for remote Spark Context RPC other than job submission [Spark Branch]

2015-01-15 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9178: -- Resolution: Fixed Fix Version/s: spark-branch Status: Resolved (was: Patch Available

[jira] [Updated] (HIVE-9387) Shutting down cli takes quite some time [Spark Branch]

2015-01-15 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9387: -- Resolution: Fixed Fix Version/s: spark-branch Status: Resolved (was: Patch Available

[jira] [Updated] (HIVE-9178) Create a separate API for remote Spark Context RPC other than job submission [Spark Branch]

2015-01-15 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9178: -- Attachment: (was: HIVE-9178.2-spark.patch) > Create a separate API for remote Spark Context

[jira] [Commented] (HIVE-9372) Parallel checking non-combinable paths in CombineHiveInputFormat

2015-01-15 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14278706#comment-14278706 ] Xuefu Zhang commented on HIVE-9372: --- +1 pending on test > Parallel check

[jira] [Commented] (HIVE-9387) Shutting down cli takes quite some time [Spark Branch]

2015-01-15 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14278692#comment-14278692 ] Xuefu Zhang commented on HIVE-9387: --- +1. Great job for tracking this down. > S

[jira] [Commented] (HIVE-9178) Create a separate API for remote Spark Context RPC other than job submission [Spark Branch]

2015-01-14 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14278179#comment-14278179 ] Xuefu Zhang commented on HIVE-9178: --- +1 > Create a separate API for remot

[jira] [Commented] (HIVE-9372) Parallel checking non-combinable paths in CombineHiveInputFormat

2015-01-14 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14278053#comment-14278053 ] Xuefu Zhang commented on HIVE-9372: --- Your patch is for trunk, which has a longer

[jira] [Commented] (HIVE-9372) Parallel checking non-combinable paths in CombineHiveInputFormat

2015-01-14 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14277982#comment-14277982 ] Xuefu Zhang commented on HIVE-9372: --- Patch looks good to me. One minor comment, ca

[jira] [Commented] (HIVE-9367) CombineFileInputFormatShim#getDirIndices is expensive

2015-01-14 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14277931#comment-14277931 ] Xuefu Zhang commented on HIVE-9367: --- +1 pending on test > CombineFileInputFor

[jira] [Updated] (HIVE-9342) add num-executors / executor-cores / executor-memory option support for hive on spark in Yarn mode [Spark Branch]

2015-01-14 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9342: -- Issue Type: Sub-task (was: Improvement) Parent: HIVE-7292 > add num-executors / executor-co

[jira] [Commented] (HIVE-9342) add num-executors / executor-cores / executor-memory option support for hive on spark in Yarn mode

2015-01-14 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14277900#comment-14277900 ] Xuefu Zhang commented on HIVE-9342: --- +1 > add num-executors / executor-cores / e

[jira] [Updated] (HIVE-9342) add num-executors / executor-cores / executor-memory option support for hive on spark in Yarn mode [Spark Branch]

2015-01-14 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9342: -- Summary: add num-executors / executor-cores / executor-memory option support for hive on spark in Yarn

[jira] [Commented] (HIVE-9379) Fix tests with some versions of Spark + Snappy [Spark Branch]

2015-01-14 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14277875#comment-14277875 ] Xuefu Zhang commented on HIVE-9379: --- +1. Looks good to me, and good for mac u

[jira] [Commented] (HIVE-9367) CombineFileInputFormatShim#getDirIndices is expensive

2015-01-14 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14277642#comment-14277642 ] Xuefu Zhang commented on HIVE-9367: --- Thanks for the explanation. This is a shim c

[jira] [Commented] (HIVE-9378) Spark qfile tests should reuse RSC

2015-01-14 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14277628#comment-14277628 ] Xuefu Zhang commented on HIVE-9378: --- [~jxiang], qfile test is supposed to

[jira] [Commented] (HIVE-9367) CombineFileInputFormatShim#getDirIndices is expensive

2015-01-14 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14277070#comment-14277070 ] Xuefu Zhang commented on HIVE-9367: --- Nice improvement. However, I'm a little

[jira] [Comment Edited] (HIVE-9178) Create a separate API for remote Spark Context RPC other than job submission [Spark Branch]

2015-01-13 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14276485#comment-14276485 ] Xuefu Zhang edited comment on HIVE-9178 at 1/14/15 5:1

[jira] [Commented] (HIVE-9178) Create a separate API for remote Spark Context RPC other than job submission [Spark Branch]

2015-01-13 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14276485#comment-14276485 ] Xuefu Zhang commented on HIVE-9178: --- The dummy patch produces 3 failures and the

[jira] [Updated] (HIVE-9178) Create a separate API for remote Spark Context RPC other than job submission [Spark Branch]

2015-01-13 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9178: -- Attachment: HIVE-9178.2-spark.patch Attached a dummy patch to test the test env. > Create a separ

[jira] [Commented] (HIVE-9178) Create a separate API for remote Spark Context RPC other than job submission [Spark Branch]

2015-01-13 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14276223#comment-14276223 ] Xuefu Zhang commented on HIVE-9178: --- It looks like that the patch somehow has incre

[jira] [Updated] (HIVE-9178) Create a separate API for remote Spark Context RPC other than job submission [Spark Branch]

2015-01-13 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9178: -- Attachment: HIVE-9178.1-spark.patch Reattach the same patch to have another test run. > Creat

[jira] [Commented] (HIVE-9178) Create a separate API for remote Spark Context RPC other than job submission [Spark Branch]

2015-01-12 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14274678#comment-14274678 ] Xuefu Zhang commented on HIVE-9178: --- The patch looks good to me. [~chengxiang li], c

[jira] [Commented] (HIVE-9258) Explain query should share the same Spark application with regular queries [Spark Branch]

2015-01-12 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14274632#comment-14274632 ] Xuefu Zhang commented on HIVE-9258: --- Makes sense. Thanks for the explanation. >

[jira] [Updated] (HIVE-9135) Cache Map and Reduce works in RSC [Spark Branch]

2015-01-12 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9135: -- Resolution: Fixed Status: Resolved (was: Patch Available) Committed to Spark branch. Thanks

[jira] [Commented] (HIVE-9135) Cache Map and Reduce works in RSC [Spark Branch]

2015-01-12 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14274537#comment-14274537 ] Xuefu Zhang commented on HIVE-9135: --- +1 > Cache Map and Reduce works in RSC

[jira] [Commented] (HIVE-9258) Explain query shouldn't launch a Spark application [Spark Branch]

2015-01-12 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14274528#comment-14274528 ] Xuefu Zhang commented on HIVE-9258: --- [~jxiang], thanks for looking into this. Lookin

[jira] [Updated] (HIVE-9258) Explain query should share the same Spark application with regular queries [Spark Branch]

2015-01-12 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9258: -- Summary: Explain query should share the same Spark application with regular queries [Spark Branch] (was

[jira] [Updated] (HIVE-9258) Explain query should share the same Spark application with regular queries [Spark Branch]

2015-01-12 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9258: -- Description: Currently for Hive on Spark, query plan includes the number of reducers, which is

Re: new hive udfs

2015-01-12 Thread Xuefu Zhang
2, 2015 at 2:48 PM, Xuefu Zhang wrote: > > > Hi Alex, > > > > This should be a good starting point: > > https://cwiki.apache.org/confluence/display/Hive/HowToContribute. > > > > Thanks, > > Xuefu > > > > On Mon, Jan 12, 2015 at 2:37 PM, Al

Re: new hive udfs

2015-01-12 Thread Xuefu Zhang
Hi Alex, This should be a good starting point: https://cwiki.apache.org/confluence/display/Hive/HowToContribute. Thanks, Xuefu On Mon, Jan 12, 2015 at 2:37 PM, Alexander Pivovarov wrote: > Hi Everyone > > I have several custom udfs I want to contribute to hive > > month_add > last_day > > grea

[jira] [Commented] (HIVE-9340) Address review of HIVE-9257 (ii)

2015-01-12 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14274303#comment-14274303 ] Xuefu Zhang commented on HIVE-9340: --- +1 pending on test > Address review of HI

[jira] [Updated] (HIVE-9340) Address review of HIVE-9257 (ii) [Spark Branch]

2015-01-12 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9340: -- Summary: Address review of HIVE-9257 (ii) [Spark Branch] (was: Address review of HIVE-9257 (ii

[jira] [Commented] (HIVE-9342) add num-executors / executor-cores / executor-memory option support for hive on spark in Yarn mode

2015-01-12 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14274074#comment-14274074 ] Xuefu Zhang commented on HIVE-9342: --- [~fangxi.yin], thanks for working on

[jira] [Updated] (HIVE-9119) ZooKeeperHiveLockManager does not use zookeeper in the proper way

2015-01-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9119: -- Labels: TODOC15 (was: ) > ZooKeeperHiveLockManager does not use zookeeper in the proper

[jira] [Updated] (HIVE-9119) ZooKeeperHiveLockManager does not use zookeeper in the proper way

2015-01-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9119: -- Resolution: Fixed Fix Version/s: 0.15.0 Status: Resolved (was: Patch Available

[jira] [Commented] (HIVE-9339) Optimize split grouping for CombineHiveInputFormat [Spark Branch]

2015-01-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14273185#comment-14273185 ] Xuefu Zhang commented on HIVE-9339: --- cc: [~lirui] > Optimize split group

[jira] [Created] (HIVE-9339) Optimize split grouping for CombineHiveInputFormat [Spark Branch]

2015-01-11 Thread Xuefu Zhang (JIRA)
Xuefu Zhang created HIVE-9339: - Summary: Optimize split grouping for CombineHiveInputFormat [Spark Branch] Key: HIVE-9339 URL: https://issues.apache.org/jira/browse/HIVE-9339 Project: Hive

[jira] [Commented] (HIVE-9257) Merge from spark to trunk January 2015

2015-01-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14273177#comment-14273177 ] Xuefu Zhang commented on HIVE-9257: --- Actually my comments on RB were not covered by

[jira] [Commented] (HIVE-9335) Address review items on HIVE-9257 [Spark Branch]

2015-01-11 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14273104#comment-14273104 ] Xuefu Zhang commented on HIVE-9335: --- +1 > Address review items on HIVE-9257

[jira] [Commented] (HIVE-9119) ZooKeeperHiveLockManager does not use zookeeper in the proper way

2015-01-10 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14272806#comment-14272806 ] Xuefu Zhang commented on HIVE-9119: --- +1 patch looks good to me. Thanks for fixing

Re: Review Request 29494: HIVE-9119: ZooKeeperHiveLockManager does not use zookeeper in the proper way

2015-01-10 Thread Xuefu Zhang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/29494/#review67606 --- Ship it! Ship It! - Xuefu Zhang On Jan. 5, 2015, 6:43 p.m., Na

[jira] [Commented] (HIVE-9257) Merge from spark to trunk January 2015

2015-01-10 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14272801#comment-14272801 ] Xuefu Zhang commented on HIVE-9257: --- I reviewed most of patches in Spark branch du

Re: Review Request 29787: HIVE-9257 : Merge spark to trunk January 2015 (Modified files)

2015-01-10 Thread Xuefu Zhang
A followup to get rid of this? ql/src/java/org/apache/hadoop/hive/ql/exec/ExplainTask.java <https://reviews.apache.org/r/29787/#comment111662> We should restrain from using * in imports. - Xuefu Zhang On Jan. 9, 2015, 11:55 p.m., Sze

[jira] [Commented] (HIVE-9335) Address review items on HIVE-9257 [Spark Branch]

2015-01-10 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9335?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14272780#comment-14272780 ] Xuefu Zhang commented on HIVE-9335: --- Patch looks good, except it seems containing

[jira] [Updated] (HIVE-9104) windowing.q failed when mapred.reduce.tasks is set to larger than one

2015-01-10 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9104: -- Component/s: (was: Spark) > windowing.q failed when mapred.reduce.tasks is set to larger than

[jira] [Updated] (HIVE-9104) windowing.q failed when mapred.reduce.tasks is set to larger than one

2015-01-10 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9104: -- Resolution: Fixed Fix Version/s: 0.15.0 Status: Resolved (was: Patch Available

[jira] [Updated] (HIVE-9112) Query may generate different results depending on the number of reducers

2015-01-10 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9112: -- Status: Patch Available (was: Open) > Query may generate different results depending on the number

[jira] [Commented] (HIVE-9104) windowing.q failed when mapred.reduce.tasks is set to larger than one

2015-01-09 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14272299#comment-14272299 ] Xuefu Zhang commented on HIVE-9104: --- [~csun] Could you add a test case in which per

[jira] [Commented] (HIVE-9104) windowing.q failed when mapred.reduce.tasks is set to larger than one

2015-01-09 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14272187#comment-14272187 ] Xuefu Zhang commented on HIVE-9104: --- +1. Code looks reasonable to me. However,

[jira] [Updated] (HIVE-9326) BaseProtocol.Error failed to deserialization due to NPE.[Spark Branch]

2015-01-09 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9326: -- Resolution: Fixed Fix Version/s: spark-branch Status: Resolved (was: Patch Available

[jira] [Commented] (HIVE-9326) BaseProtocol.Error failed to deserialization due to NPE.[Spark Branch]

2015-01-09 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14271772#comment-14271772 ] Xuefu Zhang commented on HIVE-9326: --- +1 > BaseProtocol.Error failed to deserial

[jira] [Comment Edited] (HIVE-9290) Make some test results deterministic

2015-01-09 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14271116#comment-14271116 ] Xuefu Zhang edited comment on HIVE-9290 at 1/9/15 3:42 PM: --

[jira] [Updated] (HIVE-9251) SetSparkReducerParallelism is likely to set too small number of reducers [Spark Branch]

2015-01-09 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9251: -- Resolution: Fixed Fix Version/s: spark-branch Status: Resolved (was: Patch Available

[jira] [Commented] (HIVE-9290) Make some test results deterministic

2015-01-09 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14271116#comment-14271116 ] Xuefu Zhang commented on HIVE-9290: --- I was aware of this but knew Rui was immedia

[jira] [Updated] (HIVE-9290) Make some test results deterministic

2015-01-08 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9290: -- Resolution: Fixed Fix Version/s: 0.15.0 spark-branch Status

[jira] [Commented] (HIVE-9319) Cleanup Modified Files [Spark Branch]

2015-01-08 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14270303#comment-14270303 ] Xuefu Zhang commented on HIVE-9319: --- +1 pending on test > Cleanup Modified Files

Re: Review Request 29733: HIVE-9319 : Cleanup Modified Files [Spark Branch]

2015-01-08 Thread Xuefu Zhang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/29733/#review67348 --- Ship it! Ship It! - Xuefu Zhang On Jan. 9, 2015, 12:01 a.m

[jira] [Updated] (HIVE-9306) Let Context.isLocalOnlyExecutionMode() return false if execution engine is Spark [Spark Branch]

2015-01-08 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9306: -- Resolution: Fixed Fix Version/s: spark-branch Status: Resolved (was: Patch Available

[jira] [Commented] (HIVE-9306) Let Context.isLocalOnlyExecutionMode() return false if execution engine is Spark [Spark Branch]

2015-01-08 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14270202#comment-14270202 ] Xuefu Zhang commented on HIVE-9306: --- Test failure a

[jira] [Updated] (HIVE-9306) Let Context.isLocalOnlyExecutionMode() return false if execution engine is Spark [Spark Branch]

2015-01-08 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9306: -- Attachment: HIVE-9306.3-spark.patch > Let Context.isLocalOnlyExecutionMode() return false if execut

[jira] [Updated] (HIVE-9306) Let Context.isLocalOnlyExecutionMode() return false if execution engine is Spark [Spark Branch]

2015-01-08 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9306: -- Attachment: (was: HIVE-9306.3-spark.patch) > Let Context.isLocalOnlyExecutionMode() return false

[jira] [Updated] (HIVE-9306) Let Context.isLocalOnlyExecutionMode() return false if execution engine is Spark [Spark Branch]

2015-01-08 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9306: -- Attachment: HIVE-9306.3-spark.patch > Let Context.isLocalOnlyExecutionMode() return false if execut

[jira] [Updated] (HIVE-9306) Let Context.isLocalOnlyExecutionMode() return false if execution engine is Spark [Spark Branch]

2015-01-08 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9306: -- Attachment: HIVE-9306.2-spark.patch > Let Context.isLocalOnlyExecutionMode() return false if execut

[jira] [Updated] (HIVE-9267) Ensure custom UDF works with Spark [Spark Branch]

2015-01-08 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9267: -- Resolution: Fixed Fix Version/s: spark-branch Status: Resolved (was: Patch Available

[jira] [Commented] (HIVE-9306) Let Context.isLocalOnlyExecutionMode() return false if execution engine is Spark [Spark Branch]

2015-01-08 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14269409#comment-14269409 ] Xuefu Zhang commented on HIVE-9306: --- fs_default_name2.q output needs to be upd

[jira] [Assigned] (HIVE-9112) Query may generate different results depending on the number of reducers

2015-01-08 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang reassigned HIVE-9112: - Assignee: Ted Xu (was: Chao) Hi [~tedxu], I'm assigning this to you for investigatio

[jira] [Commented] (HIVE-9290) Make some test results deterministic

2015-01-08 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14269371#comment-14269371 ] Xuefu Zhang commented on HIVE-9290: --- +1 > Make some test results determ

[jira] [Comment Edited] (HIVE-9290) Make some test results deterministic

2015-01-08 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14269371#comment-14269371 ] Xuefu Zhang edited comment on HIVE-9290 at 1/8/15 2:37 PM: ---

[jira] [Updated] (HIVE-9293) Cleanup SparkTask getMapWork to skip UnionWork check [Spark Branch]

2015-01-08 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9293: -- Resolution: Fixed Fix Version/s: spark-branch Status: Resolved (was: Patch Available

[jira] [Updated] (HIVE-9301) Potential null dereference in MoveTask#createTargetPath()

2015-01-08 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9301: -- Resolution: Fixed Fix Version/s: 0.15.0 Status: Resolved (was: Patch Available

[jira] [Commented] (HIVE-9293) Cleanup SparkTask getMapWork to skip UnionWork check [Spark Branch]

2015-01-08 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14269352#comment-14269352 ] Xuefu Zhang commented on HIVE-9293: --- +1 > Cleanup SparkTask getMapWork

[jira] [Commented] (HIVE-9251) SetSparkReducerParallelism is likely to set too small number of reducers [Spark Branch]

2015-01-07 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14268841#comment-14268841 ] Xuefu Zhang commented on HIVE-9251: --- It should be okay. Limit is still pushed dow

[jira] [Commented] (HIVE-9290) Make some test results deterministic

2015-01-07 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14268835#comment-14268835 ] Xuefu Zhang commented on HIVE-9290: --- It should be okay. Even though an extra stag

[jira] [Updated] (HIVE-9306) Let Context.isLocalOnlyExecutionMode() return false if execution engine is Spark [Spark Branch]

2015-01-07 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9306: -- Status: Patch Available (was: Open) > Let Context.isLocalOnlyExecutionMode() return false if execut

[jira] [Updated] (HIVE-9306) Let Context.isLocalOnlyExecutionMode() return false if execution engine is Spark [Spark Branch]

2015-01-07 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9306: -- Attachment: HIVE-9306.1-spark.patch > Let Context.isLocalOnlyExecutionMode() return false if execut

[jira] [Created] (HIVE-9306) Let Context.isLocalOnlyExecutionMode() return false if execution engine is Spark [Spark Branch]

2015-01-07 Thread Xuefu Zhang (JIRA)
Xuefu Zhang created HIVE-9306: - Summary: Let Context.isLocalOnlyExecutionMode() return false if execution engine is Spark [Spark Branch] Key: HIVE-9306 URL: https://issues.apache.org/jira/browse/HIVE-9306

[jira] [Commented] (HIVE-9301) Potential null dereference in MoveTask#createTargetPath()

2015-01-07 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14268564#comment-14268564 ] Xuefu Zhang commented on HIVE-9301: --- +1 > Potential null dereference in M

[jira] [Updated] (HIVE-9104) windowing.q failed when mapred.reduce.tasks is set to larger than one

2015-01-07 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9104: -- Affects Version/s: (was: spark-branch) > windowing.q failed when mapred.reduce.tasks is set

[jira] [Commented] (HIVE-9281) Code cleanup [Spark Branch]

2015-01-07 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14268523#comment-14268523 ] Xuefu Zhang commented on HIVE-9281: --- +1 > Code cleanup [Spark

[jira] [Commented] (HIVE-9281) Code cleanup [Spark Branch]

2015-01-07 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14268466#comment-14268466 ] Xuefu Zhang commented on HIVE-9281: --- Could you load both versions to RB so that I

[jira] [Commented] (HIVE-9281) Code cleanup [Spark Branch]

2015-01-07 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14268443#comment-14268443 ] Xuefu Zhang commented on HIVE-9281: --- My eyes got sored after going thru the patch,

[jira] [Commented] (HIVE-9289) TODO : Store user name in session [Spark Branch]

2015-01-07 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14268105#comment-14268105 ] Xuefu Zhang commented on HIVE-9289: --- Maybe I don't fully understand the cod

[jira] [Commented] (HIVE-9251) SetSparkReducerParallelism is likely to set too small number of reducers [Spark Branch]

2015-01-07 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14268017#comment-14268017 ] Xuefu Zhang commented on HIVE-9251: --- Besides HIVE-9290, it seems that golden files

[jira] [Updated] (HIVE-9288) TODO cleanup task1.[Spark Branch]

2015-01-07 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9288: -- Resolution: Fixed Fix Version/s: spark-branch Status: Resolved (was: Patch Available

[jira] [Updated] (HIVE-9110) Performance of SELECT COUNT(*) FROM store_sales WHERE ss_item_sk IS NOT NULL [Spark Branch]

2015-01-07 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9110: -- Assignee: Rui Li (was: Chao) > Performance of SELECT COUNT(*) FROM store_sales WHERE ss_item_sk IS

[jira] [Commented] (HIVE-9288) TODO cleanup task1.[Spark Branch]

2015-01-07 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14267729#comment-14267729 ] Xuefu Zhang commented on HIVE-9288: --- +1 > TODO cleanup task1.[Spark

[jira] [Updated] (HIVE-9288) TODO cleanup task1.[Spark Branch]

2015-01-07 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9288: -- Status: Patch Available (was: Open) > TODO cleanup task1.[Spark Bra

Re: Review Request 29655: HIVE-9288 TODO cleanup task1[Spark Branch]

2015-01-07 Thread Xuefu Zhang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/29655/#review67024 --- Ship it! Ship It! - Xuefu Zhang On Jan. 7, 2015, 9:03 a.m

[jira] [Resolved] (HIVE-9219) Investigate differences for auto join tests in explain after merge from trunk [Spark Branch]

2015-01-07 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang resolved HIVE-9219. --- Resolution: Not a Problem > Investigate differences for auto join tests in explain after merge f

[jira] [Commented] (HIVE-9219) Investigate differences for auto join tests in explain after merge from trunk [Spark Branch]

2015-01-06 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14267299#comment-14267299 ] Xuefu Zhang commented on HIVE-9219: --- [~csun], anything to be done here? If not, we

[jira] [Updated] (HIVE-9243) Static Map in IOContext is not thread safe

2015-01-06 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9243: -- Resolution: Fixed Fix Version/s: 0.15.0 Status: Resolved (was: Patch Available

[jira] [Updated] (HIVE-9154) Cache pathToPartitionInfo in context aware record reader

2015-01-06 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9154: -- Resolution: Fixed Fix Version/s: (was: spark-branch) Status: Resolved (was: Patch

[jira] [Commented] (HIVE-9251) SetSparkReducerParallelism is likely to set too small number of reducers [Spark Branch]

2015-01-06 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14267293#comment-14267293 ] Xuefu Zhang commented on HIVE-9251: --- I see it in the code now. Patch looks good. I

[jira] [Commented] (HIVE-9251) SetSparkReducerParallelism is likely to set too small number of reducers [Spark Branch]

2015-01-06 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14267243#comment-14267243 ] Xuefu Zhang commented on HIVE-9251: --- The patch looks good. One question though: (-1

[jira] [Commented] (HIVE-9251) SetSparkReducerParallelism is likely to set too small number of reducers [Spark Branch]

2015-01-06 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14267223#comment-14267223 ] Xuefu Zhang commented on HIVE-9251: --- Hi Rui, for our unit test, the input size

[jira] [Updated] (HIVE-9267) Ensure custom UDF works with Spark [Spark Branch]

2015-01-06 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9267: -- Status: Patch Available (was: Open) > Ensure custom UDF works with Spark [Spark Bra

[jira] [Updated] (HIVE-9267) Ensure custom UDF works with Spark [Spark Branch]

2015-01-06 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9267: -- Attachment: HIVE-9267.1-spark.patch > Ensure custom UDF works with Spark [Spark Bra

[jira] [Created] (HIVE-9267) Ensure custom UDF works with Spark [Spark Branch]

2015-01-06 Thread Xuefu Zhang (JIRA)
Xuefu Zhang created HIVE-9267: - Summary: Ensure custom UDF works with Spark [Spark Branch] Key: HIVE-9267 URL: https://issues.apache.org/jira/browse/HIVE-9267 Project: Hive Issue Type: Sub-task

[jira] [Commented] (HIVE-6173) Beeline doesn't accept --hiveconf option as Hive CLI does

2015-01-06 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-6173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14266711#comment-14266711 ] Xuefu Zhang commented on HIVE-6173: --- Aha. I see. These undocumented properties, suc

[jira] [Updated] (HIVE-9259) Fix ClassCastException when CBO is enabled for HOS [Spark Branch]

2015-01-05 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9259: -- Summary: Fix ClassCastException when CBO is enabled for HOS [Spark Branch] (was: Fix ClassCastException

<    2   3   4   5   6   7   8   9   10   11   >