[jira] [Commented] (HIVE-9136) Profile query compiler [Spark Branch]

2014-12-18 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14251984#comment-14251984 ] Xuefu Zhang commented on HIVE-9136: --- +1. [~csun], please create the JIRA and lin

[jira] [Updated] (HIVE-9116) Add unit test for multi sessions.[Spark Branch]

2014-12-18 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9116: -- Resolution: Fixed Fix Version/s: spark-branch Status: Resolved (was: Patch Available

[jira] [Commented] (HIVE-9154) Cache pathToPartitionInfo in context aware record reader

2014-12-18 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14251820#comment-14251820 ] Xuefu Zhang commented on HIVE-9154: --- +1 > Cache pathToPartitionInfo in contex

[jira] [Commented] (HIVE-9136) Profile query compiler [Spark Branch]

2014-12-18 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14251798#comment-14251798 ] Xuefu Zhang commented on HIVE-9136: --- Patch looks good to me. However, in SparkComp

Re: Review Request 29198: HIVE-9136 - Profile query compiler [Spark Branch]

2014-12-18 Thread Xuefu Zhang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/29198/#review65497 --- Ship it! Ship It! - Xuefu Zhang On Dec. 18, 2014, 7:36 a.m

[jira] [Commented] (HIVE-9116) Add unit test for multi sessions.[Spark Branch]

2014-12-18 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14251760#comment-14251760 ] Xuefu Zhang commented on HIVE-9116: --- +1 > Add unit test for multi sessions

Re: Review Request 29200: HIVE-9116 Add unit test for multi sessions on Spark.

2014-12-18 Thread Xuefu Zhang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/29200/#review65494 --- Ship it! Ship It! - Xuefu Zhang On Dec. 18, 2014, 9:14 a.m

[jira] [Commented] (HIVE-9153) Evaluate CombineHiveInputFormat versus HiveInputFormat [Spark Branch]

2014-12-18 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14251755#comment-14251755 ] Xuefu Zhang commented on HIVE-9153: --- Thanks for the findings, [~lirui]. I heard that

[jira] [Updated] (HIVE-8722) Enhance InputSplitShims to extend InputSplitWithLocationInfo [Spark Branch]

2014-12-18 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8722: -- Issue Type: Sub-task (was: Improvement) Parent: HIVE-9134 > Enhance InputSplitShims to ext

[jira] [Updated] (HIVE-8920) IOContext problem with multiple MapWorks cloned for multi-insert [Spark Branch]

2014-12-18 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8920: -- Attachment: HIVE-8920.2-spark.patch Patch #2 correct some code styling issue. > IOContext problem w

Re: Review Request 29205: HIVE-8920: IOContext problem with multiple MapWorks cloned for multi-insert [Spark Branch]

2014-12-18 Thread Xuefu Zhang
ql/src/test/results/clientpositive/spark/multi_insert_union_src.q.out PRE-CREATION Diff: https://reviews.apache.org/r/29205/diff/ Testing --- Added a new qtest. Thanks, Xuefu Zhang

Review Request 29205: HIVE-8920: IOContext problem with multiple MapWorks cloned for multi-insert [Spark Branch]

2014-12-18 Thread Xuefu Zhang
/multi_insert_union_src.q.out PRE-CREATION Diff: https://reviews.apache.org/r/29205/diff/ Testing --- Added a new qtest. Thanks, Xuefu Zhang

[jira] [Updated] (HIVE-8920) IOContext problem with multiple MapWorks cloned for multi-insert [Spark Branch]

2014-12-18 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8920: -- Description: The following query will not work: {code} from (select * from table0 union all select

[jira] [Updated] (HIVE-8920) IOContext problem with multiple MapWorks cloned for multi-insert [Spark Branch]

2014-12-18 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8920: -- Summary: IOContext problem with multiple MapWorks cloned for multi-insert [Spark Branch] (was

[jira] [Commented] (HIVE-9094) TimeoutException when trying get executor count from RSC [Spark Branch]

2014-12-18 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14251667#comment-14251667 ] Xuefu Zhang commented on HIVE-9094: --- +1. > TimeoutException when trying get e

Re: Review Request 29145: HIVE-9094 TimeoutException when trying get executor count from RSC [Spark Branch]

2014-12-18 Thread Xuefu Zhang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/29145/#review65489 --- Ship it! Ship It! - Xuefu Zhang On Dec. 18, 2014, 9:40 a.m

[jira] [Updated] (HIVE-8920) SplitSparkWorkResolver doesn't work with UnionWork [Spark Branch]

2014-12-17 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8920: -- Status: Patch Available (was: Open) > SplitSparkWorkResolver doesn't work with UnionWork [Spar

[jira] [Updated] (HIVE-8920) SplitSparkWorkResolver doesn't work with UnionWork [Spark Branch]

2014-12-17 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8920: -- Attachment: (was: HIVE-8920.1-spark.patch) > SplitSparkWorkResolver doesn't work with U

[jira] [Updated] (HIVE-8920) SplitSparkWorkResolver doesn't work with UnionWork [Spark Branch]

2014-12-17 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8920: -- Attachment: HIVE-8920.1-spark.patch > SplitSparkWorkResolver doesn't work with UnionWork [Spar

[jira] [Updated] (HIVE-8920) SplitSparkWorkResolver doesn't work with UnionWork [Spark Branch]

2014-12-17 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8920: -- Attachment: HIVE-8920.1-spark.patch > SplitSparkWorkResolver doesn't work with UnionWork [Spar

[jira] [Created] (HIVE-9157) Merge from trunk to spark 12/17/2014 [Spark Branch]

2014-12-17 Thread Xuefu Zhang (JIRA)
Xuefu Zhang created HIVE-9157: - Summary: Merge from trunk to spark 12/17/2014 [Spark Branch] Key: HIVE-9157 URL: https://issues.apache.org/jira/browse/HIVE-9157 Project: Hive Issue Type: Sub

[jira] [Commented] (HIVE-8920) SplitSparkWorkResolver doesn't work with UnionWork [Spark Branch]

2014-12-17 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14250834#comment-14250834 ] Xuefu Zhang commented on HIVE-8920: --- Even with HIVE-9041, a query like this: {code}

[jira] [Assigned] (HIVE-8920) SplitSparkWorkResolver doesn't work with UnionWork [Spark Branch]

2014-12-17 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang reassigned HIVE-8920: - Assignee: Xuefu Zhang > SplitSparkWorkResolver doesn't work with UnionWork [Spar

[jira] [Commented] (HIVE-9112) Query may generate different results depending on the number of reducers

2014-12-17 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14250761#comment-14250761 ] Xuefu Zhang commented on HIVE-9112: --- [~ashutoshc] and [~rhbutani], do you have any

[jira] [Updated] (HIVE-8843) Release RDD cache when Hive query is done [Spark Branch]

2014-12-17 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8843: -- Resolution: Fixed Fix Version/s: spark-branch Status: Resolved (was: Patch Available

[jira] [Updated] (HIVE-8972) Implement more fine-grained remote client-level events [Spark Branch]

2014-12-17 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8972: -- Resolution: Fixed Fix Version/s: spark-branch Status: Resolved (was: Patch Available

[jira] [Commented] (HIVE-8972) Implement more fine-grained remote client-level events [Spark Branch]

2014-12-17 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14250522#comment-14250522 ] Xuefu Zhang commented on HIVE-8972: --- +1 to the latest patch. [~vanzin], I thin

[jira] [Commented] (HIVE-9127) Improve CombineHiveInputFormat.getSplit performance

2014-12-17 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14250389#comment-14250389 ] Xuefu Zhang commented on HIVE-9127: --- {quote} Please modify the query if the patc

[jira] [Commented] (HIVE-8406) Research on skewed join [Spark Branch]

2014-12-17 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14250088#comment-14250088 ] Xuefu Zhang commented on HIVE-8406: --- [~leftylev], this is just a research task

[jira] [Updated] (HIVE-9059) Remove wrappers for SparkJobInfo and SparkStageInfo [Spark Branch]

2014-12-17 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9059: -- Resolution: Fixed Fix Version/s: spark-branch Status: Resolved (was: Patch Available

[jira] [Updated] (HIVE-9059) Remove wrappers for SparkJobInfo and SparkStageInfo [Spark Branch]

2014-12-17 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9059: -- Summary: Remove wrappers for SparkJobInfo and SparkStageInfo [Spark Branch] (was: Remove wrappers for

[jira] [Created] (HIVE-9145) authorization_admin_almighty1.q fails with result diff [Spark Branch]

2014-12-17 Thread Xuefu Zhang (JIRA)
Xuefu Zhang created HIVE-9145: - Summary: authorization_admin_almighty1.q fails with result diff [Spark Branch] Key: HIVE-9145 URL: https://issues.apache.org/jira/browse/HIVE-9145 Project: Hive

[jira] [Commented] (HIVE-9059) Remove wrappers for SparkJobInfo and SparkStageInfo

2014-12-17 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14249942#comment-14249942 ] Xuefu Zhang commented on HIVE-9059: --- +1 > Remove wrappers for SparkJobI

Re: Review Request 29147: HIVE-9059 Remove wrappers for SparkJobInfo and SparkStageInfo

2014-12-17 Thread Xuefu Zhang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/29147/#review65324 --- Ship it! Ship It! - Xuefu Zhang On Dec. 17, 2014, 7:29 a.m

[jira] [Commented] (HIVE-9094) TimeoutException when trying get executor count from RSC [Spark Branch]

2014-12-17 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14249932#comment-14249932 ] Xuefu Zhang commented on HIVE-9094: --- Minor comments on RB. [~vanzin], could you

Re: Review Request 29145: HIVE-9094 TimeoutException when trying get executor count from RSC [Spark Branch]

2014-12-17 Thread Xuefu Zhang
tps://reviews.apache.org/r/29145/#comment108440> If the same timeout is used for multiple rpc calls, then the description here might need to be updated. - Xuefu Zhang On Dec. 17, 2014, 6:28 a.m., chengxiang li wrote: > > ---

[jira] [Commented] (HIVE-9127) Improve CombineHiveInputFormat.getSplit performance

2014-12-17 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14249916#comment-14249916 ] Xuefu Zhang commented on HIVE-9127: --- +1. Please modify the query if the patch is g

[jira] [Updated] (HIVE-8787) UT: update hive-site.xml for spark UTs to add hive_admin_user to admin role

2014-12-16 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8787: -- Resolution: Fixed Fix Version/s: spark-branch Status: Resolved (was: Patch Available

[jira] [Commented] (HIVE-8843) Release RDD cache when Hive query is done [Spark Branch]

2014-12-16 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14249434#comment-14249434 ] Xuefu Zhang commented on HIVE-8843: --- +1 pending on tests. > Release RDD cache wh

[jira] [Commented] (HIVE-9127) Improve CombineHiveInputFormat.getSplit performance

2014-12-16 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14249427#comment-14249427 ] Xuefu Zhang commented on HIVE-9127: --- Hi [~lirui], I think this JIRA was re-purpose

[jira] [Resolved] (HIVE-8406) Research on skewed join [Spark Branch]

2014-12-16 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang resolved HIVE-8406. --- Resolution: Done Skew join is fully supported in Spark. We close this task as "done". Th

[jira] [Updated] (HIVE-9097) Support runtime skew join for more queries [Spark Branch]

2014-12-16 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9097: -- Resolution: Fixed Fix Version/s: spark-branch Status: Resolved (was: Patch Available

[jira] [Commented] (HIVE-9097) Support runtime skew join for more queries [Spark Branch]

2014-12-16 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14249395#comment-14249395 ] Xuefu Zhang commented on HIVE-9097: --- +1 > Support runtime skew join for more

Re: Review Request 29063: HIVE-8843 Release RDD cache when Hive query is done [Spark Branch]

2014-12-16 Thread Xuefu Zhang
ns the same reference, but that's the implementation. This is just to be on the safe side. ql/src/java/org/apache/hadoop/hive/ql/exec/spark/ShuffleTran.java <https://reviews.apache.org/r/29063/#comment108359> Same as above. - Xuefu Zhang On Dec. 16, 2014, 11:29 p

[jira] [Updated] (HIVE-9041) Generate better plan for queries containing both union and multi-insert [Spark Branch]

2014-12-16 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9041: -- Resolution: Fixed Fix Version/s: spark-branch Status: Resolved (was: Patch Available

[jira] [Created] (HIVE-9139) Clean up GenSparkProcContext.clonedReduceSinks and related code [Spark Branch]

2014-12-16 Thread Xuefu Zhang (JIRA)
Xuefu Zhang created HIVE-9139: - Summary: Clean up GenSparkProcContext.clonedReduceSinks and related code [Spark Branch] Key: HIVE-9139 URL: https://issues.apache.org/jira/browse/HIVE-9139 Project: Hive

[jira] [Commented] (HIVE-9041) Generate better plan for queries containing both union and multi-insert [Spark Branch]

2014-12-16 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14249352#comment-14249352 ] Xuefu Zhang commented on HIVE-9041: --- +1 > Generate better plan for queries con

Re: Review Request 29111: HIVE-9041 - Generate better plan for queries containing both union and multi-insert [Spark Branch]

2014-12-16 Thread Xuefu Zhang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/29111/#review65275 --- Ship it! Ship It! - Xuefu Zhang On Dec. 17, 2014, 12:32 a.m

Re: Review Request 29111: HIVE-9041 - Generate better plan for queries containing both union and multi-insert [Spark Branch]

2014-12-16 Thread Xuefu Zhang
Original name seems more meaningful. ql/src/java/org/apache/hadoop/hive/ql/parse/spark/GenSparkWork.java <https://reviews.apache.org/r/29111/#comment108332> Should we keep it? - Xuefu Zhang On Dec. 16, 2014, 7:02 p.m., Chao Sun wrote: > > --

[jira] [Commented] (HIVE-9127) Improve CombineHiveInputFormat.getSplit performance in RSC [Spark Branch]

2014-12-16 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14248835#comment-14248835 ] Xuefu Zhang commented on HIVE-9127: --- [~brocknoland], thanks for working on this. A b

Re: How to debug hive unit test in eclipse ?

2014-12-16 Thread Xuefu Zhang
Besides running the test in eclipse (if possible), the other way to do is to enable debug for sure-fire and connect it with eclipse using remote application debugging. http://maven.apache.org/surefire/maven-surefire-plugin/examples/debugging.html --Xuefu On Tue, Dec 16, 2014 at 12:17 AM, Jeff Z

[jira] [Updated] (HIVE-9101) bucket_map_join_spark4.q failed due to NPE.[Spark Branch]

2014-12-15 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9101: -- Resolution: Fixed Status: Resolved (was: Patch Available) Committed to Spark branch. Thanks

[jira] [Commented] (HIVE-9101) bucket_map_join_spark4.q failed due to NPE.[Spark Branch]

2014-12-15 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14247775#comment-14247775 ] Xuefu Zhang commented on HIVE-9101: --- +1 > bucket_map_join_spark4.q failed due

[jira] [Commented] (HIVE-9041) Generate better plan for queries containing both union and multi-insert [Spark Branch]

2014-12-15 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14247767#comment-14247767 ] Xuefu Zhang commented on HIVE-9041: --- [~csun], when the patch is ready to be revi

[jira] [Updated] (HIVE-8787) UT: update hive-site.xml for spark UTs to add hive_admin_user to admin role

2014-12-15 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8787: -- Attachment: HIVE-8787.2-spark.patch > UT: update hive-site.xml for spark UTs to add hive_admin_user

[jira] [Commented] (HIVE-8787) UT: update hive-site.xml for spark UTs to add hive_admin_user to admin role

2014-12-15 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14247742#comment-14247742 ] Xuefu Zhang commented on HIVE-8787: --- I don't think any of the test failure is r

[jira] [Commented] (HIVE-8843) Release RDD cache when Hive query is done [Spark Branch]

2014-12-15 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14247735#comment-14247735 ] Xuefu Zhang commented on HIVE-8843: --- [~jxiang], thanks for working on this. The ch

[jira] [Comment Edited] (HIVE-9113) Explain on query failed with NPE

2014-12-15 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14247713#comment-14247713 ] Xuefu Zhang edited comment on HIVE-9113 at 12/16/14 4:0

[jira] [Comment Edited] (HIVE-9113) Explain on query failed with NPE

2014-12-15 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14247713#comment-14247713 ] Xuefu Zhang edited comment on HIVE-9113 at 12/16/14 4:0

[jira] [Commented] (HIVE-9113) Explain on query failed with NPE

2014-12-15 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14247713#comment-14247713 ] Xuefu Zhang commented on HIVE-9113: --- The correct syntax for subquery in from claus

[jira] [Updated] (HIVE-9084) Investigate IOContext object initialization problem [Spark Branch]

2014-12-15 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9084: -- Attachment: HIVE-9084.4-spark.patch > Investigate IOContext object initialization problem [Spark Bra

[jira] [Updated] (HIVE-8787) UT: update hive-site.xml for spark UTs to add hive_admin_user to admin role

2014-12-15 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8787: -- Attachment: HIVE-8787.1-spark.patch > UT: update hive-site.xml for spark UTs to add hive_admin_user

[jira] [Updated] (HIVE-8787) UT: update hive-site.xml for spark UTs to add hive_admin_user to admin role

2014-12-15 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8787: -- Status: Patch Available (was: Open) > UT: update hive-site.xml for spark UTs to add hive_admin_user

[jira] [Commented] (HIVE-9026) Re-enable remaining tests after HIVE-8970 [Spark Branch]

2014-12-15 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9026?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14247341#comment-14247341 ] Xuefu Zhang commented on HIVE-9026: --- Not sure what you meant. The test should

[jira] [Updated] (HIVE-9094) TimeoutException when trying get executor count from RSC [Spark Branch]

2014-12-15 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9094: -- Summary: TimeoutException when trying get executor count from RSC [Spark Branch] (was: join25.q fails

[jira] [Updated] (HIVE-9099) infer_bucket_sort_convert_join.q and mapjoin_hook.q failed.[Spark Branch]

2014-12-15 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9099: -- Resolution: Fixed Fix Version/s: spark-branch Status: Resolved (was: Patch Available

[jira] [Commented] (HIVE-9099) infer_bucket_sort_convert_join.q and mapjoin_hook.q failed.[Spark Branch]

2014-12-15 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14247251#comment-14247251 ] Xuefu Zhang commented on HIVE-9099: --- None of the test failures are related to this p

[jira] [Commented] (HIVE-9094) join25.q fails because of timeout when trying get executor count from RSC [Spark Branch]

2014-12-15 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14247237#comment-14247237 ] Xuefu Zhang commented on HIVE-9094: --- This happens fairly frequently. Here is ano

[jira] [Comment Edited] (HIVE-9094) join25.q fails because of timeout when trying get executor count from RSC [Spark Branch]

2014-12-15 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14247237#comment-14247237 ] Xuefu Zhang edited comment on HIVE-9094 at 12/15/14 9:1

[jira] [Updated] (HIVE-9084) Investigate IOContext object initialization problem [Spark Branch]

2014-12-15 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9084: -- Attachment: HIVE-9084.4-spark.patch > Investigate IOContext object initialization problem [Spark Bra

[jira] [Created] (HIVE-9103) Support backup task for join related optimization [Spark Branch]

2014-12-15 Thread Xuefu Zhang (JIRA)
Xuefu Zhang created HIVE-9103: - Summary: Support backup task for join related optimization [Spark Branch] Key: HIVE-9103 URL: https://issues.apache.org/jira/browse/HIVE-9103 Project: Hive Issue

[jira] [Comment Edited] (HIVE-9099) infer_bucket_sort_convert_join.q and mapjoin_hook.q failed.[Spark Branch]

2014-12-15 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14246932#comment-14246932 ] Xuefu Zhang edited comment on HIVE-9099 at 12/15/14 6:1

[jira] [Commented] (HIVE-9099) infer_bucket_sort_convert_join.q and mapjoin_hook.q failed.[Spark Branch]

2014-12-15 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14246932#comment-14246932 ] Xuefu Zhang commented on HIVE-9099: --- Patch disables the two tests. We will crea

[jira] [Assigned] (HIVE-9099) infer_bucket_sort_convert_join.q and mapjoin_hook.q failed.[Spark Branch]

2014-12-15 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang reassigned HIVE-9099: - Assignee: Xuefu Zhang > infer_bucket_sort_convert_join.q and mapjoin_hook.q failed.[Spark Bra

[jira] [Updated] (HIVE-9099) infer_bucket_sort_convert_join.q and mapjoin_hook.q failed.[Spark Branch]

2014-12-15 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9099: -- Status: Patch Available (was: Open) > infer_bucket_sort_convert_join.q and mapjoin_hook.q failed.[Sp

[jira] [Updated] (HIVE-9099) infer_bucket_sort_convert_join.q and mapjoin_hook.q failed.[Spark Branch]

2014-12-15 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9099: -- Attachment: HIVE-9099.1-spark.patch > infer_bucket_sort_convert_join.q and mapjoin_hook.q failed.[Sp

[jira] [Updated] (HIVE-9084) Investigate IOContext object initialization problem [Spark Branch]

2014-12-15 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9084: -- Attachment: HIVE-9084.3-spark.patch > Investigate IOContext object initialization problem [Spark Bra

[jira] [Updated] (HIVE-9078) Hive should not submit second SparkTask while previous one has failed.[Spark Branch]

2014-12-15 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9078: -- Resolution: Fixed Fix Version/s: spark-branch Status: Resolved (was: Patch Available

[jira] [Commented] (HIVE-9078) Hive should not submit second SparkTask while previous one has failed.[Spark Branch]

2014-12-15 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14246716#comment-14246716 ] Xuefu Zhang commented on HIVE-9078: --- +1 > Hive should not submit second SparkTas

Re: Review Request 28934: HIVE-9078 Hive should not submit second SparkTask while previous one has failed.[Spark Branch]

2014-12-15 Thread Xuefu Zhang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28934/#review65087 --- Ship it! Ship It! - Xuefu Zhang On Dec. 15, 2014, 8:08 a.m

[jira] [Updated] (HIVE-9098) Check cross product for conditional task [Spark Branch]

2014-12-15 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9098: -- Resolution: Fixed Fix Version/s: spark-branch Status: Resolved (was: Patch Available

[jira] [Comment Edited] (HIVE-9101) bucket_map_join_spark4.q failed due to NPE.[Spark Branch]

2014-12-15 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14246630#comment-14246630 ] Xuefu Zhang edited comment on HIVE-9101 at 12/15/14 2:4

[jira] [Commented] (HIVE-9098) Check cross product for conditional task [Spark Branch]

2014-12-15 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9098?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14246678#comment-14246678 ] Xuefu Zhang commented on HIVE-9098: --- +1 > Check cross product for condition

[jira] [Commented] (HIVE-7816) Enable map-join tests which Tez executes [Spark Branch]

2014-12-14 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14246271#comment-14246271 ] Xuefu Zhang commented on HIVE-7816: --- Sorry, Rui. Now we have to do it as a foll

[jira] [Updated] (HIVE-7816) Enable map-join tests which Tez executes [Spark Branch]

2014-12-14 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-7816: -- Resolution: Fixed Fix Version/s: spark-branch Status: Resolved (was: Patch Available

[jira] [Commented] (HIVE-7816) Enable map-join tests which Tez executes [Spark Branch]

2014-12-14 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14246264#comment-14246264 ] Xuefu Zhang commented on HIVE-7816: --- +1. Since the test has passed, I suggest w

[jira] [Updated] (HIVE-9078) Hive should not submit second SparkTask while previous one has failed.[Spark Branch]

2014-12-13 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9078: -- Attachment: (was: HIVE-9078.2-spark.patch) > Hive should not submit second SparkTask while previ

[jira] [Updated] (HIVE-9078) Hive should not submit second SparkTask while previous one has failed.[Spark Branch]

2014-12-13 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9078: -- Attachment: (was: HIVE-9078.1-spark.patch) > Hive should not submit second SparkTask while previ

[jira] [Updated] (HIVE-9078) Hive should not submit second SparkTask while previous one has failed.[Spark Branch]

2014-12-13 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9078: -- Attachment: HIVE-9078.2-spark.patch > Hive should not submit second SparkTask while previous one

[jira] [Updated] (HIVE-9078) Hive should not submit second SparkTask while previous one has failed.[Spark Branch]

2014-12-13 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9078: -- Attachment: (was: HIVE-9078.2-spark.patch) > Hive should not submit second SparkTask while previ

[jira] [Updated] (HIVE-7816) Enable map-join tests which Tez executes [Spark Branch]

2014-12-13 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-7816: -- Attachment: (was: HIVE-7816.1-spark.patch) > Enable map-join tests which Tez executes [Spark Bra

[jira] [Updated] (HIVE-7816) Enable map-join tests which Tez executes [Spark Branch]

2014-12-13 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-7816: -- Attachment: (was: HIVE-7816.1-spark.patch) > Enable map-join tests which Tez executes [Spark Bra

[jira] [Updated] (HIVE-7816) Enable map-join tests which Tez executes [Spark Branch]

2014-12-13 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-7816: -- Attachment: HIVE-7816.1-spark.patch > Enable map-join tests which Tez executes [Spark Bra

[jira] [Updated] (HIVE-9079) Hive hangs while failed to get executorCount[Spark Branch]

2014-12-13 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9079: -- Attachment: HIVE-9079.1-spark.patch > Hive hangs while failed to get executorCount[Spark Bra

[jira] [Commented] (HIVE-9059) Remove wrappers for SparkJobInfo and SparkStageInfo

2014-12-13 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14245495#comment-14245495 ] Xuefu Zhang commented on HIVE-9059: --- [~chengxiang li], the patch seems making the p

[jira] [Updated] (HIVE-8911) Enable mapjoin hints [Spark Branch]

2014-12-13 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-8911: -- Resolution: Fixed Fix Version/s: spark-branch Status: Resolved (was: Patch Available

[jira] [Updated] (HIVE-9084) Investigate IOContext object initialization problem [Spark Branch]

2014-12-13 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9084?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9084: -- Attachment: HIVE-9084.2-spark.patch > Investigate IOContext object initialization problem [Spark Bra

[jira] [Updated] (HIVE-9059) Remove wrappers for SparkJobInfo and SparkStageInfo

2014-12-13 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9059: -- Description: SPARK-4567 is resolved. We can remove the wrappers we added to solve the serailization

[jira] [Updated] (HIVE-9059) Remove wrappers for SparkJobInfo and SparkStageInfo

2014-12-13 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-9059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuefu Zhang updated HIVE-9059: -- Attachment: HIVE-9059.1-spark.patch > Remove wrappers for SparkJobInfo and SparkStageI

[jira] [Commented] (HIVE-8911) Enable mapjoin hints [Spark Branch]

2014-12-13 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14245386#comment-14245386 ] Xuefu Zhang commented on HIVE-8911: --- ppd_join4 and smb_mapjoin_25 are not related,

<    4   5   6   7   8   9   10   11   12   13   >