[jira] [Commented] (HIVE-8701) Combine nested map joins into the parent map join if possible [Spark Branch]

2014-11-19 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14218875#comment-14218875 ] Suhas Satish commented on HIVE-8701: [~szehon] - Can you illustrate how you plan to

[jira] [Commented] (HIVE-8548) Integrate with remote Spark context after HIVE-8528 [Spark Branch]

2014-11-12 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14208562#comment-14208562 ] Suhas Satish commented on HIVE-8548: HI [~xuefuz] - Regarding unit testing remote-spark

[jira] [Commented] (HIVE-8548) Integrate with remote Spark context after HIVE-8528 [Spark Branch]

2014-11-12 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14208778#comment-14208778 ] Suhas Satish commented on HIVE-8548: Thanks for clarifying [~xuefuz] and [~vanzin]. I

[jira] [Commented] (HIVE-8622) Split map-join plan into 2 SparkTasks in 3 stages [Spark Branch]

2014-11-07 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14202496#comment-14202496 ] Suhas Satish commented on HIVE-8622: [~csun] - We already have a mapr of BaseWork

[jira] [Commented] (HIVE-8700) Replace ReduceSink to HashTableSink (or equi.) for small tables [Spark Branch]

2014-11-06 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14201198#comment-14201198 ] Suhas Satish commented on HIVE-8700: Have a patch which now generates the

[jira] [Commented] (HIVE-8700) Replace ReduceSink to HashTableSink (or equi.) for small tables [Spark Branch]

2014-11-06 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14201199#comment-14201199 ] Suhas Satish commented on HIVE-8700: {code} explain select table1.key, table2.value,

[jira] [Updated] (HIVE-8700) Replace ReduceSink to HashTableSink (or equi.) for small tables [Spark Branch]

2014-11-06 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish updated HIVE-8700: --- Attachment: HIVE-8700.2-spark.patch Replace ReduceSink to HashTableSink (or equi.) for small tables

[jira] [Commented] (HIVE-8700) Replace ReduceSink to HashTableSink (or equi.) for small tables [Spark Branch]

2014-11-06 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14201319#comment-14201319 ] Suhas Satish commented on HIVE-8700: It was an optimization suggested by eclipse to

[jira] [Commented] (HIVE-8621) Dump small table join data for map-join [Spark Branch]

2014-11-06 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14201344#comment-14201344 ] Suhas Satish commented on HIVE-8621: [~jxiang] - Are you sure you are getting any tags

[jira] [Updated] (HIVE-8700) Replace ReduceSink to HashTableSink (or equi.) for small tables [Spark Branch]

2014-11-06 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish updated HIVE-8700: --- Attachment: HIVE-8700.3-spark.patch Replace ReduceSink to HashTableSink (or equi.) for small tables

[jira] [Commented] (HIVE-8700) Replace ReduceSink to HashTableSink (or equi.) for small tables [Spark Branch]

2014-11-06 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14201354#comment-14201354 ] Suhas Satish commented on HIVE-8700: removed in HIVE-8700.3-spark.patch Replace

[jira] [Commented] (HIVE-8700) Replace ReduceSink to HashTableSink (or equi.) for small tables [Spark Branch]

2014-11-06 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14201486#comment-14201486 ] Suhas Satish commented on HIVE-8700: Hi [~csun] I thought the dummyStoreOperators were

[jira] [Commented] (HIVE-8700) Replace ReduceSink to HashTableSink (or equi.) for small tables [Spark Branch]

2014-11-06 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14201604#comment-14201604 ] Suhas Satish commented on HIVE-8700: ah yes. thanks [~csun] Regarding the test

[jira] [Commented] (HIVE-8622) Split map-join plan into 2 SparkTasks in 3 stages [Spark Branch]

2014-11-05 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14198723#comment-14198723 ] Suhas Satish commented on HIVE-8622: I saw this condition in your patch -

[jira] [Updated] (HIVE-8700) Replace ReduceSink to HashTableSink (or equi.) for small tables [Spark Branch]

2014-11-05 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish updated HIVE-8700: --- Attachment: HIVE-8700-spark.patch Replace ReduceSink to HashTableSink (or equi.) for small tables

[jira] [Updated] (HIVE-8700) Replace ReduceSink to HashTableSink (or equi.) for small tables [Spark Branch]

2014-11-05 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish updated HIVE-8700: --- Status: Patch Available (was: Open) Replace ReduceSink to HashTableSink (or equi.) for small tables

[jira] [Commented] (HIVE-8700) Replace ReduceSink to HashTableSink (or equi.) for small tables [Spark Branch]

2014-11-05 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14199000#comment-14199000 ] Suhas Satish commented on HIVE-8700: Attaching a patch that leverages changes from

[jira] [Commented] (HIVE-8622) Split map-join plan into 2 SparkTasks in 3 stages [Spark Branch]

2014-11-05 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14199002#comment-14199002 ] Suhas Satish commented on HIVE-8622: Thanks Chao, I have leveraged some of your work in

[jira] [Commented] (HIVE-8700) Replace ReduceSink to HashTableSink (or equi.) for small tables [Spark Branch]

2014-11-05 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14199011#comment-14199011 ] Suhas Satish commented on HIVE-8700: https://reviews.apache.org/r/27640/ Replace

[jira] [Updated] (HIVE-8621) Dump small table join data for map-join [Spark Branch]

2014-11-04 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish updated HIVE-8621: --- Assignee: (was: Suhas Satish) Dump small table join data for map-join [Spark Branch]

[jira] [Commented] (HIVE-8700) Replace ReduceSink to HashTableSink (or equi.) for small tables [Spark Branch]

2014-11-04 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14197096#comment-14197096 ] Suhas Satish commented on HIVE-8700: Hi Szehon, The patch still needs some work. This

[jira] [Assigned] (HIVE-8700) Replace ReduceSink to HashTableSink (or equi.) for small tables [Spark Branch]

2014-11-03 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish reassigned HIVE-8700: -- Assignee: Suhas Satish (was: Szehon Ho) Replace ReduceSink to HashTableSink (or equi.) for

[jira] [Commented] (HIVE-8700) Replace ReduceSink to HashTableSink (or equi.) for small tables [Spark Branch]

2014-11-03 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14194854#comment-14194854 ] Suhas Satish commented on HIVE-8700: Thank you [~szehon] Replace ReduceSink to

[jira] [Updated] (HIVE-8700) Replace ReduceSink to HashTableSink (or equi.) for small tables [Spark Branch]

2014-11-03 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8700?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish updated HIVE-8700: --- Attachment: HIVE-8700.patch Replace ReduceSink to HashTableSink (or equi.) for small tables [Spark

[jira] [Commented] (HIVE-8700) Replace ReduceSink to HashTableSink (or equi.) for small tables [Spark Branch]

2014-11-03 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14195403#comment-14195403 ] Suhas Satish commented on HIVE-8700: Sure [~szehon]. Attaching my changeset as a patch.

[jira] [Commented] (HIVE-8700) Replace ReduceSink to HashTableSink (or equi.) for small tables [Spark Branch]

2014-11-02 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14193895#comment-14193895 ] Suhas Satish commented on HIVE-8700: Hi Xuefu, I was working on this as apart of

[jira] [Updated] (HIVE-8621) Dump small table join data for map-join [Spark Branch]

2014-10-31 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish updated HIVE-8621: --- Summary: Dump small table join data for map-join [Spark Branch] (was: Dump small table join data into

[jira] [Updated] (HIVE-8621) Dump small table join data for map-join [Spark Branch]

2014-10-31 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish updated HIVE-8621: --- Description: This jira aims to re-use a slightly modified approach of map-reduce distributed cache in

[jira] [Updated] (HIVE-8616) convert joinOp to MapJoinOp and generate MapWorks only [Spark Branch]

2014-10-29 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish updated HIVE-8616: --- Attachment: HIVE-8616.2-spark.patch convert joinOp to MapJoinOp and generate MapWorks only [Spark

[jira] [Commented] (HIVE-8616) convert joinOp to MapJoinOp and generate MapWorks only [Spark Branch]

2014-10-29 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14188061#comment-14188061 ] Suhas Satish commented on HIVE-8616: Addressed review board comments and uploaded

[jira] [Commented] (HIVE-8616) convert joinOp to MapJoinOp and generate MapWorks only [Spark Branch]

2014-10-29 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14189370#comment-14189370 ] Suhas Satish commented on HIVE-8616: Hi Xuefu, Yes most of these failing tests set

[jira] [Updated] (HIVE-8616) convert joinOp to MapJoinOp and generate MapWorks only [Spark Branch]

2014-10-29 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish updated HIVE-8616: --- Attachment: HIVE-8616.3-spark.patch convert joinOp to MapJoinOp and generate MapWorks only [Spark

[jira] [Commented] (HIVE-8621) Dump small table join data into appropriate number of broadcast variables [Spark Branch]

2014-10-29 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14189531#comment-14189531 ] Suhas Satish commented on HIVE-8621: Currently so far in the spark implementation, we

[jira] [Commented] (HIVE-8616) convert joinOp to MapJoinOp and generate MapWorks only [Spark Branch]

2014-10-29 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14189548#comment-14189548 ] Suhas Satish commented on HIVE-8616: Even with this merged into spark branch, the

[jira] [Work started] (HIVE-8621) Dump small table join data into appropriate number of broadcast variables [Spark Branch]

2014-10-29 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HIVE-8621 started by Suhas Satish. -- Dump small table join data into appropriate number of broadcast variables [Spark

[jira] [Created] (HIVE-8616) convert joinOp to MapJoinOp and generate MapWorks only

2014-10-27 Thread Suhas Satish (JIRA)
Suhas Satish created HIVE-8616: -- Summary: convert joinOp to MapJoinOp and generate MapWorks only Key: HIVE-8616 URL: https://issues.apache.org/jira/browse/HIVE-8616 Project: Hive Issue Type:

[jira] [Updated] (HIVE-8616) convert joinOp to MapJoinOp and generate MapWorks only

2014-10-27 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish updated HIVE-8616: --- Attachment: HIVE-8616-spark.patch convert joinOp to MapJoinOp and generate MapWorks only

[jira] [Updated] (HIVE-8616) convert joinOp to MapJoinOp and generate MapWorks only

2014-10-27 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish updated HIVE-8616: --- Status: Patch Available (was: Open) Attached a patch which addresses this sub-task. With this patch

[jira] [Commented] (HIVE-7613) Research optimization of auto convert join to map join [Spark branch]

2014-10-27 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14185878#comment-14185878 ] Suhas Satish commented on HIVE-7613: Submitted patch for HIVE-8616. This can be used as

[jira] [Commented] (HIVE-8616) convert joinOp to MapJoinOp and generate MapWorks only

2014-10-27 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14185886#comment-14185886 ] Suhas Satish commented on HIVE-8616: Review board: https://reviews.apache.org/r/27247/

[jira] [Created] (HIVE-8621) Aggregate all small table join data into 1 broadcast variable

2014-10-27 Thread Suhas Satish (JIRA)
Suhas Satish created HIVE-8621: -- Summary: Aggregate all small table join data into 1 broadcast variable Key: HIVE-8621 URL: https://issues.apache.org/jira/browse/HIVE-8621 Project: Hive Issue

[jira] [Created] (HIVE-8622) Split map-join plan into 2 SparkTasks in 3 stages.

2014-10-27 Thread Suhas Satish (JIRA)
Suhas Satish created HIVE-8622: -- Summary: Split map-join plan into 2 SparkTasks in 3 stages. Key: HIVE-8622 URL: https://issues.apache.org/jira/browse/HIVE-8622 Project: Hive Issue Type: Bug

[jira] [Updated] (HIVE-8622) Split map-join plan into 2 SparkTasks in 3 stages.

2014-10-27 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish updated HIVE-8622: --- Issue Type: Sub-task (was: Bug) Parent: HIVE-7292 Split map-join plan into 2 SparkTasks in 3

[jira] [Created] (HIVE-8623) Implement SparkHashTableLoader for map-join broadcast variable read

2014-10-27 Thread Suhas Satish (JIRA)
Suhas Satish created HIVE-8623: -- Summary: Implement SparkHashTableLoader for map-join broadcast variable read Key: HIVE-8623 URL: https://issues.apache.org/jira/browse/HIVE-8623 Project: Hive

[jira] [Updated] (HIVE-8623) Implement SparkHashTableLoader for map-join broadcast variable read

2014-10-27 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish updated HIVE-8623: --- Issue Type: Sub-task (was: Task) Parent: HIVE-7292 Implement SparkHashTableLoader for

[jira] [Updated] (HIVE-8621) Aggregate all small table join data into 1 broadcast variable

2014-10-27 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish updated HIVE-8621: --- Issue Type: Sub-task (was: Bug) Parent: HIVE-7292 Aggregate all small table join data into 1

[jira] [Commented] (HIVE-8621) Aggregate all small table join data into 1 broadcast variable

2014-10-27 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14185960#comment-14185960 ] Suhas Satish commented on HIVE-8621: Hi Szehon, Yes what you say makes sense. I had not

[jira] [Updated] (HIVE-8621) Aggregate all small table join data into broadcast variables

2014-10-27 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish updated HIVE-8621: --- Summary: Aggregate all small table join data into broadcast variables (was: Aggregate all small table

[jira] [Updated] (HIVE-8621) Aggregate all small table join data into mxn broadcast variables [Spark Branch]

2014-10-27 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish updated HIVE-8621: --- Summary: Aggregate all small table join data into mxn broadcast variables [Spark Branch] (was:

[jira] [Updated] (HIVE-8621) Aggregate all small table join data into mxn broadcast variables [Spark Branch]

2014-10-27 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish updated HIVE-8621: --- Description: In the title of the jira, 'm' is the number of small tables in the (m+1)- way join and

[jira] [Updated] (HIVE-8621) Aggregate all small table join data into m x n broadcast variables [Spark Branch]

2014-10-27 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish updated HIVE-8621: --- Summary: Aggregate all small table join data into m x n broadcast variables [Spark Branch] (was:

[jira] [Updated] (HIVE-8621) Aggregate all small table join data into m x n broadcast variables [Spark Branch]

2014-10-27 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish updated HIVE-8621: --- Description: The number of broadcast variables that must be created is m x n where 'm' is the number

[jira] [Updated] (HIVE-8621) Dump small table join data into appropriate number of broadcast variables [Spark Branch]

2014-10-27 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish updated HIVE-8621: --- Summary: Dump small table join data into appropriate number of broadcast variables [Spark Branch]

[jira] [Commented] (HIVE-8621) Dump small table join data into appropriate number of broadcast variables [Spark Branch]

2014-10-27 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8621?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14186003#comment-14186003 ] Suhas Satish commented on HIVE-8621: Agreed, there was no confusion. Have updated the

[jira] [Commented] (HIVE-7916) Snappy-java error when running hive query on spark [Spark Branch]

2014-10-24 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14183290#comment-14183290 ] Suhas Satish commented on HIVE-7916: Not sure what solved it for you, but setting this

[jira] [Commented] (HIVE-7916) Snappy-java error when running hive query on spark [Spark Branch]

2014-10-17 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14175712#comment-14175712 ] Suhas Satish commented on HIVE-7916: I also hit the following snappy lib exceptions - I

[jira] [Commented] (HIVE-7916) Snappy-java error when running hive query on spark [Spark Branch]

2014-10-17 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14175771#comment-14175771 ] Suhas Satish commented on HIVE-7916: Hitting the same problem with snappy 1.1.1.3 as

[jira] [Commented] (HIVE-7551) expand spark accumulator to support hive counter [Spark Branch]

2014-10-10 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14167997#comment-14167997 ] Suhas Satish commented on HIVE-7551: Xuefu is right, feel free to work on this

[jira] [Created] (HIVE-8243) clone SparkWork for join optimization

2014-09-23 Thread Suhas Satish (JIRA)
Suhas Satish created HIVE-8243: -- Summary: clone SparkWork for join optimization Key: HIVE-8243 URL: https://issues.apache.org/jira/browse/HIVE-8243 Project: Hive Issue Type: Bug

[jira] [Updated] (HIVE-8243) clone SparkWork for join optimization

2014-09-23 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish updated HIVE-8243: --- Issue Type: Sub-task (was: Bug) Parent: HIVE-7292 clone SparkWork for join optimization

[jira] [Commented] (HIVE-8243) clone SparkWork for join optimization

2014-09-23 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14145705#comment-14145705 ] Suhas Satish commented on HIVE-8243: cloning via kryo.copy() as suggested for

[jira] [Commented] (HIVE-7613) Research optimization of auto convert join to map join [Spark branch]

2014-09-18 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14138567#comment-14138567 ] Suhas Satish commented on HIVE-7613: Hi Xuefu, thats a good idea. I was thinking on

[jira] [Commented] (HIVE-7613) Research optimization of auto convert join to map join [Spark branch]

2014-09-18 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14139611#comment-14139611 ] Suhas Satish commented on HIVE-7613: {{ConvertJoinMapJoin}} heavily uses

[jira] [Created] (HIVE-8183) make ConvertJoinMapJoin optimization pluggable for different execution frameworks

2014-09-18 Thread Suhas Satish (JIRA)
Suhas Satish created HIVE-8183: -- Summary: make ConvertJoinMapJoin optimization pluggable for different execution frameworks Key: HIVE-8183 URL: https://issues.apache.org/jira/browse/HIVE-8183 Project:

[jira] [Updated] (HIVE-8183) make ConvertJoinMapJoin optimization pluggable for different execution frameworks

2014-09-18 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish updated HIVE-8183: --- Description: Originally introduced for Tez, ConvertJoinMapJoin heavily uses OptimizeTezProcContext .

[jira] [Updated] (HIVE-8183) make ConvertJoinMapJoin optimization pluggable for different execution frameworks

2014-09-18 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-8183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish updated HIVE-8183: --- Description: Originally introduced for Tez, ConvertJoinMapJoin heavily uses OptimizeTezProcContext .

[jira] [Commented] (HIVE-7613) Research optimization of auto convert join to map join [Spark branch]

2014-09-03 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14120697#comment-14120697 ] Suhas Satish commented on HIVE-7613: as a part of this work, we should also enable

[jira] [Commented] (HIVE-7952) Investigate query failures (1)

2014-09-03 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7952?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14120706#comment-14120706 ] Suhas Satish commented on HIVE-7952: auto_sortmerge_join_1 and auto_sortmerge_join13

[jira] [Commented] (HIVE-7869) Build long running HS2 test framework

2014-09-02 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14118721#comment-14118721 ] Suhas Satish commented on HIVE-7869: thanks Brock. I will continue to add queries to

[jira] [Assigned] (HIVE-7952) Investigate query failures (1)

2014-09-02 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish reassigned HIVE-7952: -- Assignee: Suhas Satish Investigate query failures (1) --

[jira] [Commented] (HIVE-7551) expand spark accumulator to support hive counter [Spark Branch]

2014-08-29 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14115369#comment-14115369 ] Suhas Satish commented on HIVE-7551: Assigning to myself after talking to Na. Is this

[jira] [Assigned] (HIVE-7551) expand spark accumulator to support hive counter [Spark Branch]

2014-08-29 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish reassigned HIVE-7551: -- Assignee: Suhas Satish (was: Na Yang) expand spark accumulator to support hive counter

[jira] [Commented] (HIVE-7775) enable sample8.q.[Spark Branch]

2014-08-29 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14115380#comment-14115380 ] Suhas Satish commented on HIVE-7775: what kind of join did Szehon enable? Does hive on

[jira] [Updated] (HIVE-7869) Long running tests (1) [Spark Branch]

2014-08-29 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish updated HIVE-7869: --- Attachment: HIVE-7869.2-spark.patch Long running tests (1) [Spark Branch]

[jira] [Commented] (HIVE-7869) Long running tests (1) [Spark Branch]

2014-08-29 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14115909#comment-14115909 ] Suhas Satish commented on HIVE-7869: addressed review board comments Long running

[jira] [Updated] (HIVE-7869) Long running tests (1) [Spark Branch]

2014-08-28 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish updated HIVE-7869: --- Status: Patch Available (was: Open) Long running tests (1) [Spark Branch]

[jira] [Updated] (HIVE-7869) Long running tests (1) [Spark Branch]

2014-08-28 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish updated HIVE-7869: --- Attachment: HIVE-7869-spark.patch Long running tests (1) [Spark Branch]

[jira] [Commented] (HIVE-7869) Long running tests (1) [Spark Branch]

2014-08-28 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14114665#comment-14114665 ] Suhas Satish commented on HIVE-7869: https://reviews.apache.org/r/25177/ Long running

[jira] [Commented] (HIVE-7869) Long running tests (1) [Spark Branch]

2014-08-28 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14114696#comment-14114696 ] Suhas Satish commented on HIVE-7869: est failures are not related to the patch. Long

[jira] [Assigned] (HIVE-7869) Long running tests (1) [Spark Branch]

2014-08-25 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish reassigned HIVE-7869: -- Assignee: Suhas Satish Long running tests (1) [Spark Branch]

[jira] [Updated] (HIVE-7821) StarterProject: enable groupby4.q

2014-08-22 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish updated HIVE-7821: --- Status: Patch Available (was: Open) StarterProject: enable groupby4.q

[jira] [Updated] (HIVE-7821) StarterProject: enable groupby4.q

2014-08-22 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish updated HIVE-7821: --- Attachment: HIVE-7821.patch StarterProject: enable groupby4.q -

[jira] [Commented] (HIVE-7821) StarterProject: enable groupby4.q

2014-08-22 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14107319#comment-14107319 ] Suhas Satish commented on HIVE-7821: grouby4 has a deterministic order, so the output

[jira] [Updated] (HIVE-7821) StarterProject: enable groupby4.q

2014-08-22 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish updated HIVE-7821: --- Attachment: HIVE-7821-spark.2.patch StarterProject: enable groupby4.q

[jira] [Commented] (HIVE-7821) StarterProject: enable groupby4.q

2014-08-22 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14107376#comment-14107376 ] Suhas Satish commented on HIVE-7821: Attached updated patch generated with git diff

[jira] [Updated] (HIVE-7821) StarterProject: enable groupby4.q

2014-08-22 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish updated HIVE-7821: --- Attachment: (was: HIVE-7821-spark.2.patch) StarterProject: enable groupby4.q

[jira] [Updated] (HIVE-7821) StarterProject: enable groupby4.q

2014-08-22 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish updated HIVE-7821: --- Attachment: HIVE-7821.2-spark.patch StarterProject: enable groupby4.q

[jira] [Updated] (HIVE-7821) StarterProject: enable groupby4.q

2014-08-22 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish updated HIVE-7821: --- Attachment: HIVE-7821.3-spark.patch StarterProject: enable groupby4.q

[jira] [Updated] (HIVE-7821) StarterProject: enable groupby4.q

2014-08-22 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish updated HIVE-7821: --- Attachment: (was: HIVE-7821.2-spark.patch) StarterProject: enable groupby4.q

[jira] [Commented] (HIVE-7821) StarterProject: enable groupby4.q

2014-08-22 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14107639#comment-14107639 ] Suhas Satish commented on HIVE-7821: rebasing patch StarterProject: enable groupby4.q

[jira] [Updated] (HIVE-7821) StarterProject: enable groupby4.q

2014-08-22 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish updated HIVE-7821: --- Attachment: HIVE-7821.4-spark.patch StarterProject: enable groupby4.q

[jira] [Commented] (HIVE-7821) StarterProject: enable groupby4.q

2014-08-22 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14107795#comment-14107795 ] Suhas Satish commented on HIVE-7821: 4 of the 5 tests are unrelated to SparkCliDriver.

[jira] [Assigned] (HIVE-7821) StarterProject: enable groupby4.q

2014-08-21 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suhas Satish reassigned HIVE-7821: -- Assignee: Suhas Satish (was: Chinna Rao Lalam) StarterProject: enable groupby4.q

[jira] [Commented] (HIVE-5351) Secure-Socket-Layer (SSL) support for HiveServer2

2014-07-02 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14050663#comment-14050663 ] Suhas Satish commented on HIVE-5351: I have used the 3 properties above and started my

[jira] [Commented] (HIVE-4629) HS2 should support an API to retrieve query logs

2014-03-10 Thread Suhas Satish (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13926260#comment-13926260 ] Suhas Satish commented on HIVE-4629: It would be great to have this jira accepted into