[jira] [Commented] (HIVE-5718) Support direct fetch for lateral views, sub queries, etc.

2014-08-05 Thread Gopal V (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14085851#comment-14085851 ] Gopal V commented on HIVE-5718: --- +1, LGTM. I suggest leaving some comments about the

Re: Review Request 23351: Support direct fetch for lateral views, sub queries, etc.

2014-08-05 Thread Gopal V
On Aug. 1, 2014, 6:21 a.m., Gopal V wrote: ql/src/java/org/apache/hadoop/hive/ql/optimizer/SimpleFetchOptimizer.java, line 161 https://reviews.apache.org/r/23351/diff/1/?file=626500#file626500line161 This needs some comments, because I'm lost on what this exactly does. Navis

Re: Review Request 23351: Support direct fetch for lateral views, sub queries, etc.

2014-08-05 Thread Gopal V
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/23351/#review49569 --- Ship it! Ship It! - Gopal V On July 9, 2014, 6:55 a.m., Navis

[jira] [Updated] (HIVE-7607) Spark Explain should give useful information on dependencies

2014-08-05 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao updated HIVE-7607: --- Status: Patch Available (was: Open) Spark Explain should give useful information on dependencies

[jira] [Commented] (HIVE-7606) Design SparkSession, SparkSessionManager

2014-08-05 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14085853#comment-14085853 ] Xuefu Zhang commented on HIVE-7606: --- Yes, smaller tasks make sense as long as the scope

Re: Review Request 24297: Spark Explain should give useful information on dependencies

2014-08-05 Thread Chao Sun
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/24297/ --- (Updated Aug. 5, 2014, 6:09 a.m.) Review request for hive and Brock Noland.

Re: Review Request 24297: Spark Explain should give useful information on dependencies

2014-08-05 Thread Brock Noland
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/24297/#review49570 --- Hi Chao, Can you share what the output looks like with the patch?

[jira] [Commented] (HIVE-7584) Change SparkCompiler to generate a SparkWork that contains UnionWork from logical operator tree

2014-08-05 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14085860#comment-14085860 ] Szehon Ho commented on HIVE-7584: - Hi Na, as per my understanding the patch has to be

Re: Review Request 24221: HIVE-7567, support automatic adjusting reducer number for hive on spark job

2014-08-05 Thread Lars Francke
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/24221/#review49565 --- Ship it! A few more minor code style issues, apart from that it

[jira] [Updated] (HIVE-7589) Some fixes and improvements to statistics annotation rules

2014-08-05 Thread Prasanth J (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth J updated HIVE-7589: - Attachment: HIVE-7589.4.patch Rebased patch after HIVE-7587 commit. Some fixes and improvements to

[jira] [Created] (HIVE-7612) Add link to parent vertex to mapjoin in explain

2014-08-05 Thread Gunther Hagleitner (JIRA)
Gunther Hagleitner created HIVE-7612: Summary: Add link to parent vertex to mapjoin in explain Key: HIVE-7612 URL: https://issues.apache.org/jira/browse/HIVE-7612 Project: Hive Issue

[jira] [Updated] (HIVE-7612) Add link to parent vertex to mapjoin in explain

2014-08-05 Thread Gunther Hagleitner (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gunther Hagleitner updated HIVE-7612: - Attachment: HIVE-7612.1.patch Add link to parent vertex to mapjoin in explain

[jira] [Commented] (HIVE-7540) NotSerializableException encountered when using sortByKey transformation

2014-08-05 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14085875#comment-14085875 ] Xuefu Zhang commented on HIVE-7540: --- Here is what I have in mind: 1. per-row

Re: Review Request 24297: Spark Explain should give useful information on dependencies

2014-08-05 Thread Chao Sun
On Aug. 5, 2014, 6:15 a.m., Brock Noland wrote: Hi Chao, Can you share what the output looks like with the patch? Hive has thousands of .q file tests (https://github.com/apache/hive/tree/trunk/ql/src/test/queries/clientpositive) and most of them do an EXPLAIN. Thus I think

[jira] [Resolved] (HIVE-7612) Add link to parent vertex to mapjoin in explain

2014-08-05 Thread Gunther Hagleitner (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gunther Hagleitner resolved HIVE-7612. -- Resolution: Fixed Committed to branch. Add link to parent vertex to mapjoin in

[jira] [Created] (HIVE-7613) Research and verify optimization of auto convert join to map join[Spark branch]

2014-08-05 Thread Chengxiang Li (JIRA)
Chengxiang Li created HIVE-7613: --- Summary: Research and verify optimization of auto convert join to map join[Spark branch] Key: HIVE-7613 URL: https://issues.apache.org/jira/browse/HIVE-7613 Project:

[jira] [Commented] (HIVE-7540) NotSerializableException encountered when using sortByKey transformation

2014-08-05 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14085889#comment-14085889 ] Brock Noland commented on HIVE-7540: bq. the proposed workaround mentioned above seems

[jira] [Commented] (HIVE-7405) Vectorize GROUP BY on the Reduce-Side (Part 1 – Basic)

2014-08-05 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14085895#comment-14085895 ] Hive QA commented on HIVE-7405: --- {color:red}Overall{color}: -1 at least one tests failed

Re: Review Request 24289: MetadataUpdater: provide a mechanism to edit the statistics of a column in a table (or a partition of a table)

2014-08-05 Thread Lars Francke
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/24289/#review49571 --- I've only done a partial review as there seem to be a lot of minor

[jira] [Commented] (HIVE-7540) NotSerializableException encountered when using sortByKey transformation

2014-08-05 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14085898#comment-14085898 ] Xuefu Zhang commented on HIVE-7540: --- I'd be happy as long as we're not taking the

[jira] [Commented] (HIVE-7506) MetadataUpdater: provide a mechanism to edit the statistics of a column in a table (or a partition of a table)

2014-08-05 Thread Lars Francke (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14085905#comment-14085905 ] Lars Francke commented on HIVE-7506: Pengcheng, thanks for providing a new review and

[jira] [Created] (HIVE-7614) Find solution for closures containing writables

2014-08-05 Thread Brock Noland (JIRA)
Brock Noland created HIVE-7614: -- Summary: Find solution for closures containing writables Key: HIVE-7614 URL: https://issues.apache.org/jira/browse/HIVE-7614 Project: Hive Issue Type: Sub-task

[jira] [Commented] (HIVE-7614) Find solution for closures containing writables

2014-08-05 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14085906#comment-14085906 ] Brock Noland commented on HIVE-7614: [~xuefuz] [~lirui] [~sandyr] Find solution for

[jira] [Commented] (HIVE-7614) Find solution for closures containing writables

2014-08-05 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14085908#comment-14085908 ] Brock Noland commented on HIVE-7614: Three solutions discussed in HIVE-7540: # Convert

[jira] [Commented] (HIVE-7540) NotSerializableException encountered when using sortByKey transformation

2014-08-05 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14085910#comment-14085910 ] Xuefu Zhang commented on HIVE-7540: --- BTW, if we are just looking for a workaround that

[jira] [Commented] (HIVE-7540) NotSerializableException encountered when using sortByKey transformation

2014-08-05 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14085912#comment-14085912 ] Brock Noland commented on HIVE-7540: Agreed 100%. In my original statement I said, we'd

[jira] [Commented] (HIVE-7614) Find solution for closures containing writables

2014-08-05 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14085911#comment-14085911 ] Brock Noland commented on HIVE-7614: Warts for all three: 1. Is expensive and is

[jira] [Comment Edited] (HIVE-7540) NotSerializableException encountered when using sortByKey transformation

2014-08-05 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14085912#comment-14085912 ] Brock Noland edited comment on HIVE-7540 at 8/5/14 7:13 AM: bq.

Re: Review Request 24221: HIVE-7567, support automatic adjusting reducer number for hive on spark job

2014-08-05 Thread chengxiang li
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/24221/ --- (Updated Aug. 5, 2014, 7:14 a.m.) Review request for hive, Brock Noland, Lars

[jira] [Updated] (HIVE-7567) support automatic calculating reduce task number [Spark Branch]

2014-08-05 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-7567: Attachment: HIVE-7567.5-spark.patch rebase the branch and update patch. support automatic

Re: Review Request 24221: HIVE-7567, support automatic adjusting reducer number for hive on spark job

2014-08-05 Thread chengxiang li
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/24221/ --- (Updated Aug. 5, 2014, 7:19 a.m.) Review request for hive, Brock Noland, Lars

[jira] [Commented] (HIVE-7540) NotSerializableException encountered when using sortByKey transformation

2014-08-05 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14085921#comment-14085921 ] Brock Noland commented on HIVE-7540: bq. BTW, if we are just looking for a workaround

[jira] [Updated] (HIVE-7567) support automatic calculating reduce task number [Spark Branch]

2014-08-05 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-7567: Attachment: HIVE-7567.6-spark.patch fix minor style issues. support automatic calculating reduce

[jira] [Commented] (HIVE-7614) Find solution for closures containing writables

2014-08-05 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14085923#comment-14085923 ] Brock Noland commented on HIVE-7614: From my side, the ideal solution is 2. Kryo is

[jira] [Commented] (HIVE-7348) Beeline could not parse ; separated queries provided with -e option

2014-08-05 Thread Lefty Leverenz (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14085924#comment-14085924 ] Lefty Leverenz commented on HIVE-7348: -- Support for multiple -e options should be

[jira] [Updated] (HIVE-7613) Research and verify optimization of auto convert join to map join[Spark branch]

2014-08-05 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-7613: Description: ConvertJoinMapJoin is an optimization the replaces a common join(aka shuffle join)

[jira] [Updated] (HIVE-7613) Research optimization of auto convert join to map join[Spark branch]

2014-08-05 Thread Chengxiang Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengxiang Li updated HIVE-7613: Issue Type: Task (was: Bug) Summary: Research optimization of auto convert join to map

[jira] [Commented] (HIVE-7348) Beeline could not parse ; separated queries provided with -e option

2014-08-05 Thread Lars Francke (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14085935#comment-14085935 ] Lars Francke commented on HIVE-7348: {code:java}

Re: Review Request 24221: HIVE-7567, support automatic adjusting reducer number for hive on spark job

2014-08-05 Thread Lars Francke
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/24221/#review49574 --- Ship it! Ship It! - Lars Francke On Aug. 5, 2014, 7:19 a.m.,

[jira] [Commented] (HIVE-7348) Beeline could not parse ; separated queries provided with -e option

2014-08-05 Thread Lefty Leverenz (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14085942#comment-14085942 ] Lefty Leverenz commented on HIVE-7348: -- Well done, Lars. (This time you beat me to

[jira] [Commented] (HIVE-7613) Research optimization of auto convert join to map join[Spark branch]

2014-08-05 Thread Xuefu Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14085956#comment-14085956 ] Xuefu Zhang commented on HIVE-7613: --- Thanks for logging this, [~chengxiang li]. This is a

[jira] [Commented] (HIVE-7605) add more javadoc to HivePrivilegeObject

2014-08-05 Thread Lefty Leverenz (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14085958#comment-14085958 ] Lefty Leverenz commented on HIVE-7605: -- One nitpick and one possible typo in patch 1:

[jira] [Commented] (HIVE-7527) Support order by and sort by on Spark

2014-08-05 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14085961#comment-14085961 ] Hive QA commented on HIVE-7527: --- {color:red}Overall{color}: -1 at least one tests failed

[jira] [Commented] (HIVE-7426) ClassCastException: ...IntWritable cannot be cast to ...Text involving ql.udf.generic.GenericUDFBasePad.evaluate

2014-08-05 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14085968#comment-14085968 ] Hive QA commented on HIVE-7426: --- {color:red}Overall{color}: -1 at least one tests failed

[jira] [Commented] (HIVE-6584) Add HiveHBaseTableSnapshotInputFormat

2014-08-05 Thread Lefty Leverenz (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-6584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14085973#comment-14085973 ] Lefty Leverenz commented on HIVE-6584: -- Does this need to be documented in the wiki?

[jira] [Commented] (HIVE-7540) NotSerializableException encountered when using sortByKey transformation

2014-08-05 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14086005#comment-14086005 ] Sandy Ryza commented on HIVE-7540: -- Just to make sure, was Kryo serialization turned on

[jira] [Updated] (HIVE-6959) Remove vectorization related constant expression folding code once Constant propagation optimizer for Hive is committed

2014-08-05 Thread Hari Sankar Sivarama Subramaniyan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-6959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hari Sankar Sivarama Subramaniyan updated HIVE-6959: Status: In Progress (was: Patch Available) Remove

[jira] [Updated] (HIVE-6959) Remove vectorization related constant expression folding code once Constant propagation optimizer for Hive is committed

2014-08-05 Thread Hari Sankar Sivarama Subramaniyan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-6959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hari Sankar Sivarama Subramaniyan updated HIVE-6959: Status: Patch Available (was: In Progress) Remove

[jira] [Commented] (HIVE-7540) NotSerializableException encountered when using sortByKey transformation

2014-08-05 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14086009#comment-14086009 ] Sandy Ryza commented on HIVE-7540: -- Actually, this handling hasn't made it into a release

[jira] [Commented] (HIVE-7540) NotSerializableException encountered when using sortByKey transformation

2014-08-05 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14086011#comment-14086011 ] Brock Noland commented on HIVE-7540: Nice, the fix might already be in place. Let's

[jira] [Commented] (HIVE-7540) NotSerializableException encountered when using sortByKey transformation

2014-08-05 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14086012#comment-14086012 ] Rui Li commented on HIVE-7540: -- Hi [~sandyr], I set spark.serializer to KryoSerializer when I

[jira] [Created] (HIVE-7615) Beeline should have an option for user to see the query progress

2014-08-05 Thread Dong Chen (JIRA)
Dong Chen created HIVE-7615: --- Summary: Beeline should have an option for user to see the query progress Key: HIVE-7615 URL: https://issues.apache.org/jira/browse/HIVE-7615 Project: Hive Issue

Re: Review Request 24293: HIVE-4629: HS2 should support an API to retrieve query logs

2014-08-05 Thread Lars Francke
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/24293/#review49573 --- Thanks for taking care of this patch. I think the interface design

[jira] [Commented] (HIVE-7540) NotSerializableException encountered when using sortByKey transformation

2014-08-05 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14086035#comment-14086035 ] Brock Noland commented on HIVE-7540: Hi [~lirui], it seems in Spark 1.1

[jira] [Commented] (HIVE-4064) Handle db qualified names consistently across all HiveQL statements

2014-08-05 Thread Chun Chen (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14086043#comment-14086043 ] Chun Chen commented on HIVE-4064: - [~navis] It seems the patch doesn't cover alter db.table

[jira] [Commented] (HIVE-4064) Handle db qualified names consistently across all HiveQL statements

2014-08-05 Thread Chun Chen (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14086048#comment-14086048 ] Chun Chen commented on HIVE-4064: - MySQL also support rename table to a different database

[jira] [Assigned] (HIVE-7403) stats are not updated correctly after doing insert into table

2014-08-05 Thread Vasanth kumar RJ (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vasanth kumar RJ reassigned HIVE-7403: -- Assignee: Vasanth kumar RJ stats are not updated correctly after doing insert into

[jira] [Updated] (HIVE-7403) stats are not updated correctly after doing insert into table

2014-08-05 Thread Vasanth kumar RJ (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vasanth kumar RJ updated HIVE-7403: --- Attachment: HIVE-7403.patch stats are not updated correctly after doing insert into table

[jira] [Updated] (HIVE-7403) stats are not updated correctly after doing insert into table

2014-08-05 Thread Vasanth kumar RJ (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7403?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vasanth kumar RJ updated HIVE-7403: --- Status: Patch Available (was: Open) stats are not updated correctly after doing insert into

[jira] [Commented] (HIVE-7540) NotSerializableException encountered when using sortByKey transformation

2014-08-05 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14086059#comment-14086059 ] Rui Li commented on HIVE-7540: -- Oh sure. It's great if that's already fixed.

[jira] [Commented] (HIVE-7607) Spark Explain should give useful information on dependencies

2014-08-05 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14086081#comment-14086081 ] Hive QA commented on HIVE-7607: --- {color:red}Overall{color}: -1 at least one tests failed

[jira] [Commented] (HIVE-7513) Add ROW__ID VirtualColumn

2014-08-05 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14086106#comment-14086106 ] Hive QA commented on HIVE-7513: --- {color:red}Overall{color}: -1 at least one tests failed

[jira] [Commented] (HIVE-7540) NotSerializableException encountered when using sortByKey transformation

2014-08-05 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14086121#comment-14086121 ] Rui Li commented on HIVE-7540: -- I've tested with spark 1.1 branch, and verified the

[jira] [Commented] (HIVE-7609) Collect partition level stats by default

2014-08-05 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14086266#comment-14086266 ] Hive QA commented on HIVE-7609: --- {color:red}Overall{color}: -1 at least one tests failed

[jira] [Commented] (HIVE-6584) Add HiveHBaseTableSnapshotInputFormat

2014-08-05 Thread Carter Shanklin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-6584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14086306#comment-14086306 ] Carter Shanklin commented on HIVE-6584: --- I had to read the source code to get it to

[jira] [Resolved] (HIVE-7614) Find solution for closures containing writables

2014-08-05 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland resolved HIVE-7614. Resolution: Fixed As described in HIVE-7540 Spark 1.1 already implements 3. Find solution for

[jira] [Reopened] (HIVE-7614) Find solution for closures containing writables

2014-08-05 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland reopened HIVE-7614: Find solution for closures containing writables ---

[jira] [Resolved] (HIVE-7614) Find solution for closures containing writables

2014-08-05 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brock Noland resolved HIVE-7614. Resolution: Duplicate Find solution for closures containing writables

[jira] [Commented] (HIVE-7540) NotSerializableException encountered when using sortByKey transformation

2014-08-05 Thread Brock Noland (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14086326#comment-14086326 ] Brock Noland commented on HIVE-7540: Yes, since Spark has already implemented the point

[jira] [Commented] (HIVE-6584) Add HiveHBaseTableSnapshotInputFormat

2014-08-05 Thread Carter Shanklin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-6584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14086308#comment-14086308 ] Carter Shanklin commented on HIVE-6584: --- I can't edit my comment but due to some

[jira] [Commented] (HIVE-7615) Beeline should have an option for user to see the query progress

2014-08-05 Thread Carter Shanklin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14086373#comment-14086373 ] Carter Shanklin commented on HIVE-7615: --- I like the idea of getting progress. I don't

[jira] [Commented] (HIVE-6584) Add HiveHBaseTableSnapshotInputFormat

2014-08-05 Thread Nick Dimiduk (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-6584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14086367#comment-14086367 ] Nick Dimiduk commented on HIVE-6584: Restore location is optional. It defaults to /tmp.

[jira] [Updated] (HIVE-5881) Integrate Hive with Morphlines

2014-08-05 Thread wolfgang hoschek (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-5881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wolfgang hoschek updated HIVE-5881: --- Description: Integrate Hive with morphlines. Specifically, add support to Hive to call a

[jira] [Updated] (HIVE-7609) Collect partition level stats by default

2014-08-05 Thread Ashutosh Chauhan (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-7609: --- Resolution: Fixed Fix Version/s: 0.14.0 Status: Resolved (was: Patch

[jira] [Commented] (HIVE-7589) Some fixes and improvements to statistics annotation rules

2014-08-05 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14086444#comment-14086444 ] Hive QA commented on HIVE-7589: --- {color:red}Overall{color}: -1 at least one tests failed

[jira] [Updated] (HIVE-7574) CommonJoinOperator.checkAndGenObject calls LOG.Trace per row from probe side in a HashMap join consuming 4% of the CPU

2014-08-05 Thread Mostafa Mokhtar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mostafa Mokhtar updated HIVE-7574: -- Attachment: HIVE-7574.1.patch Patch with fix. CommonJoinOperator.checkAndGenObject calls

[jira] [Resolved] (HIVE-4933) Document how aliases work with the OVER clause

2014-08-05 Thread Lars Francke (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars Francke resolved HIVE-4933. Resolution: Fixed Document how aliases work with the OVER clause

[jira] [Updated] (HIVE-7543) Cleanup of org.apache.hive.service.auth package

2014-08-05 Thread Lars Francke (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars Francke updated HIVE-7543: --- Status: Patch Available (was: Open) Cleanup of org.apache.hive.service.auth package

[jira] [Updated] (HIVE-6123) Implement checkstyle in maven

2014-08-05 Thread Lars Francke (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-6123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lars Francke updated HIVE-6123: --- Status: Patch Available (was: Open) Implement checkstyle in maven -

[jira] [Updated] (HIVE-7589) Some fixes and improvements to statistics annotation rules

2014-08-05 Thread Prasanth J (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prasanth J updated HIVE-7589: - Attachment: HIVE-7589.5.patch Fixed remaining test failures. Some fixes and improvements to statistics

[jira] [Commented] (HIVE-7574) CommonJoinOperator.checkAndGenObject calls LOG.Trace per row from probe side in a HashMap join consuming 4% of the CPU

2014-08-05 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14086512#comment-14086512 ] Sergey Shelukhin commented on HIVE-7574: +1 CommonJoinOperator.checkAndGenObject

[jira] [Updated] (HIVE-7574) CommonJoinOperator.checkAndGenObject calls LOG.Trace per row from probe side in a HashMap join consuming 4% of the CPU

2014-08-05 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin updated HIVE-7574: --- Status: Patch Available (was: Open) CommonJoinOperator.checkAndGenObject calls LOG.Trace

[jira] [Updated] (HIVE-7607) Spark Explain should give useful information on dependencies

2014-08-05 Thread Chao (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao updated HIVE-7607: --- Attachment: HIVE-7607.3-spark.patch Almost the same as what Tez does. Another option would be to override

Re: Review Request 24297: Spark Explain should give useful information on dependencies

2014-08-05 Thread Chao Sun
On Aug. 5, 2014, 6:15 a.m., Brock Noland wrote: Hi Chao, Can you share what the output looks like with the patch? Hive has thousands of .q file tests (https://github.com/apache/hive/tree/trunk/ql/src/test/queries/clientpositive) and most of them do an EXPLAIN. Thus I think

Re: Review Request 24297: Spark Explain should give useful information on dependencies

2014-08-05 Thread Chao Sun
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/24297/ --- (Updated Aug. 5, 2014, 5:43 p.m.) Review request for hive and Brock Noland.

[jira] [Created] (HIVE-7616) pre-size mapjoin hashtable based on statistics

2014-08-05 Thread Sergey Shelukhin (JIRA)
Sergey Shelukhin created HIVE-7616: -- Summary: pre-size mapjoin hashtable based on statistics Key: HIVE-7616 URL: https://issues.apache.org/jira/browse/HIVE-7616 Project: Hive Issue Type:

[jira] [Updated] (HIVE-7583) Use FileSystem.access() if available to check file access for user

2014-08-05 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere updated HIVE-7583: - Attachment: HIVE-7583.3.patch re-uploading patch to run pre-commit tests. Use FileSystem.access() if

[jira] [Assigned] (HIVE-7617) optimize bytes mapjoin hash table read path wrt serialization, at least for common cases

2014-08-05 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sergey Shelukhin reassigned HIVE-7617: -- Assignee: Sergey Shelukhin optimize bytes mapjoin hash table read path wrt

[jira] [Updated] (HIVE-7583) Use FileSystem.access() if available to check file access for user

2014-08-05 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere updated HIVE-7583: - Status: Open (was: Patch Available) Use FileSystem.access() if available to check file access for user

[jira] [Created] (HIVE-7617) optimize bytes mapjoin hash table read path wrt serialization, at least for common cases

2014-08-05 Thread Sergey Shelukhin (JIRA)
Sergey Shelukhin created HIVE-7617: -- Summary: optimize bytes mapjoin hash table read path wrt serialization, at least for common cases Key: HIVE-7617 URL: https://issues.apache.org/jira/browse/HIVE-7617

[jira] [Updated] (HIVE-7583) Use FileSystem.access() if available to check file access for user

2014-08-05 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Dere updated HIVE-7583: - Status: Patch Available (was: Open) Use FileSystem.access() if available to check file access for user

[jira] [Commented] (HIVE-6245) HS2 creates DBs/Tables with wrong ownership when HMS setugi is true

2014-08-05 Thread Alexander Pivovarov (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-6245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14086572#comment-14086572 ] Alexander Pivovarov commented on HIVE-6245: --- Found one issue with patch #3

[jira] [Updated] (HIVE-7584) Change SparkCompiler to generate a SparkWork that contains UnionWork from logical operator tree

2014-08-05 Thread Na Yang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Na Yang updated HIVE-7584: -- Attachment: (was: HIVE-7584.1.patch) Change SparkCompiler to generate a SparkWork that contains UnionWork

[jira] [Commented] (HIVE-7584) Change SparkCompiler to generate a SparkWork that contains UnionWork from logical operator tree

2014-08-05 Thread Na Yang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14086573#comment-14086573 ] Na Yang commented on HIVE-7584: --- I deleted the patch and will re-upload it with the right

[jira] [Commented] (HIVE-7533) sql std auth - set authorization privileges for tables when created from hive cli

2014-08-05 Thread Jason Dere (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14086589#comment-14086589 ] Jason Dere commented on HIVE-7533: -- +1 sql std auth - set authorization privileges for

[jira] [Updated] (HIVE-7595) isKerberosMode() does a case sensitive comparison

2014-08-05 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szehon Ho updated HIVE-7595: Resolution: Fixed Fix Version/s: 0.14.0 Status: Resolved (was: Patch Available)

[jira] [Commented] (HIVE-6361) Un-fork Sqlline

2014-08-05 Thread Julian Hyde (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-6361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14086594#comment-14086594 ] Julian Hyde commented on HIVE-6361: --- A lot more than a week so far... but making

Re: Review Request 24289: MetadataUpdater: provide a mechanism to edit the statistics of a column in a table (or a partition of a table)

2014-08-05 Thread pengcheng xiong
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/24289/ --- (Updated Aug. 5, 2014, 6:40 p.m.) Review request for hive. Changes ---

[jira] [Commented] (HIVE-7441) Custom partition scheme gets rewritten with hive scheme upon concatenate

2014-08-05 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14086612#comment-14086612 ] Hive QA commented on HIVE-7441: --- {color:red}Overall{color}: -1 at least one tests failed

[jira] [Updated] (HIVE-7596) Cleanup OperatorFactory, ReduceSinkOperator, and reportStats

2014-08-05 Thread Szehon Ho (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-7596?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szehon Ho updated HIVE-7596: Resolution: Fixed Fix Version/s: 0.14.0 Status: Resolved (was: Patch Available)

  1   2   3   >