[jira] [Updated] (HIVE-9215) Some mapjoin queries broken with IdentityProjectRemover with PPD

2014-12-29 Thread Navis (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-9215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Navis updated HIVE-9215:

   Resolution: Fixed
Fix Version/s: 0.15.0
   Status: Resolved  (was: Patch Available)

Committed to trunk. Thanks Xuefu and Szehon, for the review!

 Some mapjoin queries broken with IdentityProjectRemover with PPD
 

 Key: HIVE-9215
 URL: https://issues.apache.org/jira/browse/HIVE-9215
 Project: Hive
  Issue Type: Bug
  Components: Logical Optimizer
Affects Versions: 0.15.0
Reporter: Szehon Ho
Assignee: Navis
 Fix For: 0.15.0

 Attachments: HIVE-9215.1.patch.txt, HIVE-9215.2.patch.txt, 
 auto_join_ppd.q


 IdentityProjectRemover (hive.optimize.remove.identity.project) with PPD will 
 sometimes make mapjoin query that returns the wrong result in MR case as well.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HIVE-9215) Some mapjoin queries broken with IdentityProjectRemover with PPD

2014-12-29 Thread Xuefu Zhang (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-9215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Xuefu Zhang updated HIVE-9215:
--
Affects Version/s: spark-branch

 Some mapjoin queries broken with IdentityProjectRemover with PPD
 

 Key: HIVE-9215
 URL: https://issues.apache.org/jira/browse/HIVE-9215
 Project: Hive
  Issue Type: Bug
  Components: Logical Optimizer
Affects Versions: spark-branch, 0.15.0
Reporter: Szehon Ho
Assignee: Navis
 Fix For: 0.15.0

 Attachments: HIVE-9215.1.patch.txt, HIVE-9215.2.patch.txt, 
 auto_join_ppd.q


 IdentityProjectRemover (hive.optimize.remove.identity.project) with PPD will 
 sometimes make mapjoin query that returns the wrong result in MR case as well.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HIVE-9215) Some mapjoin queries broken with IdentityProjectRemover with PPD

2014-12-28 Thread Navis (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-9215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Navis updated HIVE-9215:

Attachment: HIVE-9215.1.patch.txt

As commented in code, select operator in RS-SEL-RS should not be removed 
because current compilers are not expecting null reducer operator. We might 
modify compilers but seemed to much. Or We can remove identity select in 
physical optimizer.

 Some mapjoin queries broken with IdentityProjectRemover with PPD
 

 Key: HIVE-9215
 URL: https://issues.apache.org/jira/browse/HIVE-9215
 Project: Hive
  Issue Type: Bug
  Components: Logical Optimizer
Affects Versions: 0.15.0
Reporter: Szehon Ho
 Attachments: HIVE-9215.1.patch.txt, auto_join_ppd.q


 IdentityProjectRemover (hive.optimize.remove.identity.project) with PPD will 
 sometimes make mapjoin query that returns the wrong result in MR case as well.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HIVE-9215) Some mapjoin queries broken with IdentityProjectRemover with PPD

2014-12-28 Thread Navis (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-9215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Navis updated HIVE-9215:

Assignee: Navis
  Status: Patch Available  (was: Open)

 Some mapjoin queries broken with IdentityProjectRemover with PPD
 

 Key: HIVE-9215
 URL: https://issues.apache.org/jira/browse/HIVE-9215
 Project: Hive
  Issue Type: Bug
  Components: Logical Optimizer
Affects Versions: 0.15.0
Reporter: Szehon Ho
Assignee: Navis
 Attachments: HIVE-9215.1.patch.txt, auto_join_ppd.q


 IdentityProjectRemover (hive.optimize.remove.identity.project) with PPD will 
 sometimes make mapjoin query that returns the wrong result in MR case as well.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HIVE-9215) Some mapjoin queries broken with IdentityProjectRemover with PPD

2014-12-28 Thread Navis (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-9215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Navis updated HIVE-9215:

Attachment: HIVE-9215.2.patch.txt

Updated ppd_join4.q

 Some mapjoin queries broken with IdentityProjectRemover with PPD
 

 Key: HIVE-9215
 URL: https://issues.apache.org/jira/browse/HIVE-9215
 Project: Hive
  Issue Type: Bug
  Components: Logical Optimizer
Affects Versions: 0.15.0
Reporter: Szehon Ho
Assignee: Navis
 Attachments: HIVE-9215.1.patch.txt, HIVE-9215.2.patch.txt, 
 auto_join_ppd.q


 IdentityProjectRemover (hive.optimize.remove.identity.project) with PPD will 
 sometimes make mapjoin query that returns the wrong result in MR case as well.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HIVE-9215) Some mapjoin queries broken with IdentityProjectRemover with PPD

2014-12-24 Thread Szehon Ho (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-9215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Szehon Ho updated HIVE-9215:

Attachment: auto_join_ppd.q

Attaching testcase that repro's the issue.  Expected one row of output, got 
none.

 Some mapjoin queries broken with IdentityProjectRemover with PPD
 

 Key: HIVE-9215
 URL: https://issues.apache.org/jira/browse/HIVE-9215
 Project: Hive
  Issue Type: Bug
  Components: Logical Optimizer
Affects Versions: 0.15.0
Reporter: Szehon Ho
 Attachments: auto_join_ppd.q


 IdentityProjectRemover (hive.optimize.remove.identity.project) with PPD will 
 sometimes make mapjoin query that returns the wrong result in MR case as well.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)