[jira] [Updated] (SPARK-9482) flaky test: org.apache.spark.sql.hive.execution.HiveCompatibilitySuite.semijoin

2015-08-03 Thread Reynold Xin (JIRA)

 [ 
https://issues.apache.org/jira/browse/SPARK-9482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Reynold Xin updated SPARK-9482:
---
Sprint: Week 32

 flaky test: 
 org.apache.spark.sql.hive.execution.HiveCompatibilitySuite.semijoin
 ---

 Key: SPARK-9482
 URL: https://issues.apache.org/jira/browse/SPARK-9482
 Project: Spark
  Issue Type: Bug
  Components: SQL
Affects Versions: 1.5.0
Reporter: Xiangrui Meng
Assignee: Yin Huai
Priority: Blocker
  Labels: flaky-test

 https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/39059/testReport/org.apache.spark.sql.hive.execution/HiveCompatibilitySuite/semijoin/
 {code}
 Regression
 org.apache.spark.sql.hive.execution.HiveCompatibilitySuite.semijoin
 Failing for the past 1 build (Since Failed#39059 )
 Took 7.7 sec.
 Error Message
  Results do not match for semijoin: == Parsed Logical Plan == 'Sort ['a.key 
 ASC], false  'Project [unresolvedalias('a.key)]   'Join RightOuter, 
 Some(('a.key = 'c.key))'Join LeftSemi, Some(('a.key = 'b.key)) 
 'UnresolvedRelation [t3], Some(a) 'UnresolvedRelation [t2], Some(b)
 'UnresolvedRelation [t1], Some(c)  == Analyzed Logical Plan == key: int Sort 
 [key#176228 ASC], false  Project [key#176228]   Join RightOuter, 
 Some((key#176228 = key#176232))Join LeftSemi, Some((key#176228 = 
 key#176230)) MetastoreRelation default, t3, Some(a) MetastoreRelation 
 default, t2, Some(b)MetastoreRelation default, t1, Some(c)  == Optimized 
 Logical Plan == Sort [key#176228 ASC], false  Project [key#176228]   Join 
 RightOuter, Some((key#176228 = key#176232))Project [key#176228] Join 
 LeftSemi, Some((key#176228 = key#176230))  Project [key#176228]   
 MetastoreRelation default, t3, Some(a)  Project [key#176230]   
 MetastoreRelation default, t2, Some(b)Project [key#176232] 
 MetastoreRelation default, t1, Some(c)  == Physical Plan == ExternalSort 
 [key#176228 ASC], false  Project [key#176228]   ConvertToSafe
 BroadcastHashOuterJoin [key#176228], [key#176232], RightOuter, None 
 ConvertToUnsafe  Project [key#176228]   ConvertToSafe
 BroadcastLeftSemiJoinHash [key#176228], [key#176230], None 
 ConvertToUnsafe  HiveTableScan [key#176228], (MetastoreRelation 
 default, t3, Some(a)) ConvertToUnsafe  HiveTableScan 
 [key#176230], (MetastoreRelation default, t2, Some(b)) ConvertToUnsafe
   HiveTableScan [key#176232], (MetastoreRelation default, t1, Some(c))  Code 
 Generation: true == RDD == key !== HIVE - 31 row(s) ==   == CATALYST - 30 
 row(s) ==  00  00  0  
   0  00  00  0
 0  00  00 
  00  00  0
 0  00  00  0  
   0  00  00  0
 0  00  10   10  
 10   10  10   10  10  
  10 !48 !48 !8
 NULL !8NULL  NULL 
 NULL  NULL NULL  NULL NULL  NULL  
NULL !NULL  
 Stacktrace
 sbt.ForkMain$ForkError: 
 Results do not match for semijoin:
 == Parsed Logical Plan ==
 'Sort ['a.key ASC], false
  'Project [unresolvedalias('a.key)]
   'Join RightOuter, Some(('a.key = 'c.key))
'Join LeftSemi, Some(('a.key = 'b.key))
 'UnresolvedRelation [t3], Some(a)
 'UnresolvedRelation [t2], Some(b)
'UnresolvedRelation [t1], Some(c)
 == Analyzed Logical Plan ==
 key: int
 Sort [key#176228 ASC], false
  Project [key#176228]
   Join RightOuter, Some((key#176228 = key#176232))
Join LeftSemi, Some((key#176228 = key#176230))
 MetastoreRelation default, t3, Some(a)
 MetastoreRelation default, t2, Some(b)
MetastoreRelation default, t1, Some(c)
 == Optimized Logical Plan ==
 Sort [key#176228 ASC], false
  Project [key#176228]
   Join RightOuter, Some((key#176228 = key#176232))
Project [key#176228]
 Join LeftSemi, Some((key#176228 = key#176230))
  Project [key#176228]
   MetastoreRelation default, t3, Some(a)
  Project [key#176230]
   MetastoreRelation default, t2, Some(b)
Project [key#176232]
 MetastoreRelation default, t1, Some(c)
 == Physical Plan ==
 ExternalSort [key#176228 ASC], false
  Project [key#176228]
   ConvertToSafe

[jira] [Updated] (SPARK-9482) flaky test: org.apache.spark.sql.hive.execution.HiveCompatibilitySuite.semijoin

2015-08-03 Thread Reynold Xin (JIRA)

 [ 
https://issues.apache.org/jira/browse/SPARK-9482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Reynold Xin updated SPARK-9482:
---
Assignee: Davies Liu  (was: Yin Huai)

 flaky test: 
 org.apache.spark.sql.hive.execution.HiveCompatibilitySuite.semijoin
 ---

 Key: SPARK-9482
 URL: https://issues.apache.org/jira/browse/SPARK-9482
 Project: Spark
  Issue Type: Bug
  Components: SQL
Affects Versions: 1.5.0
Reporter: Xiangrui Meng
Assignee: Davies Liu
Priority: Blocker
  Labels: flaky-test

 https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/39059/testReport/org.apache.spark.sql.hive.execution/HiveCompatibilitySuite/semijoin/
 {code}
 Regression
 org.apache.spark.sql.hive.execution.HiveCompatibilitySuite.semijoin
 Failing for the past 1 build (Since Failed#39059 )
 Took 7.7 sec.
 Error Message
  Results do not match for semijoin: == Parsed Logical Plan == 'Sort ['a.key 
 ASC], false  'Project [unresolvedalias('a.key)]   'Join RightOuter, 
 Some(('a.key = 'c.key))'Join LeftSemi, Some(('a.key = 'b.key)) 
 'UnresolvedRelation [t3], Some(a) 'UnresolvedRelation [t2], Some(b)
 'UnresolvedRelation [t1], Some(c)  == Analyzed Logical Plan == key: int Sort 
 [key#176228 ASC], false  Project [key#176228]   Join RightOuter, 
 Some((key#176228 = key#176232))Join LeftSemi, Some((key#176228 = 
 key#176230)) MetastoreRelation default, t3, Some(a) MetastoreRelation 
 default, t2, Some(b)MetastoreRelation default, t1, Some(c)  == Optimized 
 Logical Plan == Sort [key#176228 ASC], false  Project [key#176228]   Join 
 RightOuter, Some((key#176228 = key#176232))Project [key#176228] Join 
 LeftSemi, Some((key#176228 = key#176230))  Project [key#176228]   
 MetastoreRelation default, t3, Some(a)  Project [key#176230]   
 MetastoreRelation default, t2, Some(b)Project [key#176232] 
 MetastoreRelation default, t1, Some(c)  == Physical Plan == ExternalSort 
 [key#176228 ASC], false  Project [key#176228]   ConvertToSafe
 BroadcastHashOuterJoin [key#176228], [key#176232], RightOuter, None 
 ConvertToUnsafe  Project [key#176228]   ConvertToSafe
 BroadcastLeftSemiJoinHash [key#176228], [key#176230], None 
 ConvertToUnsafe  HiveTableScan [key#176228], (MetastoreRelation 
 default, t3, Some(a)) ConvertToUnsafe  HiveTableScan 
 [key#176230], (MetastoreRelation default, t2, Some(b)) ConvertToUnsafe
   HiveTableScan [key#176232], (MetastoreRelation default, t1, Some(c))  Code 
 Generation: true == RDD == key !== HIVE - 31 row(s) ==   == CATALYST - 30 
 row(s) ==  00  00  0  
   0  00  00  0
 0  00  00 
  00  00  0
 0  00  00  0  
   0  00  00  0
 0  00  10   10  
 10   10  10   10  10  
  10 !48 !48 !8
 NULL !8NULL  NULL 
 NULL  NULL NULL  NULL NULL  NULL  
NULL !NULL  
 Stacktrace
 sbt.ForkMain$ForkError: 
 Results do not match for semijoin:
 == Parsed Logical Plan ==
 'Sort ['a.key ASC], false
  'Project [unresolvedalias('a.key)]
   'Join RightOuter, Some(('a.key = 'c.key))
'Join LeftSemi, Some(('a.key = 'b.key))
 'UnresolvedRelation [t3], Some(a)
 'UnresolvedRelation [t2], Some(b)
'UnresolvedRelation [t1], Some(c)
 == Analyzed Logical Plan ==
 key: int
 Sort [key#176228 ASC], false
  Project [key#176228]
   Join RightOuter, Some((key#176228 = key#176232))
Join LeftSemi, Some((key#176228 = key#176230))
 MetastoreRelation default, t3, Some(a)
 MetastoreRelation default, t2, Some(b)
MetastoreRelation default, t1, Some(c)
 == Optimized Logical Plan ==
 Sort [key#176228 ASC], false
  Project [key#176228]
   Join RightOuter, Some((key#176228 = key#176232))
Project [key#176228]
 Join LeftSemi, Some((key#176228 = key#176230))
  Project [key#176228]
   MetastoreRelation default, t3, Some(a)
  Project [key#176230]
   MetastoreRelation default, t2, Some(b)
Project [key#176232]
 MetastoreRelation default, t1, Some(c)
 == Physical Plan ==
 ExternalSort [key#176228 ASC], false
  Project [key#176228]
  

[jira] [Updated] (SPARK-9482) flaky test: org.apache.spark.sql.hive.execution.HiveCompatibilitySuite.semijoin

2015-08-03 Thread Michael Armbrust (JIRA)

 [ 
https://issues.apache.org/jira/browse/SPARK-9482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Michael Armbrust updated SPARK-9482:

Priority: Blocker  (was: Critical)

 flaky test: 
 org.apache.spark.sql.hive.execution.HiveCompatibilitySuite.semijoin
 ---

 Key: SPARK-9482
 URL: https://issues.apache.org/jira/browse/SPARK-9482
 Project: Spark
  Issue Type: Bug
  Components: SQL
Affects Versions: 1.5.0
Reporter: Xiangrui Meng
Assignee: Yin Huai
Priority: Blocker
  Labels: flaky-test

 https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/39059/testReport/org.apache.spark.sql.hive.execution/HiveCompatibilitySuite/semijoin/
 {code}
 Regression
 org.apache.spark.sql.hive.execution.HiveCompatibilitySuite.semijoin
 Failing for the past 1 build (Since Failed#39059 )
 Took 7.7 sec.
 Error Message
  Results do not match for semijoin: == Parsed Logical Plan == 'Sort ['a.key 
 ASC], false  'Project [unresolvedalias('a.key)]   'Join RightOuter, 
 Some(('a.key = 'c.key))'Join LeftSemi, Some(('a.key = 'b.key)) 
 'UnresolvedRelation [t3], Some(a) 'UnresolvedRelation [t2], Some(b)
 'UnresolvedRelation [t1], Some(c)  == Analyzed Logical Plan == key: int Sort 
 [key#176228 ASC], false  Project [key#176228]   Join RightOuter, 
 Some((key#176228 = key#176232))Join LeftSemi, Some((key#176228 = 
 key#176230)) MetastoreRelation default, t3, Some(a) MetastoreRelation 
 default, t2, Some(b)MetastoreRelation default, t1, Some(c)  == Optimized 
 Logical Plan == Sort [key#176228 ASC], false  Project [key#176228]   Join 
 RightOuter, Some((key#176228 = key#176232))Project [key#176228] Join 
 LeftSemi, Some((key#176228 = key#176230))  Project [key#176228]   
 MetastoreRelation default, t3, Some(a)  Project [key#176230]   
 MetastoreRelation default, t2, Some(b)Project [key#176232] 
 MetastoreRelation default, t1, Some(c)  == Physical Plan == ExternalSort 
 [key#176228 ASC], false  Project [key#176228]   ConvertToSafe
 BroadcastHashOuterJoin [key#176228], [key#176232], RightOuter, None 
 ConvertToUnsafe  Project [key#176228]   ConvertToSafe
 BroadcastLeftSemiJoinHash [key#176228], [key#176230], None 
 ConvertToUnsafe  HiveTableScan [key#176228], (MetastoreRelation 
 default, t3, Some(a)) ConvertToUnsafe  HiveTableScan 
 [key#176230], (MetastoreRelation default, t2, Some(b)) ConvertToUnsafe
   HiveTableScan [key#176232], (MetastoreRelation default, t1, Some(c))  Code 
 Generation: true == RDD == key !== HIVE - 31 row(s) ==   == CATALYST - 30 
 row(s) ==  00  00  0  
   0  00  00  0
 0  00  00 
  00  00  0
 0  00  00  0  
   0  00  00  0
 0  00  10   10  
 10   10  10   10  10  
  10 !48 !48 !8
 NULL !8NULL  NULL 
 NULL  NULL NULL  NULL NULL  NULL  
NULL !NULL  
 Stacktrace
 sbt.ForkMain$ForkError: 
 Results do not match for semijoin:
 == Parsed Logical Plan ==
 'Sort ['a.key ASC], false
  'Project [unresolvedalias('a.key)]
   'Join RightOuter, Some(('a.key = 'c.key))
'Join LeftSemi, Some(('a.key = 'b.key))
 'UnresolvedRelation [t3], Some(a)
 'UnresolvedRelation [t2], Some(b)
'UnresolvedRelation [t1], Some(c)
 == Analyzed Logical Plan ==
 key: int
 Sort [key#176228 ASC], false
  Project [key#176228]
   Join RightOuter, Some((key#176228 = key#176232))
Join LeftSemi, Some((key#176228 = key#176230))
 MetastoreRelation default, t3, Some(a)
 MetastoreRelation default, t2, Some(b)
MetastoreRelation default, t1, Some(c)
 == Optimized Logical Plan ==
 Sort [key#176228 ASC], false
  Project [key#176228]
   Join RightOuter, Some((key#176228 = key#176232))
Project [key#176228]
 Join LeftSemi, Some((key#176228 = key#176230))
  Project [key#176228]
   MetastoreRelation default, t3, Some(a)
  Project [key#176230]
   MetastoreRelation default, t2, Some(b)
Project [key#176232]
 MetastoreRelation default, t1, Some(c)
 == Physical Plan ==
 ExternalSort [key#176228 ASC], false
  Project 

[jira] [Updated] (SPARK-9482) flaky test: org.apache.spark.sql.hive.execution.HiveCompatibilitySuite.semijoin

2015-07-30 Thread Xiangrui Meng (JIRA)

 [ 
https://issues.apache.org/jira/browse/SPARK-9482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Xiangrui Meng updated SPARK-9482:
-
Labels: flaky-test  (was: )

 flaky test: 
 org.apache.spark.sql.hive.execution.HiveCompatibilitySuite.semijoin
 ---

 Key: SPARK-9482
 URL: https://issues.apache.org/jira/browse/SPARK-9482
 Project: Spark
  Issue Type: Bug
  Components: SQL
Affects Versions: 1.5.0
Reporter: Xiangrui Meng
Assignee: Yin Huai
Priority: Critical
  Labels: flaky-test

 https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/39059/testReport/org.apache.spark.sql.hive.execution/HiveCompatibilitySuite/semijoin/
 {code}
 Regression
 org.apache.spark.sql.hive.execution.HiveCompatibilitySuite.semijoin
 Failing for the past 1 build (Since Failed#39059 )
 Took 7.7 sec.
 Error Message
  Results do not match for semijoin: == Parsed Logical Plan == 'Sort ['a.key 
 ASC], false  'Project [unresolvedalias('a.key)]   'Join RightOuter, 
 Some(('a.key = 'c.key))'Join LeftSemi, Some(('a.key = 'b.key)) 
 'UnresolvedRelation [t3], Some(a) 'UnresolvedRelation [t2], Some(b)
 'UnresolvedRelation [t1], Some(c)  == Analyzed Logical Plan == key: int Sort 
 [key#176228 ASC], false  Project [key#176228]   Join RightOuter, 
 Some((key#176228 = key#176232))Join LeftSemi, Some((key#176228 = 
 key#176230)) MetastoreRelation default, t3, Some(a) MetastoreRelation 
 default, t2, Some(b)MetastoreRelation default, t1, Some(c)  == Optimized 
 Logical Plan == Sort [key#176228 ASC], false  Project [key#176228]   Join 
 RightOuter, Some((key#176228 = key#176232))Project [key#176228] Join 
 LeftSemi, Some((key#176228 = key#176230))  Project [key#176228]   
 MetastoreRelation default, t3, Some(a)  Project [key#176230]   
 MetastoreRelation default, t2, Some(b)Project [key#176232] 
 MetastoreRelation default, t1, Some(c)  == Physical Plan == ExternalSort 
 [key#176228 ASC], false  Project [key#176228]   ConvertToSafe
 BroadcastHashOuterJoin [key#176228], [key#176232], RightOuter, None 
 ConvertToUnsafe  Project [key#176228]   ConvertToSafe
 BroadcastLeftSemiJoinHash [key#176228], [key#176230], None 
 ConvertToUnsafe  HiveTableScan [key#176228], (MetastoreRelation 
 default, t3, Some(a)) ConvertToUnsafe  HiveTableScan 
 [key#176230], (MetastoreRelation default, t2, Some(b)) ConvertToUnsafe
   HiveTableScan [key#176232], (MetastoreRelation default, t1, Some(c))  Code 
 Generation: true == RDD == key !== HIVE - 31 row(s) ==   == CATALYST - 30 
 row(s) ==  00  00  0  
   0  00  00  0
 0  00  00 
  00  00  0
 0  00  00  0  
   0  00  00  0
 0  00  10   10  
 10   10  10   10  10  
  10 !48 !48 !8
 NULL !8NULL  NULL 
 NULL  NULL NULL  NULL NULL  NULL  
NULL !NULL  
 Stacktrace
 sbt.ForkMain$ForkError: 
 Results do not match for semijoin:
 == Parsed Logical Plan ==
 'Sort ['a.key ASC], false
  'Project [unresolvedalias('a.key)]
   'Join RightOuter, Some(('a.key = 'c.key))
'Join LeftSemi, Some(('a.key = 'b.key))
 'UnresolvedRelation [t3], Some(a)
 'UnresolvedRelation [t2], Some(b)
'UnresolvedRelation [t1], Some(c)
 == Analyzed Logical Plan ==
 key: int
 Sort [key#176228 ASC], false
  Project [key#176228]
   Join RightOuter, Some((key#176228 = key#176232))
Join LeftSemi, Some((key#176228 = key#176230))
 MetastoreRelation default, t3, Some(a)
 MetastoreRelation default, t2, Some(b)
MetastoreRelation default, t1, Some(c)
 == Optimized Logical Plan ==
 Sort [key#176228 ASC], false
  Project [key#176228]
   Join RightOuter, Some((key#176228 = key#176232))
Project [key#176228]
 Join LeftSemi, Some((key#176228 = key#176230))
  Project [key#176228]
   MetastoreRelation default, t3, Some(a)
  Project [key#176230]
   MetastoreRelation default, t2, Some(b)
Project [key#176232]
 MetastoreRelation default, t1, Some(c)
 == Physical Plan ==
 ExternalSort [key#176228 ASC], false
  Project [key#176228]