[jira] [Updated] (SPARK-9482) flaky test: org.apache.spark.sql.hive.execution.HiveCompatibilitySuite.semijoin
[ https://issues.apache.org/jira/browse/SPARK-9482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9482: --- Sprint: Week 32 flaky test: org.apache.spark.sql.hive.execution.HiveCompatibilitySuite.semijoin --- Key: SPARK-9482 URL: https://issues.apache.org/jira/browse/SPARK-9482 Project: Spark Issue Type: Bug Components: SQL Affects Versions: 1.5.0 Reporter: Xiangrui Meng Assignee: Yin Huai Priority: Blocker Labels: flaky-test https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/39059/testReport/org.apache.spark.sql.hive.execution/HiveCompatibilitySuite/semijoin/ {code} Regression org.apache.spark.sql.hive.execution.HiveCompatibilitySuite.semijoin Failing for the past 1 build (Since Failed#39059 ) Took 7.7 sec. Error Message Results do not match for semijoin: == Parsed Logical Plan == 'Sort ['a.key ASC], false 'Project [unresolvedalias('a.key)] 'Join RightOuter, Some(('a.key = 'c.key))'Join LeftSemi, Some(('a.key = 'b.key)) 'UnresolvedRelation [t3], Some(a) 'UnresolvedRelation [t2], Some(b) 'UnresolvedRelation [t1], Some(c) == Analyzed Logical Plan == key: int Sort [key#176228 ASC], false Project [key#176228] Join RightOuter, Some((key#176228 = key#176232))Join LeftSemi, Some((key#176228 = key#176230)) MetastoreRelation default, t3, Some(a) MetastoreRelation default, t2, Some(b)MetastoreRelation default, t1, Some(c) == Optimized Logical Plan == Sort [key#176228 ASC], false Project [key#176228] Join RightOuter, Some((key#176228 = key#176232))Project [key#176228] Join LeftSemi, Some((key#176228 = key#176230)) Project [key#176228] MetastoreRelation default, t3, Some(a) Project [key#176230] MetastoreRelation default, t2, Some(b)Project [key#176232] MetastoreRelation default, t1, Some(c) == Physical Plan == ExternalSort [key#176228 ASC], false Project [key#176228] ConvertToSafe BroadcastHashOuterJoin [key#176228], [key#176232], RightOuter, None ConvertToUnsafe Project [key#176228] ConvertToSafe BroadcastLeftSemiJoinHash [key#176228], [key#176230], None ConvertToUnsafe HiveTableScan [key#176228], (MetastoreRelation default, t3, Some(a)) ConvertToUnsafe HiveTableScan [key#176230], (MetastoreRelation default, t2, Some(b)) ConvertToUnsafe HiveTableScan [key#176232], (MetastoreRelation default, t1, Some(c)) Code Generation: true == RDD == key !== HIVE - 31 row(s) == == CATALYST - 30 row(s) == 00 00 0 0 00 00 0 0 00 00 00 00 0 0 00 00 0 0 00 00 0 0 00 10 10 10 10 10 10 10 10 !48 !48 !8 NULL !8NULL NULL NULL NULL NULL NULL NULL NULL NULL !NULL Stacktrace sbt.ForkMain$ForkError: Results do not match for semijoin: == Parsed Logical Plan == 'Sort ['a.key ASC], false 'Project [unresolvedalias('a.key)] 'Join RightOuter, Some(('a.key = 'c.key)) 'Join LeftSemi, Some(('a.key = 'b.key)) 'UnresolvedRelation [t3], Some(a) 'UnresolvedRelation [t2], Some(b) 'UnresolvedRelation [t1], Some(c) == Analyzed Logical Plan == key: int Sort [key#176228 ASC], false Project [key#176228] Join RightOuter, Some((key#176228 = key#176232)) Join LeftSemi, Some((key#176228 = key#176230)) MetastoreRelation default, t3, Some(a) MetastoreRelation default, t2, Some(b) MetastoreRelation default, t1, Some(c) == Optimized Logical Plan == Sort [key#176228 ASC], false Project [key#176228] Join RightOuter, Some((key#176228 = key#176232)) Project [key#176228] Join LeftSemi, Some((key#176228 = key#176230)) Project [key#176228] MetastoreRelation default, t3, Some(a) Project [key#176230] MetastoreRelation default, t2, Some(b) Project [key#176232] MetastoreRelation default, t1, Some(c) == Physical Plan == ExternalSort [key#176228 ASC], false Project [key#176228] ConvertToSafe
[jira] [Updated] (SPARK-9482) flaky test: org.apache.spark.sql.hive.execution.HiveCompatibilitySuite.semijoin
[ https://issues.apache.org/jira/browse/SPARK-9482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9482: --- Assignee: Davies Liu (was: Yin Huai) flaky test: org.apache.spark.sql.hive.execution.HiveCompatibilitySuite.semijoin --- Key: SPARK-9482 URL: https://issues.apache.org/jira/browse/SPARK-9482 Project: Spark Issue Type: Bug Components: SQL Affects Versions: 1.5.0 Reporter: Xiangrui Meng Assignee: Davies Liu Priority: Blocker Labels: flaky-test https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/39059/testReport/org.apache.spark.sql.hive.execution/HiveCompatibilitySuite/semijoin/ {code} Regression org.apache.spark.sql.hive.execution.HiveCompatibilitySuite.semijoin Failing for the past 1 build (Since Failed#39059 ) Took 7.7 sec. Error Message Results do not match for semijoin: == Parsed Logical Plan == 'Sort ['a.key ASC], false 'Project [unresolvedalias('a.key)] 'Join RightOuter, Some(('a.key = 'c.key))'Join LeftSemi, Some(('a.key = 'b.key)) 'UnresolvedRelation [t3], Some(a) 'UnresolvedRelation [t2], Some(b) 'UnresolvedRelation [t1], Some(c) == Analyzed Logical Plan == key: int Sort [key#176228 ASC], false Project [key#176228] Join RightOuter, Some((key#176228 = key#176232))Join LeftSemi, Some((key#176228 = key#176230)) MetastoreRelation default, t3, Some(a) MetastoreRelation default, t2, Some(b)MetastoreRelation default, t1, Some(c) == Optimized Logical Plan == Sort [key#176228 ASC], false Project [key#176228] Join RightOuter, Some((key#176228 = key#176232))Project [key#176228] Join LeftSemi, Some((key#176228 = key#176230)) Project [key#176228] MetastoreRelation default, t3, Some(a) Project [key#176230] MetastoreRelation default, t2, Some(b)Project [key#176232] MetastoreRelation default, t1, Some(c) == Physical Plan == ExternalSort [key#176228 ASC], false Project [key#176228] ConvertToSafe BroadcastHashOuterJoin [key#176228], [key#176232], RightOuter, None ConvertToUnsafe Project [key#176228] ConvertToSafe BroadcastLeftSemiJoinHash [key#176228], [key#176230], None ConvertToUnsafe HiveTableScan [key#176228], (MetastoreRelation default, t3, Some(a)) ConvertToUnsafe HiveTableScan [key#176230], (MetastoreRelation default, t2, Some(b)) ConvertToUnsafe HiveTableScan [key#176232], (MetastoreRelation default, t1, Some(c)) Code Generation: true == RDD == key !== HIVE - 31 row(s) == == CATALYST - 30 row(s) == 00 00 0 0 00 00 0 0 00 00 00 00 0 0 00 00 0 0 00 00 0 0 00 10 10 10 10 10 10 10 10 !48 !48 !8 NULL !8NULL NULL NULL NULL NULL NULL NULL NULL NULL !NULL Stacktrace sbt.ForkMain$ForkError: Results do not match for semijoin: == Parsed Logical Plan == 'Sort ['a.key ASC], false 'Project [unresolvedalias('a.key)] 'Join RightOuter, Some(('a.key = 'c.key)) 'Join LeftSemi, Some(('a.key = 'b.key)) 'UnresolvedRelation [t3], Some(a) 'UnresolvedRelation [t2], Some(b) 'UnresolvedRelation [t1], Some(c) == Analyzed Logical Plan == key: int Sort [key#176228 ASC], false Project [key#176228] Join RightOuter, Some((key#176228 = key#176232)) Join LeftSemi, Some((key#176228 = key#176230)) MetastoreRelation default, t3, Some(a) MetastoreRelation default, t2, Some(b) MetastoreRelation default, t1, Some(c) == Optimized Logical Plan == Sort [key#176228 ASC], false Project [key#176228] Join RightOuter, Some((key#176228 = key#176232)) Project [key#176228] Join LeftSemi, Some((key#176228 = key#176230)) Project [key#176228] MetastoreRelation default, t3, Some(a) Project [key#176230] MetastoreRelation default, t2, Some(b) Project [key#176232] MetastoreRelation default, t1, Some(c) == Physical Plan == ExternalSort [key#176228 ASC], false Project [key#176228]
[jira] [Updated] (SPARK-9482) flaky test: org.apache.spark.sql.hive.execution.HiveCompatibilitySuite.semijoin
[ https://issues.apache.org/jira/browse/SPARK-9482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-9482: Priority: Blocker (was: Critical) flaky test: org.apache.spark.sql.hive.execution.HiveCompatibilitySuite.semijoin --- Key: SPARK-9482 URL: https://issues.apache.org/jira/browse/SPARK-9482 Project: Spark Issue Type: Bug Components: SQL Affects Versions: 1.5.0 Reporter: Xiangrui Meng Assignee: Yin Huai Priority: Blocker Labels: flaky-test https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/39059/testReport/org.apache.spark.sql.hive.execution/HiveCompatibilitySuite/semijoin/ {code} Regression org.apache.spark.sql.hive.execution.HiveCompatibilitySuite.semijoin Failing for the past 1 build (Since Failed#39059 ) Took 7.7 sec. Error Message Results do not match for semijoin: == Parsed Logical Plan == 'Sort ['a.key ASC], false 'Project [unresolvedalias('a.key)] 'Join RightOuter, Some(('a.key = 'c.key))'Join LeftSemi, Some(('a.key = 'b.key)) 'UnresolvedRelation [t3], Some(a) 'UnresolvedRelation [t2], Some(b) 'UnresolvedRelation [t1], Some(c) == Analyzed Logical Plan == key: int Sort [key#176228 ASC], false Project [key#176228] Join RightOuter, Some((key#176228 = key#176232))Join LeftSemi, Some((key#176228 = key#176230)) MetastoreRelation default, t3, Some(a) MetastoreRelation default, t2, Some(b)MetastoreRelation default, t1, Some(c) == Optimized Logical Plan == Sort [key#176228 ASC], false Project [key#176228] Join RightOuter, Some((key#176228 = key#176232))Project [key#176228] Join LeftSemi, Some((key#176228 = key#176230)) Project [key#176228] MetastoreRelation default, t3, Some(a) Project [key#176230] MetastoreRelation default, t2, Some(b)Project [key#176232] MetastoreRelation default, t1, Some(c) == Physical Plan == ExternalSort [key#176228 ASC], false Project [key#176228] ConvertToSafe BroadcastHashOuterJoin [key#176228], [key#176232], RightOuter, None ConvertToUnsafe Project [key#176228] ConvertToSafe BroadcastLeftSemiJoinHash [key#176228], [key#176230], None ConvertToUnsafe HiveTableScan [key#176228], (MetastoreRelation default, t3, Some(a)) ConvertToUnsafe HiveTableScan [key#176230], (MetastoreRelation default, t2, Some(b)) ConvertToUnsafe HiveTableScan [key#176232], (MetastoreRelation default, t1, Some(c)) Code Generation: true == RDD == key !== HIVE - 31 row(s) == == CATALYST - 30 row(s) == 00 00 0 0 00 00 0 0 00 00 00 00 0 0 00 00 0 0 00 00 0 0 00 10 10 10 10 10 10 10 10 !48 !48 !8 NULL !8NULL NULL NULL NULL NULL NULL NULL NULL NULL !NULL Stacktrace sbt.ForkMain$ForkError: Results do not match for semijoin: == Parsed Logical Plan == 'Sort ['a.key ASC], false 'Project [unresolvedalias('a.key)] 'Join RightOuter, Some(('a.key = 'c.key)) 'Join LeftSemi, Some(('a.key = 'b.key)) 'UnresolvedRelation [t3], Some(a) 'UnresolvedRelation [t2], Some(b) 'UnresolvedRelation [t1], Some(c) == Analyzed Logical Plan == key: int Sort [key#176228 ASC], false Project [key#176228] Join RightOuter, Some((key#176228 = key#176232)) Join LeftSemi, Some((key#176228 = key#176230)) MetastoreRelation default, t3, Some(a) MetastoreRelation default, t2, Some(b) MetastoreRelation default, t1, Some(c) == Optimized Logical Plan == Sort [key#176228 ASC], false Project [key#176228] Join RightOuter, Some((key#176228 = key#176232)) Project [key#176228] Join LeftSemi, Some((key#176228 = key#176230)) Project [key#176228] MetastoreRelation default, t3, Some(a) Project [key#176230] MetastoreRelation default, t2, Some(b) Project [key#176232] MetastoreRelation default, t1, Some(c) == Physical Plan == ExternalSort [key#176228 ASC], false Project
[jira] [Updated] (SPARK-9482) flaky test: org.apache.spark.sql.hive.execution.HiveCompatibilitySuite.semijoin
[ https://issues.apache.org/jira/browse/SPARK-9482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-9482: - Labels: flaky-test (was: ) flaky test: org.apache.spark.sql.hive.execution.HiveCompatibilitySuite.semijoin --- Key: SPARK-9482 URL: https://issues.apache.org/jira/browse/SPARK-9482 Project: Spark Issue Type: Bug Components: SQL Affects Versions: 1.5.0 Reporter: Xiangrui Meng Assignee: Yin Huai Priority: Critical Labels: flaky-test https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/39059/testReport/org.apache.spark.sql.hive.execution/HiveCompatibilitySuite/semijoin/ {code} Regression org.apache.spark.sql.hive.execution.HiveCompatibilitySuite.semijoin Failing for the past 1 build (Since Failed#39059 ) Took 7.7 sec. Error Message Results do not match for semijoin: == Parsed Logical Plan == 'Sort ['a.key ASC], false 'Project [unresolvedalias('a.key)] 'Join RightOuter, Some(('a.key = 'c.key))'Join LeftSemi, Some(('a.key = 'b.key)) 'UnresolvedRelation [t3], Some(a) 'UnresolvedRelation [t2], Some(b) 'UnresolvedRelation [t1], Some(c) == Analyzed Logical Plan == key: int Sort [key#176228 ASC], false Project [key#176228] Join RightOuter, Some((key#176228 = key#176232))Join LeftSemi, Some((key#176228 = key#176230)) MetastoreRelation default, t3, Some(a) MetastoreRelation default, t2, Some(b)MetastoreRelation default, t1, Some(c) == Optimized Logical Plan == Sort [key#176228 ASC], false Project [key#176228] Join RightOuter, Some((key#176228 = key#176232))Project [key#176228] Join LeftSemi, Some((key#176228 = key#176230)) Project [key#176228] MetastoreRelation default, t3, Some(a) Project [key#176230] MetastoreRelation default, t2, Some(b)Project [key#176232] MetastoreRelation default, t1, Some(c) == Physical Plan == ExternalSort [key#176228 ASC], false Project [key#176228] ConvertToSafe BroadcastHashOuterJoin [key#176228], [key#176232], RightOuter, None ConvertToUnsafe Project [key#176228] ConvertToSafe BroadcastLeftSemiJoinHash [key#176228], [key#176230], None ConvertToUnsafe HiveTableScan [key#176228], (MetastoreRelation default, t3, Some(a)) ConvertToUnsafe HiveTableScan [key#176230], (MetastoreRelation default, t2, Some(b)) ConvertToUnsafe HiveTableScan [key#176232], (MetastoreRelation default, t1, Some(c)) Code Generation: true == RDD == key !== HIVE - 31 row(s) == == CATALYST - 30 row(s) == 00 00 0 0 00 00 0 0 00 00 00 00 0 0 00 00 0 0 00 00 0 0 00 10 10 10 10 10 10 10 10 !48 !48 !8 NULL !8NULL NULL NULL NULL NULL NULL NULL NULL NULL !NULL Stacktrace sbt.ForkMain$ForkError: Results do not match for semijoin: == Parsed Logical Plan == 'Sort ['a.key ASC], false 'Project [unresolvedalias('a.key)] 'Join RightOuter, Some(('a.key = 'c.key)) 'Join LeftSemi, Some(('a.key = 'b.key)) 'UnresolvedRelation [t3], Some(a) 'UnresolvedRelation [t2], Some(b) 'UnresolvedRelation [t1], Some(c) == Analyzed Logical Plan == key: int Sort [key#176228 ASC], false Project [key#176228] Join RightOuter, Some((key#176228 = key#176232)) Join LeftSemi, Some((key#176228 = key#176230)) MetastoreRelation default, t3, Some(a) MetastoreRelation default, t2, Some(b) MetastoreRelation default, t1, Some(c) == Optimized Logical Plan == Sort [key#176228 ASC], false Project [key#176228] Join RightOuter, Some((key#176228 = key#176232)) Project [key#176228] Join LeftSemi, Some((key#176228 = key#176230)) Project [key#176228] MetastoreRelation default, t3, Some(a) Project [key#176230] MetastoreRelation default, t2, Some(b) Project [key#176232] MetastoreRelation default, t1, Some(c) == Physical Plan == ExternalSort [key#176228 ASC], false Project [key#176228]