[jira] [Commented] (SPARK-17211) Broadcast join produces incorrect results when compressed Oops differs between driver, executor

[ https://issues.apache.org/jira/browse/SPARK-17211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15460062#comment-15460062 ] gurmukh singh commented on SPARK-17211: --- [~davies] After applying the patch, tested

[jira] [Commented] (SPARK-17211) Broadcast join produces incorrect results when compressed Oops differs between driver, executor

[ https://issues.apache.org/jira/browse/SPARK-17211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15459925#comment-15459925 ] Miguel Tormo commented on SPARK-17211: -- [~gurmukhd], you say it works only for heap

[jira] [Commented] (SPARK-17211) Broadcast join produces incorrect results when compressed Oops differs between driver, executor

[ https://issues.apache.org/jira/browse/SPARK-17211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15459877#comment-15459877 ] gurmukh singh commented on SPARK-17211: --- Sure, will update soon with my findings.

[jira] [Commented] (SPARK-17211) Broadcast join produces incorrect results when compressed Oops differs between driver, executor

[ https://issues.apache.org/jira/browse/SPARK-17211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15459835#comment-15459835 ] Davies Liu commented on SPARK-17211: Could you try the patch ? https://github.com/apa

[jira] [Commented] (SPARK-17211) Broadcast join produces incorrect results when compressed Oops differs between driver, executor

[ https://issues.apache.org/jira/browse/SPARK-17211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15459770#comment-15459770 ] gurmukh singh commented on SPARK-17211: --- Thanks, I have tested by disabling UseCom

[jira] [Commented] (SPARK-17211) Broadcast join produces incorrect results when compressed Oops differs between driver, executor

[ https://issues.apache.org/jira/browse/SPARK-17211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15459102#comment-15459102 ] Dongjoon Hyun commented on SPARK-17211: --- Oh, now I see the point of this issue. >

[jira] [Commented] (SPARK-17211) Broadcast join produces incorrect results when compressed Oops differs between driver, executor

[ https://issues.apache.org/jira/browse/SPARK-17211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15459040#comment-15459040 ] Davies Liu commented on SPARK-17211: [~migtor] Could you try this patch ? https://git

[jira] [Commented] (SPARK-17211) Broadcast join produces incorrect results when compressed Oops differs between driver, executor

[ https://issues.apache.org/jira/browse/SPARK-17211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15458947#comment-15458947 ] Miguel Tormo commented on SPARK-17211: -- I've just tried master from git, exactly the

[jira] [Commented] (SPARK-17211) Broadcast join produces incorrect results on EMR with large driver memory

[ https://issues.apache.org/jira/browse/SPARK-17211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15458239#comment-15458239 ] Miguel Tormo commented on SPARK-17211: -- Hi, I have been testing this and it seems t

[jira] [Commented] (SPARK-17211) Broadcast join produces incorrect results on EMR with large driver memory

[ https://issues.apache.org/jira/browse/SPARK-17211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15456867#comment-15456867 ] gurmukh singh commented on SPARK-17211: --- Thanks Davies. Can see the issue with the

[jira] [Commented] (SPARK-17211) Broadcast join produces incorrect results on EMR with large driver memory

[ https://issues.apache.org/jira/browse/SPARK-17211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15456598#comment-15456598 ] Apache Spark commented on SPARK-17211: -- User 'davies' has created a pull request for

[jira] [Commented] (SPARK-17211) Broadcast join produces incorrect results on EMR with large driver memory

[ https://issues.apache.org/jira/browse/SPARK-17211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15454147#comment-15454147 ] gurmukh singh commented on SPARK-17211: --- yes, outside of EMR. On a node you will h

[jira] [Commented] (SPARK-17211) Broadcast join produces incorrect results on EMR with large driver memory

[ https://issues.apache.org/jira/browse/SPARK-17211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15453936#comment-15453936 ] Himanish Kushary commented on SPARK-17211: -- [~gurmukhd] You are seeing the error

[jira] [Commented] (SPARK-17211) Broadcast join produces incorrect results on EMR with large driver memory

[ https://issues.apache.org/jira/browse/SPARK-17211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15453541#comment-15453541 ] gurmukh singh commented on SPARK-17211: --- Hi I can see this in Apache Spark 2.0 as

[jira] [Commented] (SPARK-17211) Broadcast join produces incorrect results

[ https://issues.apache.org/jira/browse/SPARK-17211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15448272#comment-15448272 ] Jarno Seppanen commented on SPARK-17211: Thanks, I've also filed the issue with A

[jira] [Commented] (SPARK-17211) Broadcast join produces incorrect results

[ https://issues.apache.org/jira/browse/SPARK-17211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15436866#comment-15436866 ] Dongjoon Hyun commented on SPARK-17211: --- Interesting, but the use case does not con

[jira] [Commented] (SPARK-17211) Broadcast join produces incorrect results

[ https://issues.apache.org/jira/browse/SPARK-17211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15436813#comment-15436813 ] Himanish Kushary commented on SPARK-17211: -- Hi [~gurmukhd] I am using this com

[jira] [Commented] (SPARK-17211) Broadcast join produces incorrect results

[ https://issues.apache.org/jira/browse/SPARK-17211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15436493#comment-15436493 ] gurmukh singh commented on SPARK-17211: --- @Himanish - How are you running the spark-

[jira] [Commented] (SPARK-17211) Broadcast join produces incorrect results

[ https://issues.apache.org/jira/browse/SPARK-17211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15435745#comment-15435745 ] Himanish Kushary commented on SPARK-17211: -- I ran the following in a Databricks

[jira] [Commented] (SPARK-17211) Broadcast join produces incorrect results

[ https://issues.apache.org/jira/browse/SPARK-17211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15435516#comment-15435516 ] Dongjoon Hyun commented on SPARK-17211: --- Is there any way to meet that situation wi

[jira] [Commented] (SPARK-17211) Broadcast join produces incorrect results

[ https://issues.apache.org/jira/browse/SPARK-17211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15435512#comment-15435512 ] Dongjoon Hyun commented on SPARK-17211: --- Up to now, this seems to happen in EMR 5.0

[jira] [Commented] (SPARK-17211) Broadcast join produces incorrect results

[ https://issues.apache.org/jira/browse/SPARK-17211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15435490#comment-15435490 ] Himanish Kushary commented on SPARK-17211: -- [~dongjoon] [~jseppanen] I am also s

[jira] [Commented] (SPARK-17211) Broadcast join produces incorrect results

[ https://issues.apache.org/jira/browse/SPARK-17211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15435406#comment-15435406 ] Dongjoon Hyun commented on SPARK-17211: --- Hi, [~jseppanen]. Thank you for the repor