[
https://issues.apache.org/jira/browse/SPARK-21274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16566399#comment-16566399
]
Apache Spark commented on SPARK-21274:
--
User 'dilipbiswal' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-21274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16558687#comment-16558687
]
Apache Spark commented on SPARK-21274:
--
User 'dilipbiswal' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-21274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16553924#comment-16553924
]
Apache Spark commented on SPARK-21274:
--
User 'dilipbiswal' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-21274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16551968#comment-16551968
]
Dilip Biswal commented on SPARK-21274:
--
[~maropu] Thanks a lot for the info.
> Implement EXCEPT
[
https://issues.apache.org/jira/browse/SPARK-21274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16551965#comment-16551965
]
Takeshi Yamamuro commented on SPARK-21274:
--
ok, thanks!
> Implement EXCEPT ALL and INTERSECT
[
https://issues.apache.org/jira/browse/SPARK-21274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16551954#comment-16551954
]
Dilip Biswal commented on SPARK-21274:
--
[~maropu] Hi Takeshi, yeah.. So the code that does the
[
https://issues.apache.org/jira/browse/SPARK-21274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16551921#comment-16551921
]
Takeshi Yamamuro commented on SPARK-21274:
--
Anybody still working on this?
> Implement EXCEPT
[
https://issues.apache.org/jira/browse/SPARK-21274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16467056#comment-16467056
]
Takeshi Yamamuro commented on SPARK-21274:
--
yea, I'm interested in the performance differences
[
https://issues.apache.org/jira/browse/SPARK-21274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16465010#comment-16465010
]
Liang-Chi Hsieh commented on SPARK-21274:
-
[~dkbiswal] No problem. Current EXCEPT ALL rewrite is
[
https://issues.apache.org/jira/browse/SPARK-21274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16465008#comment-16465008
]
Dilip Biswal commented on SPARK-21274:
--
[~viirya] Thank you. I will study this more tomorrow. From a
[
https://issues.apache.org/jira/browse/SPARK-21274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16465000#comment-16465000
]
Liang-Chi Hsieh commented on SPARK-21274:
-
I read the design doc. It looks correct to me. I found
[
https://issues.apache.org/jira/browse/SPARK-21274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16464448#comment-16464448
]
Apache Spark commented on SPARK-21274:
--
User 'dilipbiswal' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-21274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16455734#comment-16455734
]
Dilip Biswal commented on SPARK-21274:
--
[~maropu] Thanks. Yeah.. i will have two separate PRs.
>
[
https://issues.apache.org/jira/browse/SPARK-21274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16455716#comment-16455716
]
Takeshi Yamamuro commented on SPARK-21274:
--
ok, thanks! IMO it'd be better to make separate two
[
https://issues.apache.org/jira/browse/SPARK-21274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16455697#comment-16455697
]
Dilip Biswal commented on SPARK-21274:
--
[~maropu] I am currently testing the code. I will open the
[
https://issues.apache.org/jira/browse/SPARK-21274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16455470#comment-16455470
]
Takeshi Yamamuro commented on SPARK-21274:
--
Looks great to me. I checked the queries above
[
https://issues.apache.org/jira/browse/SPARK-21274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16427689#comment-16427689
]
Dilip Biswal commented on SPARK-21274:
--
Thank you [~smilegator]
Here is the link.
[
https://issues.apache.org/jira/browse/SPARK-21274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16427603#comment-16427603
]
Xiao Li commented on SPARK-21274:
-
[~dkbiswal] [~ioana-delaney] Could you post your design doc here?
>
[
https://issues.apache.org/jira/browse/SPARK-21274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16328028#comment-16328028
]
Takeshi Yamamuro commented on SPARK-21274:
--
yea, I tried though, I couldn't find a rewriting
[
https://issues.apache.org/jira/browse/SPARK-21274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16327453#comment-16327453
]
Reynold Xin commented on SPARK-21274:
-
Can't we rewrite this as two aggregates and a join?
>
[
https://issues.apache.org/jira/browse/SPARK-21274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16326119#comment-16326119
]
Takeshi Yamamuro commented on SPARK-21274:
--
Nobody takes this? If so, I'll do (Probably, this
[
https://issues.apache.org/jira/browse/SPARK-21274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16107749#comment-16107749
]
Ruslan Dautkhanov commented on SPARK-21274:
---
[~viirya], you're right. I've checked now on both
[
https://issues.apache.org/jira/browse/SPARK-21274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105919#comment-16105919
]
Liang-Chi Hsieh commented on SPARK-21274:
-
[~Tagar] I've tried the query on PostgreSQL, the
[
https://issues.apache.org/jira/browse/SPARK-21274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105127#comment-16105127
]
Ruslan Dautkhanov commented on SPARK-21274:
---
[~viirya], yes it returns {noformat}[1, 2,
[
https://issues.apache.org/jira/browse/SPARK-21274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16102969#comment-16102969
]
Liang-Chi Hsieh commented on SPARK-21274:
-
[~Tagar] Is the rewrite of INTERSECT ALL correct?
[
https://issues.apache.org/jira/browse/SPARK-21274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16070982#comment-16070982
]
Ruslan Dautkhanov commented on SPARK-21274:
---
[~rxin], I wish I could. We only use PySpark and
[
https://issues.apache.org/jira/browse/SPARK-21274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16070890#comment-16070890
]
Reynold Xin commented on SPARK-21274:
-
Do you want to submit a pull request?
> Implement EXCEPT ALL
[
https://issues.apache.org/jira/browse/SPARK-21274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16070884#comment-16070884
]
Ruslan Dautkhanov commented on SPARK-21274:
---
For INTERSECT ALL I was also experimenting with
28 matches
Mail list logo