V Luong created SPARK-2:
---
Summary: SparkML VectorAssembler.transform slow when needing to
invoke .first() on sorted DataFrame
Key: SPARK-2
URL: https://issues.apache.org/jira/browse/SPARK-2
[
https://issues.apache.org/jira/browse/SPARK-2?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16358599#comment-16358599
]
V Luong commented on SPARK-2:
-
[~cloud_fan] there are many scenarios in which oldDF involves sorting
[
https://issues.apache.org/jira/browse/SPARK-2?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16358634#comment-16358634
]
V Luong commented on SPARK-2:
-
[~cloud_fan] alternatively, is there any way that
[
https://issues.apache.org/jira/browse/SPARK-23467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
V Luong updated SPARK-23467:
Description:
I would like to echo the need described here:
[
https://issues.apache.org/jira/browse/SPARK-23467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
V Luong updated SPARK-23467:
Description:
I would like to echo the need described here:
[
https://issues.apache.org/jira/browse/SPARK-23467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
V Luong updated SPARK-23467:
Description:
I would like to echo the need described here:
V Luong created SPARK-23467:
---
Summary: Enable way to create DataFrame from pre-partitioned files
(Parquet/ORC/etc.) with each in-memory partition mapped to 1 physical file
partition
Key: SPARK-23467
URL:
[
https://issues.apache.org/jira/browse/SPARK-8582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16584726#comment-16584726
]
V Luong commented on SPARK-8582:
hi [~zsxwing], may I check if we're working on resolving this issue? I'm
[
https://issues.apache.org/jira/browse/SPARK-2?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
V Luong resolved SPARK-2.
-
Resolution: Won't Fix
> SparkML VectorAssembler.transform slow when needing to invoke .first() on
>
[
https://issues.apache.org/jira/browse/SPARK-2?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16419745#comment-16419745
]
V Luong commented on SPARK-2:
-
[~bago.amirbekian] thank you, that is indeed a good solution available
10 matches
Mail list logo