[
https://issues.apache.org/jira/browse/BEAM-12132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17549250#comment-17549250
]
Danny McCormick commented on BEAM-12132:
----------------------------------------
This issue has been migrated to https://github.com/apache/beam/issues/20857
> DataFrame API: Consider allowing partitioning by column in addition to Index
> ----------------------------------------------------------------------------
>
> Key: BEAM-12132
> URL: https://issues.apache.org/jira/browse/BEAM-12132
> Project: Beam
> Issue Type: Improvement
> Components: dsl-dataframe, sdk-py-core
> Reporter: Brian Hulette
> Priority: P3
> Labels: dataframe-api
>
> For some DataFrame use-cases it may be beneficial to partition a dataset
> across the columns as well as across the index.
> One example might be computing a correlation in a DataFrame with a very large
> number of columns. It would be beneficial to be able to perform pairwise
> column correlations on separate workers.
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
