[
https://issues.apache.org/jira/browse/BEAM-9825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Darshan Jani updated BEAM-9825:
-------------------------------
Description:
I'd like to propose following new high-level transforms.
* Intersect
Compute the intersection between elements of two PCollection.
Given _leftCollection_ and _rightCollection_, this transform returns a
collection containing elements that common to both _leftCollection_ and
_rightCollection_
* Except
Compute the difference between elements of two PCollection.
Given _leftCollection_ and _rightCollection_, this transform returns a
collection containing elements that are in _leftCollection_ but not in
_rightCollection_
* Union
Find the elements that are either of two PCollection.
Implement IntersetAll, ExceptAll and UnionAll variants of transforms.
was:
I'd like to propose following new high-level transforms.
* Intersect
Compute the intersection between elements of two PCollection.
Given _leftCollection_ and _rightCollection_, this transform returns a
collection containing elements that common to both _leftCollection_ and
_rightCollection_
* Difference
Compute the difference between elements of two PCollection.
Given _leftCollection_ and _rightCollection_, this transform returns a
collection containing elements that are in _leftCollection_ but not in
_rightCollection_
* Commons
Find the elements that are commons to two PCollection, similar like the Unix
comm utility.
Given _leftCollection_ and rightCollection, this transform returns a
CommonsResults with following:
# elements only in _leftCollection_
# elements only in _rightCollection_
# elements in both collections
I would like to work on this changes and submit a PR.
> Transforms for Intersect, IntersectAll, Except, ExceptAll, Union, UnionAll
> --------------------------------------------------------------------------
>
> Key: BEAM-9825
> URL: https://issues.apache.org/jira/browse/BEAM-9825
> Project: Beam
> Issue Type: New Feature
> Components: sdk-java-core
> Reporter: Darshan Jani
> Assignee: Darshan Jani
> Priority: Major
> Original Estimate: 96h
> Remaining Estimate: 96h
>
> I'd like to propose following new high-level transforms.
> * Intersect
> Compute the intersection between elements of two PCollection.
> Given _leftCollection_ and _rightCollection_, this transform returns a
> collection containing elements that common to both _leftCollection_ and
> _rightCollection_
>
> * Except
> Compute the difference between elements of two PCollection.
> Given _leftCollection_ and _rightCollection_, this transform returns a
> collection containing elements that are in _leftCollection_ but not in
> _rightCollection_
> * Union
> Find the elements that are either of two PCollection.
> Implement IntersetAll, ExceptAll and UnionAll variants of transforms.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
