[
https://issues.apache.org/jira/browse/BEAM-3000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16858727#comment-16858727
]
Robert Bradshaw commented on BEAM-3000:
---------------------------------------
org.apache.beam.sdk.transforms.Sample.any(N) has the same limitations, it's
just implemented as a (non-uniform) FixedSizeGlobally followed by flattening
the iterable out to a PCollection.
> No python equivalent of org.apache.beam.sdk.transforms.Sample.any(100)?
> -----------------------------------------------------------------------
>
> Key: BEAM-3000
> URL: https://issues.apache.org/jira/browse/BEAM-3000
> Project: Beam
> Issue Type: Improvement
> Components: sdk-py-core
> Reporter: Rodrigo Benenson
> Assignee: Pablo Estrada
> Priority: Critical
> Labels: starter
>
> Java's org.apache.beam.sdk.transforms.Sample.any will return a PCollection
> with bounded size (filtering strategy).
> The closest python eqiuvalent is beam.Sample.FixedSizeGlobally(n) whover,
> this version uses a combiner strategy, returning a list with n elements;
> which does not scale if n is "bigger than what fits in memory".
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
