[
https://issues.apache.org/jira/browse/BEAM-7013?focusedWorklogId=285384&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-285384
]
ASF GitHub Bot logged work on BEAM-7013:
----------------------------------------
Author: ASF GitHub Bot
Created on: 31/Jul/19 01:00
Start Date: 31/Jul/19 01:00
Worklog Time Spent: 10m
Work Description: boyuanzz commented on pull request #9144: [BEAM-7013]
Integrating ZetaSketch's HLL++ algorithm with Beam
URL: https://github.com/apache/beam/pull/9144#discussion_r309002553
##########
File path:
sdks/java/core/src/main/java/org/apache/beam/sdk/transforms/ApproximateUnique.java
##########
@@ -42,6 +42,9 @@
/**
* {@code PTransform}s for estimating the number of distinct elements in a
{@code PCollection}, or
* the number of distinct values associated with each key in a {@code
PCollection} of {@code KV}s.
+ *
+ * <p>Consider using {@code HllCount} in the {@code zetasketch} extension
module if you need better
+ * performance or need to save intermediate aggregation result into a sketch
for later processing.
Review comment:
Could you please a code example here about how to use your transform instead
of `ApprocimateUnique` and attach your design doc, especially `Comparison with
existing Beam transforms: ApproximateUnique & ApproximateDistinct` section.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
Issue Time Tracking
-------------------
Worklog Id: (was: 285384)
Time Spent: 3h 40m (was: 3.5h)
> A new count distinct transform based on BigQuery compatible HyperLogLog++
> implementation
> ----------------------------------------------------------------------------------------
>
> Key: BEAM-7013
> URL: https://issues.apache.org/jira/browse/BEAM-7013
> Project: Beam
> Issue Type: New Feature
> Components: extensions-java-sketching, sdk-java-core
> Reporter: Yueyang Qiu
> Assignee: Yueyang Qiu
> Priority: Major
> Fix For: 2.16.0
>
> Time Spent: 3h 40m
> Remaining Estimate: 0h
>
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
