[
https://issues.apache.org/jira/browse/BEAM-2728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16812341#comment-16812341
]
Brachi Packter commented on BEAM-2728:
--------------------------------------
Can I call `ApproximateDistinct.ApproximateDistinctFn` from the apache beam
SQL? with DataFlow runner
{code:java}
events.apply(SqlTransform.query(query).registerUdaf("ApproximateDistinct",
ApproximateDistinct.ApproximateDistinctFn.create(StringUtf8Coder.of()).withSparseRepresentation(16)))
{code}
I got an exception:
{code:java}
java.lang.ClassCastException: class
sun.reflect.generics.reflectiveObjects.TypeVariableImpl cannot be cast to class
java.lang.Class (sun.reflect.generics.reflectiveObjects.TypeVariableImpl and
java.lang.Class are in module java.base of loader 'bootstrap'){code}
> Extension for sketch-based statistics
> -------------------------------------
>
> Key: BEAM-2728
> URL: https://issues.apache.org/jira/browse/BEAM-2728
> Project: Beam
> Issue Type: New Feature
> Components: sdk-java-sketching
> Reporter: Arnaud Fournier
> Assignee: Arnaud Fournier
> Priority: Minor
> Time Spent: 12h 40m
> Remaining Estimate: 0h
>
> Goal : Provide an extension library to compute approximate statistics on
> streams.
> Interest : Probabilistic data structures can create an approximation (sketch)
> of the current state of a stream without storing every element but rather
> processing each observation quickly to summarize its current state and find
> useful statistical insights.
> Implementation is here :
> https://github.com/ArnaudFnr/beam/tree/sketching/sdks/java/extensions/sketching
> More info :
> https://docs.google.com/document/d/1Xy6g5RPBYX_HadpIr_2WrUeusiwL0Jo2ACI5PEOP1kc/edit
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
