Ismaël Mejía commented on BEAM-4735:

Since Dataflow is the only runner that implements Dynamic Work Rebalancing 
(DWR) once Dataflow supports DWR we can switch HBaseIO to it.

> Make HBaseIO.read() based on SDF by default
> -------------------------------------------
>                 Key: BEAM-4735
>                 URL: https://issues.apache.org/jira/browse/BEAM-4735
>             Project: Beam
>          Issue Type: Improvement
>          Components: io-java-hbase
>            Reporter: Ismaël Mejía
>            Priority: Minor
> BEAM-4020 introduces HBaseIO reads based on SDF. So far the read() method 
> still uses the Source based API because SDF does not support Dynamic Work 
> Rebalancing (DWR) but the Source API of HBase does, so changing it means 
> losing some functionality.
> Since DWR is only supported by Dataflow once Dataflow supports SDF  + DWR we 
> can move the main read() function to use the SDF API and remove the Source 
> based implementation. The rest of the runners already support Bounded based 
> Reads (like HBase based on SDF does) via a default translation without DWR.

This message was sent by Atlassian Jira

Reply via email to