Join PCollection Data with HBase Large Data - Suggestion Requested

[Chandan Biswas]

Hello All,
I have a use case where I have PCollection<KV<Key,Value>> data coming from
Kafka source. When processing each record (KV<Key,Value>) I need all old
values for that Key stored in a hbase table. The naive approach is to do
HBase lookup in the DoFn.processElement. I considered sideinput but it' not
going to work because of large dataset. Any suggestion?

Thanks,
Chandan