stankiewicz commented on issue #33039:
URL: https://github.com/apache/beam/issues/33039#issuecomment-2538589778
hi,
I assume you have known and limited amount of cells.
To add mentioned filters you need to build a chain:
```
RowFilter chain =
RowFilter.newBuilder().setChain(RowFilter.Chain.newBuilder()
.addFilters(RowFilter.newBuilder().setCellsPerRowLimitFilter(1).build())
.addFilters(RowFilter.newBuilder().setCellsPerRowOffsetFilter(1).build())
.build()).build();
readTransformCell1 =
BigtableIO.read().withInstanceId("instance").withProjectId("project").withRowFilter(chain);
```
You would have to loop through cells offset and then Flatten those
readTransformCellN
You will end up with elements <rowKey, Row with 1 cell> where multiple
elements share same rowKey. Then it's up to you if you want to do group by key
and build back large rows.
If you have unknown number of large cells then I would recommend building a
pipeline that will fetch row keys only, redistribute and write parDo to fetch
cells with similar filters in a loop using regular bigtable client.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscr...@beam.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
