[
https://issues.apache.org/jira/browse/BEAM-3446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinay varma updated BEAM-3446:
------------------------------
Description:
Read operation in RedisIO is for prefix based look ups. While this can be used
for exact key matches as well, the number of operations limits the through put
of the function.
I suggest exposing current readAll operation as readbyprefix and using more
simpler operations for readAll functionality.
ex:
{code:java}
String output = jedis.get(element);
if (output != null) {
processContext.output(KV.of(element, output));
}
{code}
instead of:
https://github.com/apache/beam/blob/7d240c0bb171af6868f1a6e95196c9dcfc9ac640/sdks/java/io/redis/src/main/java/org/apache/beam/sdk/io/redis/RedisIO.java#L292
was:
Read operation in RedisIO is for prefix based look ups. While this can be used
for exact key matches as well, the number of operations limits the through put
of the function.
I suggest exposing current readAll operation as readbyprefix and using more
simpler operations for readAll functionality.
ex:
{code:java}
String output = jedis.get(element);
if (output != null) {
processContext.output(KV.of(element, output));
}
{code}
> RedisIO non-prefix read operations
> ----------------------------------
>
> Key: BEAM-3446
> URL: https://issues.apache.org/jira/browse/BEAM-3446
> Project: Beam
> Issue Type: New Feature
> Components: sdk-java-extensions
> Reporter: Vinay varma
> Assignee: Reuven Lax
>
> Read operation in RedisIO is for prefix based look ups. While this can be
> used for exact key matches as well, the number of operations limits the
> through put of the function.
> I suggest exposing current readAll operation as readbyprefix and using more
> simpler operations for readAll functionality.
> ex:
> {code:java}
> String output = jedis.get(element);
> if (output != null) {
> processContext.output(KV.of(element, output));
> }
> {code}
> instead of:
> https://github.com/apache/beam/blob/7d240c0bb171af6868f1a6e95196c9dcfc9ac640/sdks/java/io/redis/src/main/java/org/apache/beam/sdk/io/redis/RedisIO.java#L292
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
