Eugene Kirpichov created BEAM-3425:
--------------------------------------
Summary: CassandraIO fails to estimate size: Codec not found for
requested operation: [varchar <-> java.lang.Long]
Key: BEAM-3425
URL: https://issues.apache.org/jira/browse/BEAM-3425
Project: Beam
Issue Type: Bug
Components: sdk-java-extensions
Reporter: Eugene Kirpichov
Assignee: Jean-Baptiste Onofré
See exception in
https://stackoverflow.com/questions/48090668/how-to-increase-dataflow-read-parallelism-from-cassandra/48131264#48131264
.
The exception comes from
https://github.com/apache/beam/blob/master/sdks/java/io/cassandra/src/main/java/org/apache/beam/sdk/io/cassandra/CassandraServiceImpl.java#L279
, where I suppose "range_start" and "range_end" are really varchar, but the
code expects them to be long.
Indeed they are varchar:
https://github.com/apache/cassandra/blob/4c80eeece37d79f434078224a0504400ae10a20d/src/java/org/apache/cassandra/db/SystemKeyspace.java#L238
and have been for at least the past 3 years.
However really they seem to be storing longs:
https://github.com/apache/cassandra/blob/95b43b195e4074533100f863344c182a118a8b6c/src/java/org/apache/cassandra/hadoop/cql3/CqlInputFormat.java#L229
So I guess all that needs to be fixed is adding a Long.parseLong.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
