Eugene Kirpichov created BEAM-3425: -------------------------------------- Summary: CassandraIO fails to estimate size: Codec not found for requested operation: [varchar <-> java.lang.Long] Key: BEAM-3425 URL: https://issues.apache.org/jira/browse/BEAM-3425 Project: Beam Issue Type: Bug Components: sdk-java-extensions Reporter: Eugene Kirpichov Assignee: Jean-Baptiste Onofré
See exception in https://stackoverflow.com/questions/48090668/how-to-increase-dataflow-read-parallelism-from-cassandra/48131264#48131264 . The exception comes from https://github.com/apache/beam/blob/master/sdks/java/io/cassandra/src/main/java/org/apache/beam/sdk/io/cassandra/CassandraServiceImpl.java#L279 , where I suppose "range_start" and "range_end" are really varchar, but the code expects them to be long. Indeed they are varchar: https://github.com/apache/cassandra/blob/4c80eeece37d79f434078224a0504400ae10a20d/src/java/org/apache/cassandra/db/SystemKeyspace.java#L238 and have been for at least the past 3 years. However really they seem to be storing longs: https://github.com/apache/cassandra/blob/95b43b195e4074533100f863344c182a118a8b6c/src/java/org/apache/cassandra/hadoop/cql3/CqlInputFormat.java#L229 So I guess all that needs to be fixed is adding a Long.parseLong. -- This message was sent by Atlassian JIRA (v6.4.14#64029)