troywinter commented on issue #6848:
URL:
https://github.com/apache/incubator-pinot/issues/6848#issuecomment-828177865
> Good point. We should probably isolate the transform and index and catch
exception separately.
> Does this exception occur multiple times or just once? Is it reproducible?
I need the full stack-trace to identify the issue.
```
java.lang.ClassCastException: java.lang.Integer cannot be cast to
java.lang.String
at
org.apache.pinot.core.data.recordtransformer.SanitizationTransformer.transform(SanitizationTransformer.java:71)
~[pinot-all-0.7.0-SNAPSHOT-jar-with-dependencies.jar:0.7.0-SNAPSHOT-255202ec4fc7df2283f7c275d8e9025a26cf3274]
at
org.apache.pinot.core.data.recordtransformer.CompositeTransformer.transform(CompositeTransformer.java:82)
~[pinot-all-0.7.0-SNAPSHOT-jar-with-dependencies.jar:0.7.0-SNAPSHOT-255202ec4fc7df2283f7c275d8e9025a26cf3274]
at
org.apache.pinot.core.data.manager.realtime.LLRealtimeSegmentDataManager.processStreamEvents(LLRealtimeSegmentDataManager.java:491)
[pinot-all-0.7.0-SNAPSHOT-jar-with-dependencies.jar:0.7.0-SNAPSHOT-255202ec4fc7df2283f7c275d8e9025a26cf3274]
at
org.apache.pinot.core.data.manager.realtime.LLRealtimeSegmentDataManager.consumeLoop(LLRealtimeSegmentDataManager.java:402)
[pinot-all-0.7.0-SNAPSHOT-jar-with-dependencies.jar:0.7.0-SNAPSHOT-255202ec4fc7df2283f7c275d8e9025a26cf3274]
at
org.apache.pinot.core.data.manager.realtime.LLRealtimeSegmentDataManager$PartitionConsumer.run(LLRealtimeSegmentDataManager.java:538)
[pinot-all-0.7.0-SNAPSHOT-jar-with-dependencies.jar:0.7.0-SNAPSHOT-255202ec4fc7df2283f7c275d8e9025a26cf3274]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_275]
```
Here is the full exception from log, it's not from transformation I defined
in the table, but it's from the Sanitization transform for multivalue columns,
the problem is we have mixed multi value mixing string and integer, so a cast
to string will fail.
To properly handle this situation, should we convert value to String not
cast? What do you think?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
