[jira] [Created] (HUDI-6680) Fixing the info log to fetch column value by name instead of index in function filterAndGenerateCheckpointBasedOnSourceLimit

Thu, 10 Aug 2023 13:40:06 -0700 

Lokesh Lingarajan created HUDI-6680:
---------------------------------------

             Summary: Fixing the info log to fetch column value by name instead 
of index in function filterAndGenerateCheckpointBasedOnSourceLimit
                 Key: HUDI-6680
                 URL: https://issues.apache.org/jira/browse/HUDI-6680
             Project: Apache Hudi
          Issue Type: Task
            Reporter: Lokesh Lingarajan


Sometime spark inference engine identifies the cumulative column as type double 
and this causes class cast exception trying to fetch it as Long.

Reference - 
https://github.com/apache/hudi/blob/dcf466fa48c2d54e490255bcb27f58adba7c1583/hudi-utilities/src/main/java/org/apache/hudi/utilities/sources/helpers/IncrSourceHelper.java#L220



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to