pedroarinto commented on issue #2978: URL: https://github.com/apache/hop/issues/2978#issuecomment-1877468508
I can confirm there is still a problem on 2.7.0 (2023-12-01 10.59.05) When enabling cache on Dimension Lookup/Update, the following error occurs after some records are processed (the number varies): ```2024/01/04 16:44:57 - Actualiza dimensao Artigo.0 - ERROR: Unexpected error 2024/01/04 16:44:57 - Actualiza dimensao Artigo.0 - ERROR: java.lang.RuntimeException: Error serializing row to byte array 2024/01/04 16:44:57 - Actualiza dimensao Artigo.0 - at org.apache.hop.core.row.RowMeta.extractData(RowMeta.java:1148) 2024/01/04 16:44:57 - Actualiza dimensao Artigo.0 - at org.apache.hop.pipeline.transforms.dimensionlookup.DimensionLookup.addToCache(DimensionLookup.java:1566) 2024/01/04 16:44:57 - Actualiza dimensao Artigo.0 - at org.apache.hop.pipeline.transforms.dimensionlookup.DimensionLookup.lookupValues(DimensionLookup.java:705) 2024/01/04 16:44:57 - Actualiza dimensao Artigo.0 - at org.apache.hop.pipeline.transforms.dimensionlookup.DimensionLookup.processRow(DimensionLookup.java:204) 2024/01/04 16:44:57 - Actualiza dimensao Artigo.0 - at org.apache.hop.pipeline.transform.RunThread.run(RunThread.java:55) 2024/01/04 16:44:57 - Actualiza dimensao Artigo.0 - at java.base/java.lang.Thread.run(Thread.java:829) 2024/01/04 16:44:57 - Actualiza dimensao Artigo.0 - Caused by: org.apache.hop.core.exception.HopFileException: 2024/01/04 16:44:57 - Actualiza dimensao Artigo.0 - 2024/01/04 16:44:57 - Actualiza dimensao Artigo.0 - date_from None : Unable to serialize data type 0 2024/01/04 16:44:57 - Actualiza dimensao Artigo.0 - 2024/01/04 16:44:57 - Actualiza dimensao Artigo.0 - ``` With cache disabled the pipeline executes successfully. The date_from field is using the default values (year 1900). I'm using the docker container to execute the pipeline. At first we had converted a Kettle transformation to a Hop pipeline, but we re-wrote the pipeline from scratch to test, with the same results. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
