rbrenchley commented on issue #4860: URL: https://github.com/apache/hop/issues/4860#issuecomment-2651048592
Using the database sorting. Mine was pretty simple as I was using this to populate a dimension table. I simply sorted the source landing table and the current dimension table (all from PostgreSQL using the order by statement) to check to see if I had a new value, then I would do a direct insert (with no modifications to the source value). On subsequent calls the merge diff found any string with a non alpha character to be a new field even though the fields were identical and sorted. I'm not sure what was causing the issue, as I examined the strings in the database tables and they were identical. The only thing that worked for me is to remove all non-alpha characters using a regular expression before the comparison and it worked fine. I'm very new to Apache Hop, how is the merge diff doing its compare? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
