PhilipCubix opened a new issue, #9596:
URL: https://github.com/apache/hop/issues/9596

   ### Apache Hop version?
   
   2.20.0
   
   ### Java version?
   
   21.0.13
   
   ### Operating system
   
   Windows
   
   ### What happened?
   
   Hi,
   
   After upgrading to 2.20, we encountered a duplicate output: the group by 
received the same input as before, but it produced the same (correctly grouped) 
row twice.
   
   The pipeline is simple:
   
   1. query database metadata,
   2. group the rows to build column lists for select clauses, conditions for 
where clauses, ... etc (string aggregation was not yet present in the original 
SQL Server version)
   3. distribute the rows from step 2 to 2 parallel "Execute SQL script" 
transforms. There, these rows populate queries with parameters
   
   This duplicate row gave us a problem since the insert statement that was 
populated by this row ran in parallel and caused a primary key constraint 
violation.
   
   As a workaround, we have used SQL Server's String aggregation, but we've had 
to cast input columns to varchar(max) because we'd otherwise run into it's 4000 
nvarchar limit. This error was pretty hard to debug since we had issues 
reproducing it...
   
   We've checked the input: the input was OK. We wrapped the original query and 
left it almost completeley unchanged, we only had to comment out the Order by 
clause.
   
   ### Issue Priority
   
   Priority: 2
   
   ### Issue Component
   
   Component: Transforms


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to